- 1Department of Medical and Surgical Sciences and Advanced Technologies “G.F. Ingrassia”, Section of Neurosciences, University of Catania, Catania, Italy
- 2Department of Biomedicine, Neuroscience and Advanced Diagnostics, University of Palermo, Palermo, Italy
- 3Department of Sciences for Health Promotion and Mother-Child Care, University of Palermo, Palermo, Italy
Background: Cognitive impairment in Parkinson’s disease (PD) includes a spectrum varying from Mild Cognitive Impairment (PD-MCI) to PD Dementia (PDD). The main aim of the present study is to evaluate the incidence of PD-MCI, its rate of progression to dementia, and to identify demographic and clinical characteristics which predict cognitive impairment in PD patients.
Methods: PD patients from a large hospital-based cohort who underwent at least two comprehensive neuropsychological evaluations were retrospectively enrolled in the study. PD-MCI and PDD were diagnosed according to the Movement Disorder Society criteria. Incidence rates of PD-MCI and PDD were estimated. Clinical and demographic factors predicting PD-MCI and dementia were evaluated using Cox proportional hazard model.
Results: Out of 139 enrolled PD patients, 84 were classified with normal cognition (PD-NC), while 55 (39.6%) fulfilled the diagnosis of PD-MCI at baseline. At follow-up (mean follow-up 23.5 ± 10.3 months) 28 (33.3%) of the 84 PD-NC at baseline developed MCI and 4 (4.8%) converted to PDD. The incidence rate of PD-MCI was 184.0/1000 pyar (95% CI 124.7–262.3). At multivariate analysis a negative association between education and MCI development at follow-up was observed (HR 0.37, 95% CI 0.15–0.89; p = 0.03). The incidence rate of dementia was 24.3/1000 pyar (95% CI 7.7–58.5). Out of 55 PD-MCI patients at baseline, 14 (25.4%) converted to PDD, giving an incidence rate of 123.5/1000 pyar (95% CI 70.3–202.2). A five time increased risk of PDD was found in PD patients with MCI at baseline (RR 5.09, 95% CI 1.60–21.4).
Conclusion: Our study supports the relevant role of PD-MCI in predicting PDD and underlines the importance of education in reducing the risk of cognitive impairment.
Introduction
Although Parkinson’s Disease (PD) has been classically considered a movement disorder, non-motor symptoms, such as cognitive impairment, represent very common features of the disease (Munhoz et al., 2015). Cognitive impairment encompasses a spectrum varying from Mild Cognitive Impairment (MCI) to dementia, and MCI is considered as an intermediate condition between “normal aging” and dementia (Petersen et al., 2001). This concept was originally used to early capture subjects at risk to develop Alzheimer’s disease (Petersen et al., 2001), and recently was extended and adapted to PD patients (Litvan et al., 2012). While a subtle cognitive impairment configuring MCI in PD (PD-MCI) could be diagnosed even in incident PD, a condition of overt dementia in PD (PDD) usually occurs in advanced stages with a prevalence close to 30% (Aarsland et al., 2017). Several risk factors have been associated with PDD occurrence, including old age at onset, long disease duration, severe motor impairment, and MCI (Hanagasi et al., 2017). Considering that PDD has a substantial negative effect on patient’s well-being and caregiver’s burden, the early detection of patients at risk to develop PDD deserves relevant prognostic and therapeutic implications (Aarsland et al., 2017).
To accurately identifying MCI in subjects with PD, in 2012 a task force of the Movement Disorder Society (MDS) proposed a standardized set of diagnostic criteria to be used both in daily clinical practice and research settings (Litvan et al., 2012). Depending on the comprehensiveness of neuropsychological testing, the MDS criteria provided two different diagnostic levels (i.e., Level I and Level II). Level I criteria allow for the diagnosis of PD-MCI through the administration of an “abbreviated” neuropsychological assessment, while Level II criteria recommend the administration of a “comprehensive” neuropsychological battery which permits the classification of PD-MCI into different subtypes, according to the cognitive domains impaired. Moreover, the identification of PD-MCI subtypes not only increases the diagnostic sensitivity but also allows hypothesizing MCI evolution and prognosis (Litvan et al., 2012). Studies carried out using these criteria have reported frequencies of PD-MCI ranging from 14.8 to 42.5% in patients with newly diagnosed PD (Yarnall et al., 2004; Poletti et al., 2012; Weintraub et al., 2018).
This study is part of The PArkinson’s disease COgnitive impairment Study (PACOS), an observational study involving two centers located in southern Italy (Sicily), aimed to evaluate frequency, clinical features and biomarkers associated with MCI in a large hospital-based cohort of PD patients (Baschi et al., 2018; Monastero et al., 2018). The PACOS cohort included 659 non-demented PD patients. In agreement with other studies, according to the MDS criteria, the prevalence of PD-MCI was 39.6% in the whole sample and 31.7% among newly diagnosed patients (disease duration ≤ 1 year). Amnestic MCI multidomain phenotype was the most frequent subtype recorded in 39.1% of the overall sample and 43.9% in newly diagnosed PD (Monastero et al., 2018).
Although several cross-sectional studies have evaluated the prevalence of cognitive impairment in PD, few longitudinal studies have assessed the incidence of PD-MCI according to the MDS criteria (Broeders et al., 2013; Pedersen et al., 2013, 2017; Domellof et al., 2015; Hobson and Meara, 2015; Pigott et al., 2015; Santangelo et al., 2015; Cholerton et al., 2018). Furthermore, only few studies adopted Level II MDS criteria for PD-MCI (Broeders et al., 2013; Domellof et al., 2015; Santangelo et al., 2015; Cholerton et al., 2018).
The aim of the present study was to evaluate the incidence of PD-MCI and PDD, the rate of progression from PD-MCI to PDD, and to identify demographic and clinical characteristics which predict cognitive impairment in a well-defined cohort of PD patients.
Materials and Methods
Study Population
Patients affected by PD diagnosed according to the Brain Bank criteria (Gibb and Lees, 1988) who attended the Neurologic Unit of the “Policlinico Vittorio Emanuele” in Catania and the Memory and Parkinson’s disease Center of the “Policlinico Paolo Giaccone” in Palermo, over a six-year period (2011–2016), were retrospectively enrolled in the PACOS cohort. The population included 659 non-demented PD subjects at baseline. All participants underwent a standard neurological workup, including a comprehensive neuropsychological assessment. Background and methods have been extensively reported elsewhere (Monastero et al., 2018).
Between 2014 and 2017 we retrospectively enrolled all PD patients who underwent at least two comprehensive neuropsychological evaluations (baseline and follow-up) during a period of maximum 48 months (between 12 and 48). All participants provided written informed consent prior to entering the study, which was approved by the Ethical Committee of the University Hospital of Palermo, P. Giaccone (approval number: 14:03/2018) and was in accordance with the Declaration of Helsinki.
Clinical Assessment
All patients, at baseline and follow-up, underwent a standard neurological examination performed by neurologists experienced in movement disorders. Demographic, clinical and pharmacological data were collected from patient’s medical records. PD severity was evaluated with the Unified Parkinson Disease Rating Scale – Motor Evaluation (UPDRS-ME) and the Hoehn and Yahr (HY) scale. All patients were evaluated in “off” state. The clinical phenotype was attributed according to the classification in Tremor Dominant (TD), Postural Instability Gait Difficulty (PIGD) and Undetermined using scores from part II and III of UPDRS (Jankovic et al., 1990).
Neuropsychological and Behavioral Assessment
All the enrolled patients, at baseline and follow-up, underwent a comprehensive neuropsychological assessment when in “on” state. Neuropsychological evaluations were performed by neurologists with a specific expertise in neuropsychology and dementia, and the same rater performed both baseline and follow-up assessments.
Patients underwent a Level I MDS criteria evaluation of global cognition using the following tests: the Mini Mental State Examination (MMSE) (Folstein et al., 1975), the Montreal Cognitive Assessment (MoCA) (Nasreddine et al., 2005), and the Frontal Assessment Battery (FAB) (Dubois et al., 2000).
According to MDS Level II criteria (Litvan et al., 2012), two tests for cognitive domains have been performed. The memory domain has been assessed with the Rey’s Auditory Verbal Learning Test (Carlesimo et al., 1996) and the Prose recall test with a delayed recall condition (Novelli et al., 1986a); the attention domain with the Stroop color-word test (Uttl and Graf, 1997) and the Trail Making Test part A (TMT-A) (Giovagnoli et al., 1996); the executive function domain with the Verbal fluency letter test (COWAT) (Novelli et al., 1986b) and the Colored Raven’s Progressive Matrices (Carlesimo et al., 1996); the visuo-spatial function domain with the Clock drawing test (CDT) (Shulman, 2000) and the Copy of figures (Carlesimo et al., 1996); lastly, the language domain has been assessed with the Aachener Aphasie Test-Naming item (Luzzatti et al., 1996) and the short version of the Token test (De Renzi and Vignolo, 1962).
For each test, details regarding administration procedures and Italian normative data for score adjustment (based on age, gender and education) were used. Neuropsychological performances were considered as impaired when the subject scored 2 standard deviation (SD) below normality cut-off values.
Mild cognitive impairment was diagnosed when patients scored below the cut-off values in at least two neuropsychological tests. MCI subtypes were defined as follows: amnestic MCI single domain (aMCIsd), when two of the memory tests were altered without impairment of other domains; non-amnestic MCI single domain (naMCIsd), when there were at least two tests altered within one single domain other than memory; amnestic MCI multi domain (aMCImd), when at least one memory test plus at least one test in any other domain were altered; non-amnestic MCI multiple domain (naMCImd), when two tests were altered in two different domains, without the involvement of the memory domain. The diagnosis of probable PDD was made according to the MDS criteria (Emre et al., 2007).
Functional independence was assessed using the Basic Activities of Daily Living (BADL) (Katz et al., 1963) and the Instrumental Activities of Daily Living (IADL) (Hughes et al., 1982). Lastly, Depression was evaluated using the Hamilton Depression Rating Scale, considering a cut-off scores > 9, as suggested by the MDS (Hamilton, 1960; Schrag et al., 2007).
Statistical Analysis
Data were analyzed using STATA 12.1 software packages (StataCorp, College Station, TX, United States). Data cleaning was performed before the data analysis considering both range and consistence checks. Quantitative variables were described using mean and standard deviation. The difference between means and proportions was evaluated by the t-test and the Chi square test, respectively. In case of a not normal distribution, appropriate non-parametric tests were performed.
To calculate incidence rates of PD-MCI and PDD, we divided the number of cases with PD-MCI or PDD by the total number of person-years at risk during follow-up. We estimated person-years at risk (pyar) as the total follow-up time until PD-MCI or PDD. For incident PDD cases, we assigned time of dementia onset to the midpoint of the interval between assessments at which dementia was diagnosed. Because PD-MCI, in contrast to PDD, may be reversible or fluctuate over time, we set time of onset of incident PD-MCI to the exact date at which PD-MCI was first diagnosed. Incidence rates were also estimated considering only newly diagnosed patients (disease duration ≤ 1 year).
Kaplan–Meier survival analysis was carried out to estimate the cumulative proportion from normal cognition to any cognitive impairment (MCI or dementia) as well as the progression rate from MCI to dementia. The log-rank test was used to compare survival curves.
In order to identify possible predictors associated with the probability of progression from normal cognition to any cognitive impairment (MCI or Dementia) among the clinical and demographic characteristics, Cox proportional-hazards regression model was used for both the univariate and multivariate analyses. Variables with p-value < 0.1 at univariate analysis were included in the final multivariate Cox models. Schoenfeld residuals test was used for testing the proportional hazard. 95% confidence interval (CI), and p-value (two-tailed test, a = 0.05) were calculated. Analysis was also restricted to newly diagnosed PD patients.
Whenever variables were dichotomized or polychotomized, the cut-offs were derived from the pooled distribution of cases and control subjects (e.g., using the median value). To evaluate the role of dopaminergic therapy the levodopa equivalent daily dose (LED) was calculated for those patients taking dopamine agonists or levodopa in combination with dopamine agonists (Tomlinson et al., 2010).
Results
The PACOS cohort consists of 659 non-demented PD patients (Monastero et al., 2018). Of 659 subjects, 139 PD patients (men 87, 62.6%) with a mean disease duration of 3.0 ± 2.8 years who underwent at least two neuropsychological evaluations between 12 and 48 months from 2014 to 2017 were enrolled in the present study. No significant differences in demographic and clinical characteristics were found between groups, apart from a borderline significant difference in disease duration between the two groups (see Supplementary Table S1). Of the 139 patients at baseline (first neuropsychological evaluation), 84 (60.4%) were classified as PD-NC, while 55 (39.6%) fulfilled the diagnosis of PD-MCI. Concerning the MCI subtypes, 4 (7.3%) patients had aMCIsd, 28 (50.9%) aMCImd, 12 (21.8%) naMCIsd and 11 (20.0%) naMCImd. Fifty-three (38.1%) of the 139 PD patients were newly diagnosed patients with a disease duration ≤ 1 year and of these 20 (37.7%) were classified as PD-MCI at the baseline evaluation. Baseline characteristics are shown in Table 1.
Incidence of MCI
Considering the 84 PD-NC at baseline, 28 (33.3%) fulfilled the diagnosis of PD-MCI, while 4 (4.8%) fulfilled the diagnosis of PDD at follow-up (mean follow-up time 23.5 ± 10.3 months). A slightly longer and borderline significant follow-up time was recorded among PD patients who developed MCI (25.7 ± 9.8 versus 21.3 ± 9.7 months; p-value 0.05), while a significantly longer follow-up was observed in the four patients who developed PDD (38.0 ± 9.6 months; p-value 0.004).
Regarding the MCI subtypes, 3 (10.7%) out of the 28 patients developed an aMCIsd, 8 (28.6%) naMCIsd, 10 (35.7%) aMCImd and 7 (25.0%) naMCImd. The incidence rate of MCI among PD-NC at baseline was 184.0/1000 pyar (95% CI 124.7–262.3) (total person time at risk 152.2 years), without significant difference between sex [185.6/1000 pyar for men and 181.2/1000 pyar for women; relative risk (RR) 1.02, 95% CI 0.45–2.48; p = 0.5] (see Figure 1).
Out of the 84 PD-NC, 33 (39.3%) were newly diagnosed patients and of these 10 (30.3%) developed PD-MCI at follow-up. The incidence of MCI in newly diagnosed patients was 155.8/1000 pyar (95% CI 79.1–277.6) (total person time at risk 64.2 years). There was no significant difference between the incidence in the whole cohort and the incidence rate of newly diagnosed PD patients (RR 1.18, 95% CI 0.56–2.73; p = 0.3).
At univariate Cox proportional-hazards regression models, PD patients who developed MCI at follow-up were significantly older and with a lower level of education compared to those who preserved normal cognition (see Table 2). Multivariate analysis confirmed the strong protective effect of education in the development of MCI at follow-up with a Hazard Ratio (HR) of 0.37 for PD patients with more than 8 years of schooling (95% CI 0.15–0.89; p = 0.03) (see Table 2).
According to Kaplan–Meier survival analysis, 94.8% (95% CI 91.3–99.8) of PD patients were free of MCI at 1 year of follow-up, 73.8% (95% CI 59.9–83.5) at 2 years of follow-up and 45.3% (95% CI 27.8–61.2) at 3 years as shown in Figure 2A. Close rates have been recorded when analysis was restricted to newly diagnosed patients [90.7% (95% CI 73.1–96.8) were free of MCI at 1 year, 76.7% (95% CI 54.5–89.0) at 2 years and 39.4% (95% CI 13.6–64.8) at 3 years]. A significant difference in survival curves, according to the log-rank test, has been found by age (>66 years and <66 years; p = 0.007) and education (years of schooling >8 years and <8 years; p = 0.008) as shown in Figures 3A,B.
Figure 2. Kaplan–Meier survival analysis of PD-NC at baseline who developed PD-MCI at follow-up (A) and survival estimates of PD-MCI who developed PDD at follow-up (B).
Figure 3. Kaplan–Meier survival estimates of PD-NC at baseline who developed PD-MCI at follow-up by age (A: Log rank test p-value 0.007) and education (B: Log rank test p-value 0.008).
Four of the 84 PD-NC developed dementia, giving an incidence rate of 24.3/1000 pyar (95% CI 7.7–58.5) (total person time at risk 164.8). These 4 patients presented a significantly higher UPDRS-ME (42.0 ± 21.5 versus 24.5 ± 13.7; p = 0.01) and a lower, although not significant, educational level (mean years of schooling 6.7 ± 4.5 versus 9.5 ± 3.5; p = 0.2).
Incidence of PDD
Considering the entire sample of 139 PD patients, 18 fulfilled the diagnosis of PDD at follow-up (mean follow-up time 24.0 ± 10.2 months). A significantly longer follow-up time was recorded among PD patients who developed PDD (29.0 ± 11.1 months versus 23.3 ± 9.9 months; p-value 0.02). The incidence rate of PDD was 64.7/1000 pyar (95% CI 39.5–100.3) (total person-time at risk 278.2 years) with three times higher risk for men (70.1/1000 pyar for men and 56.1.0/1000 pyar for women; RR 3.2, 95% CI 1.11–10.4; p = 0.009).
Fifty-three (38.1%) of the 139 PD patients were newly diagnosed patients, of whom (11.3%) developed PDD with an incidence rate of 53.3/1000 pyar (95% CI 21.6–110.8) (total person time at risk 112.6 years). No significant difference has been recorded between the incidence in the whole cohort and incidence rate among the newly diagnosed PD patients (RR 1.21, 95% CI 0.46–3.73; p = 0.3).
At univariate analysis, Cox proportional-hazards regression model, PD patients who developed PDD at follow-up were significantly older, with a borderline but significantly higher UPDRS-ME score and a significantly lower education level compared to subjects who do not developed dementia (see Table 3). At univariate analysis the presence of MCI at baseline was the most important factor associated with the development of PDD (univariate HR 4.37, 95% CI 1.42–13.5; p = 0.01). This association was even stronger at multivariate analysis adjusting by age, sex (a priori confounder), UPDRS-ME and education (HR 6.24, 95% CI 1.81–21.5; p = 0.004).
According to Kaplan–Meier survival analysis, 99.2% (95% CI 94.7–99.9) PD-MCI were free of dementia at 1 year of follow-up, 91.0% (95% CI 82.5–95.5) at 2 years, and 75.7% (95% CI 59.8–86.0) at 3 years (Figure 2B). A significant difference in survival curves was observed after stratifying for the presence of MCI at baseline (p = 0.005) and education (years of schooling > 8 years and ≤ 8 years; p = 0.04) as shown in Figures 4A,B. In particular, according to Kaplan–Meier survival analysis among PD-NC at baseline, the 100% were free of dementia at 1 and 2 years of follow-up, and 92.5% (95% CI 72.8–98.1) at 3 years. Considering PD-MCI patients, 98.1% (95% CI 87.1–99.7) were free of dementia at 1 year, 79.7% (95% CI 63.2–89.4) at 2 years, and only 55.0% (95% CI 28.2–75.4) at 3 years (Figure 4A).
Figure 4. Kaplan–Meier survival estimates of patients who developed PDD at follow-up by the presence of MCI at follow-up (A: Log rank test p-value 0.004) and years of schooling (B: Log rank test p-value 0.005).
Concerning the MCI subtypes, 14 out of the 18 patients who developed PDD had MCI at baseline; of these 12 (85.7%) were classified as MCI multi-domain (8 aMCImd and 4 naMCImd). A higher risk of developing PDD was recorded for those patients who had naMCImd at baseline with an adjusted HR of 21.1 (95% CI 3.89–114.7; p < 0.0001), followed by aMCImd (adjusted HR 8.70, 95% CI 2.01–38.0; p = 0.004). Overall, the risk of PDD was higher among patients with mdMCI, compared to those with sdMCI as shown in Table 4.
Concerning the five different domains evaluated, in our sample a higher risk of dementia was recorded among PD patients presenting at least one impaired test in executive function at the baseline evaluation (HR 7.76, 95% CI 2.31–5.64; p = 0.001), followed by attention (HR 4.75, 95% CI 1.44–15.6; p = 0.01). Due to the presence of just two PD patients who presented an impaired language at baseline (one developed dementia at follow-up and one did not) with the consequent wide 95% CIs, the role of this domain is difficult to evaluate as shown in Table 4.
Progression From MCI to PDD
Considering only the 55 patients with PD-MCI at baseline, 14 (25.4%) developed PDD at follow-up (mean follow-up time 24.7 ± 10.0 months), while 9 (16.3%) reverted to PD-NC. The incidence rate of PDD in patients with MCI at baseline was 123.5/1000 pyar (95% CI 70.3–202.2) (total person-time at risk 113.4), while the incidence rate of PDD among PD-NC at baseline was 24.3/1000 (95% CI 7.7–58.5), giving a RR of 5.09 (95% CI 1.60–21.4; p = 0.0009).
Of the 9 reverters, 3 (33.3%) were aMCIsd, 4 (44.4%) were aMCImd and 2 (22.2%) were naMCImd (see Figure 1). No significant differences regarding clinical and demographic characteristics at baseline between reverters and PD-MCI, irrespective of whether the patients developed PDD or not, were found.
Discussion
In the present study we evaluated the incidence rate of PD-MCI and PDD and the risk of progression from PD-MCI to dementia in the PACOS cohort. At follow-up more than 33% of PD-NC at baseline developed MCI with an incidence rate of 184.0/1000 pyar, while more than 12% converted to PDD with an incidence rate of 24.3/1000 pyar. Conversely, the incidence rate of PDD among patients with MCI at baseline was 123.5/1000 pyar, giving a five time increased risk of developing dementia. Lastly, a significant negative association between education and PD-MCI was observed. PD-NC who converted to PD-MCI at follow-up were significantly less educated than non-converters. Moreover, the presence of MCI at baseline, in particular the naMCImd subtype, was strongly associated with PDD conversion, increasing the risk of dementia more than five times.
Mild cognitive impairment is considered an intermediate state between normal cognitive aging and early dementia. Several cross-sectional studies, the majority of which are multicenter studies, have been carried out to evaluate the prevalence of MCI during the last decade reporting ratios ranging from 18.9 to 35.2% (Foltynie et al., 2004; Aarsland et al., 2009). Differences in study designs, the definition of PD-MCI and the neuropsychological assessment adopted have greatly contributed to the wide variations in the reported estimates of PD-MCI. However, a high variability has also been reported across studies using the MDS criteria (Litvan et al., 2012) with MCI prevalence ranging from 20 to 41% (Broeders et al., 2013; Domellof et al., 2015; Pedersen et al., 2017; Weintraub et al., 2018). In agreement with these studies, in the PACOS cohort the prevalence of PD-MCI was 39.1% and MCI was associated with age and motor scores while a strong negative association was observed with educational level (Monastero et al., 2018).
Nonetheless, few prospective studies based on the MDS criteria for PD-MCI (Litvan et al., 2012) and PDD (Emre et al., 2007) have been performed until now, in order to evaluate the progression from normal cognition to MCI and the incidence of dementia (Broeders et al., 2013; Domellof et al., 2015; Pigott et al., 2015; Santangelo et al., 2015; Pedersen et al., 2017; Cholerton et al., 2018). Of these, four studies (Broeders et al., 2013; Domellof et al., 2015; Santangelo et al., 2015; Cholerton et al., 2018) have adopted Level II MDS criteria for the diagnosis of PD-MCI.
Progression From Normal Cognition to MCI
Throughout the entire sample of 139 non-demented PD patients, the prevalence of PD-MCI at baseline was 44.6% and 39.2% considering only newly diagnosed patients; these rates were close to those reported for the whole PACOS cohort (Monastero et al., 2018), as well as those regarding other studies (Broeders et al., 2013; Domellof et al., 2015; Santangelo et al., 2015).
A lower frequency of MCI at baseline (20.2%) was reported in the Norwegian study (Pedersen et al., 2017), while the study by Cholerton et al. (2018) reported a higher prevalence of MCI. The latter result is probably due to the lower cut-off point used for the impairment on specific neuropsychological test (1 SD below normative data).
According to literature data, the most frequent type of MCI at baseline was the multiple domain (Santangelo et al., 2015), both amnestic and non-amnestic, representing the 49.1% and 20.0%, respectively.
At follow-up, 33.3% of PD-NC at the baseline developed MCI and considering only the newly diagnosed patients the frequency was 30.3%. These similar rates probably account for the short disease duration and mild motor impairment of the patients enrolled in the study. To the best of our knowledge, incidence rate of MCI among PD-NC was estimated only for the Norwegian study (Pedersen et al., 2017) where an incidence rate of 68.9/1000 pyar was recorded. This rate was lower with respect to our study, but it should be underlined that also a lower frequency of MCI at baseline was reported.
The results of survival analysis have demonstrated that approximately 5% of PD-NC developed MCI at 1 year, 26% at 2 years; these estimates are close to those reported by previous longitudinal studies conducted on PD-MCI, which had adopted MDS Level II criteria (Broeders et al., 2013; Santangelo et al., 2015; Pedersen et al., 2017). Nonetheless, approximately 55% of PD-NC developed MCI at 3 years, an estimate which is slightly higher than those reported in the literature (Broeders et al., 2013; Pigott et al., 2015; Pedersen et al., 2017). This difference can be in part explained by the enrolment of PD patients with a disease duration (mean disease duration: about 3 years) which is slightly longer than other cohorts (Broeders et al., 2013; Santangelo et al., 2015; Pedersen et al., 2017). At any rate when survival analysis was restricted to newly diagnosed patients close rates were found. Furthermore, it should be noted that PD patients enrolled in the present study had a lower educational level compared with other cohorts (Pigott et al., 2015; Santangelo et al., 2015; Pedersen et al., 2017) and this lower educational level probably contributed to a higher risk of developing MCI. Indeed, in agreement with these prospective studies (Santangelo et al., 2015; Pedersen et al., 2017), a strong protective effect of education was recorded with an almost 70% reduced risk of MCI in patients with more than 8 years of schooling.
Progression From PD-NC and PD-MCI to Dementia
Incidence rate of PDD in the whole cohort (PD-NC and PD-MCI) was 64.7/1000 pyar and 53.3/1000 pyar among newly diagnosed patients. Again, the lack of differences between the whole sample and the newly diagnosed patients is probably due to the short disease duration of the entire sample. Only two prospective studies have evaluated the incidence rate of PDD reporting similar estimates. In particular, a close rate of 62.6/1000 pyar has been reported by Domellof et al. (2015), while a slightly lower rate of 38.1/1000 pyar was found in the Norwegian cohort (Pedersen et al., 2017). Nonetheless, comparison with this latter study is limited by the lower frequency of MCI reported at baseline (20.2%).
A significantly higher incidence rate of PDD was recorded among PD-MCI at baseline with respect to PD-NC, resulting in a five time increased risk of PDD among PD-MCI. Only two prospective studies based on MDS criteria, have evaluated the incidence rate of PDD among PD-NC patients and patients with MCI at baseline, both reporting very close results. In particular, similar rates were reported by Domellof et al. (2015) where the incidence rate of PDD was 18.8/1000 pyar among PD-NC and 142/1000 pyar among PD-MCI at baseline, leading to a 6.5 times increased risk of developing dementia among patients with MCI at baseline. Close results have also been reported in the Norwegian cohort, where incidence rate of PDD among PD patients presenting MCI at baseline was 120.8/1000 pyar, while the incidence in the whole cohort was 38.1/1000 pyar (Pedersen et al., 2017). A clear contribution of PD-MCI to the hazard of PDD was finally reported by an international study including longitudinal data from four different cohorts assessing cognition according to MDS Level II criteria. In this very recent study, only 6.4% of PD-NC developed dementia, while 50% of the PD-MCI group developed PDD (Hoogland et al., 2017). In agreement with previous studies (Domellof et al., 2015; Hoogland et al., 2017; Pedersen et al., 2017), the presence of MCI at baseline in the present study was the main predictor of PDD regardless of age, sex, educational level, and motor impairment as demonstrated by multivariate analysis.
In agreement with previous reports (Domellof et al., 2015; Pigott et al., 2015), in our cohort the risk of PDD was significantly associated with older age and motor impairment (borderline significant) at univariate analysis, and inversely associated with educational level. Of interest, at multivariate analysis and except for the presence of MCI at baseline, only motor impairment (UPDRS–ME) was still significantly associated with the risk of developing dementia.
In our study a three times increased risk of dementia among men (70.1/1000 pyar versus 56.1.0/1000 pyar) was found. The role of gender in the risk of cognitive impairment in PD is still debated, although several studies have suggested that male gender is a risk factor (Picillo et al., 2017). In a large multicenter case-control study, conducted in central-southern Italy, the association between PD and cognitive impairment was stronger among men compared to women (adjusted OR 5.44 for men and 2.82 for women) (Nicoletti et al., 2017). Nonetheless, and considering longitudinal studies, only a few studies have demonstrated a high risk of PDD among men (Pigott et al., 2015; Cholerton et al., 2018) and in particular in a recent study the principal predictive factor in the transition from PD-NC to PD-MCI or PDD was male sex with an OR of 4.47 (Cholerton et al., 2018).
Regarding the impact of specific MCI subtypes and cognitive domain in the progression from PD-NC to PD-MCI and dementia, naMCImd was the most important predictor of PDD after multivariate regression analysis, followed by aMCImd. To the best of our knowledge, none of the prospective studies based on MDS Level II criteria for the diagnosis of MCI have evaluated the role of the different MCI subtypes as a predictor for PDD development. Concerning specific cognitive domains (at least one impaired test at the baseline evaluation), executive functions and attention were strongly associated with the development of PDD. To date there has been no agreement regarding which type of impaired cognitive domain is a predictor of PDD. Indeed, according to the “dual syndrome hypothesis,” the impaired “cholinergic” visuo-spatial domain was more likely to evolve into later dementia, while the “dopaminergic” executive dysfunction was not (Kehagia et al., 2013). On the other hand, a recent study has confirmed the role of the cholinergic system in the maintenance of attention and executive functions as well (Lee et al., 2014). These neuroanatomical bases could support the role of the executive dysfunction as a significant predictor of PDD, as previously reported (Levy et al., 2002; Chung et al., 2017) and confirmed by our study.
The presence of at least one impaired test in the language domain in the present study was also strongly related to the development of PDD. However, it should be noted that only two subjects, both classified as PD-MCI at baseline, were impaired in the language domain, and only one developed PDD at follow-up. Accordingly, we believe that accuracy of this finding is questionable as confirmed by the wide CIs obtained. Furthermore, the frequency of the impairment of the language domain is generally rather low in subjects with PD-MCI (Santangelo et al., 2015).
According to previous reports, about 10% of patients classified as PD-MCI reverted to normal cognition over a period of years (Koepsell and Monsell, 2012). A possible explanation for this “inconstant” cognitive impairment could be: the effects of practice-related learning, normal fluctuation in cognition, depression, poor motivation, mild psychiatric symptoms, other medical condition or daytime sleepiness (Koepsell and Monsell, 2012). This complex and sometimes fluctuating course of cognitive impairment in PD increases the diagnostic uncertainly of the PD-MCI construct. In this study nine (16%) PD-MCI at baseline reverted to NC at follow-up. In non-PD patients, almost 40% MCI patients reverted to normal cognition during follow-up. Non-amnestic MCI and, more generically, single domain MCI have been reported to revert with high frequency (Roberts et al., 2014). Reversion in our cohort was not associated with a specific MCI subtype, although the small number of reverters does not provide accurate estimates.
Although the data presented in this paper relating to the incidence of PD-MCI and the progression from PD-MCI to PDD are close to those reported by other studies, comparisons should be interpreted with caution. Indeed, a wide variation in estimates has been reported by studies which used the MDS criteria. This variability in estimates should not only be due to the different study design: prevalent (Pigott et al., 2015) versus incident cases (Broeders et al., 2013; Domellof et al., 2015; Santangelo et al., 2015; Pedersen et al., 2017); population-based (Domellof et al., 2015; Pedersen et al., 2017) versus hospital-based (Broeders et al., 2013; Pigott et al., 2015; Santangelo et al., 2015), but also to the different level of the MDS criteria adopted [Level I criteria (Hobson and Meara, 2015; Pigott et al., 2015; Pedersen et al., 2017) versus Level II criteria (Broeders et al., 2013; Domellof et al., 2015; Santangelo et al., 2015; Cholerton et al., 2018)]. Furthermore, the different neuropsychological assessment adopted to evaluate cognitive impairment in PD may also account for the variability in estimates. Lastly, another relevant source of variability related to the MDS criteria, is the possibility of using different cut-off levels to consider a test as impaired. Indeed, the MDS has proposed a range of cut-off scores (1 and 2 Standard Deviations below normative data), but the choice of cut-offs levels impacts on prevalence estimates (Roberts et al., 2014).
The major strength of our study lies in the large cohort size of the PACOS study at baseline (Monastero et al., 2018), that allowed us to identify several non-demented PD patients, suitable to be re-evaluated at follow-up. Furthermore, a comprehensive neuropsychological assessment was used, fulfilling the requirements of Level II MDS criteria. Lastly, we used a cut-off score of 2 SD which produces reliable sensitivity and specificity levels, and its use in this field is, therefore, recommended (Goldman et al., 2013).
Nonetheless, several limits should be taken into account in interpreting our data. First, a possible selection bias cannot be excluded due to the hospital-based study design. Regarding other hospital-based cohorts (Foltynie et al., 2004; Aarsland et al., 2009; Hoogland et al., 2017), the presence of more severe cases attending the two hospital centers involved in the study cannot be excluded, and this may possibly have contributed to the high estimate of MCI at baseline. Nonetheless and, as previously reported (Monastero et al., 2018), the average HY score and the short disease duration recorded in the PACOS cohort have revealed a mild to moderate stage of disease. Second, although analyses were adjusted for major potential confounders, residual confounding (e.g., medical and neuropsychiatric comorbidity, the use of psychotropic drugs) cannot be excluded. Lastly, due to the small samples of some of the MCI subtypes in our longitudinal analysis, our results need to be confirmed and strengthened in larger cohorts.
In conclusion, despite the difference sources of variability across the few prospective studies conducted in PD-MCI based on MDS criteria, our data are in line with those previously reported. This supports the relevant role of MCI in the risk of developing dementia in PD patients and it underlines the importance of education in reducing the risk of cognitive impairment. Furthermore, the results of the present study may have relevant clinical and therapeutic implications. Indeed, considering the high risk of developing dementia, PD-MCI patients should be carefully monitored in order to benefit from both early pharmacological (Mamikonyan et al., 2015) and non-pharmacological interventions (Dibilio et al., 2017). Prospective data relating to large populations are required to confirm the risk of cognitive impairment in male subjects with PD, in addition to the specific cognitive phenotype, which is associated with the PD progression to MCI and dementia.
Author Contributions
AN designed and conceptualized the study, analyzed and interpreted the data, and drafted the manuscript for intellectual content. AL collected and interpreted the data, and drafted the manuscript for intellectual content. RB and CEC collected the data and revised the manuscript for intellectual content. GM, MD, LP, VR and MZ interpreted the data and revised the manuscript for intellectual content. RM designed and conceptualized the study, interpreted the data, and drafted the manuscript for intellectual content. All authors approved the final manuscript.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fnagi.2019.00021/full#supplementary-material
References
Aarsland, D., Bronnick, K., Larsen, J., Tysnes, O. B., and Alves, G. (2009). Norwegian parkwest study group, cognitive impairment in incident, untreated Parkinson disease: the norwegian parkwest study. Neurology 72, 1121–1126. doi: 10.1212/01.wnl.0000338632.00552
Aarsland, D., Creese, B., Politis, M., Chaudhuri, K. R., Ffytche, D. H., Weintraub, D., et al. (2017). Cognitive decline in Parkinson disease. Nat. Rev. Neurol. 4, 217–231. doi: 10.1038/nrneurol.2017.27
Baschi, R., Nicoletti, A., Restivo, V., Recca, D., Zappia, M., and Monastero, R. (2018). Frequency and correlates of subjective memory complaints in Parkinson’s disease with and without mild cognitive impairment: data from the Parkinson’s disease cognitive impairment study. J. Alzheimers Dis. 63, 1015–1024. doi: 10.3233/JAD-171172
Broeders, M., de Bie, R. M., Velseboer, D. C., Speelman, J. D., Muslimovic, D., and Schmand, B. (2013). Evolution of mild cognitive impairment in Parkinson disease. Neurology 81, 346–352. doi: 10.1212/WNL.0b013e31829c5c86
Carlesimo, G. A., Caltagirone, C., and Gainotti, G. (1996). The mental deterioration battery: normative data, diagnostic reliability and qualitative analyses of cognitive impairment. The group for the standardization of the mental deterioration battery. Eur. Neurol. 36, 378–384. doi: 10.1159/000117297
Cholerton, B., Johnson, C. O., Fish, B., Quinn, J. F., Chung, K. A., Peterson-Hiller, A. L., et al. (2018). Sex differences in progression to mild cognitive impairment and dementia in Parkinson’s disease. Parkinsonism Relat. Disord. 50, 29–36. doi: 10.1016/j.parkreldis.2018.02.007
Chung, S. J., Shin, J. H., Cho, K. H., Lee, Y., Sohn, Y. H., Seong, J. K., et al. (2017). Subcortical shape analysis of progressive mild cognitive impairment in Parkinson’s disease. Mov. Disord. 32, 1447–1456. doi: 10.1002/mds.27106
De Renzi, E., and Vignolo, L. A. (1962). The token test: a sensitive test to detect receptive disturbances in aphasia. Brain 85, 665–678. doi: 10.1093/brain/85.4.665
Dibilio, V., Nicoletti, A., Mostile, G., Portaro, G., Luca, A., Patti, F., et al. (2017). Computer-assisted cognitive rehabilitation on freezing of gait in Parkinson’s disease: a pilot study. Neurosci. Lett. 654, 38–41. doi: 10.1016/j.neulet.2017.06.006
Domellof, M. E., Ekman, U., Forsgren, L., and Elgh, E. (2015). Cognitive function in the early phase of parkinson’s disease, a five-year follow-up. Acta Neurol. Scand. 132, 79–88. doi: 10.1111/ane.12375
Dubois, B., Slachevsky, A., Litvan, I., and Pillon, B. (2000). The FAB: frontal assessment battery at bedside. Neurology 55, 1621–1626. doi: 10.1212/WNL.55.11.1621
Emre, M., Aarsland, D., Brown, R., Burn, D. J., Duyckaerts, C., Mizuno, Y., et al. (2007). Clinical diagnostic criteria for dementia associated with Parkinson’s disease. Mov. Disord. 22, 1689–1707. doi: 10.1002/mds.21507
Folstein, M. F., Folstein, S. E., and McHugh, P. R. (1975). ‘Mini-mental state’: a practical method for grading the cognitive state of patients for the clinician. J. Psychiatr. Res. 12, 189–198. doi: 10.1016/0022-3956(75)90026-6
Foltynie, T., Brayne, C. E., Robbins, T. W., and Barker, R. A. (2004). The cognitive ability of an incident cohort of Parkinson’s patients in the UK. The CamPaIGN study. Brain 127, 550–560.
Gibb, W. R., and Lees, A. J. (1988). The relevance of the lewy body to the pathogenesis of idiopathic Parkinson’s disease. J. Neurol. Neurosurg. Psychiatry 51, 745–752. doi: 10.1136/jnnp.51.6.745
Giovagnoli, A. R., Del Pesce, M., Mascheroni, S., Simoncelli, M., Laiacona, M., and Capitani, E. (1996). Trail making test: normative values from 287 normal adult controls. Ital. J. Neurol. Sci. 1996, 305–309. doi: 10.1007/BF01997792
Goldman, J. G., Holden, S., Bernard, B., Ouyang, B., Goetz, C. G., and Stebbins, G. T. (2013). Defining optimal cutoff scores for cognitive impairment using movement disorder society task force criteria for mild cognitive impairment in Parkinson’s disease. Mov. Disord. 28, 1972–1979. doi: 10.1002/mds.25655
Hamilton, M. (1960). A rating scale for depression. J. Neurol. Neurosurg. Psychiatry 23, 56–62. doi: 10.1136/jnnp.23.1.56
Hanagasi, H. A., Tufekcioglu, Z., and Emre, M. (2017). Dementia in Parkinson’s disease. J. Neurol. Sci. 374, 26–31. doi: 10.1016/j.jns.2017.01.012
Hobson, P., and Meara, J. (2015). Mild cognitive impairment in Parkinson’s disease and its progression onto dementia: a 16-year outcome evaluation of the denbighshire cohort. Int. J. Geriatr. Psychiatry 30, 1048–1055. doi: 10.1002/gps.4261
Hoogland, J., Boel, J., de Bie, R., Geskus, R. B., Schmand, B. A., Dalrymple-Alford, J. C., et al. (2017). Mild cognitive impairment as a risk factor for Parkinson’s disease dementia. Mov. Disord. 32, 1056–1065. doi: 10.1002/mds.27002
Hughes, C. P., Berg, L., Danziger, W. L., Coben, L. A., and Martin, R. L. (1982). A new clinical scale for the staging of dementia. Br. J. Psychiatry 140, 566–572. doi: 10.1192/bjp.140.6.566
Jankovic, J., McDermott, M., Carter, J., Gauthier, S., Goetz, C., Golbe, L., et al. (1990). Variable expression of Parkinson’s disease: a base-line analysis of the datatop cohort. The parkinson study group. Neurology 40, 1529–1534. doi: 10.1212/WNL.40.10.1529
Katz, S., Ford, A. B., Moskowitz, R. W., Jackson, B. A., and Jaffe, M. W. (1963). Studies of illness in the aged. the index of ADL: a standardized measure of biological and psychosocial function. JAMA 185, 914–919. doi: 10.1001/jama.1963.03060120024016
Kehagia, A. A., Barker, R. A., and Robbins, T. W. (2013). Cognitive impairment in Parkinson’s disease: the dual syndrome hypothesis. Neurodegener. Dis. 11, 79–92. doi: 10.1159/000341998
Koepsell, T. D., and Monsell, S. E. (2012). Reversion from mild cognitive impairment to normal or near-normal cognition: risk factors and prognosis. Neurology 79, 1591–1598. doi: 10.1212/WNL.0b013e31826e26b7
Lee, J. E., Cho, K. H., Song, S. K., Kim, H. J., Lee, H. S., Sohn, Y. H., et al. (2014). Exploratory analysis of neuropsychological and neuroanatomical correlates of progressive mild cognitive impairment in Parkinson’s disease. J. Neurol. Neurosurg. Psychiatry 85, 7–16. doi: 10.1136/jnnp-2013-305062
Levy, G., Jacobs, D. M., Tang, M. X., Côté, L. J., Louis, E. D., Alfaro, B., et al. (2002). Memory and executive function impairment predict dementia in Parkinson’s disease. Mov. Disord. 17, 1221–1226. doi: 10.1002/mds.10280
Litvan, I., Goldman, J. C., Tröster, A. I., Schmand, B. A., Weintraub, D., Petersen, R. C., et al. (2012). Diagnostic criteria for mild cognitive impairment in Parkinson’s disease: movement disorder society task force guidelines. Mov. Disord. 27, 349–356. doi: 10.1002/mds.24893
Luzzatti, C., Willmes, K., and De Bleser, R. (1996). Aachener Aphasie Test (AAT, versione italiana) Manuale e Dati Normativi. Firenze: Organizzazioni Speciali.
Mamikonyan, E., Xie, S. X., Melvin, E., and Weintraub, D. (2015). Rivastigmine for mild cognitive impairment in Parkinson disease: a placebo-controlled study. Mov. Disord. 30, 912–918. doi: 10.1002/mds.26236
Monastero, R., Cicero, C. E., Baschi, R., Davì, M., Luca, A., Restivo, V., et al. (2018). Mild cognitive impairment in Parkinson’s disease: the Parkinson’s disease cognitive study (PaCoS). J. of Neurol. 265, 1050–1058. doi: 10.1007/s00415-018-8800-4
Munhoz, R. P., Moro, A., Silveira-Moriyama, L., and Teive, H. A. (2015). Non-motor signs in Parkinson’s disease: a review. Arq. Neuropsiquiatr. 73, 454–462. doi: 10.1590/0004-282X20150029
Nasreddine, Z. S., Phillips, N. A., Bedirian, V., Charbonneau, S., Whitehead, V., Collin, I., et al. (2005). The montreal cognitive assessment, MoCA: a brief screening tool for mild cognitive impairment. J. Am. Geriatr. Soc. 53, 695–699. doi: 10.1111/j.1532-5415.2005.53221.x
Nicoletti, A., Vasta, R., Mostile, G., Nicoletti, G., Arabia, G., Iliceto, G., et al. (2017). Gender effect on non-motor symptoms in Parkinson’s disease: are men more at risk? Parkinsonism relat. Disorder 35, 69–74. doi: 10.1016/j.parkreldis.2016.12.008
Novelli, G., Papagno, C., Capitani, E., Cappa, S. F., and Vallar, G. (1986a). Tre test clinici di memoria verbale a lungo termine. Arch. Psicol. Neurol. Psichiatr. 47, 278–296.
Novelli, G., Papagno, C., Capitani, E., Laiacona, M., Vallar, G., and Cappa, S. F. (1986b). Tre test clinici di ricerca e produzione lessicale. Taratura su soggetti normali. Arch. Psicol. Neurol. Psichiatr. 47, 477–506.
Pedersen, K. F., Larsen, J. P., Tysnes, O. B., and Alves, G. (2013). Prognosis of mild cognitive impairment in early Parkinson disease: the norwegian parkwest study. JAMA Neurol. 70, 580–586. doi: 10.1001/jamaneurol.2013.2110
Pedersen, K. F., Larsen, J. P., Tysnes, O. B., and Alves, G. (2017). Natural course of mild cognitive impairment in Parkinson disease: a 5-year population-based study. Neurology 88, 767–774. doi: 10.1212/WNL.0000000000003634
Petersen, R. C., Doody, R., Kurz, A., Mohs, R. C., Morris, J. C., Rabins, P. V., et al. (2001). Current concepts in mild cognitive impairment. Arch. Neurol. 58, 1985–1992. doi: 10.1001/archneur.58.12.1985
Picillo, M., Nicoletti, A., Fetoni, V., Garavaglia, B., Barone, P., and Pellecchia, M. T. (2017). The relevance of gender in Parkinson’s disease: a review. J. Neurol. 264, 1583–1607. doi: 10.1007/s00415-016-8384-9
Pigott, K., Rick, J., Xie, S. X., Hurtig, H., Chen-Plotkin, A., Duda, J. E., et al. (2015). Longitudinal study of normal cognition in Parkinson disease. Neurology 85, 1276–1282. doi: 10.1212/WNL.0000000000002001
Poletti, M., Frosini, D., Pagni, C., Baldacci, F., Nicoletti, V., Tognoni, G., et al. (2012). Mild cognitive impairment and cognitive-motor relationships in newly diagnosed drug-naive patients with Parkinson’s disease. J. Neurol. Neurosurg. Psychiatry 83, 601–606. doi: 10.1136/jnnp-2011-301874
Roberts, R. O., Knopman, D. S., Mielke, M. M., Cha, R. H., Pankratz, V. S., Christianson, T. J., et al. (2014). Higher risk of progression to dementia in mild cognitive impairment cases who revert to normal. Neurology 82, 317–325. doi: 10.1212/WNL.0000000000000055
Santangelo, G., Vitale, C., Picillo, M., Moccia, M., Cuoco, S., Longo, K., et al. (2015). Mild Cognitive Impairment in newly diagnosed Parkinson’s disease: a longitudinal prospective study. Parkinsonism Relat. Disord. 21, 1219–1226. doi: 10.1016/j.parkreldis.2015.08.024
Schrag, A., Barone, P., Brown, R. G., Leentjens, A. F., McDonald, W. M., Starkstein, S., et al. (2007). Depression rating scales in Parkinson’s disease: critique and recommendations. Mov. Disord. 22, 1077–1092. doi: 10.1002/mds.21333
Shulman, K. (2000). Clock-drawing: is it the ideal cognitive screening test? Int. J. Geriatr. Psychiatry 15, 548–561. doi: 10.1002/1099-1166(200006)15:6<548::AID-GPS242>3.0.CO;2-U
Tomlinson, C. L., Stowe, R., Patel, S., Rick, C., Gray, R., and Clarke, C. E. (2010). Systematic review of levodopa dose equivalency reporting in Parkinson’s disease. Mov. Disord. 25, 2649–2653. doi: 10.1002/mds.23429
Uttl, B., and Graf, P. (1997). Color-Word Stroop test performance across the adult life span. J. Clin. Exp. Neuropsychol. 19, 405–420. doi: 10.1080/01688639708403869
Weintraub, D., Tröster, A. I., Marras, C., and Stebbins, G. (2018). Initial cognitive changes in Parkinson’s disease. Mov. Disord. 33, 511–519. doi: 10.1002/mds.27330
Keywords: mild cognitive impairment, dementia, Parkinson’s disease, incidence, neuropsychological assessment
Citation: Nicoletti A, Luca A, Baschi R, Cicero CE, Mostile G, Davì M, Pilati L, Restivo V, Zappia M and Monastero R (2019) Incidence of Mild Cognitive Impairment and Dementia in Parkinson’s Disease: The Parkinson’s Disease Cognitive Impairment Study. Front. Aging Neurosci. 11:21. doi: 10.3389/fnagi.2019.00021
Received: 26 October 2018; Accepted: 24 January 2019;
Published: 08 February 2019.
Edited by:
Patrizia Mecocci, University of Perugia, ItalyReviewed by:
Katie Palmer, IRCCS Fondazione Ospedale San Camillo, ItalyRichard Camicioli, University of Alberta, Canada
Gaetano Barbagallo, Università degli studi Magna Græcia di Catanzaro, Italy
Copyright © 2019 Nicoletti, Luca, Baschi, Cicero, Mostile, Davì, Pilati, Restivo, Zappia and Monastero. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Alessandra Nicoletti, YW5pY29sZXRAdW5pY3QuaXQ= Roberto Monastero, cm9iZXJ0by5tb25hc3Rlcm9AdW5pcGEuaXQ=
†These authors have contributed equally to this work