Assessment of Cognitive Scales to Examine Memory, Executive Function and Language in Individuals with Down Syndrome: Implications of a 6-month Observational Study

Down syndrome (DS) is the most commonly identifiable genetic form of intellectual disability. Individuals with DS have considerable deficits in intellectual functioning (i.e., low intellectual quotient, delayed learning and/or impaired language development) and adaptive behavior. Previous pharmacological studies in this population have been limited by a lack of appropriate endpoints that accurately measured change in cognitive and functional abilities. Therefore, the current longitudinal observational study assessed the suitability and reliability of existing cognitive scales to determine which tools would be the most effective in future interventional clinical studies. Subtests of the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS), Cambridge Neuropsychological Test Automated Battery (CANTAB), and Clinical Evaluation of Language Fundamentals-Preschool-2 (CELF-P-2), and the Observer Memory Questionnaire-Parent Form (OMQ-PF), Behavior Rating Inventory of Executive Function^®–Preschool Version (BRIEF-P) and Leiter International Performance Scale-Revised were assessed. The results reported here have contributed to the optimization of trial design and endpoint selection for the Phase 2 study of a new selective negative allosteric modulator of the GABA_A receptor α5-subtype (Basmisanil), and can be applied to other studies in the DS population.

Introduction

Down syndrome (DS) is the most common chromosomal cause of intellectual disability (ID). Each year approximately 6000 babies are born in the United States with DS, which is equivalent to 1 in 700 babies (Parker et al., 2010). Worldwide the estimated incidence is approximately 1 in 1000–1100 (World Health Organization (WHO), 2015). DS is characterized by substantial limitations in intellectual functioning (i.e., low intellectual quotient (IQ), delayed learning and/or impaired language development) and adaptive behavior. Studies have revealed a specific neuropsychological profile for this population—individuals typically have an average IQ below 70 (Chapman and Hesketh, 2000; Gioia et al., 2000) and weaknesses consistently associated with associative and verbal working memory (Jarrold et al., 2006, 2008; Silverman, 2007), episodic memory and explicit long-term memory (Carlesimo et al., 1997; Vicari, 2001), expressive language (Miller, 1998), and executive function (Lanfranchi et al., 2010), whereas relative strengths have been observed in visuospatial tasks and implicit long-term memory (Edgin et al., 2010b). Although, IQ levels vary in individuals with DS, most individuals function in the mild to moderate range of ID (Centers for Disease Control Prevention, 2015; Centers for Medicare Medicaid Services, 2014). Of note, as the rate of cognitive development progressively becomes slower over the childhood years in relation to typically developing peers, a decline in IQ scores over the childhood years is also observed (Carr, 1995).

Differences in brain structure and function are already apparent in early infancy in individuals with DS (Nadel, 2003; Edgin et al., 2015), with clear alterations in hippocampus (e.g., altered microarchitecture of pyramidal cells), prefrontal cortex (reduced volume), and cerebellum (e.g., hypoplasia) apparent pre- and post-natally (Pennington et al., 2003; Lott and Dierssen, 2010). Furthermore, structural and volumetric magnetic resonance imaging (MRI) studies have shown that individuals with DS have a smaller intracranial volume than their typically developing peers, with the most profound differences observed in the frontal lobes, cerebellum, and brainstem (Kesslak et al., 1994; Raz et al., 1995; Aylward et al., 1999). Other studies have also shown that smaller volumes are observed in the temporal lobe, including the hippocampal region (Schmidt-Sidor et al., 1990; Pinter et al., 2001) which is known to affect a range of cognitive functions. As individuals with DS approach early adulthood, some are at particular risk for the early development of Alzheimer's disease (Zigman et al., 2008). The prevalence of dementia in DS increases over 45 years of age, with upwards of 75% having dementia over 65 years (Lott and Dierssen, 2010), although neuropathological and neurochemical changes have been observed as early as fetal development (Bahn et al., 2002; de Sola et al., 2015).

Recent advancements in our understanding of the underlying mechanisms of cognitive dysfunction in DS suggest an imbalance between excitatory and inhibitory neurotransmission. Ɣ-Aminobutyric acid (GABA) neurotransmission is the major inhibitory system in the mature brain. Reducing GABA-mediated inhibition by limiting GABA_A receptor activity has shown beneficial effects on hippocampal synaptic plasticity as well as learning and memory deficits in the Ts65Dn mouse model of DS (Kleschevnikov et al., 2004; Fernandez et al., 2007; Colas et al., 2013; Martínez-Cué et al., 2013; Potier et al., 2014). A negative allosteric modulator of the GABA_A α5-containing receptor subtype (Basmisanil) is currently under investigation in young adults with DS (ClinicalTrials.gov identifier: NCT02024789).

Previous pharmaceutical trials in DS have noted that studies are often limited by a lack of endpoints that accurately captured cognitive and functional changes (Heller et al., 2006). Thus, it is important to assess the suitability and reliability of existing tools that measure cognitive function in a longitudinal observational study to determine which measures may be most effective in the context of a pharmacological clinical trial. Specifically, clinical trials require measures that can be repeatedly and reliably administered across international sites, to participants of a defined age range, and that do not exhibit large practice, floor, or ceiling effects.

The recently published TESDAD battery includes neurocognitive tests and scales, but no test-retest analysis or evaluation of potential practice effect are currently available (de Sola et al., 2015). Edgin et al. also reported the development of the Arizona Cognitive Test Battery (ACTB) based on the Cambridge Neuropsychological Test Automated Battery (CANTAB) and other available tools (Edgin et al., 2010a). The ACTB was designed based on historical findings of performance deficits in domains, and tasks that had been repeatedly shown to be more difficult for those with DS (Pennington et al., 2003; Edgin et al., 2010a, 2014; Lee et al., 2011). The ACTB validation suggested that neuropsychological measures could be administered to a large sample of individuals with DS (n = 74) with low floor effects and good preliminary estimates of test-retest reliability (albeit in a small subsample). This battery could have been used in our clinical trials; however, based on the mechanism of action of Basmisanil, some of the tests may be more relevant than others (e.g., hippocampal or prefrontal tests vs. cerebellar function tests). Therefore, alternative scales were chosen for analysis in this study. Furthermore, most measurement validation studies have been limited in their ability to ascertain the reliability of endpoint measures within the retesting time frame and frequency required to determine how the measures perform in a clinical trial context. Given the frequency of new clinical investigations in this population, more measurement development and validation is urgently required, leading us to report on these data to assist the broader community with study design in the future. Furthermore, the National Institutes of Health (NIH) Research Plan on Down Syndrome, which was revised in 2014, reports on the need to study clinical and behavioral treatments and interventions for DS, with part of this plan noting the importance for reliable and valid endpoint assessments to measure the efficacy of these treatments (U.S. Department of Health Human Services National Institutes of Health, 2014).

Objectives

Given this background, the primary objective of this non-pharmacological study (BP25612; ClinicalTrials.gov identifier: NCT01580384) was to investigate the suitability (i.e., number of participants completing the tests, floor/ceiling effects, and potential learning effect) of selected neurocognitive tests in a 6-month longitudinal and multinational setting for the measurement of cognitive function in individuals with DS. Subtests of the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) (Randolph et al., 1998), subtests of CANTAB (Cantab Research Suite, 2015), subtests from the Clinical Evaluation of Language Fundamentals-Preschool-2 (CELF-P-2) (Pearson, 2004), the Observer Memory Questionnaire-Parent Form (OMQ-PF) (Gonzalez et al., 2008), and the Behavior Rating Inventory of Executive Function^®–Preschool Version (BRIEF-P) (Gioia et al., 2000) were used to assess immediate and delayed memory, language, and executive function. Secondary objectives were to assess the test-retest reliability of these measures over 6 months and to explore the influence of age (adolescents vs. adults) and non-verbal IQ level, as measured by the Leiter International Performance Scale-Revised (Leiter-R) (Roid and Miller, 1997).

Part of the results from this study were previously presented at the 2014 American Association of Intellectual and Developmental Disabilities (AAIDD) Annual Meeting (del Valle Rubido et al., 2014), as well as at the 2013 Cognition in Down Syndrome Workshop (Liogier d'Ardhuy et al., 2013). Results from the assessments using the Vineland Adaptive Behavior Scales-II (VABS-II) and the Clinician Global Impression of Severity (CGI-S) and Improvement (CGI-I) scales will be reported separately.

Methods

This was a 6-month (24–27 weeks) observational, non-pharmacological, longitudinal, multicenter (11 sites), multinational study in adolescents (12–17 years) and adults (18–30 years) with DS conducted between February 2012 and January 2014. The study was conducted in the United States, United Kingdom, Spain, France, Italy, Canada, and Argentina. Overall 90 participants (equally split between adolescents and adults) were planned to be enrolled and randomized into three different schedules of assessments (i.e., A, B, and C; C contained a smaller number of tests and visits). In order to include all of the planned assessments and keep the duration within the desired 90-min testing period for each study visit, three schedules of assessments were implemented. A 15–25 min break was planned after 45 min of testing and an additional break could be added before starting the last exercise (RBANS) if requested or deemed necessary by the rater. Randomization was stratified by age group to have a balanced number of sequences of assessments between adolescents and adults.

The current study was conducted for 6 months to reflect the clinical trial design of the ongoing Phase 2 study. Participants who met the inclusion criteria (below) received testing at the baseline visit, 4 weeks and 24 weeks later when randomized to schedule A or B or received testing at the baseline visit and at 24 weeks when randomized to schedule C (Table 1). These schedules resulted in a common data set that was administered to at least 60 participants. The total duration of the study for each participant was between 24 and 27 weeks.

TABLE 1

Table 1. Number of participants per randomization schedule and total number of subjects evaluated per task.

Study Population

Male and female adolescents (12–17 years) and adults (18–30 years) with a diagnosis of DS were included in the study if they met all of the following criteria: parent/caregiver was able to speak and understand the local language, to accompany the participant to all clinic visits, and to provide information about the participant's behavior and daily functioning. Also, the participant's speech was understandable to the examiner; at screening the participant attempted to perform the neuropsychological tests; stable treatment for at least 8 weeks prior to screening if he/she had a generalized anxiety disorder, major depressive disorder, autism spectrum disorder, attention-deficit/hyperactivity disorder, and recent laboratory tests confirming euthyroid (serum free thyroxine [FT4] and thyroid stimulating hormone [TSH]) and normoglycemic (serum glucose) status (within 12 months prior to screening visit, with or without treatment). Individuals were not included if they met any of the following criteria: diagnosed with axis I and II psychiatric disorders, except those mentioned above; exhibited significant suicidal risk; could not comply with protocol or perform the outcome measures due to hearing or visual impairment; had evidence of dementia; had thyroid dysfunction or diabetes not adequately controlled at least 8 weeks prior to randomization; or abused alcohol and/or other substances.

Written informed consent was obtained from the parents/caregivers and assent from the participants prior to participation in the study. The study was conducted in accordance with the principles of the Declaration of Helsinki and Good Clinical Practice (GCP), and all required approvals were obtained from the appropriate independent ethics committee (IEC)/institutional review board (IRB) prior to the start of the study.

Concomitant Medication

Psychotropic agents that would likely interfere with any of the assessments could not be initiated or changed during the study period. This included antidepressants (e.g., selective serotonin reuptake inhibitors [SSRIs], serotonin and norepinephrine reuptake inhibitors [SNRIs], norepinephrine-dopamine reuptake inhibitors such as bupropion, and serotonin-norepinephrine reuptake inhibitors such as the tricyclic antidepressants), antipsychotics, benzodiazepines and hypnotics, acetylcholinesterase inhibitors, GABA agonists (e.g., tiagabine, vigabatrin, and baclofen), and glutamatergic drugs (e.g., riluzole, topiramate, memantine, and lamotrigine).

Procedures

Selected raters for the cognitive assessments/rating scales were provided with instructions and comprehensive training on scale administration prior to the start of the study. Whenever possible, for each participant the same rater/caregiver consistently administered/completed the rating scales across study visits.

The assessments were completed in a prespecified and consistent order to maximize standardization across sites and participants.

Scales Selected to Measure Cognitive Skills

The Leiter International Performance Scale-revised (Leiter-R) (Roid and Miller, 1997)

Leiter-R, a non-verbal intelligence test, was individually administered to all participants. Two reasoning subtests (Sequential Order and Repeated Patterns) and two visualization subtests (Figure Ground and Form Completion) were administered to derive a non-verbal IQ.

Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) (Randolph et al., 1998)

The RBANS was individually administered and used to measure cognitive changes over time. Four subtests of the full battery of 12 subtests were used in this study to assess immediate memory (List Learning and Story Memory), as well as language capacities (i.e., Picture Naming and Semantic Fluency). The RBANS was chosen because it has been used in clinical trials investigations (Duff et al., 2010; Hobson et al., 2010) and provides four alternate forms. Alternate forms were used on each study day. The raw score on each of these scales was used for analysis.

Cambridge Neuropsychological Test Automated Battery (CANTAB) (Cantab Research Suite, 2015)

The CANTAB is a computerized battery of neuropsychological tests carried out by the participant under the supervision of qualified personnel. The Spatial Span (SSP) subtest was used in this study to assess working memory capacities; it is considered a visuospatial analog of a digit span test in which a random array of boxes on a screen change color in a particular sequence. The participant's response was given by recalling the test pattern in forward or reverse order.

Observer Memory Questionnaire-parent Form (OMQ-PF) (Gonzalez et al., 2008)

The OMQ-PF is a 27-item questionnaire designed to ascertain the perceptions of parents/caregivers about the participant's daily memory function. It has been previously validated in children with temporal lobe epilepsy and memory impairment (Gonzalez et al., 2008). Items were rated on a 5-point Likert scale (1- strongly agree to 5- strongly disagree OR 1- never to 5- always).

Behavior Rating Inventory of Executive Function^®–Preschool Version (BRIEF-P) (Gioia et al., 2000)

The BRIEF-P was completed by the parent/caregiver and measured the participant's everyday skills associated with executive function (i.e., Inhibit, Working Memory, Plan/Organize, and the Global Executive Composite [GEC]). This scale has been used in a number of investigations of DS, where it demonstrated a unique pattern of strengths and weaknesses, including deficits in parent's ratings of working memory and planning, but not in inhibition or emotional control (Lee et al., 2011).

Clinical Evaluation of Language Fundamentals-Preschool-2 (CELF-P-2) (Pearson, 2004)

The CELF-P-2 consists of a variety of subtests used to evaluate the language skills of preschool-aged children (3–6 years). The Word Classes subtest was used to evaluate the participant's ability to understand and express relationships between semantically related words. Raw scores from the receptive and expressive scales of this subtest were used in the analyses.

The CELF-P-2, RBANS, and OMQ-PF were translated into French, Italian, and Spanish by a process that included forward translation, back translation, and concept validation. Rater instructions for the Leiter-R and CANTAB were also translated. The BRIEF-P was already available in various languages and did not require translation for use in this study.

Statistical Methods

For the assessments with a minimum of 60 participants, a Mixed Model Repeated Measurements (MMRM) analysis was applied with visit-time as repeat factor; subject as subject-effect; gender, language and age as class factors; age by visit-time as interaction; and baseline IQ as continuous covariate. Estimates of the mean differences between age groups, genders and visits (6 months vs. baseline), and the estimate of the slope (β) over IQ were derived.

Measurements of between-subject variability and residual variability as well as of correlation between repeated assessments within the same subjects were extracted from the mixed model. As a measure of test-retest reliability, Intraclass Correlation Coefficient (ICC) was derived per each age group between visits (6 months vs. baseline). An ICC was considered poor, fair, good, and very good when values were < 0.40, 0.40–0.59, 0.60–0.75, and >0.75, respectively (Cicchetti and Sparrow, 1981; Oremus et al., 2012). Analyses of correlation at baseline were performed between RBANS List Learning and both CELF-P-2 Expressive and OMQ-PF scores, and between CANTAB SSP reverse and BRIEF-P scores (i.e., GEC and Working Memory subdomains).

All derived p-values were not controlled for multiple comparisons and should be interpreted as an aid to gauge the magnitude of estimated differences.

Results

Study Population

A total of 94 participants were screened, 90 were randomized (49 adolescents 12–17 years; 41 young adults 18–30 years), and 89 completed the study; the participant who did not complete the study was lost to follow up. Table 2 shows the study demographics. The mean age for the adolescent and adult groups was 15 years and 23 years, respectively. The adult group was well balanced for gender (51% female, 49% male), whereas slightly more males were enrolled in the adolescent group (59%). No procedure-related adverse events (e.g., fatigue or tiredness) were recorded in any participants.

TABLE 2

Table 2. Study demographics.

Neurocognitive Assessments

The baseline IQ scores are shown in Table 2. The mean IQ scores were similar between age groups (adolescents 42 ± 7; adults 39 ± 6), although 22% of adolescents and 61% of adults performed at the floor (36) of the test (Table 3).

TABLE 3

Table 3. Test-retest reliability (ICC) between baseline and 6 months and floor effect at baseline.

Memory Assessments

RBANS (List Learning and Story Memory)

The List Learning baseline scores followed a relatively normal distribution, ranging from 0 to 32, over a maximum possible score of 40, with means of 11.8 (standard deviation [SD] 7.5) and 13.8 (SD 8.2) for the adolescents and adults, respectively (Table 4). Very few participants had a score of zero in this task (Table 3; 4 and 7% for adolescents and adults, respectively). However, 24% of adolescents and 12% of adults had very low scores (≤ 4). The average reference List Learning scores for typically developing individuals aged 20–39 years is approximately 30 (Randolph, 2006). Overall, adults had statistically higher List Learning scores than adolescents (age, p = 0.035; Table 5). The adolescents showed improvement (+2.3 ± 5.6) over the 6-month period, whereas the adults did not, as captured by the close to significant time x age interaction. The IQ scores were significantly related to the List Learning scores (p < 0.001; Table 5).

TABLE 4

Table 4. Mean scores and standard deviations at baseline and 6 months for each scale.

TABLE 5

Table 5. Estimates of differences for each assessment and influence of Time, Age, and IQ (p-values as from MMRM analysis).

Overall, the Story Memory scores ranged from 0 to 21 out of a maximum possible score of 24 with means of 5.6 (SD 4.1) and 6.0 (SD 5.2) for the adults and adolescents, respectively (Table 4). The distribution was skewed toward the lower scores, illustrating a floor effect. This was particularly evident in the adolescent group, with 22% obtaining a score of 0 at baseline, reflecting the difficulty of this subtest for this population. However, on average, both age groups performed equally in the Story Memory subtest (p = 0.250; Table 4). Adolescents scores decreased on average over the 6-month period (−1.6 ± 3.5 SD), whereas adult scores did not change over time (time × age, p = 0.030; Table 5). IQ scores were significantly related to the Story Memory scores (p = 0.001; Table 5).

OMQ-PF (Daily Memory)

The baseline distributions of total raw scores for both age groups appeared normal, ranging from 61 to 124 (reference for typically developing children 5–16 years of age, 107). There was no significant difference in the observed memory scores between age groups (6.09, p = 0.075) or visits (0.21, p = 0.824; Table 5). IQ level did not predict perceived daily memory scores. The observed memory score correlated with the RBANS List Learning score across ages (r = 0.33, p < 0.01), demonstrating concurrent validity with a direct memory assessment.

Executive Function Assessments

CANTAB (Spatial Span)

For the forward span length, the baseline distribution was normal in both age groups and no floor effect was observed (Table 5). On the other hand, in the reverse task, 24% of the adolescents and 22% of the adults scored 0. On average, adults had significantly greater reverse span length (+0.77, p = 0.019; Table 5), whereas no difference was observed between age groups for the forward span performance (age, p = 0.095). Forward and reverse span lengths were stable over time (age × time 0.814 and 0.435, respectively; Table 5). IQ was related to both forward (p < 0.001) and reverse (p = 0.001) span length (Table 5).

BRIEF-P

At baseline, the BRIEF-P GEC scores in the adolescent group were normally distributed, whereas the adult group peaked at lower values (better). Adults had statistically lower mean BRIEF-P GEC scores compared with adolescent (−13.42, p = 0.011), indicating higher perceived executive functioning in this age group. GEC scores were stable across visits (time, p = 0.291).

IQ was not related to GEC scores (p = 0.931, Table 5). To further explore this lack of influence of IQ, correlations between IQ scores and the Working Memory domain, the Plan/Organize and the Inhibit domains were conducted and did not show any relation, in either age group. No significant correlations were found between BRIEF GEC scores and either forward or reverse span lengths from the CANTAB SSP tasks. Nevertheless, BRIEF-P Working Memory scores correlated with reverse SSP length (R = −0.27, p = 0.036, moderate effect).

Language Assessments

RBANS (Picture Naming and Semantic Fluency)

The baseline distribution of scores for both subtests followed normal distribution for both age groups, and a small number of participants performed at the floor of the tests (Table 3). No age differences were detected. Whereas, no effect of time was noticed in the Picture Naming task, time had a significant effect on Semantic Fluency results with lower scores at 6 months than at baseline (-1.17, p < 0.001, Table 5). Both Picture Naming and Semantic Fluency scores were significantly related to IQ (p = 0.005 and p = 0.006, respectively).

CELF-P-2 (Linguistic Functioning)

The baseline distribution of total scores in the CELF-P-2 was normal for the adolescents but was skewed toward the higher values for adults. This is likely due to a significant number of adult participants (n = 12) reaching the maximum score (or close to) of 20 for the receptive domain (but not for the expressive). Of note, female participants had a statistically higher average total scores (+3.95, p = 0.037) and expressive scores (+2.51, p = 0.016) than males. No gender differences were observed in receptive scores, likely due to the ceiling effect in this domain. Time did not affect any of the CELF-P-2 sub-scores. The total CELF-P-2 scores were significantly related to IQ scores (p = 0.001), driven by both the expressive and the receptive domains (p = 0.003; p = 0.024, respectively). To better understand the minimum level of language skills required to perform key cognitive tasks, we tested for correlations between receptive and expressive components of the CELF-P-2 and the RBANS List Learning and Semantic Fluency scores. In both age groups, CELF-P-2 expressive scores highly correlated with RBANS Semantic Fluency scores (p < 0.001) and with RBANS List Learning scores (Figure 1).

FIGURE 1

Figure 1. RBANS List Learning scores and CELF-P-2 Word Classes expressive scores.

Test-retest Reliability

A summary of ICCs for all scales is shown in Table 3. Reliability ranged from fair (ICC 0.40–0.59) to very good (ICC > 0.75). Most of the scales depicted good reliability (ICC = 0.63: CELF-P-2, RBANS Semantic Fluency, List Learning and Story Memory subtests, BRIEF-P and OMQ-PF). The highest ICC scores were found for the BRIEF-P and OMQ-PF, which are both parent-reported scales.

Discussion

This study assessed a variety of neurocognitive tests and functioning scales over a 6-month period to determine appropriate outcome measures for potential use in interventional pharmacological and non-pharmacological treatment studies in adolescents and young adults with DS. To date, this is the largest data set reporting evaluation of these assessments.

The Leiter-R IQ scale is a non-verbal assessment that is not influenced by linguistic production which is particularly impaired in individuals with DS. Moreover, in an international clinical trial context, form equivalence after language translation is a major barrier to the implementation of IQ scales. The Leiter-R is not influenced by this issue. Our results show that the Leiter-R may not be the most suitable means of capturing the lower end of the IQ range in DS as 22% of adolescents and 61% of adults scored at the floor of the test (36); however, this test has shown better results than those obtained in a previous clinical trial with the abbreviated Stanford-Binet Intelligence Scales Fifth Edition (ClinicalTrials.gov Identifier: NCT01436955). Based on these observations, the Leiter-3 (Roid and Miller, 1997) was administered in a study with 180 adults and adolescents with DS (Clinical.Trials.gov Identifier NCT01920633). These results are more promising in terms of data distribution and percentage of participants at the floor of 30 (approximately 1%). This suggests that the Leiter-3 is probably more appropriate to measure the full IQ range in this population (Figure 2). In studies in children with DS, it is not uncommon for standardized IQ scores to decrease across childhood (Carr, 1995). In our study of older individuals with DS (12–30 years), using the Leiter-R we found stability in IQ scores similar to the recent findings by Carr, showing no change in IQ from 21 to 45 years in a longitudinally collected sample(Carr, 2012). However, with the greater number of adults at the floor of 36, any age-related differences may have been masked by floor effects.

FIGURE 2

Figure 2. IQ scores: distributions using three different IQ scales. The horizontal bar represents the median score.

The RBANS was developed for the dual purposes of identifying and characterizing abnormal cognitive decline in older adults and as a neuropsychological screening battery for younger patients (Randolph et al., 1998). With average List Learning scores of 14 for adults with DS where the average score in typically developing peers is approximately 30, and even greater discrepancies in the Story Memory subtest, this demonstrates that these tasks are very difficult for individuals with DS. Some improvements in performance were observed over the 6-month study period and, in particular, adolescents showed improvement in the List Learning task. These observations may be linked to the natural neurodevelopment of the capacities of adolescents and/or the fact that more adolescents with DS are attending school and involved in alternative therapies such as speech therapies and educational resources. The Story Memory scores, however, did not show a similar improvement in adolescents which may be due to a greater floor effect.

Observed memory is not a direct measure of the participant's memory capacities, but a functional measure that can be affected by many facets of mnemonic ability in daily life. Overall, the OMQ-PF showed good reliability and suitability for use in clinical trials of individuals with DS. Previous results by Gonzales et al. have indicated that the OMQ-PF may be more closely related to new learning ability rather than retention or recall of information (Gonzalez et al., 2008), and other studies suggest that everyday abilities cannot necessarily be inferred from direct neuropsychological tasks (Chaytor and Schmitter-Edgecombe, 2003). Our results suggest that observed memory scores relate to specific memory functions, as illustrated by the correlation noted between the RBANS List Learning immediate and OMQ-PF scores.

Forward and backward SSP subtests were administered to assess working memory. Here we recapitulate the known working memory deficit in DS (Lanfranchi et al., 2012), with low scores in both forward and reverse tasks and a significant number of participants scoring 0, or “floor” effects, in the reverse task. Both subtests were statistically related to IQ scores, however, this relationship is likely driven by the floor effects in both IQ and spatial span tests, and thus less meaningful. Neither forward nor reverse SSP length correlated with BRIEF-P GEC scores. Overall, these findings together with low ICC values indicate that SSP would be too difficult and discouraging for individuals with DS and have limited usefulness as an outcome measure in interventional clinical trials.

The BRIEF-P was implemented as an indirect measure of executive function, including working memory function. Here again executive function deficits were clear, confirming the neurocognitive DS profile. An obvious difference was evident between the adolescent and adult groups in GEC scores, with adults performing significantly better than adolescents. Adult performance reached maximum scores, suggesting that the preschool version of the BRIEF is probably less appropriate for the adults than the adolescents with DS. The BRIEF-school age version (5–18 years) could have been used instead. This version of the BRIEF was indeed used as a behavioral assessment to establish concurrent validity for the ACTB (Edgin et al., 2010a). The perceived global executive function was not influenced by IQ across ages. We therefore looked at IQ correlations in adolescents and adults separately in BRIEF-P subdomains and interestingly noted that neither, the Working Memory, Plan/Organize or Inhibit subtests correlated with IQ. However, a focused analysis of Working Memory aspects, considered to be a major contributor to executive function weaknesses in DS, revealed that the Working Memory domain of the BRIEF-P correlated with reverse SSP, a direct Working Memory executive function measure. These findings suggest that the BRIEF-P captures executive functions engaged in the reverse SSP processing, but overall distinct functions than those captured by the Leiter.

Language difficulties are one of the most prominent barriers to independence and socialization and part of the neurocognitive profile in DS. Here we assessed elements of linguistic functioning. The CELF-P-2 Word Classes test showed a potential “ceiling” effect, reducing its use to assess changes in language abilities in a trial; nevertheless, the link between CELF-P-2 expressive scores and RBANS List Learning performances suggests this test could be of relevant use as a screening tool in future studies to ensure enrolment of participants with the minimal level of expressive language ability required to perform key cognitive tasks. In our study, the verbal communication level was on average better in females as compared to males, particularly in the expressive domain, as assessed by the CELF-P-2 Word Classes and RBANS Semantic Fluency, confirming the previously described communication profile in DS (Määttä et al., 2006).

Language proficiency was also tested with the Picture Naming and Semantic Fluency tasks from the RBANS. Overall, the test-retest scores from these two tests were considered fair, illustrating a potential lack of suitability for clinical trials in individuals with DS. However, to avoid potential practice effects, four different RBANS forms have been developed to be used on several occasions in clinical trials. A weakness in our study is that the same RBANS form was used at the baseline visit but two different forms were used at the Week 24 visit depending on the study schedule. This might explained the low ICC scores that we observed or the time effect observed in the Semantic Fluency task.

Finally, we observed that direct measurements of immediate memory, executive function and linguistic functioning as described here, were all influenced by the IQ level of the participants. On the other hand, indirect measures of executive function and memory as reported by the parents or the caregivers (BRIEF-P and OMQ-PF) were not sensitive to the IQ level.

Table 6 summarizes the main findings for each scale evaluated in this study and our conclusions on their suitability for clinical trials with adults and adolescents with Down syndrome. These conclusions contributed to the selection of suitable outcome measures for the ongoing 26-week Phase 2 study (Clinicaltrials.gov identifier: NCT02024789) evaluating the efficacy, safety and tolerability of Basmisanil in individuals (12–30 years) with DS. RBANS List Learning was chosen as the primary endpoint for evaluating hippocampal tasks associated with a global functioning evaluation, whereas the Leiter-3 was selected as the IQ measure. These results can be relevant to other trials assessing cognitive function in the DS population, but also in other conditions. Given the breath of these measures we have validated scales that could be used across trials, including memory interventions (RBANS, OMQ-PF) as well as in attention deficits (BRIEF-P, CANTAB spatial span).

TABLE 6

Table 6. Summary of key learnings.

Conclusion

To our knowledge, the results reported here are the first from a multinational study assessing cognitive function in a substantial number of adolescents and adults with DS over a 6-month period, allowing both robust suitability and reliability analyses. Multiple assessments that evaluate overlapping cognitive functions were conducted, which allowed for a robust characterization of these scales and their interrelationships. Finally, these findings provide information on the natural neurocognitive changes in adolescents and adults with DS over a 6-month period, which will contribute to a better understanding of the true impact of intervention in future efficacy trials.

Overall, the current study has important implications for measuring cognitive changes in response to pharmacological treatment. Such non-pharmacological, longitudinal studies are key in the development of medicine for neurodevelopmental disorders such as DS where the choice of appropriate tools is critical to be able to detect beneficial drug effects.

Conflict of Interest Statement

Xavier Liogier d'Ardhuy, Celia Goeldner, Jana Nöldeke, Lisa Squassante, Jeannie Visootsak, Omar Khwaja are employed by F. Hoffmann-La Roche. Jamie O. Edgin received grants from F. Hoffmann-La Roche during the conduct of the study, personal fees from F. Hoffmann-La Roche and Novartis outside of the submitted work, and has a patent pending. Priya Kishnani received personal fees/non-financial support from F. Hoffmann-La Roche during the conduct of the study. Gail Spiridigliozzi received grants from F. Hoffmann-La Roche during the conduct of the study and outside of the submitted work. Charles Bouis, Susana de Sola, Sydney Rice, and Silvia Sacco declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

Medical writing support was provided by Tara N. Miller, PhD, of Envision Scientific Solutions, funded by F. Hoffmann-La Roche. The authors would also like to acknowledge the investigators who participated in this study. We thank the families and study participants that made this work possible.

References

Aylward, E. H., Li, Q., Honeycutt, N. A., Warren, A. C., Pulsifer, M. B., Barta, P. E., et al. (1999). MRI volumes of the hippocampus and amygdala in adults with Down's syndrome with and without dementia. Am. J. Psychiatry 1564, 564–568.

PubMed Abstract | Google Scholar

Bahn, S., Mimmack, M., Ryan, M., Caldwell, M. A., Jauniaux, E., Starkey, M., et al. (2002). Neuronal target genes of the neuron-restrictive silencer factor in neurospheres derived from fetuses with Down's syndrome: a gene expression study. Lancet 359, 310–315. doi: 10.1016/S0140-6736(02)07497-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Cantab Research Suite (2015). Cognitive Research. Available online at: http://www.camcog.com/en/science/tests (Retrieved 18 March, 2015).

Carlesimo, G. A., Marotta, L., and Vicari, S. (1997). Long-term memory in mental retardation: evidence for a specific impairment in subjects with Down's syndrome. Neuropsychologia 35, 71–79.

PubMed Abstract | Google Scholar

Carr, J. (2012). Six weeks to 45 years: a longitudinal study of a population with Down syndrome. J. Appl. Res. Intellect. Disabil. 25, 414–422. doi: 10.1111/j.1468-3148.2011.00676.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Carr, J. H. (1995). Down's Syndrome: Children Growing Up. Cambridge: Cambridge University Press.

Google Scholar

Centers for Disease Control and Prevention. (2015). Official MADDSP and MADDS Surveillance Case Definitions: Metropolitan Atlanta Developmental Disabilities Surveillance Program (MADDSP) Case Definitions. Available online at: http://www.cdc.gov/ncbddd/developmentaldisabilities/casedefinitions.html (Retrieved June 8, 2015).

Centers for Medicare and Medicaid Services. (2014). ICD-9-CM Diagnosis and Procedure Codes: Abbreviated and Full Code Titles. Available online at: http://www.cms.gov/Medicare/Coding/ICD9ProviderDiagnosticCodes/codes.html (Retrieved June 8, 2015).

Chapman, R. S., and Hesketh, L. J. (2000). Behavioral phenotype of individuals with Down syndrome. Ment. Retard. Dev. Disabil. Res. Rev. 6, 84–95. doi: 10.1002/1098-2779(2000)6:2<84::AID-MRDD2>3.0.CO;2-P

PubMed Abstract | CrossRef Full Text | Google Scholar

Chaytor, N., and Schmitter-Edgecombe, M. (2003). The ecological validity of neuropsychological tests: a review of the literature on everyday cognitive skills. Neuropsychol. Rev. 13, 181–197. doi: 10.1023/B:NERV.0000009483.91468.fb

PubMed Abstract | CrossRef Full Text | Google Scholar

Cicchetti, D. V., and Sparrow, S. A. (1981). Developing criteria for establishing interrater reliability of specific items: applications to assessment of adaptive behavior. Am. J. Ment. Defic. 86, 127–137.

PubMed Abstract | Google Scholar

Colas, D., Chuluun, B., Warrier, D., Blank, M., Wetmore, D. Z., Buckmaster, P., et al. (2013). Short-term treatment with the GABAA receptor antagonist pentylenetetrazole produces a sustained pro-cognitive benefit in a mouse model of Down's syndrome. Br. J. Pharmacol. 169, 963–973. doi: 10.1111/bph.12169

PubMed Abstract | CrossRef Full Text | Google Scholar

del Valle Rubido, M., Liogier d'Ardhuy, X., De La Torre, R., Dorison, N., Edgin, J., Kishnani, P., et al. (2014). Assessment of working memory in intellectual and development disabilities: results from a 6-month global longitudinal observational study in teenagers and young adults with down syndrome,” in Paper Presented at the American Association on Intellectual and Developmental Disabilities, Orlando, FL, USA (Orlando, FL)

de Sola, S., de la Torre, R., Sánchez-Benavides, G., Benejam, B., Cuenca-Royo, A., Del Hoyo, L., et al. (2015). A new cognitive evaluation battery for Down syndrome and its relevance for clinical trials. Front. Psychol. 6:708. doi: 10.3389/fpsyg.2015.00708

PubMed Abstract | CrossRef Full Text | Google Scholar

Duff, K., Hobson, V. L., Beglinger, L. J., and O'Bryant, S. E. (2010). Diagnostic accuracy of the RBANS in mild cognitive impairment: limitations on assessing milder impairments. Arch. Clin. Neuropsychol. 25, 429–441. doi: 10.1093/arclin/acq045

PubMed Abstract | CrossRef Full Text | Google Scholar

Edgin, J., Clark, C., Massand, E., and Karmiloff-Smith, A. (2015). Building an adaptive brain across development: targets for neurorehabilitation must begin in infancy. Front. Behav. Neurosci. 9:232. doi: 10.3389/fnbeh.2015.00232

CrossRef Full Text | Google Scholar

Edgin, J. O., Mason, G. M., Allman, M. J., Capone, G. T., Deleon, I., Maslen, C., et al. (2010a). Development and validation of the Arizona Cognitive Test Battery for Down syndrome. J. Neurodev. Disord. 2, 149–164. doi: 10.1007/s11689-010-9054-3

PubMed Abstract | CrossRef Full Text | Google Scholar

Edgin, J. O., Pennington, B. F., and Mervis, C. B. (2010b). Neuropsychological components of intellectual disability: the contributions of immediate, working, and associative memory. J. Intellect. Disabil. Res. 54, 406–417. doi: 10.1111/j.1365-2788.2010.01278.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Edgin, J. O., Spanò, G., Kawa, K., and Nadel, L. (2014). Remembering things without context: development matters. Child Dev. 85, 1491–1502. doi: 10.1111/cdev.12232

PubMed Abstract | CrossRef Full Text | Google Scholar

Fernandez, F., Morishita, W., Zuniga, E., Nguyen, J., Blank, M., Malenka, R. C., et al. (2007). Pharmacotherapy for cognitive impairment in a mouse model of Down syndrome. Nat. Neurosci. 10, 411–413. doi: 10.1038/nn1860

PubMed Abstract | CrossRef Full Text | Google Scholar

Gioia, G. A., Isquith, P. K., Guy, S. C., and Kenworthy, L. (2000). Behavior rating inventory of executive function. Child Neuropsychol. 6, 235–238. doi: 10.1076/chin.6.3.235.3152

PubMed Abstract | CrossRef Full Text | Google Scholar

Gonzalez, L. M., Anderson, V. A., Wood, S. J., Mitchell, L. A., Heinrich, L., and Harvey, A. S. (2008). The observer memory questionnaire-parent form: introducing a new measure of everyday memory for children. J. Int. Neuropsychol. Soc. 14, 337–342. doi: 10.1017/S135561770808020X

PubMed Abstract | CrossRef Full Text | Google Scholar

Heller, J. H., Spiridigliozzi, G. A., Crissman, B. G., Sullivan-Saarela, J. A., Li, J. S., and Kishnani, P. S. (2006). Clinical trials in children with Down syndrome: issues from a cognitive research perspective. Am. J. Med. Genet. C Semin. Med. Genet. 142C, 187–195. doi: 10.1002/ajmg.c.30103

PubMed Abstract | CrossRef Full Text | Google Scholar

Hobson, V. L., Hall, J. R., Humphreys-Clark, J. D., Schrimsher, G. W., and O'Bryant, S. E. (2010). Identifying functional impairment with scores from the repeatable battery for the assessment of neuropsychological status (RBANS). Int. J. Geriatr. Psychiatry 25, 525–530. doi: 10.1002/gps.2382

PubMed Abstract | CrossRef Full Text | Google Scholar

Jarrold, C., Nadel, L., and Vicari, S. (2008). Memory and Neuropsychology in Down syndrome. Down syndrome education on-line (Portsmouth, UK). (Retrieved 19 March, 2015). doi: 10.3104/reviews.2068. Available online at: http://www.down-syndrome.org/reviews/2068/reviews-2068.pdf

CrossRef Full Text

Jarrold, C., Purser, H. R. M., and Brock, J. (2006). “Short-term memory in Down syndrome,” in Working Memory and Neurodevelopmental Disorders, ed T. P. A. S. Gathercole (Hove: Psychology Press), 239–266.

PubMed Abstract

Kesslak, J. P., Nagata, S. F., Lott, I., and Nalcioglu, O. (1994). Magnetic resonance imaging analysis of age-related changes in the brains of individuals with Down's syndrome. Neurology 44, 1039–1045.

PubMed Abstract | Google Scholar

Kleschevnikov, A. M., Belichenko, P. V., Villar, A. J., Epstein, C. J., Malenka, R. C., and Mobley, W. C. (2004). Hippocampal long-term potentiation suppressed by increased inhibition in the Ts65Dn mouse, a genetic model of Down syndrome. J. Neurosci. 24, 8153–8160. doi: 10.1523/JNEUROSCI.1766-04.2004

PubMed Abstract | CrossRef Full Text | Google Scholar

Lanfranchi, S., Baddeley, A., Gathercole, S., and Vianello, R. (2012). Working memory in Down syndrome: is there a dual task deficit? J. Intellect. Disabil. Res. 56, 157–166. doi: 10.1111/j.1365-2788.2011.01444.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Lanfranchi, S., Jerman, O., Dal Pont, E., Alberti, A., and Vianello, R. (2010). Executive function in adolescents with Down Syndrome. J. Intellect. Disabil. Res. 54, 308–319. doi: 10.1111/j.1365-2788.2010.01262.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Lee, N. R., Fidler, D. J., Blakeley-Smith, A., Daunhauer, L., Robinson, C., and Hepburn, S. L. (2011). Caregiver report of executive functioning in a population-based sample of young children with Down syndrome. Am. J. Intellect. Dev. Disabil. 116, 290–304. doi: 10.1352/1944-7558-116.4.290

PubMed Abstract | CrossRef Full Text | Google Scholar

Liogier d'Ardhuy, X., Spychaj, L., Nave, S., and Khwaja, O. (2013). “Clinical drug development in down syndrome: exploratory assessments,” in Paper Presented at the Cognition in Down syndrome: Molecular, Cellular and Behavioral Features and the Promise of Pharmacotherapeutics, Washington, DC, USA (Washington, DC).

Lott, I. T., and Dierssen, M. (2010). Cognitive deficits and associated neurological complications in individuals with Down's syndrome. Lancet Neurol. 9, 623–633. doi: 10.1016/S1474-4422(10)70112-5

PubMed Abstract | CrossRef Full Text | Google Scholar

Määttä, T., Tervo-Määttä, T., Taanila, A., Kaski, M., and Iivanainen, M. (2006). Mental health, behaviour and intellectual abilities of people with Down syndrome. Downs. Syndr. Res. Pract. 11, 37–43. doi: 10.3104/reports.313

PubMed Abstract | CrossRef Full Text | Google Scholar

Martínez-Cué, C., Martínez, P., Rueda, N., Vidal, R., Garcia, S., Vidal, V., et al. (2013). Reducing GABAA α5 receptor-mediated inhibition rescues functional and neuromorphological deficits in a mouse model of down syndrome. J. Neurosci. 33, 3953–3966. doi: 10.1523/JNEUROSCI.1203-12.2013

PubMed Abstract | CrossRef Full Text | Google Scholar

Miller, J. F. (1998). Profiles of Language Development in Children with Down syndrome. Baltimore, MD: Paul H. Brookes.

Nadel, L. (2003). Down's syndrome: a genetic disorder in biobehavioral perspective. Genes Brain Behav. 2, 156–166. doi: 10.1034/j.1601-183X.2003.00026.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Oremus, M., Oremus, C., Hall, G. B., and McKinnon, M. C. (2012). Inter-rater and test-retest reliability of quality assessments by novice student raters using the Jadad and Newcastle-Ottawa Scales. BMJ Open 2:e001368. doi: 10.1136/bmjopen-2012-001368

PubMed Abstract | CrossRef Full Text | Google Scholar

Parker, S. E., Mai, C. T., Canfield, M. A., Rickard, R., Wang, Y., Meyer, R. E., et al. (2010). Updated National Birth Prevalence estimates for selected birth defects in the United States, 2004-2006. Birth Defects Res. A Clin. Mol. Teratol. 88, 1008–1016. doi: 10.1002/bdra.20735

PubMed Abstract | CrossRef Full Text | Google Scholar

Pearson (2004). Clinical Evaluation of Language Fundamentals^®-Preschool-2 (CELF^®-Preschool-2). Available online at: http://www.pearsonclinical.com/language/products/100000316/celf-preschool-2-celfpreschool2.html?Pid=015-8034-945&Mode=summary

Pennington, B. F., Moon, J., Edgin, J., Stedron, J., and Nadel, L. (2003). The neuropsychology of Down syndrome: evidence for hippocampal dysfunction. Child Dev. 74, 75–93. doi: 10.1111/1467-8624.00522

PubMed Abstract | CrossRef Full Text | Google Scholar

Pinter, J. D., Eliez, S., Schmitt, J. E., Capone, G. T., and Reiss, A. L. (2001). Neuroanatomy of Down's syndrome: a high-resolution MRI study. Am. J. Psychiatry 158, 1659–1665. doi: 10.1176/appi.ajp.158.10.1659

PubMed Abstract | CrossRef Full Text | Google Scholar

Potier, M. C., Braudeau, J., Dauphinot, L., and Delatour, B. (2014). Reducing GABAergic inhibition restores cognitive functions in a mouse model of Down syndrome. CNS Neurol. Disord. Drug Targets 13, 8–15. doi: 10.2174/18715273113126660185

PubMed Abstract | CrossRef Full Text | Google Scholar

Randolph, C. (2006). Repeatable Battery for the Assessment of Neuropsychological Status (RBANS)^™. Available online at: http://images.pearsonclinical.com/images/PDF/technical_reports/RBANS.pdf (Retrieved June 3, 2015).

Randolph, C., Tierney, M. C., Mohr, E., and Chase, T. N. (1998). The Repeatable Battery for the Assessment of Neuropsychological Status (RBANS): preliminary clinical validity. J. Clin. Exp. Neuropsychol. 20, 310–319. doi: 10.1076/jcen.20.3.310.823

PubMed Abstract | CrossRef Full Text | Google Scholar

Raz, N., Torres, I. J., Briggs, S. D., Spencer, W. D., Thornton, A. E., Loken, W. J., et al. (1995). Selective neuroanatomic abnormalities in Down's syndrome and their cognitive correlates: evidence from MRI morphometry. Neurology 45, 356–366.

PubMed Abstract | Google Scholar

Roid, G.H., and Miller, L.J. (1997). Leiter International Performance Scale-Revised: Examiner's Manual. Wood Dale, IL: Stoelting Co.

Google Scholar

Schmidt-Sidor, B., Wisniewski, K. E., Shepard, T. H., and Sersen, E. A. (1990). Brain growth in Down syndrome subjects 15 to 22 weeks of gestational age and birth to 60 months. Clin. Neuropathol. 9, 181–190.

PubMed Abstract | Google Scholar

Silverman, W. (2007). Down syndrome: cognitive phenotype. Ment. Retard. Dev. Disabil. Res. Rev., 13, 228–236. doi: 10.1002/mrdd.20156

PubMed Abstract | CrossRef Full Text | Google Scholar

U.S. Department of Health and Human Services and National Institutes of Health. (2014). National Institutes of Health Research Plan on Down Syndrome: Down Syndrome Directions. Available online at: https://www.nichd.nih.gov/publications/pubs/Documents/DSResearchPlan_2014.pdf

Vicari, S. (2001). Implicit versus explicit memory function in children with Down and Williams syndrome. Downs. Syndr. Res. Pract. 7, 35–40. doi: 10.3104/reports.112

PubMed Abstract | CrossRef Full Text | Google Scholar

World Health Organization (WHO) (2015). Genomic Resource Centre: Genes and Human Disease, Genes and Chromosomal Diseases. Available online at: http://www.who.int/genomics/public/geneticdiseases/en/index1.html (Retrieved June 3, 2015).

Zigman, W. B., Devenny, D. A., Krinsky-McHale, S. J., Jenkins, E. C., Urv, T. K., Wegiel, J., et al. (2008). Alzheimer's disease in adults with Down syndrome. Int. Rev. Res. Ment. Retard. 36, 103–145. doi: 10.1016/S0074-7750(08)00004-9

PubMed Abstract | CrossRef Full Text | Google Scholar