Adolescent Executive Dysfunction in Daily Life: Relationships to Risks, Brain Structure and Substance Use

During adolescence, problems reflecting cognitive, behavioral and affective dysregulation, such as inattention and emotional dyscontrol, have been observed to be associated with substance use disorder (SUD) risks and outcomes. Prior studies have typically been with small samples, and have typically not included comprehensive measurement of executive dysfunction domains. The relationships of executive dysfunction in daily life with performance based testing of cognitive skills and structural brain characteristics, thought to be the basis for executive functioning, have not been definitively determined. The aims of this study were to determine the relationships between executive dysfunction in daily life, measured by the Behavior Rating Inventory of Executive Function (BRIEF), cognitive skills and structural brain characteristics, and SUD risks, including a global SUD risk indicator, sleep quality, and risky alcohol and cannabis use. In addition to bivariate relationships, multivariate models were tested. The subjects (n = 817; ages 12 through 21) were participants in the National Consortium on Alcohol and Neurodevelopment in Adolescence (NCANDA) study. The results indicated that executive dysfunction was significantly related to SUD risks, poor sleep quality, risky alcohol use and cannabis use, and was not significantly related to cognitive skills or structural brain characteristics. In multivariate models, the relationship between poor sleep quality and risky substance use was mediated by executive dysfunction. While these cross-sectional relationships need to be further examined in longitudinal analyses, the results suggest that poor sleep quality and executive dysfunction may be viable preventive intervention targets to reduce adolescent substance use.

Introduction

Executive functioning is a broad construct comprised of behavioral competencies and cognitive skills, including attention, inhibition, mental flexibility, working memory, self-monitoring, planning, and emotional control (Chan et al., 2008). These self-control capabilities and higher order cognitive skills support the optimization of responding to environmental and personal challenges so as to maximize reward opportunities and achieve long-term goals (Best and Miller, 2010; Diamond and Lee, 2011). Problems in executive functioning in daily life (i.e., executive dysfunction) and cognitive skills assessed by performance-based testing may, in fact, reflect different constructs.

Characteristics reflecting executive dysfunction has been found to be associated with substance use disorder (SUD) risks and outcomes (Clark and Winters, 2002; Tarter et al., 2003; Clark et al., 2008). Pertinent indicators include dysregulation in cognitive (e.g., attention deficits), behavioral (e.g., impulsivity), and affective (e.g., affective lability) domains (Clark and Winters, 2002; Vanyukov et al., 2009; Clark et al., 2012). Most studies on these relationships have not explicitly and comprehensively measured executive dysfunction dimensions, however, leaving remaining questions on the extent to which SUD risks and outcomes may relate to specific dimensions or global executive dysfunction indicators.

Several studies have examined executive dysfunction in relationship to SUD risks and outcomes using a comprehensive multidimensional executive dysfunction measure, the Behavior Rating Inventory of Executive Function (BRIEF-SR: Gioia et al., 2002a,b; Roth et al., 2015). Expressly developed to measure eight executive dysfunction dimensions, the BRIEF has been demonstrated to be a valid and practical tool in school and clinical settings as well as in research (Egeland and Fallmyr, 2010; Roth et al., 2015). The BRIEF has been utilized in adolescent research to study executive dysfunction in relationship to SUD risks and outcomes, including disruptive behavior disorders (Wang et al., 2012; Long et al., 2015), sleep problems (Anderson et al., 2009; Caruso et al., 2014), academic achievement (Langberg et al., 2013; Samuels et al., 2016), performance-based cognitive tests (Shimoni et al., 2012; Long et al., 2015), brain structure and function (Clark et al., 2012; Ziegler et al., 2013; Zhai et al., 2015), and substance use (Clark et al., 2012). While comprehensively measuring executive dysfunction dimensions, most of these prior studies have had small sample sizes. Compared with prior studies, the present study includes a broader array of assessment domains with a considerably larger sample.

Among adolescents, poor sleep has been found to be associated with difficulties that may reflect executive dysfunction, such as inattention and depression (Millman, 2005). Limited research has specifically addressed the relationship between sleep quality and expressly measured executive dysfunction among adolescents. In 236 healthy adolescents (age 13–16 years: Anderson et al., 2009), increased sleepiness was significantly associated with more problems on dimensions including Working Memory, Task Planning, Orderliness, and Task Completion (i.e., BRIEF Metacognition) and not associated with Inhibitory Control, Flexibility, Emotional Control and Monitoring (i.e., BRIEF Behavioral Regulation). Sleep problems and circadian misalignment have been found to predict adolescent alcohol and other substance use (Hasler and Clark, 2013; Hasler et al., 2014, 2016, 2017). A study with a larger sample is needed to determine whether the relationships observed between executive dysfunction and poor sleep (Anderson et al., 2009) can be confirmed. Since poor sleep may influence executive dysfunction and executive dysfunction may, in turn, influence substance use, an examination of the relationships among these characteristics may suggest mechanisms, preventive intervention targets, and directions for future research.

The construct of executive functioning refers to behaviors in daily life as well as specific cognitive skills. A hypothesis about executive functioning in daily life is that variations in specific cognitive skills reflect the capabilities needed for effective functioning (Willcutt et al., 2005). To the extent that variations in objectively assessed cognitive skills correlate with executive dysfunction, such testing may be useful in depicting a mechanism for functional deficits. Relevant constructs assessed by performance-based cognitive testing include attention (e.g., Continuous Performance Test: Kurtz et al., 2001) and working memory (e.g., N-Back Test: Ragland et al., 2002). Several studies with small adolescent samples have noted, however, that performance-based cognitive tests and executive dysfunction ratings have little or no correspondence (Mahone et al., 2009; Cyders and Coskunpinar, 2012; Boschloo et al., 2014; Long et al., 2015; see Toplak et al., 2013 for review), with some exceptions (e.g., BRIEF and Working Memory by cognitive testing: Faridi et al., 2015). These studies suggest that cognitive testing of these constructs may not be particularly informative in understanding executive dysfunction in daily life. The present study examined these relationships in a large sample.

Executive dysfunction may reflect delays or deficits in neuromaturation. To the extent that variations in structural brain characteristics are found to correlate with executive dysfunction, such findings would support a hypothesis that specific observable brain characteristics reflect the neurobiological foundation for executive functioning. Prefrontal cortex (PFC) development has been hypothesized to be the neurobiological foundation for maturing executive functioning during adolescence, with the interaction of PFC with other functionally specialized brain regions critical for integrative executive functions (Spear, 2000). During adolescence, the maturation of executive cognitive skills occurs in parallel with increasing organization or integrity of white matter tracts projecting to PFC (Klingberg et al., 1999; Chambers et al., 2003; Takahashi et al., 2004; Lenroot and Giedd, 2006; Ashtari et al., 2007; Paus, 2010). The frontoparietal network (Fassbender et al., 2006), including tracts such as the superior longitudinal fasciculus (SLF) that connect the frontal and parietal cortex. The delay or disruption in the maturation of white matter integrity has been implicated as a neurobiological substrate for executive dysfunction (Lipton et al., 2009; Skranes et al., 2009; Clark et al., 2012). A few studies with adolescents have examined executive dysfunction, measured by BRIEF, in relationship to structural brain characteristics. Among 35 adolescents with SUD and 20 controls, worse executive dysfunction was significantly correlated with less PFC and parietal white matter integrity by diffusion tensor imaging fractional anisotropy (FA: Clark et al., 2012). Among 35 children and adolescents (Mahone et al., 2009), problems indicated on the BRIEF Working Memory scale were significantly correlated with smaller frontal gray matter volume, but not with temporal, parietal or occipital gray matter volume. In the NIH MRI study (Faridi et al., 2015), BRIEF Inhibitory Control was not significantly correlated with cortical gray thickness, while BRIEF Working Memory and Emotional Control showed greater cortical thickness associated with fewer problems only in the parahippocampal gyri. These studies do not clearly establish consistent relationships between adolescent executive dysfunction and structural brain characteristics, and the present larger study will clarifiy these relationships.

To the extent that executive dysfunction is found to correlate with the early development of risky substance use patterns, such findings would support the hypothesis that deficits in self-control reflected in executive dysfunction may contribute to SUD. In a few adolescent samples, executive dysfunction, indicated by BRIEF, have been found to be associated with substance involvement. BRIEF Global Composite (GEC) has been found to be significantly different among adolescents with SUD (n = 35) and control adolescents (n = 20), with 29% of the SUD group showing scores considered to indicate clinical problems (i.e., ≥70; Clark et al., 2012). In this sample, BRIEF GEC mediated the relationship between disruption of frontoparietal white matter integrity and cannabis symptoms. More everyday executive functioning problems indicated by BRIEF scores have also been observed in young adults with substance use (Hadjiefthyvoulou et al., 2012). More extensive study of these relationships is needed, particularly the examination of the relationship between executive dysfunction and the adolescent onset of risky substance use patterns.

This study examined these relationships at the initial assessment among subjects in National Consortium on Alcohol and Neurodevelopment in Adolescents (NCANDA), providing the opportunity to examine executive dysfunction in a relatively large, representative sample with a broad array of hypothetically related psychosocial, neurocognitive and brain measures. The aims of this study were to determine the relationships between executive dysfunction in daily life, measured by the Behavior Rating Inventory of Executive Function (BRIEF), cognitive skills and structural brain characteristics, and SUD risks, including a global SUD risk indicator, sleep quality, and risky alcohol and cannabis use. In addition to bivariate relationships, multivariate models were tested.

Methods

Participants

NCANDA participants were 831 youth ranging in age from 12 to 21 years. NCANDA examines adolescent neurodevelopmental risks for and outcomes of alcohol use in a large, multisite, accelerated longitudinal design (see Brown et al., 2015 for additional details). NCANDA subjects were recruited from five sites: Duke University, University of Pittsburgh, Oregon Health and Science University, University of California, San Diego, and SRI International. For this analysis, 10 subjects were missing BRIEF, and 4 were excluded for invalid results (see below). The demographic characteristics were as follows: age: mean: 16.2 years, s.d. 2.5, range: 12.0–21.9; female: n = 417, male: n = 400; race: white: n = 586 (71.7%), African American: 95 (11.6%), Asian: n = 62 (7.6%); Native American: n = 3 (<1%); Pacific Islander: n = 4 (<1%); multiple: n = 67 (8.2%); ethnicity: Hispanic: n = 96 (11.8%), non-Hispanic: n = 721 (88.2%). These race and ethnicity proportions are similar to the U.S. population (Brown et al., 2015). Most subjects (n = 692, 83%) had little or no alcohol use history, and a subsample (n = 139, 17%) had a history of risky alcohol use based on exceeding established alcohol use thresholds (National Institute on Alcohol Abuse and Alcoholism, 2011). Youth at increased risk for problematic alcohol use, based on one or more risk factors including early alcohol use, family SUD history, disruptive behavior disorder symptoms, or two or more anxiety or depression symptoms, comprised approximately 50% of the sample. The institutional review board at each site approved the study. Adult participants consented to participate, and minors provided assent with parental or legal guardian consent.

Design

NCANDA uses an accelerated longitudinal design (Duncan et al., 1996, 2006), sampling subjects from a broad age span with subsequent follow-up assessments to characterize development across an expansive period. At the initial assessment, youth completed a comprehensive assessment of substance use, psychiatric symptoms and diagnoses, personality factors, and functioning in major life domains (Brown et al., 2015); a neurocognitive battery (Sullivan et al., 2016), and a neuroimaging assessment with structural and diffusion tensor imaging (Pfefferbaum et al., 2016; Pohl et al., 2016). One parent of each youth also completed an assessment. These analyses utilized the initial assessment data.

Measures

BRIEF

Behavior Rating Inventory of Executive Function-Self-Report Version (BRIEF-SR: Baron, 2000; Gioia et al., 2002a,b; Guy et al., 2004; Roth et al., 2015): The BRIEF-SR is an 80-item adolescent self-report behavior rating scale of purposeful, goal-directed, problem-solving behavior. For each item, the subject is asked: “Over the past 6 months, how often has each of the following behaviors been a problem?” The response choices are “Often” (3 points), “Sometimes” (2 points) and “Never” (1 point). The instrument yields a summary score, the Global Executive Composite (GEC), two composite indices, and eight scales: (1) The Inhibitory Control scale (13 items) assesses inhibitory control and impulsivity (e.g., “I have problems waiting my turn,” “I don't think of consequences before acting,” “I get out of control more than my friends”). (2) The Flexibility scale (10 items), including behavioral and cognitive characteristics, assesses the ability to make transitions and flexibly solve problems (e.g., “I have trouble changing from one activity to another”). (3) The Emotional Control scale (10 items) assesses the ability to modulate emotional responses in response to situational demands (e.g., “I overreact to small problems,” “I get upset easily”). (4) The Monitoring scale (5 items) assesses self-awareness of interpersonal strengths and weaknesses (e.g., “I don't know when my actions bother others”). (5) The Working Memory scale (12 items) assesses holding information in mind for the purpose of completing a task (e.g., “I forget instructions easily,” “I have trouble with jobs or tasks that have more than one step”). (6) The Task Planning scale (Plan: 13 items) assesses planning steps to complete a task and the anticipation of future consequences (e.g., “I don't plan ahead for school assignments,” “I don't think ahead about possible problems” “I have trouble carrying out the things that are needed to reach a goal, such as saving money for special needs, studying to get good grades, etc.”). (7) The Organization scale (Organize: 7 items) assesses the ability to keep work and school materials organized (e.g., “My backpack/schoolbag is disorganized”). (8) The Task Completion assesses the ability to complete school or work in a timely fashion by 10 items (e.g., “I have difficulty finishing a task on my own”). The Behavioral Regulation Index (BRI) combines Inhibit, Shift, Emotional Control, and Monitor scales (internal consistency: 0.96). The Metacognition Index (MCI) is comprised of Initiate, Working Memory, Plan and Organize, Task Monitor, and Organization of Materials subscales (internal consistency: 0.72). In addition, validity scales include the Inconsistency scale, which determines whether the subject responded in a consistent manner by comparing 10 pairs of similar items, and the Negativity scale (10 items), which determines whether the subject responds to selected items in an unusually negative manner. Raw scores are converted to age indexed t-scores, with higher scores indicating more problems. Subjects with missing (n = 10) or invalid (n = 4) BRIEF scores were excluded from all analyses.

Risk Factors for Alcohol Use Disorder (AUD)

The NCANDA sample (Brown et al., 2015) was configured to include approximately 50% of the sample at higher risk for problematic alcohol use based on screening evidence for one of the following: (1) early alcohol use (i.e., first standard drink before age 15 years old); (2) a family history of alcohol or other substance problems; (3) endorsement of one or more conduct disorder or antisocial personality disorder symptoms or t score ≥ 60 on the externalizing score of the Achenbach system of Empirically Based Assessments (ASEBA: Achenbach and Rescorla, 2001a,b); (4) endorsement of two or more internalizing symptoms or t ≥ 60 on ASEBA internalizing. Risk Density was calculated as the sum of the presence (1) or absence (0) of each of these characteristics (range: 0–4).

Subjective Sleep Quality

The Pittsburgh Sleep Quality Index (PSQI: Buysse et al., 1989) has been shown to be comprised of two factors, sleep efficiency and perceived sleep quality (Mollayeva et al., 2016). The PSQI has been validated in adolescent samples (de la Vega et al., 2015) and has been commonly used in adolescent research (e.g., Noone et al., 2014). The perceived sleep quality factor includes a subjective sleep quality item which correlates highly with the factor score and loads more strongly on this factor than do other items (Mollayeva et al., 2016). The subjective sleep quality item asks “During the past month, how would you rate your sleep quality overall?” with response options “very good,” “fairly good,” “fairly bad,” and “very bad.”

Performance Based Cognitive Tests

The NCANDA performance based cognitive testing protocol was designed to assess functional domains relevant for alcohol involvement risks and outcomes (see Sullivan et al., 2016 for details). The NCANDA cognitive and motor battery assessed eight domains: general ability, attention, abstraction, emotion, working memory, balance, and motor speed (Sullivan et al., 2016, 2017). Most of these domains were assessed with computer-administered WebCNP tests (Gur et al., 2010). For examining cognitive skills that may be pertinent to executive dysfunction here, the domains of attention, emotion and working memory are particularly pertinent, and the examination of general ability may provide information on the global effects of problems in this arena. The functional domains and tests included here were: (1) Attention: Continuous Performance Test (Kurtz et al., 2001); (2) Emotion: Emotion Recognition Test (Gur et al., 2002), Measured Emotion Differentiation (Fossati, 2012); (3) Working Memory: Short Fractal N-Back Test (Ragland et al., 2002); and (4) General Ability: Vocabulary Test (Lee et al., 2014), WRAT-4 Math Calculations and Word Reading (Wilkinson and Robertson, 2006). These computer administered WebCNP tests were used to generate domain specific accuracy and speed (response time) z scores. In prior analyses, older age was associated with better scores on attention, emotion, and general ability (Sullivan et al., 2016), so age was used as a covariate in these analyses.

MRI Acquisition and Analysis

The NCANDA neuroimaging battery includes structural indices (Pfefferbaum et al., 2016) and diffusion tensor imaging (DTI: Pohl et al., 2016), and more detailed descriptions of the protocols may be found in those publications. Briefly, T1-weighted, 3D images were collected in the sagittal plane on systems from two manufacturers: 3T General Electric (GE) Discovery MR750 at three sites and 3T Siemens TIM TRIO scanners at two sites. The GE sites used an Array Spatial Sensitivity Encoding Technique (ASSET) for parallel and accelerated imaging with an 8-channel head coil and acquired an Inversion Recovery-Spoiled Gradient Recalled (IR-SPGR) echo sequence. The Siemens sites used a 12-channel head coil and parallel imaging and temporal acceleration with iPAT and acquired an MPRAGE sequence. Each site scanned the ADNI phantom on each day that participants were scanned. Analysis proceeded via the NCANDA NeuroInformatics Platform (Rohlfing et al., 2014) and involved skull stripping applied to the extracted maps. The SRI24 atlas-based analysis pipeline was used to identify intracranial volume (ICV), supratentorial volume (svol), and pons, corpus callosum, subcortical white matter (including the centrum semiovale), and lateral ventricular volumes. FreeSurfer (Dale et al., 1999) was used on skull-stripped data to create bilateral surface area, volume, and thickness of frontal, temporal, parietal, occipital, cingulate cortices derived from the Desikan-Killiany regions-of-interest (ROI) scheme (Desikan et al., 2006) plus the insular cortex. Volume was expressed in cc, surface area in cm², and thickness in mm. All ROIs were adjusted for linear scaling factors from the ADNI phantom (Clarkson et al., 2009). To acquire Diffusion-Weighted Images (DWI, a.k.a. diffusion tensor imaging or DTI), GE and Siemens sites applied a 2D Axial Spin Echo, Echo-Planar protocol, as well as a reverse phase acquisition of the 2D Axial Spin Echo-Planar protocol for B0-field inhomogeneity spatial distortion correction. To achieve common anatomical coordinates across subjects, each subject's fractional anisotropy (FA) data set was registered to the FA channel of the SRI24 atlas. Cortical volume and thickness were smaller with increasing age, and cortical volumes greater in males than females (Pfefferbaum et al., 2016). For DTI indices, increasing age was associated with higher FA and lower diffusivity measures (Pohl et al., 2016). Consequently, statistical analyses on structural brain characteristics in the present study were controlled for age and sex.

Substance Use

Past and recent alcohol and other substance use were determined by the Customary Drinking and Drug Use Record (CDDR: Brown et al., 1998). The measure includes items on alcohol and marijuana use, including use frequency in the past year, and the maximum number of drinks in a drinking episode during the past year. At Risk Alcohol Use: Alcohol use frequency in the past year has been found to useful for identifying use patterns associated with alcohol use disorder (AUD) among adolescents (e.g., Chung et al., 2012; Clark et al., 2016). The National Institute on Alcohol Abuse and Alcoholism (NIAAA) Alcohol Screening and Brief Intervention for Youth: A Practitioner's Guide (NIAAA Youth Guide) recommends age specific stratified past year alcohol use frequency thresholds to define low, moderate and high risk for AUD. Moderate Risk is defined at age 12–15 as: ≥1 days; ages 16–17: ≥3 days; ages 18: ≥12 days. High Risk is defined at age 12–15 as: ≥3 days; age 16: ≥12 days; age 17: ≥24 days; age 18: ≥52 days. Subjects below these thresholds were classified as Low Risk. Binge Alcohol Use: While the traditional definition of a drinking binge has typically been applied across development, binge definitions appropriate for younger adolescents have been developed to account for smaller body size among youth (Donovan, 2009). Using the “lifetime greatest number of drinks” response, age-specific binge thresholds were calculated as follows: ages 9 to 13 years: ≥3 drinks; 14 or 15 years: ≥4 for males, ≥3 for females; 16 or 17 years: ≥5 for males, ≥3 for females.

Statistical Analyses

Overall NCANDA data management has been described (Rohlfing et al., 2014). (NCANDA Data releases used in these analyses: 000001_V1; 00010_V3; 00011; 00012_V2.) The analyses presented to test hypotheses were by analysis of variance (ANOVA) for categorical variables or Pearson correlations for continuous variables. Covariates for all analyses were age, sex and SES. A sequential procedure (Ludbrook, 1998) was used to reduce Type 1 error or family wise error rate, first testing the global hypothesis represented by the BRIEF Global Composite (i.e., GEC), followed by tests examining the BRIEF indices and scales with Šidák corrections (Šidák, 1967; Ludbrook, 1998). For analyses examining BRIEF composite, indices and scales, BRIEF GEC was examined first (p < 0.05) and, where the relationship between GEC and the dependent measure were significant, relationships with Behavioral Regulation Index (BRI) and Metacognition Index (MCI), then the eight scales, were interpreted. Corrections for multiple tests were implemented as follows: Behavioral Regulation Index or BRI and Metacognition Index or MCI: α = 0.05 for 2 tests: p < 0.025; 8 scales: α = 0.05 for 8 tests: p < 0.0064). To reduce type 1 error in sets of analyses examining correlations between multiple continuous variables (i.e., cognitive test scores and brain structure variables) and BRIEF GEC, the Šidák procedure was applied, in which the overall number of comparisons was taken into consideration to determine the significance threshold (Cognitive skill domains, with scores for accuracy and speed: α = 0.05/2 or p < 0.025; MR Structural Gray Indices: α = 0.05/18 or p < 0.0028; DTI: α = 0.05/32 or p < 0.0016). For variables with significant relationships with BRIEF GEC, multivariate models were constructed to test mediation hypotheses (Baron and Kenny, 1986).

Results

BRIEF Description

For subjects with valid BRIEF data (n = 817), mean scale t-scores ranged from 43.5 ± 8.6 (BRIEF Inhibitory Control) to 46.1 ± 9.9 (BRIEF Task Completion), with composite t-scores also in this range (BRI: 43.6 ± 9.4; MCI: 44.6 ± 10.6; GEC: 43.9 ± 10.4).

Demographic Characteristics

BRIEF composite scores did not significantly differ by gender (e.g., GEC: F: 44.0 ± 11.1; M: 43.8 ± 9.6; t = 0.2, d.f. 815, p = 0.8). BRIEF GEC was not significantly correlated with age (r = 0.06, n = 817, p = 0.10). BRIEF GEC was significantly correlated with SES (r = −0.15, n = 731, p < 0.001). Race (White: n = 586, 43.7 ± 10.1; African American: n = 95, 43.3 ± 11.7; Asian: n = 62, 43.9 ± 8.9; Other: n = 67, 46.6 ± 12.0) was not significantly associated with BRIEF GEC (F = 1.7, d.f. 3,806, p = 0.16). Ethnicity (Non-Hispanic: n = 721, 43.2 ± 11.9; Hispanic: 49.1 ± 11.9) was significantly associated with BRIEF GEC (F = 28.4, 1,815, p < 0.001). To a substantial extent, this relationship was accounted for by SES (multivariate model: n = 725; SES: F = 13.1, p < 0.001; Race: F = 1.6, p = 0.6; Ethnicity: F = 4.9, p = 0.03).

NCANDA Risk Density

Risk Density (Table 1) was determined by summing the number of risks present (range: 0–4; 0: n = 381, 46.6%; 1: 276, 33.8%; 2: 119, 14.6%; 3: 37, 4.5%; 4: 4, 0.5%). Due to few participants with 4 risk characteristics, participants with 3 or 4 risk factors were combined for analyses. Risk Density was significantly associated with BRIEF GEC, with higher Risk Density associated with greater dysfunction (Table 1; Figure 1). All BRIEF indices and scales were similarly significantly related to Risk Density. Abnormal BRIEF GEC scores (≥70), present in 2% of the sample, were associated with Risks (0 Risks, 0%; 1 risk, 2%, 2 risks, 4%, 3 or 4 Risks, 20%: Likelihood Ratio χ² = 68.0, d.f. = 3, p < 0.001). Risk Density was significantly associated with At Risk Alcohol Use (F = 40.5, p < 0.001), Binge Alcohol Episodes (F = 7.4, p < 0.01), and Marijuana Use (F = 10.3, p < 0.01) (Table 8).

TABLE 1

Table 1. BRIEF global composite, indexes and scales by NCANDA risk density categories.

FIGURE 1

Figure 1. Box plot of BRIEF global composite by NCANDA risk density categories. The figure shows box plots for NCANDA Risk Density categories. The box plot represents the interquartile range (IQR), with the shaded box representing the second and third quartiles and center demarcations indicating the median. The whiskers represent the maximum and minimum values up to 1.5 × IQR, and the circles represent values beyond 1.5 × IQR.

Sleep Quality

Sleep Quality was significantly associated with BRIEF GEC, with poorer slep quality associated with greater dysfunction (Table 2; Figure 2). All BRIEF indices and scales were similarly significantly related to Sleep Quality. Sleep Quality was significantly associated with At Risk Alcohol Use (F = 5.6, p < 0.05), Binge Alcohol Episodes (F = 3.9, p < 0.05), and Marijuana Use (F = 5.8, p < 0.05) (Table 8).

TABLE 2

Table 2. BRIEF global composite, indexes and scales by sleep quality categories.

FIGURE 2

Figure 2. Box plot of BRIEF global executive composite by sleep quality categories. The figure shows box plots for Sleep Quality categories. The box plot represents the interquartile range (IQR), with the shaded box representing the second and third quartiles and center demarcations indicating the median. The whiskers represent the maximum and minimum values up to 1.5 × IQR, and the circles represent values beyond 1.5 × IQR.

Cognitive Skill Domain Scores

Cognitive Skill Domain Scores were not significantly correlated with BRIEF GEC (Table 3). Note that, while a correction for two tests per domain (i.e., accuracy and speed) was thought applicable, a less stringent threshold of p < 0.05 did not change the interpretation of the results. Since there may be some interest in the observed correlations for specific variable pairs (e.g., Working Memory by BRIEF scale by Cognitive Skill Domain), the full table of analyses is presented.

TABLE 3

Table 3. BRIEF global composite, indexes and scales by cognitive skill domain scores.

Cortical Structure

Using a correction for multiple comparisons for tests across the BRIEF GEC by structural variables matrix (i.e., 18 tests), BRIEF GEC was not significantly correlated with gray matter volume, cortical thickness or cortical surface area in frontal temporal, parietal, occipital, cingulate, or insula regions (Table 4).

TABLE 4

Table 4. BRIEF global composite by MR structural gray segment volume, thickness and surface area.

DTI

Using a correction across the presented BRIEF GEC by structural variables (i.e., 32 tests), BRIEF GEC was not significantly correlated with DTI indices for fasciculi and tracts by region or DTI variable (Table 5).

TABLE 5

Table 5. BRIEF global composite by DTI indices for fasciculi and tracts.

Alcohol and Cannabis Use

At Risk Alcohol Use Category was determined by the past year alcohol use days frequency thresholds described in the National Institute on Alcohol Abuse and Alcoholism Youth Guide (2011). Overall (Table 6), 83% (n = 676) were Low Risk, 12% (n = 95) were Moderate Risk, and 5% (n = 41) were High Risk. At Risk Alcohol Use Category was significantly related to BRIEF GEC (F = 7.0, d.f. 2,723, p = 0.001), with higher risk associated with more problems. At Risk Alcohol Use Category was significantly associated with BRIEF BRI and MCI, and scales including Inhibitory Control, Emotional Control, and Task Planning.

TABLE 6

Table 6. At Risk Alcohol Use Frequency x BRIEF scales.

Age Defined Binge Alcohol Use

Past year age defined binge alcohol use (Table 7) was present in 129 subjects (15.9%). Including sex, age and SES as covariates, Age Defined Binge Alcohol Use was significantly related to BRIEF GEC (F = 11.1, d.f. 1,721, p = 0.001), with the presence of at least one binge in the past year associated with more problems. Age Defined Binge Alcohol Use was associated with more problems on BRIEF BRI and MCI, as well as on the including Inhibitory Control scale.

TABLE 7

Table 7. Past year age defined binge and marijuana use × BRIEF scales.

Cannabis Use

Past year cannabis use was present in 123 subjects (Table 7: 15.2%). Cannabis Use was significantly related to BRIEF GEC (F = 9.1, d.f. 1,720, p = 0.003), with the presence of cannabis use in the past year associated with more problems. Cannabis Use was associated with more problems on BRIEF BRI and MCI, as well as scales including Inhibitory Control, Emotional Control, and Task Planning.

Multivariate Models

For variables shown to be significantly related to BRIEF GEC (i.e., NCANDA Risk Density and Sleep Quality), multivariate models were tested (Table 8). NCANDA Risk Density was significantly related to Past Year At Risk Alcohol Use Frequency, Age Defined Binge Alcohol Use and Cannabis Use (i.e., substance use). In multivariate models including BRIEF GEC, the relationship between Risk Density and substance use variables diminished but remained significant, suggesting that mediation was not demonstrated. Sleep Quality was significantly related to substance use variables. In multivariate models including BRIEF GEC, the relationship between Sleep Quality and substance use variables was not statistically significant, suggesting mediation. In a model with NCANDA Risk Density, Sleep Quality and BRIEF GEC, the relationship between NCANDA Risk Density and substance use remained significance while Sleep Quality was not significantly related to substance use.

TABLE 8

Table 8. Contributions to ANOVA models of substance use outcomes.

Discussion

In NCANDA, BRIEF (Guy et al., 2004) was utilized as an ecologically valid complement to performance based cognitive testing to measure executive functioning constructs. While BRIEF scores were noted to be, on average, somewhat lower than might be expected from the scale construction samples, subsequent studies have similarly noted that normative samples have mean calculated t-scores similar to the NCANDA sample (Roth et al., 2015). BRIEF scores were not related to age, sex, or race, and showed a significant relationship with SES. Prior studies have shown relationships between SES and executive functioning, with attributions of this correlation interpreted as related to parent education and other home and family environment characteristics (Hackman et al., 2015).

As expected, higher BRIEF scores were systematically correlated with NCANDA Risk Density. Previous studies have indicated that characteristics related to executive functioning are associated with SUD risk indicators, including externalizing characteristics (Familiar et al., 2015; Long et al., 2015), internalizing characteristics (Clark et al., 1997), family SUD history (Tapert and Brown, 2000), and the early adolescent onset of alcohol use (Tarter et al., 2003). However, the multivariate models indicated that the inclusion of BRIEF was accompanied by only a modest reduction in the relationship between NCANDA Risk Density and substance use, suggesting that the mediation hypothesis was not supported. These analyses of cross-sectionally collected data were not ideal for determining directional influences, and subsequent NCANDA analyses will be able to further examine the extent to which the relationship between risk factors and later substance use may be mediated by executive dysfunction.

Poor sleep quality was significantly and consistently correlated with all executive dysfunction dimensions. While prior research has suggested that sleep problems are associated with executive dysfunction in daily life, the robust correlations observed here indicates a more extensive relationship than has been previously reported. Since prior research utilizing BRIEF in relationship to sleep has involved smaller samples, the present finding may benefit from greater statistical power. The multivariate models indicated that the inclusion of BRIEF was accompanied by a reduction in the relationship between Sleep Quality and substance use, indicating that the mediation hypothesis was supported. Since the present findings are based on cross-sectional data, however, analyses informed by changes in these relationships over time will be undertaken in the course of the NCANDA study. In addition, polysomnography being examined in an NCANDA subset will complement subjective sleep assessments (Baker et al., 2016). Sleep difficulties have been shown to predict problematic alcohol use (Hasler and Clark, 2013; Hasler et al., 2014), and subsequent NCANDA analyses will be able to examine the extent to which executive dysfunction mediates this relationship over the course of adolescent development.

The self-report of executive dysfunction in daily life assessed by BRIEF were not significantly correlated with performance based cognitive test results. While one might expect there to be some correspondence between these indicators, our results are consistent with several prior studies. A recent review of 20 studies (Toplak et al., 2013) on the relationship between self-report and performance-based executive functioning assessments found that, of 286 relevant correlations, only 68 (24%) were statistically significant, and the median correlation was only 0.19. The authors concluded that these approaches generally assess different underlying constructs. The results here were consistent with these observations. Broadly conceived, performance-based cognitive tests and BRIEF scores assess executive functioning dimensions. However, our results, consistent with prior studies (Toplak et al., 2013), indicate that executive dysfunction in daily life, measured by BRIEF, and performance based cognitive testing measure distinct constructs.

BRIEF Global Composite scores were not significantly correlated with cortical structure or DTI indicators. These findings were consistent with some prior observations (e.g., Faridi et al., 2015). The current study had a substantially larger and more representative sample than some other pertinent prior studies with positive findings (Mahone et al., 2009; Clark et al., 2012). Alternative statistical approaches, such as latent variable modeling, may provide additional insights. For example, among 286 healthy children and adolescents, a latent variable modeling approach revealed a systematic pattern of relationships between cortical networks and BRIEF scores (Ziegler et al., 2013). The examination of network based brain activation patterns, using techniques such as resting state MRI, may show relationships between functional brain development and executive functioning difficulties (Fair et al., 2009; Casey et al., 2016). The neurobiological foundations of executive dysfunction may be more reflected in functional MRI indicators of activation during tasks that require cognitive and behavioral skills in this arena. For example, among 59 young adolescents (ages 12–15), BRIEF cognitive flexibility was associated with orbitofrontal cortex activation during a behavioral inhibition task (Zhai et al., 2015).

Consistent with prior studies (Clark et al., 2012; Hadjiefthyvoulou et al., 2012), BRIEF scores were associated with indicators of risky substance use, including a frequency of alcohol use indicating risk for AUD, age defined binge drinking, and marijuana use. Difficulties with executive functioning and risky substance use may reflect both preexisting psychological dysregulation and substance use resulting in disruption of executive functioning (Clark et al., 2012). While the cross-sectional structure of these NCANDA data from the initial assessment do not support interpretations on the direction of the observed associations, multivariate models were presented that may suggest directions for future studies. The age range in this study was broad, a feature which limits the size of subsamples representing each adolescent stage. For this examination of the initial assessment data, the sample was insufficient to subgroup subjects by age. When data collection for NCANDA has been completed, the acquisition of additional follow-up data in this accelerated longitudinal design and the application of statistical modeling techniques developed for such studies will support the examination of changes in these relationships over the course of adolescence. In addition, analyses with the longitudinal data will clarify the extent to which alternative hypotheses are reflected in observed relationships. While this sample size is larger than many other similar studies, the recruitment strategy and sample characteristics were designed to optimally provide data for later analyses taking advantage of the accelerated longitudinal design, and were not ideal for some of the analyses presented here.

In summary, these analyses found significant and systematic relationships between executive dysfunction in daily life and SUD risk indicators, including a composite risk indicator (i.e., NCANDA Risk Density), poor sleep quality, and risky alcohol and marijuana use. In addition, the study contributed to the available literature on the relationship between BRIEF scores and performance based cognitive testing, indicating that these methods assess complimentary but distinct constructs. Everyday executive functioning was not systematically related to cortical structure or white matter integrity by DTI. With the on-going collection and analysis of additional follow-up assessments with the measures described here, and the examination of functional brain characteristics and other variables, NCANDA will provide insights on the relationships among difficulties with everyday executive functioning, performance-based cognitive testing of skills reflecting executive functions, structural and functional brain development, and alcohol and other substance use effects on these neurodevelopmental trajectories.

These results suggest that executive dysfunction in daily life is not accounted for by deficits in the cognitive skills measured in the NCANDA protocol. This observation has clinical implications, in that the results here imply that such testing may not provide the expected insights into the origins of executive dysfunction. Also, executive dysfunction was not accounted for by cortical structural or DTI characteristics. While some support has been presented that cognitive tests relate to some related mental disorders (e.g., ADHD: Willcutt et al., 2005), these results are consistent with other negative studies in suggesting that cognitive testing and MRI studies may not provide clinical insights explaining executive dysfunction with typical adolescents.

Consistent with several prior studies (Hasler and Clark, 2013; Hasler et al., 2014, 2016, 2017), poor sleep quality was related to both executive dysfunction and risky substance use. These findings suggest interventions to improve sleep may benefit executive functioning as well as risky substance use. Individually applicable clinical interventions to improve sleep quality have demonstrated effectiveness in adolescents (Gradisar et al., 2014). On a more general level, early school times may be detrimental to sleep quality, later sleep times warrant consideration (Hasler et al., 2014; Minges and Redeker, 2016).

Interventions to improve executive functioning, in addition to having inherent value, may also be be a viable preventive intervention target. Interventions that improve inhibitory control in childhood, for example, hold promise for preventing SUD in adolescence (Riggs and Greenberg, 2009; Diamond and Lee, 2011).

Ethics Statement

This study was carried out in accordance with the recommendations of Human Subjects Institutional Review Boards as noted below with written informed consent from all subjects. Institutional review boards approved the study for each site. University of California, San Diego (UCSD) Human Subjects Institutional Review Boards approved the study at each site: University of California, San Diego; Oregon Health & Science University; SRI International; Duke University; University of Pittsburgh. The protocol was approved by these committees. All subjects gave written informed consent in accordance with the Declaration of Helsinki. For participants under 18 years old, a parent provided written informed consent and the under 18 participant provided assent. Participants 18 years old or older provided written informed consent.

Author Contributions

All authors (DC, TC, CM, BH, DF, BL, SB, ST, TB, KC, AP, ES, KP, IC, FB, MD, KN, and BN) were involved in study conception, data collection, and manuscript editing.

Funding

This work was supported by the U.S. National Institute on Alcohol Abuse and Alcoholism with co-funding from the National Institute on Drug Abuse, the National Institute of Mental Health, and the National Institute of Child Health and Human Development [NCANDA grant numbers: AA021695 (ST), AA021692 (SB+ST), AA021697 (AP+KP), AA021696 (IC+FB), AA021681 (MD), AA021690 (DC), AA021691 (BN)], and a fellowship from the Veteran's Affairs Office of Academic Affiliation (TB).

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

Achenbach, T. M., and Rescorla, L. A. (2001a). Manual for the ASEBA School-Age Forms and Profiles. Burlington, VT: University of Vermont, Research Center for Children, Youth, and Families.

Achenbach, T. M., and Rescorla, L. A. (2001b). Manual for the ASEBA Adult Forms and Profiles. Burlington, VT: University of Vermont, Research Center for Children, Youth, and Families.

Anderson, B., Storfer-Isser, A., Taylor, H. G., Rosen, C. L., and Redline, S. (2009). Associations of executive function with sleepiness and sleep duration in adolescents. Pediatrics 123, e701–e707. doi: 10.1542/peds.2008-1182

PubMed Abstract | CrossRef Full Text | Google Scholar

Ashtari, M., Cervellione, K. L., Hasan, K. M., Wu, J., McIlree, C., Kester, H., et al. (2007). White matter development during late adolescence in healthy males: a cross-sectional diffusion tensor imaging study. Neuroimage 35, 501–510. doi: 10.1016/j.neuroimage.2006.10.047

PubMed Abstract | CrossRef Full Text | Google Scholar

Baker, F. C., Willoughby, A. R., de Zambotti, M., Franzen, P. L., Prouty, D., Javitz, H., et al. (2016). Age-related differences in sleep architecture and electroencephalogram in adolescents in the NCANDA sample. Sleep 39, 1429–1439. doi: 10.5665/sleep.5978

PubMed Abstract | CrossRef Full Text | Google Scholar

Baron, I. S. (2000). Behavior Rating Inventory of Executive Function. Child Neuropsychol. 6, 235–238. doi: 10.1076/chin.6.3.235.3152

PubMed Abstract | CrossRef Full Text | Google Scholar

Baron, R. M., and Kenny, D. A. (1986). The moderator-mediator variable distinction in social psychology research: conceptual, strategic, and statistical considerations. J. Pers. Soc. Psychol. 51, 1173–1182.

Google Scholar

Best, J. R., and Miller, P. H. (2010). A developmental perspective on executive function. Child Dev. 81, 1641–1660. doi: 10.1111/j.1467-8624.2010.01499.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Boschloo, A., Krabbendam, L., Aben, A., de Groot, R., and Jolles, J (2014). Sorting test, tower test, and BRIEF-SR do not predict school performance of healthy adolescents in preuniversity education. Front. Psychol. 5:287. doi: 10.3389/fpsyg.2014.00287

PubMed Abstract | CrossRef Full Text | Google Scholar

Brown, S. A., Brumback, T., Tomlinson, K., Cummins, K., Thompson, W. K., Nagel, B. J., et al. (2015). The National Consortium on Alcohol and Neurodevelopment in Adolescence (NCANDA): a multi-site study of adolescent development and substance use. J. Stud. Alcohol Drugs 76, 895–908. doi: 10.15288/jsad.2015.76.895

CrossRef Full Text | Google Scholar

Brown, S. A., Myers, M. G., Lippke, L., Tapert, S. F., Stewart, D. G., and Vik, P. W. (1998). Psychometric evaluation of the customary drinking and drug use record (CDDR): a measure of adolescent alcohol and drug involvement. J. Stud. Alcohol 59, 427–438.

PubMed Abstract | Google Scholar

Buysse, D., Reynolds, C., Monk, T., Berman, S., and Kupfer, D (1989). The pittsburgh sleep quality index: a new instrument for psychiatric practice and research. Psychiatry Res. 28, 193–213

PubMed Abstract | Google Scholar

Caruso, N. C., Radovanovic, B., Kennedy, J. D., Couper, J., Kohler, M., Kavanagh, P. S., et al. (2014). Sleep, executive functioning and behavior in children and adolescents with type 1 diabetes. Sleep Med. 15, 1490–1499. doi: 10.1016/j.sleep.2014.08.011

PubMed Abstract | CrossRef Full Text | Google Scholar

Casey, B. J., Galvan, A., and Somerville, L. H. (2016). Beyond simple models of adolescence to an integrated circuit-based account: a commentary. Dev. Cogn. Neurosci. 17, 128–130. doi: 10.1016/j.dcn.2015.12.006

PubMed Abstract | CrossRef Full Text | Google Scholar

Chambers, R. A., Taylor, J. R., and Potenza, M. N. (2003). Developmental neurocircuitry of motivation in adolescence: a critical period of addiction vulnerability. Am. J. Psychiatry 160, 1041–1052. doi: 10.1176/appi.ajp.160.6.1041

PubMed Abstract | CrossRef Full Text | Google Scholar

Chan, R. C. K., Shum, D., Toulopoulou, T., and Chen, E. Y. H. (2008). Assessment of executive functions: review of instruments and identification of critical issues. Arch. Clin. Neuropsychol. 23, 201–216. doi: 10.1016/j.acn.2007.08.010

PubMed Abstract | CrossRef Full Text | Google Scholar

Chung, T., Smith, G. T., Donovan, J. E., Windle, M., Faden, V. B., Chen, C. M., et al. (2012). Drinking frequency as a brief screen for adolescent alcohol problems. Pediatrics 129, 1–8. doi: 10.1542/peds.2011-1828

PubMed Abstract | CrossRef Full Text | Google Scholar

Clark, D. B., Chung, T., Thatcher, D. L., Pajtek, S., and Long, E. C. (2012). Psychological dysregulation, white matter disorganization and substance use disorders in adolescence. Addiction 107, 206–214. doi: 10.1111/j.1360-0443.2011.03566.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Clark, D. B., Martin, C. S., Chung, T., Gordon, A. J., Fiorentino, L., Tootell, M., et al. (2016). Screening for underage drinking and DSM-5 alcohol use disorder in rural primary care practice. J. Pediatr. 173, 214–220. doi: 10.1016/j.jpeds.2016.02.047

PubMed Abstract | CrossRef Full Text

Clark, D. B., Pollock, N. A., Bromberger, J. T., Bukstein, O. G., Mezzich, A. C., and Donovan, J. E. (1997). Gender and comorbid psychopathology in adolescents with alcohol use disorders. J. Am. Acad. Child Adolesc. Psychiatry 36, 1195–1203.

Google Scholar

Clark, D. B., Thatcher, D. L., and Tapert, S. (2008). Alcohol, psychological dysregulation and adolescent brain development. Alcohol. Clin. Exp. Res. 32, 375–385. doi: 10.1111/j.1530-0277.2007.00601.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Clark, D. B., and Winters, K. C. (2002). Measuring risks and outcomes in substance use disorders prevention research. J. Consult. Clin. Psychol. 70, 1207–1223. doi: 10.1037/0022-006X.70.6.1207

PubMed Abstract | CrossRef Full Text | Google Scholar

Clarkson, M. J., Ourselin, S., Nielsen, C., Leung, K. K., Barnes, J., Whitwell, J. L., et al. (2009). Comparison of phantom and registration scaling corrections using the ADNI cohort. Neuroimage 47, 1506–1513. doi: 10.1016/j.neuroimage.2009.05.045

PubMed Abstract | CrossRef Full Text | Google Scholar

Cyders, M. A., and Coskunpinar, A (2012). The relationship between self-report and lab task conceptualizations of impulsivity. J. Res. Pers. 46, 121–124. doi: 10.1016/j.jrp.2011.11.005

CrossRef Full Text | Google Scholar

Dale, A. M., Fischl, B., and Sereno, M. I. (1999). cortical surface-based analysis. I. segmentations and surface reconstruction. Neuroimage 9, 179–194.

Google Scholar

de la Vega, R., Tome-Pires, C., Sole, E., Racine, M., Castarlenas, E., Jensen, M. P., et al. (2015). The Pittsburgh sleep quality index: validity and factor structure in young people. Psychol. Assess. 27, e22–e27. doi: 10.1037/pas0000128

PubMed Abstract | CrossRef Full Text | Google Scholar

Desikan, R. S., Segonne, F., Fischl, B., Quinn, B. T., Dickerson, B. C., Blacker, D., et al. (2006). An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest. Neuroimage 31, 968–980. doi: 10.1016/j.neuroimage.2006.01.021

PubMed Abstract | CrossRef Full Text | Google Scholar

Diamond, A., and Lee, K (2011). Interventions shown to aid executive function development in children 4 to 12 years old. Science 333, 959–964. doi: 10.1126/science.1204529

PubMed Abstract | CrossRef Full Text | Google Scholar

Donovan, J. E. (2009). estimated blood alcohol concentrations for child and adolescent drinking and their implications for screening instruments. Pediatrics 123, e975–e981. doi: 10.1542/peds.2008-0027

PubMed Abstract | CrossRef Full Text | Google Scholar

Duncan, S. C., Duncan, T. E., and Hops, H. (1996). Analysis of longitudinal data within accelerated longitudinal designs. Psychol. Methods 1, 236–248. doi: 10.1037/1082-989X.1.3.236

CrossRef Full Text | Google Scholar

Duncan, S. C., Duncan, T. E., and Strycker, LA (2006). Alcohol use from ages 9 to 16: a cohort-sequential latent growth model. Drug Alcohol Depend. 81, 71–81. doi: 10.1016/j.drugalcdep.2005.06.001

PubMed Abstract | CrossRef Full Text | Google Scholar

Egeland, J., and Fallmyr, O. (2010). Confirmatory factor analysis of the Behavior Rating Inventory of Executive Function (BRIEF): support for a distinction between emotional and behavioral regulation. Child Neuropsychol. 164, 326–337. doi: 10.1080/09297041003601462

CrossRef Full Text | Google Scholar

Fair, D. A., Cohen, A. L., Power, J. D., Dosenbach, N. U., Church, J. A., Miezin, F, et al. (2009). Functional brain networks develop from “local to distributed” organization. PLoS Comput. Biol. 5, 1–14. doi: 10.1371/journal.pcbi.1000381

CrossRef Full Text | Google Scholar

Familiar, I., Ruisenor-Escudero, H., Giordani, B., Bangirana, P., Nakasujja, N., Opoka, R., et al. (2015). Use of the Behavior Rating Inventory of Executive Function and child behavior checklist in Ugandan children with HIV or a history of severe malaria. J. Dev. Behav. Pediatr. 36, 277–284. doi: 10.1097/DBP.0000000000000149

CrossRef Full Text | Google Scholar

Faridi, N., Karama, S., Burgaleta, M., White, M. T., Evans, A. C., Fonov, V., et al. (2015). Neuroanatomical correlates of behavioral rating versus performance measures of working memory in typically developing children and adolescents. Neuropsychology 29, 82–91. doi: 10.1037/neu0000079

PubMed Abstract | CrossRef Full Text | Google Scholar

Fassbender, C., Simoes-Franklin, C., Murphy, K., Hester, R., Meaney, J., Robertson, I. H., et al. (2006). The role of a right fronto-parietal network in cognitive control - common activations for “cues-to-attend” and response inhibition. J. Psychophysiol. 20, 286–296. doi: 10.1027/0269-8803.20.4.286

CrossRef Full Text | Google Scholar

Fossati, P. (2012). Neural correlates of emotion processing: from emotional to social brain. Eur. Neuropsychopharmacol. 22, 487–491. doi: 10.1016/j.euroneuro.2012.07.008

PubMed Abstract | CrossRef Full Text | Google Scholar

Gioia, G. A., Isquith, P. K., Guy, S. C., and Kenworthy, L. (2002a). Behavior Rating Inventory of Executive Function (BRIEF). Lutz, FL: Psychological Assessment Resources.

Google Scholar

Gioia, G. A., Isquith, P. K., Retzlaff, P. D., and Espy, K. A. (2002b). Confirmatory factor analysis of the Behavior Rating Inventory of Executive Function (BRIEF) in a clinical sample. Child Neuropsychol. 8, 249–257. doi: 10.1076/chin.8.4.249.13513

PubMed Abstract | CrossRef Full Text | Google Scholar

Gradisar, M., Smits, M. G., and Bjorvatn, B (2014). Assessment and treatment of delayed sleep phase disorder in adolescents: recent innovations and cautions. Sleep Med. Clin. 9, 199–210. doi: 10.1016/j.jsmc.2014.02.005

CrossRef Full Text

Gur, R. C., Richard, J., Hughett, P., Calkins, M. E., Macy, L., Bilker, W. B., et al. (2010). A cognitive neuroscience-based computerized battery for efficient measurement of individual differences: standardization and initial construct validation. J. Neurosci. Methods 187, 254–262. doi: 10.1016/j.jneumeth.2009.11.017

PubMed Abstract | CrossRef Full Text | Google Scholar

Gur, R. C., Sara, R., Hagendoorn, M., Marom, O., Hughett, P., Macy, L., et al. (2002). A method for obtaining 3-dimensional facial expressions and its standardization for use in neurocognitive studies. J. Neurosci. Methods 15, 137–143. doi: 10.1016/S0165-0270(02)00006-7

CrossRef Full Text | Google Scholar

Guy, S. C., Isquith, P. K., and Gioia, G. A. (2004). Behavior Rating Inventory of Executive Function – Self-Report Version. Lutz, FL: Psychological Assessment Resources.

Hackman, D. A., Gallop, R., Evans, G. W., and Farah, M. J. (2015). Socioeconomic status and executive function: developmental trajectories and mediation. Dev. Sci. 18, 686–702. doi: 10.1111/desc.12246

PubMed Abstract | CrossRef Full Text | Google Scholar

Hadjiefthyvoulou, F., Fisk, J. E., Montgomery, C., and Bridges, N. (2012). Self-reports of executive dysfunction in current ecstasy/polydrug users. Cogn. Behav. Neurol. 25, 128–138. doi: 10.1097/WNN.0b013e318261459c

PubMed Abstract | CrossRef Full Text | Google Scholar

Hasler, B., and Clark, D. B. (2013). Circadian misalignment, reward-related brain function, and adolescent alcohol involvement. Alcohol. Clin. Exp. Res. 37, 558–565. doi: 10.1111/acer.12003

PubMed Abstract | CrossRef Full Text | Google Scholar

Hasler, B. P., Franzen, P., de Zambotti, M., Prouty, D., Brown, S., Tapert, S., et al. (2017). Eveningness and later sleep timing are associated with greater risk for alcohol and marijuana use in adolescence: initial findings from the NCANDA study. Alcohol. Clin. Exp. Res. 41, 1154–1165. doi: 10.1111/acer.13401

CrossRef Full Text | Google Scholar

Hasler, B. P., Kirisci, L., and Clark, D. B. (2016). Restless sleep and variable sleep timing during late childhood accelerate the onset of alcohol and drug involvement. J. Stud. Alcohol Drugs 77, 649–655. doi: 10.15288/jsad.2016.77.649

PubMed Abstract | CrossRef Full Text | Google Scholar

Hasler, B. P., Martin, C. S., Wood, D. S., Rosario, B., and Clark, D. B. (2014). A longitudinal study of insomnia and other sleep complaints in adolescents with and without alcohol use disorders. Alcohol. Clin. Exp. Res. 38, 2225–2233. doi: 10.1111/acer.12474

PubMed Abstract | CrossRef Full Text | Google Scholar

Klingberg, T., Vaidya, C. J., Gabrieli, J. D., Moseley, M. E., and Hedehus, M. (1999). Myelination and organization of the frontal white matter in children: a diffusion tensor MRI study. Neuroreport 10, 2817–2921. doi: 10.1097/00001756-199909090-00022

PubMed Abstract | CrossRef Full Text | Google Scholar

Kurtz, M. M., Ragland, J. D., Bilker, W., Gur, R. C., and Gur, R. E. (2001). Comparison of the continuous performance test with and without working memory demands in healthy controls and patients with schizophrenia. Schizophr. Res. 48, 307–316. doi: 10.1016/S0920-9964(00)00060-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Langberg, J. M., Dvorsky, M. R., and Evans, S. W. (2013). What specific facets of executive function are associated with academic functioning in youth with attention-deficit/hyperactivity disorder? J. Abnorm. Child Psychol. 41, 1145–1159. doi: 10.1007/s10802-013-9750-z

PubMed Abstract | CrossRef Full Text | Google Scholar

Lee, N. R., Raznahan, A., Wallance, G. L., Alexander-Bloch, A., Clasen, L. S., Lerch, J. P., et al. (2014). anatomical coupling among distributed cortical regions in youth varies as a function of individual differences in vocabulary abilities. Hum. Brain Mapp. 35, 1885–1895. doi: 10.1002/hbm.22299

PubMed Abstract | CrossRef Full Text | Google Scholar

Lenroot, R. K., and Giedd, J. N. (2006). Brain development in children and adolescents: insights from anatomical magnetic resonance imaging. Neurosci. Biobehav. Rev. 30, 718–729. doi: 10.1016/j.neubiorev.2006.06.001

PubMed Abstract | CrossRef Full Text | Google Scholar

Lipton, M. L., Gulko, E., Zimmerman, M. E., Friedman, B. W., Kim, M., Gellella, E., et al. (2009). Diffusion-tensor imaging implicates prefrontal axonal injury in executive function impairment following very mild traumatic brain injury. Radiology 252, 816–824. doi: 10.1148/radiol.2523081584

PubMed Abstract | CrossRef Full Text | Google Scholar

Long, E., Luna, B., Verhulst, B., and Clark, D. B. (2015). Disruptive behavior disorders and indicators of disinhibition in adolescents: the BRIEF-SR, anti-saccade task, and D-KEFS color-word interference test. J. Adolesc. 44, 182–190. doi: 10.1016/j.adolescence.2015.07.003

PubMed Abstract | CrossRef Full Text | Google Scholar

Ludbrook, J. (1998). Multiple comparison procedures updated. Clin. Exp. Pharmacol. Physiol. 25, 1032–1037. doi: 10.1111/j.1440-1681.1998.tb02179.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Mahone, E. M., Martin, R., Kates, W. R., Hay, T., and Horska, A. (2009). Neuroimaging correlates of parent ratings of working memory in typically developing children. J. Int. Neuropsychol. Soc. 15, 31–41. doi: 10.1017/S1355617708090164

PubMed Abstract | CrossRef Full Text | Google Scholar

Millman, R. P. (2005). Excessive sleepiness in adolescents and young adults: causes, consequences, and treatment strategies. Pediatrics 115, 1774–1786. doi: 10.1542/peds.2005-0772

PubMed Abstract | CrossRef Full Text | Google Scholar

Minges, K. E., and Redeker, N. S. (2016). Delayed school start times and adolescent sleep: a systematic review of the experimental evidence. Sleep Med. Rev. 28, 82–91. doi: 10.1016/j.smrv.2015.06.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Mollayeva, T., Thurairajah, P., Burton, K., Mollayeva, S., Shapiro, C. M., and Colantonio, A. (2016). The Pittsburgh Sleep Quality Index as a screening tool for sleep dysfunction in clinical and non-clinical samples: a systematic review and meta-analysis. Sleep Med. Rev. 25, 52–73. doi: 10.1016/j.smrv.2015.01.009

PubMed Abstract | CrossRef Full Text | Google Scholar

National Institute on Alcohol Abuse and Alcoholism (2011). Alcohol Screening and Brief Intervention for Youth: A Practitioner's Guide. NIH Publications 11-7805. Bethesda, MD: National Institute on Alcohol Abuse and Alcoholism.

Noone, D. M., Willis, T. A., Cox, J., Harkness, F., Ogilvie, J., Forbes, E., et al. (2014). Catastrophizing and poor sleep quality in early adolescent females. Behav. Sleep Med. 12, 41–52. doi: 10.1080/15402002.2013.764528

PubMed Abstract | CrossRef Full Text | Google Scholar

Paus, T (2010). Growth of white matter in the adolescent brain: myelin or axon? Brain Cogn. 72, 26–35. doi: 10.1016/j.bandc.2009.06.002

CrossRef Full Text | Google Scholar

Pfefferbaum, A., Rohlfing, T., Pohl, K. M., Lane, B., Chu, W., Kwon, D., et al. (2016). Adolescent development of cortical and white matter structure in the NCANDA sample: role of sex, ethnicity, puberty, and alcohol drinking. Cereb. Cortex 26, 4101–4121. doi: 10.1093/cercor/bhv205

PubMed Abstract | CrossRef Full Text | Google Scholar

Pohl, K. M., Sullivan, E. V., Rohlfing, T., Chu, W., Kwon, D., Nichols, B. N., et al. (2016). Harmonizing DTI measurements across scanners to examine the development of white matter microstructure in 803 adolescents of the NCANDA study. Neuroimage 130, 194–213. doi: 10.1016/j.neuroimage.2016.01.061

PubMed Abstract | CrossRef Full Text | Google Scholar

Ragland, J. D., Turetsky, B. I., Gur, R. C., Gunning-Dixon, F., Turner, T., Schroeder, L., et al. (2002). Working memory for complex figures: an fMRI comparison of letter and fractal n-back tasks. Neuropsychology 16, 370–379. doi: 10.1037/0894-4105.16.3.370

PubMed Abstract | CrossRef Full Text | Google Scholar

Riggs, N. R., and Greenberg, M. T. (2009). Neurocognition as a moderator and mediator in adolescent substance misuse prevention. Am. J. Drug Alcohol Abuse 35, 209–213. doi: 10.1080/00952990903005940

PubMed Abstract | CrossRef Full Text | Google Scholar

Rohlfing, T., Cummins, K., Henthorn, T., Chu, W., and Nichols, B. N. (2014). N-CANDA data integration: anatomy of an asynchronous infrastructure for multi-site, multi-instrument longitudinal data capture. J. Am. Med. Inform. Assoc. 21, 758–762. doi: 10.1136/amiajnl-2013-002367

PubMed Abstract | CrossRef Full Text | Google Scholar

Roth, R. M., Erdodi, L. A., McColloch, L. J., and Isquith, P. K. (2015). Much ado about norming: the Behavior Rating Inventory of Executive Function. Child Neuropsychol. 21, 225–233. doi: 10.1080/09297049.2014.897318

PubMed Abstract | CrossRef Full Text | Google Scholar

Samuels, W. E., Tournaki, N., Blackman, S., and Zilinski, C (2016). Executive functioning predicts academic achievement in middle school: a four-year longitudinal study. J. Educ. Res. 109, 478–490. doi: 10.1080/00220671.2014.979913

CrossRef Full Text | Google Scholar

Šidák, Z. K. (1967). Rectangular confidence regions for the means of multivariate normal distributions. J. Am. Stat. Assoc. 62, 626–633. doi: 10.1080/01621459.1967.10482935

CrossRef Full Text | Google Scholar

Shimoni, M., Engel-Yeger, B., and Tirosh, E. (2012). Executive dysfunctions among boys with attention deficit hyperactivity disorder (ADHD): performance-based test and parents report. Res. Dev. Disabil. 33, 858–865. doi: 10.1016/j.ridd.2011.12.014

PubMed Abstract | CrossRef Full Text | Google Scholar

Skranes, J., Lohaugen, G. C., Martinussen, M., Indredavik, M. S., Dale, A. M., Haraldseth, O., et al. (2009). White matter abnormalities and executive function in children with very low birth weight. Neuroreport 20, 263–266. doi: 10.1097/WNR.0b013e32832027fe

PubMed Abstract | CrossRef Full Text | Google Scholar

Spear, L. P. (2000). The adolescent brain and age-related behavioral manifestations. Neurosci. Biobehav. Rev. 24, 417–463. doi: 10.1016/S0149-7634(00)00014-2

PubMed Abstract | CrossRef Full Text | Google Scholar

Sullivan, E., Brumback, T., Tapert, S., Fama, R., Prouty, D., Brown, S. A., et al. (2016). Cognitive, emotion control, and motor baseline performance of adolescents in the NCANDA study: contributions from alcohol consumption, age, puberty, sex, ethnicity, and family history of addiction. Neuropsychol. 30, 449–473. doi: 10.1037/neu0000259

CrossRef Full Text | Google Scholar

Sullivan, E., Brumback, T., Tapert, S., Prouty, D., Fama, R., Brown, S., et al. (2017). Effects of prior testing lasting a full year in NCANDA adolescents: contributions from age, sex, socioeconomic status, ethnicity, site, family history of alcohol or drug abuse, and baseline performance. Develop. Cogn. Neurosci. 24, 72–83. doi: 10.1016/j.dcn.2017.01.003

PubMed Abstract | CrossRef Full Text | Google Scholar

Takahashi, T., Murata, T., Omori, M., Kosaka, H., Takahashi, K., Yonekura, Y., et al. (2004). Quantitative evaluation of age-related white matter microstructural changes on MRI by multifractal analysis. J. Neurol. Sci. 225, 33–37. doi: 10.1016/j.jns.2004.06.016

PubMed Abstract | CrossRef Full Text | Google Scholar

Tapert, S. F., and Brown, S. A. (2000). Substance dependence, family history of alcohol dependence and neuropsychological functioning in adolescence. Addiction 95, 1043–1053. doi: 10.1046/j.1360-0443.2000.95710436.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Tarter, R. E., Kirisci, L., Mezzich, A., Cornelius, J., Pajer, K., Vanyukov, M., et al. (2003). Neurobehavioral disinhibition in childhood predicts early age onset substance use disorder. Am. J. Psychiatry 160, 1078–1085. doi: 10.1176/appi.ajp.160.6.1078

PubMed Abstract | CrossRef Full Text | Google Scholar

Toplak, M. E., West, R. F., and Stanovich, K. E. (2013). Practitioner review: do performance-based measures and ratings of executive function assess the same construct? J. Child Psychol. Psychiatry 54, 131–143. doi: 10.1111/jcpp.12001

PubMed Abstract | CrossRef Full Text | Google Scholar

Vanyukov, M., Kirisci, L., Tarter, R. E., Ridenour, T. A., Reynolds, M. D., Maher, B., et al. (2009). Measurement of the risk for substance use disorders: phenotypic and genetic analysis of an index of common liability. Behav. Genet. 39, 233–244. doi: 10.1007/s10519-009-9269-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, Y., Horst, K. K., Kronenberger, W. G., Hummer, T. A., Mosier, K. M., Kalnin, A. J., et al. (2012). White matter abnormalities associated with disruptive behavior disorder in adolescents with and without attention-deficit./hyperactivity disorder. Psychiatry Res. Neuroimag. 202, 245–251. doi: 10.1016/j.pscychresns.2012.01.005

PubMed Abstract | CrossRef Full Text | Google Scholar

Wilkinson, G. S., and Robertson, G. J. (2006). WRAT 4: Wide Range Achievement Test: Professional Manual. Lutz, FL: Psychological Assessment Resources, Incorporated.

Willcutt, E. G., Doyle, A. E., Nigg, J. T., Faraone, S. V., and Pennington, B. F. (2005). Validity of the executive function theory of attention-deficit/hyperactivity disorder: a meta-analytic review. Biol. Psychiatry 57, 1336–1346. doi: 10.1016/j.biopsych.2005.02.006

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhai, Z., Pajtek, S., Luna, B., Geier, C., Ridenour, T., and Clark, D. B. (2015). Reward modulated response inhibition, cognitive shifting, and the orbital frontal cortex in early adolescence. J. Res. Adolesc. 24, 753–764. doi: 10.1111/jora.12168

CrossRef Full Text | Google Scholar

Ziegler, G., Dahnke, R., Winkler, A. D., and Gaser, C. (2013). Partial least squares correlation of multivariate cognitive abilities and local brain structure in children and adolescents. Neuroimage 82, 284–294. doi: 10.1016/j.neuroimage.2013.05.088

PubMed Abstract | CrossRef Full Text | Google Scholar