- 1Department of Psychiatry, Medical Faculty, Ludwig Maximillians Universitaet (LMU) Munich, Munich, Germany
- 2Department of Psychiatry and Psychotherapy, Medical Faculty, University Hospital of Cologne, University of Cologne, Cologne, Germany
- 3Institute of Neurosciences and Medicine—Cognitive Neuroscience, Research Center Juelich, Jülich, Germany
- 4Department of Psychology, University of Cologne, Cologne, Germany
Executive functions (EF) have been shown to be important for the understanding of Autism Spectrum Disorder (ASD), but dysfunctions of EF are not autism-specific. The specific role of EF in ASD, its relationship to core autism characteristics, such as mentalizing, needs to be explored. Medline- and PsychINFO databases were searched for studies published between 1990 and 2020 that included measures of EF in ASD and typically developing control persons (TD) in combination with either Theory of Mind (ToM) or Weak Central Coherence (WCC) tasks. A pre-registered meta-analysis and cross-study regression was performed including a total of 42 studies (ASD n = 1,546, TD n = 1,206). Results were reported according to PRISMA guidelines. In all cognitive domains, the ASD group showed significantly reduced performance. Importantly, EF subdomains and ToM were not significantly correlated. This finding rules out a significant association between EF subdomains and ToM and questions the relevance of EF dysfunctions for the autism-specific feature of reduced mentalizing.
Introduction
Autism Spectrum Disorder (ASD) is a neurodevelopmental disorder that primarily comprises symptoms in the social domain with a focus on interaction and communication, as well as restricted repetitive behaviors (1). Aside from the primary symptoms, a disruption of executive functions (EF) has been long proclaimed as a domain-general characteristic of the autistic cognitive profile (2, 3). EF refers to higher cognitive capacities required for goal-directed behavior. The concept of EF consists of multiple subdomains, such as planning, impulse control, set shift, working memory, inhibition, and initiation and monitoring of action (4). Planning involves a dynamic operation in which a sequence of planned actions must be constantly monitored, re-evaluated and updated [e.g., the Tower of London task; (4)]. Set shift, also called mental flexibility, describes shifting to different thoughts or actions according to changes in a situation. Inhibition refers to the ability to inhibit a response and sometimes produce an alternative response. Finally, working memory is needed to maintain and manipulate mental information without external cues. Nevertheless, one should keep in mind that the subdomains are not necessarily clear-cut and that tasks assessing each subdomain may often tap into more than one cognitive domain. For example, to a certain degree, response inhibition additionally utilizes working memory, as it requires holding a rule in one’s mind (5).
Studies regarding atypical EF in individuals with ASD present heterogeneous results. On the one hand, it has been found that individuals with ASD show significantly reduced performance in tasks of EF than typically developed control persons (TD) (6). On the other hand, there are multiple studies that did not elicit differences between groups (7). Yet, there is growing evidence that executive dysfunctions, in general, are found in ASD (6). Nevertheless, it is still unknown whether a particular subset of EF is predominantly impaired in autistic individuals (6) and whether EF bear any relevance for the core symptoms of the autism-specific cognitive profile, such as atypical mentalizing.
The heterogeneity of EF findings across studies makes general statements about the relevance of EF impairments for the autistic neurocognitive profile difficult, and it is unsatisfactory to attribute this heterogeneity to variability in sampling (6). Sources for heterogeneity comprise genetic variability, a distinct gender bias and the presence of various comorbidities. Not only are medical comorbidities more prevalent in ASD persons, psychopathological comorbidities also more commonly occur than in TD persons (8). The most critical aspect about the role of atypical EF in ASD is the lack of specificity. Importantly, EF impairments can be found across neurodevelopmental disorders (9), particularly in attention deficit/hyperactivity disorder (ADHD). ADHD is thought to genetically overlap with ASD (10) but does not share the same phenotype. A recent structural equation modelling study revealed that EF impairments were particularly associated with reported ADHD symptoms in ASD (11).
Additionally, the effects of learning disabilities and ASD on EF are challenging to disentangle. It seems, however, as if a specific profile of executive dysfunction for individuals with ASD exists. In a study investigating EF impairments in two groups of persons with learning disabilities, one with, the other without the comorbidity of ASD, EF impairments were more pronounced in the ASD group (12). While these did not only exist in the ASD group, the sub-domains of planning and working memory effectively differentiated the groups (12).
Furthermore, EF impairments were reported in Tourette’s syndrome, obsessive-compulsive disorder (13), and even in persons with higher Body Mass Index (14); all suggesting a contribution of EF on impulse control. Taken together, the aforementioned analysis of EF in ASD (6) highlights the relevance of EF atypicalities in ASD; yet, an important follow-up question remains: To what extent does atypical EF, which is not autism-specific, bear a role for core symptoms of the autism-specific neurocognitive profile, such as atypical mentalizing? Consequently, EF needs to be investigated in the context of autism-specific characteristics to further evaluate their relevance for etiological and treatment considerations.
For instance, atypical mentalizing specifically prevails in ASD, as described by the reduced Theory of Mind (ToM) account (15). Likewise, a tendency toward Weak Central Coherence [WCC; (16)] is characteristic for the autistic cognitive profile. ToM, or mentalizing, relates to the core clinical symptoms of interaction and communication deficits and reflects the ability to attribute mental states to oneself and others to predict or explain a person’s behavior. Several studies have shown that individuals with ASD show significantly reduced ToM compared to TD individuals [R. (17–20)]. The WCC theory refers to the tendency of autistic individuals to perceive objects, social situations or mental constructs less as a whole and instead focus more specific on details of the holistic structure. Empirically, the WCC was demonstrated by a preference for local over global information processing (21, 22). However, definite conclusions regarding the performance in global processing are difficult to draw since most experiments have mainly studied local processing (16). Thus, evidence for the reduced global processing, in contrast to the preference for local processing, can be considered weak. Nevertheless, WCC has been a prevalent theory studied within the field and is, therefore, considered in the present study. Notably, there are now alternative domain-general accounts for functions categorized under the traditional concept of WCC, including Enhanced Perceptual Functioning (23) and Reduced Generalisation (24).
Yet, none of the previously mentioned theories can primarily explain ASD. Accordingly, it has been proposed to abandon the idea of a single theory explaining ASD (25, 26). Therefore, it is of particular interest to explore the extent to which the unspecific atypical EF in ASD relates to core symptoms of autism-associated domains, ToM and WCC, to understand the relevance of domain-general, and presumably fundamental, EF for the neurocognitive profile of ASD.
The proposal of atypical mentalizing being a consequence of EF dysfunctions has been proposed (4, 27), but few studies have researched the relationship between these domains. Relationships between EF impairments and ToM have likewise been suggested (11). EF deficits in individuals with ASD have, for instance, been associated with reported ADHD-related symptoms in these individuals, whereas ToM impairments were particularly associated with reported ASD symptoms (11). One factor contributing to the development of ToM is the biological maturation enabling children to express their understanding of mental states, which arises from an improvement in EF. Accordingly, the performance on any cognitive task arises from at least two factors: competence (the conceptual understanding required to solve a problem) and performance (other cognitive skills required to access and express understanding; e.g., memory, focussed attention, comprehension, etc.). False belief (FB) understanding, a key aspect of ToM, requires an individual to disengage from a real-world situation to attend to an abstract representation (inhibition/flexibility), to stop a prepotent or habitual response (inhibition; pointing to the actual location of an object), and to hold different and conflicting representations in mind and manipulate this information to come to the correct answer (working memory). Specifically, inhibitory control and working memory seem to be the most relevant skills for ToM development (28, 29). Therefore, deficits in ToM tasks may not be due to pure conceptual limitations but may relate to problems translating conceptual knowledge into successful action. This might result from a failure to flexibly switch between reality and imagination, a failure to inhibit a response, or being unable to withdraw attention from a salient object. Accordingly, there is evidence suggesting a positive correlation between inhibitory control measures and FB tasks (30, 31). Additionally, in a longitudinal study investigating the relationship between EF, WCC, and ToM in children with ASD at two time points, individual differences in early EF skills were shown to influence subsequent performance on ToM tasks, specifically FB tasks (32). By contrast, using a co-twin control design, no association between EF and ToM was found (33).
The evidence regarding the relationship between EF and WCC is mixed. For instance, it was considered that difficulties in global processing might be the result of an inability to switch between the local and global aspects of a stimulus (23, 34). This would suggest a possible relationship between WCC and EF, especially with respect to set shifting. Individuals with ASD might have difficulties on global processing tasks because the tasks require intact EF skills (34). On the other hand, various studies have concluded that there are no developmental links between EF and WCC (35, 36).
Thus, the current pre-registered meta-analysis and cross-study regression aimed to identify whether EF, and if so which particular subdomains, might impact the autistic cognitive profile in terms of autism-specific reduced ToM and WCC.
Materials and Methods
This systematic review and meta-analysis was pre-registered in the Prospero database (registration number: CRD42019139151).
Study Selection
Studies were included if published in English or German between January 1990 (by this year, the two concepts of ToM and WCC had been established) and September 2020. Eligible studies had to include participants with a diagnosis of ASD according to DSM-III, DSM-IV, DSM- IV-TR, DSM-5, or ICD-10. The studies had to include assessments of EF measures in combination with either ToM or WCC. Further, we only included studies that provided sufficient data to calculate effect sizes and correlations; no minimum sample size was required.
Data Collection
We searched Medline (via PubMed) and PsycInfo, applying the following generic literature search:
“Autis*” AND “THEORY OF MIND” AND “EXECUTIVE FUNCTION”
“Autis*” AND “CENTRAL COHERENCE” AND “EXECUTIVE FUNCTION”
To cover a broad range of articles the search terms, Theory of Mind, Executive Function and Central Coherence were replaced in the process by numerous synonyms and tests with respect to their domain (Table 1). To reduce a possible selection bias, screening of titles and abstracts was carried out by two evaluators (J.H. & A.B.), both involved in the study but independent of each other.
The search revealed 71 articles eligible for full-text evaluation. Full-text articles were screened by the aforementioned evaluators. We also screened reference lists of all studies included. Regarding the cognitive construct of EF, not all subdomains were included in the analysis, but only those that were studied in a sufficiently large number of studies (set to a criterion of n ≥ 20). The subdomain that was reported the most was cognitive flexibility (n = 38 articles), followed by inhibition (n = 30), planning (n = 22) and working memory (n = 20). After filtering the initial 71 articles for the inclusion criteria, 59 articles remained; 17 of these articles were excluded because they only offered limited data. Some articles only reported a mean score, without reporting a minimum or maximum, which did not allow us to calculate percentages (37, 38). Other articles only reported a mean and standard deviation for one cognitive measure (39) or did not report a mean and standard deviation at all (40). Such articles were excluded. A total of 42 articles qualified for the final analysis.
Data Items and Summary Measures
For each study, the following variables were extracted: title, author, year of publication, IQ (Intelligence Quotient), demographics of participants (including the specifics of the control groups), exclusion criteria of the respective study, as well as the mean, standard deviation, and other measures of dispersion (SE), out of which we calculated standard deviations for our analysis.
Moderator Analysis
We calculated meta-regressions of each of the individual cognitive domains to analyze associations of differences between ASD and TD groups including average age of study samples and IQ difference between ASD and TD groups (mixed effects regression, method of moments, CMA Version 2).
Risk of Bias
Two independent raters evaluated each study’s quality using the Newcastle Ottawa Quality Assessment Scale for Case Control Studies (NOS) (41).
Publication Bias
For the analysis of publication bias, we employed funnel plots (Figures 1–3). Funnel plot asymmetry can be indicative of bias that may arise from language, citation, lag time, or publication bias.
Figure 1. Funnel plot of studies comparing Executive Function performance between ASD and TD. SMD, standard mean difference (Effect Size); SE, standard error; EF1, inhibition; EF2, working memory; EF3, flexibility; EF4, planning. Positive effect sizes indicate superior performance in ASD. The solid vertical line indicates the estimate for the population effect size.
Figure 2. Funnel plot for 11 studies comparing Central Coherence performance between ASD and TD. SMD, standard mean difference (effect size); SE, standard error. Positive effect sizes indicate superior performance in ASD. The solid vertical line indicates the estimate for the population effect size.
Figure 3. Funnel plot–theory of mind funnel plot for 26 studies comparing theory of mind performance between ASD and TD. SMD, standard mean difference (effect size); SE, standard error. Positive effect sizes indicate superior performance in ASD. The solid vertical line indicates the estimate for the population effect size.
Data Analysis
Data analysis was performed using RevMan 5.3, JMP 15 and CMA (Comprehensive Meta-Analysis Software, v.2.0). All articles included in the final analysis had investigated EF in combination with either ToM or WCC among patients with ASD. Out of the 42 identified studies, nine studies did not have a control group and were subsequently omitted from the calculation of effect sizes, leaving a total of 33 studies.
To quantify the magnitude of the different measures of EF (ToM and WCC), we computed effect sizes (Hedges’ g) of performance in the ASD group relative to the control group, based on means, standard deviations and sample sizes for each measure. For the meta-analysis, a random effects model was used (42). Since the cognitive constructs under study are addressed by a variety of measures, we used a standardized effect estimate across all tests. Effect benchmarks of Hedges’ g can be categorized as the following: g: 0.2–0.5 = “small,” g: 0.5–0.8 = “medium”, g > 0.8 = “large.” For each analysis, we report the sample sizes of ASD and TD groups, the number of studies included, as well as the effect sizes and their 95% confidence intervals. Multiple studies used for the meta-analysis showed effect sizes larger than 1 (with several effect sizes considerably larger than 1; see forest plots), which might indicate possible reporting errors. All authors of the included studies were contacted and asked to confirm the accurate reporting of results. Not all authors replied, but of those who did, all of the data was eventually corrected.
As conservative approach, we conducted an additional separate meta-analysis without studies reporting effect sizes greater than one.
Studies used different tests and scales for measuring the same psychological construct. For example, the concept of inhibition, a subdomain of EF, was measured by the BRIEF (Behavior Rating Inventory of Executive Function), the Luria hand game, the Stroop Inhibition Task, a Card Sorting Task and multiple others (43). The concept of ToM has been measured by tasks like the RMET, the strange stories test and the Sally Ann Test (44). Weak Central Coherence was assessed by tasks such as the embedded figures test, block design tasks and Sentence Completion Tasks (45).
To calculate correlations between different psychological concepts among participants with ASD and to estimate the impact of multiple subdomains of EF on ToM or WCC, we standardized all reported results by transforming them to percentages. In cases where a high test-score indicated bad performance, results were reversed so that, after standardizing, a high percentage indicated a good result.
To choose regression models, normality was analyzed by the Shapiro-Wilk-Test, which showed a normal distribution of almost all measures of cognition. Therefore, we calculated Pearson’s r with 95% confidence intervals between the cognitive constructs of EF subdomains, ToM and WCC, using JMP 15 as a meta-analytical tool. Since the concept of WCC could only be correlated with very few studies, this variable was omitted from further calculations.
A total of 11 studies had to be excluded for the correlation analysis mainly due to missing data, leaving a total of 31 studies that were eligible for this part of the analysis.
We followed the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) (46). For further detail see PRISMA Flowchart (Figure 4).
Results
Retrieved Studies
Data came from a total of 42 studies used for the final analysis. The literature search yielded data from 1,546 participants with ASD (grand mean age = 13.36, SD = 8.37, mean age range: 4.95–35.46, grand median age = 10.05 years), that were compared to 1,206 typically developing individuals (grand mean age = 13.17, SD = 11.85, mean age range: 4.1–38.3 years, grand median age = 8.94 years). Sample sizes ranged from a minimum of 10 participants to a maximum of 181.
Of the 42 studies observed, 36 had measured IQ. The grand mean IQ for the ASD group was M = 101.82, SD = 10.76 and that of the TD group was M = 104.03, SD = 21.63. There was no significant effect of IQ between the two groups t(33) = 0.739, p = 0.536.
Meta-Analysis: Cognitive Constructs
The different domains of EF that were analyzed showed moderate to large effect sizes: inhibition (EF1), k = 15, g = -0.78, 95% CI [-1.03, -0.53], I2 = 72% ASD n = 575 TD n = 578; working memory (EF2), k = 11, g = -0.79, 95% CI [-1.33, -0.25], I2 = 89%, ASD n = 286, TD n = 303; flexibility (EF3), k = 19, g = -0.47, 95% CI [-0,73, -0.21], I2 = 79%, ASD n = 647, TD n = 657; planning (EF4), k = 13, g = -0.81, 95% CI [-1.16, -0.46], I2 = 85%, ASD n = 557, TD n = 549. See results in Figure 5.
Figure 5. Forest plot–executive function: subgroup analysis of EF domains. Results show medium effect size measures for all EF subtypes observed. Graphical explanations: horizontal lines present 95% confidence Interval of the effect sizes for each study; green dot: hedges‘g; diamond shape: overall effect size.
Participants with ASD (n = 873) performed poorer compared to TD participants (n = 870) in ToM tasks, with a large effect size (k = 24, g = -0.81, 95% CI [-1.10, -0.52], I2 = 87%).
Regarding WCC, participants with ASD (n = 403) showed lower test scores relative to TD participants (n = 413), with a large effect size (k = 9, g = -0.80, 95% CI [-1.43, -0.17], I2 = 93%).
Since some studies showed effect sizes larger than 1, a complementary analysis was performed with all studies reporting effect sizes less than 1.
The different domains of EF that were analyzed showed small to moderate effect sizes: the matter of inhibition (k = 10, g = -0.53, 95% CI [-0.76, -0.29], I2 = 56%), with a total of n = 422 participants with ASD and n = 420 TD participants; working memory (k = 8, g = -0.34, 95% CI [-0.68, -0.01], I2 = 64%, ASD n = 188, TD n = 197); flexibility (k = 15, g = -0.44, 95% CI [0.59, -0.28], I2 = 27%) with n = 510 participants with ASD and n = 527 TD participants planning (k = 9, g = -0.44, 95% CI [-0.66, 0.22], I2 = 53%, ASD n = 421, TD n = 436).
Participants with ASD performed poorer (n = 682) compared to TD participants (n = 696) in ToM tasks, with a moderate effect size (k = 19, g = -0.51, 95% CI [-0.71, -0.31], I2 = 66%).
Regarding WCC, participants with ASD (n = 326) showed lower test scores relative to TD participants (n = 342), with a small effect size (k = 7, g = -0.31, 95% CI [-0.64, 0.02], I2 = 71%).
Correlation Analysis
In general, the correlations between the EF subdomains (working memory, inhibition, planning, and flexibility) and ToM can be categorized as small for the ASD and the TD group. None of the correlations showed significance (p > 0.05); therefore, only the minimum and maximum correlations are reported. Correlations ranged from a maximum of r(6) = 0.143, p = 0.353 for working memory in the TD group to a minimum of r(22) = 0.0040, p = 0.7667 between planning and ToM in the ASD group.
Moderator Analysis
In meta-regressions, we found no association between effect sizes and IQ difference between ASD and TD groups. When looking at WCC, a significant effect for age was observed (slope = 0.22, p = 0.031, df = 10). The difference in WCC measures between the ASD and TD group became weaker with increasing age of participants. For ToM, no such effect was observed.
Risk of Bias
For assessing the risk of bias for individual studies, the NOS was evaluated. It showed an average overall score of 5.21 points. The NOS scale ranges from zero to nine points. Regarding analysis of studies that were included, a minimum of two points and a maximum of eight points were observed. Based on the results of this analysis, the quality of studies that were analyzed can be considered between of “fair” and “good” quality. After filtering all studies by quality, a further meta-analysis was performed that only included studies that were rated as “good” (at least six points). The studies that qualified for analysis can be drawn from Table 2.
The different domains of EF that were analyzed showed large to moderate effect sizes: for the matter of inhibition (k = 14, g = -0.77, 95% CI [-1.04, -0.51], I2 = 74%), with a total of n = 550 participants with ASD and n = 553 TD participants; working memory (k = 11, g = -0.9, 95% CI [-1.38, -0.42], I2 = 87%, ASD n = 306, TD n = 315); flexibility (k = 16, g = -0.55, 95% CI [-0.75, -0.35], I2 = 59%) with n = 582 participants with ASD and n = 584 TD participants planning (k = 11, g = -0.79, 95% CI [-1.17, -0.42], I2 = 86%, ASD n = 495, TD n = 493).
Participants with ASD showed reduced performance (n = 766) compared to TD participants (n = 769) in ToM tasks, with a moderate effect size (k = 20, g = -0.78, 95% CI [-1.10, -0.46], I2 = 88%).
Regarding WCC, participants with ASD (n = 338) showed lower test scores relative to TD participants (n = 354), with a moderate effect size (k = 6, g = -0.65, 95% CI [-1.29, -0.02], I2 = 92%).
Publication Bias
Funnel plots were generated for each analyzed cognitive construct. All constructs included data of at least 10 studies. Funnel plots did not indicate a publication bias as demonstrated in Figures 1–3.
Discussion
This pre-registered meta-analysis aimed to investigate the relevance of dysfunctional EF including subdomains on the core symptomatic autism-specific cognitive profile. In comparison to TD control persons, participants with ASD showed significantly reduced performance in all three cognitive domains: EF, ToM, and WCC. The largest group differences were found in ToM, in the EF subdomain of planning and WCC. As shown in the moderator analysis, it is possible that findings regarding WCC are due to age, having a modulatory effect on the findings. This remains a limitation of the present study, especially when considering that we investigated a developmental disorder. The observed age span ranged from 4 to 38 years, which is difficult to compare due to noted differences across the lifespan. Only a minority of five studies showed an average age greater than 18 years (N ASD = 123; N TD = 98). To account for this limitation, future research should include matched control groups to better compare the differences in ToM, EF, and WCC between ASD and control individuals. In addition, given the heterogeneity of ASD, some aspects of cognition are more affected in different age groups. Interestingly, cognitive abilities, such as visual and verbal memory, persist across adulthood in ASD, while other cognitive abilities become less apparent in old age (47).
With respect to EF, we found reduced performance in persons with ASD with large to moderate effect sizes for all studied subdomains in the following descending order: planning, working memory, inhibition, and flexibility. These results are in accordance with previous findings of atypical EF in ASD (6, 48). Age-related differences in EF were also observed in children and adolescents with ASD (49, 50). van den Bergh et al. (49) found that inhibition problems were reported less for the older children and adolescents. However, the opposite effect was observed for planning, such that older children and adolescents had more difficulties with planning. Therefore, these findings highlight the heterogeneity of the disorder, thereby emphasizing the need to focus on individual differences when studying EF in ASD.
Concerning the main question of the current study, the regression analyses showed no significant association between any of the EF subdomains and ToM, neither for the ASD nor the TD group. To our knowledge, no previous studies have looked at the relationship between these two cognitive domains employing meta-analytical tools; although previous studies have suggested that the impairment in ToM, which is regularly observed in ASD, might be understood as a consequence of EF dysfunctions (4, 27). The lack of a significant association between EF and ToM rather points at independent dysfunctions. These findings can be taken to suggest that atypical mentalizing should rather be regarded as distinctly autism-specific (51), given the lack of association with domain-general EF atypicalities and despite having been reported for other developmental disorders and conditions [e.g., (9, 13, 14)]. Notably, data used for the regression analysis came from a relatively small group; therefore, results should be cautiously interpreted and rather understood as an explorative approach toward the hypothesis of independent dysfunctions of EF and ToM. Nonetheless, our results are not in accordance with the suggestion of atypical ToM as a result of atypical EF (4, 27). Due to limitations in the number of studies, a correlation analysis for the EF subdomains and WCC was not appropriate; yet, WCC is reported herein according to pre-registration practices. The association between EF and WCC will need to be re-evaluated in future studies once sufficient evidence has been accumulated.
As a common limitation in ASD research, the included samples were very heterogeneous in multiple aspects, such as sample size and inclusion criteria. For instance, some studies allowed for comorbidities or measured the severity of symptoms whereas others did not. Therefore, all participants that were included showed highly different degrees of impairment, limiting comparability but, at the same time, reflecting the nature of the spectrum. Likewise, studies were heterogeneous in terms of paradigms and methodology. For instance, among the four subdomains of EF that were included, there were at least 16 different tasks reported. Moreover, the tests were often adapted for specific samples (e.g., a version for children), or the tests were shortened due to limited attention of participants. Furthermore, the array of tests was not individually checked for validity in the present study. This suggests that a more critical evaluation of task comparability would be useful for future investigations. The clinical and methodological heterogeneity is reflective of the research activities in the whole field, and while we accounted for this by applying random effects models, it calls for cautious interpretation.
Reduced categorization of the ToM tasks remains a further limitation of the data collection. ToM tasks of higher and lower order were not separately assessed but all summarized and considered ToM tasks in the wide sense. Since the cognitive requirements greatly differ depending on the given task in a particular study, the findings may be affected by concentration and cognitive ability. Furthermore, the EF subdomains were not discretely defined, which may also have additionally contributed to the variability.
Some included studies reported unusually high effect sizes. A previous study that had looked at subgroups of EFs also noted relatively high effect sizes. They noticed that high effect sizes were present in studies that had used self-report data or questionnaire data (6). Hence, we inspected our data set for measurements that were used in studies with unusually high effect sizes. This observation was not present in the current data set. Of the 10 studies that had reported effect sizes greater than 1, only two used questionnaires. With exception of WCC, our findings achieved in this conservative analysis remained largely unchanged after excluding studies with particularly high effect sizes.
The independence of EF and ToM renders EF as an unspecific symptom of developmental and neurological conditions (52, 53), and is suggestive of a genetic overlap between developmental disorders (10, 54). Regarding the practical relevance of our findings, children who are being trained in EF skills cannot readily be expected to show a generalization of improvement in mentalizing skills given the independence of functions.
An important factor to consider is the ecological validity of the assessments used to measure cognitive ability and executive functioning in ASD. Ultimately, the goal of research is to apply research findings into practice in a real-world setting. While executive tests are widely used as a measure of EF, studies have found that not all neuropsychological tests have strong ecological validity (55). Therefore, more focus should be placed on developing ecologically valid assessments to measure cognition and executive functioning in ASD. One study introduced the contextual assessment of social skills (CASS), which assesses the conversation ability of participants as a more ecologically valid alternative (56). Results showed strong internal validity of the CASS, and to some extent, external validity of the CASS as a measure of social cognition (56). Since ASD is characterized by atypical communicative and interactive behavior, assessments such as the CASS could be a more ecologically valid measure of social cognition among individuals ASD. Another possibility would be to use multiple types of presentation formats and tasks during assessments to better parse between problems with application versus ability (57).
Conclusion
This meta-analysis and regression showed that there is an overall atypical pattern of performance in ASD for all classical cognitive constructs: EF, ToM, and WCC. Although all EF subdomains were significantly different in the ASD group with a moderate effect size, EF did not show any significant association with the autism-specific domain of mentalizing.
Data Availability Statement
The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding authors.
Author Contributions
CB supported regarding statistics. KV supported in terms of content. All authors contributed to the article and approved the submitted version.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Acknowledgments
Thanks to Annika Behlen for helping with data collection and to all researchers for supplying additional study information upon request.
References
1. American Psychiatric Association [APA]. Diagnostic and statistical manual of mental disorders. 5th ed. Washington, DC: American Psychiatric Association (2013).
2. Ozonoff S, McEvoy RE. A longitudinal study of executive function and theory of mind development in autism. Dev Psychopathol. (1994) 6:415–31. doi: 10.1017/S0954579400006027
3. Ozonoff S, Pennington Bruce F, Rogers Sally J. Executive function deficits in high-functioning autistic individuals: relationship to theory of mind. J Child Psychol Psychiatry. (1991) 32:1081–105. doi: 10.1111/j.1469-7610.1991.tb00351.x
4. Hill EL. Executive dysfunction in autism. Trends Cogn Sci. (2004) 8:26–32. doi: 10.1016/j.tics.2003.11.003
5. Best JR, Miller PH. A developmental perspective on executive function. Child Dev. (2010) 81:1641–60. doi: 10.1111/j.1467-8624.2010.01499.x
6. Demetriou EA, Lampit A, Quintana DS, Naismith SL, Song YJC, Pye JE, et al. Autism spectrum disorders: a meta-analysis of executive function. Mol Psychiatry. (2018) 23:1198–204. doi: 10.1038/mp.2017.75
7. Geurts H, Sinzig J, Booth R, Happé F. Neuropsychological heterogeneity in executive functioning in autism spectrum disorders. Int J Dev Disabil. (2014) 60:155–62. doi: 10.1179/2047387714Y.0000000047
8. Masi A, DeMayo MM, Glozier N, Guastella AJ. An overview of autism spectrum disorder, heterogeneity and treatment options. Neurosci Bull. (2017) 33:183–93. doi: 10.1007/s12264-017-0100-y
9. Jensen O. Brief report: specific executive function profiles in three neurodevelopmental disorders. J Autism Dev Disord. (1999) 29:171–7. doi: 10.1023/a:1023052913110
10. Antshel KM, Russo N. Autism Spectrum Disorders and ADHD: overlapping Phenomenology, Diagnostic Issues, and Treatment Considerations. Curr Psychiatry Rep. (2019) 21:34. doi: 10.1007/s11920-019-1020-5
11. Lukito S, Jones CRG, Pickles A, Baird G, Happé F, Charman T, et al. Specificity of executive function and theory of mind performance in relation to attention-deficit/hyperactivity symptoms in autism spectrum disorders. Mol Autism. (2017) 8:60. doi: 10.1186/s13229-017-0177-1
12. Barnard L, Muldoon K, Hasan R, O’Brien G, Stewart M. Profiling executive dysfunction in adults with autism and comorbid learning disability. Autism. (2008) 12:125–41. doi: 10.1177/1362361307088486
13. Watkins LH, Sahakian BJ, Robertson MM, Veale DM, Rogers RD, Pickard KM, et al. Executive function in Tourette’s syndrome and obsessive–compulsive disorder. Psychol Med. (2005) 35:571–82. doi: 10.1017/S0033291704003691
14. Gunstad J, Paul RH, Cohen RA, Tate DF, Spitznagel MB, Gordon E. Elevated body mass index is associated with executive dysfunction in otherwise healthy adults. Compr Psychiatry. (2007) 48:57–61. doi: 10.1016/j.comppsych.2006.05.001
15. Baron-Cohen S. The Development of a Theory of Mind in Autism: deviance and Delay? Psychiatr Clin North Am. (1991) 14:33–51. doi: 10.1016/S0193-953X(18)30323-X
16. Dakin S, Frith U. Vagaries of visual perception in autism. Neuron. (2005) 48:497–507. doi: 10.1016/j.neuron.2005.10.018
17. Beaumont R, Newcombe P. Theory of mind and central coherence in adults with high-functioning autism or Asperger syndrome. Autism. (2006) 10:365–82. doi: 10.1177/1362361306064416
18. Happé FGE. Central coherence and theory of mind in autism: reading homographs in context. Br J Dev Psychol. (1997) 15:1–12. doi: 10.1111/j.2044-835X.1997.tb00721.x
19. Heavey L, Phillips W, Baron-Cohen S, Rutter M. The awkward moments test: a naturalistic measure of social understanding in autism. J Autism Dev Disord. (2000) 30:225–36. doi: 10.1023/a:1005544518785
20. Kimhi Y. Theory of mind abilities and deficits in autism spectrum disorders. Top Lang Disord. (2014) 34:329–43. doi: 10.1097/TLD.0000000000000033
22. Muth A, Honekopp J, Falter CM. Visuo-spatial performance in autism: a meta-analysis. J Autism Dev Disord. (2014) 44:3245–63. doi: 10.1007/s10803-014-2188-5
23. Mottron L, Belleville S, Ménard E. Local bias in autistic subjects as evidenced by graphic tasks: perceptual hierarchization or working memory deficit? J Child Psychol Psychiatry. (1999) 40:743–55. doi: 10.1111/1469-7610.00490
24. O’Riordan MA, Plaisted KC, Driver J, Baron-Cohen S. Superior visual search in autism. J Exp Psychol Hum Percept Perform. (2001) 27:719–30. doi: 10.1037/0096-1523.27.3.719
25. Happé F, Ronald A. The ‘fractionable autism triad’: a review of evidence from behavioural, genetic, cognitive and neural research. Neuropsychol Rev. (2008) 18:287–304. doi: 10.1007/s11065-008-9076-8
26. Happé F, Ronald A, Plomin R. Time to give up on a single explanation for autism. Nat Neurosci. (2006) 9:1218–20. doi: 10.1038/nn1770
27. Russell J, Jarrold C, Henry L. Working memory in children with autism and with moderate learning difficulties. J Child Psychol Psychiatry. (1996) 37:673–86. doi: 10.1111/j.1469-7610.1996.tb01459.x
28. Carlson SM, Moses LJ, Breton C. How specific is the relation between executive function and theory of mind? Contributions of inhibitory control and working memory. Infant Child Dev. (2002) 11:73–92. doi: 10.1002/icd.298
29. Carlson SM, Moses LJ, Claxton LJ. Individual differences in executive functioning and theory of mind: an investigation of inhibitory control and planning ability. J Exp Child Psychol. (2004) 87:299–319. doi: 10.1016/j.jecp.2004.01.002
30. Carlson SM, Moses LJ. Individual differences in inhibitory control and children’s theory of mind. Child Dev. (2001) 72:1032–53. doi: 10.1111/1467-8624.00333
31. Sabbagh MA, Moses LJ, Shiverick S. Executive functioning and preschoolers’ understanding of false beliefs, false photographs, and false signs. Child Dev. (2006) 77:1034–49. doi: 10.1111/j.1467-8624.2006.00917.x
32. Pellicano E. The development of core cognitive skills in autism: a 3-year prospective study. Child Dev. (2010) 81:1400–16. doi: 10.1111/j.1467-8624.2010.01481.x
33. Isaksson J, Neufeld J, Bölte S. What’s the link between theory of mind and other cognitive abilities-a co-twin control design of neurodevelopmental disorders. Front Psychol. (2021) 12:575100. doi: 10.3389/fpsyg.2021.575100
34. Rinehart NJ, Bradshaw JL, Moss SA, Brereton AV, Tonge BJ. Atypical interference of local detail on global processing in high-functioning autism and Asperger’s disorder. J Child Psychol Psychiatry. (2000) 41:769–78. doi: 10.1111/1469-7610.00664
35. Booth R, Charlton R, Hughes C, Happé F. Disentangling weak coherence and executive dysfunction: Planning drawing in autism and attention-deficit/hyperactivity disorder. Philos Trans R Soc Lond Ser B Biol Sci. (2003) 358:387–92. doi: 10.1098/rstb.2002.1204
36. Pellicano E. Individual differences in executive function and central coherence predict developmental changes in theory of mind in autism. Dev Psychol. (2010) 46:530–44. doi: 10.1037/a0018287
37. Gonzalez-Gadea ML, Tripicchio P, Rattazzi A, Baez S, Marino J, Roca M, et al. Inter-individual cognitive variability in children with Asperger’s syndrome. Front Hum Neurosci. (2014) 8:575. doi: 10.3389/fnhum.2014.00575
38. Kouklari EC, Tsermentseli S, Auyeung B. Executive function predicts theory of mind but not social verbal communication in school-aged children with autism spectrum disorder. Res Dev Disabil. (2018) 76:12–24. doi: 10.1016/j.ridd.2018.02.015
39. Overweg J, Hartman CA, Hendriks P. Temporarily out of order: temporal perspective taking in language in children with autism spectrum disorder. Front Psychol. (2018) 9:1663. doi: 10.3389/fpsyg.2018.01663
40. Beversdorf DQ, Anderson JM, Manning SE, Anderson SL, Nordgren RE, Felopulos GJ, et al. The effect of semantic and emotional context on written recall for verbal language in high functioning adults with autism spectrum disorder. J Neurol Neurosurg Psychiatry. (1998) 65:685. doi: 10.1136/jnnp.65.5.685
41. The Ottawa Hospital Research Institute. Newcastle Ottawa Quality Assesment Scale for Cohort Studies. (2020). Available online at: http://www.ohri.ca/programs/clinical_epidemiology/oxford.asp (Accessed January 9, 2020).
42. DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials. (1986) 7:177–88. doi: 10.1016/0197-2456(86)90046-2
43. Demetriou EA, DeMayo MM, Guastella AJ. Executive Function in Autism Spectrum Disorder: history, Theoretical Models, Empirical Findings, and Potential as an Endophenotype. Front Psychiatry. (2019) 10:753. doi: 10.3389/fpsyt.2019.00753
44. Jones Catherine RG, Simonoff E, Baird G, Pickles A, Marsden Anita JS, Tregay J, et al. The association between theory of mind, executive function, and the symptoms of autism spectrum disorder. Autism Res. (2017) 11:95–109. doi: 10.1002/aur.1873
45. Loth E, Gómez JC, Happé F. Event schemas in autism spectrum disorders: the role of theory of mind and weak central coherence. J Autism Dev Disord. (2008) 38:449–63. doi: 10.1007/s10803-007-0412-2
46. Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. (2009) 6:e1000097. doi: 10.1371/journal.pmed.1000097
47. Lever AG, Geurts HM. Age-related differences in cognition across the adult lifespan in autism spectrum disorder. Autism Res. (2016) 9:666–76. doi: 10.1002/aur.1545
48. Lai CLE, Lau Z, Lui SSY, Lok E, Tam V, Chan Q, et al. Meta-analysis of neuropsychological measures of executive functioning in children and adolescents with high-functioning autism spectrum disorder. Autism Res. (2017) 10:911–39. doi: 10.1002/aur.1723
49. van den Bergh SFWM, Scheeren AM, Begeer S, Koot HM, Geurts HM. Age related differences of executive functioning problems in everyday life of children and adolescents in the autism spectrum. J Autism Dev Disord. (2014) 44:1959–71. doi: 10.1007/s10803-014-2071-4
50. Rosenthal M, Wallace GL, Lawson R, Wills MC, Dixon E, Yerys BE, et al. Impairments in real-world executive function increase from childhood to adolescence in autism spectrum disorders. Neuropsychology. (2013) 27:13–8. doi: 10.1037/a0031299
51. Joseph RM, Tager-Flusberg H. The relationship of theory of mind and executive functions to symptom type and severity in children with autism. Dev Psychopathol. (2004) 16:137–55. doi: 10.1017/S095457940404444X
52. Hessen E, Alfstad KÅ, Torgersen H, Lossius MI. Tested and reported executive problems in children and youth epilepsy. Brain Behav. (2018) 8:e00971. doi: 10.1002/brb3.971
53. Levit A, Hachinski V, Whitehead SN. Neurovascular unit dysregulation, white matter disease, and executive dysfunction: the shared triad of vascular cognitive impairment and Alzheimer disease. Geroscience. (2020) 42:445–65. doi: 10.1007/s11357-020-00164-6
54. Hovik KT, Egeland J, Isquith PK, Gioia G, Skogli EW, Andersen PN, et al. Distinct patterns of everyday executive function problems distinguish children with tourette syndrome from children with ADHD or autism spectrum disorders. J Atten Disord. (2017) 21:811–23. doi: 10.1177/1087054714550336
55. Chaytor N, Schmitteredgecombe M, Burr R. Improving the ecological validity of executive functioning assessment. Arch Clin Neuropsychol. (2006) 21:217–27. doi: 10.1016/j.acn.2005.12.002
56. Simmons GL, Ioannou S, Smith JV, Corbett BA, Lerner MD, White SW. Utility of an observational social skill assessment as a measure of social cognition in autism. Autism Res. (2021) 14:709–19. doi: 10.1002/aur.2404
57. Eddy CM. What do you have in mind? Measures to assess mental state reasoning in neuropsychiatric populations. Front Psychiatry. (2019) 10:425. doi: 10.3389/fpsyt.2019.00425
58. Baez S, Rattazzi A, Gonzalez-Gadea ML, Torralva T, Vigliecca NS, Decety J, et al. Integrating intention and context: assessing social cognition in adults with Asperger syndrome. Front Hum Neurosci. (2012) 6:302. doi: 10.3389/fnhum.2012.00302
59. Beaumont RB, Sofronoff K. A new computerised advanced theory of mind measure for children with Asperger Syndrome: the ATOMIC. J Autism Dev Disord. (2008) 38:249–60. doi: 10.1007/s10803-007-0384-2
60. Berenguer C, Miranda A, Colomer C, Baixauli I, Roselló B. Contribution of theory of mind, executive functioning, and pragmatics to socialization behaviors of children with high-functioning autism. J Autism Dev Disord. (2018) 48:430–41. doi: 10.1007/s10803-017-3349-0
61. Berenguer C, Roselló B, Colomer C, Baixauli I, Miranda A. Children with autism and attention deficit hyperactivity disorder. Relationships between symptoms and executive function, theory of mind, and behavioral problems. Res Dev Disabil. (2018) 83:260–9. doi: 10.1016/j.ridd.2018.10.001
62. Brunsdon VEA, Colvert E, Ames C, Garnett T, Gillan N, Hallett V, et al. Exploring the cognitive features in children with autism spectrum disorder, their co-twins, and typically developing children within a population-based sample. J Child Psychol Psychiatry. (2015) 56:893–902. doi: 10.1111/jcpp.12362
63. Cantio C, White S, Madsen GF, Bilenberg N, Jepsen JRM. Do cognitive deficits persist into adolescence in autism? Autism Res. (2018) 11:1229–38. doi: 10.1002/aur.1976
64. Durrleman S, Franck J. Exploring links between language and cognition in autism spectrum disorders: complement sentences, false belief, and executive functioning. J Commun Disord. (2015) 54:15–31. doi: 10.1016/j.jcomdis.2014.12.001
65. Edgin JO, Pennington BF. Spatial cognition in autism spectrum disorders: superior, impaired, or just intact? J Autism Dev Disord. (2005) 35:729. doi: 10.1007/s10803-005-0020-y
66. Gonzalez-Gadea ML, Baez S, Torralva T, Castellanos FX, Rattazzi A, Bein V, et al. Cognitive variability in adults with ADHD and AS: disentangling the roles of executive functions and social cognition. Res Dev Disabil. (2013) 34:817–30. doi: 10.1016/j.ridd.2012.11.009
67. Hanson LK, Atance CM. Brief report: episodic foresight in autism spectrum disorder. J Autism Dev Disord. (2014) 44:674–84. doi: 10.1007/s10803-013-1896-6
68. Kouklari EC, Tsermentseli S, Monks CP. Developmental trends of hot and cool executive function in school-aged children with and without autism spectrum disorder: links with theory of mind. Dev Psychopathol. (2018) 31:541–56. doi: 10.1017/S0954579418000081
69. Lam YG. Re-examining the cognitive phenotype in autism: a study with young Chinese children. Res Dev Disabil. (2013) 34:4591–8. doi: 10.1016/j.ridd.2013.09.039
70. Lam YG, Yeung S-S. Cognitive deficits and symbolic play in preschoolers with autism. Res Autism Spectr Disord. (2012) 6:560–4. doi: 10.1016/j.rasd.2011.07.017
71. Low J, Goddard E, Melser J. Generativity and imagination in autism spectrum disorder: evidence from individual differences in children’s impossible entity drawings. Br J Dev Psychol. (2009) 27:425–44. doi: 10.1348/026151008x334728
72. Lai M-C, Lombardo MV, Ruigrok ANV, Chakrabarti B, Wheelwright SJ, Auyeung B, et al. Cognition in males and females with autism: similarities and differences. PLoS One. (2012) 7:e47198. doi: 10.1371/journal.pone.0047198
73. Le Sourn-Bissaoui S, Caillies S, Gierski F, Motte J. Inference processing in adolescents with Asperger syndrome: relationship with theory of mind abilities. Res Autism Spectr Disord. (2009) 3:797–808. doi: 10.1016/j.rasd.2009.03.003
74. Lind SE, Bowler DM, Raber J. Spatial navigation, episodic memory, episodic future thinking, and theory of mind in children with autism spectrum disorder: evidence for impairments in mental simulation? Front Psychol. (2014) 5:1411. doi: 10.3389/fpsyg.2014.01411
75. Livingston LA, Colvert E, Bolton P, Happé F. Good social skills despite poor theory of mind: exploring compensation in autism spectrum disorder. J Child Psychol Psychiatry. (2018) 60:102–10. doi: 10.1111/jcpp.12886
76. Lehnhardt FC, Gawronski A, Volpert K, Schilbac L, Tepe R, Hu W, et al. Autismus-Spektrum-Störungen im Erwachsenenalter: klinische und neuropsychologische Befunde spatdiägnostizierter Asperger-Syndrome = Autism spectrum disorders in adulthood: clinical and neuropsychological findings of Aspergers syndrome diagnosed late in life. Fortschr Neurol Psychiatr. (2011) 79:290–7. doi: 10.1055/s-0031-1273233
77. Miranda A, Berenguer C, Roselló B, Baixauli I, Colomer C. Social cognition in children with high-functioning autism spectrum disorder and attention-deficit/hyperactivity disorder. associations with executive functions. Front Psychol. (2017) 8:1035. doi: 10.3389/fpsyg.2017.01035
78. Montgomery JM, Stoesz BM, McCrimmon AW. Emotional intelligence, theory of mind, and executive functions as predictors of social outcomes in young adults with Asperger syndrome. Focus Autism Other Dev Disabil. (2013) 28:4–13. doi: 10.1177/1088357612461525
79. Narzisi A, Muratori F, Calderoni S, Fabbro F, Urgesi C. Neuropsychological profile in high functioning autism spectrum disorders. J Autism Dev Disord. (2013) 43:1895–909. doi: 10.1007/s10803-012-1736-0
80. Pellicano E. Links between theory of mind and executive function in young children with autism: clues to developmental primacy. Dev Psychol. (2007) 43:974–90. doi: 10.1037/0012-1649.43.4.974
81. Pellicano E, Maybery M, Durkin K, Maley A. Multiple cognitive capabilities/deficits in children with an autism spectrum disorder: “Weak” central coherence and its relationship to theory of mind and executive control. Dev Psychopathol. (2006) 18:77–98. doi: 10.1017/S0954579406060056
82. Schuwerk T, Jarvers I, Vuori M, Sodian B. Implicit mentalizing persists beyond early childhood and is profoundly impaired in children with autism spectrum condition. Front Psychol. (2016) 7:1696. doi: 10.3389/fpsyg.2016.01696
83. Stichter JP, O’Connor KV, Herzog MJ, Lierheimer K, McGhee SD. Social competence intervention for elementary students with aspergers syndrome and high functioning autism. J Autism Dev Disord. (2012) 42:354–66. doi: 10.1007/s10803-011-1249-2
84. Vanmarcke S, Van Der Hallen R, Evers K, Noens I, Steyaert J, Wagemans J. Ultra-rapid categorization of meaningful real-life scenes in adults with and without ASD. J Autism Dev Disord. (2016) 46:450–66. doi: 10.1007/s10803-015-2583-6
85. Vanegas SB, Davidson D. Investigating distinct and related contributions of weak central coherence, executive dysfunction, and systemizing theories to the cognitive profiles of children with autism spectrum disorders and typically developing children. Res Autism Spectr Disord. (2015) 11:77–92. doi: 10.1016/j.rasd.2014.12.005
86. Williams D, Boucher J, Lind S, Jarrold C. Time-based and event-based prospective memory in autism spectrum disorder: the roles of executive function and theory of mind, and time-estimation. J Autism Dev Disord. (2013) 43:1555–67. doi: 10.1007/s10803-012-1703-9
87. Yang J, Zhou S, Yao S, Su L, McWhinnie C. The relationship between theory of mind and executive function in a sample of childrenfrom mainland China. Child Psychiatry Hum Dev. (2009) 40:169–82. doi: 10.1007/s10578-008-0119-4
Keywords: autism (ASD), executive function, cognitive profile, theory of mind, weak central coherence
Citation: Hemmers J, Baethge C, Vogeley K and Falter-Wagner CM (2022) Are Executive Dysfunctions Relevant for the Autism-Specific Cognitive Profile? Front. Psychiatry 13:886588. doi: 10.3389/fpsyt.2022.886588
Received: 28 February 2022; Accepted: 24 May 2022;
Published: 18 July 2022.
Edited by:
Clare Margaret Eddy, Birmingham and Solihull Mental Health NHS Foundation Trust, United KingdomReviewed by:
Eleni Andrea Demetriou, The University of Sydney, AustraliaSusana Mouga, Coimbra Institute for Biomedical Imaging and Translational Research (CIBIT), Portugal
Copyright © 2022 Hemmers, Baethge, Vogeley and Falter-Wagner. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Julia Hemmers, anVsaWEuaGVtbWVyc0Bnb29nbGVtYWlsLmNvbQ==; Christine M. Falter-Wagner, Y2hyaXN0aW5lLmZhbHRlckBjYW50YWIubmV0