Skip to main content

CLINICAL TRIAL article

Front. Psychol., 09 September 2021
Sec. Psychology for Clinical Settings

An Exploratory Investigation of Goal Management Training in Adults With ADHD: Improvements in Inhibition and Everyday Functioning

  • 1Department of Biological and Medical Psychology, University of Bergen, Bergen, Norway
  • 2Division of Mental Health, Betanien Hospital, Bergen, Norway
  • 3Division of Psychiatry, Haukeland University Hospital, Bergen, Norway
  • 4Department of Clinical Medicine, University of Bergen, Bergen, Norway
  • 5Department of Psychology, University of Oslo, Oslo, Norway
  • 6Department of Research, Lovisenberg Diaconal Hospital, Oslo, Norway
  • 7Department of Biomedicine, University of Bergen, Bergen, Norway

Background: Adults with attention deficit/hyperactivity disorder (ADHD) are predominantly treated with medication. However, there is also a need for effective, psychologically based interventions. As ADHD is strongly associated with reduced inhibitory control, cognitive remediation approaches should be efficient. Goal management training (GMT) aims at enhancing inhibitory control and has shown positive effects on inhibitory control in non-ADHD patient groups. The aim of the current study was to explore whether GMT would specifically enhance inhibitory control in adults with ADHD, and if such an enhancement would lead to secondary improvements in self-reported everyday functioning.

Methods: Twenty-one participants with ADHD (mean age: 39.05 years [SD 11.93]) completed the intervention and assessments pre-, post- and 6 months after the intervention. Measures included neuropsychological tests and self-report questionnaires pertaining to cognitive- and executive functioning, emotion regulation, quality of life, and ADHD symptoms.

Results: Compared to baseline, the participants showed enhanced inhibitory control on performance-based measures at post-assessment and 6-month follow-up. The participants also reported increased productivity and reduced cognitive difficulties in everyday life at both assessments post-treatment, as well as improvements in aspects of emotion regulation and a reduction in the severity of core ADHD-symptoms at 6-month follow-up.

Conclusion: Our exploratory study showed that GMT seems to specifically improve one of the core executive dysfunctions in ADHD, namely inhibitory control, with a positive effect lasting at least 6 months post-treatment. The adults with ADHD also reported improved self-regulation in their everyday life after completing GMT, providing strong arguments for further investigations of GMT as a treatment option for this group of adults.

Clinical Trial Registration: The study is registered under ISRCTN.com (ISRCTN91988877; https://doi.org/10.1186/ISRCTN91988877).

Introduction

Attention deficit/hyperactivity disorder (ADHD) is a common neurodevelopmental disorder affecting individuals of all ages with an estimated prevalence of 2.5–4.4% among adults (DSM-5; Kessler et al., 2006; Simon et al., 2009; Badre, 2011; American Psychiatric Association, 2013; Polanczyk et al., 2014). Many negative consequences of ADHD have been documented ranging from difficulties regulating automatic and controlled cognitive processes, including reading, in childhood (Capri et al., 2020; Mohammadhasani et al., 2020) to underachievement in work and education later in life (Biederman et al., 2006; Halmøy et al., 2009; Klein et al., 2012; Halleland et al., 2015), difficulties related to social functioning (Biederman et al., 2006; Klein et al., 2012), and even increased mortality (e.g., Dalsgaard et al., 2015). These difficulties are partly related to the core ADHD symptoms of inattention, hyperactivity and impulsivity (Badre, 2011; American Psychiatric Association, 2013). However, they have also been linked to another frequently observed characteristic of ADHD, namely reduced executive functioning (e.g., reduced academic achievement, reduced occupational attainment; Barry et al., 2002; Doyle, 2006; Raggi and Chronis, 2006; Sarkis, 2014; Halleland et al., 2015; Fabio and Caprì, 2017).

The main treatment for adults with the disorder is pharmacotherapy with stimulant drugs (Kooij et al., 2010; Faraone et al., 2015; NICE, 2018). Despite strong evidence for its effectiveness (e.g., Cortese et al., 2018), pharmacological treatment of ADHD does not seem to fit all. In fact, a substantial number of patients continue to struggle with their symptoms, are ineligible or do not tolerate the side effects of the medication, opt out of such treatment, or discontinue the prescribed treatment (Lopez et al., 2018; NICE, 2018; Mohr-Jensen et al., 2020). Among the most frequent side effects of such treatments are loss of appetite, headaches, abdominal pain, increased heart rate and blood pressure, and available findings indicate that a significant number of those receiving medication discontinue treatment due to such adverse effects (Cortese et al., 2018; Storebø et al., 2018; Elliott et al., 2020). Other investigations also indicate that medication use is associated with psychological adverse effects such as an experience of altered cognition, reduced creativity, increases in emotional difficulties, reduced engagement in activities and a sense of changing as a person (Kovshoff et al., 2016). There is also a lack of knowledge regarding long term tolerability and effects of ADHD-medication, and the risk of less common side effects (Elliott et al., 2020). Development of other treatment alternatives is, therefore, warranted. This is also in line with the stated wishes of adults with ADHD, and with findings showing that patients who are offered treatment options in addition to pharmacotherapy are more satisfied with the health services they receive compared to adults without such options (Solberg et al., 2015). Thus, there has been an increasing effort to develop psychologically based treatment alternatives for adults with ADHD (Kooij et al., 2010; Franke et al., 2018; Lopez et al., 2018; López-Pinar et al., 2018; Lam et al., 2019; Nimmo-Smith et al., 2020), most of which are based on cognitive-behavioral approaches. Findings indicate that such interventions may lead to reductions in core symptoms, and further, that cognitive remediation interventions may specifically improve the ability to organize everyday activities (e.g., Stevenson et al., 2002; De Crescenzo et al., 2017; Nimmo-Smith et al., 2020). The evidence in favor of these interventions is, however, still scarce.

This has led to efforts aimed at exploring whether psychological interventions can ameliorate difficulties in executive functioning in individuals with ADHD. Procedures to improve working memory functioning have been investigated in children (e.g., Melby-Lervåg and Hulme, 2013) and adults with ADHD (e.g., Dentz et al., 2020). Although some studies show positive short-term effects on working memory functioning, long-term effects are uncertain and there is limited support for generalization to other aspects of executive functioning (Melby-Lervåg and Hulme, 2013; Dentz et al., 2020). The viability of applying existing working memory training programs on a population of adults with ADHD has also been questioned due to indications of limited tolerability (Marcelle et al., 2018). Similarly, studies of neurofeedback as a treatment for ADHD in children have yielded mixed findings with regards to effects on core symptoms and executive functioning (Cortese et al., 2016; Van Doren et al., 2019), while studies of neurofeedback in adults with ADHD are still limited.

In an effort to further the understanding of whether psychological interventions targeting executive functioning in adults with ADHD would be an efficient treatment alternative, we wanted to examine the effects of goal management training (GMT; Robertson, 1996; Levine et al., 2000, 2011). GMT is a group-based, metacognitive remediation protocol with an emphasis on strengthening inhibitory- and attentional control to support participants in employing strategies to maintain goal-directed behavior over time. Thus, the choice of GMT in the current study was based on the fact that poor inhibitory control has been described as a predominant causal factor of ADHD (e.g., Barkley, 1997; Sonuga-Barke et al., 2010), in addition to being conceptualized as a core component of executive functioning (Badre, 2011; Miyake and Friedman, 2012). It is also a strength that GMT has been shown to ameliorate executive dysfunction, including inhibitory control, in other groups (e.g., older adults, patients with substance use disorders) experiencing some of the same challenges as adults with ADHD (van Hooren et al., 2007; Alfonso et al., 2011; Stamenova and Levine, 2019). To the best of our knowledge, GMT for adults with ADHD has only been tested in a small-scale pilot study (In de Braek et al., 2017). In that study, a modified manual consisting of GMT and psychoeducation (n = 12) was compared with the effect of psychoeducation without GMT (n = 15), and it included outcome measures focusing predominantly on everyday cognitive functioning according to the Cognitive Failures Questionnaire (CFQ; Broadbent et al., 1982) and a clinician-rated evaluation of everyday cognitive functioning (see Schneider et al., 1997). Only one performance-based measure, assessing everyday problem-solving, was included (Zoo Map From the Behavioral Assessment of the Dysexecutive Syndrome; Krabbendam et al., 1999). A positive effect of GMT was found only on the clinician-rated evaluation of cognitive functioning in everyday life (In de Braek et al., 2017). Importantly, the study employed a modified version of GMT which included several sessions of psychoeducation and an individual session in addition to the sessions that are part of the GMT manual. As such, it is difficult to draw conclusions about the specificity of the reported effects to GMT as psychoeducation may also have made significant contributions (e.g., Vidal et al., 2013).

The aim of the current study was to follow up on the pilot study by In de Braek et al. (2017) by employing an unmodified version of GMT. We aimed to test a neuropsychological model of how to measure effects of GMT in adults with ADHD by including performance-based measures of attention and executive functions, and by this provide a model that can guide future randomized controlled studies of GMT. Previous studies in other patient groups have found significant improvements following GMT on several performance-based measures of inhibitory control and related constructs (e.g., Levine et al., 2011; Stubberud et al., 2013; Hagen et al., 2020), including on a self-report measure of inhibitory control and executive functioning (Stubberud et al., 2014). We therefore wanted to test whether GMT specifically targets the typically found reduced inhibitory control characteristic of adults with ADHD. To do so, we conducted an exploratory pilot trial of GMT in adults with ADHD, focusing specifically on effects on inhibitory control compared to effects on other aspects of executive functions such as working memory, flexible control of processing speed, and general problem-solving. We expected to find significant effects of GMT predominantly on test measures assessing inhibitory control, such as the Color Word Interference Test (CWIT) and the Tower test (Delis et al., 2001). These are tests that have previously shown that adults with ADHD tend to have impaired inhibitory control (see Young et al., 2007; Halleland et al., 2015). As secondary aims, we wanted to examine aspects of everyday functioning and expected that improved inhibitory control following GMT would be reflected in self-reports of executive-, behavioral-, and emotional control, as well as in improved quality of life.

Materials and Methods

Participants

In total, 36 potential participants were recruited for the present study through two different approaches. A small subset of participants (N = 7) were recruited through an existing study of ADHD in adults at the University of Bergen (see Halleland et al., 2012 for a description of this study), while the majority of participants (N = 29) were recruited through local outpatient clinics in the municipality of Bergen. Recruitment was conducted by distributing a short information letter about the project, i.e., inclusion and exclusion criteria, the GMT intervention, assessments as well as a prompt to contact members of the project staff for further information. Upon contacting a project member, interested individuals were screened for eligibility and given further information about the study as well as an informed-consent form in accordance with the Helsinki declaration. The study protocol was approved by the Regional Committee for Medical and Health Research Ethics, West Norway (2015/2325). All participants were compensated with 1000 NOK (approximately 110 USD) at the completion of the follow-up assessment to cover travel expenses.

Inclusion criteria for the study were an age of 18 years or older and a clinical diagnosis of ADHD (obtained prior to the project). Participants on medication were asked to avoid changes in dosage during the project period unless necessary. Exclusion criteria for the project were a lifetime history of psychotic disorder or an ongoing, severe psychiatric illness (i.e., moderate to severe suicidality, severe depression, severe social anxiety preventing participation in group sessions), ongoing substance use disorders and a full-scale intelligence quotient (IQ) below 80.

Procedure

All potential participants completed the Mini International Neuropsychiatric Interview Plus (M.I.N.I. Plus; Sheehan et al., 1998) as the first step of the baseline assessment to screen for severe psychiatric disorders or substance abuse. The Wechsler Abbreviated Scale of Intelligence (WASI; Wechsler, 1999) was used to estimate the participants’ IQ. After completion of this introductory step, eligible participants were asked to complete the assessment procedure (see details below). With one exception (i.e., one participant had to be moved to a different group due to scheduling conflicts and therefore completed the assessment 5 weeks before attending the first session of GMT), all assessments were conducted within 3 weeks prior to the first session of GMT. Post-treatment assessments were conducted within two weeks following the last group session, and the follow-up assessment was conducted six calendar months after completion of the intervention (±2 weeks).

Goal Management Training

Goal management training is a group-based metacognitive remediation program developed by Robertson (1996), Levine et al. (2000) based on Duncan (1986). According to Duncan’s theory goal management fails as a result of the individual being unable to maintain current goals when faced with competing demands in the form of external or internal stimuli. GMT therefore emphasizes a five-stage strategy aimed at supporting the processes needed for goal achievement. These stages include the intermittent stopping of ongoing behavior to assess whether this is in line with current goals and, indeed, whether current goals are clear, structuring goals as a manageable set of subgoals, self-cueing to regulate alertness and attentional control, and regular reassessment of goal list and the progress made as a result of current behavior. Mindfulness-based exercises are also included to support sustained attention, help participants maintain a present centered focus and self-regulation. The intervention followed a manualized protocol used in earlier studies (e.g., Stubberud et al., 2013; Tornås et al., 2016) consisting of PowerPoint slides and a participant workbook. The materials used in this study were translated into Norwegian and back-translated to English as part of the study conducted by Stubberud et al. (2013). Minimal adjustments were made to the materials in order to adapt the educational part to participants with ADHD (i.e., mention of brain injury and its consequences were replaced with references to ADHD). The intervention consisted of nine weekly 2-h group sessions (see Table 1). Of note, participants had to attend a minimum of six out of the nine group sessions to be classified as completers. Each group had four to eight participants and was led by a clinical psychologist and a co-therapist who was either a clinical psychologist or a clinical psychology student with clinical experience. The sessions were conducted during nine consecutive weeks when possible, or over a maximum of 11 weeks when holidays made this necessary. The sessions consisted of lectures, discussions and skill training intended to increase participants’ awareness of their own attention as well as their awareness of the skills and techniques included in GMT. The included strategies are aimed at promoting goal-directed behavior through increasing executive and inhibitory control, stressing participants to periodically stop ongoing behavior (“stop-and-think”), monitor performance, and employ a stepwise approach to problem-solving (Levine et al., 2011). Furthermore, the element of sustained attention runs continuously through GMT, and is reinforced through mindfulness exercises (Kabat-Zinn, 1990). Participants were also encouraged to practice between sessions and to employ the workbook to structure these efforts. Homework assignments included monitoring everyday behavior, recording absentmindedness as well as goal attainment, and mindfulness exercises. These assignments were the basis for in-group discussions of the participants’ experiences related to executive difficulties in their everyday life.

TABLE 1
www.frontiersin.org

Table 1. An overview of the nine GMT sessions as well as the main content.

Clinician Administered Measures

The M.I.N.I. Plus (Sheehan et al., 1998) was used to assess potential participants for severe psychiatric illness necessitating exclusion from the project. The M.I.N.I. Plus was administered at baseline by project members who were either a licensed clinical psychologist or a clinical psychology student with experience from clinical practice and the use of diagnostic interviews under the supervision of a clinical psychologist.

Performance-Based Measures

Wechsler Abbreviated Scale of Intelligence

Performance on two subtests from WASI (Matrix reasoning and Vocabulary: Wechsler, 1999) were used to estimate the participants’ IQ score. Participants completed this measure at baseline.

Delis-Kaplan Executive Function System: Trail Making Test

The Trail Making Test (TMT) from the Delis-Kaplan Executive Function System (D-KEFS; Delis et al., 2001) was administered to assess the executive functions of attentional control and cognitive flexibility (switching). The fourth task is of special interest in the current study. Here, the participants are asked to connect circles with numbers and letters in an ascending and alternating pattern. Completion time and number and type of errors are recorded.

Delis-Kaplan Executive Function System: Color-Word Interference Test

The CWIT (Delis et al., 2001) was administered to assess the executive function of inhibitory control. The test consists of 4 different subtasks. Of interest to the current investigation are conditions three and four where participants are instructed to name the color of a color-word printed in a color that does not match the color-word, or to switch between naming the un-matched, printed color and reading the color words. Completion times and errors are recorded.

Delis-Kaplan Executive Function System: Tower Test

The Tower Test (Delis et al., 2001) was administered to assess inhibition. In the test, subjects are asked to recreate a model based on a picture of the required outcome. To do so they are asked to use a specified number of disks of varying sizes and place them in the depicted pattern. They may only move one disk at a time, all disks must always be placed on one of three pegs, and larger disks may not be placed on top of smaller disks. Participants are asked to complete the depicted model in as few moves as possible, while attending to the rules. Time of first move, number of moves, rule violations, completion time and performance (i.e., completion of correct model) are recorded.

Letter-Number Sequencing and Spatial Span

The Letter-Number Sequencing task from the Wechsler Adult Intelligence Scale – 4th edition (Wechsler, 2008a) and the Spatial span from the Wechsler Memory Scale – 3rd edition (Wechsler, 2008b) were used to assess the participants’ working memory functions. In the Letter-Number Sequencing an increasing number of letters and numbers are read to the participant, the participant is then asked to repeat the sequence by arranging the numbers in increasing order followed by the letters in alphabetical order. In the Spatial span task, the examiner touches a sequence of blocks in a specified order and the participant is asked to copy the sequence (i.e., forward span) or to do so in the opposite order (i.e., backward span).

Hotel Task

The Hotel task (Manly et al., 2002) was administered as an analog of real-life problem-solving and a measure of generalization. The Hotel task consists of six different subtasks, and the participant are asked to distribute the allotted time of 15 min as evenly as possible across five of these while also completing the sixth task at two specified time points. Deviations from ideal time (e.g., 300 s) spent on the five time-demanding subtasks are recorded, so is deviation from the specified time when completing the sixth task, as well as total number of tasks attempted. The Hotel task has been shown to be sensitive to executive dysfunction and to have acceptable ecological validity (Roca et al., 2009).

Self-Report measures

Cognitive Failures Questionnaire

The CFQ (Broadbent et al., 1982) is a 25-item self-report questionnaire where respondent are asked to rate each statement using a scale from 0 (never) to 4 (very often). Higher total score indicates a higher number of difficulties related to failures in perception, memory, and motor functions.

Adult ADHD Self-Report Scale

The Adult ADHD Self-report Scale (ASRS; Kessler et al., 2005) is an 18-item symptom checklist assessing the presence of core symptoms of ADHD during the last 6 months prior to evaluation. Respondents are asked to scale each item from 0 (never) to 4 (very often). The checklist consists of nine statements related to symptoms of inattention and nine statements related to symptoms of hyperactivity/impulsivity. Both sub-scores for these two domains as well as a total sum score are calculated.

Wender-Utah Rating Scale

The Wender-Utah Rating Scale (WURS; Ward et al., 1993) is a 25-item retrospective self-report checklist assessing the presence of various difficulties associated with ADHD in childhood based on the Utah criteria (Wender, 1972). Respondents are asked to respond to each item using a scale ranging from 0 (not at all, or just a little) to 4 (very much). The WURS was used to characterize the sample and was only administered at baseline.

Adult ADHD Quality of Life Inventory

The Adult ADHD Quality of Life inventory (AAQoL; Brod et al., 2005) is a 29-item questionnaire were participants were instructed to respond to each item using a 5-point scale ranging from 1 (not at all/never) to 5 (extremely/very often), resulting in four subscales (Life Outlook, Life Productivity, Psychological Health, and Relationships) as well as a total score.

Behavior Rating Inventory of Executive Function – Adult Version

The Behavior Rating Inventory of Executive Function Adult version (BRIEF-A; Gioia et al., 2000) is a 75-item self-report measure of everyday executive function. Participants are asked to rate each item ìs frequency of occurrence on a 3-point Likert scale from 1 (never) to 3 (often). The instrument yields nine clinical scales, as well as two broad index scores. Of particular interest to the current study are the subscales Inhibit, Shift and Working memory, as well as the index scores for Behavior regulation and Metacognition. The Global executive composite score is also reported.

Dysregulation of Emotions Rating Scale

The Dysregulation of Emotions Rating Scale (DERS; Gratz and Roemer, 2004) is a 36-item questionnaire where participants are asked to rate each item using a 1 (almost never) to 5 (almost always) scale. The DERS consists of six subscales as well as a total score. For the present study, subscales measuring difficulties engaging in goal-directed behavior, impulse control difficulties and access to emotion regulation strategies when experiencing challenging emotions as well as total score, were employed.

All tests and questionnaires, except the WASI and the WURS, were administered at all assessments. Cronbach’s αs ranged from acceptable to excellent (between 0.87 and 0.96).

Analyses

Preliminary Analyses

Statistical analyses were conducted using R version 4.0.2 (R Development Core Team, 2020) and SPSS version 25 (Ibm Corporation., 2017). For all variables containing missing items, comparisons of means and covariances were conducted using Little’s missing completely at random test (Little, 1988). Outliers were identified using median absolute deviation (MAD) and a conservative cut-off of ± three times the MAD (Leys et al., 2013). Independent sample, two-sided t-tests were conducted as preliminary analyses to compare the baseline characteristics of those participants who completed the intervention and those who dropped out with regards to self-report- and performance-based measures.

Main Analyses of Treatment Effects

Linear mixed-effects regression was performed using the lme4 package for R (Bates et al., 2015). Random intercepts were specified, and restricted maximum likelihood (REML) was used. Assessment session was used as the metric of time in the analyses, and coefficients represent change from baseline. Due to the limited statistical power of the study, these analyses were conducted without controlling for covariates. In a second step, exploratory analyses including medication status and age as covariates were conducted on those measures showing a significant effect in the principal analyses. Significance tests were adjusted using false discovery rate control due to the number of tests performed following the procedure of Benjamini and Hochberg (i.e., p < d × i/n; Benjamini and Hochberg, 1995; Glickman et al., 2014). Power-analyses conducted using Gpower (Faul et al., 2007) prior to the study indicated that with an assumption of medium effect sizes and an α of.05 a total sample size of 27 participants would be required to reach a power of.80 if employing t-tests.

Results

Completion

Thirty-six potential participants volunteered for the study. Four participants were excluded, one due to psychotic disorder, one due to ongoing substance abuse, and two participants because they failed to complete the pre-assessment. The remaining 32 participants were included in the study.

Twenty-three participants completed the intervention, of which 21 completed the post-intervention and follow-up assessments. Of the 11 participants who dropped out, nine did so without giving notice or answering phone calls attempting to reestablish contact. Of these, one did so before the first treatment session, three participants attended one session prior to dropping out, one participant attended two sessions, two participants attended three sessions, and two participants completed the intervention but did not attend the post-treatment assessment. The two drop-out participants who gave notice both reported changes in their work schedules as the reason for drop-out after attending two and three sessions, respectively. All participants who completed the intervention attended a minimum of seven of the nine group sessions (see Figure 1).

FIGURE 1
www.frontiersin.org

Figure 1. A diagram showing the enrollment of subjects, their inclusion in the treatment and the data included in the analyses.

Missing Data and Outliers

The dataset had 16 missing single items from questionnaires (totaling 1% or less of total item responses per questionnaire). Little’s missing completely at random test showed that all missing items were randomly distributed. Missing items were therefore replaced using the expectation maximization algorithm in SPSS. One participants’ BRIEF-A-questionnaire from the pre-assessment was missing, assessment data from one participant was also missing for most measures of the post-assessment, and for another participant on all measures of the follow-up assessment. Complete questionnaires that were missing were not replaced.

In addition, 32 scores were identified as outliers (approximately 1% of total scores), and were replaced with ± MAD.

Participant Characteristics

Table 2 shows baseline characteristics of the complete sample, in addition to the subgroups who completed the intervention (completers) and those who did not (non-completers). Non-completers were significantly younger and reported lower quality of life at baseline compared to completers. Regarding comorbidities there were no significant differences between completers and non-completers, but a non-significant trend toward non-completers reporting higher symptom severity.

TABLE 2
www.frontiersin.org

Table 2. Descriptive characteristics of the sample and the subgroups of completers and non-completers at baseline.

Treatment Effects – Completer Sample

An overview of changes in the included variables from pre- to post- and follow-up assessments among participants who completed GMT is shown in Table 3.

TABLE 3
www.frontiersin.org

Table 3. Simplified outputs from Linear Mixed-Effects Regressions of performance-based measures examining change from baseline to post intervention and 6-month follow-up assessments.

Primary Outcome Measures – Performance-Based Tests of Executive Functions

Analyses of scores on the performance-based measures of executive functions and problem solving showed improved efficiency in inhibitory control from baseline to post-assessment, as evidenced by a significant reduction in completion times on the third and fourth conditions of the CWIT (Ms = 55.55 and 62.47 at baseline, Mdif = −4.48 and −8.64 for the third condition and fourth condition, respectively). These changes were maintained at follow-up 6 months later (Mdif = −5.60 and −9.33, respectively). The participants also increased their achievement scores on the Tower test at the follow-up assessment relative to baseline (M = 19.38 at baseline, Mdif = 2.12 at follow-up) and improved their performance on the fourth condition of the TMT (M = 72.03 at baseline, Mdif = −11.37 at follow-up), thus showing further improvements in inhibition in addition to attentional control and cognitive flexibility. No significant changes were detected on the other performance-based measures of executive function. However, on the Hotel task, an improvement in general problem solving was shown in a reduction in deviation from the ideal time from pre- to follow-up assessment (M = 352.71 at baseline, Mdif = −117.59 at follow-up).

The exploratory analyses investigating the potential effects of age and medication status did not show any significant effects of these covariates (all ps ≥ 0.09 without correction for multiple comparisons).

Secondary Outcome Measures of Self-Reported Symptoms, Quality of Life, and Everyday Functioning

As secondary effects, the participants reported a significant reduction of cognitive functioning difficulties in their everyday lives, as measured by the CFQ (M = 61.41 at baseline, Mdif = −6.75 and −7.61 at post and follow-up, respectively). The participants further reported a significant reduction of ADHD symptoms on the ASRS at both time points. They also reported increased quality of life following GMT as measured by the Life productivity subscale of the AAQoL (M = 42.32 at baseline, Mdif = 11.89 and 12.52 at post and follow-up, respectively). This subscale assesses functioning in school/work and everyday task accomplishment. The remaining subscales of the AAQoL showed no significant changes, but there was a significant change to the total score (M = 49.36 at baseline, Mdif = 6.95 and 8.24 at post and follow-up, respectively). Please see Table 4 for further information.

TABLE 4
www.frontiersin.org

Table 4. Simplified outputs from linear mixed-effects regressions of self-report measures examining change in ADHD-symptoms, everyday cognitive functioning and quality of life from baseline to post intervention and 6-month follow-up assessments.

In addition to these self-reported changes, the participants also reported significant improvements on measures of everyday executive functioning and aspects of emotion regulation (see Supplementary Table 1).

Discussion

The main aim of the current study was to conduct an exploratory pilot testing of a neuropsychological model for examining the effects of GMT on inhibition, specifically, in a sample of adults with ADHD. The effects of GMT were studied immediately after completing the treatment and at a 6-month follow-up assessment. Due to the emphasis in GMT on strategies supporting the executive function of inhibition (Levine et al., 2000, 2011), we expected that measures of this, and not other aspects of executive functioning such as working memory, flexible control of processing speed or general problem solving, would show significant improvement. Indeed, we found support for this hypothesis in that the adults with ADHD demonstrated improved inhibitory control on selected neuropsychological measures of inhibition after completing GMT both at the post- and 6-month follow-up assessments, but not on tests of working memory. Interestingly, at follow-up after 6 months, the results also showed improved problem-solving skills on the Hotel task and improvements on a measure of flexible control of processing speed. In addition to the improvements in inhibitory control following GMT, we found secondary positive effects after GMT in that the adults with ADHD reported improvements in everyday functioning. This was shown through self-reported improvements in ADHD-symptoms, everyday cognitive functioning and quality of life. Participants also reported improvements in aspects of executive functioning and emotion regulation, as can be seen in the Supplementary Materials.

In GMT, participants work specifically on improving strategies supporting goal-directed behavior by practicing intermittent stopping of ongoing behavior to monitor whether this behavior is in line with current goals (Levine et al., 2011; see also Cooper, 2010). Thus, GMT emphasizes inhibitory control training (i.e., “STOP!-and-think”). The results in the current study supported our hypothesis that this specific function would improve following GMT compared to other neuropsychological measures of executive functions. Improvements in inhibition were evident both immediately following the intervention and 6 months later on the CWIT measure of interference control, a subtest requiring voluntary control over which stimuli are attended. Furthermore, after 6 months, improvements were also observed on the Tower test. This is a problem-solving test specifically requiring inhibitory control to be able to follow the rules and complete the tower as instructed (see Miyake et al., 2000; Young et al., 2007). The importance of strengthening inhibition is reflected in both theories of ADHD, suggesting that impaired inhibition is a predominant cause of the negative impact on everyday functioning associated with the disorder (e.g., Barkley, 1997), as well as in findings showing its importance for general functioning. Inhibition is central for the ability to pursue goal-directed behavior (Cooper, 2010), which is required in academic work and in occupational work settings (e.g., Halleland et al., 2015). It is also shown to be important for emotion regulation (see Shaw et al., 2014). Furthermore, there is research pointing to inhibitory control as an important aspect of psychological resilience (see Kalisch et al., 2015), which reduces the risk of developing adverse, psychological reactions despite exposure to stressful and potentially traumatic events.

Due to the importance of inhibitory control in regulating behavior, we expected that GMT would lead to improvements in the ability to handle the challenges of everyday life. Therefore, we expected positive secondary effects of GMT on self-reported everyday functioning. The results of the current study are in accordance with this expectation as the adults with ADHD reported improvements on self-reports of cognitive and executive functioning. In particular, participants reported improvements on aspects of such functioning related to increased productivity and aspects of controlled emotion regulation. Further, positive effects of GMT were reported as a perceived reduction in the severity of ADHD symptoms after 6 months, and increased productivity with regards to school/work and everyday task achievement (AAQoL). Reports on the DERS questionnaire 6 months after completing GMT also showed that the participants experienced an enhanced ability to regulate emotional responses and were better able to use active strategies for helping them when they experienced negative emotions.

In line with our expectations, the adults with ADHD did not show changes in working memory after completing GMT. Interestingly, however, we found that after 6 months the adults with ADHD improved their general problem-solving skills as well as their flexible control of processing speed. Although we did not expect this, we believe that this change supports the interpretation of GMT leading to functional improvements. This is in contrast to the prior pilot study of an adapted version of GMT in adults with ADHD in which no change following the intervention was found on an everyday problem-solving task (In de Braek et al., 2017). The Hotel task is meant to be an analog of executive functioning in complex everyday situations (Shallice and Burgess, 1991; Manly et al., 2002), and requires that the participant devices a plan for performing the task whilst simultaneously monitoring his or her behavior and the time remaining. There are findings suggesting that the improvements on the Hotel task after completing GMT in the current study may be seen, at least in part, as a result of internalization of the exercises focusing on intermittent stopping (e.g., “STOP!-and-think”) by the participants. The periodic suspension of ongoing behavior to evaluate one’s overarching goal seems to increase goal achievement (Manly et al., 2002). In other patient samples, GMT has also been shown to improve performance on the Hotel task and similar analogs of real-life task performance (e.g., Levine et al., 2000, 2007; Miotto et al., 2009; Novakovic-Agopian et al., 2011; Stubberud et al., 2013; Tornås et al., 2016). Furthermore, in line with the findings from the current study, the majority of these studies have also shown improvements in self- or informant-reported evaluations of everyday functioning, which would be expected if participants had indeed internalized an efficient problem-solving strategy. Interestingly, in a study that showed no effect of GMT on an everyday problem-solving task, the participants did not report changes following GMT on measures of everyday cognitive functioning (Levine et al., 2011).

As the current study was a self-control case design, we cannot rule out that practice effects may have contributed to improved scores from pre- to post- and follow-up assessments. Important to note in this regard, is the fact that we hypothesized that inhibitory control would be improved, and found that neuropsychological test measures of this function, and not of working memory, improved after completing GMT. We believe that this supports the assumption that our primary results of enhanced inhibitory control are not due to pure practice effects. This interpretation is supported by results from available studies of practice effects. For instance, Calamia et al. (2012) found similar retest effect sizes for measures of working memory, processing speed and more general executive functions in their meta-analysis. Several meta-analyses have also shown that practice effects are most pronounced between the first and second administration of a test, with smaller increases for subsequent administrations (Scharfen et al., 2018a,b). This is important since we found strong effects 6 months after, and not just immediately after, completing GMT. The meta-analysis of Calamia et al. (2012) also showed that practice effects were substantially less pronounced for clinical samples compared to healthy samples.

Although the findings in the current study need to be interpreted with caution, the results strongly support the notion that the participants with ADHD adopted the learned strategies and applied them in their everyday life 6 months after completing GMT. Furthermore, in line with the primary aim of the study, our findings support the use of neuropsychological outcome variables as effect measures of GMT in ADHD samples. Specifically, GMT in ADHD seems to address inhibitory control in particular more than executive functioning in general. Interestingly, newer revisions of the understanding of executive functions lean toward inhibitory control being the unitary component of executive functioning (Cooper, 2010; Miyake and Friedman, 2012). This may imply that the neuropsychological model for assessing effect of GMT in the current study can be applicable also for studies testing the effect of GMT in other clinical samples than ADHD. A critical point of treatment studies in ADHD is the question of whether the effects are generalized to the patients’ everyday life. Cognitive remediation approaches have often been criticized for failing on this point in ADHD samples, examples include working memory training and neurofeedback (see Melby-Lervåg and Hulme, 2013; Cortese et al., 2016). In the current study, we found that the adults with ADHD also experienced improvement in their everyday life, lasting at least 6 months after completion of GMT. Future studies are, however, needed to test if these findings are replicated with a case-control design. Applying a case-control design would allow for control for spontaneous changes in how patients experience their life or changes associated with non-specific effects (e.g., professional attention, group dynamics; McCambridge et al., 2012). Since the current study aimed to explore test-effects of GMT by assessing the patients with ADHD with a neuropsychological test battery at three time points, resources for testing were prioritized above recruiting a bigger sample of patients. Due to potential participants being excluded, withdrawing due to scheduling conflicts and drop-out, the final number of participants included was not in line with the original plans for the project and the power analysis conducted during this planning. As such, lower power in the statistical analyses may have contributed to negative results on effect measures that with a larger sample would appear as a positive effect of GMT. Future studies may therefore identify effects on measures which did not reach significance in the current study. Of note, we did control for multiple testing in our statistical analyses, and the effects of GMT on inhibitory control measures were still strong enough to reach significance. Also, of relevance, the baseline data showed that the drop-out group was younger than the patients completing the GMT and the post-assessments, and also a tendency for the drop-out group to report higher symptom severity. In treatment studies of ADHD, there is often a problem with patients dropping out, which can result in a biased sample of patients completing the treatment. This can be handled with intention-to-treat analyses, however, this was not possible in the current study due to the self-control case design.

The current study indicates significant effects of GMT on inhibition among adults with ADHD. Furthermore, the current results provide support for the notion that GMT may also affect broad and important domains of functioning such as everyday cognition and productivity as well as emotion regulation. These results encourage further studies that include control conditions to examine GMT as an intervention for adults with ADHD, as replication would indicate that GMT represents an efficient and cost-effective treatment alternative.

Data Availability Statement

The datasets presented in this article are not readily available because the ethical approval states that anonymized data can only be made available for registered collaborators. Requests to access the datasets should be directed to DJ, Daniel.A.Jensen@uib.no.

Ethics Statement

The studies involving human participants were reviewed and approved by Regional Committee for Medical and Health Research Ethics, West Norway. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

LS was the project leader. DJ, LS, AL, AH, JS, and JH involved in conception and design, and approved the final version for publication. DJ collected the data. DJ and LS involved in analyses, interpretation, and writing of the manuscript. AH, AL, JS, and JH critically reviewed the manuscript.

Funding

This study received funding from the Stiftelsen Kristian Gerhard Jebsen (grant: SKGJ-MED-02) and the Norwegian National Research Network for ADHD (grant: 810986). Funds from the K. G. Jebsen Centre for Neuropsychiatric Disorders covered the salary of DJ during a period while preparing the study. Funds from the Norwegian National Research Network for ADHD covered compensation of participants as well as materials used for the assessments. The University of Bergen funded the open access publication fees.

Conflict of Interest

JH has received speaker honoraria from Lilly, Shire, HB Pharma, Medice, Takeda, and Biocodex.

The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Acknowledgments

We would like to thank the participants of this study for volunteering their time and effort. We would also like to thank all funding agencies and Emilie S. Nordby, Bente Ubostad, Paul M. Kauserud, Marius Stavang, Anne Øfsthus, Benedicte Mjeldheim, and Liv Heldal for their various contributions to the project.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2021.659480/full#supplementary-material

References

Alfonso, J. P., Caracuel, A., Delgado-Pastor, L. C., and Verdejo-Garcia, A. (2011). Combined goal management training and mindfulness meditation improve executive functions and decision-making performance in abstinent polysubstance abusers. Drug Alcohol Depend. 117, 78–81. doi: 10.1016/j.drugalcdep.2010.12.025

PubMed Abstract | CrossRef Full Text | Google Scholar

American Psychiatric Association (2013). Diagnostic and statistical manual of mental disorders, 5th Edn. Washington, D.C: American Psychiatric Association.

Google Scholar

Badre, D. (2011). Defining an ontology of cognitive control requires attention to component interactions. Topics Cogn. Sci. 3, 217–221. doi: 10.1111/j.1756-8765.2011.01141.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Barkley, R. A. (1997). Behavioral inhibition, sustained attention, and executive functions: Constructing a unifying theory of ADHD. Psychol. Bull. 121, 65–94. doi: 10.1037/0033-2909.121.1.65

PubMed Abstract | CrossRef Full Text | Google Scholar

Barry, T. D., Lyman, R. D., and Klinger, L. G. (2002). Academic underachievement and attention-deficit/hyperactivity disorder: the negative impact of symptom severity on school performance. J. School Psychol. 40, 259–283. doi: 10.1016/S0022-4405(02)00100-0

CrossRef Full Text | Google Scholar

Bates, D., Mächler, M., Bolker, B., and Walker, S. (2015). Fitting linear mixed-effects models using lme4. J. Statist. Softw. 1:2015.

Google Scholar

Benjamini, Y., and Hochberg, Y. (1995). Controlling the false discovery rate: a practical and powerful approach to multiple testing. J. R. Stat. Soc. 57, 289–300. doi: 10.1111/j.2517-6161.1995.tb02031.x

CrossRef Full Text | Google Scholar

Biederman, J., Faraone, S. V., Spencer, T. J., Mick, E., Monuteaux, M. C., and Aleardi, M. (2006). Functional impairments in adults with self-reports of diagnosed ADHD: A controlled study of 1001 adults in the community. J. Clin. Psychiatry 67, 524–540. doi: 10.4088/jcp.v67n0403

PubMed Abstract | CrossRef Full Text | Google Scholar

Broadbent, D. E., Cooper, P. F., FitzGerald, P., and Parkes, K. R. (1982). The Cognitive Failures Questionnaire (CFQ) and its correlates. Br. J. Clin. Psychol. 21, 1–16. doi: 10.1111/j.2044-8260.1982.tb01421.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Brod, M., Perwien, A., Adler, L., Spencer, T., and Johnston, J. (2005). Conceptualization and assessment of quality of life for adults with attention-deficit/hyperactivity disorder. Prim. Psychiatry 12, 58–64.

Google Scholar

Calamia, M., Markon, K., and Tranel, D. (2012). Scoring higher the second time around: meta-analyses of practice effects in neuropsychological assessment. Clin. Neuropsychol. 26, 543–570. doi: 10.1080/13854046.2012.680913

PubMed Abstract | CrossRef Full Text | Google Scholar

Capri, T., Santoddi, E., and Fabio, R. A. (2020). Multi-Source Interference Task paradigm to enhance automatic and controlled processes in ADHD. Res. Dev. Disab. 97:103542. doi: 10.1016/j.ridd.2019.103542

PubMed Abstract | CrossRef Full Text | Google Scholar

Cooper, R. P. (2010). Cognitive Control: Componential or Emergent? Topics Cogn. Sci. 2, 598–613. doi: 10.1111/j.1756-8765.2010.01110.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Cortese, S., Adamo, N., Del Giovane, C., Mohr-Jensen, C., Hayes, A. J., Carucci, S., et al. (2018). Comparative efficacy and tolerability of medications for attention-deficit hyperactivity disorder in children, adolescents, and adults: a systematic review and network meta-analysis. Lancet Psychiatry 5, 727–738. doi: 10.1016/s2215-0366(18)30269-4

CrossRef Full Text | Google Scholar

Cortese, S., Ferrin, M., Brandeis, D., Holtmann, M., Aggensteiner, P., Daley, D., et al. (2016). Neurofeedback for Attention-Deficit/Hyperactivity disorder: meta-analysis of clinical and neuropsychological outcomes from randomized controlled trials. J. Am. Acad. Child Adolescent Psychiatry 55, 444–455. doi: 10.1016/j.jaac.2016.03.007

PubMed Abstract | CrossRef Full Text | Google Scholar

Dalsgaard, S., Østergaard, S. D., Leckman, J. F., Mortensen, P. B., and Pedersen, M. G. (2015). Mortality in children, adolescents, and adults with attention deficit hyperactivity disorder: a nationwide cohort study. Lancet 385, 2190–2196. doi: 10.1016/s0140-6736(14)61684-6

PubMed Abstract | CrossRef Full Text | Google Scholar

De Crescenzo, F., Cortese, S., Adamo, N., and Janiri, L. (2017). Pharmacological and non-pharmacological treatment of adults with ADHD: a meta-review. Evid. Based Mental Health 20, 4–11. doi: 10.1136/eb-2016-102415

PubMed Abstract | CrossRef Full Text | Google Scholar

Delis, D. C., Kaplan, E., and Kramer, J. H. (2001). Delis-Kaplan Executive Functioning System (D-KEFS). San Antonio: The Psychological Corporation.

Google Scholar

Dentz, A., Guay, M.-C., Parent, V., and Romo, L. (2020). Working Memory Training for Adults With ADHD. J. Attent. Dis. 24, 918–927. doi: 10.1177/1087054717723987

PubMed Abstract | CrossRef Full Text | Google Scholar

Doyle, A. E. (2006). Executive functions in attention-deficit/hyperactivity disorder. J. Clin. Psychiatry 67, (Suppl. 8), 21–26.

Google Scholar

Duncan, J. (1986). Disorganisation of behaviour after frontal lobe damage. Cogn. Neuropsychol. 3, 271–290. doi: 10.1080/02643298608253360

CrossRef Full Text | Google Scholar

Elliott, J., Johnston, A., Husereau, D., Kelly, S. E., Eagles, C., Charach, A., et al. (2020). Pharmacologic treatment of attention deficit hyperactivity disorder in adults: A systematic review and network meta-analysis. PLoS One 15:e0240584. doi: 10.1371/journal.pone.0240584

PubMed Abstract | CrossRef Full Text | Google Scholar

Fabio, R., and Caprì, T. (2017). The executive functions in a sample of Italian adults with ADHD: attention, response inhibition and planning/organization. Mediter. J. Clin. Psychol. 2017:5.

Google Scholar

Faraone, S. V., Asherson, P., Banaschewski, T., Biederman, J., Buitelaar, J. K., Ramos-Quiroga, J. A., et al. (2015). Attention-deficit/hyperactivity disorder. Nat. Rev. Dis. Prim. 1:15020. doi: 10.1038/nrdp.2015.20

PubMed Abstract | CrossRef Full Text | Google Scholar

Faul, F., Erdfelder, E., Lang, A.-G., and Buchner, A. (2007). GPower 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav. Res. Methods 39, 175–191. doi: 10.3758/bf03193146

PubMed Abstract | CrossRef Full Text | Google Scholar

Franke, B., Michelini, G., Asherson, P., Banaschewski, T., Bilbow, A., Buitelaar, J. K., et al. (2018). Live fast, die young? A review on the developmental trajectories of ADHD across the lifespan. Eur. Neuropsychopharm. 28, 1059–1088. doi: 10.1016/j.euroneuro.2018.08.001

PubMed Abstract | CrossRef Full Text | Google Scholar

Gioia, G. A., Isquith, P. K., Guy, S. C., and Kenworthy, L. (2000). Behavior rating inventory of executive function: Professional manual. Lutz, FL: Psychological Assessment Resources, Inc.

Google Scholar

Glickman, M. E., Rao, S. R., and Schultz, M. R. (2014). False discovery rate control is a recommended alternative to Bonferroni-type adjustments in health studies. J. Clin. Epidemiol. 67, 850–857. doi: 10.1016/j.jclinepi.2014.03.012

PubMed Abstract | CrossRef Full Text | Google Scholar

Gratz, K. L., and Roemer, L. (2004). Multidimensional assessment of emotion regulation and dysregulation: development, factor structure, and initial validation of the difficulties in emotion regulation scale. J. Psychopathol. Behav. Assess. 26, 41–54. doi: 10.1023/B:JOBA.0000007455.08539.94

CrossRef Full Text | Google Scholar

Hagen, B. I., Lau, B., Joormann, J., Småstuen, M. C., Landrø, N. I., and Stubberud, J. (2020). Goal management training as a cognitive remediation intervention in depression: A randomized controlled trial. J. Affect. Dis. 275, 268–277. doi: 10.1016/j.jad.2020.07.015

PubMed Abstract | CrossRef Full Text | Google Scholar

Halleland, H. B., Haavik, J., and Lundervold, A. J. (2012). Set-Shifting in Adults with ADHD. J. Internat. Neuropsychol. Soc. 18, 728–737. doi: 10.1017/S1355617712000355

PubMed Abstract | CrossRef Full Text | Google Scholar

Halleland, H. B., Sørensen, L., Posserud, M.-B., Haavik, J., and Lundervold, A. J. (2015). Occupational status is compromised in adults with ADHD and psychometrically defined executive function deficits. J. Attent. Dis. 2015, 1–12. doi: 10.1177/1087054714564622

PubMed Abstract | CrossRef Full Text | Google Scholar

Halmøy, A., Fasmer, O. B., Gillberg, C., and Haavik, J. (2009). Occupational outcome in adult ADHD: impact of symptom profile, comorbid psychiatric problems, and treatment: a cross-sectional study of 414 clinically diagnosed adult ADHD patients. J. Attent. Dis. 13, 175–187. doi: 10.1177/1087054708329777

PubMed Abstract | CrossRef Full Text | Google Scholar

Ibm Corporation. (2017). IBM SPSS Statistics for Windows, Version 25.0. IBM Corporation.

Google Scholar

In de Braek, D., Dijkstra, J. B., Ponds, R. W., and Jolles, J. (2017). Goal management training in adults with adhd: an intervention study. J. Attent. Dis. 21, 1130–1137. doi: 10.1177/1087054712468052

PubMed Abstract | CrossRef Full Text | Google Scholar

Kabat-Zinn, J. (1990). Full Catastrophe Living. New York, NY: Dell Publishing.

Google Scholar

Kalisch, R., Müller, M. B., and Tüscher, O. (2015). A conceptual framework for the neurobiological study of resilience. Behav. Brain Sci. 38:e92. doi: 10.1017/S0140525X1400082X

PubMed Abstract | CrossRef Full Text | Google Scholar

Kessler, R. C., Adler, L., Ames, M., Demler, O., Faraone, S. V., Hiripi, E., et al. (2005). The world health organization adult adhd self-report scale (asrs): a short screening scale for use in the general population. Psycholog. Med. 35, 245–256. doi: 10.1017/S0033291704002892

PubMed Abstract | CrossRef Full Text | Google Scholar

Kessler, R. C., Adler, L., Barkley, R. A., Biederman, J., Conners, C. K., Demler, O., et al. (2006). The prevalence and correlates of adult ADHD in the United States: results from the national comorbidity survey replication. Am. J. Psychiatry 163, 716–723. doi: 10.1176/appi.ajp.163.4.716

CrossRef Full Text | Google Scholar

Klein, R. G., Mannuzza, S., Olazagasti, M. A. R., Roizen, E., Hutchison, J. A., Lashua, E. C., et al. (2012). Clinical and functional outcome of childhood attention-deficit/hyperactivity disorder 33 years later. Archiv. Gen. Psychiatry 69, 1295–1303. doi: 10.1001/archgenpsychiatry.2012.271

PubMed Abstract | CrossRef Full Text | Google Scholar

Kooij, S. J. J., Bejerot, S., Blackwell, A., Caci, H., Casas-Brugué, M., Carpentier, P. J., et al. (2010). European consensus statement on diagnosis and treatment of adult ADHD: the european network adult ADHD. BMC Psychiatry 10:67. doi: 10.1186/1471-244X-10-67

PubMed Abstract | CrossRef Full Text | Google Scholar

Kovshoff, H., Banaschewski, T., Buitelaar, J. K., Carucci, S., Coghill, D., Danckaerts, M., et al. (2016). Reports of perceived adverse events of stimulant medication on cognition, motivation, and mood: qualitative investigation and the generation of items for the medication and cognition rating scale. J. Child Adolescent Psychopharm. 26, 537–547. doi: 10.1089/cap.2015.0218

PubMed Abstract | CrossRef Full Text | Google Scholar

Krabbendam, L., de Vugt, M. E., Derix, M. M. A., and Jolles, J. (1999). The Behavioural Assessment of the Dysexecutive Syndrome as a tool to assess executive functions in schizophrenia. Clin. Neuropsycholog. 13, 370–375. doi: 10.1076/clin.13.3.370.1739

PubMed Abstract | CrossRef Full Text | Google Scholar

Lam, A. P., Matthies, S., Graf, E., Colla, M., Jacob, C., Sobanski, E., et al. (2019). Long-term effects of multimodal treatment on adult attention-deficit/hyperactivity disorder symptoms: follow-up analysis of the COMPAS Trial. JAMA Netw. Open 2, e194980–e194980. doi: 10.1001/jamanetworkopen.2019.4980

PubMed Abstract | CrossRef Full Text | Google Scholar

Levine, B., Robertson, I. H., Clare, L., Carter, G., Hong, J., Wilson, B. A., et al. (2000). Rehabilitation of executive functioning: An experimental–clinical validation of Goal Management Training. J. Int. Neuropsycholog. Soc. 6, 299–312. doi: 10.1017/s1355617700633052

PubMed Abstract | CrossRef Full Text | Google Scholar

Levine, B., Schweizer, T. A., O’Connor, C., Tumer, G., Gillingham, S., Stuss, D. T., et al. (2011). Rehabilitation of executive functioning in patients with frontal lobe brain damage with goal management training. Front. Human Neurosci. 5, 1–9. doi: 10.3389/fnhum.2011.00009

PubMed Abstract | CrossRef Full Text | Google Scholar

Levine, B., Stuss, D. T., Winocur, G., Binns, M. A., Fahy, L., Mandic, M., et al. (2007). Cognitive rehabilitation in the elderly: effects on strategic behavior in relation to goal management. J. Int. Neuropsycholog. Soc. 13, 143–152. doi: 10.1017/S1355617707070178

PubMed Abstract | CrossRef Full Text | Google Scholar

Leys, C., Ley, C., Klein, O., Bernard, P., and Licata, L. (2013). Detecting outliers: Do not use standard deviation around the mean, use absolute deviation around the median. J. Exp. Soc. Psychol. 49, 764–766. doi: 10.1016/j.jesp.2013.03.013

CrossRef Full Text | Google Scholar

Little, R. J. A. (1988). A test of missing completely at random for multivariate data with missing values. J. Am. Stat. Assoc. 83, 1198–1202. doi: 10.1080/01621459.1988.10478722

CrossRef Full Text | Google Scholar

Lopez, P. L., Torrente, F. M., Ciapponi, A., Lischinsky, A. G., Cetkovich-Bakmas, M., Rojas, J. I., et al. (2018). Cognitive-behavioural interventions for attention deficit hyperactivity disorder (ADHD) in adults. Cochr. Database Syst. Rev. 3:Cd010840. doi: 10.1002/14651858.CD010840.pub2

PubMed Abstract | CrossRef Full Text | Google Scholar

López-Pinar, C., Martínez-Sanchís, S., Carbonell-Vayá, E., Fenollar-Cortés, J., and Sánchez-Meca, J. (2018). Long-Term efficacy of psychosocial treatments for adults with attention-deficit/hyperactivity disorder: a meta-analytic review. Front. Psychol. 9:638. doi: 10.3389/fpsyg.2018.00638

PubMed Abstract | CrossRef Full Text | Google Scholar

Manly, T., Hawkins, K., Evans, J., Woldt, K., and Robertson, I. H. (2002). Rehabilitation of executive function: Facilitation of effective goal management on complex tasks using periodic auditory alerts. Neuropsychologia 40, 271–281. doi: 10.1016/S0028-3932(01)00094-X

CrossRef Full Text | Google Scholar

Marcelle, E. T., Ho, E. J., Kaplan, M. S., Adler, L. A., Castellanos, F. X., and Milham, M. P. (2018). Cogmed working memory training presents unique implementation challenges in adults with ADHD. Front. Psychiatry 9:388. doi: 10.3389/fpsyt.2018.00388

PubMed Abstract | CrossRef Full Text | Google Scholar

McCambridge, J., de Bruin, M., and Witton, J. (2012). The effects of demand characteristics on research participant behaviours in non-laboratory settings: a systematic review. PLoS One 7:e39116. doi: 10.1371/journal.pone.0039116

PubMed Abstract | CrossRef Full Text | Google Scholar

Melby-Lervåg, M., and Hulme, C. (2013). Is working memory training effective? A meta-analytic review. Dev. Psychol. 49, 270–291. doi: 10.1037/a0028228

PubMed Abstract | CrossRef Full Text | Google Scholar

Miotto, E. C., Evans, J. J., Souza de Lucia, M. C., and Scaff, M. (2009). Rehabilitation of executive dysfunction: a controlled trial of an attention and problem solving treatment group. Neuropsychol. Rehabilit. 19, 517–540. doi: 10.1080/09602010802332108

PubMed Abstract | CrossRef Full Text | Google Scholar

Miyake, A., and Friedman, N. P. (2012). The nature and organization of individual differences in executive functions: Four general conclusions. Curr. Direct. Psychol. Sci. 21, 8–14. doi: 10.1177/0963721411429458

PubMed Abstract | CrossRef Full Text | Google Scholar

Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., and Wager, T. D. (2000). The Unity and diversity of executive functions and their contributions to complex “frontal lobe” tasks: a latent variable analysis. Cognitive Psychol 41, 49–100. doi: 10.1006/cogp.1999.0734

PubMed Abstract | CrossRef Full Text | Google Scholar

Mohammadhasani, N., Caprì, T., Nucita, A., Iannizzotto, G., and Fabio, R. A. (2020). Atypical visual scan path affects remembering in ADHD. J. Int. Neuropsychol. Soc. 26, 557–566. doi: 10.1017/S135561771900136X

PubMed Abstract | CrossRef Full Text | Google Scholar

Mohr-Jensen, C., Lange, A. M., Thomsen, P. H., and Daley, D. (2020). Treatment of ADHD in adults - prevalence of discontinuation and associated factors - results from a cross-sectional analysis of Danish register data. Nordic J. Psychiatry 74, 479–488. doi: 10.1080/08039488.2020.1740781

PubMed Abstract | CrossRef Full Text | Google Scholar

NICE (2018). Attention deficit hyperactivity disorder: diagnosis and management. London: National Institute for Health and Care Excellence.

Google Scholar

Nimmo-Smith, V., Merwood, A., Hank, D., Brandling, J., Greenwood, R., Skinner, L., et al. (2020). Non-pharmacological interventions for adult ADHD: a systematic review. Psychol. Med. 50, 529–541. doi: 10.1017/s0033291720000069

PubMed Abstract | CrossRef Full Text | Google Scholar

Novakovic-Agopian, T., Chen, A. J.-W., Rome, S., Abrams, G., Castelli, H., Rossi, A., et al. (2011). Rehabilitation of executive functioning with training in attention regulation applied to individually defined goals: a pilot study bridging theory, assessment, and treatment. J. Head Trauma Rehabilit. 26, 325–338. doi: 10.1097/HTR.0b013e3181f1ead2

PubMed Abstract | CrossRef Full Text | Google Scholar

Polanczyk, G. V., Willcutt, E. G., Salum, G. A., Kieling, C., and Rohde, L. A. (2014). ADHD prevalence estimates across three decades: an updated systematic review and meta-regression analysis. Int. J. Epidemiol. 43, 434–442. doi: 10.1093/ije/dyt261

PubMed Abstract | CrossRef Full Text | Google Scholar

R Development Core Team (2020). R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing.

Google Scholar

Raggi, V. L., and Chronis, A. M. (2006). Interventions to address the academic impairment of children and adolescents with ADHD. Clin. Child Family Psychol. Rev. 9, 85–111. doi: 10.1007/s10567-006-0006-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Robertson, I. H. (1996). Goal management training: A clinical manual. Cambridge, MA: PsyConsult.

Google Scholar

Roca, M., Parr, A., Thompson, R., Woolgar, A., Torralva, T., Antoun, N., et al. (2009). Executive function and fluid intelligence after frontal lobe lesions. Brain 133, 234–247. doi: 10.1093/brain/awp269

PubMed Abstract | CrossRef Full Text | Google Scholar

Sarkis, E. (2014). Addressing attention-deficit/hyperactivity disorder in the workplace. Postgrad. Med. 126, 25–30. doi: 10.3810/pgm.2014.09.2797

PubMed Abstract | CrossRef Full Text | Google Scholar

Scharfen, J., Jansen, K., and Holling, H. (2018a). Retest effects in working memory capacity tests: A meta-analysis. Psychonomic Bull. Rev. 25, 2175–2199. doi: 10.3758/s13423-018-1461-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Scharfen, J., Peters, J. M., and Holling, H. (2018b). Retest effects in cognitive ability tests: A meta-analysis. Intelligence 67, 44–66. doi: 10.1016/j.intell.2018.01.003

CrossRef Full Text | Google Scholar

Schneider, L. S., Olin, J. T., Doody, R. S., Clark, C. M., Morris, J. C., Reisberg, B., et al. (1997). Validity and reliability of the alzheimer’s disease cooperative study-clinical global impression of change (ADCS-CGIC). Alzheimer Dis. 1997, 425–429. doi: 10.1007/978-1-4612-4116-4_64

CrossRef Full Text | Google Scholar

Shallice, T., and Burgess, P. W. (1991). Deficits in strategy application following frontal lobe damage in man. Brain 114, 727–741. doi: 10.1093/brain/114.2.727

PubMed Abstract | CrossRef Full Text | Google Scholar

Shaw, P., Stringaris, A., Nigg, J., and Leibenluft, E. (2014). Emotion dysregulation in attention deficit hyperactivity disorder. Am. J. Psychiatry 171, 276–293. doi: 10.1176/appi.ajp.2013.13070966

PubMed Abstract | CrossRef Full Text | Google Scholar

Sheehan, D. V., Lecrubier, Y., Sheehan, K. H., Amorim, P., Janavs, J., Weiller, E., et al. (1998). The Mini-International Neuropsychiatric Interview (MINI): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J. Clin. Psychiatry 59, 22–33.

Google Scholar

Simon, V., Czobor, P., Sára, B., Mészáros, Á, and Bitter, I. (2009). Prevalence and correlates of adult attention-deficithyperactivity disorder: meta-analysis. Br. J. Psychiatry 194, 204–211. doi: 10.1192/bjp.bp.107.048827

PubMed Abstract | CrossRef Full Text | Google Scholar

Solberg, B. S., Haavik, J., and Halmøy, A. (2015). Health care services for adults with ADHD: Patient satisfaction and the role of psycho-education. J. Attent. Dis. 2015, 1–10. doi: 10.1177/1087054715587941

PubMed Abstract | CrossRef Full Text | Google Scholar

Sonuga-Barke, E. J. S., Bitsakou, P., and Thompson, M. (2010). Beyond the dual pathway model: evidence for the dissociation of timing, inhibitory, and delay-related impairments in attention-deficit/hyperactivity disorder. J. Am. Acad. Child Adolesc. Psychiatry 49, 345–355. doi: 10.1097/00004583-201004000-00009

CrossRef Full Text | Google Scholar

Stamenova, V., and Levine, B. (2019). Effectiveness of goal management training® in improving executive functions: A meta-analysis. Neuropsychol. Rehabilit. 29, 1569–1599. doi: 10.1080/09602011.2018.1438294

PubMed Abstract | CrossRef Full Text | Google Scholar

Stevenson, C. S., Whitmont, S., Bornholt, L., Livesey, D., and Stevenson, R. J. (2002). A cognitive remediation programme for adults with attention deficit hyperactivity disorder. Austral. New Zealand J. Psychiatry 36, 610–616. doi: 10.1046/j.1440-1614.2002.01052.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Storebø, O. J., Pedersen, N., Ramstad, E., Kielsholm, M. L., Nielsen, S. S., Krogh, H. B., et al. (2018). Methylphenidate for attention deficit hyperactivity disorder (ADHD) in children and adolescents – assessment of adverse events in non−randomised studies. Cochr. Database Syst. Rev. 5:12069. doi: 10.1002/14651858.CD012069.pub2

PubMed Abstract | CrossRef Full Text | Google Scholar

Stubberud, J., Langenbahn, D., Levine, B., Stanghelle, J., and Schanke, A.-K. (2013). Goal management training of executive functions in patients with spina bifida: A randomized controlled trial. J. Int. Neuropsychol. Soc. 19, 672–685. doi: 10.1017/S1355617713000209

PubMed Abstract | CrossRef Full Text | Google Scholar

Stubberud, J., Langenbahn, D., Levine, B., Stanghelle, J., and Schanke, A.-K. (2014). Goal Management Training improves everyday executive functioning for persons with spina bifida: Self-and informant reports six months post-training. Neuropsychol. Rehabilit. 24, 26–60. doi: 10.1080/09602011.2013.847847

PubMed Abstract | CrossRef Full Text | Google Scholar

Tornås, S., Løvstad, M., Solbakk, A. K., Evans, J., Endestad, T., Hol, P. K., et al. (2016). Rehabilitation of executive functions in patients with chronic acquired brain injury with goal management training, external cuing, and emotional regulation: a randomized controlled trial. J. Int. Neuropsychol. Soc. 22, 436–452. doi: 10.1017/s1355617715001344

PubMed Abstract | CrossRef Full Text | Google Scholar

Van Doren, J., Arns, M., Heinrich, H., Vollebregt, M. A., and Strehl, U. (2019). Sustained effects of neurofeedback in ADHD: a systematic review and meta-analysis. Eur. Child Adolescent Psychiatry 28, 293–305. doi: 10.1007/s00787-018-1121-4

PubMed Abstract | CrossRef Full Text | Google Scholar

van Hooren, S. A. H., Valentijn, S. A. M., Bosma, H., Ponds, R. W. H. M., van Boxtel, M. P. J., Levine, B., et al. (2007). Effect of a structured course involving goal management training in older adults: A randomised controlled trial. Patient Educ. Couns 65, 205–213. doi: 10.1016/j.pec.2006.07.010

PubMed Abstract | CrossRef Full Text | Google Scholar

Vidal, R., Bosch, R., Nogueira, M., Gómez-Barros, N., Valero, S., Palomar, G., et al. (2013). Psychoeducation for adults with attention deficit hyperactivity disorder vs. cognitive behavioral group therapy: a randomized controlled pilot study. J. Nervous Mental Dis. 201, 894–900. doi: 10.1097/NMD.0b013e3182a5c2c5

PubMed Abstract | CrossRef Full Text | Google Scholar

Ward, M. F., Wender, P. H., and Reimherr, F. W. (1993). The Wender Utah Rating Scale: an aid in the retrospective diagnosis of childhood attention deficit hyperactivity disorder. Am. J. Psychiatry 150, 885–890. doi: 10.1176/ajp.150.6.885

PubMed Abstract | CrossRef Full Text | Google Scholar

Wechsler, D. (1999). Wechsler Abbreviated Scale of Intelligence (WASI) manual. San Antonio: Psychological Corporation.

Google Scholar

Wechsler, D. (2008a). WAIS-IV: Wechsler adult intelligence scale. London: Pearson.

Google Scholar

Wechsler, D. (2008b). Wechsler Memory Scale - Third Edition: Manual. San Antonio: Harcourt Assesment.

Google Scholar

Wender, P. H. (1972). The minimal brain dysfunction syndrome in children. I. The syndrome and its relevance for psychiatry. II. A psychological and biochemical model for the syndrome. J. Nerv. Ment. Dis. 155, 55–71. doi: 10.1097/00005053-197207000-00007

PubMed Abstract | CrossRef Full Text | Google Scholar

Young, S., Morris, R., Toone, B., and Tyson, C. (2007). Planning ability in adults with attention-deficit/hyperactivity disorder. Neuropsychology 21, 581–589. doi: 10.1037/0894-4105.21.5.581

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: ADHD, goal management training, treatment, intervention, inhibition, non-pharmacological, executive functioning

Citation: Jensen DA, Halmøy A, Stubberud J, Haavik J, Lundervold AJ and Sørensen L (2021) An Exploratory Investigation of Goal Management Training in Adults With ADHD: Improvements in Inhibition and Everyday Functioning. Front. Psychol. 12:659480. doi: 10.3389/fpsyg.2021.659480

Received: 27 January 2021; Accepted: 19 August 2021;
Published: 09 September 2021.

Edited by:

Rosa Angela Fabio, University of Messina, Italy

Reviewed by:

Tindara Caprì, Institute for Biomedical Research and Innovation, National Research Council (CNR), Italy
Stefanie Duijndam, Tilburg University, Netherlands

Copyright © 2021 Jensen, Halmøy, Stubberud, Haavik, Lundervold and Sørensen. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Daniel André Jensen, Daniel.A.Jensen@uib.no

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.