- Department of Nutritional Science, Rutgers University, New Brunswick, NJ, United States
Background: Generalized anxiety disorder (GAD) is common in young adults, yet few studies have established the psychometric properties of the GAD-7 screener in college students.
Methods: A secondary analysis of three studies was conducted to determine GAD-7 factor structure stability, create a GAD-Mini version using standard procedures, and evaluate the psychometric properties, validity, sensitivity, specificity, and predictive values of both versions in young adults.
Results: Exploratory and confirmatory principal components analysis indicated the GAD-7 has a single factor structure with strong loadings, reliability, and stability across data collected in three studies. Data from all studies met criteria indicative of good to excellent model fit. Iterative confirmatory principal components analyses revealed the most parsimonious group of items that maintained scale unidimensionality, strong loadings, and high reliability was two items (not able to stop or control worrying and worried too much). Both the GAD-7 and GAD-Mini exhibited good construct and convergent validity. Specificity, sensitivity, and negative predictive value were high, and positive predictive value was moderate to high for the GAD-Mini.
Conclusions: The GAD-Mini is a psychometrically sound tool that can serve as a step toward universal screening in clinical practice and contribute to early treatment and improved health outcomes for GAD.
Introduction
Anxiety is a normal feeling of worry, fear, nervousness, or apprehension that is experienced when facing or anticipating a perceived or real threat (e.g., problem, challenge, and event with an unknown outcome; American Psychiatric Association, 2013). Anxiety disorders, on the other hand, are characterized by persistent, overwhelming worry and fear that interferes with normal functioning (American Psychiatric Association, 2013). The fifth edition of the Diagnostic and Statistical Manual of Mental Health Disorders (DSM-5) includes nine types of anxiety disorders (American Psychiatric Association, 2013). The types are highly comorbid and all are characterized by anxiety, fear, and related behavioral disturbances. The anxiety disorder types differ by the situations, objects, or activities that provoke the anxiety traits.
Generalized anxiety disorder (GAD) is the most common type of anxiety disorder, accounting for nearly 110 million disability days each year in the United States population (Merikangas et al., 2007). GAD is characterized by having excessive worries and fears about non-specific situations, objects, or events on most days for at least 6 months (American Psychiatric Association, 2013). The frequency, intensity, and duration of anxiety and worries are disproportionate to the likely outcome of the actual situation, object, or event. Those with GAD have trouble controlling feelings of worry to the extent that it causes distress or impairment in social, work, and other settings. Symptoms include restlessness or jitteriness, becoming fatigued easily, difficulty concentrating or remembering, irritability, muscle tension, and sleeping problems (Beesdo et al., 2009; American Psychiatric Association, 2013; Wang et al., 2018).
Onset of anxiety disorders is usually in adolescence or early adulthood (de Lijster et al., 2017). The prevalence of anxiety in young adults enrolled in college is higher than the general adult population (LeViness et al., 2017). In fact, results of a 2018 survey of 621 college counseling center directors indicated that anxiety was the main reason students visited campus mental health counseling centers (LeViness et al., 2017). The high prevalence among young adults in college may be a reflection of the transition from adolescence to adulthood characterized by moving into more independent living conditions, increased responsibility for personal decisions, life changes from postsecondary education to university or work life, and having non-family living partners (Arnett, 1997, 2001, 2015).
Anxiety disorders that develop early in life, including young adulthood, are linked with an elevated risk for onset of other mental illness later in life (Shear et al., 2007; Ströhle et al., 2018). Thus, early diagnosis and treatment of anxiety disorders may offer protection against serial comorbidity of other mental illnesses (Ströhle et al., 2018). Brief questionnaires can help healthcare providers rapidly screen patients for a wide array of health conditions, including anxiety disorders. These same questionnaires can serve as self-help tools that can be delivered to consumers conveniently, economically, and privately by the Internet (Donker et al., 2011; Lee and Kim, 2019). Access to health screening tools can provide individualized feedback that may encourage individuals with GAD symptoms to seek treatment from a professional.
Ideally, health screeners are brief, easy to administer and score, and address key diagnostic criteria. The Generalized Anxiety Disorder scale (GAD-7) is a widely used 7-item, 4-point Likert scale designed to screen for GAD according to DSM criteria (Spitzer et al., 2006). The time constraints of doctor office visits along with the desire for rapid completion and feedback to consumers contributed to the development of the 2-item GAD-2. The psychometric properties of the GAD-7 and GAD-2 are reported to be good to excellent in an array of studies examining these questionnaires (Plummer et al., 2016). For example, psychometric studies have included the general population in The Netherlands (Donker et al., 2011), Brazil (Silva et al., 2018), and Germany (Löwe et al., 2010; Wild et al., 2014; Hinz et al., 2017); teens in Finland (Tiirikainen et al., 2019); a rural population in China (Luo et al., 2019); patients receiving addictions treatment in the United Kingdom (Delgadillo et al., 2012); primary care patients in Spain (García-Campayo et al., 2012), United States (Kroenke et al., 2007), Finland (Kujanpaa et al., 2014), and Malaysia (Sidik et al., 2012); psychiatric patients in Australia (Staples et al., 2019), United States (Kertz et al., 2013), Spain (Cano-Vindel et al., 2018), and Turkey (Konkan et al., 2013); patients receiving epilepsy care in France (Micoulaud-Franchi et al., 2017); patients with migraine in Korea (Seo and Park, 2015); patients with cancer in Germany (Esser et al., 2018); patients with multiple sclerosis in the United States (Hughes et al., 2018); pregnant women in the United States (van Heyningen et al., 2018), United Kingdom (Nath et al., 2018), and Ghana and Cote d’Ivoire (Barthel et al., 2014); individuals receiving care in a traditional medicine department in China (Zeng et al., 2013); and those speaking an array of languages (Donker et al., 2011; García-Campayo et al., 2012; Sidik et al., 2012; Sousa et al., 2015; Ahmad et al., 2017; Ahn et al., 2019).
Despite the prevalence of anxiety in young adults and the critical importance of understanding how this measure performs in this population, the only psychometric studies of the GAD questionnaires that could be located for this age group were for university students in Korea (Lee and Kim, 2019) and Portugal (Bartolo et al., 2017). Both of these studies found a single factor model of the GAD-7 to be appropriate for use in college student samples. Although the GAD-2 has been used in several studies, no published data could be located using the standard procedures for shortening instruments; rather, two items were identified as “core” items and used to truncate the GAD-7 questionnaire to two items (Kroenke et al., 2007; Skapinakis, 2007). Further, no study could be located that examined the stability of the psychometric properties of the GAD-7 and shortened versions of this questionnaire at different points in time with a defined audience (i.e., individuals in the life stage of young adulthood who are enrolled in college). Hence, the goal of this study was to conduct a secondary analysis of three large cross-sectional studies conducted at time points ranging from 2009–2010 to 2018–2019 to determine the stability of the factor structure of the GAD-7 in the target audience over time, create a GAD-Mini version of this questionnaire using standard procedures, evaluate the psychometric properties of both versions, assess construct and convergent validity, and determine sensitivity, specificity, and predictive values for identifying GAD in free-living (non-institutionalized) young adults enrolled in a university in the United States.
Materials and Methods
These studies were approved by the Institutional Review Board at the authors’ university. Participants in all studies gave informed consent.
Sample
Individuals were recruited via verbal and electronic announcements to participate in an online survey of health practices of young adults. Data for this secondary analysis were collected in three separate, unrelated cross-sectional studies conducted in 2009–2010, 2015, and 2018–2019 (Quick, 2011; Byrd-Bredbenner et al., 2016; Eck, 2020, unpublished), labeled as Data Set A, B, and C, respectively. To be eligible, participants had to be enrolled at Rutgers, The State University of New Jersey, United States and be young adults (i.e., 18–26 years of age).
Study Measures
Participants in all three studies completed an online survey that gathered demographic data (e.g., age, gender, and race/ethnicity) and included the 2-item Patient Health Questionnaire (PHQ-2) and GAD-7 questionnaire. The PHQ-2 is a commonly used reliable, valid questionnaire that screens for Major Depressive Disorder (MDD) according to the criteria in the DSM-5 (Kroenke et al., 2003; Spitzer et al., 2006). The PHQ-2 assesses the frequency of depressive symptoms over the past 2 weeks. PHQ-2 items are scored on a 4-point Likert scale (0 = not at all to 3 = nearly every day); summed item scores create the total scale score with a possible score range of 0–6 with higher scores indicating greater depression severity. The 7-item GAD-7 questionnaire examines frequency of anxiety symptoms, such as worrying and feeling nervous and has the same answer choices as the PHQ-2 (Spitzer et al., 2006). The GAD-7 scale score is determined by summing individual item scores. Total scores can range from 0 to 21, with a score of ≥10 indicating the threshold for GAD per DSM-V criteria (Spitzer et al., 2006).
Data Analysis
Data were analyzed using SPSS and AMOS (a SPSS module) version 26.0 (SPSS Inc., Chicago, IL, United States). Kaiser-Meyer-Olkin (KMO) testing was conducted separately for each of the data sets to assess sampling adequacy, with values closer to 1 indicating greater adequacy of sampling (Glen, 2020). Each data set was independently subjected to Bartlett’s test of sphericity to confirm the GAD items were related and suitable for factor analysis; significance for this test was set at p < 0.01 (Glen, 2020; IBM Knowledge Center, 2020).
To identify the factor structure of the GAD items, exploratory principle components analysis with orthogonal (varimax) and oblique (oblimin) rotations were conducted separately with all three Data Sets (Harlow, 2014). All items were allowed to freely load to determine the number of factors present. Subsequently, all Data Sets were independently subjected to confirmatory principal component analysis to verify the factor structure (i.e., by specifying number of factors) identified from the exploratory principal components analysis (Osborne, 2014; Flora and Flake, 2017). The confirmatory principal components analysis results for all Data Sets were compared to determine whether the items loaded on the same factors in all three Data Sets. Then, the magnitude of difference in each item’s factor loading from the confirmatory principal components analysis was compared across Data Sets. Magnitude of difference was calculated by squaring the difference between the factor loading for corresponding items in Data Set A and Data Set B, Data Set A and Data Set C, and Data Set B and Data Set C. Magnitude differences of ≤0.05 were considered to be small and indicative of a stable factor structure (Osborne, 2014).
Using SPSS AMOS, goodness-of-fit indicators examined comparative fit index (CFI), goodness-of-fit index (GFI), Tucker-Lewis Index (TLI), root mean square error of approximation (RMSEA) and related 90% confidence interval (CI), and standardized root mean-square residual (SRMR; Hu and Bentler, 1999; Schermelleh-Engel et al., 2003; Harlow, 2014; Parry, Undated). The values for all of these indicators ranged from 0 to 1, with higher values indicating better fit for CFI, GFI, TFI, and RMSEA and values near 0 indicating better fit for SRMR (Schermelleh-Engel et al., 2003). Chi-square (χ2) and degrees of freedom (df) also were calculated but due to the large sample sizes could not be considered as absolute fit indicators (Schermelleh-Engel et al., 2003; Boateng et al., 2018).
After the factor structure was determined and verified, the next step was to reduce the length of the GAD-7 to items to create a shortened version of the questionnaire, the “GAD-Mini.” The item elimination strategy considered factor loadings that were cross (>0.40) and/or weak (<0.60; Harlow, 2014). In cases where the lowest loading item exceeded these a priori cross and/or weak loading thresholds, the lowest loading item was eliminated. Internal consistency (Cronbach alpha) was computed after each item elimination to ensure acceptable (>0.70) but not excessive (>0.85) reliability, an indicator of item redundancy (Streiner, 2003; Tavakol and Dennick, 2011). After each item elimination, the factors also were reviewed for logical sense to ensure content validity. The goal was to iteratively continue eliminating the lowest loading item, one at a time, until all remaining items retained strong loadings and yielded an acceptable Cronbach alpha coefficient.
Research indicates that anxiety is more common in women (Scheibe and Albus, 1992; Yonkers et al., 2003; Vesga-Lopez et al., 2008). Thus, construct validity was determined by comparing total scores on the GAD-7 and the GAD-Mini by sex using independent, 2-tailed t-tests (Löwe et al., 2010). Convergent validity was assessed by comparing a measure known to be related to anxiety using Spearman rank-order correlations. The related measure was depression as measured by the PHQ-2 (Kroenke et al., 2003).
Spearman rank-order correlations were used to determine agreement between the GAD-7 and GAD-Mini scores in the assessment of sensitivity (to accurately identify anxiety), specificity (to accurately identify an individual as not having anxiety symptoms), positive predictive value (PPV; the probability of a positive diagnosis after a positive screening), and negative predictive value (NPV; the probability of a negative diagnosis after a negative screening). To calculate sensitivity, specificity, positive PPV, and NPV, the total GAD-7 score and total GAD-Mini score were dichotomously coded to indicate whether the participant was above or below the previously established threshold with greatest sensitivity and specificity indicative of anxiety [i.e., ≥10 of the possible 21 points on the GAD-7 (Spitzer et al., 2006), which is an equivalent of 48% of the total possible points]. The threshold for GAD-Mini was set at 48% of the total points possible, e.g., a 2-item GAD-Mini would have a possible score range of 0–6, thus the threshold equaled (≥6 × 0.48). Sensitivity, specificity PPV, and NPV of the GAD-Mini were all calculated using the GAD-7 as the “gold” standard (Parikh et al., 2008; Plummer et al., 2016; Hinz et al., 2017; Silva et al., 2018; Luo et al., 2019).
Results
Table 1 summarizes the demographic characteristics of the participants in the three studies. Participants’ average age ranged from 19.64 to 20.45 years. Most were women and the proportion who were white declined over time from 58% in Data Set A to 41% in Data Set C.
KMO calculations revealed that all three data sets met the criteria for sampling adequacy (Glen, 2020). The KMO values were 0.92, 0.91, and 0.93 for Data Sets A, B, and C, respectively. Bartlett’s test of sphericity values were significant (p < 0.0001) for Data Sets A, B, and C (i.e., χ2 = 7,622.071, 1,983.27, and 9,598.23, respectively); therefore, the GAD-7 items were related and suitable for factor analysis (Glen, 2020; IBM Knowledge Center, 2020).
For Data Set A, the exploratory principal components analysis for all seven items yielded one eigenvalue >1, thus indicating a single factor solution (Harlow, 2014). Additionally, rotations were not possible because only one factor was extracted, indicating a unidimensional scale. Principal components analysis procedures indicated factor structure replicability in that both Data Sets B and C also yielded a single factor solution. Similarly, confirmatory principal components analysis revealed the same single factor structure and similar loadings for all Data Sets (Table 2). As shown in Table 2, the magnitude of difference for each item’s factor loading between Data Sets A and B ranged from 0.000 to 0.007, 0.000 to 0.003 for Data Sets A and C, and 0.000 to 0.003 for Data Sets B and C. The magnitude of differences for all factor loading comparisons were well below the threshold of ≤0.05 and were indicative of a stable factor structure (Osborne, 2014).
Table 2. Principal components analysis factor loadings and magnitude of differencesa items for the Generalized Anxiety Disorder-7 (GAD-7) Questionnaire for Data Sets A, B, and C.
Goodness-of-fit findings are shown in Table 3. CFI, GFI, TLI, and SRMR values indicate good to excellent model fit for all Data Sets (Schermelleh-Engel et al., 2003). RMSEA for Data Set A was acceptable and was somewhat exceeded the generally recommended acceptable fit cutoff (≤0.10) in Data Sets B and C (Hu and Bentler, 1999).
Table 4 reports the iterative confirmatory principal components analyses conducted to reduce the number of items in the GAD-7 to the most parsimonious set of items. Each iteration of the confirmatory principal components analysis generated virtually identical findings to the first iteration; that is, there was one eigenvalue >1, no items had cross loadings or weak loadings, the scale was unidimensional, and the Cronbach alpha coefficients were high. Per the data analysis plan, the lowest loading item in Data Set A was eliminated and confirmatory principal components analysis was repeated. For Data Set A, iterations could continue per the analysis plan until only two GAD items remained. Repeating these procedures with Data Sets B and C yielded similar findings, resulting in only two GAD items remaining. Thus, the GAD-Mini was comprised of item 2 (How often have you not been able to stop worrying or control worrying?) and item 3 (How often have you worried too much about different things?) from the GAD-7. Cronbach alpha coefficients remained strong after every iteration.
Table 4. Iterative confirmatory principal components analysis factor loadings for the GAD Questionnaire items for Data Sets A, B, and C.
Construct validity was confirmed with independent two-tailed t-tests showing that anxiety scores were significantly higher in women than men on both the GAD-7 and GAD-Mini for all three Data Sets (Table 5). Similarly, convergent validity was confirmed with Spearman rank-order correlations showing that PHQ-2 and GAD-7 were moderately correlated as were PHQ-2 and the GAD-Mini (Table 6).
Table 6. Spearman rank-order correlations to establish convergent validity of (GAD-7) and GAD-Mini with Patient Health Questionnaire (PHQ-2) depression severity scores.
Table 7 indicates that the GAD-7 and GAD-Mini scores were highly correlated (R ≥ 0.90). At the threshold of ≥3, sensitivity of the GAD-Mini to accurately identify anxiety and specificity of the GAD-Mini to accurately identify an individual as not having anxiety symptoms was high across Data Sets. Additionally, nearly all young adults who were identified by the GAD-Mini as non-cases of GAD (NPV) were also classified as such by the GAD-7; however, only 59–75% of those having GAD identified by the GAD-Mini (PPV) were similarly classified by the GAD-7.
Discussion
Exploratory and confirmatory principal components analysis results of this study indicate that the GAD-7 has a single factor structure with strong loadings, high reliability coefficient, and stability in young adults enrolled in college over time. All Data Sets met a priori criteria indicative of good to excellent model fit except the RMSEA criterion in Data Sets B and C. Iterative confirmatory principal components analyses revealed the most parsimonious set of items that maintained scale unidimensionality, strong loadings, and high reliability was two items (not able to stop worrying or control worrying and worried too much about different things); this finding was stable across all three sets of data. Both the GAD-7 and GAD-Mini exhibited good construct and convergent validity in all three data sets. In every data set, the specificity, sensitivity, and NPV was high and PPV was moderate to high for the GAD-Mini.
The unidimensionality and Cronbach alpha coefficients of the GAD-7 found in this study are congruent with studies conducted in other populations. For example, this study had strikingly analogous findings to those reported for Korean and Portuguese university students (Bartolo et al., 2017; Lee and Kim, 2019). Similar findings also were reported for primary care patients (Jordan et al., 2017; Johnson et al., 2019), psychiatric patients (Dear et al., 2011; Kertz et al., 2013; Konkan et al., 2013; Rutter and Brown, 2017; Johnson et al., 2019), infertility patients (Omani-Samani et al., 2018), the general population in several countries (Konkan et al., 2013; Sousa et al., 2015; Hinz et al., 2017), adolescents (Tiirikainen et al., 2019), individuals receiving care in a traditional medicine department in China (Zeng et al., 2013), and in non-English speakers (Mills et al., 2014; Sousa et al., 2015; Ahmad et al., 2017). Further, the goodness-of-fit findings parallel those reported for populations with varying characteristics (García-Campayo et al., 2012; Mills et al., 2014; Bartolo et al., 2017; Hinz et al., 2017; Rutter and Brown, 2017; Doi et al., 2018; Lee and Kim, 2019).
To the best of the authors’ knowledge, this is the first study to conduct iterative factor analysis to shorten the GAD-7 to the most parsimonious set of items yielding strong psychometric properties. Although the GAD-2 was proposed in 2007 (Kroenke et al., 2007; Skapinakis, 2007), the two items comprising this measure were chosen because they were considered the “core” items (i.e., items 1 and 2 on the GAD-7: How often have you felt nervous, anxious, or on edge? and How often have you not been able to stop worrying or control worrying?). All three data sets in this study yielded two items from the GAD-7, with one item being the same as the GAD-2 (i.e., item 2: How often have you not been able to stop worrying or control worrying?) and the other differing (i.e., item 3: How often have you worried too much about different things?). The key difference seems to be that GAD-Mini focuses on excessive, difficult to control worry – the primary feature of GAD, whereas the GAD-2 combines worry with one of the six symptoms associated with anxiety and worry (i.e., feeling on edge; American Psychiatric Association, 2013). Given that there are five other symptoms (i.e., fatigue, difficulty concentrating, irritability, muscle tension, and sleep disturbances) it may be that the single symptom targeted in item 1 of the GAD-7, insufficiently represented the possible array of GAD symptoms. Interestingly, Donker et al. (2011) observed in a Dutch general population that it was not the GAD-7 “core” items 1 and 2 that explained the most variance in the GAD-7 scale – it was item 4 of the GAD-7 (i.e., How often have you had trouble relaxing?). This study along with that of Donker et al. (2011) suggest that future research directions should include the re-analysis of existing GAD-7 data sets using iterative confirmatory principal components analysis to confirm the psychometric properties of the GAD-Mini in other population groups and to determine its utility in relation to the GAD-2.
The GAD-7 and GAD-Mini both exhibited good construct and convergent validity, thereby supporting an array of previous studies. For example, congruent with other research (Ahmad et al., 2017; Hinz et al., 2017), women scored significantly higher on the full length and shortened measures than men. In addition, the moderate correlation between both measures and PHQ-2 was also demonstrated in other studies (Löwe et al., 2010; García-Campayo et al., 2012; Wild et al., 2014; Bartolo et al., 2017; Hinz et al., 2017; Omani-Samani et al., 2018; Ahn et al., 2019; Lee and Kim, 2019).
Like reported GAD-7 and GAD-2 comparisons (Kroenke et al., 2007; Donker et al., 2011; Delgadillo et al., 2012; Hinz et al., 2017; Hughes et al., 2018), the GAD-Mini was highly correlated with the GAD-7 suggesting that these measures may be equally effective in screening for GADs. In addition, the threshold score of ≥10 for the GAD-7 that was identified in previous research (Spitzer et al., 2006) and ≥3 score for the GAD-Mini used previously for the GAD-2 (Kroenke et al., 2007, 2010), resulted in near perfect agreement between the GAD-Mini and GAD-7 in identifying those above and below the threshold indicative of GAD. At the threshold of ≥3, the GAD-Mini correctly identified nearly all GAD cases (sensitivity) and more than eight in 10 of the non-cases of GAD (specificity). Although the GAD-Mini performs similarly to the GAD-7 in identifying those without GAD (NPV), the rate at which it classified those with GAD is higher than the GAD-7 (PPV). This finding suggests that when the GAD-Mini indicates GAD, it would be wise to confirm this with the longer GAD-7 to more clearly pinpoint symptoms of anxiety and, given its wider range of possible scores compared to the GAD-Mini (0–21 vs. 0–6), for tracking changes over time in clinical practice as treatment progresses (Kroenke et al., 2007; Hinz et al., 2017).
This study’s findings are limited to young adults enrolled at a large United States university, however the sample in all data sets was large and students were racially diverse. Additionally, study findings parallel those of university students in Portugal (Bartolo et al., 2017) and Korea (Lee and Kim, 2019) suggesting generalizability across this population. A further limitation is that this study relied on the GAD-7 to serve as the gold standard. Interviews by a psychologist or psychiatrist would have been a true gold standard (Baker et al., 2018), however this was not feasible given the online data collection method and size of the sample recruited. Moreover, the GAD-7 repeatedly has been found to have good to excellent psychometric properties for identifying GAD and has adequately served as the gold standard in similar studies (Löwe et al., 2010; Plummer et al., 2016; Hinz et al., 2017). Like all secondary data analyses, this study is limited to existing data, however the original data were carefully collected, cleaned, and stored and contained complete data for all participants. Importantly, possible effects caused by size, location, and/or mission of the higher education institution were controlled for by including only data collected from students at one university. An important strength of this study is that, to the authors’ knowledge, it is the first study to establish the psychometric properties of the GAD-7 and GAD-Mini in United States university students and demonstrate its stability in diverse young adults enrolled in college over a time period spanning a decade.
The GAD-Mini addresses the primary feature of GAD, namely worry. Its excellent psychometric qualities, along with the speed with which the GAD-Mini can be completed and scored, make it a valuable screener for practitioners and as a self-help tool for young adults. The ease with which it can be used has the potential for facilitating early diagnosis of a condition prevalent among young adults enrolled in college (LeViness et al., 2017). Left undiagnosed and untreated, GAD can become chronic, resistant to treatment, and increases the risk for comorbidity with other mental illness, such as depression (Shear et al., 2007; Maron and Nutt, 2017; Ströhle et al., 2018). Despite the high rates of GAD in older teens and young adults, the United States Preventive Services Task Force and American Academy of Pediatrics have not recommended screening for anxiety. The GAD-Mini is a psychometrically sound screening tool that can serve as a step toward universal screening in even the busiest clinical practice and contribute to early treatment and improved health outcomes in those with GAD.
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics Statement
The studies involving human participants were reviewed and approved by Rutgers University Institutional Review Board. The patients/participants provided their written informed consent to participate in this study.
Author Contributions
All authors were responsible for study design, statistical analysis, and manuscript preparation. CB-B and VQ were responsible for recruiting the participants for Data Set A. CB-B and KE were responsible for recruiting the participants for Data Sets B and C. All authors have contributed to and have approved the final manuscript.
Funding
This work was supported by the New Jersey Agricultural Experiment Station.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
Ahmad, S., Hussain, S., Shah, F., and Akhtar, F. (2017). Urdu translation and validation of GAD-7: a screening and rating tool for anxiety symptoms in primary health care. J. Pak. Med. Assoc. 67, 1536–1540.
Ahn, J. -K., Kim, Y., and Choi, K. -H. (2019). The psychometric properties and clinical utility of the Korean version of GAD-7 and GAD-2. Front. Psychiatry 10:127. doi: 10.3389/fpsyt.2019.00127
American Psychiatric Association (2013). Diagnostic and statistical manual of mental disorders: DSM-5. 5th Edn. Washington, DC: American Psychiatric Association.
Arnett, J. (1997). Young people’s conceptios of the transition to adulthood. Youth Soc. 29, 3–23. doi: 10.1177/0044118X97029001001
Arnett, J. (2001). Conceptions of the transition to adulthood: perspectives from adolescence through midlife. J. Adult Dev. 8, 133–143. doi: 10.1023/A:1026450103225
Baker, A. M., Holbrook, J. T., Yohannes, A. M., Eakin, M. N., Sugar, E. A., Henderson, R. J., et al. (2018). Test performance characteristics of the AIR, GAD-7, and HADS-anxiety screening questionnaires for anxiety in chronic obstructive pulmonary disease. Ann. Am. Thorac. Soc. 15, 926–934. doi: 10.1513/AnnalsATS.201708-631OC
Barthel, D., Barkmann, C., Ehrhardt, S., and Bindt, C. International CDS Study Group (2014). Psychometric properties of the 7-item Generalized Anxiety Disorder scale in antepartum women from Ghana and Cote d’Ivoire. J. Affect. Disord. 169, 203–211. doi: 10.1016/j.jad.2014.08.004
Bartolo, A., Monteiro, S., and Pereira, A. (2017). Factor structure and construct validity of the Generalized Anxiety Disorder 7-item (GAD-7) among Portuguese college students. Cad. Saude Publica 33:e00212716. doi: 10.1590/0102-311X00212716
Beesdo, K., Knappe, S., and Pine, D. S. (2009). Anxiety and anxiety disorders in children and adolescents: developmental issues and implications for DSM-V. Psychiatr. Clin. North Am. 32, 483–524. doi: 10.1016/j.psc.2009.06.002
Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., and Young, S. L. (2018). Best practices for developing and validating scales for health, social, and behavioral research: a primer. Front. Public Health 6:149. doi: 10.3389/fpubh.2018.00149
Byrd-Bredbenner, C., Quick, V., Koenings, M., Martin-Biggers, J., and Kattelmann, K. (2016). Relationships of cognitive load on eating and weight-related behaviors of young adults. Eat. Behav. 21, 89–94. doi: 10.1016/j.eatbeh.2016.01.002
Cano-Vindel, A., Muñoz-Navarro, R., Medrano, L. A., Ruiz-Rodríguez, P., González-Blanch, C., Gómez-Castillo, M. D., et al. (2018). A computerized version of the Patient Health Questionnaire-4 as an ultra-brief screening tool to detect emotional disorders in primary care. J. Affect. Disord. 234, 247–255. doi: 10.1016/j.jad.2018.01.030
de Lijster, J., Dierckx, B., Utens, E., Verhulst, F., Zieldorff, C., Dieleman, G., et al. (2017). The age of onset of anxiety disorders. Can. J. Psychiatry 62, 237–246. doi: 10.1177/0706743716640757
Dear, B., Titov, N., Sunderland, M., McMillan, D., Anderson, T., Lorian, C., et al. (2011). Psychometric comparison of the Generalized Anxiety Disorder scale-7 and the Penn State Worry Questionnaire for measuring response during treatment of generalised anxiety disorder. Cogn. Behav. Ther. 40, 216–227. doi: 10.1080/16506073.2011.582138
Delgadillo, J., Payne, S., Gilbody, S., Godfrey, C., Gore, S., Jessop, D., et al. (2012). Brief case finding tools for anxiety disorders: validation of GAD-7 and GAD-2 in addictions treatment. Drug Alcohol Depend. 125, 37–42. doi: 10.1016/j.drugalcdep.2012.03.011
Doi, S., Ito, M., Takebayashi, Y., Muramatsu, K., and Horikoshi, M. (2018). Factorial validity and invariance of the 7-item Generalized Anxiety Disorder scale (GAD-7) among populations with and without self-reported psychiatric diagnostic status. Front. Psychol. 9:1741. doi: 10.3389/fpsyg.2018.01741
Donker, T., van Straten, A., Marks, I., and Cuijpers, P. (2011). Quick and easy self-rating of Generalized Anxiety Disorder: validity of the Dutch web-based GAD-7, GAD-2 and GAD-SI. Psychiatry Res. 188, 58–64. doi: 10.1016/j.psychres.2011.01.016
Esser, P., Hartung, T., Friedrich, M., Johansen, C., Wittchen, H., Faller, H., et al. (2018). The Generalized Anxiety Disorder Screener (GAD-7) and the anxiety module of the Hospital and Depression Scale (HADS-A) as screening tools for generalized anxiety disorder among cancer patients. Psychooncology 27, 1509–1516. doi: 10.1002/pon.4681
Flora, D., and Flake, J. (2017). The purpose and practice of exploratory and confirmatory factor analysis in psychological research: decisions for scale development and validation. Can. J. Behav. Sci. 49, 78–88. doi: 10.1037/cbs0000069
García-Campayo, J., Zamorano, E., Ruiz, M. A., Pérez-Páramo, M., López-Gómez, V., and Rejas, J. (2012). The assessment of generalized anxiety disorder: psychometric validation of the Spanish version of the self-administered GAD-2 scale in daily medical practice. Health Qual. Life Outcomes 10, 114. doi: 10.1186/1477-7525-10-114
Glen, S. (2020). StatisticsHowTo: Kaiser-Meyer-Olkin (KMO) test for sampling adequacy. Available at: www.statisticshowto.datasciencecentral.com/kaiser-meyer-olkin/ (Accessed August 3, 2020).
Harlow, L. (2014). The essence of multivariate thinking: Basic themes and methods. 2nd Edn. NY: Routledge.
Hinz, A., Klein, A. M., Brähler, E., Glaesmer, H., Luck, T., Riedel-Heller, S. G., et al. (2017). Psychometric evaluation of the Generalized Anxiety Disorder Screener GAD-7, based on a large German general population sample. J. Affect. Disord. 210, 338–344. doi: 10.1016/j.jad.2016.12.012
Hu, L., and Bentler, P. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct. Equ. Modeling 6, 1–55. doi: 10.1080/10705519909540118
Hughes, A. J., Dunn, K. M., Chaffee, T., Bhattarai, J. J., and Beier, M. (2018). Diagnostic and clinical utility of the GAD-2 for screening anxiety symptoms in individuals with multiple sclerosis. Arch. Physical. Med. Rehab. 99, 2045–2049. doi: 10.1016/j.apmr.2018.05.029
IBM Knowledge Center (2020). KMO and Bartlett’s Test. Available at: www.ibm.com/support/knowledgecenter/SSLVMB_26.0.0/statistics_casestudies_project_ddita/spss/tutorials/fac_telco_kmo_01.html (Accessed August 3, 2020).
Johnson, S. U., Ulvenes, P. G., Øktedalen, T., and Hoffart, A. (2019). Psychometric properties of the GAD-7 in a heterogeneous psychiatric sample. Front. Psychol. 10:1713. doi: 10.3389/fpsyg.2019.01713
Jordan, P., Shedden-Mora, M. C., and Löwe, B. (2017). Psychometric analysis of the Generalized Anxiety Disorder scale (GAD-7) in primary care using modern item response theory. PLoS One 12:e0182162. doi: 10.1371/journal.pone.0182162
Kertz, S., Bigda-Peyton, J., and Bjorgvinsson, T. (2013). Validity of the Generalized Anxiety Disorder-7 scale in an acute psychiatric sample. Clin. Psychol. Psychother. 20, 456–464. doi: 10.1002/cpp.1802
Konkan, R., Senormanci, O., Guclu, O., Aydin, E., and Sungur, M. (2013). Validity and reliability study for the Turkish adaptation of the Generalized Anxiety Disorder-7 (GAD-7) scale. Arch. Neuropsychiatry 50, 53–58. doi: 10.4274/npa.y6308
Kroenke, K., Spitzer, R. L., and Williams, J. B. (2003). The Patient Health Questionnaire-2: validity of a two-item depression screener. Med. Care 41, 1284–1292. doi: 10.1097/01.MLR.0000093487.78664.3C
Kroenke, K., Spitzer, R. L., Williams, J. B., and Löwe, B. (2010). The Patient Health Questionnaire Somatic, Anxiety, and Depressive Symptom Scales: a systematic review. Gen. Hosp. Psychiatry 32, 345–359. doi: 10.1016/j.genhosppsych.2010.03.006
Kroenke, K., Spitzer, R. L., Williams, J. B., Monahan, P. O., and Löwe, B. (2007). Anxiety disorders in primary care: prevalence, impairment, comorbidity, and detection. Ann. Intern. Med. 146, 317–325. doi: 10.7326/0003-4819-146-5-200703060-00004
Kujanpaa, T., Ylisaukko-Oja, T., Jokelainen, J., Hirsikangas, S., Kantste, O., Kyngas, H., et al. (2014). Prevalence of anxiety disorders among Finnish primary care high utilizers and validation of Finnish translation of GAD-7 and GAD-2 screening tools. Scand. J. Prim. Health Care 32, 78–83. doi: 10.3109/02813432.2014.920597
Lee, B., and Kim, Y. E. (2019). The psychometric properties of the Generalized Anxiety Disorder scale (GAD-7) among Korean university students. Psychiatry Clin. Psychopharmacol. 29, 864–871. doi: 10.30773/pi.2019.0226
LeViness, P., Bershad, C., and Gorman, K. (2017). The association for university and college counseling center directors annual survey. Available at: https://www.aucccd.org/assets/documents/Governance/2017%20aucccd%20surveypublicapr26.pdf (Accessed August 3, 2020).
Löwe, B., Wahl, I., Rose, M., Spitzer, C., Glaesmer, H., Wingenfeld, K., et al. (2010). A 4-item measure of depression and anxiety: validation and standardization of the Patient Health Questionnaire-4 (PHQ-4) in the general population. J. Affect. Disord. 122, 86–95. doi: 10.1016/j.jad.2009.06.019
Luo, Z., Li, Y., Hou, Y., Zhang, H., Liu, X., Qian, X., et al. (2019). Adaptation of the two-item Generalized Anxiety Disorder scale (GAD-2) to Chinese rural population: a validation study and meta-analysis. Gen. Hosp. Psychiatry 60, 50–56. doi: 10.1016/j.genhosppsych.2019.07.008
Maron, E., and Nutt, D. (2017). Biological markers of generalized anxiety disorder. Dialogues Clin. Neurosci. 19, 147–158.
Merikangas, K. R., Ames, M., Cui, L., Stang, P. E., Ustun, T. B., Von Korff, M., et al. (2007). The impact of comorbidity of mental and physical conditions on role disability in the US adult household population. Arch. Gen. Psychiatry 64, 1180–1188. doi: 10.1001/archpsyc.64.10.1180
Micoulaud-Franchi, J. -A., Bartolomei, F., and McGonigal, A. (2017). Ultra-short screening instruments for major depressive episode and generalized anxiety disorder in epilepsy: the NDDIE-2 and the GAD-SI. J. Affect. Disord. 210, 237–240. doi: 10.1016/j.jad.2016.12.038
Mills, S., Fox, R., Malcarne, V., Roesch, S., Champagne, B., and Sadler, G. (2014). The psychometric properties of the Generalized Anxiety Disorder-7 scale in Hispanic Americans with English or Spanish language preference. Cultur. Divers. Ethnic Minor. Psychol. 20, 463–468. doi: 10.1037/a0036523
Nath, S., Ryan, E., Trevillion, K., Bick, D., Dernilew, J., Milgrom, J., et al. (2018). Prevalence and identification of anxiety disorders in pregnancy: the diagnostic accuracy of the two-item Generalised Anxiety Disorder scale (GAD-2). BMJ Open 8:e023766. doi: 10.1136/bmjopen-2018-023766
Omani-Samani, R., Maroufizadeh, S., Ghaheri, A., and Navid, B. (2018). Generalized Anxiety Disorder-7 (GAD-7) in people with infertility: a reliability and validity study. Mid. East Fertil. Soc. J. 23, 446–449. doi: 10.1016/j.mefs.2018.01.013
Osborne, J. (2014). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Scotts Valley, CA: CreateSpace Independent Publishing.
Parikh, R., Mathai, A., Parikh, S., Chandra Sekar, G., and Thomas, R. (2008). Understanding and using sensitivity, specificity, and predictive values. Indian J. Ophthalmol. 56, 46–50. doi: 10.4103/0301-4738.37595
Parry, S. (Undated). Fit indices commonly reported for CFA and SEM. Available at: www.cscu.cornell.edu/news/Handouts/SEM_fit.pdf (Accessed August 3, 2020).
Plummer, F., Manea, L., Trepel, D., and McMillan, D. (2016). Screening for anxiety disorders with the GAD-7 and GAD-2: a systematic review and diagnostic metaanalysis. Gen. Hosp. Psychiatry 39, 24–31. doi: 10.1016/j.genhosppsych.2015.11.005
Quick, V. (2011). Characteristics and disturbed/disordered eating behaviors of young adults with and without diet-related chronic health conditions. Doctoral Degree [dissertation thesis], New Brunswick (NJ): Rutgers University.
Rutter, L. A., and Brown, T. A. (2017). Psychometric properties of the Generalized Anxiety Disorder scale-7 (GAD-7) in outpatients with anxiety and mood disorders. J. Psychopathol. Behav. Assess. 39, 140–146. doi: 10.1007/s10862-016-9571-9
Scheibe, G., and Albus, M. (1992). Age at onset, precipitating events, sex distribution, and co-occurrence of anxiety disorders. Psychopathology 25, 11–18. doi: 10.1159/000284748
Schermelleh-Engel, K., Moosbrugger, H., and Muller, H. (2003). Evaluating the fit of structural equation models: tests of significance and descriptive goodness-of-fit measures. Methods Psychol. Res. Online 8, 23–73.
Seo, J. -G., and Park, S. -P. (2015). Validation of the Generalized Anxiety Disorder-7 (GAD-7) and GAD-2 in patients with migraine. J. Headache Pain 16:97. doi: 10.1186/s10194-015-0583-8
Shear, M. K., Bjelland, I., Beesdo, K., Gloster, A. T., and Wittchen, H. U. (2007). Supplementary dimensional assessment in anxiety disorders. Int. J. Methods Psychiatr. Res. 16, S52–S64. doi: 10.1002/mpr.215
Sidik, S., Arroll, B., and Goodyear-Smith, F. (2012). Validation of the GAD-7 (Malay version) among women attending a primary care clinic in Malaysia. J. Prim. Health Care 4, 5–11. doi: 10.1071/HC12005
Silva, M. T., Roa, M. C., Martins, S. S., da Silva, A. T. C., and Galvao, T. F. (2018). Generalized anxiety disorder and associated factors in adults in the Amazon, Brazil: a population-based study. J. Affect. Disord. 236, 180–186. doi: 10.1016/j.jad.2018.04.079
Skapinakis, P. (2007). The 2-item Generalized Anxiety Disorder scale had high sensitivity and specificity for detecting GAD in primary care. Evid. Based Med. 12:149. doi: 10.1136/ebm.12.5.149
Sousa, T., Viveiros, V., Chai, M., Cinente, F., Jesus, G., Carnot, M., et al. (2015). Reliability and validity of the Portuguese version of the Generalized Anxiety Disorder (GAD-7) scale. Health Qual. Life Outcomes 13:50. doi: 10.1186/s12955-015-0244-2
Spitzer, R. L., Kroenke, K., Williams, J. B., and Löwe, B. (2006). A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch. Intern. Med. 166, 1092–1097. doi: 10.1001/archinte.166.10.1092
Staples, L. G., Dear, B. F., Gandy, M., Fogliati, V., Fogliati, R., Karin, E., et al. (2019). Psychometric properties and clinical utility of brief measures of depression, anxiety, and general distress: the PHQ-2, GAD-2, and K-6. Gen. Hosp. Psychiatry 56, 13–18. doi: 10.1016/j.genhosppsych.2018.11.003
Streiner, D. (2003). Starting at the beginning: an introduction to coefficient alpha and internal consistency. J. Pers. Assess. 80, 99–103. doi: 10.1207/S15327752JPA8001_18
Ströhle, A., Gensichen, J., and Domschke, K. (2018). The diagnosis and treatment of anxiety disorders. Dtsch. Arztebl. Int. 115, 611–620. doi: 10.3238/arztebl.2018.0611
Tavakol, M., and Dennick, R. (2011). Making sense of Cronbach’s alpha. Int. J. Med. Educ. 2, 53–55. doi: 10.5116/ijme.4dfb.8dfd
Tiirikainen, K., Haravuori, H., Ranta, K., Kaltiala-Heino, R., and Marttunen, M. (2019). Psychometric properties of the 7-item Generalized Anxiety Disorder scale (GAD-7) in a large representative sample of Finnish adolescents. Psychiatry Res. 272, 30–35. doi: 10.1016/j.psychres.2018.12.004
van Heyningen, T., Honikman, S., Tomlinson, M., Field, S., and Myer, L. (2018). Comparison of mental health screening tools for detecting antenatal depression and anxiety disorders in South African women. PLoS One 13:e0193697. doi: 10.1371/journal.pone.0193697
Vesga-Lopez, O., Schneier, F., and Blanco, C. (2008). Gender differences in generalized anxiety disorder: results from the National Epidemiologic Survey on Alcohol and Related Conditions (NESARC). J. Clin. Psychiatry 69, 1606–1616. doi: 10.4088/JCP.v69n1011
Wang, R., Wang, W., daSilva, A., Huckins, J. F., Kelley, W. M., Heatherton, T. F., et al. (2018). Tracking depression dynamics in college students using mobile phone and wearable sensing. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2, 1–26. doi: 10.1145/3191775
Wild, B., Eckl, A., Herzog, W., Niehoff, D., Lechner, S., Maatouk, I., et al. (2014). Assessing generalized anxiety disorder in elderly people using the GAD-7 and GAD-2 scales: results of a validation study. Am. J. Geriatr. Psychiatry 22, 1029–1038. doi: 10.1016/j.jagp.2013.01.076
Yonkers, K. A., Bruce, S. E., Dyck, I. R., and Keller, M. B. (2003). Chronicity, relapse, and illness—course of panic disorder, social phobia, and generalized anxiety disorder: findings in men and women from 8 years of follow-up. Depress. Anxiety 17, 173–179. doi: 10.1002/da.10106
Keywords: anxiety, psychometrics, generalized anxiety disorder, young adults, instrumental study
Citation: Byrd-Bredbenner C, Eck K and Quick V (2020) Psychometric Properties of the Generalized Anxiety Disorder-7 and Generalized Anxiety Disorder-Mini in United States University Students. Front. Psychol. 11:550533. doi: 10.3389/fpsyg.2020.550533
Edited by:
Peter L. Fisher, University of Liverpool, United KingdomReviewed by:
Bárbara Nazaré, Universidade Lusófona, PortugalNaomi Du Bois, Ulster University, United Kingdom
Copyright © 2020 Byrd-Bredbenner, Eck and Quick. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Kaitlyn Eck, a21kMjYwQHNjYXJsZXRtYWlsLnJ1dGdlcnMuZWR1