- 1Department of Psychology, The University of North Carolina at Wilmington, Wilmington, NC, United States
- 2Department of Psychiatry, Rutgers, The State University of New Jersey, New Brunswick, NJ, United States
- 3Department of Psychology, University of Rhode Island, Kingston, RI, United States
- 4Department of Psychology, Northern Kentucky University, Highland Heights, KY, United States
- 5Department of Psychiatry, University of California, San Diego, La Jolla, CA, United States
- 6Department of Epidemiology, University of Florida, Gainesville, FL, United States
The novel coronavirus pandemic that emerged in late 2019 (COVID-19) has created challenges not previously experienced in human research. This paper discusses two large-scale NIH-funded multi-site longitudinal studies of adolescents and young adults – the National Consortium on Alcohol and Neurodevelopment in Adolescence (NCANDA) and the Adolescent Brain Cognitive Development (ABCD) Study – and valuable approaches to learn about adaptive processes for conducting developmentally sensitive research with neuroimaging and neurocognitive testing across consortia during a global pandemic. We focus on challenges experienced during the pandemic and modifications that may guide other projects, such as implementing adapted protocols that protect the safety of participants and research staff, and addressing assessment challenges through the use of strategies such as remote and mobile assessments. Given the pandemic’s disproportionate impacts on participants typically underrepresented in research, we describe efforts to retain these individuals. The pandemic provides an opportunity to develop adaptive processes that can facilitate future studies’ ability to mobilize effectively and rapidly.
Introduction
The novel coronavirus that hit the world in the latter part of 2019 (COVID-19) has changed the global research landscape. In the United States, more than 80% of on-site research activities stopped at some point since the pandemic began (Wigginton et al., 2020). COVID-19 has mandated changes to research protocols, particularly to large, multi-site studies that examine neurodevelopment with carefully planned timelines that require time-sensitive in-person contact and retention over many years. Here we focus on two National Institutes of Health (NIH) funded studies of adolescent and young adult development: (1) the National Consortium on Alcohol and Neurodevelopment in Adolescence (NCANDA), comprised of 831 youth, recruited at ages 12-21 years and followed across five sites in the United States, to determine the effects of alcohol use on the developing brain (Brown et al., 2015); and (2) the Adolescent Brain Cognitive Development (ABCD) Study, comprised of 11,880 children, ages 9-10 years at baseline from twenty-one sites in the United States, as they mature through adolescence (Auchter et al., 2018). The emergence of COVID-19 presented an opportunity for further collaboration between these consortia, and across disciplines, to adapt and implement developmentally sensitive protocols that ensure the safety of participants and staff, and advance knowledge of the effects of a pandemic on youth and young adult development (Holmes et al., 2020).
NCANDA and ABCD joined forces to offer suggestions on best practices for adapting assessment protocols and steps taken to retain adolescent and young adult research participants during and after the pandemic, including underrepresented minority (URM) (e.g., Black/African American, Hispanic/Latinx) individuals. To do this, we convened expert workgroups to review and make recommendations—including discussions with administrative units, principal investigators and research staff across consortia—for adhering to safety regulations while maintaining as much data collection as is feasible during the pandemic, particularly aspects that require in-person assessment [e.g., neuroimaging (Auchter et al., 2018)].
NCANDA and ABCD Background
NCANDA recruited pre-adolescent to young adult participants (N = 831, ages 12–21 at baseline), along with their parent, in an accelerated longitudinal design at five sites across the United States (Figure 1; Brown et al., 2015). Youth complete baseline and annual in-person follow-ups to age 22, after which they are assessed by phone annually, with in-person visits at ages 24 and 27; throughout the study, mid-year phone interviews are conducted, and self-report data are collected by a project app (mNCANDA) installed on the smartphone of consenting participants (Cummins et al., in press). The NCANDA battery includes neuroimaging, neurocognitive testing, biospecimen collection (e.g., saliva, urine), and a comprehensive interview and questionnaire assessment which covers substance use, mental and physical health, education and employment, and adverse childhood experiences. For a detailed description of NCANDA, see Brown et al. (2015). The NCANDA goal is to maintain 85% or higher consortium-wide retention of those eligible at each follow-up through year 12. Among NCANDA participants, there are not cumulative differences by race/ethnicity in the completion of interview or brain scans through 5-year follow-up. More than 90% of participants across race/ethnic groups have completed 3 + assessments, which is the minimum required to statistically compute developmental trajectories.
Figure 1. NCANDA and ABCD sites (N = 22 total). All located in the United States. Yellow = ABCD sites only (n = 17); Green = NCANDA site only (n = 1), Red = NCANDA and ABCD sites (n = 4; note – staff and participants are separate).
In ABCD, participants (ages 9–10 at baseline) were recruited with a participating parent, to complete annual phenotypic assessments (Auchter et al., 2018) and biannual neuroimaging at 21 sites in the United States (Figure 1). The ABCD battery covers substance use, neurocognition, mental and physical health, culture and environment, collects biospecimens (e.g., blood, saliva, urine, hair sample, baby teeth), and uses novel technologies (e.g., Fitbit) to provide objective information on physical health, sleep, and activity level. Between in-person visits, a brief virtual mid-year assessment maintains participants’ connection with the study, updates contact information, and collects interim data on mental health and substance use. For a detailed description of ABCD, see Auchter et al. (2018). The ABCD consortium goal is to maintain 95% or higher retention at each follow-up. Since ABCD recruitment occurred in 2016–2018, the first wave of data collection has been completed, but the second wave of scans was suspended in mid-March 2020 due to pandemic-related mandated stay-at-home orders. Therefore, statistics on retention trajectories are not yet available (Auchter et al., 2018).
NCANDA and ABCD studies differ in duration, with NCANDA’s recruitment occurring in 2012–2013 and ABCD’s in 2016–2018. NCANDA and ABCD studies diverge in the number and location of sites. Four of the five NCANDA sites are also ABCD sites; however, the participants and staff do not overlap. Common features of NCANDA and ABCD include consortium-wide development of safety protocols for staff and participants to minimize infection risk, and allowance for sites to determine when any on-site assessment activity is safe. Together, the projects’ catchment areas cover 35% of the US population and illustrate broadly generalizable features that can be applied to a diverse range of projects (Brown et al., 2015; Auchter et al., 2018).
Retention of Underrepresented Minority Participants
Though all participants may face hurdles to completing biomedical studies, due to histories of negative experiences in health care and biomedical research, and the resource-demand of participating in research studies (e.g., taking time off from work to attend sessions; navigating transportation, childcare), individuals from URM populations may face even greater difficulties participating in research studies, particularly during challenging times, such as the pandemic (Cottler et al., 1996; Striley et al., 2008; Singh et al., 2017; Sander et al., 2018). Broad representation is essential, however, to the validity, generalizability and reproducibility of research findings, and reducing bias associated with non-random dropout (Robinson et al., 2007; Poulton et al., 2015; Western et al., 2016). As ongoing longitudinal studies, NCANDA and ABCD are attuned to barriers to retention. To date, in NCANDA, there has been no evidence of differential attrition by race/ethnicity. Attrition data for ABCD are not yet available. Specific methods used by the consortia to enhance retention of URM individuals (Table 1) start at recruitment, and include, for example, leveraging community relationships to build trust, anticipating individual needs (e.g., arranging transportation), and offering flexible scheduling (e.g., multiple visits to accommodate busy schedules) (Feldstein Ewing et al., 2018; Hoffman et al., 2018; Webb et al., 2019; Kim et al., 2020).
COVID-19 Broad Impacts on Health and Longitudinal Research With Youth
The distribution of COVID-19 cases in the US varies markedly across states and over time, and has ranged from 386 to 4846 diagnosed cases per 100,000 persons across NCANDA and ABCD sites (Center for Disease Control and Prevention, 2020b). COVID-19 may impact participants and their families, for example, through educational disruption, changes in employment (e.g., job loss, salary changes), interrupted communication services (e.g., phone, internet), geographic relocation, change in healthcare access, and food and housing insecurity (Brock and Laifer, 2020; Brooks et al., 2020; Ghosh et al., 2020). Social/physical distancing and associated isolation might have long-term impacts on participants and their families (e.g., increased domestic violence and stress (Bradley et al., 2020); reduced contact with supports).
Pandemics such as COVID-19 have disproportionately affected URM groups (Dorn et al., 2020; Ferdinand and Nasser, 2020; Millett et al., 2020). For example, some URM individuals have experienced greater adverse COVID-19-related health, financial, and family stress impacts ranging from decreased access to medical care to greater economic impacts associated with job loss (Maggs, 2020), family members becoming ill, and navigating greater childcare needs (e.g., due to transition to “virtual” schooling). Underserved and URM groups in particular, also may be more vulnerable to COVID-19-related stress associated with social distancing and prolonged isolation (Millett et al., 2020). In addition, multi-systemic impacts (e.g., at community, interpersonal levels) may increase the chronicity of existing stressors, particularly among underserved groups in the United States (Coughlin et al., 2020; Millett et al., 2020).
The pandemic could impact health outcomes of interest in NCANDA and ABCD, such as substance use, physical and mental health, and brain and cognitive development and functioning. The protocols now include enhanced assessment of impacts on stress and emotion associated with social distancing. These are receiving additional attention in both consortia with pandemic-related supplements.
Substance Use
NCANDA and ABCD will leverage on-going longitudinal data collection to prospectively examine the effect of pandemic-related closures of schools, public businesses and entertainment venues, and social/physical distancing practices on substance use (Dumas et al., 2020; Maggs, 2020). Of note, a study of 14–18 year-olds in Ontario, Canada during stay-at-home orders found that youth who reported substance use had increased alcohol and cannabis use relative to the pre-stay-at home period, with stress/coping motives cited most often as the reason for use (Dumas et al., 2020; Maggs, 2020). Further, certain contexts of increased adolescent alcohol use during stay-at-home periods are particularly concerning, such as solitary alcohol use, and alcohol use with parents (Dumas et al., 2020; Maggs, 2020). Importantly, these motives and contexts for substance use predict later substance-related problems, which can persist into adulthood, (Brown et al., 2008) making them important for longitudinal studies to monitor.
Physical and Mental Health
Children and adolescents who had the COVID-19 virus or who were in contact with someone with COVID-19 are at risk for multisystem inflammatory syndrome in children (MIS-C) (European Centre for Disease Prevention and Control, 2020). Similar to COVID-19, risk for MIS-C is higher among those with lower socioeconomic status, which may disproportionally impact URM youth (Riphagen et al., 2020). The coronavirus also may have primary or secondary effects on brain structure and functioning among those infected (Ghosh et al., 2020; Mahammedi et al., 2020), which NCANDA and ABCD studies are well-positioned to monitor with their multi-modal batteries. Effects of COVID-related trauma and chronic stress may impact brain structure and functioning, particularly during critical periods of adolescent development (Zucker and Brown, 2019). Acute impacts of the pandemic, for example, in the form of stress on emotion processing and regulation could influence an individual’s performance on neuropsychological and other study measures (e.g., activity level, sleep). These potential COVID-19-related impacts highlight the importance of on-going assessment of physical and mental health conditions in NCANDA and ABCD (Sheth et al., 2017).
Unexpected Opportunities
The pandemic has provided opportunities to gain greater insight into specific aspects of quality of life, such as healthcare access; and to enhance rapport with participants during mandated stay-at-home. Specifically, both projects added assessment of COVID-19 symptoms, testing, attitudes toward vaccination, and healthcare access. Most of these assessments were deployed within weeks of the pandemic and some will continue to be administered. Mandated stay-at-home offered the projects greater availability to some participants, who had previously been challenging to reach. Staying-at-home also provided opportunities for research staff to solidify positive connections with participants, and for participants to reinvest in their highly valued role in the project. Research compensation also held increased value for some due to the loss of other income sources.
Adaptations to the Research Protocol in Response to the Pandemic
Adaptations to the NCANDA and ABCD research protocols (Table 1) took into account the developmental level of participants (e.g., role of the parent versus autonomous young adult), and evolved as conditions changed (e.g., stay-at-home orders lapsed or resumed). During the initial suspension of all in-person research activity (e.g., neuroimaging, biosamples), study protocols were rapidly adapted to remote versions, with Institutional Review Board (IRB) approval, while researchers and participants were at home. The remote or “virtual” assessment protocol, conducted with supervision by research staff (e.g., video chat) as needed, required new standard operating procedures for consenting and assenting, ensuring secure data transmission, and managing participant privacy within the home/remote setting. To keep participants and families informed of COVID-19-related project changes, study websites were updated and local resource information was provided.
Confidentiality and Privacy
To maintain a high level of research integrity, maintaining confidentiality and privacy was a chief concern for study staff and participants. Each consortia developed adapted remote protocols that were HIPAA-compliant to maximize confidentiality of data collection. Maintaining rapport with participants was critical as some were in crowded quarters, necessitating creativity to complete assessments and flexibility in scheduling that afford more privacy (e.g., evenings). Providing the same high level of confidentiality and privacy helped maintain participant comfort with study participation, despite modified procedures.
Electronic Device and Internet Access
Electronic access was a consideration for study staff and participants, as some may not have had access to devices or internet for completing assessments. For staff, laptop computers were rapidly updated to allow for secure use outside of institutional settings, and efforts were made to provide service for staff without internet service. Unreliable internet connections represented an ongoing challenge for staff, and participants and their families. For participants without video capabilities on their devices, some assessments were completed by phone. To address this challenge, a triaged approach allowed for critical assessments to be prioritized in case a participant’s time on devices was limited (e.g., shared family device). Some youth had school-provided tablets or laptops. Youth from families with fewer economic resources and from less-resourced school districts were less likely to have access to these devices and the stable internet connections needed to power them, which also disproportionally impact URM communities (Ejiogu et al., 2011). Therefore, careful consideration was taken to ensure that all participants were individually assessed to determine their needs to maximize follow-up. Sites used evolving multi-modal approaches to keep participants, especially those with limited resources, engaged. Distribution of tablets and mobile hotspots may be helpful going forward, budgets permitting.
Maintaining Staff Morale
Staff morale and rapport with participants were key concerns, as they are cornerstones of retention. To address morale of research assistants, who are responsible for much of the day-to-day scheduling and assessments of participants and parents, consortia held weekly staff meetings to specifically address questions about protocol adaptions as well as staff burnout (Foster, 2020; Restauri and Sheridan, 2020). These weekly meetings were essential for building cohesion while working from home, understanding how staff and participants were responding to the pandemic, and modeling self-care by discussing what burnout looks like, how to best address it, and ways to find support from the consortium and other professional and personal sources (Cénat et al., 2020).
Special Considerations for In-Person Visits During the Pandemic
NCANDA and ABCD consortia continue to carefully consider when participants can safely complete in-person research visits at each site. Timelines for in-person research appointments vary across sites and are subject to change based on the virus incidence rate which differs by region, local, state and federal regulations, and institutional requirements. While the consortium establishes minimal safety guidelines based on CDC recommendations (Center for Disease Control and Prevention, 2020a), sites have developed protocols to meet the physical distancing, sanitization and use of PPE applications. Research rooms have been re-arranged to ensure that participants and study staff are at least 6 feet apart at all times, have appropriate ventilation, and stocks of cleaning supplies and masks.
Returning to In-Person Visits
Participants were informed in advance of the logistical changes for in person assessments. Those due for an in-person visit during pandemic-related lab closures completed remote (i.e., phone/computer) assessments within the required assessment window. At the next annual interview (i.e., if/when labs opened), sites performed neuroimaging scans, collect neuropsychological data, biospecimens, self-reports and the full phenotypic interview. The majority of the assessment battery was completed remotely, limiting in-person contact to only parts of the study that could not be done remotely (e.g., neuroimaging, biospecimens). This hybrid (remote and in-person) protocol allowed consortia to acquire approximately the same number of total scans while limiting in-person contact and maintaining well-spaced scan data for most participants. Although in-person neuroimaging stopped at all sites in March 2020, it resumed with enhanced protocols to meet COVID-19 safety guidelines in August 2020. Some sites paused or decreased in-person neuroimaging in November 2020 due to seasonal increases in rates of COVID-19.
To further address gaps in data collection between the extended follow-up intervals starting at age 24, NCANDA developed the mNCANDA app, which began collecting weekly reports of substance use and other health behaviors (e.g., exercise) in Year 6 (Cummins et al., in press). The mNCANDA app leverages this age group’s high ownership of mobile phones and willingness to engage in quick (median time: 180 sec) incentivized surveys (Cummins et al., in press). Because most youth, including URM youth, have a mobile phone even if their access to other devices (e.g., laptops) is more limited, the mNCANDA app is of particular use during the pandemic (Marler, 2018; Steinberg et al., 2018).
Neuropsychological Testing and Biospecimen Collection
As described above, during in-person assessment, larger tables are used to maintain distance during testing sessions, and plexiglass dividers minimize direct airflow between participant and research staff. Some sites have separate testing rooms for the participant and research staff, who communicate by video-conferencing. If possible, some in-person testing (e.g., grooved peg board) may be delayed until a subsequent visit. Similarly, with biospecimen collection, additional PPE (e.g., face shields) in addition to masks, are worn by study staff to ensure greater protection for participants and study staff. Saliva and urine samples can be left in designated areas or containers by participants, so that staff can maintain physical distancing. Given the extensive use of cleaning supplies to disinfect rooms and equipment, and PPE by study staff and participants, projects need to budget for increased costs.
Impact of PPE on Research
Both consortia and individual sites have discussed how having staff and participants wear PPE may impact retention and performance on study measures (e.g., stress associated with wearing a mask). Adolescents are at a developmental stage when concerns about their appearance and how they are perceived by their peers is highly externally oriented (Zucker and Brown, 2019). Adolescents (versus children or adults), have a greater sensitivity to peer evaluation and are highly influenced by perception of peer appraisals. Therefore, youth may be resistant to wearing PPE themselves and may be hesitant to enter a research setting where staff are wearing PPE because this could increase uncomfortable thoughts and feelings about the pandemic.
Staff wearing PPE could impact participant performance on neurocognitive and clinical assessments as well as phenotypic measures of coping and stress. As such, study staff will need to take steps to normalize PPE use both by study staff and participants to prepare participants for their visit and openly discuss at the start of each visit. Steps to normalize PPE include conducting in-person assessment in separate rooms with use of video-conference, if available, to allow communication between participant and research staff without masks. When masks are used, staff can acknowledge directly, thoughtfully, and appropriately, concerns that adolescent participants and their parents may have about wearing PPE and returning to the research setting during a pandemic. NCANDA and ABCD Coordinating Centers have provided guidance in developing basic scripts for communicating in a developmentally appropriate manner with participants, which can be tailored according to institutional guidance and IRB regulations.
Conclusion
NCANDA and ABCD consortia have leveraged the interdisciplinary strengths of psychologists, physicians, neuroimagers, technicians, and essential research staff to implement protocol adaptations and retention strategies to safely conduct in-person research assessments with participants during a pandemic. The approaches reviewed represent evolving best practice guidelines based on two large scale longitudinal neuroimaging studies of youth and young adults that are designed to capture change across a range of domains (e.g., brain, cognition, behavior) during a critical period of development. COVID-19 required adaptions to the research protocol and has led to the collection of unique new data during this developmental period, such as attitudes toward vaccination, the emotional and stress-related impacts of prolonged social isolation, and examination of differential impacts of a pandemic across URM subgroups. In keeping with the tenets of the open science model, the goal of the NCANDA and ABCD consortia is to foster an environment of open collaboration that will enhance trust in the research process for our participants and families.
Data Availability Statement
The datasets presented in this study can be found in online repositories. The names of the repository/repositories and accession number(s) can be found below: NCANDA.org.
Ethics Statement
The studies involving human participants were reviewed and approved by each of the site for NCANDA and ABCD. Written informed consent to participate in this study was provided by the participants’ legal guardian/next of kin.
Author Contributions
KN was the primary author. TC, SF, and TB contributed with writing, editing, and figures. ZA contributed with formatting, tables, and references. ST, SB, and LC contributed with overall conceptualization and substantial editing. All authors contributed to the article and approved the submitted version.
Funding
Reported data was obtained from the multisite National Consortium on Alcohol and Neurodevelopment in Adolescence (NCANDA) study, which is supported by the U.S. National Institute on Alcohol Abuse and Alcoholism with co-funding from the National Institute on Drug Abuse, the National Institute of Mental Health, and the National Institute of Child Health and Human Development grant numbers: AA021697 (Pfefferbaum and Pohl), AA021695 (Brown and Tapert), AA021692 (Tapert), AA021696 (Colrain and Baker), AA021681 (De Bellis), AA021690 (Clark), and AA021691 (Nagel). This manuscript was also supported by the multisite Adolescent Brain Cognitive Development (ABCD) study with: 1U01DA41148-01 (Fair, Feldstein Ewing, and Nagel) and 1U01DA5101601 (Cottler and Nixon).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
Auchter, A. M., Hernandez Mejia, M., Heyser, C. J., Shilling, P. D., Jernigan, T. L., Brown, S. A., et al. (2018). A description of the ABCD organizational structure and communication framework. Dev. Cogn. Neurosci. 32, 8–15. doi: 10.1016/j.dcn.2018.04.003
Bradley, N. L., DiPasquale, A. M., Dillabough, K., and Schneider, P. S. (2020). Health care practitioners’ responsibility to address intimate partner violence related to the COVID-19 pandemic. Can. Med. Assoc. J. 192, E609–E610. doi: 10.1503/cmaj.200634
Brock, R. L., and Laifer, L. M. (2020). Family science in the context of the COVID-19 pandemic: solutions and new directions. Fam. Process. doi: 10.1111/famp.12582 [Epub ahead of print].
Brooks, S. K., Webster, R. K., Smith, L. E., Woodland, L., Wessely, S., Greenberg, N., et al. (2020). The psychological impact of quarantine and how to reduce it: rapid review of the evidence. Lancet 395, 912–920.
Brown, S. A., Brumback, T., Tomlinson, K., Cummins, K., Thompson, W. K., Nagel, B. J., et al. (2015). The National Consortium on Alcohol and NeuroDevelopment in Adolescence (NCANDA): a multisite study of adolescent development and substance use. J. Stud. Alcohol Drugs 76, 895–908.
Brown, S. A., McGue, M., Maggs, J., Schulenberg, J., Hingson, R., Swartzwelder, S., et al. (2008). A developmental perspective on alcohol and youths 16 to 20 years of age. Pediatrics 121, S290–S310. doi: 10.1542/peds.2007-2243D
Cénat, J. M., Noorishad, P.-G., Blais-Rochette, C., McIntee, S.-E., Mukunzi, J. N., Darius, W. P., et al. (2020). Together for hope and resilience: a humanistic experience by the vulnerability, trauma, resilience and culture lab members during the COVID-19 pandemic. J. Loss Trauma 25, 1–6. doi: 10.1080/15325024.2020.1774704
Center for Disease Control and Prevention (2020a). COVID-19 Guidance: Businesses and Employers. Cent. Dis. Control Prev. Available online at: https://www.cdc.gov/coronavirus/2019-ncov/community/guidance-business-response.html (accessed December 3, 2020).
Center for Disease Control and Prevention. (2020b). COVIDView Weekly Summary. Cent. Dis. Control Prev. Available online at: https://www.cdc.gov/coronavirus/2019-ncov/covid-data/covidview/index.html (accessed December 3, 2020).
Cottler, L. B., Compton, W. M., Ben-Abdallah, A., Horne, M., and Claverie, D. (1996). Achieving a 96.6 percent follow-up rate in a longitudinal study of drug abusers. Drug Alcohol Depend. 41, 209–217.
Coughlin, S. S., Moore, J. X., George, V., Johnson, J. A., and Hobbs, J. (2020). COVID-19 among african americans: from preliminary epidemiological surveillance data to public health action. Am. J. Public Health 110, 1157–1159. doi: 10.2105/AJPH.2020.305764
Cummins, K. M., Brumback, T., Chung, T., Moore, R. C., Henthorn, T., Eberson, S., et al. (in press). Frequent continuous mobile assessment of health behaviors in a multi-year study: acceptability, validity, and engagement with mNCANDA. J. Med. Internet Res.
Dorn, A. V., Cooney, R. E., and Sabin, M. L. (2020). COVID-19 exacerbating inequalities in the US. Lancet 395, 1243–1244. doi: 10.1016/S0140-6736(20)30893-X
Dumas, T. M., Ellis, W., and Litt, D. M. (2020). What does adolescent substance use look like during the COVID-19 pandemic? Examining changes in frequency, social contexts, and pandemic-related predictors. J. Adolesc. Health 67, 354–361. doi: 10.1016/j.jadohealth.2020.06.018
Ejiogu, N., Norbeck, J. H., Mason, M. A., Cromwell, B. C., Zonderman, A. B., and Evans, M. K. (2011). Recruitment and retention strategies for minority or poor clinical research participants: lessons from the healthy aging in neighborhoods of diversity across the life span study. Gerontologist 51, S33–S45. doi: 10.1093/geront/gnr027
European Centre for Disease Prevention and Control (2020). Rapid Risk Assessment: Paediatric Inflammatory Multisystem Syndrome and SARS-CoV-2 Infection in Children. Available online at: https://www.ecdc.europa.eu/en/publications-data/paediatric-inflammatory-multisystem-syndrome-and-sars-cov-2-rapid-risk-assessment (accessed August 3, 2020).
Feldstein Ewing, S. W., Chang, L., Cottler, L. B., Tapert, S. F., Dowling, G. J., and Brown, S. A. (2018). Approaching retention within the ABCD study. Dev. Cogn. Neurosci. 32, 130–137. doi: 10.1016/j.dcn.2017.11.004
Ferdinand, K. C., and Nasser, S. A. (2020). African-American COVID-19 mortality. J. Am. Coll. Cardiol. 75, 2746–2748. doi: 10.1016/j.jacc.2020.04.040
Foster, S. (2020). Burnout: a continuing problem. Br. J. Nurs. 29, 721–721. doi: 10.12968/bjon.2020.29.12.721
Ghosh, R., Dubey, M. J., Chatterjee, S., and Dubey, S. (2020). Impact of COVID-19 on children: special focus on the psychosocial aspect. Minerva Pediatr. 72, 226–235.
Hoffman, E. A., Howlett, K. D., Breslin, F., and Dowling, G. J. (2018). Outreach and innovation: communication strategies for the ABCD Study. Dev. Cogn. Neurosci. 32, 138–142. doi: 10.1016/j.dcn.2018.04.001
Holmes, E. A., O’Connor, R. C., Perry, V. H., Tracey, I., Wessely, S., Arseneault, L., et al. (2020). Multidisciplinary research priorities for the COVID-19 pandemic: a call for action for mental health science. Lancet Psychiatry 7:e43.
Kim, M. M., Cheney, A., Black, A., Thorpe, R. J., Cene, C. W., Dave, G. J., et al. (2020). Trust in community-engaged research partnerships: a methodological overview of designing a multisite clinical and translational science awards (CTSA) initiative. Eval. Health Prof. 43, 180–192. doi: 10.1177/0163278718819719
Maggs, J. L. (2020). Adolescent life in the early days of the pandemic: less and more substance use. J. Adolesc. Health 67, 307–308. doi: 10.1016/j.jadohealth.2020.06.021
Mahammedi, A., Saba, L., Vagal, A., Leali, M., Rossi, A., Gaskill, M., et al. (2020). Imaging in neurological disease of hospitalized COVID-19 patients: an italian multicenter retrospective observational study. Radiology 297, E270–E273. doi: 10.1148/radiol.2020201933
Marler, W. (2018). Mobile phones and inequality: findings, trends, and future directions. New Media Soc. 20, 3498–3520. doi: 10.1177/1461444818765154
Millett, G. A., Jones, A. T., Benkeser, D., Baral, S., Mercer, L., Beyrer, C., et al. (2020). Assessing differential impacts of COVID-19 on black communities. Ann. Epidemiol. 47, 37–44. doi: 10.1016/j.annepidem.2020.05.003
Poulton, R., Moffitt, T. E., and Silva, P. A. (2015). The dunedin multidisciplinary health and development study: overview of the first 40 years, with an eye to the future. Soc. Psychiatry Psychiatr. Epidemiol. 50, 679–693.
Restauri, N., and Sheridan, A. D. (2020). Burnout and posttraumatic stress disorder in the Coronavirus Disease 2019 (COVID-19) Pandemic: intersection, impact, and interventions. J. Am. Coll. Radiol. 17, 921–926. doi: 10.1016/j.jacr.2020.05.021
Riphagen, S., Gomez, X., Gonzalez-Martinez, C., Wilkinson, N., and Theocharis, P. (2020). Hyperinflammatory shock in children during COVID-19 pandemic. Lancet 395, 1607–1608.
Robinson, K. A., Dennison, C. R., Wayman, D. M., Pronovost, P. J., and Needham, D. M. (2007). Systematic review identifies number of strategies important for retaining study participants. J. Clin. Epidemiol. 60, 757–765.
Sander, A. M., Lequerica, A. H., Ketchum, J. M., Hammond, F. M., Gary, K. W., Pappadis, M. R., et al. (2018). Race/ethnicity and retention in traumatic brain injury outcomes research: a traumatic brain injury model systems national database study. J. Head Trauma Rehabil. 33, 219–227. doi: 10.1097/HTR.0000000000000395
Sheth, C., McGlade, E., and Yurgelun-Todd, D. (2017). Chronic stress in adolescents and its neurobiological and psychopathological consequences: an RDoC perspective. Chronic Stress 1:247054701771564. doi: 10.1177/2470547017715645
Singh, S., Mitsch, A., and Wu, B. (2017). HIV care outcomes among men who have sex with men with diagnosed HIV infection – United States, 2015. MMWR Morb. Mortal. Wkly. Rep. 66, 969–974. doi: 10.15585/mmwr.mm6637a2
Steinberg, A., Griffin-Tomas, M., Abu-Odeh, D., and Whitten, A. (2018). Evaluation of a mobile phone app for providing adolescents with sexual and reproductive health information, New York City, 2013-2016. Public Health Rep. 133, 234–239. doi: 10.1177/0033354918769289
Striley, C. L. W., Callahan, C., and Cottler, L. B. (2008). Enrolling, retaining, and benefiting out-of-treatment drug users in intervention research. J. Empir. Res. Hum. Res. Ethics 3, 19–25. doi: 10.1525/jer.2008.3.3.19
Webb, F. J., Khubchandani, J., Striley, C. W., and Cottler, L. B. (2019). Black-white differences in willingness to participate and perceptions about health research: results from the population-based healthstreet study. J. Immigr. Minor. Health 21, 299–305.
Western, B., Braga, A., Hureau, D., and Sirois, C. (2016). Study retention as bias reduction in a hard-to-reach population. Proc. Natl. Acad. Sci. U.S.A. 113, 5477–5485. doi: 10.1073/pnas.1604138113
Wigginton, N. S., Cunningham, R. M., Katz, R. H., Lidstrom, M. E., Moler, K. A., Wirtz, D., et al. (2020). Moving academic research forward during COVID-19. Science 368, 1190–1192. doi: 10.1126/science.abc5599
Keywords: adolescent, young adult, longitudinal, neuroimaging, retention, pandemic, developmental
Citation: Nooner KB, Chung T, Feldstein Ewing SW, Brumback T, Arwood Z, Tapert SF, Brown SA and Cottler L (2021) Retaining Adolescent and Young Adult Participants in Research During a Pandemic: Best Practices From Two Large-Scale Developmental Neuroimaging Studies (NCANDA and ABCD). Front. Behav. Neurosci. 14:597902. doi: 10.3389/fnbeh.2020.597902
Received: 22 August 2020; Accepted: 21 December 2020;
Published: 18 January 2021.
Edited by:
Fabrizio Sanna, University of Cagliari, ItalyReviewed by:
Frauke Nees, Kiel University, GermanyAmanda Elton, University of North Carolina at Chapel Hill, United States
Marisa M. Silveri, McLean Hospital, United States
Copyright © 2021 Nooner, Chung, Feldstein Ewing, Brumback, Arwood, Tapert, Brown and Cottler. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Kate B. Nooner, bm9vbmVya0B1bmN3LmVkdQ==