Jaclyn M. Martindale1*
Victor M. Ringheanu2Kelly A. Pring2Sandra Norona3Kimberly Wiseman4
Roy E. Strowd1
Leah Chapman1
Joseph Rigdon5
Stephen R. Rapp6
Eric A. Storch7
Edward Ip5
Jonathan W. Mink8- 1Department of Neurology, Wake Forest University School of Medicine, Winston-Salem, NC, United States
- 2Wake Forest University School of Medicine, Winston-Salem, NC, United States
- 3Clinical and Translational Science Institute, Wake Forest University School of Medicine, Winston-Salem, NC, United States
- 4Department of Social Sciences and Health Policy, Wake Forest University School of Medicine, Winston-Salem, NC, United States
- 5Department of Biostatistics and Data Science, Wake Forest University School of Medicine, Winston-Salem, NC, United States
- 6Department of Psychiatry & Behavioral Medicine, Wake Forest University School of Medicine, Winston-Salem, NC, United States
- 7Menninger Department of Psychiatry and Behavioral Sciences, Baylor College of Medicine, Houston, TX, United States
- 8Department of Neurology, University of Rochester, Rochester, NY, United States
Introduction: Persistent Tic Disorders such as Tourette Syndrome are common neurodevelopmental disorders that are highly stigmatized. Many individuals with Persistent Tic Disorders experience peer rejection, loneliness, and self-stigma. Experiencing stigmatization during childhood can influence the persistence of moderate-to-severe tics later in life. Additionally, these factors have been associated with increased suicidal ideation, suicide attempts, and psychiatric symptom severity. There is a need for interventions to reduce stigma and stigmatization in Persistent Tic Disorders. Before developing cost-effective interventions to mitigate stigma’s profound downstream health impacts, a reliable measure of stigmatization must be created. The overarching goal of this research is to develop and validate the Tourette Discrimination-Stigmatization (TD-STIGMA) Scale.
Methods: This paper presents the study protocol for developing and validating the TD-STIGMA Scale. The study is designed as a mixed methods study to develop the TD-STIGMA scale and evaluate its psychometric properties. The study uses a phased approach: (1) collection of narrative and thematic content data through in-depth qualitative interviews of stakeholders, (2) development of a novel TD-STIGMA self-report scale using the Delphi Method based on these results, and (3) completion of analyses to determine the scale’s psychometric properties (confirmatory factor analysis, convergent, known-group, criterion validity, and test–retest reliability).
Discussion: This project will result in a personalized approach to stigma measurement about youth and young adults with Persistent Tic Disorders, which to date does not exist. There are several limitations. Comorbidities or spiritual or cultural beliefs may affect perceptions of stigma and are not directly assessed in this study. We will utilize institutional resources for community outreach to purposefully sample underrepresented minorities who may be at disproportionate risk of adverse outcomes. However, this may not be fully representative of the generalized tic population. The study team will be purposeful in maintaining participant engagement for study retention. Lastly, participants from a tertiary referral center may not fully represent the generalized tic community. However, we hope our broad recruitment strategy and virtual study visits will facilitate a diverse and inclusive sampling of the patient population.
1 Introduction
Persistent Tic Disorders (PTD), including Tourette Syndrome (TS), are developmental neurobiological disorders characterized by multiple motor and vocal tics present for at least 1 year. PTD affects 1.4 million US children, adolescents, and adults (Tinker et al., 2022). Neuropsychiatric conditions co-occur in 90% of individuals with PTD/TS. PTD/TS and its co-morbidities, including attention-deficit hyperactivity disorder (ADHD) (Comings and Comings, 1987), obsessive-compulsive disorder (OCD) (Hirschtritt et al., 2015), and anxiety (Martino et al., 2017), impact how individuals interact with others and their environment at home, school, work, and in social activities.
Individuals with PTD/TS (ITS) experience many stressors related to their diagnosis, which can contribute to poor mental, physical, and functional outcomes. The lack of general knowledge and inaccurate beliefs of TS promotes an environment where ITS are often misunderstood (Lee et al., 2016, 2019; Ludlow et al., 2016, 2022; Ben-Ezra et al., 2017; Edwards et al., 2017; Lemelson and Tucker, 2017; Malli and Forrester-Jones, 2017, 2022; O'Hare et al., 2017; Schneider et al., 2018; Lee and Park, 2019; Fernández de la Cruz et al., 2021; Rodin et al., 2021; Stofleth and Parks, 2022; Stacy et al., 2023). Some ITS resort to suppressing their tics, concealing their diagnosis, or avoiding situations to prevent unwanted attention. Motivating factors for these behaviors include maintaining social normalcy and peer acceptance (O'Hare et al., 2015; Lee et al., 2016, 2019; Malli et al., 2019; Soós et al., 2022). Unfortunately, many ITS experience peer rejection (Lee et al., 2016, 2019, 2020; Lemelson and Tucker, 2017; O'Hare et al., 2017; Malli et al., 2019; Rodin et al., 2021; Stiede et al., 2021; Soós et al., 2022; Stofleth and Parks, 2022), the act of being labeled by others or stigmatization (O'Hare et al., 2015, 2016; Lee et al., 2016, 2019, 2020; Wadman et al., 2016; Edwards et al., 2017; Lemelson and Tucker, 2017; Jackson et al., 2019; Malli et al., 2019; Charania et al., 2022; Iyanda, 2022; Malli and Forrester-Jones, 2022; Mataix-Cols et al., 2022; Soós et al., 2022; Stofleth and Parks, 2022; Vermilion et al., 2022), loneliness (Lee et al., 2016, 2019; O'Hare et al., 2017; Malli et al., 2019; Rodin et al., 2021), and internalizing the negative stereotypes or self-stigma (Eaton et al., 2016; Hanks et al., 2016; Liu et al., 2017; Silvestri et al., 2017; Lee et al., 2019, 2022; Malli et al., 2019; Malli and Forrester-Jones, 2022). These experiences can influence the persistence of moderate-to-severe tics (Groth, 2018) and tic severity (Shiu et al., 2023). Additionally, while already higher risk than the general population (Comings and Comings, 1987; Cheung et al., 2007; Hirschtritt et al., 2015; Storch et al., 2015; Johnco et al., 2016; Martino et al., 2017; America TAO, 2022), studies show distress in ITS increases the risk of suicidal ideation (Van Orden et al., 2010; Yanos et al., 2010), suicide attempts (Fernández de la Cruz et al., 2017), psychiatric symptom severity (Johnco et al., 2016), and leads to poorer overall health (Fernández de la Cruz and Mataix-Cols, 2020).
Although research in this critical area is increasing, little is understood about why PTD/TS stigmatization persists despite decades of patient advocacy (Andersen, 1986; America TAO, 2022). Additionally, evidence-based interventions to reduce stigmatization and promote well-being in PTD/TS are lacking. However, a reliable measure of stigmatization must be created before developing cost-effective interventions to mitigate stigma’s profound downstream health impacts.
1.1 The social-ecological model of stigma and stigmatization
Stigmatization refers to labeling or linking to undesirable features, which creates beliefs that a person is fundamentally different (Andersen, 1986; Link and Phelan, 2001). Justifications are constructed for these stigmatizing actions toward others (Link and Phelan, 2001). Stigmatization can range from microaggressions, biases, and purposeful exclusion, while discrimination (also called enacted or experienced stigmatization) (Fernandes et al., 2011; Brohan et al., 2013) can be overt. The National Alliance on Mental Illness argues that the scope of stigmatization needs to encompass discrimination to adequately represent the negative impact of stereotypes these individuals experience (Sue Abderholden, 2019). Otherwise, it is easy to overlook the more distal behavioral effects when assessing the impact of stigma (Link and Phelan, 2001).
However, stigmatization depends on social-ecological factors that create and perpetuate the labeling of stigma in the first place (Link and Phelan, 2001). The social-ecological model (SEM) has been used to model stigmatization in several other healthcare populations (Parker and Aggleton, 2003; Baral et al., 2013; White Hughto et al., 2015; Stangl et al., 2019). A SEM-based approach (Figure 1) derived from prior medical models of stigma (Parker and Aggleton, 2003; Baral et al., 2013; White Hughto et al., 2015; Stangl et al., 2019; Michaels, 2022) can help delineate factors contributing to stigmatization in PTD/TS. According to Link and Phelan’s theory, interventions that only target one mechanism leave the broader context untouched and are likely to fail (Link and Phelan, 2001). This is especially important in the context of interventions geared to prevent stigmatization. The SEM-based approach guides the development of a disorder-specific, comprehensive, relevant framework (Link and Phelan, 2001; White Hughto et al., 2015; Stangl et al., 2019). Globally, programs have been developed to diminish mental health-related stigmatization. However, stigma-related research remains limited by a lack of direct stigma measurements, limited validated youth measures (McKeague et al., 2015; Kaushik et al., 2017), proxy reports (Conelea et al., 2011), and non-validated questionnaires (Debes et al., 2010).
Figure 1. Social-ecological model of stigmatization in Tourette Syndrome.
1.2 The necessity of a TS-specific measure
To face hardships, ITS requires resilience by harnessing resources to sustain well-being. The National Institute of Health (NIH) announced well-being as a 2023 funding priority (Mroczek et al., 2015), recognizing the potential impact of interventions focusing on well-being to improve health outcomes (Mroczek et al., 2015; Pressman et al., 2019; Villanueva et al., 2021). The NIH established a cohesive framework for well-being, defining emotional well-being as “how positive an individual feels generally and about life overall. It includes experiential features (emotional quality of experiences) and reflective features (life satisfaction, meaning, and self-efficacy) within the context of culture, life circumstances, resources, and life course” (Park et al., 2023). Existing interventions promoting well-being have shown sustained improvements in well-being and quality of life in cancer, type 1 diabetes, depression, and HIV/AIDS (Storch et al., 2012; McGuire et al., 2015; Cheung et al., 2018; Addington et al., 2019; Salsman et al., 2020; Leuchter et al., 2023; Moskowitz et al., 2023; Salsman et al., 2023). ITS need the opportunity to benefit from targeted, supportive interventions to enhance their well-being and resilience.
While evidence-based treatments exist, these focus on tic reduction and management. Barriers, including geography, availability, and the financial burden, make these treatments impractical or inaccessible for many (Pring et al., 2023). Stigma, motivation, and fear of making tics worse impact participation and success of treatment. Two pilot interventions incorporated positive coping strategies into their programs with preliminary reductions in tic-related impairment and improved quality of life (Storch et al., 2012; McGuire et al., 2015; Heijerman-Holtgrefe et al., 2021, 2022; BT-Coach, 2017). However, coping skills were not the primary intervention focus. Although these interventions reduced symptoms and impairment, the absence of impairment does not equate to well-being (Anderson, 1995; Constitution of the World Health Organization, 2005). It is critical to develop interventions that allow ITS to thrive despite their symptoms and foster their well-being.
When considering the theoretical framework for a PTD/TS-specific intervention that helps reduce psychological distress and promote well-being, stigmatization plays an integral role. However, there is no standard way to measure stigmatization in ITS. We postulate when ITS are stigmatized, they come to see their identity as threatened and unmanageable, which in turn adversely affects their subsequent mental, physical, and functioning. Malli reported when PTD/TS is perceived as self-defining, individuals express more disadvantages, anger, self-stigma, grieving the loss of their old self, and a deprived sense of normalcy (Malli et al., 2019; Malli and Forrester-Jones, 2022). Conversely, if they see their identity as protected and manageable in this framework, their outcomes will be better. As such, some adults believed PTD/TS provided the opportunity for self-development and search for greater meaning, allowing emotional strength and personal growth (Lee et al., 2016, 2019; Malli et al., 2019).
This conceptual framework is informed by the Transactional Model of Stress and Coping (Folkman, 1984) and Identity Threat Models of Stigma (Crocker et al., 1998; Berjot and Gillet, 2011), where stigmatized disorders, such as PTD/TS, include a primary appraisal of social or personal identity as individuals react distinctly different to identity-appraising and non-identity appraising situations. The secondary appraisal occurs when the ITS assess if they have the resources to cope with the situation.
If ITS have the resources to sustain well-being (resilience) in the face of adversity, does that change mental, physical, and functional outcomes? Antecedents such as social determinants of health, cultural and societal stereotypes, social support, and social resources are not directly modifiable without broad-scale interventions (Folkman, 1984; Berjot and Gillet, 2011). However, modifiable factors include how (digital, individual) and what (coping, stigma sensitivity) resources are developed and delivered. Additionally, intervening at either at the identity-appraisal or resource-appraisal stage can both be effective (Liu et al., 2021), but these are age- and context-sensitive (Panter-Brick and Leckman, 2013). The early challenges ITS experience can alter brain structure and function (McEwen, 2007; Karatsoreos and McEwen, 2011; Karatsoreos and McEwen, 2013) through epigenetic changes resulting in long-term consequences, including impacting their mental health outcomes (Green et al., 2010; Kessler et al., 2010). This overall process, biological embedding (Hanson and Gluckman, 2008; Shonkoff et al., 2009; Hertzman and Boyce, 2010), is most influential during periods of brain development such as early childhood and adolescence (Karatsoreos and McEwen, 2013) when tics are also beginning and peaking (Leckman et al., 1998; Freeman et al., 2000; Hirschtritt et al., 2015). Targeting interventions during these periods will have the greatest impact (Yousafzai et al., 2013).
Intervention development relies on the ability to test the conceptual framework and reliably measure stigma. Therefore, having a PTD/TS-specific measure is necessary. Existing measures have not been widely used nor studied in the youth population (Stuart, 2005; Kanter et al., 2008) nor address the full spectrum of PTD/TS-relevant stigmatization (Cella et al., 2012; Lai et al., 2012; McKeague et al., 2015; Kaushik et al., 2017). The overarching goal of this research is to develop and validate a PTD/TS-specific stigma measure, the Tourette Discrimination-Stigmatization Scale (TD-STIGMA), so we can test our conceptual framework for a wellbeing intervention in PTD/TS. This paper presents the study protocol for developing and validating the TD-STIGMA. The aims of this study are: (1) engaging with PTD/TS stakeholders to identify perceived stigmatization, experienced discrimination, and the need for targeted interventions in youth and young adults with PTD/TS, (2) to develop a clinical measure of stigmatization and discrimination using stakeholder input, and (3) to evaluate psychometric properties of the TD-STIGMA scale. The proposed research aims will inform the future development of a working clinical model and behavioral intervention that improves downstream mental, physical, and functional outcomes in ITS.
2 Methods
2.1 Setting
This study occurs at Wake Forest University School of Medicine (WFUSM), a tertiary facility in Winston-Salem, North Carolina. WFUSM serves as the academic core of Advocate Health, the nation’s fifth-largest nonprofit integrated health system in the United States. The southeast region has over 2,500 eligible English-speaking patients between 8 and 30 years old with diagnoses of PTD/TS. The southeast regional catchment area includes North Carolina, South Carolina, Virginia, Tennessee, and West Virginia. This study is registered under Clinicaltrials.gov NCT05696769 and the Open Science Framework https://doi.org/10.17605/OSF.IO/EX52G.
2.2 Participants
This study focuses on three specific cohorts: (1) youth and young adults with PTD/TS, (2) supporters, which include parents, caregivers, partners, or significant others, and (3) medical providers and advocates. Inclusion criteria for the ITS include a physician or neuropsychologist-confirmed diagnosis of PTD/TS based on the Diagnostic and Statistical Manual for Mental Disorders – Fifth Edition (DSM-V), English speaking, and between the ages of 8–30 years old. Exclusion criteria include a diagnosis of intellectual disability, active psychosis, or any other condition that, in the Principal Investigator’s opinion, would limit the participant’s (or parent’s) ability to understand study measures. Inclusion criteria for the supporter cohort include caring or having a relationship for/with a youth and young adults with PTD/TS for at least 1 year and being English-speaking. Inclusion criteria for the medical providers and advocates cohort include caring for a youth and young adults with PTD/TS and speaking English.
2.3 Overall study design
The study is designed as an exploratory sequential mixed methods study to develop the TD-STIGMA scale and evaluate its psychometric properties. The study uses a phased approach: (1) collection of narrative and thematic content data through in-depth qualitative interviews of PTD/TS stakeholders, (2) development of a novel TD-STIGMA self-report scale using the Delphi Method based on these results, and (3) completion of analyses to determine the scale’s psychometric properties (confirmatory factor analysis, convergent, known-group, criterion validity, and test–retest reliability). We report how we determined our sample size, all data exclusions, all manipulations, and all measures in the study.
2.3.1 Recruitment
Eligible patients in the southeast region of our healthcare enterprise will be identified through the Translational Data Warehouse (TDW). The TDW aggregates data from the electronic health record and other clinical systems for research purposes. The TDW includes information on more than 6.6 million unique patients and over 270 million encounters. The southeast region encompasses five states: North Carolina, South Carolina, Virginia, Tennessee, and West Virginia. The southeast region has over 2,500 eligible English-speaking patients between 8 and 30 years old with diagnoses of PTD/TS. Demographic data shows 73% are male, 27% are female, 83% are White, 9% are Black, and 8% are other URM (American Indian, Alaskan Native, Asian, Other Pacific Islander, and Latin American or Hispanic). Black and Latino have half the rate of TS compared to White individuals (Blumberg et al., 2007) yet increased risk for marginalization and poorer outcomes (Luthar, 1991; Brooks, 2006; Masten, 2011).
Participants will be recruited through normal patient flow at Atrium Health Wake Forest Baptist specialty clinics, referral networks, direct mailers, and regional TS chapters. Additional participant identification and recruitment will occur through the Be Involved network, a community-facing website that helps patients, community members, and healthy volunteers to find study opportunities in the region. We will partner with Maya Angelou Center for Health Equity (MACHE) Integrating Special Populations Program of the Wake Forest Clinical and Translational Science Institute (CTSI) to facilitate purposeful enrollment and retention of those are at disproportionate risk of adverse outcomes.
2.3.2 Sample size
Sample sizes in qualitative studies are guided by whether there will be sufficient information power based on five study dimensions including specific aims, sample specificity, use of established theory, quality of dialogue, and analysis strategy. While the scope of our study is broad, enrollment of the target population, strong communication, theoretical framework, and analytical strategy guides our sample size enrollment projections for the qualitative interviews. Based on this information power model (Malterud et al., 2016) the goal for semi-structured interviews is 20 individuals with PTD/TS (ages 8–17, n = 10; ages 18–30, n = 10), five supporters, and ten providers/advocates. We will attempt to reach data saturation in the PTD/TS interview groups based on the expected sex distribution of PTD, 4:1 M:F (Leckman et al., 1998; Freeman et al., 2000; Garris and Quigg, 2021). These estimates allow a large enough sample to gather new and rich information but still small enough to gather detailed data (Sandelowski, 1995). If valuable information is still being identified after 80% of interviews, we will consider adding participants (Lincoln and Guba, 1985; Malterud et al., 2016) until nothing new is learned (Saunders et al., 2018). Given the relative rarity of PTD/TS and that the domains in confirmatory factor analysis have been identified in prior literature (Ritsher et al., 2003; Cella et al., 2012; Lai et al., 2012), for determining the psychometric properties of the TD-STIGMA, 100 individuals with PTD/TS (ages 8–17, n = 50; ages 18–30, n = 50) will be enrolled.
2.3.3 Development of the demographic domains
Demographic questions have been compiled from several validated scales relevant to this study, including the National Survey of Children’s Health (NSCH) (National Survey of Children’s Health, 2021), the Center for Disease Control (CDC) Youth Risk Behavior Surveillance System (YRBSS) (Youth Risk Behavior Surveillance System, 2019), and the CDC National Health Interview Survey (NHIS) (Control CfD, 2022). Survey questions were not modified to be able to compare our sample to the national data sets. Demographic questions were chosen to align with the domains in the interview guides. These will be completed in REDCap (Research Electronic Data Capture) before the qualitative interview. All project materials can be accessed at https://doi.org/10.17605/OSF.IO/AN5T3.
2.3.4 Development of exploratory questionnaire
An initial set of 44–47 stigma questionnaire items was developed using domains of interest, clinical expertise, and gaps in the literature and modeled from validated stigma scales. The Questionnaire on Anticipated Discrimination (QUAD) (Gabbidon et al., 2013), Discrimination and Stigma Scale (DISC) (Bakolis et al., 2019), PaedS (Kaushik et al., 2017), PMHSS (McKeague et al., 2015), and specific questions of the Internalized Stigma of Mental Illness (ISMI) (Ritsher et al., 2003) were used as models for stigma questions. Items were created to include perceived and experienced stigmatization of the individual with PTD/TS at each level of the SEM: individual, interpersonal, community, and structural. Examples of selected questions are provided in Table 1.
Table 1. Selected examples from exploratory questionnaire TD-STIGMA questions – youth and young adults.
The exploratory questionnaire covers several domains, including experienced and perceived stigmatization at each SEM level, positive psychosocial factors (In what ways do having tics make you stronger? What has been most helpful for you in coping with your tics?), contributing or confounding stigmatization risk factors (gender identity, sexual identity for adults, sociodemographic variables), and intervention priorities (What do you feel would be most helpful in addressing some of the challenges you have mentioned?)
There are eight sections on the exploratory questionnaire including how tics make people feel, experiences at school, relationships with others, experiences at jobs, experiences with medical care, in public or at home, and priorities for interventions. The questions are adapted to the age appropriateness and type of the participant. This resulted in four versions of the exploratory questionnaire: (1) youth (8–17 years), (2) young adult version (18–30 years), (3) supporters (parents, caregivers, partners), and (4) medical providers or advocates. Several study members reviewed and revised the questionnaires for flow, content, and length. There are 24–30 items developed referencing PTD/TS, depending on the version, and four items about the survey experience.
2.3.5 Eligibility visit
For individuals with PTD/TS who are interested in the study, eligibility visits will be scheduled in person or via secure video with the study physician or neuropsychologist to confirm eligibility. If eligible, the Yale Global Tic Severity Scale (YGTSS) with tic inventory will also be completed (Storch et al., 2005).
2.3.6 Qualitative interviews
The qualitative interviews will be conducted individually with the study team and members of the Qualitative and Patient-Reported Outcomes (Q-PRO) Shared Resource. All interviews will be conducted via in-person or secure video. Interviews will be recorded to allow audio transcription for qualitative analysis. As mentioned previously, the exploratory questionnaire serves as the interview guide with questions adapted for age appropriateness and participant type. Topics covered include how tics make people feel, experiences at school, relationships with others, experiences at jobs, experiences with medical care, in public, or at home, and priorities for interventions.
Youth will be given time to answer sensitive questions confidentially. Youth will be asked about gender identity (for 12 and up), home environment, bullying, self-harm, risky behaviors, and their personal experiences. These answers will be confidential unless there is a concern that the there is a safety risk to themselves or others. At the end of the interview, participants will provide feedback regarding ease of completion, content, and completion time. Interviews are estimated to take 60–90 min to complete. Breaks will be provided as needed, and participants will be compensated for their time.
2.3.7 Qualitative analysis
Qualitative analysis will include transcribing verbatim and de-identifying all audio-recorded interviews in ATLAS.ti software. The study team will analyze the interviews using thematic content analysis practices (Green and Thorogood, 2018) to identify emerging themes and subthemes. Two study team members will develop a draft codebook including inductive and deductive codes, which will be reviewed and edited by the study team accordingly. Two study team members will then independently code the transcripts, meet regularly to discuss, and resolve discrepancies and reach a consensus. As needed, the PI (Principal Investigator) will serve as a third coder for unresolved discrepancies. Reports will be run for each code, and data will be reviewed within single codes or combination of codes to identify patterns and themes with the assistance of Q-PRO.
2.3.8 Feedback process
A total of 10 participants from Aim 1 will be invited to be the expert panel (two individuals with PTD/TS ages 8–17 years, two individuals with PTD/TS ages 18–30 years, two caregivers, two medical providers, and two advocates). A summary of the feedback process can be seen in Figure 2. We will use a holistic review to ensure diverse representation among the panelists. The main selection criteria will be the diversity of the panel member’s background or specialty, practice setting if applicable, geographic representation, minority representation, and absence of conflicts of interest. Panelists will complete the Delphi method through REDCap to maintain anonymity, minimize group conformity, and increase panelist comfort in providing their opinions.
Figure 2. TD-STIGMA feedback process.
A concise list of indications and definitions will be provided to begin the Delphi method. A de-identified, alphabetized summary document of thematic content and narrative content analysis from Aim 1 will be securely emailed by blind-copying the panel to maintain anonymity and minimize bias. An initial indication matrix will be created from the exploratory questionnaire and proposed response options based on the Rand UCLA Appropriateness Method (Fitch, 2001). The panel will rate items on a Likert scale of 1–9 (1 = extremely inappropriate, 5 = uncertain, 9 = extremely appropriate). Each item will be rated separately for ages 8–17 and 18–30. The panel will also be asked to rate the proposed recall period and instructions.
During the first round of ratings, panelists will rate each item as described above and can provide open-ended survey responses on each question. Statistical analysis will synthesize the responses and content analysis of the open-ended responses will be conducted to identify any additional relevant information. The Rand UCLA criteria for agreement will be used. Disagreement is indicated by at least three panelists rating the indication in each extreme of the 9-point Likert scale.
During additional rounds, the panel will be provided with their responses, the frequency of the panel responses, and the panels’ anonymous comments. The individual rater will re-rate each item. We anticipate three rounds; however, additional closing criteria include achieving agreement and stability of responses for two rounds (Sekayi and Kennedy, 2017). The outcome of this process will be a close-ended TD-STIGMA scale. The Flesch Reading Ease (Flesch, 1948) score and Flesch–Kincaid Grade (Thomas et al., 1975) level will be used to assess questionnaire readability. We will aim for a fourth-grade reading level.
After the exploratory questionnaire item pool has been developed, the selection of items for quantitative analysis will follow an iterative process of expert and stakeholder reviews based on the Delphi Method. The comprehensive review of the items aims to establish face and content validities of the scale. We expect to eventually include 20 items for each version (young adult and youth) in the finalized questionnaire on N = 100 participants (N = 50 young adult and N = 50 youth).
2.3.9 Second interviews
The same recruitment methods will be used for the second interview. Participants with PTD/TS who participated in Interview 1 will be invited to participate again. Interviews will be scheduled in person or by secure video to complete the clinician administered YGTSS and inventory. The remainder of the study visit includes self-report and parent-proxy companion measures entered REDCap. The companion measures will be included to establish the psychometric properties of the TD-STIGMA scale. Participants will be compensated for their time.
2.3.9.1 Companion measures
The clinician-rated (YGTSS) is the gold-standard measure of tic severity. It is a clinician-administered, semi-structured inventory that measures tic severity and impairment over the past week. Motor and vocal tics are rated separately for their number, frequency, intensity, complexity, and interference on a 0–5 Likert scale. The total is summed to reflect motor tic severity (0–25), phonic tic severity (0–25), or combined tic severity (0–50). A single question rates tic-related impairment (0–50). The YGTSS displays excellent internal consistency, reliability, and convergent and divergent validity (Storch et al., 2005).
Quality of Life in Neurological Disorders (Neuro-QoL™) (Perez et al., 2007; Cella et al., 2011) instruments were developed through a collaborative, multi-site research initiative sponsored by the National Institute for Neurological Disorders and Stroke to construct psychometrically sound and clinically relevant health-related QoL measurement tools for individuals with neurological conditions. Through Neuro-QoL, the pediatric (Lai et al., 2012) and adult (Cella et al., 2012) stigma question bank is utilized. These are brief, reliable, valid, and standardized QOL assessments applicable across neurologic conditions. The adult bank has 24 questions for self-report, and pediatric (Lee et al., 2016, 2019; Ludlow et al., 2016, 2022; Lemelson and Tucker, 2017; Malli and Forrester-Jones, 2017, 2022; O'Hare et al., 2017; Lee and Park, 2019; Rodin et al., 2021) has 18 questions for self or parent report.
The Internalized Stigma of Mental Illness Inventory (ISMI) includes 29 items with five subscales assessing alienation, stereotype endorsement, discrimination experience, social withdrawal, and stigma resistance. Data analysis showed high internal consistency, test–retest reliability, and construct validity (Ritsher et al., 2003) as there are no validated discrimination measures in youth; adapted versions interchanging the word “mental illness” with persistent tic disorders are utilized for adult self-report and parent proxy reports. While changing the terminology and the age of use poses concerns for validity, in this study, we will gather proof of principle and preliminary data in preparation for future larger projects.
2.4 Scale development method
Descriptive statistics will be used to examine TD-STIGMA item-level scores for detecting ceiling/floor effects, outliers, normality, and other problematic distributional characteristics. Such initial screening of the items may result in removing items that do not perform well (e.g., strong ceiling effect).
Following guidelines from the modified Consensus-based Standards for selecting health Measurement Instruments (Prinsen et al., 2018), we plan to evaluate the scale’s psychometric properties along several aspects of validity. The assessment of face and content validities is described in the section Feedback Process. Confirmatory factor analysis (CFA) will also assess the structural validity for the hypothesized domains-- structural, community, interpersonal, and individual levels of stigma and discrimination (Figure 1). We do acknowledge the smaller sample size. However, given the relatively rare disease and that the domains in CFA have been identified in prior literature we felt it was appropriate. A fifth protective domain will include protective measures against stigma and discrimination. Missing values for the CFA will be treated as missing-at-random, and the full information maximum likelihood method, in which only those variables observed for a case would enter the estimation procedure, will be used to maximize efficiency. We will use multiple commonly accepted goodness-of-fit indexes to evaluate if the a priori-determined factor structure is valid (Hu and Bentler, 1999). We also plan to conduct a bifactor analysis (Gibbons and Hedeker, 1992). Because most of the items in TD-STIGMA will be adapted from validated instruments, we expect only minor adjustments (e.g., item removal) will be needed to establish the structural validity for the domains in TD-STIGMA. The subscale score will be formed from the sum score of the items under the subscale, and the unweighted sum of subscales will form the overall score.
We expect missing values to be minimal. If the proportion of missing items exceeds 50%, the participant will not receive a score and will be excluded from all analyses. Internal consistency will be evaluated using Cronbach’s alpha at the item and the subscale/scale level. The intraclass correlation will assess test–retest reliability by retesting a subset of clinically stable participants (n = 20) 2 weeks after test administration. We expect the test–retest intraclass correlation coefficient to be above 0.70 (Paiva et al., 2014). Items may be removed if that criterion is not achieved. Both convergent validity and known-group validity will be evaluated. Convergent validity will be evaluated by assessing the correlation coefficients between the subscale/scale of TD-STIGMA and the companion measures. We plan to use the criterion based on the ISMI for assessing criterion validity. We will use a cutoff of 2.5 on the ISMI scale (Ritsher et al., 2003; Boyd et al., 2014; Bengochea-Seco et al., 2018), of which the total score range is 0 to 4, 4 being the worst, to indicate the presence of stigma. We will compare the means of TD-STIGMA of the stigma and the non-stigma groups using a t-test. We hypothesize that TD-STIGMA is higher in the stigma group identified by ISMI. The analyses will use the SAS 9.3 statistical software and Mplus v8.
2.5 Safety protocol
There may be discomfort in discussing some of the information, or it may be difficult for caregivers to hear. If a participant becomes distressed or triggers a reportable event, the study team will follow the outlined procedures as appropriate. Reportable events include positive suicidal ideation, suicidal attempt, self-harming behaviors, or another mandated event.
2.6 Confidentiality, privacy, and data management
All appropriate measures will be taken to ensure confidentiality including restricted access to secure study files, de-identified transcripts, and using unique study identifiers. We will not reuse the recordings. The audio or video will be uploaded into a secure study folder. Data for this initiative will be entered into a REDCap database. Following data collection, the subject identifying information is destroyed 6 years after the closure of the study, consistent with data validation and study design, producing an anonymous analytical data set. No reference to any individual participant will appear in reports, presentations, or publications that may arise from the study.
3 Discussion
There are several limitations. Perceptions of stigma may be influenced by comorbidities and spiritual or cultural beliefs. As part of a larger study, we will systematically assess participant’s anxiety, depression, and positive affect. To ensure a narrow scope, feasible study, and limited survey burden, self-reported diagnoses of all co-occurring conditions will be reported and will be more systematically explored in future studies. We will utilize MAHCE for community outreach to purposefully sample marginalized participants who may be at disproportioned risk of adverse outcomes. However, this may not be fully representative of the generalized population. These will be considered in future work with larger samples. Secondly, for most participants enrolled in qualitative interviews, there is a gap in study participation. The study team will work with MACHE to develop a strategy for maintaining participant engagement to maintain study retention. A study website and newsletter may be helpful in keeping participants up to date on the study’s progress. Lastly, participants from a tertiary referral center may not fully represent the generalized PTD. However, we hope our broad recruitment strategy and virtual study visits will facilitate a diverse and inclusive sampling of the patient population.
4 Conclusion
This project will result in a personalized approach to stigma measurement about youth and young adults with TS, which to date does not exist. We envision that such a measure will have implications for assessment and treatment. Quantifying stigma at the start of treatment will help understand potential clinical barriers in the environment, which may be targets of behavioral interventions. Particularly addressing the need to promote well-being in ITS and, in turn, improve downstream mental, physical, and functioning. Additionally, evaluating the broader impact of stigma may help advocate for increased allocation of funding for resources, research, and education to mitigate stigmatization.
Ethics statement
The studies involving humans were approved by Wake Forest University Health Sciences Institutional Review Board. The studies were conducted in accordance with the local legislation and institutional requirements. Written informed consent for participation in this study was provided by the participants' legal guardians/next of kin.
Author contributions
JMM: Conceptualization, Funding acquisition, Investigation, Methodology, Project administration, Resources, Writing – original draft, Writing – review & editing. VR: Investigation, Project administration, Writing – original draft, Writing – review & editing. KP: Investigation, Writing – original draft, Writing – review & editing. SN: Project administration, Resources, Supervision, Writing – review & editing. KW: Conceptualization, Investigation, Project administration, Supervision, Writing – original draft, Writing – review & editing. RS: Methodology, Resources, Supervision, Writing – review & editing. LC: Investigation, Methodology, Resources, Writing – review & editing. JR: Conceptualization, Investigation, Methodology, Resources, Supervision, Writing – original draft, Writing – review & editing. SR: Conceptualization, Methodology, Resources, Supervision, Writing – review & editing. ES: Conceptualization, Resources, Supervision, Writing – review & editing. EI: Conceptualization, Formal analysis, Methodology, Resources, Supervision, Writing – original draft, Writing – review & editing. JWM: Conceptualization, Methodology, Resources, Supervision, Writing – review & editing.
Funding
The author(s) declare that financial support was received for the research, authorship, and/or publication of this article. This work was supported by the Tourette Association of America.
Acknowledgments
We would like to thank the Tourette Association of America for supporting this work.
Conflict of interest
JMM receives research support from the Tourette Association of America and the American Board of Psychiatry and Neurology. ES receives research funding to his institution from the Ream Foundation, International OCD Foundation, and NIH. He is a consultant for Brainsway and Biohaven Pharmaceuticals. He owns stock of less than $ 5,000 in NView. He receives book royalties from Elsevier, Wiley, Oxford, American Psychological Association, Guildford, Springer, Routledge, and Jessica Kingsley. KW conducts research supported in part by the Qualitative and Patient-Reported Outcomes Shared Resource of the Atrium Health Wake Forest Baptist Comprehensive Cancer Center’s NCI (National Cancer Institute) Cancer Center Support Grant P30CA012197. RS serves as a consultant for Monteris Medical and Novocure. He receives an editorial stipend from the American Academy of Neurology. He has received research/grant support from the American Academy of Neurology, the American Society for Clinical Oncology, the Southeastern Brain Tumor Foundation, Jazz Pharmaceuticals, and the International Association for Medical Science Educators. He has served as a paid lecturer for Lecturio and Kaplan. He has received book royalties from Elsevier. JWM serves as a Central Adjudicator for Emalex, a DSMB member for PTC, and a consultant for TEVA, Applied Therapeutics, Sumitomo, and Theranexus. He has received research funding from Neurogene and Amicus.
The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
Addington, E. L., Cheung, E. O., Bassett, S. M., Kwok, I., Schuette, S. A., Shiu, E., et al. (2019). The MARIGOLD study: feasibility and enhancement of an online intervention to improve emotion regulation in people with elevated depressive symptoms. J. Affect. Disord. 257, 352–364. doi: 10.1016/j.jad.2019.07.049
Andersen, S. M. (1986). Book review: reacting to stigmatizing conditions: Social blemishes in interpersonal relations 4, 114–122. doi: 10.1521/jscp.1986.4.1.114
Anderson, R. M. (1995). Patient empowerment and the traditional medical model: a case of irreconcilable differences? Diabetes Care 18, 412–415. doi: 10.2337/diacare.18.3.412
Bakolis, I., Thornicroft, G., Vitoratou, S., Rusch, N., Bonetto, C., Lasalvia, A., et al. (2019). Development and validation of the DISCUS scale: a reliable short measure for assessing experienced discrimination in people with mental health problems on a global level. Schizophr. Res. 212, 213–220. doi: 10.1016/j.schres.2019.07.018
Baral, S., Logie, C. H., Grosso, A., Wirtz, A. L., and Beyrer, C. (2013). Modified social ecological model: a tool to guide the assessment of the risks and risk contexts of HIV epidemics. BMC Public Health 13:482. doi: 10.1186/1471-2458-13-482
Ben-Ezra, M., Anavi-Goffer, S., Arditi, E., Ron, P., Atia, R. P., Rate, Y., et al. (2017). Revisiting stigma: exposure to Tourette in an ordinary setting increases stigmatization. Psychiatry Res. 248, 95–97. doi: 10.1016/j.psychres.2016.11.040
Bengochea-Seco, R., Arrieta-Rodríguez, M., Fernández-Modamio, M., Santacoloma-Cabero, I., Gómez de Tojeiro-Roce, J., García-Polavieja, B., et al. (2018). Adaptation into Spanish of the internalised stigma of mental illness scale to assess personal stigma. Rev Psiquiatr Salud Ment (Engl Ed) 11, 244–254. doi: 10.1016/j.rpsm.2016.01.007
Berjot, S., and Gillet, N. (2011). Stress and coping with discrimination and stigmatization. Front. Psychol. 2:33. doi: 10.3389/fpsyg.2011.00033
Blumberg, S. J., Foster, E. B., Frasier, A. M., Satorius, J., Skalland, B. J., Nysse-Carris, K. L., et al. (2007). Design and operation of the National Survey of Children's Health. Vital Health Stat 2012, 1–149.
Boyd, J. E., Adler, E. P., Otilingam, P. G., and Peters, T. (2014). Internalized stigma of mental illness (ISMI) scale: a multinational review. Compr. Psychiatry 55, 221–231. doi: 10.1016/j.comppsych.2013.06.005
Brohan, E., Clement, S., Rose, D., Sartorius, N., Slade, M., and Thornicroft, G. (2013). Development and psychometric evaluation of the discrimination and stigma scale (DISC). Psychiatry Res. 208, 33–40. doi: 10.1016/j.psychres.2013.03.007
Brooks, J. E. (2006). Strengthening resilience in children and youths: maximizing opportunities through the schools. Child. Sch. 28, 69–76. doi: 10.1093/cs/28.2.69
BT-Coach. (2017) Behaviour therapy for tics and Tourette syndrome. Available at: https://www.bt-tics.com/bt-coach
Cella, D., Lai, J. S., Nowinski, C. J., Victorson, D., Peterman, A., Miller, D., et al. (2012). Neuro-QOL: brief measures of health-related quality of life for clinical research in neurology. Neurology 78, 1860–1867. doi: 10.1212/WNL.0b013e318258f744
Cella, D., Nowinski, C., Peterman, A., Victorson, D., Miller, D., Lai, J. S., et al. (2011). The neurology quality-of-life measurement initiative. Arch. Phys. Med. Rehabil. 92, S28–S36. doi: 10.1016/j.apmr.2011.01.025
Charania, S. N., Danielson, M. L., Claussen, A. H., Lebrun-Harris, L. A., Kaminski, J. W., and Bitsko, R. H. (2022). Bullying victimization and perpetration among US children with and without Tourette syndrome. J. Dev. Behav. Pediatr. 43, 23–31. doi: 10.1097/DBP.0000000000000975
Cheung, E. O., Addington, E. L., Bassett, S. M., Schuette, S. A., Shiu, E. W., Cohn, M. A., et al. (2018). A self-paced, web-based, positive emotion skills intervention for reducing symptoms of depression: protocol for development and pilot testing of MARIGOLD. Jmir Res. Protoc. 7:e10494. doi: 10.2196/10494
Cheung, M. Y., Shahed, J., and Jankovic, J. (2007). Malignant Tourette syndrome. Mov. Disord. 22, 1743–1750. doi: 10.1002/mds.21599
Comings, D. E., and Comings, B. G. (1987). A controlled study of Tourette syndrome. I. Attention-deficit disorder, learning disorders, and school problems. Am. J. Hum. Genet. 41, 701–741.
Conelea, C. A., Woods, D. W., Zinner, S. H., Budman, C., Murphy, T., Scahill, L. D., et al. (2011). Exploring the impact of chronic tic disorders on youth: results from the Tourette syndrome impact survey. Child Psychiat. Hum. 42, 219–242. doi: 10.1007/s10578-010-0211-4
Constitution of the World Health Organization. (2005) Amendments from the 51st world Health Assemblies 15 September 2005 are incorporated ed.
Crocker, J, Major, B, and Steele, C. The handbook of social psychology, Vols 1-2, 4th ed. New York, NY, US: McGraw-Hill (1998). 504–553.
Debes, N., Hjalgrim, H., and Skov, L. (2010). The presence of attention-deficit hyperactivity disorder (ADHD) and obsessive-compulsive disorder worsen psychosocial and educational problems in Tourette syndrome. J. Child Neurol. 25, 171–181. doi: 10.1177/0883073809336215
Eaton, C. K., LaMotte, J., Gutierrez-Colina, A. M., Kardon, P., and Blount, R. L. (2016). Changes in socio-emotional and behavioral functioning after attending a camp for children with Tourette syndrome: a preliminary investigation. J. Abnorm. Child Psychol. 44, 1197–1203. doi: 10.1007/s10802-015-0105-9
Edwards, K. R., Mendlowitz, S., Jackson, E., Champigny, C., Specht, M., Arnold, P., et al. (2017). A qualitative exploration of the experiences of children and adolescents with Tourette syndrome. J. Can. Acad. Child Adolesc. Psychiatry 26, 39–44.
Fernandes, P. T., Snape, D. A., Beran, R. G., and Jacoby, A. (2011). Epilepsy stigma: what do we know and where next? Epilepsy Behav. 22, 55–62. doi: 10.1016/j.yebeh.2011.02.014
Fernández de la Cruz, L., and Mataix-Cols, D. (2020). General health and mortality in Tourette syndrome and chronic tic disorder: a mini-review. Neurosci. Biobehav. Rev. 119, 514–520. doi: 10.1016/j.neubiorev.2020.11.005
Fernández de la Cruz, L., Ringberg, H., Anderson, S., Stern, J. S., and Mataix-Cols, D. (2021). Driving with tic disorders: an international survey of lived experiences. Move Disord. Clin. Pract. 8, 412–419. doi: 10.1002/mdc3.13177
Fernández de la Cruz, L., Rydell, M., Runeson, B., Brander, G., Rück, C., D’Onofrio, B. M., et al. (2017). Suicide in Tourette’s and chronic tic disorders. Biol. Psychiatry 82, 111–118. doi: 10.1016/j.biopsych.2016.08.023
Flesch, R. (1948). A new readability yardstick. J. Appl. Psychol. 32, 221–233. doi: 10.1037/h0057532
Folkman, S. (1984). Personal control and stress and coping processes: a theoretical analysis. J. Pers. Soc. Psychol. 46, 839–852. doi: 10.1037/0022-3514.46.4.839
Freeman, R. D., Fast, D. G., Burd, L., Kerbeshian, J., Robertson, M. M., and Sandor, P. (2000). An international perspective on Tourette syndrome: selected findings from 3500 individuals in 22 countries. Dev. Med. Child Neurol. 42, 436–447. doi: 10.1111/j.1469-8749.2000.tb00346.x
Gabbidon, J., Brohan, E., Clement, S., Henderson, R. C., and Thornicroft, G.Group MS (2013). The development and validation of the questionnaire on anticipated discrimination (QUAD). BMC Psychiatry 13:297. doi: 10.1186/1471-244X-13-297
Garris, J., and Quigg, M. (2021). The female Tourette patient: sex differences in Tourette disorder. Neurosci. Biobehav. Rev. 129, 261–268. doi: 10.1016/j.neubiorev.2021.08.001
Gibbons, R. D., and Hedeker, D. R. (1992). Full-information item bi-factor analysis. Psychometrika 57, 423–436. doi: 10.1007/BF02295430
Green, J. G., McLaughlin, K. A., Berglund, P. A., Gruber, M. J., Sampson, N. A., Zaslavsky, A. M., et al. (2010). Childhood adversities and adult psychiatric disorders in the National Comorbidity Survey Replication I: associations with first onset of DSM-IV disorders. Arch. Gen. Psychiat. 67, 113–123. doi: 10.1001/archgenpsychiatry.2009.186
Groth, C. (2018). Tourette syndrome in a longitudinal perspective. Clinical course of tics and comorbidities, coexisting psychopathologies, phenotypes and predictors. Dan. Med. J. 65, 1–25.
Hanks, C. E., McGuire, J. F., Lewin, A. B., Storch, E. A., and Murphy, T. K. (2016). Clinical correlates and mediators of self-concept in youth with chronic tic disorders. Child Psychiat Hum D. 47, 64–74. doi: 10.1007/s10578-015-0544-0
Hanson, M. A., and Gluckman, P. D. (2008). Developmental origins of health and disease: new insights. Basic Clin. Pharmacol. Toxicol. 102, 90–93. doi: 10.1111/j.1742-7843.2007.00186.x
Heijerman-Holtgrefe, A., Huyser, C., Verdellen, C., Jvd, G., Beljaars, L., Kan, K.-J., et al. (2022). Effectiveness of ‘tackle your tics’, a brief, intensive group-based exposure therapy programme for children with tic disorders: study protocol of a randomised controlled trial. BMJ Open 12:e058534. doi: 10.1136/bmjopen-2021-058534
Heijerman-Holtgrefe, A. P., Verdellen, C. W. J., van de Griendt, J., Beljaars, L. P. L., Kan, K. J., Cath, D., et al. (2021). Tackle your tics: pilot findings of a brief, intensive group-based exposure therapy program for children with tic disorders. Eur. Child Adolesc. Psychiatry 30, 461–473. doi: 10.1007/s00787-020-01532-5
Hertzman, C., and Boyce, T. (2010). How experience gets under the skin to create gradients in developmental health. Annu. Rev. Public Health 31, 329–347. doi: 10.1146/annurev.publhealth.012809.103538
Hirschtritt, M. E., Lee, P. C., Pauls, D. L., Dion, Y., Grados, M. A., Illmann, C., et al. (2015). Lifetime prevalence, age of risk, and genetic relationships of comorbid psychiatric disorders in Tourette syndrome. JAMA Psychiatry 72, 325–333. doi: 10.1001/jamapsychiatry.2014.2650
Hu, L.-t., and Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct. Equ. Model. 6, 1–55. doi: 10.1080/10705519909540118
Iyanda, A. E. (2022). Bullying victimization of children with mental, emotional, and developmental or behavioral (MEDB) disorders in the United States. J. Child Adolesc. Trauma 15, 221–233. doi: 10.1007/s40653-021-00368-8
Jackson, D. B., Vaughn, M. G., and Kremer, K. P. (2019). Bully victimization and child and adolescent health: new evidence from the 2016 NSCH. Ann. Epidemiol. 29, 60–66. doi: 10.1016/j.annepidem.2018.09.004
Johnco, C., McGuire, J. F., McBride, N. M., Murphy, T. K., Lewin, A. B., and Storch, E. A. (2016). Suicidal ideation in youth with tic disorders. J. Affect. Disord. 200, 204–211. doi: 10.1016/j.jad.2016.04.027
Kanter, J. W., Rusch, L. C., and Brondino, M. J. (2008). Depression self-stigma - a new measure and preliminary findings. J. Nerv. Ment. Dis. 196, 663–670. doi: 10.1097/NMD.0b013e318183f8af
Karatsoreos, I. N., and McEwen, B. S. (2011). Psychobiological allostasis: resistance, resilience and vulnerability. Trends Cogn. Sci. 15, 576–584. doi: 10.1016/j.tics.2011.10.005
Karatsoreos, I. N., and McEwen, B. S. (2013). Annual research review: the neurobiology and physiology of resilience and adaptation across the life course. J. Child Psychol. Psyc. 54, 337–347. doi: 10.1111/jcpp.12054
Kaushik, A., Papachristou, E., Dima, D., Fewings, S., Kostaki, E., Ploubidis, G. B., et al. (2017). Measuring stigma in children receiving mental health treatment: validation of the Paediatric self-stigmatization scale (PaedS). Eur. Psychiatry 43, 1–8. doi: 10.1016/j.eurpsy.2017.01.004
Kessler, R. C., McLaughlin, K. A., Green, J. G., Gruber, M. J., Sampson, N. A., Zaslavsky, A. M., et al. (2010). Childhood adversities and adult psychopathology in the WHO world mental health surveys. Br. J. Psychiatry 197, 378–385. doi: 10.1192/bjp.bp.110.080499
Lai, J. S., Nowinski, C., Victorson, D., Bode, R., Podrabsky, T., McKinney, N., et al. (2012). Quality-of-life measures in children with neurological conditions: pediatric neuro-QOL. Neurorehabil. Neural Repair 26, 36–47. doi: 10.1177/1545968311412054
Leckman, J. F., Zhang, H. P., Vitale, A., Lahnin, F., Lynch, K., Bondi, C., et al. (1998). Course of tic severity in Tourette syndrome: the first two decades. Pediatrics 102, 14–19. doi: 10.1542/peds.102.1.14
Lee, M. Y., Mu, P. F., Wang, W. S., and Wang, H. S. (2016). 'Living with tics': self-experience of adolescents with Tourette syndrome during peer interaction. J. Clin. Nurs. 25, 463–471. doi: 10.1111/jocn.13074
Lee, M., and Park, S. (2019). Beliefs about tic disorders and Tourette's syndrome in South Korea: an online panel survey. Soa Chongsonyon Chongsin Uihak. 30, 109–115. doi: 10.5765/jkacap.190007
Lee, H., Park, S., Lee, J., and Lee, M. S. (2020). Relationships among tic symptoms, expressed emotions, and quality of life in tic disorder patients. J. Child Fam. Stud. 29, 2051–2057. doi: 10.1007/s10826-019-01651-x
Lee, M. Y., Wang, H. S., Chen, C. J., and Lee, M. H. (2019). Social adjustment experiences of adolescents with Tourette syndrome. J. Clin. Nurs. 28, 279–288. doi: 10.1111/jocn.14564
Lee, M. Y., Wang, H. S., and Lee, T. Y. (2022). Psychosocial stress, self-esteem, and social adjustment: a moderated mediation analysis in Taiwanese adolescents with Tourette syndrome. J. Pediatr. Nurs. 62, e84–e90. doi: 10.1016/j.pedn.2021.07.013
Lemelson, R., and Tucker, A. (2017). The bird dancer and the warrior king: divergent lived experiences of Tourette syndrome in Bali. Transcult. Psychiatry 54, 540–561. doi: 10.1177/1363461517722869
Leuchter, J. D., Kook, M., Geller, D. A., Hertz, A. G., Garcia, J., Trent, E. S., et al. (2023). Promoting OCD WEllness and resilience (POWER) study: rationale, design, and methods. Psychiatry Res Commun. 3:100111. doi: 10.1016/j.psycom.2023.100111
Link, B. G., and Phelan, J. C. (2001). Conceptualizing Stigma. Annu. Rev. Sociol. 27, 363–385. doi: 10.1146/annurev.soc.27.1.363
Liu, S., Liu, P., Wang, M., and Zhang, B. (2021). Effectiveness of stereotype threat interventions: a meta-analytic review. J. Appl. Psychol. 106, 921–949. doi: 10.1037/apl0000770
Liu, S., Zheng, L., Zheng, X., Zhang, X., Yi, M., and Ma, X. (2017). The subjective quality of life in young people with Tourette syndrome in China. J. Atten. Disord. 21, 426–432. doi: 10.1177/1087054713518822
Ludlow, A. K., Brown, R., and Schulz, J. (2016). A qualitative exploration of the daily experiences and challenges faced by parents and caregivers of children with Tourette’s syndrome. J. Health Psychol. 23, 1790–1799. doi: 10.1177/1359105316669878
Ludlow, A. K., Cutler, A., and Keville, S. (2022). British teachers' knowledge and awareness of Tourette syndrome in children attending mainstream school. J. Res. Spec. Educ. Needs 22, 323–331. doi: 10.1111/1471-3802.12570
Luthar, S. S. (1991). Vulnerability and resilience: a study of high-risk adolescents. Child Dev. 62, 600–616. doi: 10.2307/1131134
Malli, M. A., and Forrester-Jones, R. (2017). "I'm not being rude, I'd want somebody normal": Adolescents' perception of their peers with Tourette's syndrome: an exploratory study. J. Dev. Phys. Disabil. 29, 279–305. doi: 10.1007/s10882-016-9524-y
Malli, M. A., and Forrester-Jones, R. (2022). Stigma and adults with Tourette's syndrome: "never laugh at other People's disabilities, unless they have Tourette's-because how can you not?". J. Dev. Phys. Disabil. 34, 871–897. doi: 10.1007/s10882-021-09829-2
Malli, M. A., Forrester-Jones, R., and Triantafyllopoulou, P. (2019). “Tourette’s is a lonely place”: an interpretative phenomenological analysis of the personal experience and identity of adults with Tourette’s syndrome. J. Dev. Phys. Disabil. 31, 819–845. doi: 10.1007/s10882-019-09676-2
Malterud, K., Siersma, V. D., and Guassora, A. D. (2016). Sample size in qualitative interview studies: guided by information power. Qual. Health Res. 26, 1753–1760. doi: 10.1177/1049732315617444
Martino, D., Ganos, C., and Pringsheim, T. M. (2017). Tourette syndrome and chronic tic disorders: the clinical Spectrum beyond tics. Int. Rev. Neurobiol. 134, 1461–1490. doi: 10.1016/bs.irn.2017.05.006
Masten, A. S. (2011). Resilience in children threatened by extreme adversity: frameworks for research, practice, and translational synergy. Dev. Psychopathol. 23, 493–506. doi: 10.1017/S0954579411000198
Mataix-Cols, D., Virtanen, S., Sidorchuk, A., Fernández de la Cruz, L., Larsson, H., Lichtenstein, P., et al. (2022). Association of Tourette Syndrome and Chronic Tic Disorder with Violent Assault and criminal convictions. JAMA Neurol. 79, 459–467. doi: 10.1001/jamaneurol.2022.0167
McEwen, B. S. (2007). Physiology and neurobiology of stress and adaptation: central role of the brain. Physiol. Rev. 87, 873–904. doi: 10.1152/physrev.00041.2006
McGuire, J. F., Arnold, E., Park, J. M., Nadeau, J. M., Lewin, A. B., Murphy, T. K., et al. (2015). Living with tics: reduced impairment and improved quality of life for youth with chronic tic disorders. Psychiatry Res. 225, 571–579. doi: 10.1016/j.psychres.2014.11.045
McKeague, L., Hennessy, E., O'Driscoll, C., and Heary, C. (2015). Peer mental health stigmatization scale: psychometric properties of a questionnaire for children and adolescents. Child. Adol. Ment. 20, 163–170. doi: 10.1111/camh.12088
Michaels, C. (2022). Mental health and well-being ecological model. Center for Leadership Education in Maternal & Child Public Health. Minneapolis, MN: University of Minnesota–Twin Cities. Available at: https://mch.umn.edu/resources/mhecomodel/.
Moskowitz, J. T., Jackson, K., Freedman, M. E., Grote, V. E., Kwok, I., Schuette, S. A., et al. (2023). Positive psychological intervention effects on depression: positive emotion does not mediate intervention impact in a sample with elevated depressive symptoms. Affect. Sci. 4, 163–173. doi: 10.1007/s42761-022-00140-7
Mroczek, D. K., Stawski, R. S., Turiano, N. A., Chan, W., Almeida, D. M., Neupert, S. D., et al. (2015). Emotional reactivity and mortality: longitudinal findings from the VA normative aging study. J. Gerontol. B Psychol. Sci. Soc. Sci. 70, 398–406. doi: 10.1093/geronb/gbt107
National Survey of Children’s Health. (2021) Initiative CaAHM, editor.: Data Resource Center for Child and Adolescent Health supported by Cooperative Agreement U59MC27866 from the U.S. Department of Health and Human Services
O'Hare, D., Eapen, V., Grove, R., Helmes, E., McBain, K., and Reece, J. (2017). Youth with Tourette syndrome: parental perceptions and experiences in the Australian context. Aust. J. Psychol. 69, 48–57. doi: 10.1111/ajpy.12111
O'Hare, D., Eapen, V., Helmes, E., McBain, K., Reece, J., and Grove, R. (2015). Factors impacting the quality of peer relationships of youth with Tourette's syndrome. BMC Psychol. 3:34. doi: 10.1186/s40359-015-0090-3
O'Hare, D., Eapen, V., Helmes, E., McBain, K., Reece, J., and Grove, R. (2016). Recognising and treating Tourette's syndrome in young Australians: a need for informed multidisciplinary support. Aust. Psychol. 51, 238–245. doi: 10.1111/ap.12170
Paiva, C. E., Barroso, E. M., Carneseca, E. C., de Pádua, S. C., Dos Santos, F. T., Mendoza López, R. V., et al. (2014). A critical analysis of test-retest reliability in instrument validation studies of cancer patients under palliative care: a systematic review. BMC Med. Res. Methodol. 14:8. doi: 10.1186/1471-2288-14-8
Panter-Brick, C., and Leckman, J. F. (2013). Editorial commentary: resilience in child development – interconnected pathways to wellbeing. J Child Psychol Psyc. 54, 333–336. doi: 10.1111/jcpp.12057
Park, C. L., Kubzansky, L. D., Chafouleas, S. M., Davidson, R. J., Keltner, D., Parsafar, P., et al. (2023). Emotional well-being: what it is and why it matters. Affect. Sci. 4, 10–20. doi: 10.1007/s42761-022-00163-0
Parker, R., and Aggleton, P. (2003). HIV and AIDS-related stigma and discrimination: a conceptual framework and implications for action. Soc. Sci. Med. 57, 13–24. doi: 10.1016/S0277-9536(02)00304-0
Perez, L., Huang, J., Jansky, L., Nowinski, C., Victorson, D., Peterman, A., et al. (2007). Using focus groups to inform the neuro-QOL measurement tool: exploring patient-centered, health-related quality of life concepts across neurological conditions. J. Neurosci. Nurs. 39, 342–353. doi: 10.1097/01376517-200712000-00005
Pressman, S. D., Jenkins, B. N., and Moskowitz, J. T. (2019). Positive affect and health: what do we know and where next should we go? Annu. Rev. Psychol. 70, 627–650. doi: 10.1146/annurev-psych-010418-102955
Pring, K., Malli, M., Hardy, B. W., Rapp, S. R., Storch, E. A., Mink, J. W., et al. (2023). Reframing stigma in Tourette syndrome: an updated scoping review. Eur. Child Adolesc. Psychiatry. doi: 10.1007/s00787-023-02332-3
Prinsen, C. A. C., Mokkink, L. B., Bouter, L. M., Alonso, J., Patrick, D. L., de Vet, H. C. W., et al. (2018). COSMIN guideline for systematic reviews of patient-reported outcome measures. Qual. Life Res. 27, 1147–1157. doi: 10.1007/s11136-018-1798-3
Ritsher, J. B., Otilingam, P. G., and Grajales, M. (2003). Internalized stigma of mental illness: psychometric properties of a new measure. Psychiatry Res. 121, 31–49. doi: 10.1016/j.psychres.2003.08.008
Rodin, A., Fleetwood-Meade, K., Gilmour, J., Kasujja, R., and Murphy, T. (2021). Why don't children in Uganda have tics? A mixed-methods study of beliefs, knowledge, and attitudes of health professionals. Child Adolesc. Ment. Health. 26, 47–53. doi: 10.1111/camh.12370
Salsman, J. M., McLouth, L. E., Cohn, M., Tooze, J. A., Sorkin, M., and Moskowitz, J. T. (2020). A web-based, positive emotion skills intervention for enhancing posttreatment psychological well-being in young adult Cancer survivors (EMPOWER): protocol for a single-arm feasibility trial. Jmir. Res. Protoc. 9:e17078. doi: 10.2196/17078
Salsman, J. M., McLouth, L. E., Tooze, J. A., Little-Greene, D., Cohn, M., Kehoe, M. S., et al. (2023). An eHealth, positive emotion skills intervention for enhancing psychological well-being in young adult Cancer survivors: results from a multi-site, pilot feasibility trial. Int. J. Behav. Med. 30, 639–650. doi: 10.1007/s12529-023-10162-5
Sandelowski, M. (1995). Sample size in qualitative research. Res. Nurs. Health 18, 179–183. doi: 10.1002/nur.4770180211
Saunders, B., Sim, J., Kingstone, T., Baker, S., Waterfield, J., Bartlam, B., et al. (2018). Saturation in qualitative research: exploring its conceptualization and operationalization. Qual. Quant. 52, 1893–1907. doi: 10.1007/s11135-017-0574-8
Schneider, S. C., La Buissonniere-Ariza, V., Cepeda, S. L., Coy, L., and Storch, E. A. (2018). Improving knowledge about chronic tic disorders among child welfare professionals. J. Obsess Compuls Rel. 16, 6–7. doi: 10.1016/j.jocrd.2017.10.003
Sekayi, D., and Kennedy, A. (2017). Qualitative Delphi method: a four round process with a worked example. Qual. Rep. 22, 2755–2763. doi: 10.46743/2160-3715/2017.2974
Shiu, C., Chen, W.-T., Kim, B., Ricketts, E., Stiede, J. T., Espil, F. M., et al. (2023). The roles of lifetime enacted stigma in tic symptoms among young adults with Tourette syndrome. Movement Disorders Clinical Practice. 10, 1759–1768. doi: 10.1002/mdc3.13900
Shonkoff, J. P., Boyce, W. T., and McEwen, B. S. (2009). Neuroscience, molecular biology, and the childhood roots of health disparities: building a new framework for health promotion and disease prevention. JAMA 301, 2252–2259. doi: 10.1001/jama.2009.754
Silvestri, P. R., Chiarotti, F., Baglioni, V., Neri, V., Cardona, F., and Cavanna, A. E. (2017). A preliminary examination of self-concept in older adolescents and young adults with Gilles de la Tourette syndrome. Eur. J. Paediatr. Neurol. 21, 468–474. doi: 10.1016/j.ejpn.2016.12.006
Soós, M. J., Coulson, N. S., and Davies, E. B. (2022). Exploring Social support in an online support Community for Tourette Syndrome and tic disorders: analysis of postings. J. Med. Internet Res. 24:e34403. doi: 10.2196/34403
Stacy, S., Salinas, G. D., Belcher, E., Wilhelm, A., Alexander, J. K., and Mattingly, G. W. (2023). Assessing the educational needs of physicians in the management of patients with Tourette syndrome: results of a United States survey on practicing clinicians and caregivers. CNS Spectr. 28, 343–350. doi: 10.1017/S1092852921000766
Stangl, A. L., Earnshaw, V. A., Logie, C. H., van Brakel, W., Simbayi, L. C., Barré, I., et al. (2019). The health stigma and discrimination framework: a global, crosscutting framework to inform research, intervention development, and policy on health-related stigmas. BMC Med. 17, 1–13. doi: 10.1186/s12916-019-1271-3
Stiede, J. T., Woods, D. W., Anderson, S., Eapen, V., Gev, E., Latimer, R., et al. (2021). Cultural differences in reactions to tics and tic severity. Child Family Behav. Ther. 43, 161–180. doi: 10.1080/07317107.2021.1940586
Stofleth, D., and Parks, E. S. (2022). “Sorry, I Didn’t mean to kiss at you”: a descriptive analysis of Tourette syndrome in interpersonal interactions. J. Dev. Phys. Disabil. 35, 783–805. doi: 10.1007/s10882-022-09881-6
Storch, E. A., Hanks, C. E., Mink, J. W., McGuire, J. F., Adams, H. R., Augustine, E. F., et al. (2015). Suicidal thoughts and behaviors in children and adolescents with chronic tic disorders. Depress. Anxiety 32, 744–753. doi: 10.1002/da.22357
Storch, E. A., Morgan, J. E., Caporino, N. E., Brauer, L., Lewin, A. B., Piacentini, J., et al. (2012). Psychosocial treatment to improve resilience and reduce impairment in youth with tics: an intervention case series of eight youth. J. Cogn. Psychother. 26, 57–70. doi: 10.1891/0889-8391.26.1.57
Storch, E. A., Murphy, T. K., Geffken, G. R., Sajid, M., Allen, P., Roberti, J. W., et al. (2005). Reliability and validity of the Yale global tic severity scale. Psychol. Assess. 17, 486–491. doi: 10.1037/1040-3590.17.4.486
Stuart, H. (2005). The inventory of stigmatizing experiences: its development and reliability. World Psychiatry 4, 33–37.
Sue Abderholden, M (2019). National Alliance on Mental Illness. Available at: https://www.nami.org/Blogs/NAMI-Blog/March-2019/It-s-Not-Stigma-It-s-Discrimination
Thomas, G., Hartley, R. D., and Kincaid, J. P. (1975). Test-retest and inter-analyst reliability of automated readability index, Flesch Reading ease score, and fog count. J. Read. Behav. 7, 149–154. doi: 10.1080/10862967509547131
Tinker, S. C., Bitsko, R. H., Danielson, M. L., Newsome, K., and Kaminski, J. W. (2022). Estimating the number of people with Tourette syndrome and persistent tic disorder in the United States. Psychiatry Res. 314:114684. doi: 10.1016/j.psychres.2022.114684
Van Orden, K. A., Witte, T. K., Cukrowicz, K. C., Braithwaite, S. R., Selby, E. A., and Joiner, T. E. Jr. (2010). The interpersonal theory of suicide. Psychol. Rev. 117, 575–600. doi: 10.1037/a0018697
Vermilion, J., Augustine, E. F., Adams, H. R., Vierhile, A., Collins, A. T., McDermott, M. P., et al. (2022). Risk behaviors in youth with and without Tourette syndrome. Pediatr. Neurol. 126, 20–25. doi: 10.1016/j.pediatrneurol.2021.10.007
Villanueva, C. M., Silton, R. L., Heller, W., Barch, D. M., and Gruber, J. (2021). Change is on the horizon: call to action for the study of positive emotion and reward in psychopathology. Curr. Opin. Behav. Sci. 39, 34–40. doi: 10.1016/j.cobeha.2020.11.008
Wadman, R., Glazebrook, C., Beer, C., and Jackson, G. M. (2016). Difficulties experienced by young people with Tourette syndrome in secondary school: a mixed methods description of self, parent and staff perspectives. BMC Psychiatry 16:14. doi: 10.1186/s12888-016-0717-9
White Hughto, J. M., Reisner, S. L., and Pachankis, J. E. (2015). Transgender stigma and health: a critical review of stigma determinants, mechanisms, and interventions. Soc. Sci. Med. 147, 222–231. doi: 10.1016/j.socscimed.2015.11.010
Yanos, P. T., Roe, D., and Lysaker, P. H. (2010). The impact of illness identity on recovery from severe mental illness. Am. J. Psychiatr. Rehabil. 13, 73–93. doi: 10.1080/15487761003756860
Yousafzai, A. K., Rasheed, M. A., and Bhutta, Z. A. (2013). Annual research review: improved nutrition – a pathway to resilience. J. Child Psychol. Psyc. 54, 367–377. doi: 10.1111/jcpp.12019
Youth Risk Behavior Surveillance System. (2019) Centers for Disease Control and Prevention. Available at: https://www.cdc.gov/healthyyouth/data/yrbs/index.htm
Glossary
Keywords: Tourette, TIC, stigma, discrimination, scale, qualitative, quantitative
Citation: Martindale JM, Ringheanu VM, Pring KA, Norona S, Wiseman K, Strowd RE, Chapman L, Rigdon J, Rapp SR, Storch EA, Ip E and Mink JW (2024) Study protocol for measuring stigmatization in persistent tic disorders: development and validation of the Tourette discrimination-stigmatization scale. Front. Psychol. 15:1381063. doi: 10.3389/fpsyg.2024.1381063
Edited by:
María Roncero, University of Valencia, SpainReviewed by:
Brianna Wellen, University of Minnesota Twin Cities, United StatesLeon Dure, University of Alabama at Birmingham, United States
Copyright © 2024 Martindale, Ringheanu, Pring, Norona, Wiseman, Strowd, Chapman, Rigdon, Rapp, Storch, Ip and Mink. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Jaclyn M. Martindale, am1hcnRpbmRAd2FrZWhlYWx0aC5lZHU=