Skip to main content

ORIGINAL RESEARCH article

Front. Psychiatry, 06 August 2020
Sec. Child and Adolescent Psychiatry
This article is part of the Research Topic Children, Adolescents and Families with Severe Mental Illness: Towards a Comprehensive Early Identification of Risk View all 22 articles

Comparing Models of the Children’s Yale-Brown Obsessive-Compulsive Scale (CY-BOCS) in an Italian Clinical Sample

  • 1Dipartimento di Psicologia Generale, Università di Padova, Padova, Italy
  • 2Dipartimento di Neuroscienze Umane, Università di Roma “La Sapienza”, Roma, Italy
  • 3Dipartimento di Psicologia dello Sviluppo e della Socializzazione, Università di Padova, Padova, Italy

Background: Obsessive-Compulsive Disorder (OCD) is a mental disorder that interferes with daily functioning and may arise during childhood. The current study is the first attempt by Italian researchers to validate the Children’s Yale-Brown Obsessive-Compulsive Scale (CY-BOCS).

Aims: The study’s primary aim was to investigate the best CY-BOCS model fit, adopting a Bayesian model comparison strategy, among four different factor models: a one-factor model; a two-factor model based on Obsessions and Compulsions; Storch et al.’s and Mc Kay et al.’s two-factor model based on Disturbance and Severity. The study also aimed to investigate the types of treatments found in a sample of Italian OCD children patients.

Methods: The study sample was made up of 53 children with OCD and 14 children with Tourette Syndrome and TIC.

Results: An analysis of our data demonstrated that the Obsessions and Compulsions model was the most plausible one, as it demonstrated the best fit indices, strong convergent validity, and good reliability. The study results additionally uncovered that 24.5% of the children in the OCD sample had not yet begun any treatment pathway a year after a diagnosis was formulated.

Conclusions: These findings suggest that the Obsessions and Compulsions scales of the CY-BOCS separately represent appropriate instruments to evaluate children with OCD.

Background

Prevalence and Phenomenology

The estimated lifetime prevalence of Obsessive-Compulsive Disorder (OCD) ranges between 2 and 4% (13). On average, symptoms of OCD present at 19.5 years of age (between 10 and 40); in males, the onset is generally before the age of 10, while in females it is during or after adolescence (usually between 20 and 25) (4, 5).

The estimated prevalence of OCD in childhood and adolescence is 0.25%–4%, with those aged between 16 and 18 years old (1%) showing the highest prevalence. The disorder is frequently characterized by gradual onset, a chronic course, and exacerbation of symptoms over a long period of time (the average length of time is 8.9 years over a lifetime) (57). Most juvenile OCD patients show a progressive age-related worsening of symptoms, and poor school performance seems to be associated with symptom severity (8). According to several studies, juvenile OCD seems to be mainly characterized by compulsions alone (4, 9, 10) and may be difficult to differentiate from tic-like behaviors.

Garcia etal. (11) more recently reported that 96% of an OCD juvenile patient sample had a mean of four concomitant compulsions, 75% had two concomitant obsessions, and 18% reported having compulsions without obsessions.

Moreover, several researchers put in evidence that juvenile OCD is left unrecognized or untreated and, for this reason, it is characterized by an insidious and progressive course; it can severely disrupt global functioning, negatively affect the lives of patients and their families, and persist in the course of later childhood, adolescence, and adulthood (i.e., 1215).

Comorbidity

OCD in childhood is frequently associated with other psychiatric conditions such as depression and anxiety disorders, attention deficit hyperactivity disorder (ADHD), tic disorder (TIC), and autism spectrum disorder (in 77-85% of cases), and that can further exacerbate the patient’s condition. Some studies have uncovered overlapping comorbidities such as TIC and Tourette Syndrome (TS), which are found in 9-59% of individuals with OCD (16). The presence of OCD has, in turn, frequently been observed in children who have been diagnosed with TIC. One study, in fact, reported that more than 50% of children with TIC also manifested OCD symptoms (17). Bloch etal. (18) pointed out that in approximately 30−50% of the sample of children with TS, it was in comorbidity with OCD. The best estimate of the prevalence of TD in school-age children is approximately 3–8/1000 (19). Boys seem to be more likely than girls to manifest TIC, with a gender ratio ranging between 2:1 and 4:1. The prevalence of TS seems to decrease when children/adolescents grow older, with the highest prevalence found in 7–10-year-olds (20). OCD symptoms associated with TIC generally present at a pre-pubertal age and may predate the onset of TIC (21).

The Psychometric Properties of the CY-BOCS

Several studies have highlighted the importance of investigating childhood-onset OCD, as it represents a serious mental health problem often associated with other conditions that may have important implications for patients’ current and future health and quality of life. The Children’s Yale-Brown Obsessive-Compulsive Scale (CY-BOCS; 22, 23) is currently the instrument of choice to assess the presence and severity of OCD symptoms in children/adolescents and to monitor treatment. To our knowledge, no attempt has been made to validate the Italian version of the scale. The CY-BOCS is a semi-structured interview made up of 10 items rated on a 5-point Likert scale evaluating the severity of Obsessions and Compulsions across five dimensions, Frequency, Interference, Distress, Resistance, and Control, during the previous week and up to the time of interview. A score above 16 is generally considered indicative of the presence of OCD (16-23 = moderate severity; 24-40 = severe).

The CY-BOCS is similar to the adult version (Y-BOCS), and numerous studies suggest that both can be explained by a two-factor model: Obsessions and Compulsions. In contrast, the validity of a three-factor model (the Obsessions and Compulsions scores and the total severity score) has not been confirmed (2427).

Other studies have found evidence confirming the validity of a two-factor model based on a Disturbance factor and a Severity factor in an adult (24, 27, 28) and juvenile population (29, 30). Using Confirmatory Factor Analysis (CFA), McKay etal. (29) examined a Severity factor related to general impairment and reflected in Distress, Interference, and Frequency symptoms; the Disturbance factor was linked to the Resistance and Controlling symptoms of both Obsessions and Compulsions. These results were partially replicated by Storch etal. (31), who examined the same two-factor model, the only difference being that the symptom frequency items were loaded onto the Severity factor rather than on the Disturbance one.

In light of conflicting results and in view of the importance of an appropriate assessment of the disorder in juvenile populations, the current study’s primary aim was to use a Bayesian model comparison strategy to compare three two-factor models and one single-factor model to determine the best model fit for the CY-BOCS in a sample of Italian children/adolescents diagnosed with OCD.

The single-factor model consisted of only one factor that included all the symptoms related to Obsessions and Compulsions. The second consisted of a two-factor model examining Obsessions and Compulsions. The other two two-factor models were both based on Severity and Disturbance; they differed only with regard to the frequency variable, as in one model, it was loaded onto the Severity factor, while in the other, it was loaded onto the Disturbance one.

Given the shortage of studies examining this disorder in Italian children/adolescents, the study also focused on collecting information regarding the severity of disability and the kind of treatment that is provided in different Italian public health facilities.

Methods

Participants

The study sample was made up of 67 children/adolescent outpatients/inpatients recruited at different public health facilities located in Northern (n=40), Southern (n=12), and Central (n=15) Italian towns/cities between 2014 and 2017. All of the children/adolescents were evaluated by Pediatric Neuro-Psychiatrist specialists who formulated their diagnoses on the basis of the patient’s score on the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5; 19). Out of the 67-patient population enrolled in the study, 53 were diagnosed with OCD (79.1%), 11 were diagnosed with TS (16.4%), and 3 were diagnosed with TIC (4.5%).

The OCD Group

The OCD study group was made up of 33 boys (62.3%) and 20 girls (37.7%) (mean age = 12.9 years; SD = 3.3 years, range = 6 to 18 years). On average, they were 11.4 years old (SD = 3.1 years, range = 4 to 16 years) when OCD was diagnosed, and they were first evaluated approximately 1.5 years after the first symptoms of the disorder presented (SD = 1.5 years, range = 0 to 6 years).

Comorbid conditions, principally TIC, ADHD/Attentive Disorder, Learning Disabilities, and Anxiety/Emotional Disorder, were present in 52.8% of the sample. Moreover, 15.1% had at least one family member who had been diagnosed with OCD, TIC, or TS. Out of the total patient group being examined, 60.3% were undergoing treatment (26.4% pharmacological treatment, 7.5% psychological treatment, 26.4% both). Out of the total group, 50.9% had never been hospitalized for the disorder, and 24.5% were receiving some type of psychological treatment. As far as school was concerned, 9.5% were receiving some type of educational support, and 3.8% had already left school. Overall, the average number of years of schooling in this group was 7.2 years (DS: 3.5; range: 0 to 13 years).

The Tourette Syndrome and TIC Disorder Group

The second study group was made up of 8 boys (73%) and 3 girls (27%) who were diagnosed with TS and 2 boys (67%) and 1 girl (33%) who were diagnosed with TIC. The mean ages in the TS and TIC subgroups were, respectively, 10.4 years (SD = 2.3, range = 8 to 16 years) and 9 years (SD = 2, range = 7 to 11 years). On average, they were 6.6 years old (SD= 1.5, range=4 to 9 years) when they were diagnosed. The TS patients were evaluated approximately 3.7 years after the first symptoms presented (SD = 2.9 years; range = 1 to 10 years), and the TIC patients were first evaluated less than a year after the first symptoms presented. Comorbid conditions, for the most part, OCD/obsessive-compulsive traits, ADHD, separation anxiety disorder, and generalized anxiety disorder/depressive traits, were present in 82% of the TS patients and in all of the TIC patients.

As far as the TS subgroup was concerned, 55% had a family history of OCD (18%), TIC, or TS (36%). Twenty-seven percent were undergoing treatment (9% pharmacological treatment, 9% psychological treatment, and 9% both). None of the patients in this group had ever been hospitalized for the disorder. Two of the TIC patients had a family history respectively of OCD and TS; none were undergoing treatment, and none had ever been hospitalized for the disorder. As far as school was concerned, one patient was receiving special education assistance. Overall, the average number of years of schooling was 4.2 years (SD: 2.3 years; range: 2 to 10 years) in the TS subgroup and 3 years (SD: 2 years; range: 1 to 5 years) in the TIC subgroup. The participants’ demographic data are outlined in Table 1.

TABLE 1
www.frontiersin.org

Table 1 Demographic characteristics of the patients studied.

Procedures

During the first phase of the study, three specialized psychologists were trained in administering the CY-BOCS. The training sessions were audio-recorded and evaluated by the first author of the present study. The assessment phase was carried out at the different mental health facilities respectively located in the north, center, and south of Italy. All the outpatients and inpatients were diagnosed by specialized Pediatric Neuropsychiatrists in those facilities using the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5).

The inclusion criterion consisted of a primary diagnosis of OCD and/or TS and/or TIC in a child/adolescent, and all consecutive patients assessed for the first time or during the ongoing monitoring visit were included.

Individuals with neurological disorders or mental retardation based on a previous Pediatric Neuro-Psychiatrist assessment were excluded. Once the patients were identified, they were interviewed individually using the CY-BOCS (or in their parents’ presence if they were 7 years old or younger). The interview was carried out by one of the specialized psychologists who was unaware of the patient’s diagnoses. The psychologists were simply informed that the patients they would be interviewing could have OCD or/and TIC or/and TS. The interview lasted approximately 40 min.

The Obsessive-Compulsive Inventory-Child Version (OCI-CV) was also administered, with parents if the child was less than 7 years of age.

This study was conducted in accordance with the Declaration of Helsinki and approved by the Ethical Committees of the Department of General Psychology (University of Padova) and all of the mental health facilities participating in the study. All of the children/adolescents participated on an entirely voluntary basis and were enrolled only after their parents had signed consent forms. Their social and demographic information were collected after they were enrolled.

Measures

The Children’s Yale-Brown Obsessive-Compulsive Scale (22, 23) was the main measure under consideration. Although the original version of the CY-BOCS was translated with the forward translation mode into Italian (32), to our knowledge, to date, no study has investigated its psychometric properties in Italian juvenile patients.

The Obsessive-Compulsive Inventory-Child Version (OCI-CV; 33, 34) is a well-established 21-item self-report questionnaire using a three-point Likert scale (ranging from 0 to 2) to assess the frequency of obsessions and compulsions over the previous month. Its six sub-scales concern Doubting/Checking, Obsessing, Hoarding, Washing, Ordering, and Neutralizing. The questionnaire has demonstrated good/modest internal consistency (33, 35). One study by researchers assessing Italian patients reported an excellent/good/acceptable internal consistency both for the inventory’s total score and sub-scale scores (34). In our sample of patients, the internal consistency of the total score was found to be good (Cronbach’s alpha= 0.84).

The Child Behavior Checklist 6-18 (CBCL/6-18; 36; Italian version by A. Frigerio - IRCCS EUGENIO MEDEA-LA NOSTRA FAMIGLIA) is a standardized self-report questionnaire used by parents and teachers to screen for psychological problems (emotional and behavioral) and social competencies in children and adolescents. The questionnaire is formed of two sections regarding social competence/adaptive functioning and emotional/behavioral problems. The first section contains 20 items examining social and school activities and specifically the time devoted to sports, games/hobbies, types of activities engaged in, number of friends in general and of close friends, frequency of social interactions, level of self-sufficiency during playtime, problems at school, and academic performance. The second section, termed the “syndrome scale,” includes 113 items and uses a three-point Likert scale. The items are grouped into eight categories: anxious/depressed, withdrawn/depressed, somatic complaints, social problems, thought problems, attention problems, rule-breaking behavior, and aggressive behavior. Many studies have demonstrated a high rate of reliability between the CBCL scales and the psychological diagnoses formulated (37). The instrument is known to have a good test-retest reliability (ranging from 0.82 to 0.90) and internal consistency (Cronbach’s alphas ranged from 0.72 to 0.97). It also has strong criterion-related validity (36).

Statistical Analysis

The Bayesian approach, which presents many practical advantages (e.g., 3844), was used to analyze our data. A Bayesian model, in fact, provides an adaptive tool that is useful for handling small sample size by including prior information (45). Moreover, it provides a direct representation of the most credible values of the estimated parameter (44, 46) All analyses were performed using R statistical software (47). Each model was fitted using the Bayesian Markov Chain Monte Carlo (MCMC) estimation method implemented in the Just another Gibbs sampler (JAGS) package (48) coupled with the R statistical packages blavaan (49) and runjags (50).

Posterior distributions for each parameter were estimated using four MCMC chains, each running at least for 5000 replicates. MCMC convergence was assessed by calculating the potential scale reduction factor (PSRF) (also called Rhat; 51), which compares the ratio of the average variance of samples within each chain with the variance of the pooled samples across the chains; if all of the chains are at equilibrium, these will be the same, and R̂ will be one.

We adopted a model comparison strategy (52) in order to identify the best model by considering the following fit indices: the Bayesian Comparative Fit Index (BCFI), the Bayesian Tucker-Lewis Fit Index (BTLFI), the Bayesian Root Mean Square Error of Approximation (BRMSEA) (53), the Standardized Root Mean Square Residual (SRMR; 54), the Bayes Factor (BF), the Widely-Applicable Information Criterion (WAIC; 55), and the Akaike Weights (AW) (5658). For each fit index and estimated parameter, we computed the mean of the posterior distributions as the estimate and the 90% credibility interval (also called Highest Posterior Density Interval; HPDI; 5860).

We adopted the following priors for model parameters: 1) ν ∼ Normal(0, 31.6), for intercepts; 2) λ ∼ Normal(0.5, 0.58), for factor loadings; 3) θ ∼ Gamma(1, 0.5), for residual variances; 4) ϕ ∼ Beta(1, 1), for factor correlations. As suggested by Muthén and Asparouhov (45), we included informative small-variance priors for the cross-loadings, λc ∼ Normal(0, 0.32). In addition, we considered paired items by including residual covariance with prior distribution Beta(1, 1). The following models were considered: 1) a one-factor model; 2) a two-factor model (Obsessions and Compulsions); 3) Storch etal.’s (30) two-factor model; 4) McKay et al.’s (29) two-factor model (Figure 1). We also used Cronbach alpha and Pearson’s r for correlational analysis to assess reliability and construct validity, respectively.

FIGURE 1
www.frontiersin.org

Figure 1 One_F, One-Factor; Cmp, Compulsions; Obs, Obsessions; Dst, Disturbance; Grv, Gravity; Cont_c, Control_compulsions; Cont_o, Control_obsessions; Res_c, Resistance_compulsions; Res_o, Resistance_obsessions; Dstrs_c, Distress_compulsions; Dstrs_o, Distress_obsessions; Int_c, Interference_compulsions; Int_o, Interference_obsessions; Time_c, Time occupied_compulsions; Time_o, Time occupied_obsessions.

Results

Comparing the CY-BOCS Scale With the Four Factor Models

The Bayesian Comparative Fit Index (BCFI; with 90% hpdi), the Bayesian Tucker-Lewis Index (BTLI, with 90% hpdi), the Bayesian Root Mean Square Error of Approximation (BRMSEA, with 90% hpdi), the Standardized Root Mean Square Residual (SRMR, with 90% hpdi), the Bayes Factor (log) (evidence regarding the worst model, in this case, the one-factor one), the Widely Applicable Information Criterion (WAIC), and the Akaike weight (5658) were used as fit indices to examine the models. The BCFI, BTLI, and BRMSEA can range between 0 and 1, and values close to 1 on the BCFI and BTLI and close to 0 on the BRMSEA and SRMR indicate a good fit. The BF, which is the likelihood ratio of the marginal likelihood for two competing models, can be interpreted as the relative evidence or plausibility of one model with respect to another. The WAIC is a generalized version of the Akaike Information Criterion (AIC); the smaller the value, the better the model fits the data. Finally, the Akaike Weights represent an estimate of the probability that the model will make the best prediction on new data conditional on the set of models considered (5658).

The fit indices of the models considered are outlined in Table 2. The single-factor model was found to have the worst fit, as it had a BF and an Akaike Weight equal to 0. The model formed by the Obsessions and Compulsions scales was found to be the most plausible, as it had a BF equal to 22.42 and an Akaike weight equal to 0.92. Besides presenting inferior fits in all the indices considered with respect to the Obsessions and Compulsions model, the other two competing models had nearly equivalent BF values (9.86 and 9.99 respectively) and predictions of new data (Akaike Weights 0.05 and 0.03). The Obsessions and Compulsions model can be considered 20.42 (0.92/0.05) times more plausible than Storch et al.’s model and 29.57 (0.92/0.03) times more likely to be correct than McKay’s model.

TABLE 2
www.frontiersin.org

Table 2 Comparison of the fit indices of the models considered.

Table 3 outlines the estimated factor loadings for the Obsessions and Compulsions model. Every item is grouped in the corresponding scale. Loadings related to the Obsessions were all greater than or equal to 0.70; the loadings related to the Compulsions were all greater than or equal to 0.60. The cross-loadings were proximal to zero, and since the Highest Posterior Density Intervals (HPDs) of all the cross-loadings included zero, we can consider them irrelevant. We can assume, therefore, that they were more likely 95% of the time.

TABLE 3
www.frontiersin.org

Table 3 The estimated factor loadings for the Obsessions and Compulsions model.

Discriminant Power, the Intercorrelation Between Scales, and Construct Validity

The scores on the CY-BOCS and the patients’ diagnoses were compared. The scale’s Sensitivity (Se; the proportion of true positives) and Specificity (Sp; the proportion of true negatives) was established by comparing the diagnoses formulated by the Pediatric Neuro-Psychiatrists with the scores on the CY-BOCS (using 16 as the cut-off score). The analysis revealed that it had a high Sensitivity (Se = 0.75) and Specificity (Sp = 1) for OCD.

The internal consistency indices uncovered a good internal consistency for both the Obsessions (α=0.81) and Compulsions scales (α=0.80).

Generally speaking, the correlations between the CY-BOCS sub-scales were very low (-0.25 < r < 0.22), except for the correlations between the Obsessions and Compulsions items connected to Time (r=0.41; p<0.01), those connected to Interference (r=0.41; p<0.01), and the Interference of the Obsessions item both with the Distress for Compulsions item (r=0.30; p<0.05) and the Compulsions Total score (r=0.33; p<0.05). The correlation between the total scores of the Obsessions and Compulsions scales was also very low (r=0.15; p>0.05) (Table 4).

TABLE 4
www.frontiersin.org

Table 4 Intercorrelations of the CY BOCS sub-scales in the OCD sample studied (N=53).

As far as the convergent validity between the CY-BOCS and the OCI-CV was concerned, our analysis showed that both the Obsessions and Compulsions scales of the CY-BOCS were positively correlated with the OCI-CV (r=0.55 and r=0.49, respectively; p<0.01). The Obsessions scale of the CY-BOCS was negatively correlated with the activities scale and the total competence score of the CBCL (respectively, r=-0.29 and r=0.34; p<0.05). Finally, only the Obsessions scale of the CY-BOCS was positively correlated with the total syndrome rating score of the CBCL (r=0.30; p<0.05) (Table 5).

TABLE 5
www.frontiersin.org

Table 5 Correlations between the CY-BOCS and the OCI-CV and the CBCL in the OCD sample studied (N=53).

Discussion

To our knowledge, this is the first study so far aiming to examine the CY-BOCS best model through the Bayesian approach considering an Italian sample.

Three two-factor models were examined. One was the Obsessions and Compulsions factor model (29) and the other two were the Disturbance and Severity factor models; in the first case, symptom frequency was loaded onto the Disturbance factor (29), and in the other, it was loaded onto the Severity factor (30). We also examined a highly debated single-factor solution that includes all obsessive and compulsive symptomatology (2427). The Bayesian approach was used in view of its many advantages, including that of allowing the researcher to reach a better prospective likelihood of fit and to study and compare models even in small samples of patients. As far as our juvenile OCD group was concerned, our analyses showed that the two-factor model representing Obsessions and Compulsions was the best factorial structure of the CY-BOCS; the other three models examined showed inadequate fit.

These findings, which further confirmed the validity of the two-factor solution proposed by McKay et al. (29), have relevant implications for understanding the disorder, i.e., that Obsessions and Compulsions should be assessed separately. In fact, data analysis showed that a single-factor solution is unsuitable and that using it exclusively could lead to misinterpretation of the severity of the disorder. Not only that, but using it alone in a treatment context could lead to mistakes in interpreting intervention-related changes. Examining the two faces of the disorder separately would seem then to be a better approach to evaluating juvenile OCD.

These results are in line with one retrospective study (4) showing higher scores on the Compulsions scale of the Y-BOCS in those patients presenting an early-onset form of the disorder. They are also consistent with the findings of some studies showing that there tends to be a prevalence of Compulsions in these patients that often precedes the onset of Obsessions. In fact, some have reported that juvenile OCD cases are characterized by an onset of compulsive behavior alone (without obsessions) that may be indistinguishable from TIC (9, 10, 6163).

As far as validity was concerned, the internal consistency of the CY-BOCS Obsessions and Compulsions scales was high, but in contrast to other studies in which the intercorrelations with the total score were high for both the Obsessions (0.77) and Compulsions (0.82) scales (64), in our sample, it was only moderate, especially for the Obsessions factor (r=0.47 for Obsessions; r=0.72 for Compulsions). Moreover, the intercorrelation between the Obsessive and Compulsive scales was very low (r ranging from -0.22 to 0.41), and only the time spent in compulsions was found to be correlated with the total score of the Obsessions scale (r=0.27). Likewise, the intercorrelation between the Obsessions and Compulsions scales was very low (r=0.15). However, the methodology used here did not enable us to make comparisons with other studies as far as construct validity was concerned: for example, Freeman etal. (64) found an internal consistency of 0.71 for Compulsions and only of 0.64 for Obsessions, while Storch etal. (30) found a moderate relation between Obsessions and Compulsions (r=0.49). Collectively, these findings show that the Obsessions and the Compulsions scales separately provide a clinically useful, reliable, and valid assessment of OCD severity in young children, suggesting that the two factors are distinct OCD constructs. This type of structure is useful to identify the frequent situations in children where obsessions are absent or there is no awareness of their presence. Assessing obsessions and compulsions together would result in an underestimation of OCD diagnosis, which could also lead to a lower probability of access to treatment for those children who would need it. Therefore, this factorial solution, instead, might include data regarding the presence of distinct factors at an early age and could allow early access to treatments, thus interfering with the characteristic tendency for it to become a chronic disorder (i.e., 1215).

We cannot, however, entirely exclude the possibility that the immaturity of some of the children examined did not allow them access to the cognitive constructs linked to obsessions when, instead, the problem of compulsive behaviors was more evident to them and to others. Future studies with larger numbers of younger children over a wide age range will be able to clarify this point.

The study findings also showed that the Obsessions and Compulsions scales have a good convergent validity with the OCI-CV and confirm its usefulness.

Furthermore, the Obsessions and Compulsions scales were found to be negatively correlated with what parents said about their children’s competencies, as evaluated using the CBCL. In this case, the correlation with the Obsessions factor (r=-0.34) was stronger than that with the Compulsions one (r=-0.17). This was an unexpected result, as parents generally tend to be quite aware of the children’s difficulties. We could postulate that the parents’ evaluation could be mainly focalized on the cognitive resources indispensable for academic performance and that are affected by Obsessions.

As far as the sensitivity and specificity of the CY-BOCS were concerned, our findings show that they can be considered excellent. In the future, it would be interesting to investigate whether other (separate) cut-offs could be more useful in assessing the disorder’s severity and monitoring treatment.

Approximately 24.5% of the children in our sample attending the different mental health facilities participating in our study were not receiving any treatment a year after the diagnosis was formulated, and 26% were receiving only pharmacological treatment. Regardless of the reasons for this choice, treatment guidelines such as the National Institute for Clinical Excellence (65) recommend Cognitive Behavioral Therapy (CBT) for young people with OCD as the first line of treatment even if they have other comorbidities. Again, as far as the children studied here were concerned, 13.2% had left school or was struggling academically and requiring the assistance of a special needs teacher during classes. We are convinced that early assessment and appropriate intervention could lower that percentage (66) and, more importantly, could have a significant impact on the quality of life of the children and their families.

Limits

These findings should be considered in light of the study’s limitations. First of all, as mentioned above and despite the presence of a parent during the interview, the youngest children participating in our study may not have been able to identify the cognitive aspects linked to obsessions. Moreover, our sample could be biased as we are not aware of how many individuals have refused to participate or have been excluded from the study based on exclusion criteria (e.g., due to having a neurological disorder).

In addition, as the results regarding the scales’ sensitivity and specificity are based on the data of a small subgroup of children in the TIC/TS group, the study findings should be interpreted cautiously, and further studies with larger samples are indeed warranted. Future studies could investigate temporal reliability, as it has not been assessed; these data would have important implications in the construct stability, considering this age range. Moreover, we would like to point out that more than half of the children in our sample had comorbidity with another diagnosis and, of 28 individuals (52.8%), 6 (11.3%) had a secondary diagnosis of TIC/Tourette Syndrome disorders. Therefore, it is not possible to exclude that the greater representativeness of the Compulsion aspect with respect to the Obsession one could be partially explained by tic-like behaviors, which often overlap with Compulsions. Finally, although the facilities participating in the study were distributed throughout the country, the sample cannot be considered representative of the Italian population since the sampling was on a voluntary basis. For all of these reasons, future studies are warranted.

Conclusions

Our analyses showed that the best factorial structure of the CY-BOCS is a two-factor model representing Obsessions and Compulsions and suggest that the two scales of the CY-BOCS separately represent appropriate instruments for evaluating and monitoring the management of children with OCD. In any case, to better support the results of the present research, future studies should focus on a larger sample of children with OCD and without overlapping comorbidities.

Data Availability Statement

The datasets generated for this study are available on request to the corresponding author.

Ethics Statement

The studies involving human participants were reviewed and approved by approved by the Ethical Committees of the Department of General Psychology of the University of Padova and of all of the mental health facilities participating in the study. Written informed consent to participate in this study was provided by the participants’ legal guardian/next of kin.

Author Contributions

CN conceived and planned the study. SP and FC contributed to sample preparation. MP contributed to the analysis of the data. All authors provided critical feedback and helped shape the research, analysis and manuscript.

Funding

This work was carried out within the scope of the project “use-inspired basic research”, for which the Department of General Psychology of the University of Padova has been recognized as “Dipartimento di eccellenza” by the Ministry of University and Research.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

1. Douglass HM, Moffit TE, Dar R, McGee R, Silva P. Obsessive-compulsive disorder in a birth cohort of 18-year-olds: prevalence and predictors. J Am Acad Child Adolesc Psychiatry (1995) 34(11):1424–31. doi: 10.1097/00004583-199511000-00008

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Rapoport JL, Inoff-Germain G, Weissman MM, Greenwald S, Narrow WE, Jensen PS, et al. Childhood obsessive-compulsive disorder in the NIMH MECA study: parent versus child identification of cases. methods for the epidemiology of Child and Adolescent Mental Disorders. J Anxiety Disord (2000) 14(6):535–48. doi: 10.1016/S0887-6185(00)00048-7

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Geller DA, March J. Obsessive-compulsive and spectrum disorders in children and adolescents. Psychiatr Clinics North America (2006) 29(2):353–70. doi: 10.1016/j.psc.2006.02.012

CrossRef Full Text | Google Scholar

4. Maina G, Albert U, Salvi V, Pessina E, Bogetto F. Early-onset obsessive-compulsive disorder and personality disorders in adulthood. Psychiatry Res (2008) 158(2):217–25. doi: 10.1016/j.psychres.2006.08.003

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Ruscio AM, Stein DJ, Chiu WT, Kessler RC. The epidemiology of Obsessive-Compulsive Disorder in the National Comorbidity Survey Replication. Mol Psychiatry (2010) 15(1):53–63. doi: 10.1038/mp.2008.94

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Heyman I, Fombonne E, Simmons H, Ford T, Meltzer H, Goodman R. Prevalence of obsessive-compulsive disorder in the British nationwide survey of child mental health. Br J Psychiatry (2001) 179:324–9. doi: 10.1192/bjp.179.4.324

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Krebs G, Heyman I. Obsessive-compulsive disorder in children and adolescents. Arch Dis Childhood (2015) 100:495–9. doi: 10.1136/archdischild-2014-306934

CrossRef Full Text | Google Scholar

8. Ledley DR, Pasupuleti RV. School issues in children with obsessive- compulsive disorder. In: Storch EA, Geffken GR, Murphy TK, editors. Handbook of Child and Adolescent Obsessive-Compulsive Disorder. Mahwah, NJ: Lawrence Erlbaum (2007). p. 333–50.

Google Scholar

9. Geller DA, Biederman J, Griffin, S, Jones, J, Lefkowitz TR. Comorbidity of juvenile obsessive-compulsive disorder with disruptive behavior disorders. J Am Acad Child Adolesc Psychiatry (1996) 35:1637–46. [PubMed: 8973071]. doi: 10.1097/00004583-199612000-00016

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Geller DA, Biederman J, Jones J, Park K, Schwartz S, Shapiro S, et al. Is juvenile obsessive–compulsive disorder a developmental subtype of the disorder? A review of the pediatric literature. J Am Acad Child Adolesc Psychiatry (1998) 37(4):420–7. [PubMed: 9549963]. doi: 10.1097/00004583-199804000-00020

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Garcia AM, Freeman JB, Himle MB, Berman NC, Ogata AK, Choate-Summers JML, et al. Phenomenology of early childhood-onset obsessive compulsive disorder. J Psychopathol Behav Assess (2009) 31(2):104–11. doi: 10.1007/s10862-008-9094-0

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Koran LM, Thienemann M, Davenport R. Quality of life for patients with obsessive compulsive disorder. Am J Psychiatry (1996) 153(6):783–8. doi: 10.1176/ajp.153.6.783

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Walitza S, Melfsen S, Jans T, Zellmann H, Wewetzer C, Warnke A. Obsessive-compulsive disorder in children and adolescent. Deutsches Ärzteblatt Int (2011) 108(11):173–9. doi: 10.3238/arztebl.2011.0173

CrossRef Full Text | Google Scholar

14. Piacentini J, Bergman L, Keller M, McCracken J. functional impairment in children and adolescents with Obsessive-Compulsive Disorder. J Child Adolesc Psychopharmacol (2003) 13(1):S61–9. doi: 10.1089/104454603322126359

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Valderhaug R, Ivarsson T. Functional impairment in clinical samples of Norwegian and Swedish children and adolescents with obsessive-compulsive disorder. Eur Child Adolesc Psychiatry (2005) 14(3):164–73. doi: 10.1007/s00787-005-0456-9

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Stewart SE, Geller DA, Jenike M, Pauls D, Shaw D, Mullin B, et al. Long-term outcome of pediatric obsessive-compulsive disorder: a meta-analysis and qualitative review of the literature. Acta Psychiatrica Scandinavica (2004) 110(1):4–13. doi: 10.1111/j.1600-0447.2004.00302.x

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Lebowitz ER, Panza KE, Su J, Bloch MH. Family accommodation in obsessive-compulsive disorder. Expert Rev Neurother (2012) 12(2):229–38. doi: 10.1586/ern.11.200

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Bloch MH, Peterson BS, Scahill L, Otka J, Katsovich L, Zhang H, et al. Adulthood outcome of tic and obsessive-compulsive symptom severity in children with Tourette syndrome. Arch Pediatr Adolesc Med (2006) 160(1):65–9. doi: 10.1001/archpedi.160.1.65

PubMed Abstract | CrossRef Full Text | Google Scholar

19. American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 5th ed. APA: Washington, DC (2013).

Google Scholar

20. Scahill L, Chappell PB, Kim YS, Schultz RT, Katsovich L, Shepherd E, et al. A placebo-controlled study of guanfacine in the treatment of children with tic disorders and attention deficit hyperactivity disorder. Am J Psychiatry (2001) 158(7):1067–74. doi: 10.1176/appi.ajp.158.7.1067 PUBMED: 11431228.

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Leckman JF, Bloch MH, Scahill L, King RA. Tourette syndrome: the self under siege. J Child Neurol (2006) 21(8):642–9. doi: 10.1177/08830738060210081001

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Goodman WK, Price LH, Rasmussen SA, Riddle MA, Rapoport JL. Children’s Yale-Brown Obsessive-Compulsive Scale. Second Revision. Yale Child Study Center: New Haven, CT (1991).

Google Scholar

23. Scahill L, Riddle MA, McSwiggin-Hardin M, Ort S II, King RA, Goodman WK, et al. Children’s Yale-Brown Obsessive Compulsive Scale: reliability and validity. J Am Acad Child Adolesc Psychiatry (1997) 36(6):844–52. doi: 10.1097/00004583-199706000-00023

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Amir N, Foa EB, Coles ME. Factor structure of the Yale–Brown Obsessive Compulsive Scale. psychol Assess (1997) 9(3):312–6. doi: 10.1037/1040-3590.9.3.312

CrossRef Full Text | Google Scholar

25. Arrindell WA, de Vlaming IH, Eisenhardt BM, van Berkum DE, Kwee MG. Cross-cultural validity of the Yale-Brown Obsessive Compulsive Scale. J Behav Ther Exp Psychiatry (2002) 33(3-4):159–76. doi: 10.1016/S0005-7916(02)00047-2

PubMed Abstract | CrossRef Full Text | Google Scholar

26. McKay D, Danyko S, Neziroglu F, Yaryura-Tobias JA. Factor structure of the Yale-Brown Obsessive-Compulsive scale: a two dimensional measure. Behav Res Ther (1995) 33(7):865–9. doi: 10.1016/0005-7967(95)00014-O

PubMed Abstract | CrossRef Full Text | Google Scholar

27. McKay D, Neziroglu F, Stevens K, Yaryura-Tobias JA. The Yale-Brown Obsessive-Compulsive Scale: confirmatory factor analytic findings. J Psychopathol Behav Assess (1998) 20(3):265–74. doi: 10.1023/A:1023019419065

CrossRef Full Text | Google Scholar

28. Storch E, Rasmussen S, Price L, Larson M, Murphy T, Goodman W. Development and psychometric evaluation of the Yale-Brown Obsessive-Compulsive Scale–Second Edition. psychol Assessessment (2010) 22:223–32. doi: 10.1037/a0018492

CrossRef Full Text | Google Scholar

29. McKay D, Piacentini J, Greisberg S, Graae F, Jaffer M, Miller J, et al. The Children’s Yale-Brown Obsessive-Compulsive Scale: item structure in an outpatient setting. psychol Assess (2003) 15(4):578–81. doi: 10.1037/1040-3590.15.4.578

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Storch EA, Murphy TK, Geffken GR, Bagner DM, Soto O, Sajid M, et al. Factor analytic study of the Children’s Yale–Brown Obsessive–Compulsive Scale. J Clin Child Adolesc Psychol (2005a) 34(2):312–9. doi: 10.1207/s15374424jccp3402_10

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Storch EA, Shapira NA, Dimoulas E, Geffken GR, Murphy TK, Goodman WK. Yale-Brown Obsessive Compulsive Scale: the dimensional structure revisited. Depression Anxiety (2005b) 22(1):28–35. doi: 10.1002/da.20088

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Neri V, Cardona F. Children’s Yale-Brown Obsessive-Compulsive Scale. In: Sica C, editor. Disturbo Ossessivo Compulsivo: Questionari e interviste per la valutazione clinica. Trento: Erickson editore (2012). p. 121–50.

Google Scholar

33. Foa EB, Coles ME, Huppert JD, Pasupuleti R, Franklin ME, March JS. Development and validation of a child version of the Obsessive Compulsive Inventory. Behav Ther (2010) 41:121–32. doi: 10.1016/j.beth.2009.02.001

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Pozza A, Barcaccia B, Dettore D. The Obsessive Compulsive Inventory-Child Version (OCI-CV): further evidence on confirmatory factor analytic structure, incremental and criterion validity in italian community children and adolescents. Arch Psychiatr Nurs (2017) 31(3):291–5. doi: 10.1016/j.apnu.2017.02.003

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Jones AM, De Nadai AS, Arnold EB, McGuire JF, Lewin AB, Murphy TK, et al. Psychometric properties of the obsessive compulsive inventory: child version in children and adolescents with Obsessive-Compulsive Disorder. Child Psychiatry Hum Dev (2013) 44(1):137–51. doi: 10.1007/s10578-012-0315-0

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Achenbach TM, Rescorla LA. Manual for the ASEBA school-age forms & profiles. Research Centre for Children, Youth and Families, University of Vermont: Burlington (2001). (Italian version by A. Frigerio - IRCCS EUGENIO MEDEA-LA NOSTRA FAMIGLIA).

Google Scholar

37. Warnick E, Bracken MB, Kasl S. Screening efficiency of the child behavior checklist and strengths and difficulties questionnaire: a systematic review. Child Adolesc Ment Health (2007) 13(3):140–7. doi: 10.1111/j.1475-3588.2007.00461.x

CrossRef Full Text | Google Scholar

38. Dienes Z. Bayesian versus orthodox statistics: which side are you on? Perspect psychol Sci (2011) 6(3):274–90. doi: 10.1177/1745691611406920

PubMed Abstract | CrossRef Full Text | Google Scholar

39. van de Schoot R, Kaplan D, Denissen J, Asendorpf JB, Neyer FJ, Aken MA. A gentle introduction to Bayesian analysis: applications to developmental research. Child Dev (2014) 85(3):842–60. Retrieved from http://tinyurl.com/vandeschoot doi: 10.1111/cdev.12169

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Fawcett JM, Lawrence MA, Taylor TL. The representational consequences of intentional forgetting: impairments to both the probability and fidelity of long-term memory. J Exp Psychol.: Gen (2016) 145(1):56–81. doi: 10.1037/xge0000128

PubMed Abstract | CrossRef Full Text | Google Scholar

41. van De Schoot R, Winter SD, Ryan O, Zondervan-Zwijnenburg M, Depaoli S. A systematic review of Bayesian articles in psychology: the last 25 years. psychol Methods (2017) 22(2):217–39. doi: 10.1037/met0000100

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Dienes Z, Mclatchie N. Four reasons to prefer bayesian analyses over significance testing. Psychonomic Bull Rev (2018) 25(1):207–18. doi: 10.3758/s13423-017-1266-z

CrossRef Full Text | Google Scholar

43. Etz A, Gronau QF, Dablander F, Edelsbrunner PA, Baribault B. How to become a Bayesian in eiht easy steps: an annotated reading list. Psychonomic Bull Rev (2018) 25(1):219–34. doi: 10.3758/s13423-017-1317-5

CrossRef Full Text | Google Scholar

44. Kruschke JK, Liddell TM. The Bayesian new statistics: hypothesis testing, estimation, meta-analysis, and power analysis from a Bayesian perspective. Psychonomic Bull Rev (2018) 25(1):178–206. doi: 10.3758/s13423-016-1221-4

CrossRef Full Text | Google Scholar

45. Muthén B, Asparouhov T. Bayesian structural equation modeling: a more flexible representation of substantive theory. psychol Methods (2012) 17(3):313–35. doi: 10.1037/a002680

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Kruschke J. Doing Bayesian data analysis: A tutorial with R and BUGS. 2nd ed. Elsevier: Amsterdam, The Netherlands (2014).

Google Scholar

47. R Core Team. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing: Vienna, Austria (2018).

Google Scholar

48. Plummer M. JAGS: A program for analysis of Bayesian graphical models using Gibbs sampling. Vienna, Austria (2003) 124(125):1–10. Available at: http://citeseer.ist.psu.edu/plummer03jags.html.

Google Scholar

49. Merkle EC, Rosseel Y. Blavaan: Bayesian structural equation models via parameter expansion. J Stat Software (2018) 85(4):1–3. doi: 10.18637/jss.v085.i04

CrossRef Full Text | Google Scholar

50. Denwood MJ. Runjags: an R package providing interface utilities, model templates, parallel computing methods and additional distributions for MCMC models in JAGS. J Stat Software (2016) 71(9):1–25. doi: 10.18637/jss.v071.i09

CrossRef Full Text | Google Scholar

51. Gelman A, Rubin DB. Inference from iterative simulation using multiple sequences (with discussion). Stat Sci (1992) 7(4):457–72. doi: 10.1214/ss/1177011136

CrossRef Full Text | Google Scholar

52. Burnham KP, Anderson DR. Model Selection and Multimodel Inference: A Practical Information-Theoretic Approach. 2nd ed. New York: Springer Science & Business Media (2002).

Google Scholar

53. Jorgensen TD, Garnier-Villarreal M. (2018). Fit Indices for BSEM. Retrieved from https://osf.io/afkcw/.

Google Scholar

54. Jöreskog KG, Sorbom D. LISREL8: User’s reference guide. Scientific Software: Mooresville (1996).

Google Scholar

55. Watanabe S. Asymptotic equivalence of bayes cross validation and widely applicable information criterion in singular learning theory. J Mach Learn Res (2010) 11:3571–94.

Google Scholar

56. Wagenmakers EJ, Farrell S. AIC model selection using Akaike weights. Psychonomic Bull Rev (2004) 11(1):192–6. doi: 10.3758/BF03206482

CrossRef Full Text | Google Scholar

57. Burnham KP, Anderson DR, Huyvaert KP. AIC model selection and multimodel inference in behavioral ecology: some background, observations, and comparisons. Behav Ecol Sociobiol. (2011) 65(1):23–35. doi: 10.1007/s00265-010-1029-6

CrossRef Full Text | Google Scholar

58. McElreath R. Statistical Rethinking: A Bayesian Course with Examples in R and Stan. Chapman & Hall/CRC Press editor: Boca Raton, London and New York, Washington, DC: Apple Academic Press Inc. (2016).

Google Scholar

59. Box GE, Tiao GC. Bayesian Inference in Statistical Analysis. Palgrave Macmillan, London: Addison-Wesley Pub. Co. (1973). Reading, Mass.

Google Scholar

60. Kruschke J. Doing Bayesian data analysis: A tutorial with R and BUGS. 1st ed. Elsevier: Amsterdam, The Netherlands (2010).

Google Scholar

61. Rettew DC, Swedo SE, Leonard HL, Lenane MC, Rapoport JL. Obsessions and compulsions across time in 79 children and adolescents with obsessive–compulsive disorder. J Am Acad Child Adolesc Psychiatry (1992) 31:1050–6. [PubMed: 1429404]. doi: 10.1097/00004583-199211000-00009

PubMed Abstract | CrossRef Full Text | Google Scholar

62. Swedo SE, Rapoport JL, Leonard HL, Lenane M, Cheslow D. Obsessive compulsive disorders in children and adolescents: clinical phenomenology of 70 consecutive cases. Arch Gen Psychiatry (1989) 46:335–43. [PubMed: 2930330]. doi: 10.1001/archpsyc.1989.01810040041007

PubMed Abstract | CrossRef Full Text | Google Scholar

63. Eischstedt JA, Arnold SL. Childhood-onset obsessive–compulsive disorder: a tic-related subtype of OCD? Clin Child Rev (2001) 21(1):137–58. doi: 10.1016/S0272-7358(99)00044-6

CrossRef Full Text | Google Scholar

64. Freeman J, Flessner CA, Garcia A. The Children’s Yale-Brown Obsessive Compulsive Scale: reliability and validity for use among 5 to 8 year olds with Obsessive-Compulsive Disorder. J Abnormal Child Psychol (2011) 39(6):877–83. doi: 10.1007/s10802-011-9494-6

CrossRef Full Text | Google Scholar

65. National Institute for Clinical Excellence. Obsessive compulsive disorder: core intervention in the treatment of obsessive compulsive disorder and body dysmorphic disorder. the British Psychological Society and the Royal College of Psychiatrists: London (2006).

Google Scholar

66. Turner C, O’Gorman B, Nair A, O’Kearney R. Moderators and predictors of response to cognitive behaviour therapy for pediatric obsessive-compulsive disorder: a systematic review. Psychiatry Res (2018) 261:50–60. doi: 10.1016/j.psychres.2017.12.034

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: Children’s Yale-Brown Obsessive-Compulsive Scale (CY-BOCS), Obsessive-Compulsive Disorder, Tourette Syndrome, TIC Disorder, Bayesian model comparison

Citation: Novara C, Pardini S, Cardona F and Pastore M (2020) Comparing Models of the Children’s Yale-Brown Obsessive-Compulsive Scale (CY-BOCS) in an Italian Clinical Sample. Front. Psychiatry 11:615. doi: 10.3389/fpsyt.2020.00615

Received: 30 January 2020; Accepted: 12 June 2020;
Published: 06 August 2020.

Edited by:

Andrea Raballo, University of Perugia, Italy

Reviewed by:

Silvia Molteni, University of Pavia, Italy
Marta Camacho, University of Cambridge, United Kingdom

Copyright © 2020 Novara, Pardini, Cardona and Pastore. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Caterina Novara, Y2F0ZXJpbmEubm92YXJhQHVuaXBkLml0

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.