- 1Department of Personality, Assessment, and Psychological Treatment, Universidad of Murcia, Murcia, Spain
- 2Department of Health Psychology, Miguel Hernández University, Elche, Spain
- 3Department of Developmental Psychology and Teaching, University of Alicante, Alicante, Spain
The main objective of this research was to validate the parents’ version of the Children’s Separation Anxiety Scale (CSAS-P), which assesses separation anxiety symptoms in pre-adolescence, the stage with the highest incidence of anxiety disorder due to separation. In Study 1, 1,089 parents, those children aged between 8 and 11 (M = 9.59, SD = 1.11), 51.7% girls, were selected by random cluster sampling, who completed the CSAS-P to obtain the factorial structure. Exploratory factor analysis identified four related factors: Worry, Opposition, Calm, and Distress, which explained 42.93% of the variance. In Study 2, 3,801 parents, those children aged between 8 and 11 (M = 9.50, SD = 1.10), 50.2% girls, completed the CSAS-P, and their children completed the Children’s Separation Anxiety Scale (CSAS). The four related-factor model from Study 1 was validated by confirmatory factor analysis. The CSAS-P had adequate internal consistency (α = 0.84), temporal stability (r = 0.72), and invariance across children’s age and gender and the parent who completed the scale. Age and gender differences were small: older children scored higher on Worry and younger children on Distress; the girls scored higher on all factors. Small differences were also found depending on the parent who completed the scale without finding a clear pattern. Parents scored significantly lower than the child on all four factors of the scale. The results support the reliability and validity of the CSAS-P, an instrument that complements the child’s self-report in the framework of the multi-source assessment.
Introduction
Separation anxiety disorder (SAD) in childhood is the child’s disproportionate and maladaptive anxiety when they are separated from their main caregivers, usually the parents, or when they anticipate separation. Anxiety manifests in the form of excessive concern for the well-being and health of the attachment figure or the child themselves (e.g., that the parents might suffer an accident); associated discomfort (e.g., stomachache and nausea at school); and opposition to separation (e.g., protests to prevent parents from going out at night by leaving them with a babysitter) (American Psychiatric Association, 2013).
It is estimated that up to 12% of children are diagnosed with an anxiety disorder (Essau et al., 2018), with SAD being the most prevalent one under 12 years of age (American Psychiatric Association, 2013). Along with several types of specific phobia, specifically, animal, blood-injection-injury, and environmental, SAD presents at an earlier age of onset, and most cases of SAD begin before the age of 12 (Beesdo et al., 2009), with a mean age of onset of 8 years (Keller et al., 1992). In an epidemiological study in which 29,699 children and adolescents were randomly selected, the prevalence of SAD was 5.3% and was more frequent in the 6-9 years (7.2%) and 10-14 years (5.5%) age groups, than in the 15-18 years group (3%) (Mohammadi et al., 2020).
The avoidance of situations that involve separation from attachment figures or withdrawal from home restricts the child’s social relationships, has a negative impact on family functioning, and causes problems with school attendance. Symptoms of separation anxiety and school fears are strongly linked (Orgilés et al., 2009). A significant proportion of cases of school refusal present SAD: 22.2% in the clinical population (Allen et al., 2010) and 10.8% in the community population (Egger et al., 2003). Students with symptoms of separation anxiety have worse social functioning (Gonzálvez et al., 2019) and higher rates of school absenteeism (Fornander and Kearney, 2020).
The comorbidity of SAD with other disorders is high, with rates of up to 86% (Shear et al., 2006), especially with generalized anxiety disorder (74%) and with specific phobia (58%) (Verduin and Kendall, 2003). SAD is not only associated with other anxiety disorders, but also with various disorders such as Gilles de la Tourette syndrome (Eapen et al., 2018). The presence of SAD in childhood predicts the same disorder in adolescence (13-19 years) (Bittner et al., 2007) and is a powerful risk factor (78.6%) for the development of psychopathology in early adulthood (19-30 years) (Lewinsohn et al., 2008). SAD increases the risk of many disorders, including panic disorder, depression, and substance abuse (Aschenbrand et al., 2003; Hayward et al., 2004; Biederman et al., 2007; Brückl et al., 2007). Concerning SAD in adulthood, 36.1% presented it in childhood, especially women (Silove et al., 2010).
The prevalence of SAD in childhood, its serious negative repercussions in the family, school, and social spheres, its high comorbidity, and the risk of psychopathology in adolescence and adulthood advise early detection and early treatment of the disorder. In the evaluation of anxiety disorders, questionnaires and scales are widely used for their ease of administration, correction, and interpretation. From the point of view of multi-source evaluation, it is recommended to complement the child’s self-report with the parents’ report, especially considering that parents are the most important source of information for the clinician in the evaluation of the child’s emotional problems (Achenbach et al., 1987; Kazdin, 1988). Concerning SAD, children report discomfort more precisely, while their parents report disruptive behaviors (Allen et al., 2010). Parents often complain that their child cries, has tantrums, follows them around the house like their shadow, sleeps with them, refuses to participate in extracurricular activities, and performs other behaviors that affect family functioning.
There are parents’ versions of generic scales that assess anxiety disorders in childhood, including the SAD: the Multidimensional Anxiety Scale for Children (MASC; March et al., 1997), the Screen for Child Anxiety-Related Emotional Disorder (SCARED; Birmaher et al., 1997), and the Spence Children’s Anxiety Scale (SCAS; Spence, 1997). However, these scales, widely used in epidemiological studies, include only a reduced set of SAD items. In clinical contexts, it is useful to have specific instruments that collect the relevant aspects of SAD and that help plan therapy based on the particular characteristics of the case. There are two instruments for parents: the Separation Anxiety Avoidance Inventory - Parent Version (SAAI-P; In-Albon et al., 2013) and the Separation Anxiety Assessment Scale - Parent Version (SAAS-P; Eisen and Schaefer, 2005). The 12 items of the SAAI-P are limited to evaluating avoidance behavior, omitting fundamental dimensions such as worry and discomfort. The SAAS-P allows a more comprehensive evaluation, but its 34 items mix symptoms with triggering events of the disorder and safety signals that reduce separation anxiety. Moreover, both instruments evaluate separation anxiety indistinctly in childhood and adolescence: 4-15 years (SAAI-P) and 6-17 years (SAAS-P), although its manifestations vary with age. In a classic study, Francis et al. (1987) found that separation nightmares were more frequent in children (5-8 years), than in preadolescents (9-12 years) and adolescents (13-16 years); while separation distress was more common in children and preteens than in teens. According to the American Psychiatric Association (2000), young children do not usually express specific concerns, but as they get older, the concerns tend to become specified; for example, that parents have an accident. Adolescents, on the other hand, may deny separation anxiety, although it is reflected in the limitations to their independent activity, for example, refusing to leave the house.
The main objective of this research was to validate the parents’ version of the Children’s Separation Anxiety Scale (Méndez et al., 2014), which assesses separation anxiety symptoms in pre-adolescence, the life stage with the highest incidence of SAD. To this end, we carried out two studies with independent samples: in Study 1, we performed an exploratory factor analysis of the parent’s version of the scale (CSAS-P); In Study 2, we performed a confirmatory factor analysis, internal consistency, temporal stability, factor invariance and the difference in latent means, as well as the analysis of the differences between the child’s assessment (CSAS) and that of the parents (CSAS- P).
Study 1
Materials and Methods
Participants
A random cluster sampling was carried out in two provinces in southeastern Spain. The primary units were the comarcas, the secondary units were the schools, and the tertiary units were the classrooms. 1,285 parents, whose children were in 3rd to 6th grade of Primary Education, were recruited from 13 schools. 196 (9.78%) parents were excluded due to errors or omissions in the answers, because they did not give informed consent, or because they were foreigners with significant deficits in the command of Spanish. The sample consisted of 1,089 parents, from 26 to 59 years of age (M = 38.57, SD = 5.96). Most of the parents were Spanish (89.26%), the rest were non-Spanish European (3.49%), Latin American (3.03%), North African (2.30%), and Asian (1.93%). Regarding the composition, 77.59% of the families were formed by both parents, and 22.41% by a single parent. Concerning educational level, 40.40% had higher education, 32.60% intermediate studies, 24.79% primary studies, and 2.20% did not report this. The socioeconomic status of the families was medium-high or high (28.65%), medium (43.71%), and medium-low or low (27.64%). Children, from 8 to 11 years old (M = 9.59, SD = 1.11), 51.7% girls, attended public (60.98%), subsidized (30.04%) and private (8.97%) schools. The chi-squared test for homogeneity of the distribution of frequencies indicated that there were no statistically significant differences between the eight groups of age x gender (χ2 = 3.12, df = 3, p = 0.37).
Instruments
Demographic Form
A short questionnaire was developed to collect data on age, gender, nationality, family structure, educational level, and socioeconomic status.
Children’s Separation Anxiety Scale - Parent Version
This is the adaptation for parents of the original scale for children (Méndez et al., 2014), which assesses the frequency of symptoms of separation anxiety in the child. It consists of 20 items and is rated on a five-point Likert-type scale with options 1 (never or almost never), 2 (sometimes), 3 (often), 4 (very often), and 5 (always or almost always).
Procedure
After obtaining permission from the educational authorities, the researchers met with the principals and the heads of the Psychology Department of the selected schools to inform them verbally and in writing of the study objectives, request their authorization, and obtain their collaboration. An informational meeting was held with the parents in which their written consent was requested and the demographic form and the CSAS-P were provided to them, which they had to complete within one week.
Ethical Considerations
This study was approved by the Research Ethics Committee of the University of Alicante (Spain), reference number UA-2019-07-10.
Statistical Analysis
The underlying structure of the CSAS-P was determined by iterative principal axis factor analysis with oblique rotation because the factors were correlated. Principal axis analysis was used as it was considered, within the ordinary least squares methods, the recommended classical option when the assumption of normality is not fulfilled (Fabrigar et al., 1999). The distribution of the data was explored and some items yielded values of a non-normal distribution. There were 183 participants who left between 1 and 3 items unanswered. The missing data were assigned using the multiple imputation method (Lang and Little, 2018). To interpret the goodness of fit, saturations equal to or greater than 0.35 were taken as a reference. The factors were not forced to equate their number with the expected factors.
Data analyses were performed with the SPSS statistical package, version 20.0.
Results
The Kaiser-Meyer-Olkin measure of sampling adequacy (KMO = 0.86) and Bartlett’s sphericity test (χ2 = 6990.87, df = 190, p < 0.001) showed adequate values. The same four factors were obtained as in the original version for the child, with an eigenvalue greater than one (Kaiser criterion) and with an explained variance of 42.93% (see Figure 1). The factor loadings varied between 0.35 and 0.77 (M = 0.59). Factor 1, Worry (Items 10, 13, 16, 18, and 20), 14.80% of the explained variance, is the cognitive component of anxiety that assesses the child’s concern about something bad happening to their parents and/or to them. Factor 2, Opposition (Items 1, 2, 4, 5, and 9), 10.74% of the explained variance, is the behavioral component of anxiety and refers to the child’s actions to avoid or end the situation of being separated from parents. Factor 3, Calm (Items 3, 8, 12, 15, and 19), 9.50% of the explained variance, is a positive factor that expresses the child’s confidence when separated from their parents or away from home. Factor 4, Distress (Items 6, 7, 11, 12, and 14), 7.89% of the explained variance, is the psychophysiological component of anxiety and includes the discomfort experienced by the child when they are separated from their parents (see Table 1).
Study 2
Materials and Methods
Participants
Similar to Study 1, a random cluster sampling was carried out in three provinces in southeastern Spain. 4,271 parent-child dyads were recruited from 43 schools that had not participated in Study 1.470 (11%) parent-child dyads were excluded due to errors or omissions in the answers, because they did not give informed consent, or because they were foreigners with significant deficits in the command of Spanish. The sample consisted of 3,801 parent-child dyads. The age range of the parents was 25-57 years (M = 37.23, SD = 5.48). The nationality of the families was Spanish (87.13%), non-Spanish European (4.13%), Latin American (3.05%), or other (5.68%). The children lived with both parents (74.40%), with the mother alone (20.68%), or with the father alone (4.92%). Regarding the parents’ educational level, 39.17% had higher education, 33.78% intermediate education, and 27.05% primary education or a lower level. The socioeconomic status of most of the families was medium (47.83%), and the rest were medium-low or low (26.89%) and medium-high or high (25.28%).
Test-retest reliability was calculated with 590 parents randomly selected from the sample, who completed the CSAS-P again four weeks later.
Children, from 8 to 11 years old (M = 9.50, SD = 1.10), 50.2% girls, attended public (60.98%), subsidized (30.04%) and private (8.97%) schools. The Chi-square test of homogeneity of the frequency distribution revealed that there were no statistically significant differences between the eight age x gender groups (χ2 = 2.34, df = 3, p = 0.50).
Instruments
The demographic form and the CSAS-P were completed by the parents: 72.11% by the mother, 16.23% by the father, and 11.65% by both.
The children answered the CSAS (Méndez et al., 2014). The coefficients omega were adequate in this study: CSAS (0.89), Worry (0.78), Opposition (0.72), Calm (0.73), and Distress (0.70). The correlation with other measures of separation anxiety is high: r = 0.71 with the Separation Anxiety Assessment Scale (SAAS; Eisen and Schaefer, 2005), r = 0.62 with the Separation Anxiety subscale of the Screen for Child Anxiety-Related Emotional Disorders (SCARED; Birmaher et al., 1997; Spanish version, Vigil-Colet et al., 2009), and r = 0.61 with Separation Anxiety Disorder subscale from the Spence Children’s Anxiety Scale (SCAS; Spence, 1997; version Spanish, Orgilés et al., 2012a).
Procedure
The process with the parents was similar to that of Study 1. After obtaining parental consent, the children collectively completed the CSAS in the classroom during school hours.
Statistical Analysis
First, the internal structure of the CSAS-P was contrasted using four confirmatory factor analyses (CFAs): null model (0 factors), 1-factor model, 4-uncorrelated factor model, and 4-correlated factor model from Study 1. As the Mardia multivariate kurtosis coefficient was very high (405.23), exceeding the value 5 and revealing that the data did not fit the multivariate normal distribution (Bentler, 2006), the robust maximum likelihood method was used. As the use of several indices is recommended to evaluate the fit of a structural model (Weston and Gore, 2006; Kline, 2013), in addition to the Satorra-Bentler scaled chi-square statistic (S-Bχ2), the following indices were used: Robust Root Mean Square Error of Approximation (R-RMSEA): < 0.05 excellent fit, < 0.08 acceptable fit; Standardized Root Mean-squared Residual (SRMR): < 0.05 good fit, close to 0.08 acceptable fit; Robust Comparative Fit Index (R-CFI): ≥ 0.95 good fit, ≥ 0.90 acceptable fit; and Tucker-Lewis Index (TLI): ≥ 0.90 acceptable fit (Hu and Bentler, 1999; Brown, 2006). The reliability of the CSAS-P was calculated using Cronbach’s alpha coefficient of internal consistency and Pearson’s product-moment correlation coefficient of temporal stability.
Second, measurement invariance and structural invariance were examined as a function of the age and gender of the child and the parent who had completed the CSAS-P, using multigroup confirmatory factor analysis (MGCFA) to confirm the invariance of the model that would have obtained better fit indices in the previous step. Again, the Mardia coefficients were high: 170.67 (8 years), 180.36 (9 years), 196.84 (10 years), and 240.27 (11 years); 314.78 (boys), and 255.51 (girls); 333.66 (mothers), 171.48 (fathers) and 124.60 (both), so robust maximum likelihood estimators were used to fit the measurement model (Satorra and Bentler, 2001), proceeding according to a series of hierarchical steps (Byrne, 2006, 2008; Liu et al., 2015; Samuel et al., 2015). In Model 0, no restrictions were set on configural invariance; in Model 1, factor load restrictions were imposed for metric invariance; in Model 2, restrictions were imposed of the factor loadings and the intercepts of the variables for scalar invariance or strong invariance; in Model 3, restrictions were imposed of the factor loadings, the intercepts of the variables, and the variances and co-variances of the errors for the strict invariance; in Model 4, the variances and co-variances of the factors in Model 2 were matched to assess structural invariance. The fit of the models was assessed using the above-mentioned indices (R-RMSEA, SRMR, R-CFI, and TLI) and the equivalence of the models through the change in the Satorra-Bentler scaled chi-square statistic (ΔS-Bχ2) with p > 0.05 and in the Comparative Fit Index (ΔCFI) with differences > −0.01 (Cheung and Rensvold, 2002).
Third, the critical ratio (CR) was used to assess the existence of significant differences in the latency of means in parents across age, gender of the children and the parent who completed the scale (significant difference, -1.96 > CR > 1.96; Tsaousis and Kazi, 2013). The effect size was calculated using Cohen’s d statistic (Fritz et al., 2012). Regarding the age of the child, the scores of the parents with younger children in each of the three comparisons that were made were set to zero (8, 9, and 10 years, respectively). Regarding gender, the scores of the parents of the boys were set to zero to compare them with the scores of the parents of the girls. Regarding the person who completed the questionnaires, two comparisons were made in which the mothers and fathers, respectively, were taken as reference.
Finally, Student’s t-test was used to analyze the differences between the scores of the parents and the children on the scale, and the Pearson correlation (interclass correlation coefficient) was used to compare the scores of the child and the parents.
The analyses described were carried out with the SPSS program, version 20, and with the EQS program, version 6.1.
Results
Confirmatory Factor Analysis
The model with four correlated factors was the one that obtained the best fit and adequate indices (Table 2). Table 3 shows the correlation coefficients between the factors and with the total score of the CSAS-P. Graphic representation of the 4-factor model of the CSAS-P with the factor loadings, the associated standard errors and the correlations among factors are shown in Figure 2.
Reliability
The coefficients omega were: 0.92 for the CSAS-P, 0.86 for Factor 1 Worry, 0.77 for Factor 2 Opposition, 0.72 for Factor 3 Calm, and 0.62 for Factor 4 Distress. The test-retest reliability coefficients were: 0.72 for the CSAS-P, 0.68 for Factor 1 Worry, 0.68 for Factor 2 Opposition, 0.58 for Factor 3 Calm, and 0.56 for Factor 4 Distress.
Factor Invariance Across Child’s Age and Gender
Tables 4–6 show that the invariance models analyzed presented a good fit according to the indices used. The requirements that no ΔS-Bχ2 value was statistically significant and that ΔCFI values were greater than −0.01 were also met. Therefore, the measurement and structure invariance were confirmed for the CSAS-P of 4 correlated factors based on the age and gender of the child and the parent who completed the scale.
Latent Mean Differences Across Child’s and Parent’s Age and Gender
Regarding the age of the child, the statistics of the latent mean structures were adequate. Taking 8 years as a reference: S-B χ2 = 1555.156, df = 732, p < 0.000; R-RMSEA = 0.017, CI = 0.016, 0.018; SRMR = 0.049; R-CFI = 0.944; TLI = 0.933; 9 years as a reference: S-B χ2 = 1171.501, df = 541, p < 0.000; R-RMSEA = 0.020, CI = 0.018, 0.021; SRMR = 0.049; R-CFI = 0.942; TLI = 0.931; 10 years as a reference: S-Bχ2 = 754.572, df = 350, p < 0.000; R-RMSEA = 0.024, CI = 0.022, 0.026; SRMR = 0.048; R-CFI = 0.942, TLI = 0.931. In relation to the child’s gender, adequate fit indices were also obtained, taking as reference the boys: S-Bχ2 = 1140.901, df = 350, p < 0.000; R-RMSEA = 0.024, CI = 0.023, 0.026; SRMR = 0.045; R-CFI = 0.943; TLI = 0.932. Finally, the fit indices referring to the parent who had answered the CSAS-P were adequate. Taking the mothers as a reference: S-Bχ2 = 1253.279, df = 541, p < 0.000; R-RMSEA = 0.019, CI = 0.017, 0.020; SRMR = 0.056; R-CFI = 0.950; TLI = 0.940; taking the fathers as reference: S-Bχ2 = 598,171, df = 350, p < 0.000; R-RMSEA = 0.026, CI = 0.022, 0.029; SRMR = 0.060; R-CFI = 0.937; TLI = 0.924.
As can be seen in Table 7, the age differences were scarce and of minimal size (d < 0.28); the general pattern was that older children scored higher on Worry and younger children on Distress from. Girls scored higher on all factors, except for Calm, although the gender difference was small. The differences depending on the parent who completed the CSAS-P were also small and there was no clear pattern.
Parent-Child Agreement
The correlation coefficient between CSAS (child) and CSAS-P (parents) was r = 0.28 and between the respective factors on both scales: r = 0.15 Worry, r = 0.31 Opposition, r = 0.13 Calm, and r = 0.17 Distress. These coefficients, although significant, were low (0.10 ≤ r ≤ 0.30), except for the Opposition factor, which was medium (0.30 ≤ r ≤ 0.50) (Cohen, 1988). Parents scored significantly lower than the child on all factors on the scale, except for Calm. Disagreement was large (d ≥ 0.80) in Worry and Calm, moderate (0.50 ≤ d < 0.80) in Distress, and small (0.20 ≤ d < 0.50) in Opposition. The difference was greater than a point and a half in three items related to the child’s concern for their health and well-being: Item 18 (“Is your child worried about his/her health?” [1.96]), Item 16 (“Is your child worried about something bad happening to them?” [1.73]), and Item 20 (“Is your child worried about having an accident?” [1.51]). On the contrary, the highest degree of agreement between the child and the parents was found in Item 2 (“Does your child protest if you or your partner, tell him that you are going out?” [−0.06]), Item 7 (“Does your child complain of a tummy ache when he/she is separated from you or her partner? [0.23]), and Item 14 (“Does your child cry when you or your partner say goodbye to him at school? [0.23]) (see Table 8).
Discussion
The CSAS-P is based on the three-dimensional theory of Lang (1968), which states that anxiety manifests through three related systems, giving rise to different response profiles depending on the predominant system: cognitive if concern has greater weight, psychophysiological if discomfort predominates, and behavioral if the most relevant aspect is escape/avoidance. Martínez-Monteagudo et al. (2012) state that it is appropriate to evaluate these three dimensions to plan the treatment. In this sense, the CSAS-P represents a contribution to the existing instruments, because the SAAI-P is limited to escape/avoidance behavior, a dimension that is not explicitly addressed in the SAAS-P (Figure 3). On another hand, the psychologists who assessed the original bank of items recommended including positive items to control the tendency to respond negatively and, contrary to expectations, when inverting the score, the positive items were not distributed among the negative factors, but rather emerged in a new factor, Calm (Méndez et al., 2008). In studies on the Personal Report of Confidence as Speaker (Paul, 1966) in the adolescent population, our research team found that confidence did not equate to a low level or absence of fear, but instead, self-confidence referred to the enjoyment of speaking. In other words, the experience was not only not scary or neutral, but reinforcing (Méndez et al., 1999, 2004).
Internal consistency for the CSAS-P and the Worry factor was good (Cronbach’s α > 0.80) and adequate for the other factors (Cronbach’s α > 0.70), values similar to those obtained with the SAAI-P, (0.75 ≤ α ≤ 0.87) and SAAS-P (0.70 ≤ α ≤ 0.84). The temporal stability of the CSAS-P was adequate, although it presented some deficiencies in the Calm and Distress factors (0.55 ≤ r ≤ 0.65). It should be investigated whether the joint completion of the scale by both parents introduces a source of variability in the answer in a significant proportion of cases because the degree of agreement between the mother and the father on the child’s internalized problems is modest (Stanger and Lewis, 1993).
Unlike SAAI-P and SAAS-P, the CSAS-P focuses on pre-adolescence, “a neglected population” (Cartwright-Hatton et al., 2006). A study with schoolchildren revealed that, from the age of 11, there was a generalized decrease in excessive fear, defined as twice the standard deviation above the mean in the Inventory of Fears, by Sosa et al. (1993), both on the intensity and the number of excessive fears; the fear of being separated from the parents increased notably in pre-adolescence: 4.48% (7 years), 9.76-11.11% (8-11 years), 5.10% (12 years) (Méndez et al., 2003).
Not only the increase in separation anxiety in pre-adolescence justifies the development of an instrument for this age group, but also the evolution of its manifestations. González (2003) analyzed the parents’ responses to the Early Onset Separation Anxiety Questionnaire, finding three dimensions: separation anxiety due to the loss or harm of a loved one (e.g., “If you or your partner have been admitted to the hospital, has your child shown excessive signs of anxiety?”); sleep-related separation anxiety (e.g., “If your child wakes up during the night, does he/she call you insistently and you have to go to his/her room to calm him/her down?”); and separation anxiety about everyday events (e.g., “If you are separated from your child to attend a social event [dinner, wedding, etc.], is your child eager for you to come home or does he/she feel the urge to phone you?”). That is, the dimensions referred to the situation (variable E), not to the reaction (variable R).
Our findings on age and gender differences in separation anxiety are consistent with the literature on the subject. The symptoms of separation anxiety diminish with age. Compton et al. (2000) found significantly higher levels in a community sample in the 8-12-year-old group than in the 13-19-year-old group. However, when the age range is reduced, the differences are usually small. The only difference of medium size that Orgilés et al. (2011) found was between the extreme ages of the recruited school sample, 8 and 11 years; younger children scored higher, especially in discomfort. Similarly, in the general population, separation anxiety symptoms are more frequent in the female gender (Orgilés et al., 2003), although again, this difference is small (Orgilés et al., 2012b).
The correlation between the child’s and parents’ scores was low. Studies of other separation anxiety scales with community pre-adolescent samples show similar results: r = 0.26 SAAS (Orenes, 2015), r = 0.36 MASC (Baldwin and Dadds, 2007), r = 0.27 SCARED (Cosi et al., 2010), and r = 0.16 SCAS (Ishikawa et al., 2014), data that corroborate the conclusion that “in general, parent-child and parent-parent concordance is low for internalizing symptoms, especially for domains that are relatively less observable by parents” (March and Parker, 2004, p. 48). Parent-child disagreement was greater in concern and lower in behaviors such as protesting, complaining, or crying, consistent with the greater degree of agreement in observable symptoms than in unobservable ones (Comer and Kendall, 2004).
Our research was carried out with a school population. Future studies should examine the psychometric properties of the CSAS-P with clinical samples, where parent-child agreement is usually higher. Arendt et al. (2014) obtained correlation coefficients of 0.45 and 0.60 for the SCAS Separation Anxiety Scale both in community and clinical samples.
In our study, carried out within the framework of the multi-source evaluation, and the child and the parents (or the main attachment figures) both participated but the evaluation was reduced to a single instrument. Future research should overcome this limitation and calculate the convergent validity of the CSAS-P with other measures of separation anxiety, as well as the sensitivity and specificity of the scale through a clinical interview.
Data Availability Statement
The datasets presented in this article are not readily available because Institutional regulations. Requests to access the datasets should be directed to JG-F, am9zZW1hZ2ZAdWEuZXMu
Ethics Statement
The studies involving human participants were reviewed and approved by University of Alicante. The patients/participants provided their written informed consent to participate in this study.
Author Contributions
All authors participated in the design of the study, the analysis and interpretation of the data, the writing of the initial version of the manuscript, and approval of the final version.
Funding
This research was supported by the Spanish National Plan for Research, Development and Technological Innovation Grant (EDU2008-05060) awarded to XM.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
Achenbach, T. M., McConaughy, S. H., and Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: implications of cross-informant correlations for situational specificity. Psychol. Bull. 101, 213–232. doi: 10.1037/0033-2909.101.2.213
Allen, J. L., Lavallee, K., Herren, C., Ruhe, J., and Schneider, S. (2010). DSM-IV criteria for childhood separation anxiety disorder: informant, age, and sex differences. J. Anxiety Disord. 24, 946–952. doi: 10.1016/j.janxdis.2010.06.022
American Psychiatric Association (2000). Diagnostic and Statistical Manual of Mental Disorders, 4th Edn. Washington, DC: American Psychiatric Association, 866.
American Psychiatric Association (2013). Diagnostic and Statistical Manual of Mental Disorders, 5th Edn. Arlington, VA: American Psychiatric Association, 991.
Arendt, K., Hougaard, E., and Thastum, M. (2014). Psychometric properties of the child and parent versions of Spence children’s anxiety scale in a Danish community and clinical sample. J. Anxiety Disord. 28, 947–956. doi: 10.1016/j.janxdis.2014.09.021
Aschenbrand, S., Kendall, P., Webb, A., Safford, S., and Flannery-Schroeder, E. (2003). Is childhood separation anxiety disorder a predictor of adult panic disorder and agoraphobia? A seven-year longitudinal study. J. Am. Acad. Child Adolesc. Psychiatry 42, 1478–1485. doi: 10.1097/00004583-200312000-00015
Baldwin, J. S., and Dadds, M. R. (2007). Reliability and validity of parent and child versions of the multidimensional anxiety scale for children in community samples. J. Am. Acad. Child Adolesc. Psychiatry 46, 252–260. doi: 10.1097/01.chi.0000246065.93200.a1
Beesdo, K., Knappe, S., and Pine, D. S. (2009). Anxiety and anxiety disorders in children and adolescents: developmental issues and implications for DSM-V. Psychiatr. Clin. North Am. 32, 483–524. doi: 10.1016/j.psc.2009.06.002
Bentler, P. M. (2006). EQS Structural Equations Program Manual. Encino, CA: Multivariate Software, 418.
Biederman, J., Petty, C. R., Hirshfeld-Becker, D. R., Henin, A., Faraone, S. V., Fraire, M., et al. (2007). Developmental trajectories of anxiety disorders in offspring at high risk for panic disorder and major depression. Psychiatry Res. 153, 245–252. doi: 10.1016/j.psychres.2007.02.016
Birmaher, B., Khetarpal, S., Brent, D., Cully, M., Balach, L., Kaufman, J., et al. (1997). The Screen for Child Anxiety Related Emotional Disorders (SCARED): scale construction and psychometric characteristics. J. Am. Acad. Child Adolesc. Psychiatry 36, 543–553. doi: 10.1097/00004583-199704000-00018
Bittner, A., Egger, H. L., Erkanli, A., Costello, E. J., Foley, D. L., and Angold, A. (2007). What do childhood anxiety disorders predict? J. Child Psychol. Psychiatry 48, 1174–1183. doi: 10.1111/j.1469-7610.2007.01812.x
Brown, T. A. (2006). Confirmatory Factor Analysis for Applied Research. New York, NY: Guilford Press, 462.
Brückl, T. M., Wittchen, H.-U., Höfler, M., Pfister, H., Schneider, S., and Lieb, R. (2007). Childhood separation anxiety and the risk of subsequent psychopathology: results from a community study. Psychother. Psychosom. 76, 47–56. doi: 10.1159/000096364
Byrne, B. M. (2006). Structural Equation Modeling with EQS: Basic Concepts, Applications, and Programing, 2nd Edn. New York, NY: Lawrence Erlbaum, 439.
Byrne, B. M. (2008). Testing for multigroup equivalence of a measuring instrument: a walk through the process. Psicothema 20, 872–882.
Cartwright-Hatton, S., Mcnicol, K., and Doubleday, E. (2006). Anxiety in a neglected population: prevalence of anxiety disorders in pre-adolescent children. Clin. Psychol. Rev. 26, 817–832. doi: 10.1016/j.cpr.2005.12.002
Cheung, G. W., and Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Struct. Equ. Modeling 9, 233–255. doi: 10.1207/S15328007SEM0902_5
Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences, 2nd Edn. New York, NY: Lawrence Erlbaum, 567.
Comer, J. S., and Kendall, P. C. (2004). A symptom-level examination of parent–child agreement in the diagnosis of anxious youths. J. Am. Acad. Child Adolesc. Psychiatry 43, 878–886. doi: 10.1097/01.chi.0000125092.35109.c5
Compton, S. N., Nelson, A. H., and March, J. S. (2000). Social phobia and separation anxiety symptoms in community and clinical samples of children and adolescents. J. Am. Acad. Child Adolesc. Psychiatry 39, 1040–1046. doi: 10.1097/00004583-200008000-00020
Cosi, S., Canals, J., Hernández-Martinez, C., and Vigil-Colet, A. (2010). Parent–child agreement in SCARED and its relationship to anxiety symptoms. J. Anxiety Disord. 24, 129–133. doi: 10.1016/j.janxdis.2009.09.008
Eapen, V., Walter, A., and Robertson, M. M. (2018). “Heterogeneity in tics and Gilles de la Tourette syndrome,” in Understanding Uniqueness and Diversity in Child and Adolescent Mental Health, eds M. Hodes, S. S. Gau, and P. J. de Vries (London: Academic Press), 57–76. doi: 10.1016/b978-0-12-815310-9.00003-4
Egger, H., Costello, E., and Angold, A. (2003). School refusal and psychiatric disorders: a community study. J. Am. Acad. Child Adolesc. Psychiatry 42, 797–807. doi: 10.1097/01.CHI.0000046865.56865.79
Eisen, A. R., and Schaefer, C. E. (2005). Separation anxiety in children and Adolescents: an Individualized Approach to Assessment and Treatment. New York, NY: Guilford Press, 298.
Essau, C. A., Lewinsohn, P. M., Lim, J. X., Moon-ho, R. H., and Rohde, P. (2018). Incidence, recurrence and comorbidity of anxiety disorders in four major developmental stages. J. Affect. Disord. 228, 248–253. doi: 10.1016/j.jad.2017.12.014
Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., and Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychol. Methods 4, 272–299. doi: 10.1037/1082-989X.4.3.272
Fornander, M. J., and Kearney, C. A. (2020). Internalizing symptoms as predictors of school absenteeism severity at multiple levels: ensemble and classification and regression tree analysis. Front. Psychol. 10:3079. doi: 10.3389/fpsyg.2019.03079
Francis, G., Last, C. G., and Strauss, C. C. (1987). Expression of separation anxiety disorder: the roles of age and gender. Child Psychiatry Hum. Dev. 18, 82–89. doi: 10.1007/BF00709952
Fritz, C. O., Morris, P. E., and Richler, J. J. (2012). Effect size estimates: current use, calculations, and interpretation. J. Exp. Psychol. Gen. 141, 2–18. doi: 10.1037/a0024338
González, M. C. (2003). Elaboración y Validación del Cuestionario de Ansiedad por Separación de Inicio Temprano [Elaboration and Validation of the Early Onset Separation Anxiety Questionnaire]. Doctoral dissertation. Murcia: University of Murcia.
Gonzálvez, C., Inglés, C. J., Martínez-Palau, A., Sanmartín, R., Vicent, M., and García-Fernández, J. M. (2019). Child and adolescent social adaptive functioning scale: factorial invariance, latent mean differences, and its impact on school refusal behavior in Spanish children. Front. Psychol. 10:1894. doi: 10.3389/fpsyg.2019.01894
Hayward, C., Wilson, K., Lagle, K., Killen, J., and Taylor, C. (2004). Parent-reported predictors of adolescent panic attacks. J. Am. Acad. Child Adolesc. Psychiatry 43, 613–620. doi: 10.1097/00004583-200405000-00015
Hu, L. T., and Bentler, P. M. (1999). Cut off criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct. Equ. Modeling 6, 1–55. doi: 10.1080/10705519909540118
In-Albon, T., Meyer, A., and Schneider, S. (2013). Separation anxiety avoidance inventory-child and parent version: psychometric properties and clinical utility in a clinical and school sample. Child Psychiatry Hum. Dev. 44, 689–697. doi: 10.1007/s10578-013-0364-z
Ishikawa, S. I., Shimotsu, S., Ono, T., Sasagawa, S., Kondo-Ikemura, K., Sakano, Y., et al. (2014). A parental report of children’s anxiety symptoms in Japan. Child Psychiatry Hum. Dev. 45, 306–317. doi: 10.1007/s10578-013-0401-y
Kazdin, A. E. (1988). The diagnosis of childhood disorders: assessment issues and strategies. Behav. Assess. 10, 67–94.
Keller, M. B., Lavori, P. W., Wunder, J., Beardslee, W. R., Schwartz, C. E., and Roth, J. (1992). Chronic course of anxiety disorder in children and adolescents. J. Am. Acad. Child Adolesc. Psychiatry 31, 595–599. doi: 10.1097/00004583-199207000-00003
Kline, R. B. (2013). Beyond Significance Testing: Statistics Reform in the Behavioral Sciences, 2nd Edn. Washington, DC: American Psychological Association, 349.
Lang, K. M., and Little, T. D. (2018). Principled missing data treatments. Prev. Sci. 19, 284–294. doi: 10.1007/s11121-016-0644-5
Lang, P. J. (1968). “Fear reduction and fear behavior: problems in treating a construct,” in Research in Psychotherapy, ed. J. M. Shlien (Washington, DC: American Psychological Association), 90–102. doi: 10.1037/10546-004
Lewinsohn, P., Holm-Denoma, J., Small, J., Seeley, J., and Joiner, T. (2008). Separation anxiety disorder in childhood as a risk factor for future mental illness. J. Am. Acad. Child Adolesc. Psychiatry 47, 548–555. doi: 10.1097/CHI.0b013e31816765e7
Liu, W., Lei, H., Li, L., Yi, J., Zhong, M., Yang, Y., et al. (2015). Factorial invariance of the mood and anxiety symptom questionnaire-short form across gender. Pers. Individ. Dif. 87, 136–140. doi: 10.1016/j.paid.2015.07.036
March, J. S., and Parker, J. D. A. (2004). “The multidimensional anxiety scale for children (MASC),” in The use of Psychological Testing for Treatment Planning and Outcomes Assessment, Volume 2 Instruments for Children and Adolescents, 3rd Edn, ed. M. E. Maruish (Mahwah, NJ: Lawrence Erlbaum), 39–62. doi: 10.4324/9781410610621-2
March, J. S., Parker, J. D. A., Sullivan, K., Stallings, P., and Conners, K. (1997). The multidimensional anxiety scale for children (MASC): factor structure, reliability, and validity. J. Am. Acad. Child Adolesc. Psychiatry 36, 554–565. doi: 10.1097/00004583-199704000-00019
Martínez-Monteagudo, M. C., Inglés, C. J., Cano, A., and García-Fernández, J. M. (2012). Estado actual de la investigación sobre la teoría tridimensional de la ansiedad de Lang [Current status of research on Lang’s three-dimensional theory of anxiety]. Ansiedad Estrés 18, 201–219.
Méndez, F. X., Inglés, C. J., and Hidalgo, M. D. (1999). Propiedades psicométricas del Cuestionario de Confianza para Hablar en Público: estudio con una muestra de alumnos de enseñanzas medias [Psychometric properties of the personal report of confidence as speaker: a study with a sample of secondary education]. Psicothema 11, 65–74.
Méndez, F. X., Inglés, C. J., and Hidalgo, M. D. (2004). La versión española abreviada del Cuestionario de Confianza para Hablar en Público: fiabilidad y validez en población adolescente [The shortened Spanish version of the personal report of confidence as speaker: reliability and validity in adolescent population]. Behav. Psychol. 12, 5–24.
Méndez, F. X., Inglés, C. J., Hidalgo, M. D., García-Fernández, J. M., and Quiles, M. J. (2003). Los miedos en la infancia y la adolescencia: un estudio descriptivo [Fears in childhood and adolescence: a descriptive study]. Rev. Electron. Motiv. Emot. 6, 4–16.
Méndez, X., Espada, J. P., Orgilés, M., Hidalgo, M. D., and García-Fernández, J. M. (2008). Psychometric properties and diagnostic ability of the separation anxiety scale for children (SASC). Eur. Child Adolesc. Psychiatry 17, 365–372. doi: 10.1007/s00787-008-0678-8
Méndez, X., Espada, J. P., Orgilés, M., Llavona, L. M., and García-Fernández, J. M. (2014). Children’s separation anxiety scale (CSAS): psychometric properties. PLoS One 9:e103212. doi: 10.1371/journal.pone.0103212
Mohammadi, M. R., Badrfam, R., Khaleghi, A., Hooshyari, Z., Ahmadi, N., and Zandifar, A. (2020). Prevalence, comorbidity and predictor of separation anxiety disorder in children and adolescents. Psychiatr. Q. 91, 1415–1429. doi: 10.1007/s11126-020-09778-7
Orenes, A. (2015). Evaluación de la Ansiedad por Separación y Prevención de las Dificultades Emocionales [Assessment of Separation Anxiety and Prevention of Emotional Difficulties]. Doctoral dissertation. Murcia: University of Murcia.
Orgilés, M., Espada, J. P., García-Fernández, J. M., and Méndez, X. (2009). Relación entre miedos escolares y síntomas de ansiedad por separación infantil [Relationship between school fears and separation anxiety symptoms in children]. Rev. Mex. Psicol. 26, 17–25.
Orgilés, M., Espada, J. P., García-Fernández, J. M., Méndez, X., and Hidalgo, M. D. (2011). Most feared situations related to separation anxiety and characteristics by age and gender in late childhood. An. Psicol. 27, 80–85.
Orgilés, M., Méndez, X., Spence, S. H., Huedo-Medina, T. B., and Espada, J. P. (2012a). Spanish validation of the Spence children’s anxiety scale. Child Psychiatry Hum. Dev. 43, 271–281. doi: 10.1007/s10578-011-0265-y
Orgilés, M., Méndez, X., Espada, J. P., Carballo, J. L., and Piqueras, J. A. (2012b). Síntomas de ansiedad en niños y adolescentes: diferencias en función de la edad y el sexo en una muestra comunitaria [Anxiety disorder symptoms in children and adolescents: differences by age and gender in a community simple. Rev. Psiquiatr. Salud Ment. 5, 115–120. doi: 10.1016/j.rpsm.2012.01.005
Orgilés, M., Méndez, X., Rosa, A. I., and Inglés, C. J. (2003). La terapia cognitivo-conductual en problemas de ansiedad generalizada y ansiedad por separación: un análisis de su eficacia [Cognitive-behavioral therapy for generalized anxiety and separation anxiety disorders: an analysis of the effectiveness]. An. Psicol. 19, 193–204.
Paul, G. L. (1966). Insight vs Desensitization in Psychotherapy. Stanford, CA: Stanford University Press, 148.
Samuel, D. B., South, S. C., and Griffin, S. A. (2015). Factorial invariance of the five-factor model rating form across gender. Assessment 22, 65–75. doi: 10.1177/1073191114536772
Satorra, A., and Bentler, P. M. (2001). A scaled difference chi-square test statistic for moment structure analysis. Psychometrika 66, 507–514. doi: 10.1007/BF02296192
Shear, K., Jin, R., Ruscio, A. M., Walters, E. E., and Kessler, R. C. (2006). Prevalence and correlates of estimated DSM-IV child and adult separation anxiety disorder in the national comorbidity survey replication (NCS-R). Am. J. Psychiatry 163, 1074–1083. doi: 10.1176/appi.ajp.163.6.1074
Silove, D., Marnane, C., Wagner, R., Manicavasagar, V., and Rees, S. (2010). The prevalence and correlates of adult separation anxiety disorder in an anxiety clinic. BMC Psychiatry 10:21. doi: 10.1186/1471-244X-10-21
Sosa, C. D., Capafons, J. I., Conesa-Peraleja, M. D., Martorell, M. C., Silva, F., and Navarro, A. M. (1993). “Inventario de miedos (IM),” in EPIJ: Evaluación de la Personalidad Infantil y Juvenil [Assessment of Child and Youth Personality], Vol. III, eds F. Silva and C. Martorell (Madrid: MEPSA), 99–124.
Spence, S. H. (1997). Structure of anxiety symptoms among children: a confirmatory factor-analytic study. J. Abnorm. Child Psychol. 106, 280–297. doi: 10.1037/0021-843X.106.2.280
Stanger, C., and Lewis, M. (1993). Agreement among parents, teachers, and children on internalizing and externalizing behavior problems. J. Clin. Child Psychol. 22, 107–115. doi: 10.1207/s15374424jccp2201_11
Tsaousis, I., and Kazi, S. (2013). Factorial invariance and latent mean differences of scores on trait emotional intelligence across gender and age. Pers. Individ. Dif. 54, 169–173. doi: 10.1016/j.paid.2012.08.016
Verduin, T., and Kendall, P. (2003). Differential occurrence of comorbidity within childhood anxiety disorders. J. Clin. Child Adolesc. Psychol. 32, 290–295. doi: 10.1207/S15374424JCCP3202_15
Vigil-Colet, A., Canals, J., Cosí, S., Lorenzo-Seva, U., Ferrando, P. J., Hernández-Martínez, C., et al. (2009). The factorial structure of the 41-item version of the screen for child anxiety related emotional disorders (SCARED) in a Spanish population of 8 to 12 years-old. Int. J. Clin. Health Psychol. 9, 313–327.
Keywords: children, separation anxiety, psychometric adaptation, parents, assessment
Citation: Méndez X, Espada JP, Ortigosa JM and García-Fernández JM (2022) Validation of the Children’s Separation Anxiety Scale – Parent Version (CSAS-P). Front. Psychol. 13:783943. doi: 10.3389/fpsyg.2022.783943
Received: 27 September 2021; Accepted: 01 March 2022;
Published: 05 April 2022.
Edited by:
María Roncero, University of Valencia, SpainReviewed by:
Javier Fenollar Cortés, Loyola University Andalusia, SpainSilje Hukkelberg, The Norwegian Center for Child Behavioral Development (NCCBD), Norway
Copyright © 2022 Méndez, Espada, Ortigosa and García-Fernández. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Xavier Méndez, eG1lbmRlemNAdW0uZXM=