This article is a commentary on:
Commentary: Parent-Reported Behavioral and Psychiatric Problems Mediate the Relationship between Sleep-Disordered Breathing and Cognitive Deficits in School-Aged Children
Dale L. Smith
David Gozal
Scott J. Hunter2,3
Leila Kheirandish-Gozal- 1Department of Psychology, Olivet Nazarene University, Bourbonnais, IL, United States
- 2Department of Pediatrics, Pritzker School of Medicine, Biological Sciences Division, The University of Chicago, Chicago, IL, United States
- 3Department of Psychiatry and Behavioral Neuroscience, Pritzker School of Medicine, Biological Sciences Division, The University of Chicago, Chicago, IL, United States
A commentary on
We appreciate the opportunity to further discuss our recent study on the potential for behavioral and psychiatric functioning to mediate the relationship between sleep-disordered breathing (SDB) and cognitive functioning (1), in the context of the recent commentary raising various critiques on this report (2). In the following paragraphs, it will become clear that such commentary unfortunately falls outside the realm of providing substantive and informative reporting based on an adequate understanding of the current state of sleep medicine as it pertains to SDB in children, neuropsychological assessment, or current practices in statistics.
The bulk of concerns as raised by Barwick and Guilleminault appears to involve our use of several highly validated scales of behavioral and cognitive functioning in children. In support of their arguments, the authors take the somewhat confusing and misleading stance that our discussion of the wide applicability of these measures to various clinical populations does not necessarily imply that such measures are adequate or extensively validated in our population involving sleep-disordered children. A cursory examination of the recent literature in this field should illustrate the common clinical use and relevance of these measures to this child sleep medicine [e.g., review articles such as Ref. (3–5)]. In addition, although concerns regarding use of individual subscores are not particularly novel, the authors gloss over how these measures were used in our report and seem out of touch with how they are currently being extensively applied in this field. We should first state that inferences were never made based exclusively on any of these individual subtests in our report but were instead made regarding general domains, within which these measures have been shown to provide valid information alongside other associated measures. Furthermore, the authors appear to rely on inadequate review of the years of research that has been conducted and subsequently published in peer-reviewed contexts, within the domains of developmental psychopathology, pediatric neuropsychology, adult clinical neuropsychology and psychopathology, and in collaborative research within medicine, where the examination of groups of single test performances as well as aggregate factors from the measures utilized, such as has been done with our studies, are in fact the norm when addressing components of both cognitive and behavioral status. The authors interestingly choose to reference both Wechsler and Sattler [from their citations (2, 3)], ignoring that neither of these individuals ever discussed that research concerning cognitive and behavioral domains of functioning should not be examined at both the individual subtest and aggregate factor level, as we have done with our studies. In fact, what Wechsler and Sattler discuss is the importance of looking at aggregate information when making clinical decisions, and not research inferences, something we agree with as well. They also do not reference other informative psychometricians within neuropsychology (i.e., it is important to recognize that neither Sattler nor Wechsler were neuropsychologists), who have addressed how research addressing cognition and behavior can be well informed by the examination of sets of appropriate data [e.g., Ref. (6–10)]. Furthermore, none of the papers referenced by Barwick and Guilleminault expressed any specific rationale as to why both subtest performances and aggregates of subtests contributing to the factors of broader interest could not be useful information and provide informative data regarding cognitive capacities; indeed, they do not address how measures are utilized for research purposes at all. Similarly, while Achenbach’s and Conner’s measures are developed to provide information at a global level, they also have a long standing history of consideration at the individual domain level [e.g., Anxiety; Disruptive Behavior; and Attention (11–14)], particularly with regard to psychopathology and behavioral functioning. The wealth of articles published in premier peer-reviewed journals, including those with some of the highest impact factors in the developmental neuropsychology field (e.g., Child Development; Pediatrics; NEJM; and The Lancet) that includes consideration of subtest and aggregate subscale data is substantial [e.g., Ref. (12, 15–17)], which includes a paper utilizing a single Conner’s hyperactivity subscore as an outcome that was in fact coauthored by Guilleminault (18). That such extensive implementation of such approaches is ignored or glossed-over by Barwick and Guilleminault is unfortunate and misrepresents how researchers in clinical domains frequently and appropriately make use of cognitive and behavioral assessment measures.
Also misleading is the authors’ contention that the plausibility of other model specifications (e.g., cognition as a mediator) was simply not assessed or addressed in our report. Their acknowledged of lack of statistical sophistication could certainly obviate forgiveness for ignoring a cardinal rule for model building; that sound and defensible theory should guide model creation, rather than building such models exclusively on fallible tests of significance or model fit. However, this does not excuse the failure to acknowledge that such alternate model specifications were indeed conducted and were explicitly addressed in our report as footnote #1. These theoretical constructs were explored to ensure defensibility of our proposed model and were found to be inferior at ascertaining mediational effects compared with the a priori mediation model that formed the basis for our publication (e.g., non-significant mediational pathways for nearly all iterations of SDB when examining cognition as a mediator).
Barwick and Guilleminault further point to modest relationships between SDB and behavior and cognitive functioning as if the presence of such relationship falling below a specific threshold of strength suggests problems in relevance or explanatory power. This criticism ignores the fundamental notion that a large and highly variable number of factors likely contributes to differences in the context of complex psychological constructs. It is thus unrealistic to expect that the proportion of the variability in behavior or cognition that may be accounted for by clinical factors in any field will be more than simply modest. If as low as 5% of the variability in behavioral or cognitive functioning can be explained by SDB, or could be improved through clinical intervention of related conditions, this would certainly constitute a relevant topic for clinical consideration. Although larger sample sizes can, of course, detect smaller relationships (e.g., a sample of equivalent size to ours could detect correlations as low as r = 0.035 with 0.8 power, far smaller than those in our report), post hoc naïve regression analyses indicated that SDB status and behavior accounted for greater than 5–10% of the variability in cognition in most iterations of both adjusted and unadjusted models. It is certainly important to be wary of those who may abuse the power inherent to large sample sizes in significance testing; however, expectations that the majority of the variance in cognition, behavior, or psychiatric outcomes will be attributable to sleep pathology suggest poor understanding of this field.
Other analytic concerns that Barwick and Guilleminault raise generally exist for all observational research studies (e.g., omitted variables and potential confounding) and are certainly important to consider in utilizing mediation analyses. However, these were already extensively addressed in our report, making the necessity of reiterating them in a separate commentary questionable. Furthermore, the notion that the possibility of existent unadjusted confounders renders an analytic approach that utilized several existing mediation methods and variable characterizations along with a relevant sensitivity analysis “incomplete” seems out of touch with the realities of virtually all applications of observational research. We appreciate the authors’ attempts to encourage dialog and critical thought regarding this important topic, as this is obviously a vitally important part of the peer review process and the hallmark of progress and scientific understanding. However, when such commentaries contain inaccuracies, are out of touch with current practices or expectations in the field of interest, or simply re-report possible limitations that were already addressed in the original publication, their utility is unfortunately diminished.
Author Contributions
All authors listed have made a substantial, direct, and intellectual contribution to the work and approved it for publication.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Funding
This research was supported by National institutes of Health grants HL65270 and HL130984.
References
1. Smith DL, Gozal D, Hunter SJ, Kheirandish-Gozal L. Parent-reported behavioral and psychiatric problems mediate the relationship between sleep-disordered breathing and cognitive deficits in school-aged children. Front Neurol (2017) 8:410. doi:10.3389/fneur.2017.00410
2. Barwick F, Guilleminault C. Commentary: parent-reported behavioral and psychiatric problems mediate the relationship between sleep-disordered breathing and cognitive deficits in school-aged children. Front Neurol (2017) 8:597. doi:10.3389/fneur.2017.00597
3. Owens JA. Neurocognitive and behavioral impact of sleep disordered breathing in children. Pediatr Pulmonol (2009) 44(5):417–22. doi:10.1002/ppul.20981
4. Sedky K, Bennett DS, Carvalho KS. Attention deficit hyperactivity disorder and sleep disordered breathing in pediatric populations: a meta-analysis. Sleep Med Rev (2014) 18(4):349–56. doi:10.1016/j.smrv.2013.12.003
5. Chinnadurai S, Jordan AK, Sathe NA, Fonnesbeck C, McPheeters ML, Francis DO. Tonsillectomy for obstructive sleep-disordered breathing: a meta-analysis. Pediatrics (2017) 139:e20163491. doi:10.1542/peds.2016-3491
6. Bagiella E, Novack TA, Ansel B, Diaz-Arrastia R, Dikmen S, Hart T, et al. Measuring outcome in traumatic brain injury treatment trials: recommendations from the traumatic brain injury clinical trials network. J Head Trauma Rehabil (2010) 25(5):375–82. doi:10.1097/HTR.0b013e3181d27fe3
7. Falautano M. Neuropsychological assessment: experimental and clinical research. Neurol Sci (2010) 31(Suppl 2):S223–6. doi:10.1007/s10072-010-0371-9
8. Green MF, Nuechterlein KH, Gold JM, Barch DM, Cohen J, Marder SR. Approaching a consensus cognitive battery for clinical trials in schizophrenia: the NIMH-MATRICS conference to select cognitive domains and test criteria. Biol Psychiatry (2004) 56:301–7. doi:10.1016/j.biopsych.2004.06.023
9. Lezak MD, Howieson DB, Bigler ED, Tranel D. Neuropsychological Assessment. New York, NY: Oxford University Press (2012).
10. Peyser JM, Rao SM, LaRocca NG, Kaplan E. Guidelines for neuropsychological research in multiple sclerosis. Arch Neurol (1990) 47:94–7. doi:10.1001/archneur.1990.00530010120030
11. Becker SP, Ramsey RR, Byars KC. Convergent validity of the Child Behavior Checklist sleep items with validated sleep measures and sleep disorder diagnoses in children and adolescents referred to a sleep disorders center. Sleep Med (2015) 16:79–86. doi:10.1016/j.sleep.2014.09.008
12. Chang L, Wang M, Tsai P. Diagnostic accuracy of rating scales for attention-deficit/hyperactivity disorder: a meta-analysis. Pediatrics (2016) 137(3):e20152749. doi:10.1542/peds.2015-2749
13. Read KL, Settipani CA, Peterman J, Kendall PC, Compton S, Piacentini J, et al. Predicting anxiety diagnoses and severity with the CBCL-A: improvement relative to other CBCL scales? J Psychopathol Behav Assess (2015) 37(1):100–11. doi:10.1007/s10862-014-9439-9
14. Van Meter A, Youngstrom E, Youngstrom JK, Ollendick T, Demeter C, Findling RL. Clinical decision making about child and adolescent anxiety disorders using the Achenbach system of empirically based assessment. J Clin Child Adolesc Psychol (2014) 43(4):552–65. doi:10.1080/15374416.2014.883930
15. Votruba-Drzal E, Coley RL, Maldonado-Carreno C, Li-Grining C, Chase-Lansdale PL. Child care and the development of behavior problems among economically disadvantaged children in middle childhood. Child Dev (2010) 81(5):1460–74. doi:10.1111/j.1467-8624.2010.01485.x
16. Boivin MJ, Vokhiwa M, Magen JG. The correspondence validity of Malawian preschool developmental assessment and school-age neurocognitive performance in the longitudinal assessment of severe malaria. Lancet (2013) 381:S18. doi:10.1016/S0140-6736(13)61272-6
17. Marcus CL, Moore RH, Rosen CL, Giordani B, Garetz SL, Taylor HG, et al. A randomized trial of adenotonsillectomy for childhood sleep apnea. N Engl J Med (2013) 368:2366–76. doi:10.1056/NEJMoa1215881
Keywords: sleep-disordered breathing, cognition, behavior, children, mediation
Citation: Smith DL, Gozal D, Hunter SJ and Kheirandish-Gozal L (2018) Response: Commentary: Parent-Reported Behavioral and Psychiatric Problems Mediate the Relationship between Sleep Disordered Breathing and Cognitive Deficits in School-Aged Children. Front. Neurol. 9:63. doi: 10.3389/fneur.2018.00063
Received: 17 November 2017; Accepted: 24 January 2018;
Published: 13 February 2018
Edited by:
Lino Nobili, Centre of Epilepsy Surgery, Centre of Sleep Medicine, ItalyReviewed by:
F. Javier Puertas, Universitat de València, SpainCopyright: © 2018 Smith, Gozal, Hunter and Kheirandish-Gozal. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Dale L. Smith, dsmith8@olivet.edu