- Department of Psychology, University of Denver, Denver, CO, USA
Childhood poverty is a pervasive problem that can alter mental health outcomes. Children from impoverished circumstances are more likely than their middle-income counterparts to develop internalizing problems such as depression and anxiety. To date, however, the emotional-cognitive control processes that link childhood poverty and internalizing symptoms remain largely unexplored. Using the Emotion Go/NoGo paradigm, we examined the association between poverty and emotional response inhibition in middle childhood. We further examined the role of emotional response inhibition in the link between middle childhood poverty and internalizing symptoms. Lower income was associated with emotional response inhibition difficulties (indexed by greater false alarm rates in the context of task irrelevant angry and sad faces). Furthermore, emotional response inhibition deficits in the context of angry and sad distracters were further associated with child-report internalizing problems. The results of the current study demonstrate the significance of understanding the emotional-cognitive control vulnerabilities of children raised in poverty and their association with mental health outcomes.
Introduction
Poverty is a pervasive social problem that affects millions of families in the USA. Currently, over 16 million children under the age of 18 live in households that fall below the poverty line (United States Census Bureau, 2013). One of the most consistent findings in the literature is the inverse relationship between childhood poverty and mental health (Tracy et al., 2008; Evans and Cassells, 2013). The current study focuses on internalizing symptoms (i.e., symptoms of anxiety and depression) that are frequently associated with childhood economic disadvantage (Brooks-Gunn and Duncan, 1997; Murali and Oyebode, 2004; Slopen et al., 2010). The prevalence of symptoms of depression and anxiety is greater among children from low-income backgrounds (Duncan et al., 1994; Gilman et al., 2002; Murali and Oyebode, 2004). To date, however, we have limited understanding of the emotional-cognitive processes by which poverty and these internalizing symptomatologies are associated. Behavioral and neuroimaging research in both high-risk and typically developing children suggests that deficits in emotional response inhibition (i.e., the ability to inhibit a behavioral response in the context of negatively valenced emotional distracters) are associated with greater levels of childhood anxiety and depression (Tottenham et al., 2010; Kilford et al., 2015). However, few studies have examined the influence of socioeconomic disadvantages such as poverty on emotional response inhibition, which can in turn increase risks for internalizing symptoms. Thus, the goals of the present study are: (1) to investigate the relationship between family income and emotional response inhibition in middle childhood and (2) to explore the indirect effect of childhood poverty on internalizing symptoms via an emotional response inhibition pathway.
Emotional response inhibition refers to one’s ability to inhibit a pre-potent response to emotionally charged stimuli (Schulz et al., 2007, 2009). In the current study, this specifically refers to the ability to inhibit responses to irrelevant emotional information. This may also be described as the tendency to orient attention to salient but irrelevant emotional information, and subsequent difficulties disengaging attention away from these emotional stimuli. Difficulties disengaging attention away from these emotional cues can in turn affect cognitive control processes or goal directed behavior (i.e., inhibiting a response to irrelevant information). Using the Emotion Go/NoGo paradigm – a task that measures response inhibition in the context of emotional distracters, studies have found that difficulties with emotional response inhibition in the context of negatively valenced emotional distracters (i.e., angry, sad, or fearful information) can be a risk factor for anxiety and depression (Tottenham et al., 2010; Kilford et al., 2015). The Emotion Go/NoGo requires participants to rapidly respond to a set of “Go” target neutral facial expressions presented with a series of “NoGo” distracter emotional facial expressions (happy, fearful, angry, and sad), or vice versa. The number of false responses to emotional NoGo distracters serves as a primary measure of emotional response inhibition (Schulz et al., 2007, 2009). Indeed, adolescents diagnosed with depression exhibit greater response inhibition difficulties in the context of negative emotional stimuli (Kilford et al., 2015), as indexed by greater false alarm rates to sad stimuli in a modified Emotion Go/NoGo task. Using the same paradigm, Tottenham et al. (2010) found that response inhibition difficulties in the context of negatively valenced facial expressions (averaged across fearful, angry, and sad faces) are associated with early adversity exposure (i.e., being previously institutionalized), amygdala hypertrophy, and anxiety symptoms in middle childhood.
As suggested by the Tottenham et al. (2010) study, being previously institutionalized is an important model of early adversity. However, it is an extreme and relatively atypical experience for most children. To date, there is little understanding of whether relatively typical examples of early adversity such as poverty may be associated with deficits in emotional response inhibition. However, existing literature provides consistent evidence of the negative effects of poverty on cognitive and emotional processes. Several neuroimaging studies have demonstrated the link between childhood socioeconomic disadvantage and anatomical and functional changes to brain regions involved in emotion processing of negative information (such as angry or fearful faces), including the amygdala (Gianaros et al., 2008; Hackman et al., 2010; Noble et al., 2012; Luby et al., 2013). In addition, childhood poverty has also been associated with altered structural and functional changes in brain regions that are related to difficulties in emotion regulation in response to negative social cues, including the prefrontal cortex (Kim et al., 2013; Javanbakht et al., 2015; Liberzon et al., 2015). These imaging findings are consistent with physiological and behavioral evidence suggesting heightened sensitivity to negative emotional information (Evans and Kim, 2007; Evans et al., 2013), and greater negative affect among poor children (Murali and Oyebode, 2004; Barajas et al., 2007; Tracy et al., 2008; Najman et al., 2010). Currently, however, less is known about how heightened sensitivity to negative emotional information interact with cognitive function. Childhood poverty exposure has been associated with inhibitory control difficulties (Spielberg et al., 2015), but whether such difficulties may be influenced by emotional context is largely unknown. Thus, the current study aims to examine how emotional sensitivity to negative emotional information among children who are exposed to poverty may disrupt inhibitory control. Understanding the links between poverty and emotional response inhibition would be significant because deficit in emotional response inhibition has been associated with internalizing problems in children and adults (Tottenham et al., 2010; Pacheco-Unguetti et al., 2012; Kilford et al., 2015).
In the present study, we investigate the role of emotional response inhibition in the relationship between family income and internalizing symptoms in middle childhood. Middle childhood is a particularly vulnerable developmental period when early symptoms of depression and anxiety emerge but largely predate clinical diagnosis (Costello et al., 2005; Thapar et al., 2012). Thus, understanding the associations between family income and emotional response inhibition processes at this developmental stage may have implications for prevention efforts before symptoms fully develop into clinical disorders during adolescence. We hypothesize that family income will be negatively associated with internalizing symptoms. We also hypothesize that family income will be negatively associated with emotional response inhibition, such that children from lower-income households will exhibit response inhibition problems (i.e., greater false alarm rates) in the context of task irrelevant negative facial expressions. We further hypothesize that emotional response inhibition problems among poor children will be further associated with greater internalizing problems.
Materials and Methods
Participants
Children and their biological mothers were recruited from the University of Denver’s volunteer database and through flyer distribution around Denver metro area public schools and anti-poverty programs. Interested participants contacted the research team and were screened for eligibility. Only one child per household was eligible to participate. The study targeted low-income and middle-income children (0 ≤ income-to-needs ratio ≤ 5; see Family Income). Children who were currently being treated for psychiatric disorders, had a past or present neurological diagnosis, or an IQ below 80 were excluded. One hundred forty-nine mothers completed the initial eligibility survey. Of those, 47 children and their mothers passed the initial screening and participated in the home visit. Two of the children did not complete the Emotion Go/NoGo computer task due to timing issues during the home visit, and two more were excluded after more detailed data collected during the home visit revealed participant ineligibility (i.e., having an IQ below 80 and a family income-to-needs ratio above 5). The final sample included 43 children (60% female; mean age = 8.7 ± 0.67; 56% White/Caucasian, 28% Black/African American, 9% Hispanic, 7% Bi-racial; Table 1).
Procedures
A pair of trained researchers independently worked with the child participant and his/her mother and administered all measures in the participants’ home. Mothers provided written consent prior to participation. Children provided written and verbal assent in accordance with the University of Denver’s Institutional Review Board guidelines. Income-to-needs ratio and demographic information were collected during a structured interview with the child’s biological mother. IQ was assessed using the Wechsler Abbreviated Scale of Intelligence (WASI; Wechsler, 1999) by a trained researcher. IQ scores were calculated by summing the vocabulary and matrix reasoning subscale scores of the WASI. The Emotion Go/NoGo behavioral task was administered to the child using a laptop. Both mother and child completed a set of questionnaires about the target child’s internalizing symptoms.
Measures
Family Income
Family income was assessed based on the family’s income-to-needs ratio. In absolute terms, poverty is defined as having an income level that falls below an established federal poverty threshold, and is a condition whereby the amount of family income does not meet basic needs such as food and shelter (United States Census Bureau, 2013). The ratio of family income-to-needs was computed by dividing the total parent-reported family income by the federal poverty threshold, adjusted for the number of individuals in the home. Family income-to-needs has been used as a primary measure of absolute poverty in a number of studies that examined poverty and socio-emotional development (Evans et al., 2005; Barajas et al., 2007; Slopen et al., 2010; Kim et al., 2013; Barch et al., 2015; Javanbakht et al., 2015; Liberzon et al., 2015; Raver et al., 2015). The income-to-needs ratio was calculated based on the parent-reported family income within the last 12 months from the date of the home visit (M = 2.15; SD = 1.35; Range: 0.00–4.95). Forty-nine percent of the sample lived in poverty (income-to-needs ratio ≤ 1) or near poverty (income-to-needs ratio ≤ 2).
Behavioral Task
The Emotion Go/NoGo task is an emotional response inhibition paradigm used in a similar age group (ages 5–12; Tottenham et al., 2011a,b). The Emotion Go/NoGo was administered on a laptop and took approximately 10 min to complete (Tottenham et al., 2010; task downloaded from the Sackler Institute Assays and Tools, 2014). Participants were asked to rapidly respond to a series of target facial expression (e.g., neutral, “Go” target trials) while inhibiting a response to a series of distracter emotional facial expressions (e.g., happy, fearful, angry, and sad, “NoGo” distracter trials), or vice versa (Figure 1). Neutral faces were always paired with either a positively valenced (i.e., happy) face or a negatively valenced (i.e., fearful, angry, or sad) face. There were a total of eight blocks (neutral/happy, neutral/fearful, neutral/sad, neutral/angry, happy/neutral, fearful/neutral, sad/neutral, angry/neutral) with 30 trials each. The trials were 70% Go targets to build a prepotent response. Each stimulus was presented for 500 ms with an interstimulus interval of 1000 ms. Stimulus presentation and inter-stimulus interval duration are considered to be appropriate for this age range based on children’s overall accuracy levels (Tottenham et al., 2011b). Stimulus presentation was randomized across conditions. Prior to the task, practice trials were administered to ensure that all participants fully understand the task. False alarms to NoGo emotional distracters were used as a primary measure of emotional response inhibition (Schulz et al., 2007). False alarm rates were defined as false responses to distracter stimuli and were calculated by dividing the number of false presses by the number of distracter stimuli. Reaction time (RT) and percentage of correct responses were calculated to examine overall task performance. The percentage of correct responses was calculated by summing false alarms and missed target responses then subtracting them from the total number of trials. RTs were calculated for correct trials only.
FIGURE 1. Emotion Go/NoGo Task. The trials were 70% Go targets. Each stimulus was presented for 500 ms with an interstimulus interval of 1000 ms.
Internalizing Questionnaires
Internalizing symptoms were assessed by both self-report and mother-report questionnaires.
(A) Self-report: children completed the Strengths and Difficulties Questionnaire child-report version (cSDQ; Goodman and Scott, 1999). Large national studies have used the emotion subscale of the cSDQ as a self-report measure of emotional health and internalizing symptoms in middle childhood (age 6–10 years-old; Muris et al., 2003; Curvis et al., 2013). The emotion subscale consists of five questions (e.g., “I worry a lot”) scored on a three-point Likert scale: 0 = Not True, 1 = Somewhat True, 2 = Certainly True. Child-report SDQ has a good and comparable reliability and validity similar to a parent-report SDQ and Child Behavior Checklist (Goodman, 2001; Muris et al., 2003). Within our sample, Cronbach’s alpha for the five-item subscale is 0.70, which is comparable to data using large samples (Goodman, 2001; Giannakopoulos et al., 2013).
(B) Mother-report: mothers completed the Child Behavior Checklist (CBCL; Achenbach, 1991). The CBCL is a reliable and well-validated parent-report checklist that measures internalizing and externalizing behaviors (Nakamura et al., 2009). The internalizing subscale of the CBCL consists of 26 items (e.g., child’s “Feelings easily hurt?”) scored on a three-point Likert scale: 0 = Not True, 1 = Somewhat True or Sometimes, 2 = Very True or Often True.
Analyses Plan
Percentage of correct responses and RT duration were examined for outliers (RT < 100 ms and > 1000 ms; Ladoucer et al., 2006), but no outliers were detected. All participants had above 50% accuracy (based on overall performance, averaged across Go and NoGo trials). Pearson correlations were conducted to examine the associations among variables. Demographic variables that were significantly correlated with family income were included as covariates.
A three-way repeated measures ANCOVA was conducted for the dependent measure of false alarm rate, with Family Income as a between-subject factor, and Emotion (happy, fearful, angry, and sad) and Condition (Go and NoGo) as within-subjects factors, with covariates IQ, race, and accuracy to “Go” trials. Significant interactions were decomposed using post hoc ANCOVA and regression analyses. RT and percentage of correct responses were added to the repeated measures ANCOVA with Family Income as a between-subject factor, and Emotion (happy, fearful, angry, and sad) and Condition (Go and NoGo) as within-subjects factors, with covariates. SPSS Version 23 was used for all interaction and post hoc analyses. To test the indirect effect of poverty on internalizing symptoms through an emotional response inhibition pathway, Preacher and Hayes’ (2004) bootstrapping method was used (mediation model number 4; 10,000 bootstrap resamples), which is an appropriate test of indirect effect in studies with small sample sizes. An indirect path is statistically significant if the associated 95% confidence interval (CI; bias corrected) does not include zero.
Correlations among Variables
Family income was significantly correlated with the emotional subscale score of the cSDQ (Table 2), r(41) = -0.31, p < 0.05. While lower income was associated with greater levels of child-report internalizing symptoms, it was not significantly correlated with parent-report of internalizing symptoms on the CBCL. Race and IQ were significantly correlated with family income and were included as covariates in the main interaction analyses.
TABLE 2. Bivariate correlations between family income, child internalizing symptoms, and demographic variables.
Behavioral outcomes (false alarm rate, overall percentage of correct responses, RT) of the Emotion Go/NoGo task are included in Table 3. Overall mean accuracy, false alarm rates, and RTs are similar to studies of children within this age range (Tottenham et al., 2010, 2011b). ANOVA analysis examining the effects of Condition and Emotion yielded similar results to a previous study using the same task among children of comparable age range (Tottenham et al., 2011a; see more detailed results in Supplementary Materials).
Emotional Response Inhibition
We examined the association between false alarm rate and family income. A three-way Emotion × Condition × Family Income interaction on the dependent variable of false alarm rate was significant, F(3,93) = 4.14, p < 0.01, = 0.12. Post hoc analyses revealed a two-way Emotion × Family Income interaction in the NoGo condition only (when neutral target “Go” faces were presented with a series of emotional distracter “NoGo” faces), F(3,93) = 5.70, p < 0.005, = 0.16. Post hoc regressions revealed that lower family income was associated with higher false alarm rates during angry distracter face trials, b = -0.36, p < 0.05 (Figure 2), and sad distracter face trials, b = -0.34, p < 0.05 (Figure 3). No significant associations were found between family income and false alarm rates during fearful or happy distracter face trials. There were no significant interactions or main effects of Condition or Emotion with family income or a main effect of family income on the dependent variable of false alarm rate.
FIGURE 2. Relationship between family income and the probability of false alarm rates during Angry “NoGo” distracter trials, b = -0.36, p < 0.05.
FIGURE 3. Relationship between family income and the probability of false alarm rates during Sad “NoGo” distracter trials, b = -0.34, p < 0.05.
Overall Performance
Percentage of Correct Responses
A three-way Emotion × Condition × Family Income interaction (with the percentage of correct responses as a dependent variable) was significant, F(3,117) = 2.68, p < 0.05, = 0.06. Post hoc ANCOVA revealed a two-way Emotion × Family Income interaction in the “Go” condition only (when emotional faces were the target stimuli), F(3,117) = 3.16, p < 0.05, = 0.08. Post hoc regression revealed that lower family income was significantly associated with lower percentage of correct responses during fearful target face trials (or when fearful faces were the “Go” target stimuli), b = 0.39, p < 0.01. There were no significant interactions of Condition or Emotion with family income or a main effect of family income.
Response Time
A three-way Emotion × Condition × Family Income ANCOVA with RT as a dependent variable did not yield any significant interactions or main effects.
Associations among Family Income, Emotional Response Inhibition, and Internalizing Symptoms
Indirect Effect of Family Income on Internalizing Symptoms via an Emotional Response Inhibition Pathway
The indirect effect of family income on child report of inter nalizing symptoms via an emotional response inhibition pathway was tested using Preacher and Hayes’ bootstrapping analysis. Two indirect effect analyses, false alarm rates of each angry and sad “NoGo” distracter face trials as a mediator, were conducted with family income as an independent variable, internalizing symptoms as outcome variables, with IQ and race as covariates in both models.
Bootstrapping analyses revealed a significant indirect effect of family income on internalizing symptoms via false alarm rates during angry distracter face trials (indirect effect = -0.17, CIs = -0.504 to -0.002), and via false alarm rates during sad distracter face trials (indirect effect = -0.14, CIs = -0.455 to -0.002). Thus, preliminary evidence suggests that lower income children exhibited greater emotional response inhibition difficulties (i.e., greater false alarm rates to angry and sad “NoGo” distracter faces), which were in turn associated with greater levels of internalizing symptoms.
The bootstrapping analysis was repeated to test an alternative hypothesis (i.e., a potential indirect effect of family income on false alarm rates through an internalizing symptoms pathway). False alarm rates in the context of sad and angry distracter face trials were used as outcome variables, and internalizing symptoms as a mediator. However, the indirect effect of family income was not significant via a false alarm rate pathway during angry or sad “NoGo” distracter face trials.
Mediation Analysis using Regression
The mediation model using regression analysis was not significant. There was no significant association between family income and cSDQ internalizing symptoms after controlling for race and IQ, b = -0.06, p > 0.10. Angry (b = 0.23) and sad (b = 0.24) false alarm rates and internalizing symptoms were associated at trend levels, controlling for race and IQ, ps < 0.1.
Post hoc Analysis: Child SDQ Depression vs. Anxiety Symptoms
Although, the cSDQ measure does not separate anxiety and depression symptoms, as an exploratory analysis, we repeated the indirect effect test using what we consider as anxiety items (items 2, 4, 5) and depressive items (items 1, 3) of the cSDQ (see Supplementary Materials for item breakdown). Family income was negatively associated with anxiety symptoms, r(41) = -0.31, p < 0.05, but was not significantly associated with depressive symptoms, r(41) = -0.20, p > 0.10. Using the calculated anxiety symptom scores, we tested the indirect effect of family income on cSDQ anxiety scores via an emotional response inhibition pathway, with covariates IQ and race. Bootstrapping analyses revealed a significant indirect effect of family income on cSDQ anxiety symptoms via false alarm rates during angry distracter face trials (indirect effect = -0.12, CI = -0.35 to -0.01), and via false alarm rates during sad distracter face trials (indirect effect = -0.10, CI = -0.33 to -0.008). Significant indirect effects were not observed when cSDQ depression scores were included in the model in place of cSDQ anxiety scores.
Discussion
The present study examined the associations between family income, internalizing symptoms, and emotional response inhibition in middle childhood. We further examined the indirect effect of family income on child internalizing symptoms via an emotional response inhibition pathway. We found that lower family income was associated with emotional response inhibition difficulties particularly in the context of task irrelevant angry and sad emotional faces. In addition, greater emotional response inhibition difficulties in the context of angry and sad faces were in turn associated with increased self-reported internalizing symptoms.
Family Income and Emotional Response Inhibition
Using the Emotion Go/NoGo task, we found that children from lower income homes exhibited emotional response inhibition difficulties in the context of negatively valenced distracters. Lower income was associated with greater false responses to angry and sad distracter “NoGo” faces presented with a series of neutral target “Go” faces. The false alarm rate findings suggest that children from lower income homes were more likely to be influenced by task irrelevant negative emotional information. Failure to inhibit in the context of sad and angry expressions may be due to greater exposure to emotionally relevant stressors in the context of poverty. Our findings are consistent with a growing body of literature that shows the negative effects of early exposure to poverty-related stressors on emotion processing and emotion regulation (Kim et al., 2013; Luby et al., 2013; Javanbakht et al., 2015). Children from impoverished circumstances are more likely to be exposed to chronic psychological stressors, harsh environments, and early adversity (Evans, 2004; Evans et al., 2013). Compared to wealthier children, poor children are more likely to be deprived of supportive environments, experience harsher and less responsive parenting, and receive less optimal care (Wood, 2003; Evans, 2004). Childhood poverty has also been associated with greater daily hassles and stressful life events (e.g., family turmoil/chaos, inadequate housing, diminished resources, interparental aggression) that negatively impact child neurocognitive and socio-emotional development (Evans and English, 2002; Evans et al., 2005; Hanson et al., 2013; Luby et al., 2013). When economic strains are high, parents are also at an increased risk of developing emotional (e.g., depression, anxiety) and behavioral problems (e.g., substance use) and exhibit harsher and less supportive parenting, which in turn have been associated with child emotional problems, including internalizing symptoms (Conger and Donellan, 2007). Thus, poor children are more likely than their middle- and high-income counterparts to experience psychological distress associated with poverty. Exposure to these stressors is in turn associated with neurocognitive deficits and emotional problems (Kim et al., 2013; Luby et al., 2013; Javanbakht et al., 2015), which is consistent with our current findings.
We recognize that some may argue that false responses during angry and sad “NoGo” distracter face trials may instead be due to emotion recognition difficulties associated with poverty (Raver et al., 2015). However, we found that in our sample, lower income children performed with the same accuracy as middle income children when angry and sad faces were the target stimuli (i.e., angry and sad target “Go” faces were presented with a series of neutral distracter “NoGo” faces). This finding suggests that lower income children recognized angry and sad facial expressions as well as middle income children.
Family Income and Fear Recognition
It is important to note that inhibition difficulties were not observed in the context of fearful “NoGo” distracter face trials. Angry faces may signify a direct threat, whereas fearful faces may be more ambiguous and provide less information about the source of threat (Whalen et al., 2001). Thus, angry relative to fearful faces may be more salient and hold more ecological significance to lower income children. Another possible explanation could be that lower income children have greater difficulty recognizing fearful faces, as reflected by the lower percentage of correct responses when fearful faces were the target stimuli. In general, younger children are substantially worse at recognizing fearful expressions relative to other emotional expressions (e.g., happy, angry, sad; Lawrence et al., 2015). It is suggested that fear is a later developing emotion expressed more so by children’s peers than adults, whereas anger is displayed more by adults to young children (Lawrence et al., 2015). Perhaps angry emotional expressions are expressed even more frequently by adults (i.e., parents) in lower income homes (e.g., parental conflict, harsh parenting; Evans, 2004), which could account for its salience relative to fearful expressions. This is consistent with parental conflict and harsh parenting studies (Pollak and Kistler, 2002; Briggs-Gowan et al., 2015; Schermerhorn et al., 2015) that showed aberrant emotion processing of angry information, and over identification of angry expressions relative to other emotions such as fear (Pollak and Kistler, 2002). It is important to note, however, that neuroimaging studies of maternal deprivation found heightened amygdala activity in response to fearful stimuli, suggesting neural hyper-reactivity to fearful information (Tottenham et al., 2011b; Gee et al., 2013). On the other hand, in adults and adolescents, socioeconomic disadvantages have been associated with heightened amygdala responses to angry faces (Gianaros et al., 2008; Muscatell et al., 2012). However, among these studies, few have included both angry and fearful stimuli in the paradigm. Thus, more studies including both fearful and angry stimuli among children who are exposed to poverty and other types of adversity would help to confirm whether poverty may be specifically associated with emotional response inhibition in the context of angry faces or negative emotional information in general. It is also plausible that the lower accuracy we observed during the “Go” fearful trial condition is due to sustained attention problems to fearful emotional stimuli. However, it is difficult to investigate the potential role of sustained attention using this task. To test the potential role of sustained attention, future eye tracking studies that measure attention allocation differences (e.g., sustained attention or attention avoidance) to fearful stimuli between low- and middle- income children may be useful.
Indirect Effect of Family Income on Internalizing Symptoms through an Emotional Response Inhibition Pathway
Importantly, difficulties in response inhibition in the context of sad and angry faces were further associated with internalizing symptoms. In the current study, children form lower income homes exhibited greater emotional response inhibition difficulties in the context of negative (angry and sad) emotional distracter faces, which in turn were associated with greater levels of internalizing symptoms. This finding suggests that emotional response inhibition difficulties may play a significant role in the development of internalizing symptoms among economically disadvantaged children. Failure to inhibit in the context of negative stimuli may indicate enhanced sensitivity to emotional negative information which may be adaptive in the context of poverty (i.e., better detection of danger cues). However, as our results suggest, repeated and exaggerated reactivity to negative information can also have adverse effects on emotional health (Ellis and Del Giudice, 2014), perhaps one of which is the development of internalizing symptoms.
Alternative Socioeconomic Disadvantage Variable
Although the current study focused on the effects of poverty exposure on child internalizing symptoms and emotional response inhibition, other types of socioeconomic variables such as parental education have also been associated with offspring outcomes (e.g., cognitive, educational, and emotional outcomes; Roberts et al., 1999; Dubow et al., 2009; Carneiro et al., 2011; Quesnel-Vallee and Taylor, 2012; Park et al., 2013; Sonego et al., 2013; Wirback et al., 2014). In the current study, we examined parental education, but did not find a significant link with emotional response inhibition. The non-significant association may be due to the limited variability in parental education levels in our sample. Thus, studies with a more diverse sample would be important to further examine the overlapping and unique role of family income and parental education on children’s emotional response inhibition abilities and internalizing symptoms.
Depressive vs. Anxiety Symptoms
As an exploratory analysis, we investigated whether the anxiety or depressive symptoms of the child SDQ were associated with income and emotional response inhibition. The exploratory analysis further suggests that family income was more strongly associated with anxiety symptoms than depressive symptoms, and higher false alarm rates for angry and sad faces were further associated with the child SDQ anxiety scores. This is consistent with previous studies (Tottenham et al., 2010) demonstrating the link between false alarm rates and anxiety symptoms. Given the exploratory nature of the analysis, future studies using more extensive self-report measures such as the Children’s Depression Inventory (CDI; Kovacs, 1992) or the Revised Children’s Manifest Anxiety Scale (RCMAS; Reynolds and Richmond, 1985), or a clinical diagnostic interview could be helpful in further examining the links between emotional response inhibition deficits in the context of specific emotional information and internalizing diagnosis.
Limitations and Future Studies
The results of the present work should be cautiously interpreted. First, the small sample size makes it difficult to draw conclusions about the relationship between family income and emotional response inhibition. However, the effect size (using partial eta squared) of the main interaction analyses is large ( > 0.1) especially considering the small sample. Second the cross-sectional design makes it difficult to draw causal inferences and conclusions about the direction of influence of poverty exposure and emotional response inhibition on internalizing symptoms. To address this limitation we examined alternative models and used internalizing symptoms as a possible mediator between family income and emotional response inhibition (angry and sad), however the models did not yield significant findings. The small sample size can also potentially limit external validity and findings may not generalize to the general population and/or clinical samples with depressive and anxiety disorders. In addition, given the differential emotional face processing observed between men and women (McClure, 2000), factors such as gender may also play a role in Emotional Go/NoGo task performance (Schulz et al., 2007), but the small sample size make it difficult to tease out these potential effects. Future studies with larger and more diverse participants are necessary. Furthermore, in the current path analysis, the direct effect of family income on internalizing symptoms was not significant. The non-significant association between family income and internalizing symptoms may in part be due to the small sample size. Studies with larger samples have consistently reported a robust association between childhood poverty and internalizing symptoms (Brooks-Gunn and Duncan, 1997; Murali and Oyebode, 2004; Slopen et al., 2010). Instead, the current study has identified a significant indirect effect of family income on internalizing symptoms via an emotional response inhibition pathway. Studies suggest that a meaningful indirect effect can be observed without a significant relationship between the independent and dependent variable (MacKinnon et al., 2000; MacKinnon et al., 2008; Hayes, 2009; Erisen, 2010). However, it is important to be cautious when interpreting the findings beyond the indirect effect, and future studies with larger samples will be important to establish the full or partial mediating role of emotional response inhibition in the link between family income and internalizing symptoms. Further studies are needed to examine prospective relations among family income, emotional response inhibition, and internalizing symptoms. It is unclear whether the emotional response inhibition difficulties we observed among lower-income children will be associated with later diagnosis of anxiety and depression. In the present study, lower family income was associated with higher levels of self-reported internalizing symptoms. However, we found no association between mother-reported internalizing symptoms and family income. Some suggest that child-report questionnaires may be a more reliable measure since parent-report internalizing instruments can be sensitive to rater bias (Kujipers et al., 2015). However, future research using a clinical diagnostic interview may be helpful in examining the links between emotional response inhibition deficits in the context of specific emotional information and internalizing diagnoses.
Conclusion
In summary, the current study revealed that middle childhood poverty is related to emotional response inhibition deficits particularly in the context of angry and sad emotional information. These emotional response inhibition deficits were in turn associated with greater self-report internalizing symptoms in middle childhood. By examining impoverished children during an important developmental period, we gain a better understanding of the emotional vulnerabilities of this high-risk group. To our knowledge, this is one of the first studies to explore the socioemotional deficits associated with childhood poverty using an emotional-cognitive control computer task. The current findings inform neuroimaging studies that show heightened amygdala responses to negatively valenced cues in the context of poverty. Future neuroimaging studies may confirm whether heightened neural reactivity to negatively valenced cues may be involved in the emotional response inhibition deficits observed in the context of childhood poverty. Emotional response inhibition deficits may increase risks for internalizing problems, particularly anxiety disorders, among poor children, which is in line with evidence that suggests emotional inhibitory control deficits among clinical mood and anxiety disorders (Ladoucer et al., 2006). One implication for intervention that these findings afford is the potential of training children in emotional response inhibition to help attenuate internalizing symptoms (Raviv and Wadsworth, 2010) among disadvantaged children.
Author Contributions
All authors of the paper (CC, HB, and PK) have fulfilled the criteria for authorship. The undersigned authors warrant that the material contained in the manuscript represents original work. The authors acquired, analyzed, and interpreted collected data. The final version of the manuscript was approved by the authors and all agreed to be accountable to all aspects of the work.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
This work was supported by National Institute of Child Health and Human Development R21HD078797, the Professional Research Opportunity for Faculty (PROF) and Faculty Research Fund (FRF), University of Denver; and the Victoria S. Levin Award For Early Career Success in Young Children’s Mental Health Research, Society for Research in Child Development (SRCD). The authors declare that they have no conflicts of interest in the research. Special thanks to Daniel Mason, Laura Jeske, Daniel Bartholomew, Naomi Wallace, Nanxi Xu, and Christina Congleton for their help in recruitment, data collection, and data entry.
Supplementary Material
The Supplementary Material for this article can be found online at: http://journal.frontiersin.org/article/10.3389/fpsyg.2016.01242
References
Achenbach, T. M. (1991). Integrative Guide for the 1991 CBCL/4-18, YSR and TRF Profiles. Burlington, VT: University of Vermont.
Barajas, R. G., Philipsen, N., and Brooks-Gunn, J. (2007). Cognitive and Emotional Outcomes for Children in Poverty. Available at: http://www.corwin.com/upm-data/17259_Chapter_18.pdf
Barch, D., Pagliaccio, D., Belden, A., Harms, M. P., Gaffrey, M., Sylvester, C. M., et al. (2015). Effect of hippocampal and amygdala connectivity on the relationship between preschool poverty and school-age depression. Am. J. Psychiatry doi: 10.1176/appi.ajp.2015.15081014 [Epub ahead of print].
Briggs-Gowan, M. J., Pollak, S. D., Grasso, D., Voss, J., Mian, N. D., Zobel, E., et al. (2015). Attention bias and anxiety in young children exposed to family violence. J. Child Psychol. Psychiatry 56, 1194–1201. doi: 10.1111/jcpp.12397
Brooks-Gunn, J., and Duncan, G. J. (1997). The effects of poverty in children. Future Child. 7, 55–71. doi: 10.2307/1602387
Carneiro, P., Meghir, C., and Parey, M. (2011). Maternal education, home environments, and the development of children and adolescents. J. Eur. Econ. Assoc. 11, 123–160. doi: 10.1111/j.1542-4774.2012.01096.x
Conger, R. D., and Donellan, M. B. (2007). An interactionist perspective on the socioeconomic context of human development. Annu. Rev. Psychol. 58, 175–199. doi: 10.1146/annurev.psych.58.110405.085551
Costello, E. J., Egger, H., and Angold, A. (2005). The developmental epidemiology of anxiety disorders: phenomenology, prevalence, and comorbidity. Child Adolesc. Psychiat. Clin. N. Am. 14, 631–648. doi: 10.1016/j.chc.2005.06.003
Curvis, W., McNulty, S., and Qualter, P. (2013). The validation of the self-report Strengths and Difficulties Questionnaire for use by 6- to 10-year-old children in the UK. Br. J. Clin. Psychol. 53, 131–137. doi: 10.1111/bjc.12025
Dubow, E. F., Boxer, P., and Huesmann, L. R. (2009). Long-term effects of parents’ education on children’s educational and occupational success: mediation by family interactions, child aggression, and teenage aspirations. Merill Palmer Q. 55, 224–249. doi: 10.1353/mpq.0.0030
Duncan, G. J., Brooks-Gunn, J., and Klebanov, P. K. (1994). Economic deprivation and early childhood development. Child Dev. 65, 296–318. doi: 10.2307/1131385
Ellis, B. J., and Del Giudice, M. (2014). Beyond allostatic load: rethinking the role of stress in regulating human development. Dev. Psychopathol. 26, 1–20. doi: 10.1017/S0954579413000849
Erisen, C. (2010). Sequential mediation analysis in experimental research. Paper Presented in Panel 8-13 at the 106th Annual Meeting of the American Political Science Association, Washington, DC.
Evans, G. W. (2004). The environment of childhood poverty. Am. Psychol. 59, 77–92. doi: 10.1037/0003-066X.59.2.77
Evans, G. W., and Cassells, R. C. (2013). Childhood poverty, cumulative risk exposure, and mental health in emerging adults. Clin. Psychol. Sci. 2, 287–296. doi: 10.1177/2167702613501496
Evans, G. W., and English, K. (2002). The environment of poverty: multiple stressor exposure, psychophysiological stress, and socioemotional adjustment. Child Dev. 73, 1238–1248. doi: 10.1111/1467-8624.00469
Evans, G. W., Exner-Cortens, D., Kim, P., and Bartholomew, D. (2013). Childhood poverty and blood pressure reactivity to and recovery from an acute stressor in late adolescence: the mediating role of family conflict. Psychosom. Med. 75, 691–700. doi: 10.1097/PSY.0b013e31829f9823
Evans, G. W., Gonnella, C., Marcynyszyn, L. A., Gentile, L., and Salpekar, N. (2005). The role of chaos in poverty and children’s socioemotional adjustment. Psychol. Sci. 16, 560–565. doi: 10.1111/j.0956-7976.2005.01575.x
Evans, G. W., and Kim, P. (2007). Childhood poverty and health: cumulative risk exposure and stress dysregulation. Psychol. Sci. 18, 953–957. doi: 10.1111/j.1467-9280.2007.02008.x
Gee, D. G., Gabard-Durnam, L. J., Flannery, J., Goff, B., Humphreys, K. L., Telzer, E. H., et al. (2013). Early developmental emergence of human amygdala–prefrontal connectivity after maternal deprivation. PNAS 110, 15638–15643. doi: 10.1073/pnas.1307893110
Gianaros, P. J., Horenstein, J. A., Hariri, A. R., Sheu, L. K., Manuck, S. B., Matthews, K. A., et al. (2008). Potential neural embedding of parental social standing. Soc. Cogn. Affect. Neurosci. 3, 91–96. doi: 10.1093/scan/nsn003
Giannakopoulos, G., Dimitrakaki, C., Papdopoulou, K., Tzavara, C., Kolaitis, G., Ravens-Siberer, U., et al. (2013). Reliability and validity of the strengths and difficulties questionnaire in Greek adolescents and their parents. Health 5, 1774–1783. doi: 10.4236/health.2013.511239
Gilman, S. E., Kawachi, I., Fitzmaurice, G. M., and Buka, S. L. (2002). Socioeconomic status in childhood and the lifetime risk of major depression. Int. J. Epidemiol. 31, 359–367. doi: 10.1093/ije/31.2.359
Goodman, R. (2001). Psychometric properties of the strengths and difficulties questionnaire. J. Am. Acad. Child Adolesc. Psychiatry 40, 1337–1345. doi: 10.1097/00004583-200111000-00015
Goodman, R., and Scott, S. (1999). Comparing strengths and difficulties questionnaire and the child behavior checklist: is small beautiful? J. Abnorm. Child Psychol. 27, 17–24. doi: 10.1023/A:1022658222914
Hackman, D. A., Farah, M. J., and Meaney, M. J. (2010). Socioeconomic status and the brain: mechanistic insights from human and animal research. Nat. Rev. Neurosci. 11, 651–659. doi: 10.1038/nrn2897
Hanson, J. L., Hair, N., Shen, D. G., Shi, F., Gilmore, J. H., Wolfe, B. L., et al. (2013). Family poverty affects the rate of human infant growth. PLoS ONE 11:e80954. doi: 10.1371/journal.pone.0080954
Hayes, A. F. (2009). Beyond Baron and Kenny: statistical mediation analysis in the new millennium. Commun. Monogr. 76, 408–420. doi: 10.1080/03637750903310360
Javanbakht, A., King, A. P., Evans, G. W., Swain, J. E., Angstadt, M., Phan, K. L., et al. (2015). Childhood poverty predicts adult amygdala and frontal activity and connectivity in response to emotional faces. Front. Behav. Neurosci. 9:154. doi: 10.3389/fnbeh.2015.00154
Kilford, E. J., Foulkes, L., Potter, R., Collishaw, S., Thapar, A., and Rice, F. (2015). Affective bias and current, past, and future adolescent depression: a familial high risk study. J. Affect. Disord. 15, 265–271. doi: 10.1016/j.jad.2014.11.046
Kim, P., Evans, G. W., Angstadt, M., Ho, S. S., Sripada, C. S., Swain, J. E., et al. (2013). Effects of childhood poverty and chronic stress on emotion regulatory brain function in adulthood. PNAS 110, 18442–18447. doi: 10.1073/pnas.1308240110
Kovacs, M. (1992). The Children’s Depression Inventory (CDI) Manual. New York, NY: Multi-Health Systems.
Kujipers, R., Kleinjan, M., Engels, R., Stone, L. L., and Otten, R. (2015). Child self-repot to identity internalizing and externalizing problems and the influence of maternal mental health. J. Child Fam. Stud. 24, 1605–1614. doi: 10.1007/s10826-014-9964-x
Ladoucer, C. D., Dahl, R. E., Williamson, D. E., Birmaher, B., Axelson, D. A., Ryan, N. D., et al. (2006). Processing emotional facial expressions influences performance on a Go/NoGo task in pediatric anxiety and depression. J. Child Psychol. Psychiatry 47, 1107–1115. doi: 10.1111/j.1469-7610.2006.01640.x
Lawrence, K., Campbell, R., and Skuse, D. (2015). Age, gender, and puberty influence the development of facial emotion recognition. Front. Psychol. 6:761. doi: 10.3389/fpsyg.2015.00761
Liberzon, I., Ma, S. T., Okada, G., Ho, S. S., Swain, J. E., and Evans, G. W. (2015). Childhood poverty and recruitment of adult emotion regulatory neurocircuitry. Soc. Cogn. Affect. Neurosci. 10, 1596–1606. doi: 10.1093/scan/nsv045
Luby, J., Belden, A., Botteron, K., Marrus, N., Harms, M. P., Babb, C., et al. (2013). The effects of poverty on childhood brain development: the mediating effect of caregiving and stressful life events. JAMA Pediatr. 167, 1135–1142. doi: 10.1001/jamapediatrics.2013.3139
MacKinnon, D. P., Fairchild, A. J., and Fritz, M. S. (2008). Mediation analysis. Annu. Rev. Psychol. 58, 593. doi: 10.1146/annurev.psych.58.110405.085542
MacKinnon, D. P., Krull, J. L., and Lockwood, C. M. (2000). Equivalence of the mediation, confounding and suppression effects. Prev. Sci. 1, 173–181. doi: 10.1023/A:1026595011371
McClure, E. B. (2000). A meta-analytic review of sex differences in facial expression processing and their development in infants, children, and adolescents. Psychol. Bull. 126, 424–453. doi: 10.1037/0033-2909.126.3.424
Murali, V., and Oyebode, F. (2004). Poverty, social inequality and mental health. Br. J. Psychiatry 10, 216–224.
Muris, P., Meesters, C., and van den Berg, F. (2003). The Strengths and Difficulties Questionnaire (SDQ): further evidence for its reliability and validity in a community sample of Dutch children and adolescents. Eur. Child Adolesc. Psychiatry 12, 1–8. doi: 10.1007/s00787-003-0298-2
Muscatell, K. A., Morelli, S. A., Falk, E. M., Way, B. M., Pfeifer, J. H., Galinksly, A. D., et al. (2012). Social status modulates neural activity in the mentalizing network. Neuroimage 60, 1771–1777. doi: 10.1016/j.neuroimage.2012.01.080
Najman, J. M., Hayatbakhsh, M. R., Clavarino, A., Bor, W., O’Callaghan, M. J., and Williams, G. M. (2010). Family poverty over the early life course and recurrent adolescent and young adult anxiety and depression: a longitudinal study. Am. J. Public Health 100, 1719–1723. doi: 10.2105/AJPH.2009.180943
Nakamura, B. J., Ebesutani, C., Bernstein, A., and Chorpita, A. (2009). A psychometric analysis of the child behavior checklist DSM-oriented scales. J. Psychopathol. Behav. Assess. 31, 178–189. doi: 10.1017/S0954579413000333
Noble, K. G., Houston, S. M., Kan, E., and Sowell, E. R. (2012). Neural correlates of socioeconomic status in the developing human brain. Dev. Sci. 15, 516–527. doi: 10.1111/j.1467-7687.2012.01147.x
Pacheco-Unguetti, A. P., Acosta, A., Lupianez, J., Roman, N., and Derakshan, N. (2012). Response inhibition and attentional control in anxiety. Q. J. Exp. Psychol. 65, 646–660. doi: 10.1080/17470218.2011.637114
Park, A. L., Fuhrer, R., and Quesnel-Vallee, A. (2013). Parents’ education and the risk of major depression in early adulthood. Soc. Psychiatry Psychiatr. Epidemiol. 48, 1829–1839. doi: 10.1007/s00127-013-0697-8
Pollak, S. D., and Kistler, D. J. (2002). Early experience is associated with the development of categorical representations for facial expressions of emotion. PNAS 99, 9072–9076. doi: 10.1073/pnas.142165999
Preacher, K. J., and Hayes, A. (2004). SPSS and SAS procedures for estimating indirect effects in simple mediation models. Behav. Res. Methods Instrum. Comput. 36, 717–731. doi: 10.3758/BF03206553
Quesnel-Vallee, A., and Taylor, M. (2012). Socioeconomic pathways to depressive symptoms in adulthood: evidence from the National Longitudinal Survey of Youth 1979. Soc. Sci. Med. 74, 734–743. doi: 10.1016/j.socscimed.2011.10.038
Raver, C., Blair, C., and Garrett-Peters, P. (2015). Poverty, household chaos, and interpersonal aggression predict children’s ability to recognize and modulate negative emotions. Dev. Psychopathol. 27, 695–708. doi: 10.1017/S0954579414000935
Raviv, T., and Wadsworth, M. E. (2010). The efficacy of a pilot prevention program for children and caregivers coping with economic strain. Cogn. Ther. Res. 34, 216–228. doi: 10.1007/s10608-009-9265-7
Reynolds, C. R., and Richmond, B. O. (1985). Revised Children Manifest Anxiety Scale: RCMAS Manual. Los Angeles, CA: Western Psychological Services.
Roberts, E., Bornstein, M. H., Slater, A. M., and Barrett, J. (1999). Early cognitive development and parental education. Infant Child Dev. 8, 49–62. doi: 10.1002/(SICI)1522-7219(199903)8:1<49::AID-ICD188>3.0.CO;2-1
Schermerhorn, A. C., Bates, J. E., Puce, A., and Molfese, D. L. (2015). Neurophysiological correlates of children’s processing of interparental conflict cues. J. Fam. Psychol. 29, 518–527. doi: 10.1037/fam0000088
Schulz, K. P., Clerkin, S. M., Halperin, J. M., Newcorn, J. H., Tang, C. Y., and Fan, J. (2009). Dissociable neural effects of stimulus valence and preceding context during the inhibition of responses to emotional faces. Hum. Brain Mapp. 30, 2821–2833. doi: 10.1002/hbm.20706
Schulz, K. P., Fan, J., Magidina, O., Marks, D. J., Hahn, B., and Halperin, J. M. (2007). Does the emotional go/no-go task really measure behavioral inhibition? Convergence with measures on a non-emotional analog. Arch. Clin. Neuropsychol. 22, 151–160.
Slopen, N., Fitzmaurice, G., Williams, D. R., and Gilman, S. E. (2010). Poverty, food insecurity, and the behavior for childhood internalizing and externalizing disorders. J. Am. Acad. Child Adolesc. Psychiatry 49, 444–452. doi: 10.1097/00004583-201005000-00005
Sonego, M., Llacer, A., Galan, I., and Simon, F. (2013). The influence of parental education on child mental health in Spain. Q. Life Res. 22, 203–211. doi: 10.1007/s11136-012-0130-x
Spielberg, J. M., Galarce, E. M., Ladouceur, C. D., McMakin, D. L., Olino, T. M., Forbes, E. E., et al. (2015). Adolescent development of inhibition as a function of SES and gender: converging evidence from behavior and fMRI. Hum. Brain Mapp. 36, 3194–3203. doi: 10.1002/hbm.22838
Thapar, A., Collishaw, S., Pine, D. S., and Thapar, A. K. (2012). Depression in adolescence. Lancet 379, 1056–1067. doi: 10.1016/S0140-6736(11)60871-4
Tottenham, N., Hare, T. A., and Casey, B. J. (2011a). Behavioral assessment of emotion discrimination, emotion regulation, and cognitive control in childhood, adolescence, and adulthood. Front. Pyschol. 2:39. doi: 10.3389/fpsyg.2011.00039
Tottenham, N., Hare, T. A., Millner, A., Zevin, J., and Casey, B. J. (2011b). Elevated amygdala response to faces following early deprivation. Dev. Sci. 14, 190–204. doi: 10.1111/j.1467-7687.2010.00971.x
Tottenham, N., Hare, T. A., Quinn, B. T., McCarry, T. W., Nurse, M., Gilhooly, T., et al. (2010). Prolonged institutional rearing is associated with atypically large amygdala volume and difficulties in emotion regulation. Dev. Sci. 13, 46–61. doi: 10.1111/j.1467-7687.2009.00852.x
Tracy, M., Zimmerman, F. J., Galea, S., McCauley, E., and Stoep, A. V. (2008). What explains the relation between family poverty and childhood depressive symptoms? J. Psychiatr. Res. 42, 1163–1175. doi: 10.1016/j.jpsychires.2008.01.011
United States Census Bureau (2013). Poverty. Available at: http://www.census.gov/topics/income-poverty/poverty/data/tables.2013.html
Wechsler, D. (1999). Wechsler Abbreviated Scale of Intelligence. The Psychological Corporation. New York, NY: Harcourt Brace and Company.
Whalen, P. J., Shin, L. M., McInerney, S. C., Fischer, H., Wright, C. I., and Rauch, S. L. (2001). A functional MRI study of human amygdala responses to facial expressions of fear versus anger. Emotion 1, 70–83. doi: 10.1037/1528-3542.1.1.70
Wirback, T., Moller, J., Larsson, J. O., Galanti, M. R., and Engstrom, K. (2014). Social factors in childhood risk of depressive symptoms among adolescents: a longitudinal study in Stockholm, Sweden. Int. J. Equity Health 13: 96. doi: 10.1186/s12939-014-0096-0
Keywords: middle childhood, poverty, family income, emotional response inhibition, internalizing symptoms
Citation: Capistrano CG, Bianco H and Kim P (2016) Poverty and Internalizing Symptoms: The Indirect Effect of Middle Childhood Poverty on Internalizing Symptoms via an Emotional Response Inhibition Pathway. Front. Psychol. 7:1242. doi: 10.3389/fpsyg.2016.01242
Received: 25 February 2016; Accepted: 04 August 2016;
Published: 17 August 2016.
Edited by:
Yvette Renee Harris, Miami University, USACopyright © 2016 Capistrano, Bianco and Kim. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Christian G. Capistrano, Y2NhcGlzdHJAZHUuZWR1