- 1Department of Psychology, University of Saskatchewan, Saskatoon, SK, Canada
- 2Division of Medical Sciences, University of Victoria, Victoria, BC, Canada
Human and animal studies suggest an intriguing relationship between the immune system and the development of depression. Some peripherally produced cytokines, such as TNF-α, can cross the blood brain barrier and result in activation of brain microglia which produces additional TNF-α and fosters a cascade of events including decreases in markers of synaptic plasticity and increases in neurodegenerative events. This is exemplified by preclinical studies, which show that peripheral administration of pro-inflammatory cytokines can elicit depression-like behavior. Importantly, this depression-like behavior can be ameliorated by anti-cytokine therapies. Work in our laboratory suggests that TNF-α is particularly important for the development of a depressive phenotype and that TNF-α antagonists might have promise as novel antidepressant drugs. Future research should examine rates of inflammation at baseline in depressed patients and whether anti-inflammatory agents could be included as part of the treatment regimen for depressive disorders.
Depression
Depression remains the most common psychiatric disorder, affecting approximately 350 million people worldwide. Accordingly, depression now ranks as the top cause of global disability in terms of years lost due to disability. The defining characteristics of depression include anhedonia, a loss of interest in pleasurable activities, and lowered mood (Nestler et al., 2002). Depression is further characterized by alterations in cognition, weight, sleep, irritability, thoughts of suicide, and decreased sexual function/interest (Nemeroff, 1998). Medications that target the monoaminergic system provide the primary course of treatment for depressed patients. These medications include monoamine oxidase inhibitors (MOAI’s), tricyclic antidepressants (TCAs), and selective serotonin reuptake inhibitors (SSRI’s). Despite their widespread use, currently available antidepressants are frequently ineffective, with the percentage of patients experiencing remission as low as 45% (Thase et al., 2001). This suggests that factors other than disruptions in monoamines are at play in the development of depressive symptoms. Indeed, recent evidence has implicated astroglial pathology (Wang et al., 2017), mitochondrial dysfunction (Allen et al., 2018), and deficient hippocampal neurogenesis and neuronal maturation (Bessa et al., 2009; Eisch and Petrik, 2012; Lussier et al., 2013; Mateus-Pinheiro et al., 2013) as potential causal factors in depression. In addition, it has long been thought that neuroinflammation plays a key role in the etiology of depression (Brites and Fernandes, 2015; Furtado and Katzman, 2015). In this short review, we focus on new data suggesting that elevations in the inflammatory cytokine TNF-α might instigate depressive symptoms and that therapies aimed at reducing TNF-α levels hold therapeutic promise.
The Role of Inflammation in Depression
The notion that inflammation could be a contributing factor in the pathogenesis of depression is not a new one. Work in the 1980s’s first revealed that some patients with heightened immune activity (e.g., a patient with an intense cold) displayed the hallmark features of depression (i.e., lethargy, depressed mood, anhedonia) (Miller and Raison, 2016). This in turn led to the cytokine sickness hypothesis of depression, which posits that sustained increases in circulating levels of pro-inflammatory cytokines can produce depressive symptoms (Dantzer, 2009). This hypothesis is summarized in Figure 1. Interestingly, high circulating levels of the pro-inflammatory cytokine IL-6 are strongly associated with feelings of guilt and suicidal ideation (Alesci et al., 2005; O’Donovan et al., 2013). If the cytokine sickness hypothesis of depression is correct, then one would expect that disorders characterized by high circulating levels of cytokines would share a high comorbidity with depression, and this turns out to be the case. For example, rheumatoid arthritis, which is a disorder in which the immune system targets bodily tissues and instigates widespread inflammation, shares a 13–42% comorbidity rate with depression (Margaretten et al., 2011). Furthermore, cancer patients treated with cytokines experience a significant reduction in plasma tryptophan levels that coincides with depression (Capuron et al., 2002). This tryptophan reduction reduces the bioavailability of serotonin, which is a known risk factor for the development of depression according to the monoamine hypothesis. It was later discovered that the culprit for this decrease in plasma tryptophan levels in cancer patients receiving immunotherapy is indoleamine 2,3-dioxygenase (IDO). Activation of IDO decreases tryptophan bioavailability, creating a net decrease in monoamines (Dantzer, 2009). Immuno-activation in healthy control subjects creates depressive-like behavior and impairments in cognition (Reichenberg et al., 2001), and serum concentrations of interleukin-6 at 9 years of age is positively correlated with depressive symptomology at 18 years of age (Khandaker et al., 2014). Finally, high circulating levels of cytokines are associated with treatment-resistant depression (Carvalho et al., 2013).
Stress is also known to transiently elevate the expression of pro-inflammatory cytokines. Unsurprisingly, pro-inflammatory cytokines are efficient activators of the hypothalamic-pituitary-adrenal (HPA) axis (Kenis and Maes, 2002), which often becomes dysregulated in depression. However, as not all depressed patients display a dysregulated HPA axis, it is tempting to speculate that elevated levels of pro-inflammatory cytokines occur in a subset of depression patients, possibly those patients who develop symptoms after a period of major life stressors leading to HPA dysfunction.
Inflammation and Cytokines: the Roles of TNF-α
Cytokines are increasingly being recognized as having a contributive role in the development of depressive symptoms. Treatment with proinflammatory cytokines, including IL-1, IL-6, or TNF-α, or lipopolysaccharide (LPS), induces sickness behavior and corresponding depression-like behavior on the forced swim test (Dantzer, 2004; Dunn and Swiergiel, 2005; Henry et al., 2008). Yang et al. (2015) showed that chronic mild stress (CMS) resulted in an increased expression of proinflammatory cytokines, particularly IL-1, IL-6, and TNF-α, and lower immunoreactivity of myelin protein and decreased numbers of oligodendrocytes in the prefrontal cortex that coincided with the development of depression-like behavior. Maldonado-Bouchard et al. (2015) showed that the stress associated with lesioning the spinal cord in rodents resulted in increased levels of hippocampal cytokines and increased depression and anxiety-like behaviors. This suggests that the inflammation and increased cytokine release per se produced by a spinal cord injury can lead to the development of depression-like behaviors. Dunn and Swiergiel (2005) demonstrated that mice treated with IL-1 spent significantly more time immobile on both the forced swim test and tail suspension test, which are two classic rodent indices of depression-like behavior. Mice that lack certain cytokines or cytokine receptors do not display stress-induced depression-like behavior (Chourbaji et al., 2006), which suggests that lower levels of cytokines confer a protective effect on the development of depression-like behavior. The idea that low levels of cytokines could protect against the development of depression-like behavior is an interesting one and one that will be explored in greater detail in subsequent sections of this review.
Although the release of pro-inflammatory cytokines can contribute to the development of depression-like behavior, TNF-α in particular is receiving considerable attention due to its prominent roles in promoting inflammation and its dampening effects on synaptic plasticity (Khairova et al., 2009; Pribiag and Stellwagen, 2014; Lewitus et al., 2016). It is important to differentiate between TNF-α in the periphery and TNF-α in the brain. Recent findings suggest TNF-α is produced peripherally by leukocytes, lymphoid cells, mast cells, endothelial cells, and adipose tissue and is involved in functions of host defense including the stimulation of protective granuloma formation incurred during mycobacterial infections and the promotion of liver and spleen function (Kruglov et al., 2008). However, when TNF-α signaling is not tightly controlled, dysregulation of peripheral TNF-α signaling can contribute to the development of inflammatory and autoimmune disorders including septic shock and rheumatoid arthritis (Kruglov et al., 2008).
TNF-α is a protein that is initially released as a soluble cytokine (sTNF-α) after being enzymatically cleaved by its cell surface bound precursor (tmTNF-α) by TNF-α converting enzyme (TACE) (Bortolato et al., 2015) and is therefore expressed as a transmembrane protein. TNF-α binds to one of two receptors: TNF receptor 1 (TNFR1) and TNF receptor 2 (TNFR2). TNFR1 is activated by soluble and transmembrane TNF-α, and promotes inflammation and tissue degeneration (Kalliolias and Ivashkiv, 2016). TNFR2’s expression is restricted to neurons, endothelial cells, and immune cells, and is involved in mediating cell survival and tissue regeneration (Kalliolias and Ivashkiv, 2016). The sTNF-α possesses a higher affinity for binding with TNFR1. When TNF-α binds to TNFRs, complex 1 is assembled at the plasma membrane and includes the TNF-α associated death domain protein (TRADD) among other complexes, resulting in the creation of a scaffolding ubiquitin network (Kalliolias and Ivashkiv, 2016). This scaffolding ubiquitin creates the recruitment and activation of two signaling complexes: transforming growth factor (TGF) -β activated kinase 1 (TAK1) complex and the inhibitor of kB (Ikkβ) kinase complex (Kalliolias and Ivashkiv, 2016).
One of the main roles of TNF-α is in maintaining inflammation during times of proinflammatory conditions. During proinflammatory events, TNF-α production is induced by other cytokines (e.g., IL-1) and microglia. Once released, TNF-α stimulates the production of other proinflammatory cytokines, including IL-1 and 6, and it increases the production of reactive oxygen intermediates, including nitric oxide (Bortolato et al., 2015). It is easy to conceptualize this process as a positive feedback loop, whereby an initial stressful or inflammatory event triggers the release of TNF- α, which in turn triggers the release of other pro-inflammatory cytokines, creating a state of prolonged inflammation. This helps explain, why autoimmune diseases are among the hardest disorders to treat. Perhaps it is not surprising that increased inflammation as a result of sustained TNF-α production and release results in altered glutamatergic signaling and excitotoxicity. Mechanistically, TNF-α upregulates glutaminase (the enzyme responsible for the conversion of glutamate from glutamine) expression, resulting in the transportation of glutaminase from the mitochondria into the extracellular space. This in turn leads to elevated concentrations of glutamate both intracellularly and extracellularly, eventually causing cell death through excitotoxicity (Ye et al., 2013). This fits in line with the reported elevations of plasma glutamate levels seen in depressed populations (Inoshita et al., 2018). Interestingly, proinflammatory cytokines (TNF-α) trigger the release of kidney type glutaminase (KGA) from mitochondria, which then travels to the cytosolic compartment of neurons (Ye et al., 2013), increasing glutamate content. This is of interest as we have recently published a report outlining a link between mitochondrial function and depression (see Allen et al., 2018).
TNF-α and Depression: Animal Models and Clinical Studies
Preclinical studies corroborate the role of TNF-α in depression-like behavior. Peripheral administration of TNF-α can produce anhedonic behavior in rodents (van Heesch et al., 2013). Likewise, deletion of TNFR1 or TNFR2 creates an antidepressant phenotype on measures of depressive-like behavior (Simen et al., 2006). Yamada et al. (2000) showed that TNF-α knockout mice display a mild antidepressant phenotype. Along these same lines, administration of the TNF-α inhibitor infliximab during chronic mild stress significantly decreased immobility time in the forced swim test, increased sucrose consumption during the sucrose preference test, and decreased anxiety-like behavior in the elevated plus maze (Karson et al., 2013).
Given that cytokine treatment produces depression-like behavior and reducing cytokine levels alleviates this, the question that arises is whether or not antidepressants can influence inflammation. Interestingly, SSRIs and tricyclic antidepressants are known to reduce levels of TNF-α and other proinflammatory cytokines and increase anti-inflammatory cytokines, including IL-10 (Song et al., 1994). Two potential explanations for how antidepressant drugs might reduce pro-inflammatory cytokine levels have been offered. The first explanation posits that higher levels of activation of serotonergic receptors located on immune cells dynamically regulate the production of pro-and anti-inflammatory cytokines, and this could be influenced by a higher availability of serotonin upon antidepressant treatment, although the pro- or anti- inflammatory effects of peripheral serotonin is still under debate (recently reviewed in Herr et al., 2017; see also Kenis and Maes, 2002). The second explanation sees the increased production of cyclic adenosine monophosphate (cAMP) by antidepressants as a mechanism by which antidepressants might reduce cytokine levels. Specifically, cAMP activates protein kinase A (PKA), increasing the production of cAMP responsive element binding protein (CREB), both of which act to decrease pro-inflammatory cytokine production (Kenis and Maes, 2002).
Considerable attention has been dedicated to the antidepressant potential of ketamine. Ketamine rapidly reverses depression-like behavior in both clinical and preclinical subjects, in a timeframe of hours (Yoshi and Constantine-Paton, 2010; Cusin et al., 2012). An important question asked within the literature is whether ketamine is altering neuroinflammation? Although this question is relatively recent, it does appear to be the case that at least a component of the antidepressant properties of ketamine involve reductions in neuroinflammation, in particular TNF-α. For example, Wang et al. (2015) have shown that in chronically-stressed rats, the rapid antidepressant effects of ketamine are accompanied by a reduction of hippocampal TNF-α levels. Moreover, a reduction in depressive symptoms 40 min post-ketamine infusion in depressed patients has been shown to be correlated with reductions in serum TNF-α levels (Chen et al., 2018). These findings suggest that rapid changes in neuroinflammation, in particular TNF-α, are perhaps one of the mechanisms underlying the antidepressant actions of ketamine.
In terms of clinical studies, a large body of evidence supports the role of TNF-α in depression. Endotoxin administration in control subjects produces an increase in TNF-α in addition to depressed mood and cognitive impairment (Della and Hannestad, 2010). Microarray mRNA studies demonstrate increased expression of tmTNF-α in the prefrontal cortex (PFC) of suicide victims (Pandey et al., 2012). In fact, higher suicidal ideation itself is associated with an increased cytokine profile, including elevated TNF-α (O’Donovan et al., 2013), and high circulating levels of TNF-α are found in peripheral tissues of suicide victims (Lindqvist et al., 2009). Several lines of evidence support the efficacy of TNF-α inhibitors in the treatment of depression. Patients with rheumatoid arthritis and plaque psoriasis taking prescribed etanercept, which is a TNF-α antagonist, reported significant reductions in depressive symptoms (Gelfand et al., 2008; Kekow et al., 2011). Similarly, patients with Crohns Disease receiving infusions of infliximab experienced significant reductions in depressive symptoms and this decrease was associated with corresponding reductions in proinflammatory cytokines (Guloksuz et al., 2013). Finally, psoriasis patients with comorbid psychiatric conditions report improvement in mood and overall well-being when taking infliximab (Bassukas et al., 2008). Interestingly, inflammation itself is associated with anhedonia, and one of the first symptoms to be alleviated in depressed patients receiving anti-inflammatory compounds is anhedonia (Felger et al., 2016).
Some interesting extensions of these clinical studies have been observed in patients with treatment-resistant depression. Raison et al. (2013) reported that patients with treatment -resistant depression with a high baseline level of inflammation as indicated by elevated high sensitivity C-reactive protein expression responded favorably to infusions of the TNF-α inhibitor infliximab. However, in patients with a low baseline level of high sensitivity C-reactive protein infliximab was not more effective than placebo. This pattern of results suggests that subsets of treatment-resistant patients experience high levels of inflammation, and therapies aimed at reducing inflammation might be particularly effective in these patients. However, other patients may have a different physiological profile such that factors other than inflammation are at play. This conclusion is consistent with the observation that two depressed patients can present with a different cluster of symptoms. For example, patient A could present with agitation, weight loss, an inability to sleep, and lowered mood, whereas patient B presents with weight gain, excess sleep, psychomotor retardation, and anhedonia. This raises the question (asked elsewhere; see Nestler and Hyman, 2010) of whether depression is actually part of a constellation of different disorders. It is tempting to suggest that depressed patients with inflammation might represent a subset of depressed patients who require a different course of treatment compared to their non-inflamed counterparts. Kappelmann et al. (2016) conducted a meta-analysis of the effectiveness of anti-cytokine treatments in depression. They found that across seven double-blind clinical trials involving 1309 subjects, anti-cytokine treatment was generally more efficacious than treatment with placebo. Of interest is the fact that several research groups have reported that currently available non-cytokine antidepressant medications are not more effective than placebo, at least in the treatment of non-severe depression (Garland, 2004; Kirsch et al., 2008; Fournier et al., 2010). Therefore, treatments that target inflammation might represent a more viable approach to the treatment of depression, as the monoamine hypothesis of depression largely does not align with what is currently known about the biological causes of depression. Of the anti-cytokine treatments analyzed, Kappelmann et al. (2016) reported that anti-TNF-α drugs were the most commonly used option. The picture that emerges is that depression is associated with elevations in TNF-α, and treatments aimed at reducing circulating TNF-α produce significant normalization of depressive symptoms. In the next section, we elaborate on some putative mechanisms underlying the antidepressant effect of TNF-α antagonists.
Targeting TNF-α in Depression
Peripheral injection of TNF-α antagonists (i.e., etanercept) causes a functional decrease in peripheral TNF-α with only an indirect effect on central TNF-α expression, as drugs like etanercept cannot cross the blood brain barrier (Boado et al., 2010). Therefore, it has been assumed that drugs like etanercept are only able to indirectly reduce central inflammation as a consequence of reduced peripheral TNF-α activity (Kerfoot et al., 2006). However, TNF-α per se can cross the blood brain barrier by a receptor mediated mechanism (Pan and Kastin, 2001, 2002; Pan et al., 2006), and when this occurs, it instigates an increase of both TNF-α protein and mRNA by stimulating central expression of TNF-α by microglial cells (Qin et al., 2007; McCoy and Tansey, 2008). Peripheral TNF-α also can stimulate secretion of TNF-α from circumventricular organs and choroid plexus, and TNF-α secreted by these organs can then induce the activation of microglia and a subsequent increase in TNF-α secretion by microglial cells (Qin et al., 2007; McCoy and Tansey, 2008). As stated, etanercept does not cross the blood brain barrier but it binds peripheral TNF-α, and in doing so, it reduces the effect of peripheral TNF-α in promoting the activation of microglia, which results in decreased secretion of central TNF-α.
One should therefore expect that etanercept injections would prevent some of the central effects of protracted release of central TNF-α, such as its effects on hippocampal activity and neurogenesis (see McCoy and Tansey, 2008; and Bortolato et al., 2015). In line with this observation, we have recently shown that semi-weekly peripheral injections of etanercept (0.8 mg/kg) can normalize the depression-like behavior produced by 21 days of exogenous corticosterone injections in rats (Brymer et al., 2018). Etanercept can also restore performance on object-location and object-in-place recognition memory tests of hippocampal functioning. Moreover, etanercept restores the number and complexity of dentate subgranular/granular neurons expressing doublecortin, which is a marker of immature newborn neurons, and perhaps this action of etanercept may be underlying its antidepressant effects (Brymer et al., 2018). It should in any case be noted that the role of adult hippocampal neurogenesis in depression remains a contentious issue. Antidepressant effects can be achieved without increases in neurogenesis, and ablation of neurogenesis is not sufficient to create a depression-like phenotype (Hanson et al., 2011). Recently, Sorrels et al. (2018) found that human hippocampal neurogenesis sharply drops from childhood to near undetectable levels in adulthood, boldly suggesting that hippocampal neurogenesis does not occur past childhood. However, counter to this report, Boldrini et al. (2018) report that human hippocampal neurogenesis persists throughout the lifespan, even into the 70th year of life. Moreover, recent reports have found reductions in hippocampal neurogenesis in post-mortem tissue from patients with depression (Boldrini et al., 2012). In an elegant study, Hill et al. (2015) showed that increasing hippocampal neurogenesis through transgenic methods alone is sufficient to create an antidepressant phenotype. While the debate seems far from over, the picture that emerges is that neurogenesis is associated with depression, however, the degree of causality in human populations is still unknown.
Another intriguing hypothesis about the mechanism by which etanercept might enhance hippocampal neurogenesis comes from a separate set of studies we conducted that focus on the extracellular matrix protein reelin. Reelin has been extensively studied for its role in guiding cell migration during development, but in the adult brain it is involved in the promotion of synaptic plasticity. Reelin binds to two receptors, the very-low-density lipoprotein receptor (VLDR) and apolipoprotein receptor 2 (ApoER2). Activation of these receptors by reelin ultimately excites downstream targets including mTOR and P13K (Jossin and Goffinet, 2007). Importantly, inactivation of either PI3K or mTOR has been shown to reduce dendritic complexity in neuronal cultures (Jaworski et al., 2005). On a more direct level, reelin overexpression accelerates dendritic growth within adult-generated neurons, and inactivation of the reelin signaling pathway impairs adult hippocampal neurogenesis (Teixeira et al., 2012). In addition to our findings that peripheral etanercept injections can normalize neurogenesis after a period of corticosterone administration, we also showed that etanercept rescues reelin expression in GABAergic interneurons located in the proliferative subgranular zone of the dentate gyrus (Brymer et al., 2018). We have previously hypothesized about the important role that reelin could play in the neurobiology of depression (Caruncho et al., 2016), as revealed by our observations that depression-like behavior is associated with a significant decrease in the number of reelin+ cells in the subgranular zone (Lussier et al., 2009; Fenton et al., 2015). We found that the timecourse for the emergence of depression-like behavior after corticosterone administration parallels the timecourse for dampened neurogenesis and the loss of reelin-positive cells (Lussier et al., 2013). We also found that heterozygous reeler mice, with 50% normal levels of reelin, were more susceptible to the depressogenic effects of corticosterone than wild type mice (Lussier et al., 2011). Taking all these observations into account, we believe that the antidepressant effects of etanercept in rats treated with corticosterone could occur through a normalization of hippocampal reelin expression. This is an important area for future studies as it could help explain the mechanism by which TNF-α antagonists exert their antidepressant effects.
It is therefore worth considering how etanercept might interact with the reelin signaling system in the dentate gyrus. Very little direct research has been done on this topic to date, but there could be a link through neuronal nitric oxide. TNF-α promotes the expression of nitric oxide synthase, and there are reports that some neuronal subtypes might reflect nitric oxide-mediated oxidative damage in response to increased levels of TNF-α (see as example Thomas et al., 2005). There is also evidence that the nitric oxide system has multiple effects in modulating adult neurogenesis (reviewed in Carreira et al., 2013). Overproduction of nitric oxide and accumulation of nitric oxide metabolites has been linked to mitochondrial dysfunction and oxidative stress in depression (recently reviewed by Allen et al., 2018). Interestingly, we have found that heterozygous reeler mice, which as mentioned above are highly susceptible to the depressogenic effects of repeated corticosterone (Lussier et al., 2011), show a decrease in the number of neurons co-expressing reelin and neuronal nitric oxide synthase (nNOS) specifically in the proliferative subgranular zone (Romay-Tallon et al., 2010). We also know that repeated corticosterone has differential effects on the co-expression of reelin and nNOS in wild type and heterozygous reeler mice (Romay-Tallon et al., 2015). We have discussed these data as an indication that nitric oxide-mitochondria-mediated excitotoxic events in reelin expressing neurons in the subgranular zone may instigate a decrease in reelin secretion by these neurons, resulting in deficits in dendritic maturation within newborn granule cells and dampened hippocampal plasticity that may be a key event in the pathophysiology of depression (see Caruncho et al., 2016; Allen et al., 2018). One could therefore surmise that the effects of etanercept in antagonizing the actions of TNF-α could result in a reversal of its effects in activating the NO system, and a subsequent neuroprotective action on reelin expressing neurons in the dentate subgranular zone. Additional research is necessary to properly assess these hypotheses, but they could open the door to the identification of novel targets for new antidepressant drug development.
One should also consider that there seems to be considerable cross-talk between ApoE and TNF-α in that low levels of ApoE result in increased cytokine production, in particular TNF- α and that in a similar vein, release of proinflammatory cytokines (TNF-α) downregulates ApoE production (Zhang et al., 2011). It is therefore likely that under conditions of stress, such as during administration of exogenous corticosterone, peripheral production and release of TNF-α is enhanced, which in turn increases central expression of TNF-α through the actions of microglia. This increase in TNF-α levels in the brain would then downregulate ApoE expression, and as both ApoE and reelin work through ApoE receptors and may have a synergistic effect on regulating neural plasticity, one could speculate that alterations in ApoE might also indirectly affect reelin binding to ApoE receptors and as a result, reelin functionality would be altered. This process would be reversed upon treatment with TNF-α antagonists.
Another question that remains to be answered is when etanercept actually interacts with reelin. In the Brymer et al. (2018) study mentioned above, etanercept was given to the rats semi-weekly during the 21-day period of corticosterone administration. Therefore, the rats received etanercept early on, presumably before any significant stress-related pathology had been created by the corticosterone injections. This experimental design leaves open the question of whether etanercept might have neuroprotective effects rather than antidepressant effects per se. It will be important to conduct further studies on this issue, with etanercept given in different animal models of depression at different time periods during and after periods of stress, so that a more complete understanding of the beneficial effects of etanercept can emerge.
Conclusion
Numerous reports point toward the effectiveness of anti-TNFα drugs for some depression patients. Use of TNF-α antagonists as antidepressants may be particularly important for subpopulations of patients with treatment resistant depression that show high levels of expression of proinflammatory cytokines.
Author Contributions
All authors contributed to the ideas presented in this review and contributed to editing the manuscript. KB wrote the first draft and developed the figure. LK and HC finalized the manuscript.
Funding
This work was supported by grants from the Natural Sciences and Engineering Research Council of Canada (NSERC) to LK and HC. KB was supported by an NSERC Canada Graduate Scholarship-Doctoral.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
Alesci, S., Martinez, P. E., Kelkar, S., Ilias, I., Ronsaville, D. S., Listwak, S. J., et al. (2005). Major depression is associated with significant diurnal elevations in plasma interleukin-6 levels, a shift of its circadian rhythm, and loss of physiological complexity in its secretion: clinical implications. J. Clin. Endocrinol. Metab. 90, 2522–2530. doi: 10.1210/jc.2004-1667
Allen, J., Romay-Tallon, R., Brymer, K. J., Caruncho, H. J., and Kalynchuk, L. E. (2018). Mitochondria and mood: mitochondrial dysfunction as a key player in the manifestation of depression. Front. Neurosci. 12:386. doi: 10.3389/fnins.2018.00386
Bassukas, I. D., Hyphantis, T., Gamvroulia, C., Gaitanis, G., and Mavreas, V. (2008). Infliximab for patients with plaque psoriasis and severe psychiatric comorbidity. J. Eur. Acad. Dermatol. Venereol. 22, 257–258. doi: 10.1111/j.1468-3083.2007.02310
Bessa, J. M., Ferriera, D., Melo, I., Marques, F., Cerqueira, J. J., Palha, J. A, et al. (2009). The mood-improving actions of antidepressants do not depend on neurogenesis but are associated with neuronal remodelling. Mol. Psychiatry 14, 764–773. doi: 10.1038/mp.2008.119
Boado, R. J., Hui, E. K. W., Lu, J. Z., Zhou, Q. H., and Pardridge, W. M. (2010). Selective targeting of a TNFR decoy receptor pharmaceutical to the primate brain as a receptor-specific IgG fusion protein. J. Biotechnol. 146, 84–91. doi: 10.1016/j.biotec.2010.01.011
Boldrini, M., Fulmore, C. A., Tartt, A. N., Simeon, L. R., Pavlova, I., Poposka, V., and Mann, J. J. (2018). Human hippocampal neurogenesis persists throughout aging. Cell Stem Cell 22, 589–599. doi: 10.1016/j.stem.2018.03.015
Boldrini, M., Hen, R., Underwood, M. D., Rosoklija, G. B., Gwork, A. J., Mann, J. J., et al. (2012). Hippocampal angiogenesis and progenitor cell proliferation are increased with antidepressant use in major depression. Biol. Psychiatry 72, 562–571. doi: 10.1016/jbiopsych.2012.04.024
Bortolato, B., Carvalho, A. F., Soczynska, J. K., Perini, G. I., and McIntyre, R. S. (2015). The involvement of TNF-α in cognitive dysfunction associated with major depressive disorder: an opportunity for domain specific treatments. Curr. Neuropharmacol. 13, 558–576 doi: 10.2174/1570159X13666150630171433
Brites, D., and Fernandes, A. (2015). Neuroinflammation and depression: microglial activation, extracellular microvesicles and microRNA dysregulation. Front. Cell Neurosci. 9:476. doi: 10.3389/fncel.2015.00476
Brymer, K. J., Fenton, E. Y., Kalynchuk, L. E., and Caruncho, H. J. (2018). Peripheral etanercept administration normalizes behavior, hippocampal neurogenesis, and hippocampal reelin and GABAA expression in a preclinical model of depression. Front. Pharmacol. 9:121. doi: 10.3389/fphar.2018.00121
Capuron, L., Ravaud, A, Neveu, P. J., Miller, A. H., Maes, M., and Dantzer, R. (2002). Association between decreased serum tryptophan concentrations and depressive symptoms in cancer patients undergoing cytokine therapy. Mol. Psychiatry 7, 468–473. doi: 10.1038/sj.mp.4000995
Carreira, B. P., Santos, A. I., Cartvalhi, C. M., and Araujo, I. M. (2013). Modulation of adult neurogenesis by the nitric oxide system. Chapter 7 in “Neural Stem Cells – New Perspectives”. London: IntechOpen. doi: 10.5772/54982
Caruncho, H. J., Brymer, K. J., Romay-Tallon, R., Mitchell, M. A., Rivera-Baltanas, T., Botterill, J., et al. (2016). Reelin-related disturbances in depression: implications for translational studies. Front. Cell Neurosci. 10:48. doi: 10.3389/fncel.2016.00048
Carvalho, L. A., Torre, J. P., Papadopoulos, A. S., Poon, L., Jurena, M. F., Markopoulou, K. et al. (2013). Lack of clinical therapeutic benefit of antidepressants is associated with overall activation of the inflammatory system. J. Affect. Disord. 148, 136–140. doi: 10.1016/j.jad.2012.10.036
Chen, M. H., Li, C. T., Lin, W. C., Hong, C. J., Tu, P. C., Bai, Y. M., et al. (2018). Rapid inflammation modulation and antidepressant efficacy of low-dose ketamine infusion in treatment-resistant depression: a randomized, double-blind control study. Psychiatry Res. 269, 207–211. doi: 10.1016/j.psychres.2018.08.078
Chourbaji, S., Urani, A., Inta, I., Sanchis-Segura, C., Brandwein, C., Zink, M., et al. (2006). IL-6 knockout mice exhibit resistance to stress-induced development of depression-like behaviors. Neurobiol. Dis. 23, 587–594. doi: 10.1016/j.nbd.2006.05.001
Cusin, C., Hilton, G. Q., Nirenberg, A. A., and Fava, M. (2012). Long-term maintenance with intramuscular ketamine for treatment-resistant bipolar II depression. Am. J. Psychiatry 169, 868–869. doi: 10.1176/appi.ajp.2012.12020219
Dantzer, R. (2004). Cytokine-induced sickness behavior: a neuroimmune response to activation of innate immunity. Eur. J. Pharmacol. 500, 399–411. doi: 10.1016/j.ejphar.2004.07.040
Dantzer, R. (2009). Cytokine, sickness behavior, and depression. Immunol. Allergy Clin. North Am. 29, 247–264. doi: 10.1016/j.iac.2009.02.002
Della, G. N., and Hannestad, J. A. (2010). A critical review of human endotoxin administration as an experimental paradigm of depression. Neurosci. Biobehav. Rev. 34, 130–143. doi: 10.1016/j.neubiorev.2009.07.014
Dunn, A. J., and Swiergiel, A. H. (2005). Effects of interleukin-1 and endotoxin in the forced swim and tail suspension tests in mice. Pharmacol. Biochem. Behav. 81, 688–693. doi: 10.1016/j.pbb.2005.04.019
Eisch, A. J., and Petrik, D. (2012). Depression and hippocampal neurogenesis: a road to remission? Science 338, 72–75. doi: 10.1126/science.1222941
Felger, J. C., Li, Z., Haroon, E., Woolwine, B. J., Jung, M. Y., Hu, X., et al. (2016). Inflammation is associated with decreased functional connectivity within corticostriatal reward circuity in depression. Mol. Psychiatry 21, 1358–1365. doi: 10.1038/mp.2015.168
Fenton, E. Y., Fournier, N. M., Lussier, A. L., Romay-Tallon, R., Caruncho, H. J., and Kalynchuk, L. E. (2015). Imipramine protects against the deleterious effects of chronic corticosterone on depression-like behavior, hippocampal reelin expression, and neuronal maturation. Prog. Neuropsychopharmacol. Biol. Psychiatry 60, 52–59. doi: 10.1016/j.pnpbp.2015.02.001
Fournier, J. C., DeRubeis, R. J., Hollon, S. D., Dimidjian, S., Amsterdam, J. D., Shelton, R. C., et al. (2010). Antidepressant drug effects and depression severity: a patient-level meta-analysis. JAMA 303, 47–53. doi: 10.1001/jama.2009.1943
Furtado, M., and Katzman, M. A. (2015). Examining the role of neuroinflammation in major depression. Psychiatry Res. 229, 27–36. doi: 10.1016/j.psychres.2015.06.009
Garland, E. J. (2004). Facing the evidence: antidepressant treatment in children and adolescents. CMAJ 170, 489–491.
Gelfand, J. M., Kimball, A. B., Mostow, E. N., Chiou, C. F., Patel, V., Xia, H. A., and Stevens, S. R. (2008). Patient-reported outcomes and health-care resource utilization in patients with psoriasis treated with etanercept: continuous versus interrupted treatment. Value Health 11, 400–407. doi: 10.1111/j.1524-4733.2007.00251.x
Guloksuz, S., Wichers, M., and Kenis, G. (2013). Depressive symptoms in Crohn’s disease: relationship with immune activation and tryptophan availability. PLoS One 8:e60435. doi: 10.1371/journal.pone.0060435
Hanson, N. D., Owens, M. J., and Nemeroff, C. B. (2011). Depression, antidepressants, and neurogenesis: a critical reappraisal. Neuropsychopharmacology 36, 2589–2602. doi: 10.1038/npp.2011.220.
Henry, C. J., Huang, Y., Wynne, A., Hanke, M., Himler, J., Bailey, M. T., et al. (2008). Minocycline attenuates lipopolysaccharide (LPS)-induced neuroinflammation, sickness behavior, and anhedonia. J. Neuroinflammation 5:15. doi: 10.1186/1742-2094-5-15.
Herr, N., Bode, C., and Duerschmied, D. (2017). The effects of serotonin in immune cells. Front. Cardiovasc. Med. 4:48. doi: 10.3389/fcvm.2017.00048
Hill, A. S., Sahay, A., and Hen, R. (2015). Increasing adult hippocampal neurogenesis is sufficient to reduce anxiety and depression-like behaviors. Neuropsychopharmacology 40, 2368–2378. doi: 10.1038/npp.2015.85
Inoshita, M., Umehara, H., Watanabe, S. Y., Nakataki, M., Kinoshita, M., Tomioka, Y., et al. (2018). Elevated peripheral blood glutamate levels in major depressive disorder. Neuropsychiatr. Dis. Treat 14, 945–953. doi: 10.2147/NDT.S159855
Jaworski, J., Spangler, S., Seeburg, D. P., Hoogenraad, C. C., and Sheng, M. (2005). Control of dendritic arborization by the phosphoinositide-3’-kinase-Akt-mammalian target of rapamycin pathway. J. Neurosci. 25, 11300–11312. doi: 10.1523/JNEUROSCI.2270-05.2005
Jossin, Y., and Goffinet, A. M. (2007). Reelin signals through phosphatidylinositol 3-kinase and Akt to control cortical development and through mTor to regulate dendrite growth. Mol. Cell Biol. 20, 7113–7124. doi: 10.1128/MCB.00928-07
Kalliolias, G. D., and Ivashkiv, L. B. (2016). TNF biology, pathogenetic mechanisms and emerging therapeutic strategies. Nat. Rev. Rheumatol. 12, 49–62. doi: 10.1038/nrrheum.2015.169
Kappelmann, N., Lewis, G., Dantzer, R., Jones, P. B., and Khandaker, G. M. (2016). Antidepressant activity of anti-cytokine treatment: a systematic review and meta-analysis of clinical trials of chronic inflammatory conditions. Mol. Psychiatry 12, 49–62. doi: 10.1038/mp.2016.167
Karson, A., Demirtas, T., Bayramgurler, D., Balci, F., and Utkan, T. (2013). Chronic administration of infliximab (TNF-α inhibitor) decreases depression and anxiety-like behavior in rat model of chronic mild stress. Basic Clin. Pharmacol. Toxicol. 112, 335–340. doi: 10.1111/bcpt.12037
Kekow, J., Moots, R., Khandker, R., Melin, J., Freundlich, B., and Singh, A. (2011). Improvements in patient-reported outcomes, symptoms of depression and anxiety, and their association with clinical remission among patients with moderate-to-severe active early rheumatoid arthritis. Rheumatology 50, 401–409. doi: 10.1093/rheumatology/keq327
Kenis, G., and Maes, M. (2002). Effects of antidepressants on the production of cytokines. Int. J. Neuropsychopharmacol. 5, 401–412. doi: 10.1017/S1461145702003164
Kerfoot, S. M., D’Mello, C., Nguyen, H., Ajuebor, M. N., Kubes, P., Le, T., et al. (2006). TNF-alpha-secreting monocytes are recruited into the brain of cholestatic mice. Hepatology 43, 154–162. doi: 10.1002/hep.21003
Khairova, R A., Machado-Vieira, R., Du, J., and Manji, H J. (2009). A potential role for pro-inflammatory cytokines in regulating synaptic plasticity in major depressive disorder. Int. J. Neuropsychopharmacol. 12, 561–578. doi: 10.1017/S1461145709009924.
Khandaker, G. M., Pearson, R. M., Zammit, S., Lewis, G., and Jones, P. B. (2014). Association of serum interleukin 6 and C-reactive protein in childhood with depression and psychosis in young adult life: a population-based longitudinal study. JAMA Psychiatry 71, 1121–1128. doi: 10.1001/jamapsychiatry.2014.1332
Kirsch, I., Deacon, B.J., Heudo-Medina, T. B., Scoboria, A., Moore, T. J., and Johnson, B. T. (2008). Initial severity and antidepressant benefits: a meta-analysis of data submitted to the food and drug administration. PLoS Med. 5:e45. doi: 10.1371/journal.pmed.0050045
Kruglov, A. A., Kuchmiy, A., Grivennikov, S. I., Tumanov, A. V., Kuprash, D. V., and Nedospasov, S. A. (2008). Physiological functions of tumor necrosis factor and the consequences of its pathologic overexpression or blockade: mouse models. Cytokine Growth Factor Rev. 19, 231–244. doi: 10.1016/j.cytogfr.2008.04.010
Lewitus, G. M., Konefal, S. C., Greenhalgh, A. D., Pribiag, H., Augereau, K., and Stellwagen, D. (2016). Microglial TNF- α suppresses cocaine-induced plasticity and behavioral sensitization. Neuron 90, 483–491. doi: 10.1016/j.neuron.2016.03.030
Lindqvist, D., Janelidze, S., Hagell, P., Erhardt, S., Samuelsson, M., Minthon, L., et al. (2009). Interleukin-6 is elevated in the cerebrospinal fluid of suicide attempters and related to symptom severity. Biol. Psychiatry 66, 287–292. doi: 10.1016/j.biopsych.2009.01.030
Lussier, A. L., Caruncho, H. J., and Kalynchuk, L. E. (2009). Repeated exposure to corticosterone, but not restraint, decreases the number of reelin-positive cells in the adult rat hippocampus. Neurosci. Lett. 460, 170–174. doi: 10.1016/j.neulet.2009.05.050
Lussier, A. L., Lebedeva, K., Fenton, E. Y., Guskjolen, A., Caruncho, H. J., and Kalynchuk, L. E. (2013). The progressive development of depression-like behavior in corticosterone- treated rats is paralleled by slowed granule cell maturation and decreased reelin expression in the adult dentate gyrus. Neuropharmacology 71, 174–183. doi: 10.1016/j.neuropharm.2013.04.012
Lussier, A. L., Romay-Tallon, R., Kalynchuk, L. E., and Caruncho, H. J. (2011). Reelin as a putative vulnerability factor for depression: examining the depressogenic effects of repeated corticosterone in heterozygous reeler mice. Neuropharmacology 60, 1064–1074. doi: 10.1016/j.neuropharm.2010.09.007
Maldonado-Bouchard, S., Peters, K., Woller, S. A., Madahian, B., Faghihi, U., Patel, S., et al. (2015). Inflammation is increased with anxiety and depression-like signs in a rat model of spinal cord injury. Brain Behav. Immun. 51, 176–195. doi: 10.1016/j.bbi.2015.08.009
Margaretten, M., Julian, L., Katz, P., and Yelin, E. (2011). Depression in patients with rheumatoid arthritis: description, causes and mechanisms. Int. J. Clin. Rheumatol. 6, 617–623. doi: 10.2217/IJR.11.6
Mateus-Pinheiro, A., Pinto, L., Bessa, J. M., Morais, M., Alves, N. D., Monteiro, S., et al. (2013). Sustained remission from depressive-like behavior depends on hippocampal neurogenesis. Transl. Psychiatry 3:e20. doi: 10.1038/tp.2012.141
McCoy, M. K., and Tansey, M. G. (2008). TNF signalling inhibition in the CNS: implications for normal brain function and neurodegenerative disease. J. Neuroinflammation 5:45. doi: 10.1186/1742-2094-5-45
Miller, A. H., and Raison, C. L. (2016). The role of inflammation in depression: from evolutionary imperative to modern treatment target. Nat. Rev. Immunol. 16, 22–34. doi: 10.1038/nri.2015.5
Nemeroff, C. B. (1998). The neurobiology of depression. Sci. Am. 278, 42–49. doi: 10.1038/scientificamerican0698-42
Nestler, E. J., Barrot, M., DiLeone, R. J., Eisch, A. J., Gould, S. J., and Monteggia, L. M. (2002). Neurobiology of depression. Neuron 34, 13–25. doi: 10.1016/S0896-6273(02)00653-0
Nestler, E. J., and Hyman, S. E. (2010). Animal models of neuropsychiatric disorders. Nat. Neurosci. 13, 1161–1169. doi: 10.1038/nn.2647
O’Donovan, A., Rush, G., Hoatam, G., Hughes, B. M., McCrohan, A., Kelleher, C., et al. (2013). Suicidal ideation is associated with elevated inflammation in patients with major depressive disorder. Depress Anxiety 30, 307–314. doi: 10.1002/da.22087
Pan, W., Ding, Y., Yu, Y., Ohtaki, H., Nakamachi T., and Kastin, A. J. (2006). Stroke upregulates TNFα transport across the blood-brain barrier. Exp. Neurol. 198, 222–233. doi: 10.1006/ex.nr.2005.11.020
Pan, W., and Kastin, A. J. (2001). Increase in TNFα transport after SCI is specific for time, region, and type of lesion. Exp. Neurol. 170, 357–363. doi: 10.1006/ex.nr.2001.7702
Pan, W., and Kastin, A. J. (2002). TNFα transport across the blood-brain barrier is abolished in receptor knockout mice. Exp. Neurol. 174, 193–200. doi: 10.1006/ex.nr.2002.7871
Pandey, G. N., Rizavi, H. S., and Ren, X. (2012). Proinflammatory cytokines in the prefrontal cortex of teenage suicide victims. J. Psychiatr. Res. 46, 57–63. doi: 10.1016/j.jpsychires.2011.08.006
Pribiag, H., and Stellwagen, D. (2014). Neuroimmune regulation of homeostatic synaptic plasticity. Neuropharmacology 78, 13–22. doi: 10.1016/j.neuropharm.2013.06.008
Qin, L., Wu, X., Block, M. L., Liu, Y., Breese, G. R., Hong, J.-S., et al. (2007). Systemic LPS causes chronic neuroinflammation and progressive neurodegeneration. Glia 55, 453–462. doi: 10.1002/glia.20467
Raison, C. L., Rutherford, R. E., Woolwine, B. J., Shuo, C., Schettler, P., Drake, D. F., et al. (2013). A randomized controlled trial of the tumor necrosis factor antagonist infliximab for treatment resistant depression: the role of baseline inflammatory biomarkers. JAMA Psychiatry 70, 31–41. doi: 10.1001/2013.jamapsychiatry.4
Reichenberg, A., Yirmiya, R., Schuld, A., Kraus, T., Haack, M., Morag, A., et al. (2001). Cytokine-associated emotional and cognitive disturbances in humans. Arch. Gen. Psychiatry 58, 445–452. doi: 10.1001/archpsyc.58.5.445
Romay-Tallon, R., Dopeso-Reyes, I. G., Lussier, A. L., Kalynchuk, L. E., and Caruncho, H. J. (2010). The coexpression of reelin and neuronal nitric oxide synthase in a subpopulation of dentate gyrus neurons is downregualted in heterozygous reeler mice. Neural Plast. 2010:130429. doi: 10.1155/2010/130429
Romay-Tallon, R., Rivera-Baltanas, T., Kalynchuk, L. E., and Caruncho, H. J. (2015). Differential effects of corticosterone on the colocalization of reelin and neuronal nitric oxide synthase in the adult hippocampus in wild type and heterozygous reeler mice. Brain Res. 1594, 274–283. doi: 10.1016/j.brainres.2014.10.050
Simen, B. B., Duman, C. H., Simen, A. A., and Duman, R. S. (2006). TNF-alpha signaling in depression and anxiety: behavioral consequences of individual receptor targeting. Biol. Psychiatry 59, 775-785. doi: 10.1016/j.biopsych.2005.10.013
Song, C., Killeen, A. A., and Leonard, B. E. (1994). Catalase, superoxide dismutase and glutathione peroxidase activity in neutrophils of sham-operated and olfactory-bulbectomised rats following chronic treatment with desipramine and lithium chloride. Neuropsychobiology 30, 24–28. doi: 10.1159/000119131
Sorrels, S. F., Paredes, M. F., Cebrian-Silla, A., Sandoval, K., Qi, D., Kelley, K. W., et al. (2018). Human hippocampal neurogenesis drops sharply in children to undetectable levels in adults. Nature 555, 377–381. doi: 10.1038/nature25975
Teixeira, C. M., Kron, M. M., Masachs, N., Zhang, H., Lagace, D. C., Martinez, A., et al. (2012). Cell-autonomous inactivation of the reelin pathway impairs adult neurogenesis in the hippocampus. J. Neurosci. 32, 12051–12065. doi: 10.1523/JNEUROSCI.1857-12.2012
Thase, M. E., Entsuah, A. R., and Rudolph, R. I. (2001). Remission rates during treatment with venlaflaxine or selective serotonin reuptake inhibitors. Br. J. Psychiatry 178, 234–241. doi: 10.1192/bjp.178.3.234
Thomas, M. S., Zhang, W. R., Jordan, P. M., Saragovi, H. U., and Taglialatela, G. (2005). Signaling pathways mediating a sective induction of nitric oxide synthase II by tumor necrosis factor alpha in nerve growth factor – responsive cells. J. Neuroinflammation 2:19. doi: 10.1186/1742-2094-2-19
van Heesch, F., Prins, J., and Korte-Bouws, G. A. (2013). Systemic tumor necrosis factor-alpha decreases brain stimulation reward and increases metabolites of serotonin and dopamine in the nucleus accumbens of mice. Behav. Brain Res. 253, 191–195. doi: 10.1016/j.bbr.2013.07.038
Wang, N., Yu, H. Y., Shen, X. F., Gao, Z. Q., Yang, C., Yang, J. J., et al. (2015). The rapid antidepressant effect of ketamine in rats is associated with down-regulation of pro-inflammatory cytokines in the hippocampus. Ups. J. Med. Sci. 120, 241–248. doi: 10.3109/03009374.2015.1060281
Wang, W., Jie, W., Liu, J. H., Yang, J. M., and Gao, T. M. (2017). An astroglial basis of major depressive disorder? an overview. Glia 65, 1227–1250. doi: 10.1002/glia.23143
Yamada, K., Iida, R., and Miyamoto, Y. (2000). Neurobehavioral alterations in mice with a targeted deletion of the tumor necrosis factor-alpha gene: implications for emotional behavior. J. Neuroimmunol. 111, 131–138. doi: 10.1016/S0165-5728(00)00375-1
Yang, P., Gao, Z., Zhang, H., Fang, Z., Wu, C., Xu, H., et al. (2015). Changes in proinflammatory cytokines and white matter in chronically stressed rats. Neuropsychiatr. Dis. Treat 11, 597–607. doi: 10.2147/NDT.S78131
Ye, L., Huang, Y., Zhao, L., Li, Y., Sun, L., Zhou, Y., et al. (2013). IL-1 and TNF-α induce neurotoxicity through glutamate production: a potential role for neuronal glutaminase. J. Neurochem. 125, 897–908. doi: 10.1111/jnc.12263
Yoshi, A., and Constantine-Paton, M. (2010). Postsynpatic BNDF-TrkB signaling in synapse maturation, plasticity, and disease. Dev. Neurobiol. 70, 304–322. doi: 10.10002/dneu.20765
Keywords: depression, inflammation, cytokines, stress, TNF-α, rat, antidepressant, hippocampus
Citation: Brymer KJ, Romay-Tallon R, Allen J, Caruncho HJ and Kalynchuk LE (2019) Exploring the Potential Antidepressant Mechanisms of TNFα Antagonists. Front. Neurosci. 13:98. doi: 10.3389/fnins.2019.00098
Received: 30 September 2018; Accepted: 28 January 2019;
Published: 11 February 2019.
Edited by:
Hanting Zhang, West Virginia University, United StatesReviewed by:
Andrzej Pilc, Institute of Pharmacology of the Polish Academy of Sciences, PolandRegina A. Mangieri, The University of Texas at Austin, United States
Copyright © 2019 Brymer, Romay-Tallon, Allen, Caruncho and Kalynchuk. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Lisa E. Kalynchuk, bGthbHluY2h1a0B1dmljLmNh