- 1Clinical and Affective Neuroscience Lab, Department of Psychology and Cognitive Sciences (DiPSCo), University of Trento, Rovereto, Italy
- 2Center for Medical Sciences - CISMed, University of Trento, Trento, Italy
- 3Department of Psychology, Science Division, New York University of Abu Dhabi, Abu Dhabi, United Arab Emirates
- 4Universitas Mercatorum, Rome, Italy
- 5MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, United Kingdom
Previous morphometric studies of Borderline Personality Disorder (BPD) reported inconsistent alterations in cortical and subcortical areas. However, these studies have investigated the brain at the voxel level using mass univariate methods or region of interest approaches, which are subject to several artifacts and do not enable detection of more complex patterns of structural alterations that may separate BPD from other clinical populations and healthy controls (HC). Multiple Kernel Learning (MKL) is a whole-brain multivariate supervised machine learning method able to classify individuals and predict an objective diagnosis based on structural features. As such, this method can help identifying objective biomarkers related to BPD pathophysiology and predict new cases. To this aim, we applied MKL to structural images of patients with BPD and matched HCs. Moreover, to ensure that results are specific for BPD and not for general psychological disorders, we also applied MKL to BPD against a group of patients with bipolar disorder, for their similarities in affective instability. Results showed that a circuit, including basal ganglia, amygdala, and portions of the temporal lobes and of the orbitofrontal cortex, correctly classified BPD against HC (80%). Notably, this circuit positively correlates with the affective sector of the Zanarini questionnaire, thus indicating an involvement of this circuit with affective disturbances. Moreover, by contrasting BPD with BD, the spurious regions were excluded, and a specific circuit for BPD was outlined. These results support that BPD is characterized by anomalies in a cortico-subcortical circuit related to affective instability and that this circuit discriminates BPD from controls and from other clinical populations.
Introduction
The diagnosis of personality disorders based only on observable signs and symptoms is highly problematic considering the difficulties in distinguishing trait-dependent manifestations from active symptoms common to other mental disorders (1). One case in point is Borderline Personality Disorder (BPD), which is not only the most commonly diagnosed personality disorder affecting presumably 2% of the population (2) but also one of the most problematic diagnostic categories (1). Relevant dimensions that characterize BPD are affective difficulties, socio-interpersonal difficulties, and impulsivity (3, 4), which may lead to extremely diversified pattern of symptoms across patients (5). Moreover, the high comorbidity—e.g., with eating, abuse, personality, and affective disorders (2, 6)—and the insidious overlap of symptoms with other psychopathology (1) contribute to the difficulty of BPD diagnosis, with high rate of misdiagnosis for this disorder (7).
The problem of reliable diagnosis in psychiatry has been previously addressed in the literature (8), and affective neuroscience has been identified as a field that can crucially contribute to the overcoming of current limitations in available diagnostic systems through the detection of neurobiological markers for specific psychopathological conditions. Neuroimaging investigations of BPD have provided important insights concerning its neural correlates but limited contributions for the discrimination of healthy and pathological conditions. Structural alterations have been found in the prefrontal cortex and in several limbic structures (9). Related to these structural alterations, functional alterations consistent with the clinical manifestations of the disorder have been identified: Altered activity of dorsolateral prefrontal and limbic brain regions in response to emotional stimuli is consistent with the conceptualization of BPD as an emotion dysregulation disorder (9–13); the hyperactivity of the default mode network areas at rest is consistent with difficulties in both interpersonal and affective regulation (13–16). Structural studies partially confirm alterations in some of these regions (9, 17–22). Structural alterations have been previously reported in patients with BPD for what concerns the thalamus (6, 21, 23), the amygdala (9, 24–26), and the fusiform area (27). However, previous studies suffer from major limitations. First, they have used mass univariate analysis that examines each voxel in isolation and does not take into account statistical dependencies among voxels (28–30). Moreover, individual differences were not taken into consideration, as the average of individuals inside each group was only considered. In some cases, region of interest (ROI) analyses were used instead of whole-brain approaches, thus limiting results on a limited set of a priori–defined regions (31). Last but not least, these results could not be tested for generalization to new unobserved cases.
An alternative approach that has proven extremely useful for diagnostic classification of subjects on the basis of MRI signal patterns is the use of machine learning for the separation of patients from healthy controls (HCs). Machine learning, also called multi-voxel pattern analysis (MVPA) in the context of neuroscience, can dramatically increase the sensitivity of human brain imaging by accumulating information across multiple voxels of MRI signal, i.e., by taking into account the information contained in a distributed spatial pattern of brain activity rather than a single voxel or location (32). A commonly applied implementation of machine learning is the use of a classification algorithm that is trained to distinguish between two classes of data using whole-brain pattern-based information. Such techniques have proven extremely useful for the decoding of between-subject classification of brain imaging data in a number of psychiatric and neurological diseases, reaching a good classification (from 60 to 90%) in the cases of depression (33), schizophrenia (34), and social anxiety disorder (35). Among classification algorithms, the Multiple Kernel Learning (MKL) algorithm has the additional advantage to allow the identification of the most relevant sources for the classification, e.g., brain regions contributing to the model. Authors have recently used MKL to make predictions based on anatomical localization (36, 37) and to help to determine which are the most relevant brain regions that contribute to group classification to predict differential diagnosis between mood disorders (38).
The first aim of the present study is to explore, for the first time, the potentiality of MKL for the diagnostic classification of patients with BPD on the basis of their brain structural features. In line with this aim, we applied MKL to the classification of patients with BPD and HCs. We hypothesized that some of the brain structures previously identified in separate studies can effectively discriminate these groups of participants. Because MKL allows the understanding of which brain structures, among all areas, maximally discriminate the two groups in the classifier, we were also interested in understanding which brain structures are more relevant for the understanding of neurobiological features of BPD. We hypothesized to find a widely distributed circuit including portions of the orbitofrontal cortex (OFC) and of the temporal lobe, for their relations with affective disturbances and lack of control over emotions, as well as subcortical structures such as the amygdala and the basal ganglia for emotion dysregulation and impulsivity displayed by patients with BPD.
A second relevant aspect of BPD diagnosis concerns its specificity compared with other forms of psychopathologies. One of the most critical aspects of differential diagnosis regards the consideration of affective symptomatology as a manifestation of a clinical syndrome, instead of a more general personality impairment. Typically, patients with BPD seems be at increased risk of being misdiagnosed with bipolar disorder (BD) (7). Affective disturbances have been described as a core feature of both disorders (39, 40). Mood swings and anger reactions typically described in BPD can be easily observed also in maniac episodes of the BD (41). Similarly, the impulsiveness observed in maniac episodes is frequently considered as a core aspect of borderline personality (29, 30, 42–44). In a meta-analysis (45), abnormalities in the amygdala and parahippocampal gyrus were reported, and a smaller volume of the right medial OFC was detected in both BD and BPD. In another study, differences consisting in more volumetric alterations and larger diffusion in BD (involving several cortical and subcortical structures) than BPD (confined to mainly fronto-limbic regions) have been found. In a recent study, Lapomarda et al. (29) applied unsupervised machine learning to compare BPD, BD, and controls. A blind source separation method known as Independent Component Analysis (ICA) (28–31, 46–48) was applied to gray and white matter. Compared with controls, patients with BD increased gray matter in a network involving mostly subcortical structures and cerebellar areas, possibly related to abnormal mood. In contrast, patients with BPD showed milder alterations compared with patients with BD and controls. Moreover, BPD differed from BD and controls for a white matter circuit including frontal-parietal and temporal regions possibly associated with dysfunctional top-down emotion regulation (29, 49–51). However, one limitation of the method used in that study is that the unsupervised machine learning used (ICA) is not suitable for classification or for creating biomarkers to predict the diagnosis of new cases as it strictly depends on the sample used. Moreover, ICA was applied simultaneously to BPD, BD, and HC. Thus, the results found for BPD depended on the simultaneous comparison of all three groups. Thus, following the first aim, we intended to apply the same methodology but this time to classify BPD against BD. This will let us understand which brain structures maximally discriminate the two groups and may help the differential diagnoses of such patients. We predicted that the classifier can correctly classify BPD from BD and that similar regions involved in the classification of BPD against HC will discriminate BPD against BD. Moreover, by subtracting the circuit that correctly separates BPD from BD, from the circuit that separates BPD from HC, a possible neural substrate to serve as a starting point for developing a biomarker specific for BPD can be outlined. This circuit may serve as a baseline for future investigations intended to develop a biomarker for correctly diagnosing BPD from structural brain features.
Methods
Participants
We selected 20 patients with BPD (Mage = 35.75, SDage = 8.61), 30 patients with BD type I (BD; Mage = 37.17, SDage = 8.64), and 45 healthy participants as controls (HC; Mage = 36.80, SDage = 8.43), matched for age and sex. All the data were extracted from the shared OpenNeuro database (52). Demographic information about participants is displayed in Table 1.
Patients with BPD were selected from Clinical Research Imaging Centre in Edinburgh (OpenNeuro database, accession number ds000214). The recruitment took place in outpatient and support services from around Edinburgh. The diagnosis was verified using Structured Clinical Interview for DSM-IV (SCID-II). The Zanarini Rating Scale for BPD (ZAN-BPD) was administered to assess the current symptoms. Exclusion criteria included pregnancy, MRI contraindications, diagnosis of a psychotic disorder, and current illicit substance dependence. All participants gave written informed consent approved by the Lothian National Health Service Research Ethics Committee. Patients with BPD were acquired with a 3T Siemens Magneton Verio with TR = 2,300 (ms), TE = 2.98 (ms), and 160 slices. Patients with BD and HCs were selected from UCLA Consortium for Neuropsychiatric Phenomics (OpenNeuro database, accession number ds000030). They were recruited via community advertisements in the Los Angeles area. Self-reported history of psychopathology was verified with the SCID-IV (53). Inclusion criteria comprised the following: at least 8 years of education, no history of head injury with loss of consciousness or cognitive sequelae, no use of psychoactive medications or substance dependence within past 6 months, and no history of major mental illness. Participants were excluded if they had history of significant medical illness, contraindications for MRI, and mood-altering medication on scan day (based on self-report). All participants gave written informed consent approved by the University of California, Los Angeles Institutional Review Board. A high-resolution T1-weighted 3D magnetization prepared rapid gradient echo scan was acquired for each participant. HCs and patients with BD were acquired with a 3T Siemens Magneton Trio with TR = 1,900 (ms), TE = 2.26 (ms), and 176 slices.
Preprocessing
After quality check of the images to exclude artifacts and before any analyses, all data were preprocessed with the same pipeline using the segmentation routines provided by the Computational Anatomy Toolbox (CAT12, http://www.neuro.uni-jena.de/cat/), a toolbox available for SPM12 software (http://www.fil.ion.ucl.ac.uk/spm/software) in the MATLAB environment. Segmentation of gray and white matter and cerebrospinal fluid was thus obtained. Modulated normalized writing option was chosen. Diffeomorphic Anatomical Registration through Exponential Lie algebra (DARTEL) tool, a potential alternative to SPM's traditional registration approaches that operates using a whole-brain approach, was used (47, 48, 54). Normalization to MNI space with spatial smoothing (full width at half maximum of Gaussian smoothing kernel [8, 8, 8]) was then applied on DARTEL images.
Data Analysis
MVPA on the basis of MKL method was carried out in the Pattern Recognition for Neuroimaging Toolbox (PRoNTo) (55, 56). Between-group analyses, with patients with BPD against HC, and then patients with BPD against patients with BD, were entered as two classes in separate MKL analyses with the preprocessed gray matter images. In MKL, heterogenous kernels are linearly combined (57), to define a decision boundary. MKL has been shown to enhance the interpretability of the decision function and improve performances (57). Whole-brain analyses were performed using a general mask provided inside PRoNTo. Data were mean centered and normalized, and age and gender were regressed out. The predictive function was defined during a training phase where the algorithm learned patterns from the provided data to predict a label (diagnosis). Whereas, during a test phase, the algorithm is used to predict outcome in an independent dataset. Leave-one-subject-out cross-validation was performed, making the test set independent from the training set. Each class accuracy was calculated averaging classification results across all the folds of cross-validation (55). Statistical significance of the classifications was tested using permutation testing with 1,000 permutations with random assignment of group class to input image. The resulting null-hypothesis distribution was used to calculate the p-value of the accuracies or the proportion of permutations that yielded a greater accuracy than the accuracy found for the classification models. The Automated Anatomical Labeling [AAL; (58)] atlas, built using the WFU- PickUp Atlas toolbox of SPM and consisting of 116 brain regions, was used to explore regional contribution of each classification model. In MKL approach, being a hierarchical model of the brain, it was possible to derive weight contribution of each region to the decision function. Regions were ranked according to their contribution to the model and averaged across folds. Only regions with >1% contribution to the decision function f are displayed. Through the pair-wise classification, common, and unique structural features among the two contrasts were identified [see (59), for a similar approach], using the formula BPD specificity = (BPD ≠ HC) ∧ (BPD ≠ BD). If one structural area separated BPD against HC, and the same also separated BPD against BD, this feature was selected as a specific neural abnormality uniquely associated with BPD. By contrast, regions that separated BPD against HC, but not BPD against BD, were excluded (in other words, this region may be similarly affected in both BPD and BD, and so, it cannot be considered specific for BPD). Surf Ice software was used to plot the brain maps (https://www.nitrc.org/projects/surfice/).
Results
No significant differences were found for age [F(2,92) = 0.172, p = 0.842], gender [F(2,92) = 0.725, p = 0.487], HDRS, and medication load comparing BPD, HC, and BD (all p > 0.05).
BPD Against Controls
The MKL returned a total accuracy of 84.62%, bipolar disorder (BA) of 76.39% (p = 0.002), class predictive values of 91.6–97.78%, and AUC value of 88% (Figure 1). Model performance significantly exceeds the threshold of randomly guessing the labels, thus confirming that the algorithm has successfully learned a predictive function (56). A positive correlation was found between Zanarini affective sector scores and betas extracted from the classifier (r = 0.45, p = 0.047), thus confirming a relation between the circuit that predicts BPD and affective disturbances.
Figure 1. Results from BPD against HC. Multiple Kernel Learning machine classification of patients with Borderline Personality Disorder (BPD) and healthy controls (HC) based on structural (GM) features. (A) Left: Density version of histogram plot of function values. Right: Receiver Operator Curve, Areas Under the Curve = 0.88. ROI weights in percentage and in voxel size are displayed in the two bar plots. (B) Surface plots, including subcortical reconstruction of the significant regions.
Regions with larger contribution to the model (weight > 1%) were in order of importance: the right Putamen, the left thalamus, the right fusiform gyrus, the right amygdala, the lingual gyrus, the right middle and superior OFC, the left pallidum, the left fusiform gyrus, and portions of the cerebellum (see Figure 1; Table 2). To characterize the direction of these areas, simple voxel-to-voxel comparisons were computed. Raw data were extracted from the gray matter (GM) images of both BPD and HC after masking for the circuit found by MKL analysis. A threshold of 0.001 uncorrected was used. This analysis showed that all areas were characterized by greater GM for BPD relative to HC, except the putamen, the pallidus, and the thalamus, which showed the opposite trend.
BPD Against BD
The MKL returned a total accuracy of 80%, BA of 79.17% (p = 0.001), class predictive values of 75% for BPD and 83.33% for BD, and AUC value of 83% (Figure 2). Model performance significantly exceeds the threshold of randomly guessing the labels, thus confirming that the algorithm has successfully learned a predictive function (56). Regions with larger contribution to the model (weight > 1%) were in order of importance: the right pallidum, the right inferior frontal cortex, the right amygdala, portions of the cerebellum, the right superior temporal pole, the right fusiform, the right inferior temporal area, the right putamen, the left caudate, and the right superior part of the OFC among others (see Figure 2; Table 3).
Figure 2. Results from BPD against BD. Multiple Kernel Learning machine classification of patients with Borderline Personality Disorder (BPD) and healthy controls (HC) based on structural (GM) features. (A) Left: Density version of histogram plot of function values. Right: Receiver Operator Curve, Areas Under the Curve = 0.83. ROI weights in percentage and in voxel size are displayed in the two bar plots. (B) Surface plots, including subcortical reconstruction of the significant regions.
BPD Against HC and BD
Areas surviving both contrasts (e.g., areas that separate BPD from both control groups) were in order of importance (weight contribution derived from BD against HC model): the right Putamen, the right amygdala, the superior and mid parts of the orbitofrontal, the fusiform area, and the left 7b part of the cerebellum.
Discussion
The detection of neuroimaging-based biomarkers of BPD may crucially contribute to overcome the limitations of diagnostic procedures exclusively based on subjective evaluations of clinical signs and symptoms and to further elucidate the neural mechanisms of such disorder. With this regard, traditional univariate approaches that identify structural and functional abnormalities in brain regions associated with a mental disorder are not suitable for individual diagnosis, mostly because of large inter-individual variance in regional fMRI activations. To overcome this gap, the first aim of the present study is to apply a multivariate whole-brain machine learning approach to distinguish BPD from HCs on the basis of structural brain features. Yet, to ensure that results are specific for BPD and not for similar mental disorders, the second aim of the present study is to compare the BPD brain alterations with a commonly associated mental disorder that is BD (45, 60).
Overall, results showed that patients with BPD were correctly and reliably classified against HC (total accuracy of 84.62%) and BD (total accuracy of 80%). To our knowledge, this is the first study using machine learning methodology to identify a BPD-specific neural circuit to serve as a possible biomarker based on structural features. The success of the present procedure in predicting BPD against HC and another clinical control group (BD) fosters the machine learning approach as a useful method to allow classification of structural brain images of each patient, in line with other applications of machine learning for clinical diagnosis classifications [for reviews, see the works of Fu and Costafreda (61) and Wolfers et al. (62)].
The most relevant sources for the classification of BPD and HC included structural alterations in several subcortical structures (such as the amygdala, the thalamus, the pallidum, and the putamen), in the fusiform gyrus, in the OFC, and in the cerebellum. Notably, we also observed significant associations between these brain alterations and the affective sector of the Zanarini questionnaire, thus strengthening the association between brain such alterations and affective disturbances characterizing this pathology. The localization of the highest accuracy scores in subcortical regions is consistent with the results of past univariate comparisons of BPD and HC (9, 17, 20, 21). The putamen, which is the structure with the greatest weight in the model, and the pallidum both belong to the basal ganglia and underpin reward processing and impulsivity behaviors (18, 19, 29, 30). In BPD, an increased activity of these brain regions is associated with impulsivity and aggressiveness traits (63), as well as with the processing of negative stimuli and emotion dysregulation (64). Structural alterations of the thalamus have been previously reported in patients with BPD (6, 21, 23). Of note, Nenadić et al. (6) found a negative correlation between the GM concentration of the thalamus and symptoms severity. Our results confirm such reduced GM in the thalamus as well as in the basal ganglia in patients with BPD. The activity in this brain area is linked not only to emotion (65) and reward (66) but also to general mental operations such as attention, memory, and consciousness (67). The amygdala, another region with larger contribution in the model, is probably one of the most targeted areas in structural BPD investigations (9, 24–26). Having a primary role in decoding affective information and in generating emotional arousal and triggering behavioral responses (68, 69), alterations in the amygdala have been extensively reported in BPD (17). Several studies reported an increased responsivity of the amygdala during processing of negative stimuli (9), which suggest a hypersensitivity of this structure in BPD. Such increased responsivity is supported by the fact that, in our additional analyses (raw data voxel-to-voxel comparisons), we also found these areas to have greater GM in BPD as compared with HC.
With regard to cortical areas, the fusiform gyrus was another area highly contributing to the classification. This area is involved in humans' face processing (70) and plays certainly a key role in social cognition (71, 72). Its structural abnormalities in BPD have been already reported in other studies (27), and functional alterations of this area emerged mostly in studies using social stimuli (73), especially emotional faces (27). There is also evidence that fusiform cortex volume correlated positively with insufficient self-control (6). Our further analyses showed increased GM as compared with HC in this area, further supporting the hypothesis of the abnormal activity found in the previous studies.
The OFC, with its anatomical connections with cortical and subcortical limbic areas, is another key area in BPD neuroimaging literature (18, 74). In support of our findings, a recent meta-analysis (45) reported that structural differences between BPD and control in the OFC were robust and consistent across the selected literature (i.e., 13 studies). The OFC has been involved in many humans' behavior among which actions inhibition, and control and regulation of emotional responses (18, 74). Notably, these studies found smaller GM concentration in the medial part of the OFC for BPD compared with controls. Whereas, in our analyses, we found GM increased in the right lateral part of the OFC for BPD compared with control. Future studies are needed to better understand the role of different portions of the OFC in BPD. Other studies reported a negative relationship in the local gyrification of this area and impulsivity in BPD (17, 75). In addition, the OFC and the right inferior frontal gyrus seem to play a key role in anger and its regulation (76), which is known to be dysregulated in BPD.
Finally, in addition, the cerebellum, among other functions, is also involved in affective evaluation, in interaction with the prefrontal cortex and basal ganglia (77). Accordingly, the cerebellar–thalamus–striatum circuit could be linked to reward and mood alterations in BPD (29). In line with previous observations (6), we found increased GM in the cerebellum for BPD compared with HC.
To identify a possible substrate to serve as a future biomarker for BPD, we also compared BPD with another clinical control group of patients with BD. Despite the previous observation of a shared neural substrate between BPD and BD (60), the machine learning approach used in the present study offered the advantage to clearly disentangle the potential ambiguity due to the similarity of clinical signs shared by both disorders, accounting for a neural differentiation between these two pathological conditions (30). With regard to the source of such neural differentiation, again, subcortical brain structures resulted to have the highest discriminative power, suggesting that emotional reactivity (i.e., the amygdala) and impulsivity (i.e., the pallidum, the putamen, and the caudate) that discriminate BPD from HC also discriminate between BPD and BD. The involvement of the striatum in the regulation of voluntary actions as well as in motivated behaviors (78) may represent a coherent substrate for BPD symptomatology related to the impulsivity, intended as aggressiveness, substance abuse, self-mutilation, and eating disorders (60). Abnormalities in the amygdala, on the other hand, explain the hypersensitivity of patients with BPD to emotionally salient stimuli, especially the negative ones [e.g., (9)], and the typical rapid-cycling mood changes in these patients.
The cluster of abnormalities in brain regions involved in socio-affective processes may be a further aspect distinguishing BPD from BD. Indeed, a specific deficit in BPD, which is only marginal in BD, concerns the handling of social relationships (1). In BPD, interpersonal experiences are often characterized “by rapid attachment, anxious dependency, and fear of abandonment” [(1), p. 4]. According to this social deficiency, the alteration characterizing BPD embraced the temporal regions and the fusiform area, both associated to the processing of socio-affective stimuli (emotional faces). Similarly, the vermis is considered as the limbic portion of the cerebellum, which, in turn, has been recently suggested a structure related to social brain (79).
Finally, by considering only the regions that discriminate BPD from both HC and BD, we were able to outline a possible biomarker specific for BPD. Results indicate that the alterations in the triad involving putamen, amygdala, and OFC represent the specificity of this disorder (42–44). This circuit has been largely associated with affective instability and anger control as a consequence of dysfunctional emotion regulation (see Figure 3) (3, 10, 11, 29, 30, 80, 81).
Figure 3. A model for BPD circuit. Areas surviving both contrasts (BPD against HC, and BPD against BD) are displayed as well as their potential functional meaning.
The present study provides the first evidence of a specific neural circuit that correctly classify patients with BPD, but such a scientific advance does not come without some limitations to point out. First, the sample size of patients with BPD was small. This is mainly because it is difficult to find open datasets including BPD data. For other disorders such as schizophrenia, depression, and anxiety, large datasets are now publicly available, but not for personality disorders. We acknowledged that a limited sample size in predictive models has been recently questioned because it may affect cross-validation error (82). However, there is also evidence that bigger sample size does not improve bias in performance estimates when this validation method is used [(83); see also (84), for different considerations on this topic]. Future studies with larger sample are needed to replicate these findings. A second limitation concerns mostly the type of the sample that consisted in patients on drugs. Although this can be a factor to be controlled in functional studies, in structural investigations, it should less affect results and individual variability (28, 31).
Despite the limitations, the present study represents a first attempt to addressed scholars' concerns that mental disorders are still lacking reliable and specific biomarkers (85–87), especially when considering BPD and personality disorders (88–90). The present finding encourages the employment of this methodology to disclose pathophysiology and improve classification of mental diseases (85, 89). We hope that this study will inspire future investigations in which a larger sample size will be used and in which BPD will be also distinguished from other psychopathologies, such as schizophrenia (91) or major depression (92).
Data Availability Statement
Publicly available datasets were analyzed in this study. This data can be found at: UCLA Consortium for Neuropsychiatric Phenomics - OpenNeuro database, accession number ds000030.
Ethics Statement
The studies involving human participants were reviewed and approved by reuse of open access data, see details inside manuscript. The patients/participants provided their written informed consent to participate in this study.
Author Contributions
AG conceptualized the study, performed the machine learning and other statistical analyses, and drafted the manuscript. GL and SS pre-processed the data and revised the manuscript. BM and IM conceptualized the study, drafted, and critically reviewed the article. RS supervised and reviewed the article. All authors contributed to the article and approved the submitted version.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
1. Paris J, Black DW. Borderline personality disorder and bipolar disorder: what is the difference and why does it matter? J Nerv Ment Dis. (2015) 203:3–7. doi: 10.1097/NMD.0000000000000225
2. Trull TJ, Jahng S, Tomko RL, Wood PK, Sher KJ. Revised NESARC personality disorder diagnoses: gender, prevalence, and comorbidity with substance dependence disorders. J Person Disord. (2010) 24:412–26. doi: 10.1521/pedi.2010.24.4.412
3. De Panfilis C, Schito G, Generali I, Gozzi L, Ossola P, Marchesi C, et al. Emotions at the border: Increased punishment behavior during fair interpersonal exchanges in Borderline Personality Disorder. J Abnorm Psychol. (2019) 128:162–72. doi: 10.1037/abn0000404
4. van Zutphen L, Siep N, Jacob GA, Domes G, Sprenger A, Willenborg B, et al. Impulse control under emotion processing: an fMRI investigation in borderline personality disorder compared to non-patients and cluster-C personality disorder patients. Brain Imag Behav. (2019) 14:2107–21. doi: 10.1007/s11682-019-00161-0
5. Davies G, Hayward M, Evans S, Mason O. A systematic review of structural MRI investigations within borderline personality disorder: Identification of key psychological variables of interest going forward. Psychiatry Res. (2020) 286:112864. doi: 10.1016/j.psychres.2020.112864
6. Nenadi,ć I., Katzmann I, Besteher B, Langbein K, Güllmar D. Diffusion tensor imaging in borderline personality disorder showing prefrontal white matter alterations. Comprehensive Psychiatry. (2020) 101:152172. doi: 10.1016/j.comppsych.2020.152172
7. Ruggero CJ, Zimmerman M, Chelminski I, Young D. Borderline personality disorder and the misdiagnosis of bipolar disorder. J Psychiatr Res. (2010) 44:405–8. doi: 10.1016/j.jpsychires.2009.09.011
8. Regier DA, Narrow WE, Clarke DE, Kraemer HC, Kuramoto SJ, Kuhl EA, et al. DSM-5 field trials in the United States and Canada, Part II: test-retest reliability of selected categorical diagnoses. Am J Psychiatry. (2013) 170:59–70. doi: 10.1176/appi.ajp.2012.12070999
9. Schulze L, Schmahl C, Niedtfeld I. Neural correlates of disturbed emotion processing in borderline personality disorder: a multimodal meta-analysis. Biol Psychiatry. (2016) 79:97–106. doi: 10.1016/j.biopsych.2015.03.027
10. Dadomo H, Grecucci A, Giardini I, Ugolini E, Carmelita A, Panzeri M. Schema therapy for emotional dysregulation: theoretical implication and clinical application. Front Psychol. (2016) 7:1987. doi: 10.3389/fpsyg.2016.01987
11. Dadomo H, Panzeri M, Caponcello D, Carmelita A, Grecucci A. Schema therapy for emotional dysregulation in personality disorders: a review. Curr Opin Psychiatry. (2018) 31:43–9. doi: 10.1097/YCO.0000000000000380
12. Frederickson JJ, Messina I, Grecucci A. Dysregulated anxiety and dysregulating defenses: toward an emotion regulation informed dynamic psychotherapy. Front Psychol. (2018) 9:2054. doi: 10.3389/fpsyg.2018.02054
13. Ruocco AC, Amirthavasagam S, Choi-Kain LW, McMain SF. Neural correlates of negative emotionality in borderline personality disorder: an activation-likelihood-estimation meta-analysis. Biol Psychiatry. (2013) 73:153–60. doi: 10.1016/j.biopsych.2012.07.014
14. Paris J. Differential diagnosis of bipolar and borderline personality disorders. Neuropsychiatry. (2011) 1:251. doi: 10.2217/npy.11.21
15. Paris J, Gunderson J, Weinberg I. The interface between borderline personality disorder and bipolar spectrum disorders. Compr Psychiatry. (2007) 48:145–54. doi: 10.1016/j.comppsych.2006.10.001
16. Koenigsberg HW, Anwunah I, New AS, Mitropoulou V, Schopick F, Siever LJ. Relationship between depression and borderline personality disorder. Depress Anxiety. (1999) 10:158–67. doi: 10.1002/(SICI)1520-6394(1999)10:4<158::AID-DA4>3.0.CO;2-B
17. Ding JB, Hu K. Structural MRI brain alterations in borderline personality disorder and bipolar disorder. Cureus. (2021) 13:e16425. doi: 10.7759/cureus.16425
18. Fettes P, Schulze L, Downar J. Cortico-striatal-thalamic loop circuits of the orbitofrontal cortex: promising therapeutic targets in psychiatric illness. Front Syst Neurosci. (2017) 11:25. doi: 10.3389/fnsys.2017.00025
19. Luo X, Mao Q, Shi J, Wang X, Li CR. Putamen gray matter volumes in neuropsychiatric and neurodegenerative disorders. World J Psychiatry Mental Health Res. (2019) 3:1020.
20. Soloff P, Nutche J, Goradia D, Diwadkar V. Structural brain abnormalities in borderline personality disorder: A voxel-based morphometry study. Psychiatry Res. (2008) 164:223–36. doi: 10.1016/j.pscychresns.2008.02.003
21. Xu T, Cullen KR, Mueller B, Schreiner MW, Lim KO, Schulz SC, et al. Network analysis of functional brain connectivity in borderline personality disorder using resting-state fMRI. NeuroImage. (2016) 11:302–15. doi: 10.1016/j.nicl.2016.02.006
22. Rossi R, Pievani M, Lorenzi M, Boccardi M, Beneduce R, Bignotti S, et al. Structural brain features of borderline personality and bipolar disorders. Psychiatry Res. (2013) 213:83–91. doi: 10.1016/j.pscychresns.2012.07.002
23. Prossin AR, Love TM, Koeppe RA, Zubieta JK, Silk KR. Dysregulation of regional endogenous opioid function in borderline personality disorder. Am J Psychiatry. (2010) 167:925–33. doi: 10.1176/appi.ajp.2010.09091348
24. Minzenberg MJ, Fan J, New AS, Tang CY, Siever LJ. Frontolimbic structural changes in borderline personality disorder. J Psychiatr Res. (2008) 42:727–33. doi: 10.1016/j.jpsychires.2007.07.015
25. Nunes PM, Wenzel A, Borges KT, Porto CR, Caminha RM, de Oliveira IR. Volumes of the hippocampus and amygdala in patients with borderline personality disorder: A meta-analysis. J Pers Disord. (2009) 23:333–45. doi: 10.1521/pedi.2009.23.4.333
26. Ruocco AC, Amirthavasagam S, Zakzanis KK. Amygdala hippocampal volume reductions as candidate endophenotypes for borderline personality disorder: a meta-analysis of magnetic resonance imaging studies. Psychiatry Res. (2012) 201:245–52. doi: 10.1016/j.pscychresns.2012.02.012
27. Bertsch K, Krauch M, Roelofs K, Cackowski S, Herpertz SC, Volman I. Out of control? Acting out anger is associated with deficient prefrontal emotional action control in male patients with borderline personality disorder. Neuropharmacol. (2019) 156:107463. doi: 10.1016/j.neuropharm.2018.12.010
28. Sorella S, Lapomarda G, Messina I, Frederickson JJ, Siugzdaite R, Job R, et al. Testing the expanded continuum hypothesis of schizophrenia and bipolar disorder. Neural and psychological evidence for shared and distinct mechanisms. NeuroImage. (2019) 23:101854. doi: 10.1016/j.nicl.2019.101854
29. Lapomarda G, Grecucci A, Messina I, Pappaianni E, Dadomo H. Common and different gray and white matter alterations in bipolar and borderline personality disorder: A source-based morphometry study. Brain Res. (2021) 1762:147401. doi: 10.1016/j.brainres.2021.147401
30. Lapomarda G, Pappaianni E, Siugzdaite R, Sanfey AG, Rumiati RI, Grecucci A. Out of control: an altered parieto-occipital-cerebellar network for impulsivity in bipolar disorder. Behav Brain Res. (2021). 406:113228. doi: 10.1016/j.bbr.2021.113228
31. Pappaianni E, De Pisapia N, Siugzdaite R, Crescentini C, Calcagnì A., Job R, et al. Less is more: psychological and morphometric differences between low vs high reappraisers. Cognit Affect Behav Neurosci. (2019) 20:128–40. doi: 10.3758/s13415-019-00757-5
32. Norman KA, Polyn SM, Detre GJ, Haxby JV. Beyond mind-reading: multi-voxel pattern analysis of fMRI data. Trends Cogn Sci. (2006) 10:424–30. doi: 10.1016/j.tics.2006.07.005
33. Mwangi B, Ebmeier KP, Matthews K, Steele JD. Multi-centre diagnostic classi- fication of individual structural neuroimaging scans from patients with major depressive disorder. Brain. (2012) 135:1508–21. doi: 10.1093/brain/aws084
34. Squarcina L, Bellani M, Rossetti MG, Perlini C, Delvecchio G, Dusi N, et al. Similar white matter changes in schizophrenia and bipolar disorder: A tract-based spatial statistics study. PLoS ONE. (2017) 12:e0178089. doi: 10.1371/journal.pone.0178089
35. Frick A, Gingnell M, Marquand AF, Howner K, Fischer H, Kristiansson M, et al. Classifying social anxiety disorder using multivoxel pattern analyses of brain function and structure. Behav Brain Res. (2014) 259:330–5. doi: 10.1016/j.bbr.2013.11.003
36. Mourao-Miranda J, Almeida J, Hassel S, de Oliveira L, Versace A, Marquand A, et al. Pattern recognition analyses of brain activation elicited by happy and neutral faces in unipolar and bipolar depression. Bipolar Disord. (2012) 14:451–60. doi: 10.1111/j.1399-5618.2012.01019.x
37. Rondina J, Kobuti Ferreira L, Luis de Souza Duran F, Kubo R, Rachel Ono C, Costa Leite C, et al. Selecting the most relevant brain regions to discriminate Alzheimer's disease T patients from healthy controls using multiple kernel learning: A comparison across functional and structural imaging modalities and atlases. NeuroImage. (2018) 17:628–41. doi: 10.1016/j.nicl.2017.10.026
38. Vai B, Parenti L, Bollettini I, Cara C, Verga C, Melloni E, et al. Predicting differential diagnosis between bipolar and unipolar depression with multiple kernel learning on multimodal structural neuroimaging. Eur Neuropsychopharmacol. (2020) 34:28–38. doi: 10.1016/j.euroneuro.2020.03.008
39. Henry C, Mitropoulou V, New AS, Koenigsberg HW, Silverman J, Siever LJ. Affective instability and impulsivity in borderline personality and bipolar II disorders: similarities and differences. J Psychiatr Res. (2001) 35:307–12. doi: 10.1016/S0022-3956(01)00038-3
40. Koenigsberg HW, Harvey PD, Mitropoulou V, Schmeidler J, New AS, Goodman M, et al. Characterizing affective instability in borderline personality disorder. Am J Psychiatry. (2002) 159:784–8. doi: 10.1176/appi.ajp.159.5.784
41. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders: Diagnostic and Statistical Manual of Mental Disorders, Fifth, Edition. Arlington, VA: American Psychiatric Association (2013). doi: 10.1176/appi.books.9780890425596
42. Swann AC, Pazzaglia P, Nicholls A, Dougherty DM, Moeller FG. Impulsivity phase of illness in bipolar disorder. J Affect Disord. (2003) 73:105–11. doi: 10.1016/S0165-0327(02)00328-2
43. Zanarini MC, Yong L, Frankenburg FR, Hennen J, Reich DB, Marino MF, et al. Severity of reported childhood sexual abuse and its relationship to severity of borderline psychopathology and psychosocial impairment among borderline inpatients. J Nerv Ment Dis. (2002) 190:381–7. doi: 10.1097/00005053
44. Brown MZ, Comtois KA, Linehan MM. Reasons for suicide attempts and nonsuicidal self-injury in women with borderline personality disorder. J Abnorm Psychol. (2002) 111:198–202. doi: 10.1037//0021-843x.111.1.198
45. Yu H, Meng YJ, Li XJ, Zhang C, Liang S, Li ML, et al. Common and distinct patterns of grey matter alterations in borderline personality disorder and bipolar disorder: Voxel-based meta-analysis. Br J Psychiatry. (2019) 215:395–403. doi: 10.1192/bjp.2019.44
46. Calhoun VD, Liu J, Adali T. A review of group ICA for fMRI data and ICA for joint inference of imaging, genetic, ERP data. Neuroimage. (2009) 45:S163–72. doi: 10.1016/j.neuroimage.2008.10.057
47. Grecucci A, Rubicondo D, Siugzdaite R, Surian L, Job R. Uncovering the social deficits in the autistic brain. A source-based morphometric study. Front Neurosci. (2016) 10:388. doi: 10.3389/fnins.2016.00388
48. Pappaianni E, Siugzdaite R, Vettori S, Venuti P, Job R, Grecucci A. Three shades of grey: detecting brain abnormalities in children with autism using source-, voxel- and surface-based morphometry. Euro J Neurosci. (2018) 47:13704. doi: 10.1111/ejn.13704
49. Grecucci A, Giorgetta C, Bonini N, Sanfey A. Reappraising social emotions: the role of inferior frontal gyrus, temporo-parietal junction and insula in interpersonal regulation. Front Hum Neurosci. (2013) 7:523. doi: 10.3389/fnhum.2013.00523
50. Grecucci A, Giorgetta C, van Wout M, Bonini N, Sanfey A. Reappraising the Ultimatum: an fMRI study of emotion regulation and decision-making. Cerebral Cortex. (2013) 23:399–410. doi: 10.1093/cercor/bhs028
51. Messina I, Bianco S, Sambin M, Viviani R. Executive and semantic processes in reappraisal of negative stimuli: insights from a meta-analysis of neuroimaging studies. Front Psychol. (2015) 6:956. doi: 10.3389/fpsyg.2015.00956
52. Poldrack RA, Gorgolewski KJ. OpenfMRI: open sharing of task fMRI data. NeuroImage. (2017) 144:259–61. doi: 10.1016/j.neuroimage.2015.05.073
53. First MB, Spitzer RL, Gibbon M, Williams JBW, Davies M, Borus J, et al. The structured clinical interview for DSM-III-R personality disorders (SCID-II). Part II: Multi-site test-retest reliability study. J Pres Disord. (1995) 9:92–104.
54. Yassa MA, Stark CEL. A quantitative evaluation of cross-participant registration techniques for MRI studies of the medial temporal lobe. Neuroimage. (2009) 44:319–27. doi: 10.1016/j.neuroimage.2008.09.016
55. Schrouff J, Monteiro JM, Portugal L, Rosa MJ, Phillips C, Mourao-Miranda J. Embedding anatomical or functional knowledge in whole-brain multiple kernel learning models. Neuroinformatics. (2018) 16:117–43. doi: 10.1007/s12021-017-9347-8
56. Schrouff J, Cremers J, Garraux G, Baldassarre L, Mourao-Miranda J, Phillips C. Localizing and comparing weight maps generated from linear kernel machine learning models. In: International Workshop on Pattern Recognition in Neuroimaging (PRNI). (2013). p. 124–7. doi: 10.1109/PRNI.2013.40
57. Lanckriet GR, Deng M, Cristianini N, Jordan MI, Noble WS. Kernel-based data fusion and its application to protein function prediction in yeast. Pac Symp Biocomput. (2004) 300–11. doi: 10.1142/9789812704856_0029
58. Tzourio-Mazoyer N, Landeau B, Papathanassiou D, Crivello F, Etard O, Delcroix N, et al. Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. Neuroimage. (2002) 15:273–89. doi: 10.1006/nimg.2001.0978
59. Du Y, Fu Z, Sui J, Gao S, Xing Y, Lin D, et al. NeuroMark: an automated and adaptive ICA based pipeline to identify reproducible fMRI markers of brain disorders. Neuroimage Clin. (2020) 28:102375. doi: 10.1016/j.nicl.2020.102375
60. Coulston CM, Tanious M, Mulder RT, Porter RJ, Malhi GS. Bordering on bipolar: the overlap between borderline personality and bipolarity. Aust New Zeal J Psychiatry. (2012) 46:506–21. doi: 10.1177/0004867412445528
61. Fu CH, Costafreda SG. Neuroimaging-based biomarkers in psychiatry: clinical opportunities of a paradigm shift. Canad J Psychiatry. (2013) 58:499–508. doi: 10.1177/070674371305800904
62. Wolfers T, Buitelaar JK, Beckmann CF, Franke B, Marquand AF. From estimating activation locality to predicting disorder: a review of pattern recognition for neuroimaging-based psychiatric diagnostics. Neurosci Biobehav Rev. (2015) 57:328–49. doi: 10.1016/j.neubiorev.2015.08.001
63. Soloff PH, Abraham K, Burgess A, Ramaseshan K, Chowdury A, Diwadkar VA. Impulsivity and aggression mediate regional brain responses in Borderline Personality Disorder: an fMRI study. Psychiatry Res. (2017) 260:76–85. doi: 10.1016/j.pscychresns.2016.12.009
64. Lamers A, Toepper M, Fernando SC, Schlosser N, Bauer E, Woermann F, et al. Nonacceptance of negative emotions in women with borderline personality disorder: association with neuroactivity of the dorsal striatum. J Psychiatry Neurosci. (2019) 44:303–12. doi: 10.1503/jpn.180077
65. Arend I, Henik A, Okon-Singer H. Dissociating emotion and attention functions in the pulvinar nucleus of the thalamus. Neuropsychology. (2015) 29:191–6. doi: 10.1037/neu0000139
66. Komura Y, Tamura R, Uwano T, Nishijo H, Kaga K, Ono T. Retrospective and prospective coding for predicted reward in the sensory thalamus. Nature. (2001) 412:546–9. doi: 10.1038/35087595
67. Ward LM. The thalamus: Gateway to the mind. WIREs Cogn Sci. (2013) 4:609–22. doi: 10.1002/wcs.1256
68. Adolphs R. What does the amygdala contribute to social cognition? Ann N Y Acad Sci. (2010) 1191:42–61. doi: 10.1111/j.1749-6632.2010.05445.x
69. Roy AK, Shehzad Z, Margulies DS, Kelly AMC, Uddin LQ, Gotimer K, et al. Functional connectivity of the human amygdala using resting state fMRI NeuroImage. (2009) 45:614–26. doi: 10.1016/j.neuroimage.2008.11.030
70. Haxby JV, Gobbini MI. Distributed neural systems for face perception. In: The Oxford Handbook of Face Perception. (Oxford) (2011). p. 93–110. doi: 10.1093/oxfordhb/9780199559053.013.0006
71. Schultz RT, Grelotti DJ, Klin A, Kleinman J, Van der Gaag C, Marois R, et al. The role of the fusiform face area in social cognition: implications for the pathobiology of autism. Philos Trans R Soc London. (2003) 358:415–27. doi: 10.1098/rstb.2002.1208
72. Schurz M, Radua J, Tholen MG, Maliske L, Margulies DS, Mars RB, et al. Toward a hierarchical model of social cognition: a neuroimaging meta-analysis and integrative review of empathy and theory of mind. Psychol Bull. (2021) 147:293. doi: 10.1037/bul0000303
73. Koenigsberg HW, Fan J, Ochsner KN, Liu X, Guise KG, Pizzarello S, et al. Neural correlates of the use of psychological distancing to regulate responses to negative social cues: a study of patients with borderline personality disorder. Biol Psychiatry. (2009) 66:854–63. doi: 10.1016/j.biopsych.2009.06.010
74. Wolf RC, Thomann PA, Sambataro F, et al. Orbitofrontal cortex and impulsivity in borderline personality disorder: an MRI study of baseline brain perfusion. Eur Arch Psychiatry Clin Neurosci. (2012) 262:677–85. doi: 10.1007/s00406-012-0303-1
75. Depping MS, Thomann PA, Wolf ND, Vasic N, Sosic-Vasic Z, Schmitgen MM, et al. Common and distinct patterns of abnormal cortical gyrification in major depression and borderline personality disorder. Euro Neuropsychopharmacol. (2018) 28:1115–25. doi: 10.1016/j.euroneuro.2018.07.100
76. Sorella S, Grecucci A, Piretti L, Job R. Do anger perception and the experience of anger share common neural mechanisms? Coordinate-based meta-analytic evidence of similar and different mechanisms from functional neuroimaging studies. NeuroImage. (2021) 230:117777. doi: 10.1016/j.neuroimage.2021.117777
77. Pierce JE, Péron J. The basal ganglia and the cerebellum in human emotion. Soc Cogn Affect Neurosci. (2020) 15:599–613. doi: 10.1093/scan/nsaa076
78. Napier TC, Mickiewicz AL. The role of the ventral pallidum in psychiatric disorders. Neuropsychopharmacol. (2010) 35:337. doi: 10.1038/npp.2009.113
79. Leggio M, Olivito G. Topography of the cerebellum in relation to social brain regions and emotions. Handb Clin Neurol. (2018) 154:71–84. doi: 10.1016/B978-0-444-63956-1.00005-9
80. Brunner R, Henze R, Richter J, Kaess M. Neurobiological findings in youth with borderline personality disorder. Scand J Child Adolesc Psychiatr Psychol. (2015) 3:22–30.
81. Daros AR, Guevara MA, Uliaszek AA, McMain SF, Ruocco AC. Cognitive emotion regulation strategies in borderline personality disorder: diagnostic comparisons and associations with potentially harmful behaviors. Psychopathology. (2018) 51:83–95. doi: 10.1159/000487008
82. Varoquaux G. Cross-validation failure: small sample sizes lead to large error bars. Neuroimage. (2018) 180:68–77. doi: 10.1016/j.neuroimage.2017.06.061
83. Vabalas A, Gowen E, Poliakoff E, Casson AJ. Machine learning algorithm validation with a limited sample size. PLoS ONE. (2019) 14:e0224365. doi: 10.1371/journal.pone.0224365
84. Turner BO, Santander T, Paul EJ, Barbey AK www.nature.com/articles/s42003-019-0379-5#auth-MichaelB-Miller MB. Reply to: fMRI replicability depends upon sufficient individual-level data. Commun Biol. (2019) 2:129. doi: 10.1038/s42003-019-0379-5
85. Linden DEJ. The challenges and promise of neuroimaging in psychiatry. Neuron. (2012) 73:8–22. doi: 10.1016/j.neuron.2011.12.014
86. Pratt J, Hall J. Biomarkers in Psychiatry. Cham: Springer (2019). doi: 10.1007/978-3-319-99642-4
87. Lozupone M, La Montagna M, D'Urso F, Daniele A, Greco A, Seripa D, et al. The role of biomarkers in psychiatry. Adv Exp Med Biol. (2019) 1118:135–62. doi: 10.1007/978-3-030-05542-4_7
88. Sanches M. The limits between bipolar disorder and borderline personality disorder: a review of the evidence. Diseases. (2019) 7:49. doi: 10.3390/diseases7030049
89. Quevedo J, Yatham LN. Biomarkers in mood disorders: Are we there yet? J Affect Disord. (2018) 233:1–2. doi: 10.1016/j.jad.2018.01.002
90. Moran P, Crawford M. Assessing the severity of borderline personality disorder. Br J Psychiatry. (2013) 203:163–4. doi: 10.1192/bjp.bp.113.128249
91. Zandersen M, Henriksen MG, Parnas J. A recurrent question: what is borderline? J Pers Disord. (2019) 33:341–69. doi: 10.1521/pedi_2018_32_348
Keywords: Borderline Personality Disorder, bipolar disorder, machine learning, multi-voxel pattern analysis, affective instability
Citation: Grecucci A, Lapomarda G, Messina I, Monachesi B, Sorella S and Siugzdaite R (2022) Structural Features Related to Affective Instability Correctly Classify Patients With Borderline Personality Disorder. A Supervised Machine Learning Approach. Front. Psychiatry 13:804440. doi: 10.3389/fpsyt.2022.804440
Received: 29 October 2021; Accepted: 03 January 2022;
Published: 28 February 2022.
Edited by:
Giorgia Silani, University of Vienna, AustriaReviewed by:
Joel Paris, McGill University, CanadaSimon Surguladze, South London and Maudsley NHS Foundation Trust, United Kingdom
Copyright © 2022 Grecucci, Lapomarda, Messina, Monachesi, Sorella and Siugzdaite. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Alessandro Grecucci, YWxlc3NhbmRyby5ncmVjdWNjaSYjeDAwMDQwO3VuaXRuLml0