- 1National Laboratory of Biosciences, Brazilian Center for Research in Energy and Materials, Campinas, Brazil
- 2School of Electrical and Computer Engineering, University of Campinas, Campinas, Brazil
- 3Brazilian Synchrotron Light Laboratory, Brazilian Center for Research in Energy and Materials, Campinas, Brazil
- 4Neuroimaging Laboratory, Neurology Department, University of Campinas, School of Medical Sciences, Campinas, Brazil
The study of brain connectivity has been a cornerstone in understanding the complexities of neurological and psychiatric disorders. It has provided invaluable insights into the functional architecture of the brain and how it is perturbed in disorders. However, a persistent challenge has been achieving the proper spatial resolution, and developing computational algorithms to address biological questions at the multi-cellular level, a scale often referred to as the mesoscale. Historically, neuroimaging studies of brain connectivity have predominantly focused on the macroscale, providing insights into inter-regional brain connections but often falling short of resolving the intricacies of neural circuitry at the cellular or mesoscale level. This limitation has hindered our ability to fully comprehend the underlying mechanisms of neurological and psychiatric disorders and to develop targeted interventions. In light of this issue, our review manuscript seeks to bridge this critical gap by delving into the domain of mesoscale neuroimaging. We aim to provide a comprehensive overview of conditions affected by aberrant neural connections, image acquisition techniques, feature extraction, and data analysis methods that are specifically tailored to the mesoscale. We further delineate the potential of brain connectivity research to elucidate complex biological questions, with a particular focus on schizophrenia and epilepsy. This review encompasses topics such as dendritic spine quantification, single neuron morphology, and brain region connectivity. We aim to showcase the applicability and significance of mesoscale neuroimaging techniques in the field of neuroscience, highlighting their potential for gaining insights into the complexities of neurological and psychiatric disorders.
1 Introduction
The human brain is a remarkably intricate network composed of billions of neurons, encompassing diverse cell types interconnected through trillions of synapses (Luo et al., 2008). Different brain regions exhibit distinct microstructural architectures, functional specializations, interconnectivity, and often an orderly topographic arrangement. The major task in connectivity-related research is capturing the hierarchical multiscale organization of the brain by mapping network relationships across various spatial dimensions (Sporns, 2013). It extends beyond structural considerations and encompasses functionality, denoted by the degree of correlation and covariance among brain signals, influenced by both experimental parameters and temporal context (Cabral et al., 2017).
The organization of brain connections plays a pivotal role in shaping interactions between different brain areas, giving rise to a multitude of functional networks. Structural data provide the anatomical framework, while functional data reveal how different brain regions work together and respond to various stimuli or tasks. The multimodal correlation of imaging techniques, integrating both structural and functional neuroimaging methods, allows the harnessing of their best features, offering a broader approach and better understanding of brain connectivity (Howard et al., 2023). This multidimensional approach is essential for advancing our knowledge of complex neurological and cognitive processes (Hirsch et al., 2015).
Multiple, albeit subtle, non-physiological shifts in brain organization likely lead to network disorders which encompass a wide range of neurological and psychiatric conditions arising from aberrant neural connections. These include autism spectrum, schizophrenia, attention-deficit/hyperactivity, epilepsy, depression, and anxiety disorders (Kaiser, 2013; Contreras-Rodríguez et al., 2015; Holmes et al., 2023).
Most of the data used to reconstruct brain networks comes from bidimensional (2D) images. However, the correlation between a single cell interacting with the whole neuronal tissue in a tridimensional (3D) manner remains an open problem. This 3D spatial-scale context holds the key to bridging morphological mechanisms and functional outcomes to better understand the complexities of brain connectivity-related disorders. The complex 3D circuits that define brain connectivity comprise a variety of organizational structures and microarchitectures that can be arduous to discern (Sporns et al., 2005), presenting a significant challenge in the field of neuroscience and computational analysis. Additionally, to preserve the volumetric information of the network it can be necessary to work with samples as thick as possible coupling to 3D-imaging techniques, as extensively applied in image-based neuroresearch and diagnosis (Kim et al., 2021).
The brain connectome sensu (Sporns et al., 2005) takes on different definitions at various scales, presenting a defying task in translating morphological and functional measurements to the symptoms of brain disorders affected by connectivity. Understanding integrated brain function demands a multitude of measurements across various scales. Neurophysiological and neuroimaging methods, along with the use of whole-brain models to provide fresh insights into its underlying mechanisms (Hallett et al., 2020). Thus, brain connectivity conventionally encompasses three scales: nano/microscale, mesoscale, and macroscale (Bohland et al., 2009), each one with its optimized imaging method (Figure 1).
Figure 1. Overview of experimental bioimage tools currently available for studying neural connectivity across a range of spatial scales and biological questions. At the left, different human brain organization structures are presented under the perspective of spatial scales: from the study of the dendritic spine (top) to the whole brain (bottom), with a focus on the structures that can be studied using mesoscale imaging. From the top to the bottom, spatial scales range from 10 nanometers to 10 millimeters. The second section, denoted Biological Inquiries, displays the cellular elements that contribute and shape neural connectivity across the different scales, followed by a repertoire of image acquisition techniques displayed as vertical bars in the last section. Purple bars represent techniques suited to structural imaging while the pink bars represent the ones suited for functional purposes; lastly, the red bars represent techniques that incorporate both. MRI, magnetic resonance imaging; fMRI, functional magnetic resonance Imaging; SPECT, single photon emission computed tomography; PET, positron emission tomography.
At the nano/microscale, lies the ultrastructural information, that can reveal synaptic morphology, their components and connections in individual cells, often employing Electron Microscopy (EM), demanding sample chemical preservation and physical sectioning. The opposite extreme encompasses the macroscale, which examines the anatomical and connective patterns between distinct brain regions, such as long-range connections, often inferred from fiber tracts, and frequently revealed by techniques also capable of retrieving functional aspects, such as Magnetic Resonance Imaging (MRI), Positron Emission Tomography (PET), Single Photon Emission Computed Tomography (SPECT). These approaches prove particularly valuable for non-invasive studies of living tissues (Bennett et al., 2018).
Between both spatial extremities lies the multi-cellular level (Mitra, 2014), also known as the mesoscale, which plays a pivotal role in the investigation of the intricate network of the brain. Mesoscale spans from the structural and functional properties of single neurons to local neural circuits and their intrinsic connectivity (Mitra, 2014; Haueis, 2021).
Most neuroimaging studies on humans and human samples have primarily used macroscale techniques like PET and functional magnetic resonance imaging (fMRI) for in vivo imaging, and microscale techniques such as thin-depth light microscopy for tissue samples. Although substantial insights into brain networks and abnormal connectivity have been acquired using these techniques, they lack the spatial resolution needed to resolve the 3D conformation of local neuronal connections (Tyson and Margrie, 2022). Consequently, further progress in the understanding of brain functions within complex neuronal circuits requires exploration at the mesoscale level (Rah et al., 2015). It depicts connections, networks, and spatial cellular gradients of distinct neuronal populations, improving resolution and the analysis of interactions that form the basis of cognitive and behavioral processes (Haueis, 2021). Intact/live samples can be used, albeit sample preparation is necessary according to the specific imaging technique. Optical microscopies (wide field, laser confocal, light sheet, and two-photons) allow both high spatial and temporal resolution, often used to study live cells.
In this landscape, data acquisition and image processing emerge as a critical domain of local neural circuits, i.e., spatially co-localized neurons of the same kind or with shared organizational traits (Bohland et al., 2009). It also generates a huge amount of data to be processed and may not be as easily quantifiable (Lang et al., 2012; Chen et al., 2019). Currently, artificial intelligence algorithms have proved their ability to help researchers in image processing and analysis: from contrast enhancement/normalization to segmentation and extraction of morphological features necessary for structural correlation of connectivity (Durkee et al., 2021).
As stated above, neuroimaging encompasses a diverse array of techniques for exploring different scales of magnitude and activities within cells and tissues. Consequently, data analyses are predominantly linked to the complexities of the images, posing a challenge for neuroscientists who may not be familiar with the intricacies of the field. In this review, we aim to explore mesoscale brain imaging and processing, arranging the main methodologies traditionally used to investigate brain functioning throughout its network. It begins by exploring the state-of-the-art in neurological and psychiatric disorders research and imaging techniques relevant to the field; it then addresses image processing strategies suited to solving these questions. Recent literature was compiled on various imaging modalities to study neural connections and the respective computational methods to identify misorganization in schizophrenia and epilepsy. It also organizes concepts in network neurological disorders to guide non-expert and advanced readers in the field of neuroimaging and processing. Finally, to accommodate the diverse readership in this multidisciplinary field, a Glossary tailored to the terminology of some key concepts in neurobiology, imaging, and computational processing is included.
2 Brain connectivity in disorders of the central nervous system
This section explores a selection of connectivity-related issues and the bioimaging techniques employed to address them. Disorders affected by brain connectivity encompass a wide range of neurological and psychiatric conditions arising from aberrant neural connections. These include autism spectrum disorder, schizophrenia, attention-deficit/hyperactivity disorder, epilepsy, depression, and anxiety disorders (Kaiser, 2013; Contreras-Rodríguez et al., 2015; Holmes et al., 2023). Although substantial insights into the network of the brain and abnormal connectivity in these disorders have been gained using macroscale imaging techniques such as MRI and PET, further progress in our understanding requires the exploration at the mesoscale level for increased resolution. In this section, we examine brain connectivity in two different disorders, representing examples from psychiatric and neurological conditions. Our analysis highlights the crucial role of advanced neuroimaging techniques in uncovering the complexities of these conditions. We particularly focus on the potential of mesoscale neuroimaging to further enhance our understanding of their underlying mechanisms.
2.1 Schizophrenia
Schizophrenia is a multifactorial mental condition that impacts over 23 million individuals worldwide. It involves positive symptoms such as delusions and hallucinations, negative symptoms such as reduced motivation and social withdrawal, and cognitive impairment. The pathophysiology of schizophrenia involves molecular and morphological abnormalities within the nervous system, encompassing faulty brain connectivity, altered myelination of brain regions and white matter tracts, as well as abnormal neuronal morphology and defects in neurotransmitter systems (Schultz and Andreasen, 1999; Kahn et al., 2015).
Recent years have witnessed significant advancements in imaging studies, shedding light on the neurobiological basis of schizophrenia. In this section, we delve into the contribution of imaging studies to our understanding of the connectivity basis of the disorder.
2.1.1 Structural and functional brain network abnormalities
Coordinated functioning of multiple brain regions is crucial for normal brain function, encompassing perception, cognition, emotions, and mood responses. A significant amount of evidence points to a dysfunctional local circuitry in schizophrenia in the prefrontal cortex (PFC) and its connections with other brain regions, particularly those associated with the limbic system (Lewis et al., 2005). In the past two decades, numerous studies involving neuroimaging techniques like fMRI have yielded compelling findings indicating abnormal activity within the local prefrontal network and disrupted integration of information processes in the PFC and other brain regions among individuals with schizophrenia (Anticevic et al., 2014, 2015; Hunt et al., 2017). Although the evidence supporting disconnectivity in schizophrenia is robust, understanding its causes is complex, and there is ongoing debate regarding its mechanisms and significance concerning clinical symptoms (Gao W. et al., 2022).
Investigations using fMRI have consistently revealed disrupted connectivity in individuals with schizophrenia, both during resting-state conditions and while engaged in specific cognitive tasks (Garrity et al., 2007; Whitfield-Gabrieli et al., 2009; Sheffield and Barch, 2016; Erdeniz et al., 2017; Godwin et al., 2017). More recently, a meta-analysis and an original article reported consistent changes in local functional connectivity in schizophrenia. It was found that patients showed significantly higher Regional Homogeneity (ReHo) in the bilateral medial superior frontal gyrus, while lower ReHo in the bilateral post-central gyrus, right pre-central gyrus, and right middle occipital gyrus (Cai et al., 2022); and differences in the functional connectivity between the salience network and certain brain regions, including the right inferior and middle temporal gyrus, left caudate, and right pre-central gyrus (Huang H. et al., 2022). These findings suggest that there are consistent aberrant local functional connectivity patterns in schizophrenia.
The assessment of functional connectivity in schizophrenia relies predominantly on fMRI scanning data acquired from adult individuals diagnosed with the disorder. However, due to the dependence of fMRI on hemodynamic fluctuations associated with neural activity, it is unsuitable for capturing rapid transitions in brain functional connectivity configurations with high temporal resolution (Jamadar et al., 2021). Moreover, the spatial resolution of this technique is limited to a millimeter scale. As a result, our comprehension of the cellular mechanisms underlying the aberrant brain functional connectivity observed in schizophrenia remains incomplete.
2.1.2 Neurotransmitter systems
Multiple etiological hypotheses have been proposed to elucidate the abnormal brain connectivity seen in schizophrenia. The dopaminergic hypothesis posits that abnormal dopaminergic neurotransmission contributes to the development and manifestation of schizophrenia (Creese et al., 1976; Toda and Abi-Dargham, 2007). Several lines of evidence support the dopaminergic hypothesis such as alterations in dopamine receptor density and availability in affected individuals revealed by PET and SPECT imaging (Patel et al., 2010). Specifically, an increased number of dopamine D2 receptors has been observed in the limbic striatum. Hyperactivity of D2 receptors in the mesolimbic pathway is thought to contribute to the positive symptoms of schizophrenia (Howes et al., 2009).
The glutamatergic hypothesis was also proposed as an additional perspective on the pathophysiology of schizophrenia (McCutcheon et al., 2020). For instance, decreased glutamate levels have been found in the anterior cingulate cortex and prefrontal cortex, regions implicated in cognitive and emotional processing (Chen et al., 2017). Moreover, PET studies have shown abnormalities in the expression, binding, and availability of glutamate receptors in various brain regions of individuals with schizophrenia (Beck et al., 2021).
It is becoming increasingly evident that the dopaminergic and glutamatergic hypotheses alone fall short of providing a comprehensive explanation for the disorder highlighting the need to consider additional neurochemical systems involved in schizophrenia, such as the GABAergic system (Jahangir et al., 2021). fMRI and PET studies have also provided insights into the altered neural connectivity and network dynamics associated with GABAergic abnormalities in the disorder (Shukla et al., 2019; Marques et al., 2021).
2.1.3 Myelin and white matter tracts
Employing MRI, researchers investigated gray/white-matter contrast in sensory and motor regions of the cortex in schizophrenia revealing reduced myelin in three bilateral sensory and motor regions (Jørgensen et al., 2016). Furthermore, a study employing Diffusion Tensor Imaging (DTI-fMRI) observed significantly lower fractional anisotropy (FA) values in white matter tracts of patients with psychosis compared to healthy controls (Xu et al., 2022). Additionally, the study demonstrated a positive correlation between decreased white matter tract integrity and cognitive performance in patients with psychosis. Electron microscopy of brain tissue from individuals with schizophrenia revealed ultrastructural signs of apoptosis and necrosis in oligodendroglial cells within the cortex and the caudate nucleus with damage to myelin sheath lamellae, and a significant decrease in the nucleus area and volume density of mitochondria (Uranova et al., 2001).
2.1.4 Dendritic pathology
Dendritic spines are the primary sites of excitatory synaptic connections (Papa et al., 1995). As such, alterations to their morphology directly impact the neuronal circuitry within and across multiple brain regions, potentially contributing to the pathogenesis of schizophrenia. Studies on schizophrenia subjects have revealed reductions in dendritic spine density, dendritic arborization and plasticity in several cortical and non-cortical areas (Glantz and Lewis, 2000; Konopaske et al., 2014; MacDonald et al., 2017). By employing confocal microscopy, researchers have investigated the formation, maturation, and pruning of synaptic connections, using in vitro models (Sellgren et al., 2019). Studies in human stem cell-derived neural models have revealed increased synapse elimination and significant developmental and connectivity issues, including the abnormal spread of proliferating neural progenitor cells from the ventricular zone to the intermediate and cortical zones (Stachowiak et al., 2017). Interestingly, maturing neurons were found to be abundantly developed in the deeper neural structure (analogous to subcortical regions) but were notably depleted in surface layers (analogous to the cortical region) of schizophrenia neural organoids.
2.2 Epilepsy
Epilepsy is recognized as a network disorder with multifactorial causes, representing a multiscale challenge that includes cellular, network, and systems levels. It encompasses widespread areas that stretch well beyond the pinpointed site of a seizure, displaying distinctive patterns that might be specific to each particular syndrome (Stafstrom and Carmant, 2015). To gain a comprehensive understanding of the mechanisms underlying hyperexcitability in epilepsy, it is essential to highlight two primary epilepsy classifications. The first is focal epilepsy, which is characterized by seizures originating from a specific focal onset within one hemisphere of the brain, as determined by clinical patterns or electroencephalogram (EEG) localization. Common examples of focal epilepsy encompass conditions like mesial temporal lobe epilepsy associated or not with hippocampal sclerosis and malformations of cortical development. The second classification, generalized epilepsy, is defined by seizures occurring simultaneously in both hemispheres (Fisher, 2017). In this topic, we review the literature on abnormal neural networks and harness the potential of imaging techniques to address critical knowledge gaps in epilepsy-related brain connectivity.
2.2.1 Structural and functional brain network abnormalities
In vivo mapping of the regional distribution of network abnormalities is a crucial way to define precisely the site of seizure onset. The identification of the site where seizures start and how they propagate is critical to understanding both the pathophysiology of epilepsies and developing therapeutic approaches. Macroscale neuroimaging techniques, such as high-resolution MRI and fMRI, are the entrance step in providing insights into the topological organization of brain networks and connectivity disruptions in epilepsy patients.
Extensive findings have emerged from quantitative structural MRI investigations employing volumetry, voxel-based morphometry, cortical thickness mapping, and structural covariance analysis. In DTI investigations, several parameters can be obtained to characterize white matter microstructure including tractography, tensor-derived metrics, and connectivity matrices (Bartolomei et al., 2005).
In structural MRI, volumetric analysis frequently reveals atrophy in limbic structures, such as the hippocampus, entorhinal cortex, and amygdala, which often correlates with histological evidence of neuronal loss in excised temporal lobe epilepsy (TLE) brain tissue (Bartolomei et al., 2005; Bernhardt et al., 2013). Likewise, post-processing methods in quantitative MRI, such as voxel-based morphometry and cortical thickness analysis, have also revealed that TLE is linked to widespread neocortical irregularities. Covariance analyses of these abnormalities extend beyond mesial temporal structures to comprise prefrontal, frontocentral, cingulate, occipitotemporal, and lateral temporal neocortex (Bernasconi et al., 2004; Bernhardt et al., 2012, 2013). ENIGMA-Epilepsy MRI scans showed gray and white matter changes in different epilepsy types, with more widespread and bilateral extra-hippocampal gray matter differences in left TLE (Whelan et al., 2018; Hatton et al., 2020; Sisodiya et al., 2020). Also, in individuals with TLE, the investigation of preoperative structural connectivity using DTI-fMRI and its association with post-operative seizure control outcomes revealed specific preoperative connectivity patterns that are associated with improved surgical outcomes (Bonilha et al., 2013).
While there has been substantial progress in understanding structural connectivity abnormalities at the macroscale, we face limitations due to our access being restricted to network topology without achieving a finer neuronal resolution and specificity. In this regard, the mesoscale provides a more precise comprehension by pinpointing the particular neural components contributing to local connectivity. Thus, the gold standard for noticing abnormal structural connectivity in a mesoscale is anterograde and retrograde viral neuronal tracing (Lanciego and Wouterlood, 2020). These tracers exhibit high accuracy and sensitivity, especially when mapping long-range connections, thus contributing to a comprehensive and detailed understanding of connectivity across various brain areas (Saleeba et al., 2019). Their invasive nature restricts the use to animal models. Du et al. (2017) employed a rat model induced by pilocarpine and utilized rabies tracing techniques to discern intricate morphological details of projections within the dynamic hippocampal circuit. This study revealed that newly formed dentate granule cells (DGCs) in adults, triggered by seizures, receive excitatory signals from pyramidal cells in the cornu Ammonis (CA3) and repeated excitatory inputs from other DGCs.
In fMRI, Englot et al. (2016) explored local and distant synchronization of resting-state fMRI signals in TLE and focal epilepsy patients. They observed altered connectivity within and between various brain regions, highlighting the impact of epilepsy on network organization. Likewise, analysis of resting state in focal cortical dysplasia (FCD) identified distinct patterns of functional connectivity with the hypo-connected patterns in cases with FCD type IIB, whereas the hyperconnected lesions were predominantly associated with type IIA (Hong et al., 2019).
2.2.2 Abnormal neuron morphology
Alterations in the size and shape of neuronal cell bodies have been detected across diverse brain regions, encompassing the hippocampus, neocortex, and other regions linked to abnormal neural connectivity (Stouffer et al., 2016). The connection between these morphological alterations and epileptogenesis has already been confirmed (Abdijadid et al., 2015). These deviations in neuronal cell body structure can influence the interconnection and communication between neurons, potentially influencing the onset and advancement of epilepsy (Hsieh et al., 2016; Wu et al., 2022). More precisely, these alterations in local and global connectivity can impact the manifestation of seizures, determining whether abnormal connectivity and hyperexcitability result in focal or generalized seizures (Sheybani et al., 2018; Represa, 2019).
In focal epilepsies, malformations of cortical development are associated as the primary substrate in which the presence of morphologically abnormal neurons significantly affects neural connectivity (Mainen and Sejnowski, 1996; Richards and Van Hooser, 2018). The existence of atypical neurons could influence the subsequent stages of development that regulate cortical synaptic connectivity (Subramanian et al., 2020). Avansini et al. (2022) observed an enhanced level of network connectivity (termed effective connectivity) along with increased neuronal excitability in human neural organoids derived from pluripotent stem cells of patients with FCD. The aberrant connectivity seen in FCD appears to be influenced by neuronal morphological abnormalities, particularly the presence of dysmorphic neurons. Using 3D confocal microscopy, the researchers detected enlarged cell bodies and increased dendritic complexity, potentially contributing to a more interconnected neural circuitry and the formation of an epileptogenic network in FCD.
Using high-resolution synchrotron x-ray microtomography and Golgi-Cox staining, Fonseca et al. noticed an altered distribution of neurons and a reduction of cell number in the hippocampus in a status epilepticus mouse model. These approaches allowed the assessment of the 3D cytoarchitecture, neuron density, and morphology (Fonseca et al., 2018).
2.2.3 Abnormal neuronal localization
The integration of dendrites and synapses into functional networks is heavily affected by how neocortical neurons are positioned during development (Martineau et al., 2018). Malpositioned neurons in the cortex cytoarchitecture are called heterotopic neurons (Ishii et al., 2015). These neurons alone may play a role but do not seem to be sufficient to trigger seizures (Aghakhani et al., 2005). The aberrant organization of cortical cytoarchitecture potentially leads to aberrant connections within these developing neuronal networks. Additionally, the recruitment of distinct microcircuits from different cortical locations could alter synchronicity, leading to abnormal neural oscillations (Dubeau et al., 1995; Abdijadid et al., 2015).
Neuronal disorganization and clusters of heterotopic neurons are primarily observed in human specimens from cortical migration malformations such as periventricular heterotopia (Ekşioğlu et al., 1996) and FCD type I (Coras et al., 2021) using light microscopy with immunohistochemical and DiI tracing techniques. Additionally, in animal epilepsy models (Mello et al., 1993), there have been observations of heterotopic granule cells in the dentate gyrus, resembling those found in human epilepsy. Heterotopic granule cells establish new connections and potentially impact synaptic reorganization (Babb, 1991).
2.2.4 Dendritic pathology
The presence of dendritic spine pathologies and abnormal dendritic arborization have been suggested to be implicated in epilepsy worsening, increasing neuronal hyperexcitability in the circuits, and contributing to cognitive deficits, synaptic remodeling, and aberrant plasticity (Fiala et al., 2002).
Dendritic spines are mostly observed in excitatory synapses and neurons respond to epileptogenic changes in the circuitry by modifying the structure of their dendritic trees. Alterations in the distribution, quantity, and morphology of dendritic spines have been proposed to have a direct impact on seizures and epileptogenesis (Jiang et al., 1998; Jean et al., 2023). However, it remains unclear whether these changes are the cause or are a consequence of seizure recurrence (Wong and Guo, 2013). Dendritic pathology in epilepsy can be broadly categorized into two main fields, as described below:
Neuronal dendritic arborization: Morphological changes of dendrites can affect neuronal excitability. Abnormalities in dendritic length, shape, and branching patterns have been described in epilepsies associated with either hippocampal sclerosis, or tumors, or microdysgenesis (von Campe et al., 1997), and also associated with the presence of varicose swelling of the dendrites of granular dentate neurons of the hippocampus (Blümcke et al., 1999).
Dendritic spine pathology: The initial observation of dendritic spine loss occurred in hippocampal pyramidal neurons and dentate granule cells among individuals with TLE (Scheibel et al., 1974), providing a plausible mechanism to elucidate the learning and memory challenges experienced by these patients (Chen et al., 2010). In Lennox-Gastaut syndrome, a childhood epileptic disorder linked to intellectual disability, pyramidal neurons from brain biopsy were observed to possess a reduced number of spines using EM (Renier et al., 1988). In human cerebral cortices derived from FCD patients, a reduction of dendritic spines, and sporadic filopodia-like protrusions emerging from the soma in dysmorphic neurons were noticed using Golgi impregnation and confocal microscopy (Rossini et al., 2023).
Employing Golgi-Cox staining, optionally combined with immunohistochemistry, as well as DiI tracing, and utilizing both confocal microscopy and EM techniques, provides a comprehensive method for assessing the morphology and structure of dendritic arborization, as well as the density and morphology of neuronal dendritic spines in epilepsy.
2.3 Exploring connectivity in central nervous system disorders via mesoscale imaging for deeper insights
Functional and structural imaging studies have consistently identified aberrant connectivity as a fundamental feature in the pathogenesis of various brain disorders. These investigations have primarily involved live human subjects and focused on a macroscale level, employing techniques such as MRI/fMRI and PET/SPECT, which deliver the overall spatial context of a large field of views, albeit at lower resolution. As seen in Table 1, which compiles brain connectivity studies in schizophrenia and epilepsy from the literature, there has historically been an over-representation of use of macroscale techniques to try to answer biological questions. While these studies have provided valuable insights into the presence of aberrant connectivity, they have fallen short in uncovering its precise etiological underpinnings in different brain disorders. Mesoscale imaging provides a means to address the potential untapped source of information for novel insights pertaining to brain connectivity, as observed in this context.
Table 1. Compilation of brain connectivity studies in schizophrenia and epilepsy: synthesis across different scales, data acquisition modalities, and image processing strategies.
To gain more understanding of the etiology of these disorders, the integration of morphological and functional 3D data at mesoscale resolution is imperative. Multimodal imaging techniques, including confocal microscopy, light-sheet microscopy, EM, and x-ray tomography, present promising opportunities to obtain a more comprehensive perspective on alterations in neural connectivity. Nevertheless, it is essential to recognize the impracticality of performing live imaging at a mesoscale level in human subjects. In this scenario, robust in vitro models, such as 2D neuronal cultures and 3D neural organoid cultures, play a critical role in investigating the complexities of human aberrant connectivity within a controlled environment in a model that more closely resembles human brain development. These combined efforts have the potential to enhance our comprehension of the origins and establishment of aberrant connectivity, and may ultimately contribute to the development of innovative therapeutic approaches.
In recent years, significant advancements have been achieved in the field of mesoscale multimodal imaging, enabling the integration of diverse techniques for comprehensive analysis. Notably, it is now possible to merge a myriad of imaging modalities, resulting in the complete 3D morphological reconstruction of individual neurons while simultaneously acquiring invaluable functional data in view to study global connectivity (Keller and Ahrens, 2015; Kuan et al., 2020; Santuy et al., 2020; Muñoz-Castañeda et al., 2021; Walsh et al., 2021; Bosch et al., 2022; Pisano et al., 2022). Among these techniques are Genetically Encoded Calcium Indicators (GECIs) (Miyawaki et al., 1997; Nakai et al., 2001), with the recently developed CaMPARI (calcium-modulated photoactivatable ratiometric integrator) emerging as a notable standout in mesoscale imaging (Fosque et al., 2015). CaMPARI distinguishes itself by its unique feature of irreversibly labeling photoconverted neurons, extending the observation of active networks beyond the initial snapshot of activity. This capability has been leveraged to capture task-dependent activity patterns across brain regions and visualize hippocampal synaptic plasticity in freely moving animals (Berndt et al., 2023; Das et al., 2023). Notably, the practicality of CaMPARI is enhanced by its capability for multiple uses in longitudinal in vivo studies (Das et al., 2023). Furthermore, the single-cell precision of CaMPARI facilitates the exploration of interconnected microcircuits, allowing for the evaluation of disruptions in excitatory and inhibitory (E/I) signaling (Martin and Plavicki, 2020), a crucial factor in connectivity influencing conditions such as schizophrenia and epilepsy. This remarkable progress reflects the convergence of innovative technologies and methodologies, leading to a deeper understanding of neural structures and their structural and functional connections at the mesoscale level.
In this context, there are several gaps in understanding disorders affected by brain connectivity that could be addressed by leveraging mesoscale-related approaches. In schizophrenia, delayed PFC maturation, specifically GABAergic interneurons, contributes to cognitive and social deficits in adolescence (Lewis, 1997; Caballero and Tseng, 2016; Delevich et al., 2018). Investigating prefrontal circuitry formation and the impact of excitatory inputs from subcortical regions on interneurons vs. pyramidal neurons in the PFC is crucial. CaMPARI, for example, could offer valuable means to investigate these dynamics. Integrating 3D models with mesoscale imaging (e.g., confocal or live cell imaging and functional calcium imaging) can address these questions, revealing dynamic processes and synaptic development in the neuronal circuitry.
Likewise, in epilepsy research, we may inquire about the processes involved in the conversion of a focal seizure into a generalized event encompassing several cortical areas by addressing questions such as: What factors drive this electrical propagation? Is it the result of abnormal neurite branching patterns or an unusual number of dendritic spines? Moreover, it remains imperative to determine the specific neural cell type responsible for orchestrating the shift from a localized circuit, synchronizing neighboring cells, to the initiation of a generalized ictal event. Thus, studying brain network development and organization in the mesoscale will allow us to understand seizure formation and spread.
3 Image processing: quantifying connectivity
Image processing tools are essential for quantifying data and revealing the intricate relationships between brain networks and aberrant connectivity. Image processing techniques can extract qualitative and quantitative measurements from a variety of neuroimaging modalities, including MRI, two-photon, confocal, super-resolution, microscopy, and EM. Initial steps involve the identification of which information the research needs to extract from the data (e.g., tiny structures), followed by the selection of algorithms and their fine-tuning on a particular data (e.g., noise filtering, contrast enhancement). After establishing an adequate workflow, the outcome must be validated by expert neurobiologists. During this stage of image processing, human input on several levels inevitably leads to undesired bias or even difficulties in identifying subtle information such as fine morphological structures. Adding to this equation, the amount of raw data is sometimes not feasible to be fully accomplished manually, and this is especially true for mesoscale generated data. In this scenario, the development of automated or semi-automated computerized processing is paramount to achieving an efficient large-scale data processing. In general, a typical processing workflow consists of three fundamental steps: image preprocessing, image analysis, and quantification (Figure 2). However, it is important to note that specific modifications on the pipeline are required based on the type of image used and the particular neural structure under investigation. While a general image analysis pipeline can find utility in various scenarios, it is important to recognize that each biological question has a unique demand, and this requires the development of dedicated processing pipelines.
Figure 2. Overview of the bioimage analysis workflow. The pipeline generally comprises three fundamental steps: image preprocessing (I), image analysis (II), and quantification (III). In the preprocessing step, raw image quality is enhanced to facilitate subsequent analysis or visualization. Image analysis involves identifying and delineating specific regions or objects of interest, which is essential for extracting quantitative data from bioimages. The quantification step involves extracting meaningful quantitative measurements and deriving insights from the acquired images.
In the following section, we will explore the most suitable image acquisition and processing techniques for tackling key issues associated with conditions affected by abnormal brain connectivity. These issues encompass inter-regions brain connectivity, axonal and soma density, single neuron morphology, and dendritic spine quantification and morphology. Our approach will commence with the macroscopic analysis of brain regional images and end with the micro-scale assessment of dendritic spine quantification and morphology. We will not address image contrast enhancement and noise reduction preprocessing strategies as they have several computational implementations in each of the acquisition techniques and it could divert our focus from the main goal of this section: understanding the crucial role of segmentation and data analysis in comprehending connectivity. For an in-depth review of image denoising, the interested reader is referred to Kollem et al. (2019), Kaur et al. (2021), and Huang C. et al. (2022). There is a plethora of manual image analysis tools but in this review we will focus on automatic or semi-automatic quantification.
3.1 Quantifying inter-regional brain connectomics
Anatomically, the brain is compartmentalized into distinct regions, each with designated functions that collectively contribute to a range of high-order cognitive processes. Inter-regional brain connectomics consists of mapping and studying the complex networks between different regions (Behrens and Sporns, 2012). By analyzing these connections, using either macro, meso, or multiscale imaging strategies, it is possible to gain insights into how different regions cooperate or compete (Behrens and Sporns, 2012), and how disruptions in these networks may lead to neurological or psychiatric disorders. The macroscale approach focuses on imaging techniques that encompass the entire brain, ideally in vivo, with a selection of modalities such as MRI for structural covariance, fMRI, diffusion weighted image (DWI–including DTI and tractography), and PET. Structural connectivity, primarily addressed through DWI/DTI and tractography, when combined with fMRI, can also reveal structural connectivity (Axer and Amunts, 2022).
In the context of computational processing for macroscale images, artificial intelligence methods for image analysis are widely utilized in diagnosis contexts to understand neurological and psychological disorders (Zhang et al., 2020). For meso and micro scales, image analysis techniques currently available to extract neural connectivity lie within the segmentation and neuron individualization. Pixel/voxel classification, frequently called Region of Interest (ROI) delimitation, is the first step to a multitude of tasks. Once an ROI is defined, it becomes possible to trace morphological markers in longitudinal or comparative studies. Furthermore, it aids in the precise delineation of abnormal regions, guiding surgeons in tasks such as tumor extraction or identifying the epileptogenic zone by PET/fMRI images. In longitudinal developmental studies, segmenting regions like the prefrontal cortex over time provides valuable insights into the maturation of connectivity networks associated with cognitive development (Liu et al., 2023). ROI segmentation is also a crucial step for morphological quantification assessment as it enables researchers to access region volume or identify morphological differences in patients compared to control individuals in MRI.
Within psychiatric imaging, schizophrenia research has consistently revealed two prominent observations: increased cerebroventricular size and reductions in cerebral gray matter volume (Ananth et al., 2002; Shapleske et al., 2002). Automatic ROI segmentation and morphometric quantification of gray matter volume in MRI images decrease human biases and help to evaluate different groups in comparative or longitudinal studies (Fornito et al., 2017; Nemoto et al., 2020). While traditional image processing techniques such as thresholding-based segmentation, watershed labeling, neuroanatomical-atlas-based segmentation, or semi-manual masking [using tools like FreeSurfer (Fischl, 2012) or BET (Smith, 2002) are available, the medical context often requires greater accuracy even on images with unclear borders or blurred definition (Wang et al., 2023)]. In this context, several machine learning techniques have been successfully used in analysis of complex datasets, including k-means clustering, Support Vector Machines (SVM), Random Forest, Adaptive Boosting (AdaBoost), eXtreme Gradient Boosting (XGBoost) and Deep Learning strategies like Convolutional Neural Networks (CNN), Generative Adversarial Networks (GAN), Recurrent Neural Networks (RNN) (Wang et al., 2014; Zhang Z. et al., 2021; Verma et al., 2023).
In the field of epilepsy, image segmentation or ROI delimitation primarily aims to locate the epileptogenic zone and define pre-operative surgical areas. While this kind of analysis is commonly applied to MRI-T1 and fMRI images (Segato et al., 2020), its applicability extends to PET, DTI, and DWI scans (Sollee et al., 2022). For instance, in the study conducted by Lee et al. (2020), the authors used deep-learning CNN to pinpoint specific regions for surgical resection in DWI and tractography images of pediatric patients. Additionally, (Zhang Q. et al., 2021) constructed a pair-of-cube (PoC)-based Siamese CNN using two identical 18-layer ResNet to identify epileptic focus in F-fluorodeoxyglucose (F-FDG) PET images. After localization, the metabolic abnormality level of the predicted focus was automatically determined using the asymmetric index (AI). In another instance (Li K. et al., 2019; Vakharia et al., 2019) conducted detailed segmentation of critical areas, including the ventricular system, brainstem, amygdalohippocampal complex, parahippocampal gyrus, and sulci, from MRI-T1 9 images. Subsequently, they employed Random Forest algorithms to preplan laser trajectories of respective surgeries of epileptic zones with less adverse events associated with epilepsy surgery. For a comprehensive exploration of how deep learning techniques can be used in epilepsy, we recommend Sollee et al. (2022) review.
3.2 Multiscale imaging: bridging micro to macroscale
Macroscale inter-regional insights are directly associated with microscale synaptic organization and arborization (Wei et al., 2019). The overall cortico-cortical connectivity observed at the macroscale in BigBrain profiles is strongly correlated to microscale laminar cytoarchitectonic patterns (Wei et al., 2019). Essentially, cortical regions exhibiting higher similarity in microscale patterns are more likely to be interconnected (Wei et al., 2019).
Additionally, multiscale approaches, which integrate data from various imaging modalities, hold the potential to interlink micro and macro scales. For example, the BigMac dataset, developed by Howard et al. (2023), combines in vivo MRI images with post-mortem microscopy data and ultra-high angular resolution diffusion imaging and enables the mapping of microscale cellular structures to macroscale features. This comprehensive approach allows researchers to study brain connections at both macro and micro levels, bridging the gap between them.
However, Haueis (2021) cautioned against oversimplifying the micro-to-macro correlation by merely averaging microscale details. Failing to account for the intermediate mesoscale structure and organization in this practice may lead to analytical errors. Haueis further emphasized the critical role of mesoscale circuit organization in accurately depicting the structure-function relationship, particularly in the context of cortical gradient modeling. This is a compelling piece of evidence that bridging micro-to-macro scale connectivity should pass through mesoscale circuit understanding.
3.3 Mesoscale imaging
The trade-off between image resolution and sample size in 3D is a well-known limitation. The higher spatial resolution comes at the cost of a smaller field of view (FOV). Nonetheless, mesoscale brain imaging strategies combine cellular-level resolution and an extended spatial range. The primary approach employed in mesoscale imaging involves the use of wide-field or laser-scanning confocal microscopies, heavily impacted by the thickness of the sample. Recent methodologies such as light-sheet and two-photon partially overcome this limitation by going deeper inside intact tissues, while preserving high spatial resolution (Cazemier et al., 2016; Tyson and Margrie, 2022). For example, Li et al. (2010) used an automatic micro-optical sectioning tomography (MOST) to obtain a mesoscale atlas of the mouse brain. This strategy integrates a microtome, light microscope, and image recorder, and allows for simultaneous imaging and sectioning (Li et al., 2010). Another possible approach was the use of post-mortem axonal projections enhanced by green fluorescent protein (EGFP)-labeling (Oh et al., 2014). They imaged many small patches of brain tissue with two-photon microscopy to form a big image with cellular-level resolution (Oh et al., 2014). Imaging at this scale in larger FOV took 18.5 h of scanning and resulted in a 750 GB raw dataset. Likewise, (Wang et al., 2019) developed the VISoR system, a sophisticated adaptation of light sheet microscopy, to obtain 3D mouse brain images with neurite resolution within 1.5 h.
Another time-optimizing approach for mesoscale involves the use of synchrotron X-ray imaging. Especially in 3D computed tomography is becoming popular since the higher energies of x-rays allow deeper penetration and very high resolution. Although it can take a few hours to measure a sample in benchtop equipment, synchrotron sources emerge as a solution for fast measurements and even higher spatial and temporal resolutions, which also allow a combination of several tomograms to reconstitute large FOV (Fonseca et al., 2018; Rodrigues et al., 2021; Claro et al., 2023). Image processing pipelines are usually developed for a specific imaging acquisition technique. A comprehensive summary of primary mesoscale image processing methods for the main image acquisition modalities can be found in Figure 3.
Figure 3. Overview of mesoscale bioimage processing methods. Image acquisition techniques are represented by big circles: Light Microscopy (orange), Serial Section Electron Microscopy (blue), and Synchrotron X-ray (pink). Image processing steps are depicted by ellipses, and algorithms of analysis are represented by boxes. Labels I, II, and III denote the fundamental steps of mesoscale image analysis: preprocessing, segmentation, and data analysis, respectively. Algorithms tools are referenced in Table 2 (✩) and Table 3 (Δ). FOV, field of view; FFN, flood-filling network; CNN, convolutional neural network; EM, electron microscopy; PCA, principal component analysis.
3.3.1 Processing at the mesoscale level: insights into neurite and soma regional density
Extensively imaging and tracing axons throughout the brain provides a mesoscale view of regional connectivity, offering insights into soma and neurite density as well as assessing total cell reductions and identifying cell death in specific brain regions (Bazinet et al., 2023). Although mesoscale imaging strategies can unveil a series of histological structures, they present their computational challenges.
The first challenge encountered in the mesoscale is usually the stitching of large quantities of high-resolution microscopy images. Image stitching refers to the process of aligning and overlaying two or more images of the same object taken from different, consecutive, and overlapping FOV. Through image registration processing (Sarvaiya et al., 2009), corresponding features or structures in these images are spatially aligned, making it possible to combine them into a single and panoramic image. In the case of brain microscopy, this involves merging multiple images, sometimes acquired at varying scales, into a comprehensive, high-resolution representation of the brain. Registering can mean either tile stitching multiple consecutive FOVs, without overlapping or positioning microscopic images into a larger dataset using fiducial markers, or a common reference frame to localize them into the brain. In both cases, it is expected that mesoscale imaging strategies generate the largest amount of raw data. BigStitcher is a method of stitching consecutive FOVs into a single high-resolution image (Hörl et al., 2019). To manage such large amounts of data, the BigSticher software computes shifts between overlapping image tiles by using a phase correlation method in downsampled images, which optimizes the computational time necessary for image stitching (Hörl et al., 2019). Moreover, DeepSlice is a CNN specifically trained on a substantial histological dataset to automatically align coronal mouse brain two-photon microscopy images with the Allen Common Coordinate Framework (CCF) (Carey et al., 2023).
The following step is to detect neuronal cell bodies in the entire image and quantify soma density across brain regions. The size of mesoscale data makes manual handling impractical and prone to biases; hence, automatic or semi-automatic tools are more suitable for its processing (Bjerke et al., 2023). Soma detection can be made either by traditional image enhancement filters followed by intensity thresholds, such as in ClearMap (Renier et al., 2016) and MIRACL (Goubran et al., 2019), or by advanced machine learning techniques for pixel classification as deep learning approaches (Tyson and Margrie, 2022). Intensity thresholding approaches also work well with DAPI-stained nuclei images (Kim et al., 2015), and modifications of thresholding can be done to address large-scale GFP images even with a large variability in contrast (Frasconi et al., 2014). These modifications consist of first using mean shift clustering to detect soma centers followed by image deconvolution and finally manifold learning for filtering false positives (Frasconi et al., 2014). However, intensity thresholding and morphological approaches fail especially with densely packed images and that is precisely where deep learning can be used. For example, (Hu et al., 2021) combined 3D U-shaped full CNN with multi-task learning to perform soma segmentation in Nissl stained images. This strategy is done in small patches and would take a long time to train in teravoxel mesoscale images. As a faster approach, (Wei et al., 2023) used a lightweight MCC-Net to reduce computational complexity in soma detection. Then, in the second stage, they employed SFS-Net for precise soma localization in mouse brain images, utilizing advanced segmentation techniques. Experimental results confirmed the excellent performance of the method and its capacity to provide valuable information for neuron reconstruction (Wei et al., 2023). The user-friendly software CellPose (Stringer et al., 2021) also has a DeepLearning module that has been used to count pyramidal neurons in histopathological images (Oltmer et al., 2023). An alternative option is to employ Suite2p software (Pachitariu et al., 2017), which offers AutoROI cell segmentation designed for simultaneous analysis of functional and morphological two-photon calcium images. The compilation of the main soma quantification methods for mesoscale connectivity is presented in Table 2.
The next step to a mesoscale connectivity view is to detect, trace, and quantify neurites across the brain. In the study conducted by Allen Mouse Brain Connectivity Atlas (Oh et al., 2014), axonal detection at the mesoscale level starts with a very similar process to single neuron morphology mesh tracing. Signal detection algorithms, such as filament tracing, can be used as an initial segmentation. The authors then rescale image intensity and remove noise using filters and morphological techniques. Candidate signal objects were identified based on adaptive edge/line detection and morphological attributes such as length and area. Additionally, high-intensity pixels near these objects were considered. In a post-segmentation step, objects considered artifacts were removed. It is important to note that passing fibers and terminals were not differentiated. The outcome is a high-resolution mask classifying each 0.35 μm × 0.35 μm pixel as a signal or background (Oh et al., 2014).
Also in the mesoscale, TRAILMAP uses a modification of a 3D UNet to extract axonal projections from uncleared brain tissue in light-sheet microscopy (Friedmann et al., 2020). This method focuses on segmenting axons from the background in a generalized way that can be applied to all brain regions. Unlike filament tracing methods, it does not address neurite branching numbers or spatial positions. The purpose is mainly to address axonal fiber density and compare it across brain regions (Tyson and Margrie, 2022).
Another possibility is to use the MIRACL pipeline and toolbox. MIRACL is based on a multimodal approach that integrates CLARITY data at the microscopic level with macroscopic in vivo and ex vivo imaging data, including structural, diffusion, and quantitative MRI, all aligned to the Allen atlas reference frame “ARA.” This integration facilitates various analyses, including the examination of histological features across network graphs and fiber tracts, as well as connectivity analyses based on projection terminals. Additionally, MIRACL supports group-level statistics, multimodal correlations, and comparisons of connectivity maps across different scales (Goubran et al., 2019).
3.3.2 Single neuron morphology
The morphology of a neuron can have a big impact on its connectivity with other local neuronal circuits. Neurons with a complex dendritic branching pattern tend to have a larger surface area and a denser synaptic field, allowing them to have more candidate synapses (van Pelt and van Ooyen, 2013). According to Peter’s rule, the colocalization of dendritic and axonal arbors are reasonable predictors of connectivity among neuron types (Rees et al., 2017). Nevertheless, a greater number of potential synapses does not always mean a greater number of functional synapses (Rees et al., 2017). Axo-dendritic overlapping is a necessary but not sufficient condition to ensure a synaptic connection. Light microscopy is the ideal imaging technique to study both neuronal morphology (using cytoplasmic markers) and synaptic connectivity (using puncta colocalization) (Wang et al., 2020). In contrast, neuron morphology has recently been described to predict non-random connectivity in local networks and circuits (Udvary et al., 2022). The authors state that the specificity in neural wiring is influenced by morphological factors such as similarities in neurite projections, packing density, and the diversity of cell types in the neuropil (Udvary et al., 2022). High values in these factors lead to recurring patterns in the network, while lower values result in a more feedforward network structure (Udvary et al., 2022).
To address single neuron morphology using imaging techniques we must first extract from the image which pixels belong to each neuron. This process is called instance segmentation or neuron instance individualization (You et al., 2019). The main techniques used to measure multiple neurons are light microscopy (including confocal, two-photon, STED, and light-sheet) and serial-section EM.
3.3.2.1 Single neuron morphology using light microscopy
Traditionally in light microscopy (confocal, light sheet, and STED), neuron instance individualization starts with filament tracing methods (Xiao and Peng, 2013; Feng et al., 2015; Liu et al., 2016; Quan et al., 2016; Shih et al., 2021). These methods work as an initial segmentation and are responsible for differentiating the neural mass foreground from the noisy scattered background (Magliaro et al., 2019). They transform an image into a graph of connected points. Filament tracing pipelines consist mainly of four steps: (i) an image pre-processing step to improve signal-to-noise ratio enhancing filaments and smoothing background; (ii) a seed point detection step followed by (iii) “energy minimization algorithms” such as Fast Marching Method (FMM) (Sethian, 1996) and Dijkstra algorithm (Dijkstra, 1959); and (iv) a pruning step to reduce redundant traces and improve overall segmentation (Liu Y. et al., 2022).
In the pre-processing step, the main goal is to significantly enhance the signal-to-noise ratio. In confocal imaging techniques, the pre-processing involves PSF (point spread function) deconvolution, feature-enhancing filters (Frangi et al., 1998), or deep learning techniques that enhance neurons based on a predicted morphology (Yang et al., 2021a). Then, seed point detection usually includes the detection of somata searching for the brightest point on the image (Xiao and Peng, 2013). After that, energy minimization algorithms find the shortest path between a starting point and all other points in a graph, using a cost function usually based on image intensity or transformed distance of a filament. The final step is filament pruning and morphological corrections (Liu Y. et al., 2022). These traditional tracing methods are very robust and widely used in neuron imaging. Nonetheless, most algorithms are not optimized for large volumetric images (giga or tera voxels) and images with densely packed cells. If the traced image contains multiple neurons this will result in a mesh containing all cells and will require further neuron individualization.
Nonetheless, filament tracing has improved a lot since the 2008’s DIADEM golden age. The Big Neuron Project and Mouse Light Project have reconstructed over 1000 neurons and are constructing a database. Neuron Crawler (Zhou et al., 2015) has begun solving the big data problem and, Deep Learning methods have been helping to improve the tracing framework (Dai et al., 2019; Tan et al., 2020; Huang et al., 2021; Yang et al., 2021b; Liu C. et al., 2022; Wang et al., 2022). Table 3 summarizes the main filament tracing methods used in the mesoscale connectivity.
Once the neuronal mesh is accurately traced by filament tracing strategies, the next step is to individualize each neuron. Algorithms such as G-Cut (Li R. et al., 2019) and NeuroGPS-Tree (Quan et al., 2016) use the soma identity and position, and from previously learned morphological parameters trace the most probable neuron given the soma and the traced neuronal mesh.
3.3.2.2 Single neuron morphology using electron microscopy
Electron Microscopy can also uncover single neuron morphology and local connectomics with nanometric synapse level resolution. Using EM to reconstruct neuron wiring and connectivity involves multiple steps: high-throughput data acquisition, image registration, image segmentation, proofreading, and tracking (Beyer et al., 2022). Unlike confocal or light sheet microscopy, 3D EM neuron reconstruction requires physical sectioning of the sample. The samples are cut into about 30 nm thick samples and individually imaged. A 1 mm3 brain sample requires about 5000 slices, 2.1 petabytes of raw microscopy data, and 326 days to finish data acquisition (Shapson-Coe et al., 2021). Similarly, (Winding et al., 2023) imaged 3016 neurons and 548,000 synapses in a Drosophila larval brain. The resulting image contained 4841 z-slices and processing it took manual annotation of multiple users and a specialized annotation tool for big images (CATMAID) (Winding et al., 2023).
After each image has been acquired the next step is to stitch adjacent 2D images and correctly stack (register) them to form a 3D volume. During 3D thin-sliced EM image acquisition, the most fundamental step for proper 3D reconstruction is image registration. Aligning microscopy slices can be challenging since they are not perfectly aligned and often have different quality and acquisition parameters (Beyer et al., 2022). The main 2D stitching includes plugins such as TeraSticher (Bria and Iannello, 2012) and 3D registration can be done with the ImageJ plugin TrackEM2 (Cardona et al., 2012). Once the image volume is completed, the next step is to individualize and segment each neuron. Due to the highly textured nature of EM images, segmentation is typically accomplished using deep learning techniques (Shapson-Coe et al., 2021), using a flood-filling network (FFN). Most of the EM segmentation algorithms rely on detecting cell membranes to separate neurons, and even small errors in this detection could split or merge neurons, significantly impacting the reconstructed neural circuit (Krasowski et al., 2018). In this context, combining neuro-morphological priors with local membrane information can be a viable resource to reduce errors in the neuronal individualization process (Krasowski et al., 2018; Hong et al., 2023).
3.3.3 Morphology quantification of individual neurons
The first and most important parameter to quantify single neuron morphology is the radial profile of neuron dendrite spanning tree, also known as the Sholl Intersection Profile (SIP) (Bird and Cuntz, 2019). The complete Sholl analysis includes measuring the total length of the dendrite, the axon domain maximum and minimum from the soma, and the angular distribution of dendritic segments that deviate from a direct path to the soma. According to the authors (Bird and Cuntz, 2019), a larger dendrite extension length implies a larger region where synapses can occur, peaks in the SIPs are related to regions where synapses have a higher probability to occur and valleys in the SIPs are regions to where synapses have a lower probability to occur. The angular distribution is related to a neuron’s centripetal bias and implies a neuron that minimizes wiring to ensure an efficient propagation of electrical impulses.
Alternative ways to measure neuronal shape include parameters such as the total length of neurites, the minimal occupied volume, the distribution of branch lengths as represented in histograms, and the frequency of distances between successive bifurcations along the neural trajectory. These measurements are obtained through the open-source software L-measure, as outlined in the work of Scorcioni et al. (2008).
A further challenge is to classify neuron types using only their morphological assets without any molecular markers (Polavaram et al., 2014) used L-measure to extract morphological features of neurons in the NeuroMorpho database. They subsequently applied principal component analysis (PCA) as a statistical tool to identify key morphological parameters capable of effectively classifying dendritic structures across diverse metadata categories. Their findings highlight the importance of specific measures like branching density, size, tortuosity, bifurcation angles, arbor flatness, and topological asymmetry in capturing meaningful features of dendritic trees. Similarly, Khalil et al. (2021) extracted L-measure metrics and modified Sholl descriptors from the NeuroMorpho database and used PCA and KNN clustering to classify neuronal types.
Deep learning revolutionized feature extraction and image classification and has been used to classify neurons. For example, GraphDINO used a Transformer-based Graph Neural Network to create 3D spatial embedding representations of neuronal graphs and later classified them into neuronal types (Weis et al., 2021). The authors adapted positional encoding and introduced a novel attention mechanism called AC-Attention to fit neuronal graphs and achieved results comparable to expert-manual classification without prior knowledge about neuronal structural features and outperforms previous methods in predicting expert labels on quantitative benchmarks (Weis et al., 2021). Similarly, MorphoGNN is a novel approach for embedding single neuron morphologies using graph neural networks (GNN) and learns spatial relationships between nodes in reconstructed neuron fibers by considering their nearest neighbors on each layer. This process generates a reduced-dimensional representation of individual neurons using an end-to-end model that incorporates densely connected Densely Connected Convolutional layers and a dual pooling operator (Zhu et al., 2023).
3.4 Dendritic spine quantification and morphology
Dendritic spines are small protrusions from dendrites that constitute the center of excitatory synaptic interaction among central neurons (Papa et al., 1995). They are crucial structures for interneuronal communication and play a crucial role in learning and memory. Neuronal spines can range in size from tiny, barely visible protrusions to larger and more complex structures. This variety suggests that neuronal spines have a wide range of functions and are essential for neural plasticity and cognitive and sensory functions (Rochefort and Konnerth, 2012; Ekaterina et al., 2023).
The analytical approach is often used to study dendritic spines, including their density and respective morphological features (Chang et al., 2017). Light microscopy and EM can image dendritic spines and monitor their dynamic alterations in response to neural network activity (Arellano et al., 2007). In this section, we have chosen to emphasize image processing tools obtained by light microscopy.
Traditionally, dendritic spine images are obtained through Golgi staining and wide-field microscopy. 3D studies of such structures can benefit from confocal reflection imaging, although manual dendrite tracing is still in place. Popular software like Imaris (Govindan et al., 2021), or NeuroLucida (Dickstein et al., 2016), followed by the utilization of semi-automatic measurement tools such as software like SPINEJ (Levet et al., 2020) and NeuronStudio (Rodriguez et al., 2008) have a broad use. To employ deep learning for automated methods, it requires extensive datasets comprising meticulously segmented, high-quality images, known as “ground truth images” (Vidaurre-Gallart et al., 2022). However, it’s important to note that even with such datasets, there may still be limitations to achieving precise reconstructions (Vidaurre-Gallart et al., 2022).
The image processing routine for analyzing dendritic spines involves a five-step pipeline: (i) data pre-processing as described before, (ii) spine location detection, (iii) segmentation to isolate them, (iv) quantification of morphological characteristics, and (v) classification or clustering based on their morphology (Li et al., 2023).
The primary objective in the spine detection phase is the precise identification of individual entities’ locations within the 3D image (Rodriguez et al., 2008). This process begins delineating dendrite boundaries, utilizing information extracted from the dendrite 3D mesh (Mukai et al., 2011; Okabe, 2020). There are four main spine detection automatic approaches. The most prevalent method is skeletonization, which involves the removal of consecutive layers of pixels from the dendritic boundary (Okabe, 2020). To detect spines using skeletons, it is necessary to binarize the original images correctly and extract all spines that are still connected to dendritic shafts. If any spines become disconnected during the binarization process, they need to be reattached through further processing (Rusakov and Stewart, 1995). The Rayburst sampling (Rodriguez et al., 2006, 2008), gradient-based methods (Zhang et al., 2010), and analysis of 3D surfaces (Li and Deng, 2012) represent alternative automated approaches for spine detection.
For spike detection, it is necessary to establish the boundary that separates the spines from the dendritic shafts, using iterative methods (Okabe, 2020). One way to perform automatic spine segmentation using light microscopy involves a calculation of the distance to the surface of the neuritic shaft for each voxel outside the shaft (Rodriguez et al., 2008; Singh et al., 2017).
After segmentation, a variety of spine morphological measurements and posterior spine classification can be automatized. Parameters of the 3D structure of spines encompassing spine length, head diameter, neck length, volume, curvature, basal radius, maximum and minimum radius, and head-to-neck ratio (Rodriguez et al., 2006; Janoos et al., 2009). After 3D neuronal morphometry, various principles for spine classification have been proposed and the commonly employed method involves categorizing spines into four main groups stubby, thin, filopodia, and mushroom-shaped (Hering and Sheng, 2001). While traditional phenotypic classification often relies on manual inspection, machine learning approaches, aided by labeled training datasets, have demonstrated comparable accuracy to human operators (Basu et al., 2018), most of them using semi-supervised learning (Shi et al., 2009, 2014). Computational analysis of 3D spine morphology has the potential to unveil novel spine characteristics by fusing clustering methods to automatically group spines with similar structures. Luengo-Sanchez et al. (2018) proposed a probabilistic approach that categorized the spine in clusters based on a selected set of morphology features, with a Gaussian finite mixture model.
The rise of the high-resolution light microscopy image era has led to an expansion of techniques for automated spine detection, segmentation, and measurement. For a comprehensive overview, we recommend a thorough review presented by Okabe (2020).
4 Challenges and perspectives
In the examination of mesoscale connectivity within the context of connectivity-related brain disorders, we highlighted the following challenges: (i) refinement of human models; (ii) enhancement of imaging acquisition; and (iii) optimization of computational processing.
Human neural organoids are revolutionizing the study of neural development and diseases in a controlled in vitro setting, overcoming the limitations of traditional animal models. These organoids recapitulate the complexities of neural development, offering insights into health and diseases (Avansini et al., 2022). The in vitro system allows for drug testing, intervention studies, and close observation of potential side effects. Organoid models support experiments and correlative microscopy in multimodal platforms, enabling comprehensive characterizations of entire samples in vivo. This approach represents a significant stride in neurobiology and drug development. Neural tracing using viral vectors and X-ray markers offers precise tools to investigate neural connections and circuitry, enhancing imaging capabilities for detailed visualization and mapping of neural structures. This combination facilitates a deeper understanding of neural development.
From the perspective of image acquisition, EM provides unparalleled spatial resolution at the sub-micron to nanoscale, but it comes with challenges, including difficulties in measuring samples several micrometers thick due to the destructive nature of sample preparation for transmission images and limitations on molecular markers. Photon-based microscopies offer an alternative, capable of imaging multiple cell layers with single-cell identification resolution. Visible light microscopies simultaneously label numerous molecular markers, but a new physical phenomenon limits resolution due to the larger wavelength of light. Super-resolution microscopies (e.g., STED, SIM, PALM/STORM) overcome this limitation and are now widely available in bioimaging facilities, paving the way for enhanced imaging beyond traditional light microscopy constraints.
Expansion microscopy techniques have recently proven effective in reconstructing neuronal connections by employing a water-swellable polymer to expand tissue samples, overcoming optical microscopy limitations (Chen et al., 2015; Gallagher and Zhao, 2021; Lillvis et al., 2022; Kraft et al., 2023). This approach preserves sample integrity while providing detailed insights into cellular and sub-cellular details, including cell projections and connections.
A complementary approach involves increasing photon energy (i.e., shortening the wavelength), with X-rays being a prominent choice due to their deep penetration and high resolution. Although not practical for most benchtop equipment, synchrotron radiation techniques have demonstrated feasibility in neuronal connectomics, offering effective contrast for both unstained (phase propagation) and contrast-enhanced (absorption) samples (Kuan et al., 2020; Rodrigues et al., 2021; Claro et al., 2023). Scanning X-ray fluorescence can map cellular and subcellular chemical elements, potentially providing a biochemical signature for specific disorders (Finnegan et al., 2019; Álvarez-Marimon et al., 2021). Correlative Light and Electron Microscopy (CLEM) is a promising technique that seamlessly combines the advantages of light microscopy, such as molecular markers, with the high spatial resolution of EM. Particularly valuable for studying neural circuits, CLEM generates synaptic-level resolution images across a large field of view, revealing extensive neural circuitry. Its ability to incorporate fluorescent markers streamlines post-processing segmentation, resulting in a more precise reconstruction of neural networks (Iwasaki et al., 2022). It is important to highlight additional aspects of multimodal imaging. APEX2 and MiniSOG serve as genetic tags that are applicable not only in EM as molecular markers but are also suitable for X-ray tomography absorption contrast, as noted by Kuan et al. (2020). These tags, when fused with specific proteins, enable researchers to selectively label and study the dynamics of organelles, membrane structures, and the localization of proteins within cells in 3D space.
Computational processing in a High-Performance Computing (HPC) environment imposes several challenges, including storage of large datasets and models, memory capacity, and parallelization of algorithms (Zhang et al., 2023). Although deep learning techniques have been demonstrated as a cornerstone approach for image analysis, the use of such algorithms on large-scale datasets in HPC environments still requires advanced expertise in the design of parallel algorithms and programming in specialized language programming (e.g., C/C++, CUDA). To overcome this limitation, a new research area, called High-Performance Machine Learning, has recently emerged to provide methodologies and tools that explore data and model parallelism in a heterogeneous computing environment, i.e., composed of hundreds of CPU cores and GPUs, transparently to the users (Website, no date). Thus, the researchers can focus efforts on solving the problem by designing proper algorithms, without caring about model size and how to feed the neural networks with large datasets.
Another crucial limitation of deep learning techniques is their dependency on labeling data. Machine learning has streamlined the manual processing of imaging data, yet the scarcity of validated annotated datasets are bottlenecks. Collaboration within neuroscience is vital for creating integrated, standardized and multiscale validated datasets, akin to efforts by the Allen Institute. The demand for multidisciplinary experts in neurosciences and computational vision is rising to evaluate machine learning model predictions. Synthetic data generated by artificial intelligence serves as a data augmentation resource, mitigating the scarcity of labeled data in deep learning training. Vision transformers and morphological features for neuron classification are reshaping image analysis, enhancing algorithm performance, particularly with large datasets, and providing efficient methods to quantify mesoscale connectivity.
5 Conclusion
To attain a comprehensive understanding of brain function it is essential to seamlessly integrate cellular functions into the broader framework of brain organization. This integration involves incorporating fine details, ranging from the intricacies of dendritic spines to the branching patterns and interactions of individual neurons, into tridimensional models of neuronal network formation and adaptation to stimuli. A critical aspect of this integration is the preservation of the hierarchical organization of brain tissue, ensuring that cellular and sub-cellular data become an intrinsic part of the entire network. The mesoscale (cell-cell interactions) information links the micro/nanoscale (cellular and subcellular data) to the macro scale (whole brain functioning network). As such, integrative data can retrieve meaningful connections between cells, providing deeper insights into the complex neural network and reveal mechanisms underlying neurological and psychiatric disorders. Our review article aimed to highlight the state-of-the-art of the innovative field of neuroimaging in the context of the mesoscale, giving particular attention to its importance for a better comprehension of schizophrenia and epilepsy. This work presented the main techniques for image acquisition, data processing, and analysis optimized for mesoscale, emphasizing their distinctive aspects in analyzing specific structures, as well as acknowledging their limitations, especially concerning sample integrity. In this regard, we pinpoint multimodal imaging techniques like CLEM are emerging as the next frontier to capture large volumes in fine detail. Additionally, the latest (4th) generation of synchrotron accelerators offers approximately 1000x faster measurement capacities, enabling objective data generation through scanning, volume registration studies, and increased sample sizes (Winding et al., 2023).
Like every frontier of knowledge, neuroimaging is continuously expanding and experiencing rapid innovations. Its interdisciplinarity should not, therefore, be the primary limitation to its advancement. It is crucial that neuroscientists and computer scientists can comprehend the uses and potentials within the field of neuroimaging through a shared language.
Author contributions
AC: Conceptualization, Writing – original draft, Writing – review and editing. AA: Conceptualization, Writing – original draft, Writing – review and editing. MA: Conceptualization, Writing – original draft, Writing – review and editing. BS: Conceptualization, Writing – original draft, Writing – review and editing. JR: Writing – original draft, Writing – review and editing. CC: Writing – review and editing. MF: Writing – review and editing. AP: Supervision, Writing – review and editing. LP-S: Writing – review and editing. SA: Conceptualization, Supervision, Writing – original draft, Writing – review and editing. MC: Conceptualization, Supervision, Writing – review and editing.
Funding
The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This work was supported by a grant to SA by International Brain Research Organization (IBRO) and to MC and MF by São Paulo Research Foundation - FAPESP (grant No. 2018/16453-8). Thanks to scholarship to MF by Brazilian National Council for Scientific and Technological Development-CNPq (grant No. 141253/2019-3) and Coordenação de Aperfeiçoamento de Pessoal de Nível Superior – Brasil-CAPES (PROEX, 33003017040P8). CNPEM (FNDCT-MCTI) is acknowledged for supporting and open-access of the core facilities.
Acknowledgments
Artificial intelligence: Chatgpt (GPT-3.5 version) and Bard (2023.10.30 release) were employed in this article to refine the academic language of this review article.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
Abdijadid, S., Mathern, G., Levine, M., and Cepeda, C. (2015). Basic mechanisms of epileptogenesis in pediatric cortical dysplasia. CNS Neurosci. Ther. 21, 92–103.
Aghakhani, Y., Kinay, D., Gotman, J., Soualmi, L., Andermann, F., Olivier, A., et al. (2005). The role of periventricular nodular heterotopia in epileptogenesis. Brain 128(Pt 3), 641–651.
Alexander, A., Lee, J., Lazar, M., and Field, A. (2007). Diffusion tensor imaging of the brain. Neurotherapeutics 4, 316–329.
Álvarez-Marimon, E., Castillo-Michel, H., Reyes-Herrera, J., Seira, J., Aso, E., Carmona, M., et al. (2021). Synchrotron X-ray fluorescence and FTIR signatures for amyloid fibrillary and nonfibrillary plaques. ACS Chem. Neurosci. 12, 1961–1971. doi: 10.1021/acschemneuro.1c00048
Ananth, H., Popescu, I., Critchley, H., Good, C., Frackowiak, R., and Dolan, R. (2002). Cortical and subcortical gray matter abnormalities in schizophrenia determined through structural magnetic resonance imaging with optimized volumetric voxel-based morphometry. Am. J. Psychiatry 159, 1497–1505. doi: 10.1176/appi.ajp.159.9.1497
Anticevic, A., Cole, M., Repovs, G., Murray, J., Brumbaugh, M., Winkler, A., et al. (2014). Characterizing thalamo-cortical disturbances in schizophrenia and bipolar illness. Cereb. Cortex 24, 3116–3130. doi: 10.1093/cercor/bht165
Anticevic, A., Haut, K., Murray, J., Repovs, G., Yang, G., Diehl, C., et al. (2015). Association of thalamic dysconnectivity and conversion to psychosis in youth and young adults at elevated clinical risk. JAMA Psychiatry 72, 882–891. doi: 10.1001/jamapsychiatry.2015.0566
Arellano, J., Benavides-Piccione, R., Defelipe, J., and Yuste, R. (2007). Ultrastructure of dendritic spines: correlation between synaptic and spine morphologies. Front. Neurosci. 1:131–143. doi: 10.3389/neuro.01.1.1.010.2007
Avansini, S., Puppo, F., Adams, J., Vieira, A., Coan, A., Rogerio, F., et al. (2022). Junctional instability in neuroepithelium and network hyperexcitability in a focal cortical dysplasia human model. Brain 145, 1962–1977. doi: 10.1093/brain/awab479
Axer, M., and Amunts, K. (2022). Scale matters: the nested human connectome. Science 378, 500–504. doi: 10.1126/science.abq2599
Babb, T. (1991). Bilateral pathological damage in temporal lobe epilepsy. Can. J. Neurol. Sci. 18, 4(Suppl.), 645–648.
Baliyan, V., Das, C. J., Sharma, R., and Gupta, A. K. (2016). Diffusion weighted imaging: technique and applications. World J. Radiol. 8, 785–798.
Bartolomei, F., Khalil, M., Wendling, F., Sontheimer, A., Régis, J., Ranjeva, J., et al. (2005). Entorhinal cortex involvement in human mesial temporal lobe epilepsy: an electrophysiologic and volumetric study. Epilepsia 46, 677–687.
Basu, S., Saha, P., Roszkowska, M., Magnowska, M., Baczynska, E., Das, N., et al. (2018). Quantitative 3-D morphometric analysis of individual dendritic spines. Sci Rep. 8:3545.
Bazinet, V., Hansen, J., Vos, de Wael, R., Bernhardt, B., van den Heuvel, M., et al. (2023). Assortative mixing in micro-architecturally annotated brain connectomes. Nat. Commun. 14:2850. doi: 10.1038/s41467-023-38585-4
Beck, K., Arumuham, A., Veronese, M., Santangelo, B., McGinnity, C., Dunn, J., et al. (2021). N-methyl-D-aspartate receptor availability in first-episode psychosis: a PET-MR brain imaging study. Transl. Psychiatry 11:425.
Belgiu, M., and Drăguţ, L. (2016). Random forest in remote sensing: a review of applications and future directions. ISPRS J. Photogrammetry Remote Sens. 114, 24–31.
Bennett, S. H., Kirby, A. J., and Finnerty, G. T. (2018). Rewiring the connectome: evidence and effects. Neurosci. Biobehav. Rev. 88, 51–62. doi: 10.1016/j.neubiorev.2018.03.001
Bernasconi, N., Duchesne, S., Janke, A., Lerch, J., Collins, D., and Bernasconi, A. (2004). Whole-brain voxel-based statistical analysis of gray matter and white matter in temporal lobe epilepsy. Neuroimage 23, 717–723. doi: 10.1016/j.neuroimage.2004.06.015
Berndt, M., Trusel, M., Roberts, T., Pfeiffer, B., and Volk, L. (2023). Bidirectional synaptic changes in deep and superficial hippocampal neurons following in vivo activity. Neuron 111, 2984–2994.e4. doi: 10.1016/j.neuron.2023.08.014
Bernhardt, B., Bernasconi, N., Kim, H., and Bernasconi, A. (2012). Mapping thalamocortical network pathology in temporal lobe epilepsy. Neurology 78, 129–136.
Bernhardt, B., Hong, S., Bernasconi, A., and Bernasconi, N. (2013). Imaging structural and functional brain networks in temporal lobe epilepsy. Front. Hum. Neurosci. 7:624. doi: 10.3389/fnhum.2013.00624
Betz, O., Wegst, U., Weide, D., Heethoff, M., Helfen, L., Lee, W., et al. (2007). Imaging applications of synchrotron X-ray phase-contrast microtomography in biological morphology and biomaterials science. I. general aspects of the technique and its advantages in the analysis of millimetre-sized arthropod structure. J. Microsc. 227, 51–71. doi: 10.1111/j.1365-2818.2007.01785.x
Beyer, J., Trodil, J., Boorboor, S., Hadwiger, M., Kaufman, A., and Pfister, H. (2022). A survey of visualization and analysis in high-resolution connectomics. Comput. Graphics Forum 41, 573–607. doi: 10.3389/fncir.2018.00090
Bird, A., and Cuntz, H. (2019). Dissecting sholl analysis into its functional components. Cell Rep. 27, 3081–3096.e5. doi: 10.1016/j.celrep.2019.04.097
Biswal, B., Yetkin, F., Haughton, V., and Hyde, J. (1995). Functional connectivity in the motor cortex of resting human brain using echo-planar MRI. Magn. Reson. Med. 34, 537–541.
Bjerke, I., Yates, S., Carey, H., Bjaalie, J., and Leergaard, T. (2023). Scaling up cell-counting efforts in neuroscience through semi-automated methods. iScience 26:107562. doi: 10.1016/j.isci.2023.107562
Blümcke, I., Zuschratter, W., Schewe, J., Suter, B., Lie, A., Riederer, B., et al. (1999). Cellular pathology of hilar neurons in Ammon’s horn sclerosis. J. Comp. Neurol. 414, 437–453.
Bohland, J., Wu, C., Barbas, H., Bokil, H., Bota, M., Breiter, H., et al. (2009). A proposal for a coordinated effort for the determination of brainwide neuroanatomical connectivity in model organisms at a mesoscopic scale. PLoS Comput. Biol. 5:e1000334. doi: 10.1371/journal.pcbi.1000334
Bonilha, L., Helpern, J., Sainju, R., Nesland, T., Edwards, J., Glazier, S., et al. (2013). Presurgical connectome and postsurgical seizure control in temporal lobe epilepsy. Neurology 81, 1704–1710.
Bosch, C., Ackels, T., Pacureanu, A., Zhang, Y., Peddie, C., Berning, M., et al. (2022). Functional and multiscale 3D structural investigation of brain tissue through correlative in vivo physiology, synchrotron microtomography and volume electron microscopy. Nat. Commun. 13:2923. doi: 10.1038/s41467-022-30199-6
Bria, A., and Iannello, G. (2012). TeraStitcher - a tool for fast automatic 3D-stitching of teravoxel-sized microscopy images. BMC Bioinformatics 13:316. doi: 10.1186/1471-2105-13-316
Caballero, A., and Tseng, K. (2016). GABAergic function as a limiting factor for prefrontal maturation during adolescence. Trends Neurosci. 39, 441–448. doi: 10.1016/j.tins.2016.04.010
Cabral, J., Kringelbach, M., and Deco, G. (2017). Functional connectivity dynamically evolves on multiple time-scales over a static structural connectome: models and mechanisms. Neuroimage 160, 84–96. doi: 10.1016/j.neuroimage.2017.03.045
Cai, M., Wang, R., Liu, M., Du, X., Xue, K., Ji, Y., et al. (2022). Disrupted local functional connectivity in schizophrenia: an updated and extended meta-analysis. Schizophrenia 8:93. doi: 10.1038/s41537-022-00311-2
Cardona, A., Saalfeld, S., Schindelin, J., Arganda-Carreras, I., Preibisch, S., Longair, M., et al. (2012). TrakEM2 software for neural circuit reconstruction. PLoS One 7:e38011. doi: 10.1371/journal.pone.0038011
Carey, H., Pegios, M., Martin, L., Saleeba, C., Turner, A., Everett, N., et al. (2023). DeepSlice: rapid fully automatic registration of mouse brain imaging to a volumetric atlas. Nat. Commun. 14:5884. doi: 10.1038/s41467-023-41645-4
Cazemier, J., Clascá, F., and Tiesinga, P. (2016). Connectomic analysis of brain networks: novel techniques and future directions. Front. Neuroanat. 10:110. doi: 10.3389/fnana.2016.00110
Chang, J.-B., Chen, F., Yoon, Y., Jung, E., Babcock, H., and Kang, J. (2017). Iterative expansion microscopy. Nat. Methods 14, 593–599. doi: 10.1016/bs.mcb.2020.06.003
Chen, F., Tillberg, P., and Boyden, E. (2015). Optical imaging expansion microscopy. Science 347, 543–548.
Chen, S., He, Z., Han, X., He, X., Li, R., Zhu, H., et al. (2019). How big data and high-performance computing drive brain science. Genomics Proteomics Bioinformatics 17, 381–392.
Chen, T., Wang, Y., Zhang, J., Wang, Z., Xu, J., Li, Y., et al. (2017). Abnormal concentration of GABA and glutamate in the prefrontal cortex in schizophrenia.-an in vivo 1H-MRS study. Shanghai Arch. Psychiatry 29, 277–286. doi: 10.11919/j.issn.1002-0829.217004
Chen, Y., Almarzouqi, S. J., Morgan, M. L., and Lee, A. G. (2018). “T1-weighted image’, in Encyclopedia of Ophthalmology, eds U. Schmidt-Erfurth and T. Kohnen. Berlin: Springer.
Chen, Y., Rex, C., Rice, C., Dubé, C., Gall, C., Lynch, G., et al. (2010). Correlated memory defects and hippocampal dendritic spine loss after acute stress involve corticotropin-releasing hormone signaling. Proc. Natl. Acad. Sci. U S A. 107, 13123–13128. doi: 10.1073/pnas.1003825107
Claro, P. I. C., Borges, E. P. S., Schleder, G. R., Archilha, N. L., Pinto, A., and Carvalho, M. (2023). From micro- to nano- and time-resolved x-ray computed tomography: bio-based applications, synchrotron capabilities, and data-driven processing. Appl. Phys. Rev. 10:021301.
Contreras-Rodríguez, O., Pujol, J., Batalla, I., Harrison, B., Soriano-Mas, C., Deus, J., et al. (2015). Functional connectivity bias in the prefrontal cortex of psychopaths. Biol. Psychiatry 78, 647–655. doi: 10.1016/j.biopsych.2014.03.007
Coras, R., Holthausen, H., and Sarnat, H. (2021). Focal cortical dysplasia type 1. Brain Pathol. 31:e12964.
Corle, T. R., and Kino, G. S. (1996). “Chapter 1 – Introduction,” in Confocal Scanning Optical Microscopy and Related Imaging Systems, eds T. R. Corle and G. S. Kino (Cambridge, MA: Academic Press), doi: 10.1016/B978-012408750-7/50009-4
Creese, I., Burt, D., and Snyder, S. (1976). Dopamine receptor binding predicts clinical and pharmacological potencies of antischizophrenic drugs. Science 192, 481–483.
Cristianini, N., and Ricci, E. (2008). “Support vector machines,” in Encyclopedia of Algorithms, ed. M. Y. Kao (Boston, MA: Springer).
Dai, T., Dubois, M., Arulkumaran, K., Campbell, J., Bass, C., Billot, B., et al. (2019). Deep Reinforcement Learning for Subpixel Neural Tracking. Available Online at: https://openreview.net/pdf?id=HJxrNvv0JN (accessed 21 June 2023).
Das, A., Holden, S., Borovicka, J., Icardi, J., O’Niel, A., Chaklai, A., et al. (2023). Large-scale recording of neuronal activity in freely-moving mice at cellular resolution. Nat. Commun. 14:6399. doi: 10.1038/s41467-023-42083-y
Delevich, K., Thomas, A., and Wilbrecht, L. (2018). Adolescence and late blooming synapses of the prefrontal cortex. Cold Spring Harb. Symp. Quant. Biol. 83, 37–43.
Denk, W., Strickler, J., and Webb, W. (1990). Two-photon laser scanning fluorescence microscopy. Science 248, 73–76.
Desai, A., and Mitchison, T. (1997). Microtubule polymerization dynamics. Annu. Rev. Cell Dev. Biol. 13, 83–17.
Devous, M. (1995). SPECT functional brain imaging. technical considerations. J. Neuroimaging. 5, S2–S13.
Dickstein, D., Dickstein, D., Janssen, W., Hof, P., Glaser, J., Rodriguez, A., et al. (2016). Automatic dendritic spine quantification from confocal data with neurolucida 360. Curr. Protoc. Neurosci. 77, 1.27.1–1.27.21. doi: 10.1002/cpns.16
Dijkstra, E. W. (1959). A note on two problems in connexion with graphs. Numerische Mathematik 1, 269–271.
Du, X., Zhang, H., and Parent, J. (2017). Rabies tracing of birthdated dentate granule cells in rat temporal lobe epilepsy. Ann. Neurol. 81, 790–803. doi: 10.1002/ana.24946
Dubeau, F., Tampieri, D., Lee, N., Andermann, E., Carpenter, S., Leblanc, R., et al. (1995). Periventricular and subcortical nodular heterotopia. a study of 33 patients. Brain 118, 1273–1287.
Durkee, M., Abraham, R., Clark, M., and Giger, M. (2021). Artificial intelligence and cellular segmentation in tissue microscopy images. Am. J. Pathol. 191, 1693–1701.
Ekaterina, P., Peter, V., Smirnova, D., Vyacheslav, C., and Ilya, B. (2023). SpineTool is an open-source software for analysis of morphology of dendritic spines. Sci. Rep. 13:10561. doi: 10.1038/s41598-023-37406-4
Ekşioğlu, Y., Scheffer, I., Cardenas, P., Knoll, J., DiMario, F., Ramsby, G., et al. (1996). Periventricular heterotopia: an X-linked dominant epilepsy locus causing aberrant cerebral cortical development. Neuron 16, 77–87. doi: 10.1016/s0896-6273(00)80025-2
Englot, D., Konrad, P., and Morgan, V. (2016). Regional and global connectivity disturbances in focal epilepsy, related neurocognitive sequelae, and potential mechanistic underpinnings. Epilepsia 57, 1546–1557. doi: 10.1111/epi.13510
Erdeniz, B., Serin, E., İbadi, Y., and Taş, C. (2017). Decreased functional connectivity in schizophrenia: the relationship between social functioning, social cognition and graph theoretical network measures. Psychiatry Res. Neuroimaging 270, 22–31. doi: 10.1016/j.pscychresns.2017.09.011
Feng, L., Zhao, T., and Kim, J. (2015). neuTube 1.0: a new design for efficient neuron reconstruction software based on the SWC format. eNeuro 2:ENEURO.0049-14.2014. doi: 10.1523/ENEURO.0049-14.2014
Fiala, J., Spacek, J., and Harris, K. (2002). Dendritic spine pathology: cause or consequence of neurological disorders? Brain Res. Rev. 39, 29–54.
Finnegan, M., Visanji, N., Romero-Canelon, I., House, E., Rajan, S., Mosselmans, J., et al. (2019). Synchrotron XRF imaging of Alzheimer’s disease basal ganglia reveals linear dependence of high-field magnetic resonance microscopy on tissue iron concentration. J. Neurosci. Methods 319, 28–39. doi: 10.1016/j.jneumeth.2019.03.002
Fisher, R. (2017). An overview of the 2017 ILAE operational classification of seizure types. Epilepsy Behav. 70, 271–273.
Fisher, R., Scharfman, H., and deCurtis, M. (2014). How can we identify ictal and interictal abnormal activity? Adv. Exp. Med. Biol. 813, 3–23.
Fonseca, M., Araujo, B., Dias, C., Archilha, N., Neto, D., Cavalheiro, E., et al. (2018). High-resolution synchrotron-based X-ray microtomography as a tool to unveil the three-dimensional neuronal architecture of the brain. Sci Rep. 8:12074. doi: 10.1038/s41598-018-30501-x
Fornito, A., Bullmore, E., and Zalesky, A. (2017). Opportunities and challenges for psychiatry in the connectomic era. Biol. Psychiatry Cogn. Neurosci. Neuroimaging 2, 9–19.
Fosque, B., Sun, Y., Dana, H., Yang, C., Ohyama, T., Tadross, M., et al. (2015). Neural circuits. labeling of active neural circuits in vivo with designed calcium integrators. Science 347, 755–760. doi: 10.1126/science.1260922
Frangi, A. F., Niessen, W. J., Vincken, K. L., and Viergever, M. A. (1998). “Multiscale vessel enhancement filtering,” in Medical Image Computing and Computer-Assisted Intervention — MICCAI’98. MICCAI 1998. Lecture Notes in Computer Science, eds W. M. Wells, A. Colchester, and S. Delp (Berlin: Springer), doi: 10.1007/BFb0056195
Frasconi, P., Silvestri, L., Soda, P., Cortini, R., Pavone, F. S., and Iannello, G. (2014). Large-scale automated identification of mouse brain cells in confocal light sheet microscopy images. Bioinformatics 30, i587–i593. doi: 10.1093/bioinformatics/btu469
Friedmann, D., Pun, A., Adams, E., Lui, J., Kebschull, J., Grutzner, S., et al. (2020). Mapping mesoscale axonal projections in the mouse brain using a 3D convolutional network. Proc. Natl. Acad. Sci. U S A. 117, 11068–11075. doi: 10.1073/pnas.1918465117
Gallagher, B., and Zhao, Y. (2021). Expansion microscopy: a powerful nanoscale imaging tool for neuroscientists. Neurobiol. Dis. 154:105362. doi: 10.1016/j.nbd.2021.105362
Gao, S., Yang, K., Shi, H., Wang, K., and Bai, J. (2022). Review on Panoramic Imaging and its Applications in Scene Understanding. Piscataway, NJ: IEEE.
Gao, W., Yang, S., Mack, N., and Chamberlin, L. (2022). Aberrant maturation and connectivity of prefrontal cortex in schizophrenia-contribution of NMDA receptor development and hypofunction. Mol. Psychiatry 27, 731–743. doi: 10.1038/s41380-021-01196-w
Garrity, A., Pearlson, G., McKiernan, K., Lloyd, D., Kiehl, K., and Calhoun, V. (2007). Aberrant default mode functional connectivity in schizophrenia. Am. J. Psychiatry 164, 450–457.
Glantz, L., and Lewis, D. (2000). Decreased dendritic spine density on prefrontal cortical pyramidal neurons in schizophrenia. Arch. Gen. Psychiatry 57, 65–73.
Godwin, D., Ji, A., Kandala, S., and Mamah, D. (2017). Functional connectivity of cognitive brain networks in schizophrenia during a working memory task. Front. Psychiatry 8:294. doi: 10.3389/fpsyt.2017.00294
Goodfellow, I. J., Pouget-Abadie, J., Mirza, M., Xu, B., Warder-Farley, D., and Ozair, S. (2014). Generative Adversarial Networks. Available online at: http://arxiv.org/abs/1406.2661 (accessed 7 November 2023).
Goubran, M., Leuze, C., Hsueh, B., Aswendt, M., Ye, L., Tian, Q., et al. (2019). Multimodal image registration and connectivity analysis for integration of connectomic data from microscopy to MRI. Nat. Commun. 10:5504. doi: 10.1038/s41467-019-13374-0
Govindan, S., Batti, L., Osterop, S., Stoppini, L., and Roux, A. (2021). Mass generation, neuron labeling, and 3D imaging of minibrains. Front. Bioeng. Biotechnol. 8:582650. doi: 10.3389/fbioe.2020.582650
Hagmann, P., Cammoun, L., Gigandet, X., Meuli, R., Honey, C., Wedeen, V., et al. (2008). Mapping the structural core of human cerebral cortex. PLoS Biol. 6:e159. doi: 10.1371/journal.pbio.0060159
Hallett, M., de Haan, W., Deco, G., Dengler, R., Di Iorio, R., Gallea, C., et al. (2020). Human brain connectivity: clinical applications for clinical neurophysiology. Clin. Neurophysiol. 131, 1621–1651.
Hatton, S., Huynh, K., Bonilha, L., Abela, E., Alhusaini, S., Altmann, A., et al. (2020). White matter abnormalities across different epilepsy syndromes in adults: an ENIGMA-epilepsy study. Brain 143, 2454–2473. doi: 10.1093/brain/awaa200
Haueis, P. (2021). Multiscale modeling of cortical gradients: the role of mesoscale circuits for linking macro- and microscale gradients of cortical organization and hierarchical information processing. Neuroimage 232:117846. doi: 10.1016/j.neuroimage.2021.117846
Hayes, T., and Pease, R. (1968). The scanning electron microscope: principles and applications in biology and medicine. Adv. Biol. Med. Phys. 12, 85–37. doi: 10.1016/b978-1-4831-9928-3.50006-0
He, K., Zhang, X., Ren, S., and Sun, J. (2015). Deep residual learning for image recognition. arXiv [Preprint]. Available Online at: http://arxiv.org/abs/1512.03385 (accessed October 10, 2024).
Henze, D., Urban, N., and Barrionuevo, G. (2000). The multifarious hippocampal mossy fiber pathway: a review. Neuroscience 98, 407–427. doi: 10.1016/s0306-4522(00)00146-9
Hering, H., and Sheng, M. (2001). Dendritic spines: structure, dynamics and regulation. Nat. Rev. Neurosci. 2, 880–888.
Hillman, E., Voleti, V., Li, W., and Yu, H. (2019). Light-sheet microscopy in neuroscience. Annu Rev Neurosci. 42, 295–313.
Hirsch, G., Bauer, C., and Merabet, L. (2015). Using structural and functional brain imaging to uncover how the brain adapts to blindness. Ann. Neurosci. Psychol. 2:5.
Holmes, A., Levi, P., Chen, Y., Chopra, S., Aquino, K., Pang, J., et al. (2023). Disruptions of hierarchical cortical organization in early psychosis and schizophrenia. Biol. Psychiatry Cogn. Neurosci. Neuroimaging 8, 1240–1250.
Hong, B., Liu, J., Shen, L., Xie, Q., Yuan, J., Emrouznejad, A., et al. (2023). Graph partitioning algorithms with biological connectivity decisions for neuron reconstruction in electron microscope volumes. Exp. Sys. Appl. 222:119776.
Hong, S., Lee, H., Gill, R., Crane, J., Sziklas, V., Bernhardt, B., et al. (2019). A connectome-based mechanistic model of focal cortical dysplasia. Brain 142, 688–699. doi: 10.1093/brain/awz009
Hörl, D., Rojas Rusak, F., Preusser, F., Tillberg, P., Randel, N., Chhetri, R., et al. (2019). BigStitcher: reconstructing high-resolution image datasets of cleared and expanded samples. Nat. Methods 16, 870–874. doi: 10.1038/s41592-019-0501-0
Howard, A., Huszar, I., Smart, A., Cottaar, M., Daubney, G., Hanayik, T., et al. (2023). An open resource combining multi-contrast MRI and microscopy in the macaque brain. Nat. Commun. 14:4320. doi: 10.1038/s41467-023-39916-1
Howes, O., Montgomery, A., Asselin, M., Murray, R., Valli, I., Tabraham, P., et al. (2009). Elevated striatal dopamine function linked to prodromal signs of schizophrenia. Arch. Gen. Psychiatry 66, 13–20. doi: 10.1001/archgenpsychiatry.2008.514
Hsieh, L., Wen, J., Claycomb, K., Huang, Y., Harrsch, F., Naegele, J., et al. (2016). Convulsive seizures from experimental focal cortical dysplasia occur independently of cell misplacement. Nat. Commun. 7:11753. doi: 10.1038/ncomms11753
Hu, T., Xu, X., Chen, S., and Liu, Q. (2021). Accurate neuronal soma segmentation using 3D multi-task learning u-shaped fully convolutional neural networks. Front. Neuroanat. 14:592806. doi: 10.3389/fnana.2020.592806
Huang, C., Wang, J., Wang, S., and Zhang, Y. (2022). Applicable artificial intelligence for brain disease: a survey. Neurocomputing 504, 223–239.
Huang, H., Chen, C., Rong, B., Wan, Q., Chen, J., Liu, Z., et al. (2022). Resting-state functional connectivity of salience network in schizophrenia and depression. Sci. Rep. 12:11204.
Huang, Q., Cao, T., Chen, Y., Li, A., Zeng, S., and Quan, T. (2021). Automated neuron tracing using content-aware adaptive voxel scooping on CNN predicted probability map. Front. Neuroanat. 15:712842. doi: 10.3389/fnana.2021.712842
Hunt, M. J., Kopell, N., Traub, R., and Whittington, M. (2017). Aberrant network activity in Schizophrenia. Trends Neurosci. 40, 371–382.
Ishii, K., Kubo, K., Endo, T., Yoshida, K., Benner, S., Ito, Y., et al. (2015). Neuronal heterotopias affect the activities of distant brain areas and lead to behavioral deficits. J. Neurosci. 35, 12432–12445. doi: 10.1523/JNEUROSCI.3648-14.2015
Iwasaki, H., Ichinose, S., Tajika, Y., and Murakami, T. (2022). Recent technological advances in correlative light and electron microscopy for the comprehensive analysis of neural circuits. Front. Neuroanat. 16:1061078. doi: 10.3389/fnana.2022.1061078
Jahangir, M., Zhou, J., Lang, B., and Wang, X. (2021). GABAergic system dysfunction and challenges in Schizophrenia research. Front. Cell Dev. Biol. 9:663854. doi: 10.3389/fcell.2021.663854
Jamadar, S., Ward, P., Liang, E., Orchard, E., Chen, Z., and Egan, G. (2021). Metabolic and hemodynamic resting-state connectivity of the human brain: a high-temporal resolution simultaneous BOLD-fMRI and FDG-fPET multimodality study. Cereb. Cortex 31, 2855–2867.
Janoos, F., Mosaliganti, K., Xu, X., Machiraju, R., Huang, K., and Wong, S. (2009). Robust 3D reconstruction and identification of dendritic spines from optical microscopy imaging. Med. Image Anal. 13, 167–179. doi: 10.1016/j.media.2008.06.019
Jean, G., Carton, J., Haq, K., and Musto, A. (2023). The role of dendritic spines in epileptogenesis. Front Cell Neurosci. 17:1173694. doi: 10.3389/fncel.2023.1173694
Jeurissen, B., Descoteaux, M., Mori, S., and Leemans, A. (2019). Diffusion MRI fiber tractography of the brain. NMR Biomed. 32:e3785.
Jiang, M., Lee, C., Smith, K., and Swann, J. (1998). Spine loss and other persistent alterations of hippocampal pyramidal cell dendrites in a model of early-onset epilepsy. J. Neurosci. 18, 8356–8368. doi: 10.1523/JNEUROSCI.18-20-08356.1998
Jin, X., and Han, J. (2011). “K-Means Clustering,” in Encyclopedia of Machine Learning, eds C. Sammut and G. I. Webb (Boston, MA: Springer).
Jonkman, J., and Brown, C. (2015). Any way you slice it-a comparison of confocal microscopy techniques. J. Biomol. Tech. 26, 54–65. doi: 10.7171/jbt.15-2602-003
Jørgensen, K., Nerland, S., Norbom, L., Doan, N., Nesvåg, R., Mørch-Johnsen, L., et al. (2016). Increased MRI-based cortical grey/white-matter contrast in sensory and motor regions in schizophrenia and bipolar disorder. Psychol. Med. 46, 1971–1985. doi: 10.1017/S0033291716000593
Kahn, R., Sommer, I., Murray, R., Meyer-Lindenberg, A., Weinberger, D., Cannon, T., et al. (2015). Schizophrenia. Nat. Rev. Dis. Primers 1:15067.
Kaiser, M. (2013). The potential of the human connectome as a biomarker of brain disease. Front. Hum. Neurosci. 7:484. doi: 10.3389/fnhum.2013.00484
Kaur, S., Singla, J., and Nikita Singh, A. (2021). “Review on medical image denoising techniques,” in 2021 International Conference on Innovative Practices in Technology and Management (ICIPTM), (Piscatawy, NJ: IEEE).
Keller, P., and Ahrens, M. (2015). Visualizing whole-brain activity and development at the single-cell level using light-sheet microscopy. Neuron 85, 462–483. doi: 10.1016/j.neuron.2014.12.039
Khalil, R., Kallel, S., Farhat, A., and Dlotko, P. (2021). Topological sholl descriptors for neuronal clustering and classification. bioRxiv [Preprint]. Available online at: https://doi.org/10.1101/2021.01.15.426800 (accessed October 10, 2023).
Khan, S., Naseer, M., Hayat, M., Zamir, S. W., Khan, F. S., and Shah, M. (2022). Transformers in vision: a survey. ACM Comput. Surv. 54, 1–41.
Kim, B., Kim, H., Kim, S., and Hwang, Y. (2021). A brief review of non-invasive brain imaging technologies and the near-infrared optical bioimaging. Appl. Microsc. 51:9. doi: 10.1186/s42649-021-00058-7
Kim, K., Son, K., and Palmore, G. (2015). Neuron image analyzer: automated and accurate extraction of neuronal data from low quality images. Sci. Rep. 5:17062.
Koch, G., Amara, I., Davis, G., and Gillings, D. (1982). A review of some statistical methods for covariance analysis of categorical data. Biometrics 38, 563–595.
Kollem, S., Reddy, K. R. L., and Rao, D. S. (2019). A review of image denoising and segmentation methods based on medical images. Int. J. Mach. Learn. Comput. 9, 288–295.
Konopaske, G., Lange, N., Coyle, J., and Benes, F. (2014). Prefrontal cortical dendritic spine pathology in schizophrenia and bipolar disorder. JAMA Psychiatry 71, 1323–1331.
Kraft, N., Muenz, T., Reinhard, S., Werner, C., Sauer, M., Groh, C., et al. (2023). Expansion microscopy in honeybee brains for high-resolution neuroanatomical analyses in social insects. Cell Tissue Res. 393, 489–506. doi: 10.1007/s00441-023-03803-4
Krasowski, N., Beier, T., Knott, G., Kothe, U., Hamprecht, F., and Kreshuk, A. (2018). Neuron segmentation with high-level biological priors. IEEE Trans. Med. Imaging 37, 829–839. doi: 10.1109/TMI.2017.2712360
Kuan, A., Phelps, J., Thomas, L., Nguyen, T., Han, J., Chen, C., et al. (2020). Dense neuronal reconstruction through X-ray holographic nano-tomography. Nat. Neurosci. 23, 1637–1643. doi: 10.1038/s41593-020-0704-9
Lanciego, J., and Wouterlood, F. (2020). Neuroanatomical tract-tracing techniques that did go viral. Brain Struct. Funct. 225, 1193–1224. doi: 10.1007/s00429-020-02041-6
Lang, E., Tomé, A., Keck, I., Górriz-Sáez, J., and Puntonet, C. (2012). Brain connectivity analysis: a short survey. Comput. Intell. Neurosci. 2012:412512. doi: 10.1155/2012/412512
Lee, M., O’Hara, N., Sonoda, M., Kuroda, N., Juhasz, C., Asano, E., et al. (2020). Novel deep learning network analysis of electrical stimulation mapping-driven diffusion MRI tractography to improve preoperative evaluation of pediatric epilepsy. IEEE Trans. Biomed. Eng. 67, 3151–3162. doi: 10.1109/TBME.2020.2977531
Levet, F., Tønnesen, J., Nägerl, U., and Sibarita, J. (2020). SpineJ: a software tool for quantitative analysis of nanoscale spine morphology. Methods 174, 49–55. doi: 10.1016/j.ymeth.2020.01.020
Lewis, D. (1997). Development of the prefrontal cortex during adolescence: insights into vulnerable neural circuits in schizophrenia. Neuropsychopharmacology 16, 385–398.
Lewis, D., Hashimoto, T., and Volk, D. (2005). Cortical inhibitory neurons and schizophrenia. Nat. Rev. Neurosci. 6, 312–324.
Li, A., Gong, H., Zhang, B., Wang, Q., Yan, C., Wu, J., et al. (2010). Micro-optical sectioning tomography to obtain a high-resolution atlas of the mouse brain. Science 330, 1404–1408.
Li, B., Sumera, A., Booker, S., and McCullagh, E. (2023). Current best practices for analysis of dendritic spine morphology and number in neurodevelopmental disorder research. ACS Chem. Neurosci. 14, 1561–1572. doi: 10.1021/acschemneuro.3c00062
Li, K., Vakharia, V. N., Sparks, R., França, L. G. S., Granados, A., McEvoy, A. W., et al. (2019). Optimizing trajectories for cranial laser interstitial thermal therapy using computer-assisted planning: A machine learning approach. Neurotherapeutics 16, 182–191. doi: 10.1007/s13311-018-00693-1
Li, Q., and Deng, Z. (2012). A surface-based 3-D dendritic spine detection approach from confocal microscopy images. IEEE Trans. Image Process. 21, 1223–1230. doi: 10.1109/TIP.2011.2166973
Li, R., Zhu, M., Li, J., Bienkowski, M., Foster, N., Xu, H., et al. (2019). Precise segmentation of densely interweaving neuron clusters using G-Cut. Nat. Commun. 10:1549. doi: 10.1038/s41467-019-09515-0
Lillvis, J., Otsuna, H., Ding, X., Pisarev, I., Kawase, T., Colonell, J., et al. (2022). Rapid reconstruction of neural circuits using tissue expansion and light sheet microscopy. Elife 11:e81248. doi: 10.7554/eLife.81248
Liu, C., Fan, J., Bailey, B., Müller, R., and Linke, A. (2023). Assessing predictive ability of dynamic time warping functional connectivity for ASD classification. Int. J. Biomed. Imaging 2023:8512461. doi: 10.1155/2023/8512461
Liu, C., Wang, D., Zhang, H., Wu, W., Sun, W., Zhao, T., et al. (2022). Using simulated training data of voxel-level generative models to improve 3D neuron reconstruction. IEEE Trans. Med. Imaging 41, 3624–3635. doi: 10.1109/TMI.2022.3191011
Liu, S., Zhang, D., Liu, S., Feng, D., Peng, H., and Cai, W. (2016). Rivulet: 3D neuron morphology tracing with iterative back-tracking. Neuroinformatics 14, 387–401. doi: 10.1007/s12021-016-9302-0
Liu, Y., Leong, A., Zhao, Y., Xiao, L., Mak, H., Tsang, A., et al. (2021). A low-cost and shielding-free ultra-low-field brain MRI scanner. Nat. Commun. 12:7238. doi: 10.1038/s41467-021-27317-1
Liu, Y., Wang, G., Ascoli, G., Zhou, J., and Liu, L. (2022). Neuron tracing from light microscopy images: automation, deep learning and bench testing. Bioinformatics 38, 5329–5339. doi: 10.1093/bioinformatics/btac712
Luengo-Sanchez, S., Fernaud-Espinosa, I., Bielza, C., Benavides-Piccione, R., Larrañaga, P., and DeFelipe, J. (2018). 3D morphology-based clustering and simulation of human pyramidal cell dendritic spines. PLoS Comput. Biol. 14:e1006221. doi: 10.1371/journal.pcbi.1006221
Luo, L., Callaway, E., and Svoboda, K. (2008). Genetic dissection of neural circuits. Neuron 57, 634–660.
MacDonald, M., Alhassan, J., Newman, J., Richard, M., Gu, H., Kelly, R., et al. (2017). Selective loss of smaller spines in Schizophrenia. Am. J. Psychiatry 174, 586–594. doi: 10.1176/appi.ajp.2017.16070814
Magliaro, C., Callara, A., Vanello, N., and Ahluwalia, A. (2019). Gotta Trace ’em all: a mini-review on tools and procedures for segmenting single neurons toward deciphering the structural connectome. Front. Bioeng. Biotechnol. 7:202. doi: 10.3389/fbioe.2019.00202
Mainen, Z., and Sejnowski, T. (1996). Influence of dendritic structure on firing pattern in model neocortical neurons. Nature 382, 363–366.
Marques, T., Ashok, A., Angelescu, I., Borgan, F., Myers, J., Lingford-Hughes, A., et al. (2021). GABA-A receptor differences in schizophrenia: a positron emission tomography study using [11C]Ro154513. Mol. Psychiatry 26, 2616–2625.
Martin, N., and Plavicki, J. (2020). Advancing zebrafish as a model for studying developmental neurotoxicology. J. Neurosci. Res. 98, 981–983. doi: 10.1002/jnr.24621
Martineau, F., Sahu, S., Plantier, V., Buhler, E., Schaller, F., Fournier, L., et al. (2018). Correct laminar positioning in the neocortex influences proper dendritic and synaptic development. Cereb. Cortex 28, 2976–2990. doi: 10.1093/cercor/bhy113
Mason, L. no date. “Boosting algorithms as gradient descent,” in Proceedings of the 12th International Conference on Neural Information Processing Systems, (New York, NY: ACM).
McCutcheon, R., Krystal, J., and Howes, O. (2020). Dopamine and glutamate in schizophrenia: biology, symptoms and treatment. World Psychiatry 19, 15–33.
Mello, L., Cavalheiro, E., Tan, A., Kupfer, W., Pretorius, J., Babb, T., et al. (1993). Circuit mechanisms of seizures in the pilocarpine model of chronic epilepsy: cell loss and mossy fiber sprouting. Epilepsia 34, 985–995. doi: 10.1111/j.1528-1157.1993.tb02123.x
Mitra, P. (2014). The circuit architecture of whole brains at the mesoscopic scale. Neuron 83, 1273–1283.
Miyawaki, A., Llopis, J., Heim, R., McCaffery, J., Adams, J., Ikura, M., et al. (1997). Fluorescent indicators for Ca2+ based on green fluorescent proteins and calmodulin. Nature 388, 882–887.
Möhler, H. (2012). The GABA system in anxiety and depression and its therapeutic potential. Neuropharmacology 62, 42–53.
Motta, A., Berning, M., Boergens, K., Staffler, B., Beining, M., Loomba, S., et al. (2019). Dense connectomic reconstruction in layer 4 of the somatosensory cortex. Science 366:eaay3134.
Mukai, H., Hatanaka, Y., Mitsuhashi, K., Hojo, Y., Komatsuzaki, Y., Sato, R., et al. (2011). Automated analysis of spines from confocal laser microscopy images: application to the discrimination of androgen and estrogen effects on spinogenesis. Cereb. Cortex 21, 2704–2711. doi: 10.1093/cercor/bhr059
Muñoz-Castañeda, R., Zingg, B., Matho, K., Chen, X., Wang, Q., Foster, N., et al. (2021). Cellular anatomy of the mouse primary motor cortex. Nature 598, 159–166.
Nakai, J., Ohkura, M., and Imoto, K. (2001). A high signal-to-noise Ca(2+) probe composed of a single green fluorescent protein. Nat. Biotechnol. 19, 137–141. doi: 10.1038/84397
Nemoto, K., Shimokawa, T., Fukunaga, M., Yamashita, F., Tamura, M., Yamamori, H., et al. (2020). Differentiation of schizophrenia using structural MRI with consideration of scanner differences: a real-world multisite study. Psychiatry Clin. Neurosci. 74, 56–63. doi: 10.1111/pcn.12934
Oh, J., Lee, C., and Kaang, B. (2019). Imaging and analysis of genetically encoded calcium indicators linking neural circuits and behaviors. Korean J. Physiol. Pharmacol. 23, 237–249.
Oh, S., Harris, J., Ng, L., Winslow, B., Cain, N., Mihalas, S., et al. (2014). A mesoscale connectome of the mouse brain. Nature 508, 207–214.
Okabe, S. (2020). Recent advances in computational methods for measurement of dendritic spines imaged by light microscopy. Microscopy 69, 196–213.
Oltmer, J., Rosenblum, E., Williams, E., Roy, J., Llamas-Rodriguez, J., Perosa, V., et al. (2023). Stereology neuron counts correlate with deep learning estimates in the human hippocampal subregions. Sci. Rep. 13:5884. doi: 10.1038/s41598-023-32903-y
Østerlund, I., Persson, S., and Nikoloski, Z. (2022). Tracing and tracking filamentous structures across scales: a systematic review. Comput. Struct. Biotechnol. J. 21, 452–462. doi: 10.1016/j.csbj.2022.12.023
Pachitariu, M., Stringer, C., Dipoppa, M., Schroder, S., Rossi, F., Dalgelshi, H., et al. (2017). Suite2p: beyond 10,000 neurons with standard two-photon microscopy. bioRxiv [Preprint]. Available online at: https://doi.org/10.1101/061507 (accessed January 1, 2024).
Papa, M., Bundman, M., Greenberger, V., and Segal, M. (1995). Morphological analysis of dendritic spine development in primary cultures of hippocampal neurons. J. Neurosci. 15(1 Pt 1), 1–11.
Patel, N., Vyas, N., Puri, B., Nijran, K., and Al-Nahhas, A. (2010). Positron emission tomography in schizophrenia: a new perspective. J. Nucl. Med. 51, 511–520.
Paşca, S. P., Arlotta, P., Bateup, H. S., Camp, J. G., Cappello, S., Gage, F. H., et al. (2022). A nomenclature consensus for nervous system organoids and assembloids. Nature 609, 907–910. doi: 10.1038/s41586-022-05219-6
Phelps, M. (2000). Positron emission tomography provides molecular imaging of biological processes. Proc. Natl. Acad. Sci. U S A. 97, 9226–9233.
Pisano, T., Hoag, A., Dhanerawala, Z., Guariglia, S., Jung, C., Boele, H., et al. (2022). Automated high-throughput mouse transsynaptic viral tracing using iDISCO+ tissue clearing, light-sheet microscopy, and BrainPipe. STAR Protoc. 3:101289. doi: 10.1016/j.xpro.2022.101289
Polavaram, S., Gillette, T., Parekh, R., and Ascoli, G. (2014). Statistical analysis and data mining of digital reconstructions of dendritic morphologies. Front. Neuroanat. 8:138. doi: 10.3389/fnana.2014.00138
Quan, T., Zhou, H., Li, J., Li, S., Li, A., Li, Y., et al. (2016). NeuroGPS-Tree: automatic reconstruction of large-scale neuronal populations with dense neurites. Nat. Methods 13, 51–54. doi: 10.1038/nmeth.3662
Rah, J., Feng, L., Druckmann, S., Lee, H., and Kim, J. (2015). From a meso- to micro-scale connectome: array tomography and mGRASP. Front. Neuroanat. 9:78. doi: 10.3389/fnana.2015.00078
Rajotte, J., Bergen, R., Buckeridge, D., El Emam, K., Ng, R., and Strome, E. (2022). Synthetic data as an enabler for machine learning applications in medicine. iScience 25:105331. doi: 10.1016/j.isci.2022.105331
Rees, C., Moradi, K., and Ascoli, G. (2017). Weighing the evidence in peters’ rule: does neuronal morphology predict connectivity? Trends Neurosci. 40, 63–71. doi: 10.1016/j.tins.2016.11.007
Renier, N., Adams, E., Kirst, C., Wu, Z., Azevedo, R., Kohl, J., et al. (2016). Mapping of brain activity by automated volume analysis of immediate early genes. Cell 165, 1789–1802. doi: 10.1016/j.cell.2016.05.007
Renier, W., Gabreëls, F., and Jaspar, H. (1988). Morphological and biochemical analysis of a brain biopsy in a case of idiopathic lennox-gastaut syndrome. Epilepsia 29, 644–649. doi: 10.1111/j.1528-1157.1988.tb03776.x
Represa, A. (2019). Why malformations of cortical development cause epilepsy. Front. Neurosci. 13:250. doi: 10.3389/fnins.2019.00250
Richards, S., and Van Hooser, S. (2018). Neural architecture: from cells to circuits. J. Neurophysiol. 120, 854–866.
Rochefort, N., and Konnerth, A. (2012). Dendritic spines: from structure to in vivo function. EMBO Rep. 13, 699–708.
Rodrigues, P., Tostes, K., Bosque, B., de Godoy, J., Amorim Neto, D., Dias, C., et al. (2021). Illuminating the brain With X-rays: contributions and future perspectives of high-resolution microtomography to neuroscience. Front. Neurosci. 15:627994. doi: 10.3389/fnins.2021.627994
Rodriguez, A., Ehlenberger, D. B., Dickstein, D. L., Hof, P. R., and Wearne, S. L. (2008). Automated three-dimensional detection and shape classification of dendritic spines from fluorescence microscopy images. PLoS One 3:e1997. doi: 10.1371/journal.pone.0001997
Rodriguez, A., Ehlenberger, D., Hof, P., and Wearne, S. (2006). Rayburst sampling, an algorithm for automated three-dimensional shape analysis from laser scanning microscopy images. Nat. Protoc. 1, 2152–2161.
Ronneberger, O., Fischer, P., and Brox, T. (2015). “U-Net: convolutional networks for biomedical image segmentation,” in Proceedings of the International Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015, eds N. Navab, J. Hornegger, W. Wells, and A. Frangi (Cham: Springer).
Rossini, L., De Santis, D., Cecchini, E., Cagnoli, C., Maderna, E., Cartelli, D., et al. (2023). Dendritic spine loss in epileptogenic type II focal cortical dysplasia: role of enhanced classical complement pathway activation. Brain Pathol. 33:e13141. doi: 10.1111/bpa.13141
Rusakov, D., and Stewart, M. (1995). Quantification of dendritic spine populations using image analysis and a tilting disector. J. Neurosci. Methods 60, 11–21. doi: 10.1016/0165-0270(94)00215-3
Saleeba, C., Dempsey, B., Le, S., Goodchild, A., and McMullan, S. (2019). A student’s guide to neural circuit tracing. Front Neurosci. 13:897. doi: 10.3389/fnins.2019.00897
Santuy, A., Tomás-Roca, L., Rodríguez, J., González-Soriano, J., Zhu, F., Qiu, Z., et al. (2020). Estimation of the number of synapses in the hippocampus and brain-wide by volume electron microscopy and genetic labeling. Sci. Rep. 10:14014. doi: 10.1038/s41598-020-70859-5
Sarvaiya, J. N., Patnaik, S., and Bombaywala, S. (2009). “Image registration by template matching using normalized cross-correlation,” in Proceedings of the 2009 International Conference on Advances in Computing, Control, and Telecommunication Technologies. Telecommunication Technologies (ACT), (Piscataway, NJ: IEEE).
Schapire, R. E., and Singer, Y. (1999). Improved boosting algorithms using confidence-rated predictions. Machine Learn. 37, 297–336. doi: 10.1007/s10994-005-1123-6
Scheibel, M., Davies, T., Lindsay, R., and Scheibel, A. (1974). Basilar dendrite bundles of giant pyramidal cells. Exp. Neurol. 42, 307–319. doi: 10.1016/0014-4886(74)90028-4
Scorcioni, R., Polavaram, S., and Ascoli, G. (2008). L-Measure: a web-accessible tool for the analysis, comparison and search of digital reconstructions of neuronal morphologies. Nat. Protoc. 3, 866–876. doi: 10.1038/nprot.2008.51
Segato, A., Marzullo, A., Calimeri, F., and De Momi, E. (2020). Artificial intelligence for brain diseases: a systematic review. APL Bioeng. 4:041503.
Sellgren, C., Gracias, J., Watmuff, B., Biag, J., Thanos, J., Whittredge, P., et al. (2019). Increased synapse elimination by microglia in schizophrenia patient-derived models of synaptic pruning. Nat. Neurosci. 22, 374–385. doi: 10.1038/s41593-018-0334-7
Sethian, J. (1996). A fast marching level set method for monotonically advancing fronts. Proc. Natl. Acad. Sci. U S A. 93, 1591–1595. doi: 10.1073/pnas.93.4.1591
Shapleske, J., Rossell, S., Chitnis, X., Suckling, J., Simmons, A., Bullmore, E., et al. (2002). A computational morphometric MRI study of schizophrenia: effects of hallucinations. Cereb. Cortex 12, 1331–1341.
Shapson-Coe, A., Januszewski, M., Berger, D. R., Pope, A., Wu, Y., and Blakley, T. (2021). A connectomic study of a petascale fragment of human cerebral cortex. bioRxiv [Preprint]. Available Online at: https://doi.org/10.1101/2021.05.29.446289 (accessed January 1, 2024).
Sheffield, J., and Barch, D. (2016). Cognition and resting-state functional connectivity in schizophrenia. Neurosci. Biobehav. Rev. 61, 108–120.
Shenton, M., Hamoda, H., Schneiderman, J., Bouix, S., Pasternak, O., Rathi, Y., et al. (2012). A review of magnetic resonance imaging and diffusion tensor imaging findings in mild traumatic brain injury. Brain Imaging Behav. 6, 137–192.
Sheybani, L., Birot, G., Contestabile, A., Seeck, M., Kiss, J., Schaller, K., et al. (2018). Electrophysiological evidence for the development of a self-sustained large-scale epileptic network in the kainate mouse model of temporal lobe epilepsy. J. Neurosci. 38, 3776–3791. doi: 10.1523/JNEUROSCI.2193-17.2018
Shi, P., Huang, Y., and Hong, J. (2014). Automated three-dimensional reconstruction and morphological analysis of dendritic spines based on semi-supervised learning. Biomed. Opt. Express 5, 1541–1553. doi: 10.1364/BOE.5.001541
Shi, P., Zhou, X., Li, Q., Baron, M., Teylan, M., Kim, Y., et al. (2009). Online three-dimensional dendritic spines mophological classification based on semi-supervised learning. Proc. IEEE Int. Symp. Biomed Imaging 1019–1022. doi: 10.1109/ISBI.2009.5193228
Shih, C., Chen, N., Wang, T., He, G., Wang, G., Lin, Y., et al. (2021). NeuroRetriever: automatic neuron segmentation for connectome assembly. Front. Syst. Neurosci. 15:687182. doi: 10.3389/fnsys.2021.687182
Shukla, D., Wijtenburg, S., Chen, H., Chiappelli, J., Kochunov, P., Hong, L., et al. (2019). Anterior cingulate glutamate and GABA associations on functional connectivity in Schizophrenia. Schizophr. Bull. 45, 647–658.
Singh, P., Hernandez-Herrera, P., Labate, D., and Papadakis, M. (2017). Automated 3-D detection of dendritic spines from in vivo two-photon image stacks. Neuroinformatics 15, 303–319. doi: 10.1007/s12021-017-9332-2
Sisodiya, S., Whelan, C., Hatton, S., Huynh, K., Altmann, A., Ryten, M., et al. (2020). The ENIGMA-epilepsy working group: mapping disease from large data sets. Hum Brain Mapp. 43, 113–128. doi: 10.1002/hbm.25037
Sollee, J., Tang, L., Igiraneza, A., Xiao, B., Bai, H., and Yang, L. (2022). Artificial intelligence for medical image analysis in epilepsy. Epilepsy Res. 182:106861.
Spocter, M., Hopkins, W., Barks, S., Bianchi, S., Hehmeyer, A., Anderson, S., et al. (2012). Neuropil distribution in the cerebral cortex differs between humans and chimpanzees. J. Comp. Neurol. 520, 2917–2929.
Sporns, O., Tononi, G., and Kötter, R. (2005). The human connectome: a structural description of the human brain. PLoS Comput. Biol. 1:e42. doi: 10.1371/journal.pcbi.0010042
Spruston, N. (2008). Pyramidal neurons: dendritic structure and synaptic integration. Nat. Rev. Neurosci. 9, 206–221.
Squire, L., Stark, C., and Clark, R. (2004). The medial temporal lobe. Annu. Rev. Neurosci. 27, 279–306.
Stachowiak, E., Benson, C., Narla, S., Dimitri, A., Chuye, L., Dhiman, S., et al. (2017). Cerebral organoids reveal early cortical maldevelopment in schizophrenia-computational anatomy and genomics, role of FGFR1. Transl. Psychiatry 7:6. doi: 10.1038/s41398-017-0054-x
Stafstrom, C., and Carmant, L. (2015). Seizures and epilepsy: an overview for neuroscientists. Cold Spring Harb. Perspect. Med. 5:a022426.
Stephan, K., and Friston, K. (2010). Analyzing effective connectivity with functional magnetic resonance imaging. Wiley Interdiscip. Rev. Cogn. Sci. 1, 446–459.
Stouffer, M., Golden, J., and Francis, F. (2016). Neuronal migration disorders: focus on the cytoskeleton and epilepsy. Neurobiol. Dis. 92, 18–45.
Stringer, C., Wang, T., Michaelos, M., and Pachitariu, M. (2021). Cellpose: a generalist algorithm for cellular segmentation. Nat. Methods 18, 100–106. doi: 10.1038/s41592-020-01018-x
Subramanian, L., Calcagnotto, M., and Paredes, M. (2020). Cortical malformations: lessons in human brain development. Front. Cell Neurosci. 13:576. doi: 10.3389/fncel.2019.00576
Tan, Y., Liu, M., Chen, W., Wang, X., Peng, H., and Wang, Y. (2020). DeepBranch: deep neural networks for branch point detection in biomedical images. IEEE Trans. Med. Imaging 39, 1195–1205. doi: 10.1109/TMI.2019.2945980
Toda, M., and Abi-Dargham, A. (2007). Dopamine hypothesis of schizophrenia: making sense of it all. Curr. Psychiatry Rep. 9, 329–336. doi: 10.1007/s11920-007-0041-7
Tyson, A., and Margrie, T. (2022). Mesoscale microscopy and image analysis tools for understanding the brain. Prog. Biophys. Mol. Biol. 168, 81–93.
Udvary, D., Harth, P., Macke, J., Hege, H., de Kock, C., Sakmann, B., et al. (2022). The impact of neuron morphology on cortical network architecture. Cell Rep. 39:110677.
Uranova, N., Orlovskaya, D., Vikhreva, O., Zimina, I., Kolomeets, N., Vostrikov, V., et al. (2001). Electron microscopy of oligodendroglia in severe mental illness. Brain Res. Bull. 55, 597–610.
Vakharia, V., Sparks, R., Li, K., O’Keeffe, A., Pérez-García, F., França, L., et al. (2019). Multicenter validation of automated trajectories for selective laser amygdalohippocampectomy. Epilepsia 60, 1949–1959. doi: 10.1111/epi.16307
van Pelt, J., and van Ooyen, A. (2013). Estimating neuronal connectivity from axonal and dendritic density fields. Front. Comput. Neurosci. 7:160. doi: 10.3389/fncom.2013.00160
Verma, S., Goel, T., Tanveer, M., Ding, W., Sharma, R., and Murugan, R. (2023). Machine learning techniques for the Schizophrenia diagnosis: a comprehensive review and future research directions. J. Ambient Intelligence Humanized Comput. 14, 4795–4807.
Vicidomini, G., Bianchini, P., and Diaspro, A. (2018). STED super-resolved microscopy. Nat. Methods 15, 173–182.
Vidaurre-Gallart, I., Fernaud-Espinosa, I., Cosmin-Toader, N., Talavera-Martínez, L., Martin-Abadal, M., Benavides-Piccione, R., et al. (2022). A deep learning-based workflow for dendritic spine segmentation. Front. Neuroanat. 16:817903. doi: 10.3389/fnana.2022.817903
von Campe, G., Spencer, D., and de Lanerolle, N. (1997). Morphology of dentate granule cells in the human epileptogenic hippocampus. Hippocampus 7, 472–488.
Walsh, C., Tafforeau, P., Wagner, W., Jafree, D., Bellier, A., Werlein, C., et al. (2021). Imaging intact human organs with local resolution of cellular structures using hierarchical phase-contrast tomography. Nat. Methods 18, 1532–1541. doi: 10.1038/s41592-021-01317-x
Wang, H., Zhu, Q., Ding, L., Shen, Y., Yang, C., Xu, F., et al. (2019). Scalable volumetric imaging for ultrahigh-speed brain mapping at synaptic resolution. Natl. Sci. Rev. 6, 982–992. doi: 10.1093/nsr/nwz053
Wang, L., Ye, X., Ju, L., He, W., Zhang, D., Wang, X., et al. (2023). Medical matting: medical image segmentation with uncertainty from the matting perspective. Comput. Biol. Med. 158:106714. doi: 10.1016/j.compbiomed.2023.106714
Wang, R., Wang, J., Ding, J., and Zhang, S. (2014). “Automatic segmentation and quantitative analysis of gray matter on MR images of patients with epilepsy based on unsupervised learning methods,” in Trends and Applications in Knowledge Discovery and Data Mining. PAKDD 2014. Lecture Notes in Computer Science, eds W. Peng et al. (Cham: Springer), doi: 10.1007/978-3-319-13186-3_54
Wang, Y., Lang, R., Li, R., and Zhang, J. (2022) NRTR: Neuron Reconstruction with Transformer from 3D Optical Microscopy Images. Available online at: http://arxiv.org/abs/2212.04163 (accessed 21, June 2023).
Wang, Y., Wang, C., Ranefall, P., Broussard, G. J., Wang, Y., Shi, G., et al. (2020). SynQuant: An automatic tool to quantify synapses from microscopy images. Bioinformatics 36, 1599–1606. doi: 10.1093/bioinformatics/btz760
Website no date. Available online at: https://dl.acm.org/doi/pdf/10.5555/3454287.3454297 (accessed November 15, 2023).
Wei, X., Liu, Q., Liu, M., Wang, Y., and Meijering, E. (2023). 3D soma detection in large-scale whole brain images via a two-stage neural network. IEEE Trans. Med. Imaging 42, 148–157. doi: 10.1109/TMI.2022.3206605
Wei, Y., Scholtens, L., Turk, E., and van den Heuvel, M. (2019). Multiscale examination of cytoarchitectonic similarity and human brain connectivity. Netw. Neurosci. 3, 124–137. doi: 10.1162/netn_a_00057
Weis, M. A., Hansel, L., Luddecke, T., and Ecker, A. S. (2021). Self-supervised graph representation learning for neuronal morphologies. arXiv [Preprint]. Available online at: http://arxiv.org/abs/2112.12482 (accessed 10 October 2023).
Welvaert, M., and Rosseel, Y. (2013). On the definition of signal-to-noise ratio and contrast-to-noise ratio for FMRI data. PLoS One 8:e77089. doi: 10.1371/journal.pone.0077089
Whelan, C., Altmann, A., Botía, J., Jahanshad, N., Hibar, D., Absil, J., et al. (2018). Structural brain abnormalities in the common epilepsies assessed in a worldwide ENIGMA study. Brain 141, 391–408. doi: 10.1093/brain/awx341
Whitfield-Gabrieli, S., Thermenos, H., Milanovic, S., Tsuang, M., Faraone, S., McCarley, R., et al. (2009). Hyperactivity and hyperconnectivity of the default network in schizophrenia and in first-degree relatives of persons with schizophrenia. Proc. Natl. Acad. Sci. U S A. 106, 1279–1284. doi: 10.1073/pnas.0809141106
Winding, M., Pedigo, B., Barnes, C., Patsolic, H., Park, Y., Kazimiers, T., et al. (2023). The connectome of an insect brain. Science 379:eadd9330.
Wong, M., and Guo, D. (2013). Dendritic spine pathology in epilepsy: cause or consequence? Neuroscience 251, 141–150.
Wu, C., Lin, T., Chiou, G., Lee, C., Luan, H., Tsai, M., et al. (2021). A systematic review of MRI neuroimaging for education research. Front. Psychol. 12:617599. doi: 10.3389/fpsyg.2021.617599
Wu, X., Sosunov, A., Lado, W., Teoh, J., Ham, A., Li, H., et al. (2022). Synaptic hyperexcitability of cytomegalic pyramidal neurons contributes to epileptogenesis in tuberous sclerosis complex. Cell Rep. 40:111085. doi: 10.1016/j.celrep.2022.111085
Xiao, H., and Peng, H. (2013). APP2: automatic tracing of 3D neuron morphology based on hierarchical pruning of a gray-weighted image distance-tree. Bioinformatics 29, 1448–1454. doi: 10.1093/bioinformatics/btt170
Xu, F., Jin, C., Zuo, T., Wang, R., Yang, Y., and Wang, K. (2022). Segmental abnormalities of superior longitudinal fasciculus microstructure in patients with schizophrenia, bipolar disorder, and attention-deficit/hyperactivity disorder: an automated fiber quantification tractography study. Front. Psychiatry 13:999384. doi: 10.3389/fpsyt.2022.999384
Xu, Z., Lai, J., Zhang, H., Ng, C., Zhang, P., Xu, D., et al. (2019). Regional homogeneity and functional connectivity analysis of resting-state magnetic resonance in patients with bipolar II disorder. Medicine 98:e17962.
Yamashita, R., Nishio, M., Do, R., and Togashi, K. (2018). Convolutional neural networks: an overview and application in radiology. Insights Imaging 9, 611–629.
Yang, B., Chen, W., Luo, H., Tan, Y., Liu, M., and Wang, Y. (2021a). Neuron image segmentation via learning deep features and enhancing weak neuronal structures. IEEE J. Biomed. Health Informatics 25, 1634–1645. doi: 10.1109/JBHI.2020.3017540
Yang, B., Huang, J., Wu, G., and Yang, J. (2021b). Classifying the tracing difficulty of 3D neuron image blocks based on deep learning. Brain Inform. 8:25. doi: 10.1186/s40708-021-00146-0
You, Z., Balbastre, Y., Bouvier, C., Hérard, A., Gipchtein, P., Hantraye, P., et al. (2019). Automated individualization of size-varying and touching neurons in macaque cerebral microscopic images. Front. Neuroanat. 13:98. doi: 10.3389/fnana.2019.00098
Zhang, L., Wang, M., Liu, M., and Zhang, D. (2020). A survey on deep learning for neuroimaging-based brain disorder analysis. Front. Neurosci. 14:779. doi: 10.3389/fnins.2020.00779
Zhang, P., Lee, B., and Qiao, Y. (2023). ‘Experimental evaluation of the performance of Gpipe parallelism’. Future Generations Comput. Syst. 147, 107–118.
Zhang, Q., Liao, Y., Wang, X., Zhang, T., Feng, J., Deng, J., et al. (2021). A deep learning framework for 18F-FDG PET imaging diagnosis in pediatric patients with temporal lobe epilepsy. Eur. J. Nucl. Med. Mol. Imaging 48, 2476–2485. doi: 10.1007/s00259-020-05108-y
Zhang, Y., Chen, K., Baron, M., Teylan, M., Kim, Y., Song, Z., et al. (2010). A neurocomputational method for fully automated 3D dendritic spine detection and segmentation of medium-sized spiny neurons. Neuroimage 50, 1472–1484. doi: 10.1016/j.neuroimage.2010.01.048
Zhang, Z., Li, G., Xu, Y., and Tang, X. (2021). Application of artificial intelligence in the MRI classification task of human brain neurological and psychiatric diseases: a scoping review. Diagnostics 11:1402. doi: 10.3390/diagnostics11081402
Zhou, J., Cui, G., Hu, S., Zhang, Z., Yang, C., and Liu, Z. (2020). Graph neural networks: a review of methods and applications. AI Open 1, 57–81.
Zhou, Z., Sorensen, S. A., and Peng, H. (2015). “Neuron crawler: an automatic tracing algorithm for very large neuron images,” in Proceedings of the 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI), (Piscataway, NJ: IEEE).
Zhu, T., Yao, G., Hu, D., Xie, C., Li, P., Yang, X., et al. (2023). Data-driven morphological feature perception of single neuron with graph neural network. IEEE Trans. Med. Imaging 42, 3069–3079. doi: 10.1109/TMI.2023.3275209
Zolkefley, M., Firwana, Y., Hatta, H., Rowbin, C., Nassir, C., Hanafi, M., et al. (2021). An overview of fractional anisotropy as a reliable quantitative measurement for the corticospinal tract (CST) integrity in correlation with a Fugl-meyer assessment in stroke rehabilitation. J. Phys. Ther. Sci. 33, 75–83. doi: 10.1589/jpts.33.75
Glossary
Adaptive Boosting (AdaBoost): | is a meta-learning algorithm that combines weak learners, slightly outperforming random guessing, into a weighted sum during the training process (Schapire and Singer, 1999). |
3D neural organoids: | three-dimensional structures generated from stem cells that can mimic certain aspects of the developing human brain (Paşca et al., 2022). |
Calcium-modulated photoactivatable ratiometric integrator (CaMPARI): | a photoconvertible calcium indicator to investigate network dynamics. CaMPARI shifts from green to red fluorescence when exposed to calcium influx and violet light, allowing for precise identification of activated neuronal populations (Fosque et al., 2015). |
Confocal microscopy: | light microscopy technique that uses a laser to illuminate a single plane eliminating out-of-focus light to produce sharp, high-contrast images (Jonkman and Brown, 2015). |
Convolutional Neural Network (CNN): | neural network architecture for images that uses a hierarchical stack of convolutional layers to extract features (Yamashita et al., 2018). |
Covariance: | statistical tool used to understand the relationship between two variables. A positive covariance means both variables increase together, while a negative covariance suggests that they move in opposite directions (Koch et al., 1982). |
DAPI (4′,6-diamidino-2-phenylindole): | fluorescent probe that binds to the minor groove (A-T rich) of double-stranded DNA (Kapuscinski, 1995). |
Diffusion weighted image (DWI): | MRI technique that measures water diffusion in tissues. DWI images are used to diagnose and monitor a variety of neurological disorders (Baliyan et al., 2016). |
Diffusion MRI tractography: | allow assessing the topological organization of brain networks (Jeurissen et al., 2019). |
Diffusion Tensor Imaging (DTI): | MRI-based technique that measures the diffusion of water molecules within the brain. DTI and tractography are employed to visualize and map the pathways of nerve fiber bundles and the white matter tracts (Alexander et al., 2007). |
Dijkstra algorithm: | greedy graph algorithm for finding the shortest path from a single source node to all other nodes in a weighted graph (Dijkstra, 1959). |
Effective connectivity: | the causal interactions among neural elements within a neural system aiming to identify their intricate interrelation (Stephan and Friston, 2010). |
Electron microscopy (EM): | technique that uses electron beams instead of visible light to achieve much higher resolution in imaging (Hayes and Pease, 1968). |
Epileptogenic zone: | macroscopic/microscopic brain lesion responsible for the generation of seizures (Jehi, 2018). |
Fast Marching Method (FMM): | numerical method for finding the global minimum of an energy function (Sethian, 1996). |
Fields Of View (FOV): | in optical instruments is the angle at the camera’s vertex, created by the two edges that represent the maximum range within which the measured target’s object can traverse (Gao S. et al., 2022). |
Filament tracing: | bioimaging technique used to reconstruct the three-dimensional (3D) morphology of neuronal filaments, such as axons and dendrites (Østerlund et al., 2022). |
Fractional Anisotropy (FA): | metric in diffusion imaging that measures the directionality and integrity of water diffusion in tissues. Higher FA values indicate healthy white matter, while lower values suggest disruption or damage (Zolkefley et al., 2021). |
Functional connectivity: | measurement of the synchronization of neural activity between different brain regions (Biswal et al., 1995). |
GABA: | main inhibitory neurotransmitter in the brain, reduces neuronal excitability by binding to GABA receptors on neurons (Möhler, 2012). |
Genetically Encoded Calcium Indicator (GECI): | a molecular probe designed to monitor intracellular calcium ion (Ca^2+) levels within living cells (Oh et al., 2019). |
Generative Adversarial Networks (GAN): | type of deep learning model consisting of two neural networks, a generator and a discriminator, trained in a competitive manner to generate realistic data (Goodfellow et al., 2014). |
Graph: | data structure composed of nodes or vertices connected by edges or links, representing their relationships (Zhou et al., 2020). |
Hippocampus: | region of the brain located in the medial temporal lobe and involved in processes related to memories (Squire et al., 2004). |
Ictal event: | seizure caused by abnormal electrical activity in the brain (Fisher et al., 2014). |
K-Means clustering: | unsupervised learning technique that subdivides data into groups based on their characteristics. This algorithm operates by placing so-called centroids within the data’s vector space, and data points are classified by the centroid closest to them (Jin and Han, 2011). |
L-measure: | software tool for quantifying the morphology of neurons (Scorcioni et al., 2008). |
Light sheet microscopy or Selective Plane Illumination Microscopy (SPIM): | imaging technique that uses a thin sheet of laser light to illuminate a specimen from the side, minimizing photodamage and allowing for fast 3D imaging (Hillman et al., 2019). |
Magnetic resonance imaging (MRI): | non-invasive, non-ionizing, quantitative, and multi-parametric imaging technique (Liu et al., 2021). It includes functional MRI (fMRI) and structural MRI (sMRI) (Shenton et al., 2012; Wu et al., 2021). |
MCC-Net: | deep learning model for medical image segmentation that learns robust features at different scales of the image using contrastive learning (Wei et al., 2023). |
Microtubules: | tube-like structures that provide structural support and facilitate intracellular transport (Desai and Mitchison, 1997). |
Mossy fiber: | excitatory axons that project to and modulate hippocampal activity for spatial memory formation and consolidation (Henze et al., 2000). |
MRI-T1: | type of MRI scan that produces images with high contrast between water and fat (Chen et al., 2018). |
Neuropil: | defined as the space between neuronal and glial cell bodies that is composed of dendrites, axons, synapses, glial cell processes, and microvasculature (Spocter et al., 2012). |
Point spread function (PSF) deconvolution: | method that attempts to correct the optical distortion. It serves as a mathematical representation of the blurring effect that occurs when a point source of light is recorded by an optical system (Corle and Kino, 1996). |
Positron emission tomography (PET): | medical imaging technique that uses small amounts of radioactive tracers to visualize and measure physiological processes in the body (Phelps, 2000). |
Principal Component Analysis (PCA): | statistical method for reducing the dimensionality of data while preserving as much of the variation in the data as possible (Jolliffe, 2002). |
Pyramidal neurons: | Neurons exhibit a distinctive cellular structure, featuring apical and basal dendritic trees, as well as a pyramidal-shaped soma (Spruston, 2008). |
RandomForest: | machine learning algorithm used for classification and regression, where the result is generated from the combination of multiple decision trees. Each decision tree is an independent model that divides the data into subsets based on a sequence of rules for data features (Belgiu and Drăguţ, 2016). |
Regional homogeneity (ReHo): | concept and analysis technique to measure the similarity or coherence of the blood oxygen level-dependent (BOLD) signal within a specific brain region or voxel (Xu et al., 2019). |
Region of interest (ROI): | significant portion of an image to be focused on or analyzed (Poldrack, 2007). |
Residual Network (ResNet): | neural network architecture designed to address the vanishing gradient problem in very deep convolutional neural networks. It introduces skip connections, which allow gradients to flow more easily during training, improving the training of deeper networks in tasks like image recognition (He et al., 2015). |
Resting state: | state in which a person is awake and alert but not actively engaged in a specific task or mental activity, also known as a baseline functional connectivity, when the brain continues to exhibit spontaneous neural activity (Biswal et al., 1995). |
Serial section electron microscopy: | EM technique that sections and images a specimen to create 3D models of its internal structures, aiding in mapping neuronal connections within the brain (Gay and Anderson, 1954; Motta et al., 2019). |
Sholl descriptors: | rule that links each neuron to a specific feature, associating neuron morphology with a function that produces numeric values in a metric space (Khalil et al., 2021). |
Signal-to-Noise Ratio (SNR): | measure used to quantify the quality or strength of a signal in relation to the level of background noise or interference. A higher SNR indicates a more reliable and discernible signal compared to unwanted or random variations (noise) (Welvaert and Rosseel, 2013). |
Single-photon emission computed tomography (SPECT): | nuclear medicine imaging technique that uses gamma-ray-emitting radiotracers to create 3D images of the distribution of radioactive compounds within the body (Devous, 1995). |
Stimulated Emission Depletion (STED): | super-resolution microscopy technique that uses a combination of laser beams to overcome the diffraction limit, achieving extremely high spatial resolution in imaging (Vicidomini et al., 2018). |
Structural connectivity: | Anatomical connections between different brain regions. It represents the physical pathways formed by bundles of nerve fibers (axons) that connect neurons in one part of the brain to neurons in another part (Hagmann et al., 2008). |
Support Vector Machines (SVM): | supervised machine learning algorithm used for classification operates by identifying a hyperplane that separates different classes with a larger margin (Cristianini and Ricci, 2008). |
Synchrotron x-ray microtomography: | non-destructive image technique that uses intense x-ray beams generated by a synchrotron particle accelerator to create high-resolution, 3D images of the internal structures of biological specimens (Betz et al., 2007). |
Synthetic data: | artificially generated data used for various purposes, including training machine learning models (Rajotte et al., 2022). |
Two-photon microscopy: | microscopy technique able to image a cm-thick biological specimen to create 3D images of its internal structures, aiding in mapping neuronal connections within the brain (Denk et al., 1990). |
UNet: | Architecture employed for image segmentation. Uses convolutional layers for feature extraction and employs upsampling and transposed convolutional layers to create a segmentation mask (Ronneberger et al., 2015). |
Voxel: | three-dimensional pixel, which is the smallest unit of a 3D space in a digital image or a 3D dataset (Foley, 1990). |
Vision Transformers (ViT): | neural network architectures that utilize attention mechanisms to transform image patches into embedded representations, replacing traditional convolutional layers in computer vision tasks (Khan et al., 2022). |
XGBoost (eXtreme Gradient Boosting): | an optimized version of the Gradient Boosting algorithm for classification and regression problems (Mason, no date). |
Watershed: | image segmentation and instance labeling algorithm. It starts by dropping seeds to mark different regions, then these labeled seeds expand and delimitate the image into different areas, helping to identify individual instances in the image (Najman and Schmitt, 1994). |
Keywords: connectivity, mesoscale, NeuroImage, schizophrenia, epilepsy, computer vision, segmentation, deep learning
Citation: Caznok Silveira AC, Antunes ASLM, Athié MCP, da Silva BF, Ribeiro dos Santos JV, Canateli C, Fontoura MA, Pinto A, Pimentel-Silva LR, Avansini SH and de Carvalho M (2024) Between neurons and networks: investigating mesoscale brain connectivity in neurological and psychiatric disorders. Front. Neurosci. 18:1340345. doi: 10.3389/fnins.2024.1340345
Received: 17 November 2023; Accepted: 29 January 2024;
Published: 20 February 2024.
Edited by:
Xi-Nian Zuo, Beijing Normal University, ChinaReviewed by:
James Mac Shine, The University of Sydney, AustraliaAniruddha Das, Cleveland Clinic, United States
Copyright © 2024 Caznok Silveira, Antunes, Athié, da Silva, Ribeiro dos Santos, Canateli, Fontoura, Pinto, Pimentel-Silva, Avansini and de Carvalho. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Simoni Helena Avansini, c2ltb25pLmF2YW5zaW5pQGxuYmlvLmNucGVtLmJy
†These authors have contributed equally to this work and share last authorship