Measuring catatonia motor behavior with objective instrumentation

Objective: Catatonia is a neuropsychiatric syndrome, with important psychomotor features, associated with schizophrenia and other psychiatric disorders. The syndrome comprises multiple symptoms including abnormal motor control, behaviors, volition, and autonomic regulation. Catatonia assessment relies on clinical rating scales and clinicians familiar with the catatonia exam. However, objective instrumentation may aid the detection of catatonia. We aimed to investigate the relationship between movement parameters derived from actigraphy and expert ratings of catatonia symptoms measured by the Bush Francis Catatonia Rating Scale (BFCRS) and the Northoff Catatonia scale (NCS).

Methods: Eighty-six acutely ill inpatients with schizophrenia spectrum disorders were assessed with the BFCRS, the NCS, and 24 h continuous actigraphy. Non-wear and sleep periods were removed from the actigraphy data prior to analysis. Associations between total catatonia scores, derived from both BFCRS and NCS, and actigraphy parameters as well as between single BFCRS items and actigraphy parameters were calculated using Spearman's rank correlation and non-parametric ANCOVAs (Quade's ANCOVAs), respectively.

Results: Both higher BFCRS total scores (r = 0.369, p = 0.006) and NCS total scores (r = 0.384, p = 0.004) were associated with lower activity levels (AL). Higher scores on single BFCRS items such as immobility/stupor or staring were linked to lower AL (immobility/stupor: F = 17.388, p < 0.001, η² = 0.175; staring: F = 7.849, p = 0.001, η² = 0.162) and lower metabolic equivalents of task (MET).

Conclusion: Specific catatonia symptoms such as immobility/stupor and staring can be measured with actigraphy. This may aid the detection, staging, and monitoring of catatonia in clinical settings.

Introduction

Catatonia is a complex neuropsychiatric syndrome that involves psychomotor abnormalities. Symptoms include increased or decreased gross motor activity, abnormal motor control, behavior, volition, and autonomic regulation (1–3). First described in 1874 by Karl Kahlbaum, for decades catatonia was exclusively considered as a subtype of schizophrenia, despite conflicting evidence (4). The Diagnostic and Statistical Manual of Mental Disorders 5 (DSM-5) has revised the classification of catatonia and now enables diagnosing catatonia as an independent syndrome or as specifier to multiple conditions (5, 6). This was a very important classification change, since catatonia is not only observed in schizophrenia spectrum disorders but also in mood disorders, autism, dementia, intoxications, and general medical conditions (3, 5–9). Catatonia is quite frequent in samples of mixed acute psychiatric inpatients with a prevalence of 9% (10) and an incidence of 10.6 episodes per 100,000 person-years (11).

Catatonia can either present as an acute episode or persist in chronic forms (12). In case of an acute episode effective treatment is possible with lorazepam and electroconvulsive therapy (ECT) (8, 13, 14). In chronic catatonia treatment is more difficult due to persistent symptoms of unknown etiology and the lack of response to benzodiazepines (15, 16). Despite current treatment options, catatonia is still associated with increased mortality (mortality rate of 9%), especially if catatonia is not diagnosed correctly (11, 17, 18). Therefore, early diagnosis of catatonia is crucial in order to prevent morbidity and mortality. However, the diagnosis of catatonia remains challenging and clinicians are likely to neglect catatonia symptoms (19–21).

Varying definitions of the syndrome and insufficient training have rendered diagnosing catatonia difficult (1, 6, 21, 22). Indeed, more than 40 different symptoms have been described in the context of catatonia (1, 17, 22). In clinical practice catatonia is either diagnosed by referring to the DSM-5 diagnostic criteria or by applying clinical rating scales such as the Bush Francis Catatonia Rating Scale (BFCRS) (23) or the Northoff Catatonia Scale (NCS) (24). Depending on the diagnostic tool used, a different set of catatonia symptoms with distinct total scores as well as different diagnostic criteria and cut-off scores is included. Furthermore, symptom patterns of catatonia may fluctuate over time, resulting in periods characterized by either excitement or withdrawal in the same patient (6). In addition, not only can catatonia symptoms fluctuate as a result of the underlying mental disorder, but symptoms might also be influenced or induced by antipsychotic medication (25–27). Since catatonia assessments with either the DSM-5 criteria or clinical rating scales typically focus on a single time point, they might fall short detecting the syndrome. Undetected fluctuations or assessments at less optimal time points increase the risk of missing or underestimating the severity of catatonia (28). Finally, the clinical examination informs the clinical rating scale scoring or DSM checklists, but examination is subject to observation bias (29) and depends on the level of training (21, 28).

Instrumental measures have the potential to overcome diagnostic challenges of psychomotor abnormalities such as catatonia. Compared to clinical assessments, instrumental measures lack observer bias, require little training, and offer continuous long-term assessments. Furthermore, instrumental measures are highly reliable and sensitive, even in detecting subclinical motor abnormalities (28). Wrist actigraphy is a simple instrumental method to measure general physical activity across settings (28, 30). Moreover, wrist actigraphy enables the simultaneous measurement of different parameters reflecting physical activity (31). Multiple studies have demonstrated the use of wrist actigraphy in schizophrenia. For example, wrist actigraphy measures were associated with motor abnormalities such as antipsychotic induced akathisia or parkinsonism (32, 33) and psychopathological dimensions of schizophrenia (30, 31, 34). Furthermore, wrist actigraphy has been applied to study catatonia. In this context, wrist actigraphy indicated patients with the catatonic subtype of schizophrenia according to DSM-IV to have lower activity levels and longer periods of immobility compared to patients of the paranoid or disorganized subtype (35). In addition, increased catatonia severity, as measured by the BFCRS total score, was associated with lower activity levels (AL) (36).

Given that catatonia alters motor behavior in multiple ways, other actigraphy parameters such as the number of steps or metabolic parameters should be explored in relation to catatonia severity. Indeed, modern actigraphy technology offers more than one meaningful measure of physical activity, extending the possibilities of instrumental assessment of motor abnormalities in mental illness (27, 36, 37, 73). However, these associations have not been investigated so far. Likewise, the relationship between catatonia severity as measured by catatonia rating scales other than the BFCRS and actigraphy parameters remains unknown. Most research focuses on motor and volitional symptoms of catatonia (2), neglecting affective symptoms. Similarly, most clinical rating scales, including the BFCRS, focus on motor and behavioral symptoms of catatonia, again neglecting potential affective symptoms (38). Even though the NCS also includes affective symptoms, its association with measures of physical activity has not been investigated yet. Finally, catatonia is characterized by different and sometimes opposing symptom patterns (6, 9, 23), but currently it remains unclear which catatonia symptoms are measurable with actigraphy.

We aimed to investigate the association between the severity of catatonia indicated by the BFCRS as well as by the NCS and physical activity measured by actigraphy. We hypothesize that lower physical activity will be observed in cases of more severe catatonia. Furthermore, we aimed to examine the relationship between NCS motor, affective as well as behavioral subscores and physical activity measured through actigraphy. Here, we hypothesize that we will find the strongest association between the motor subscore and physical activity. Finally, we aimed to investigate whether the expected correlations between BFCRS total score and actigraphy parameters are specific to single items of the BFCRS. Again, we hypothesize that this might mainly be the case for core motor behavioral items.

Materials and methods

Participants

Eighty-six acutely ill patients with schizophrenia spectrum disorders according to the DSM-5 were recruited at the University Hospital of Psychiatry and Psychotherapy in Bern, Switzerland. All data included in this study are baseline data of an ongoing clinical trial named Overcoming Psychomotor Slowing in Psychosis (OCoPS-P, ClinicalTrials.gov Identifier: NCT03921450, funded by the Swiss National Science Foundation grant 182469). This trial is conducted according to the declaration of Helsinki and was approved by the local ethics committee (file 2018-02164). All participants provided written informed consent to participate in the whole clinical trial. Table 1 provides demographic and clinical characteristics of the patient sample. Exclusion criteria were active substance abuse or dependence other than nicotine, medical or neurological disorders affecting motor abilities, e.g., epilepsy, or past severe head trauma with temporary loss of consciousness.

TABLE 1

Table 1. Demographic and clinical characteristics.

All but 2 patients received antipsychotic treatment during data acquisition. Mean olanzapine equivalents (OLZ eq.) were calculated according to Gardner and Leucht (39–42).

Assessments

Assessment of catatonia

Catatonia severity was assessed with the Bush Francis Catatonia Rating Scale (BFCRS) and the Northoff Catatonia scale (NCS). Both scales were rated consecutively by a single well-trained expert, i.e., advanced psychiatric residents (DA, DBG, AK). All raters were trained by the principal investigator to achieve optimal interrater reliability on the item levels (kappa > 0.8). The BFCRS consists of 23 items. Items 13 and 17–21 are rated as either absent or present with a score of 0 or 3, respectively. All other items are rated according to their severity on a scale from 0 to 3. On this scale 0 indicates absence, 1 occasional presence, 2 frequent presence, and 3 constant presence of the respective symptom. The BFCRS total score ranges from 0 to 69. The first 14 items of the BFCRS form the Bush Francis Catatonia Screening Instrument (BFCSI). The BFCSI is used to assess the presence or absence of catatonia. If two or more items on the BFCSI are rated as present irrespective of their severity, catatonia is diagnosed. The NCS consists of 40 items assessing catatonia symptoms in the motor (13 items), affective (12 items), and behavioral (15 items) domains. Catatonia is diagnosed if the NCS total score is >7 and a minimum of one symptom per domain (motor, affective, behavioral) irrespective of its severity is present. The items are rated on a scale from 0 to 2. On this scale 0 indicates absence, 1 the item is sometimes present, and 2 the item is always present. The total score of the NCS ranges from 0 to 80. Total subscores range from 0 to 26 for motor, 0 to 24 for affective, and 0 to 30 for behavioral catatonic symptoms.

Actigraphy

Actigraphy enables measuring multiple parameters related to physical activity. Activity level (AL), movement index (MI), and mean duration of uninterrupted immobility periods (MIP) are well-known actigraphy parameters based on activity counts derived from one axis of the acceleration signal (43). AL is the mean number of activity counts per hour. MI is the percentage of epochs with an activity count >0. MIP describes the amount and distribution of immobility epochs, i.e., epochs with an activity count of 0. Similar to AL, the number of steps indicates the total amount of physical activity, whereas similar to MI, the activity class (AC) indicates the total duration of active time. AC active refers to the percentage of time spent either walking or jogging and AC inactive refers to the percentage of waking time spent sedentary. However, contrary to MI, AC is based on different acceleration features and barometric air pressure (44). In addition, the actigraphy data provides information on metabolic parameters such as the intensity of physical activity based on metabolic equivalent of task (MET) classes and energy expenditure in general. MET is defined as the ratio between the amount of oxygen used by a person during physical activity in milliliters (mL) per kilogram of body mass and the reference value of 3.5 mL, which is equivalent to the assumed sedentary energy expenditure (45). MET <3 refers to light, whereas MET 3-6 refers to moderate, and MET >6 refers to vigorous physical activity (LPA, MPA, and VPA, respectively) (46). Resting energy expenditure (REE) refers to the energy used by a person when being completely sedentary. Active energy expenditure (AEE) refers to the energy used by a person when being physically active, i.e., everything requiring a MET >1. Total energy expenditure (TEE) is the sum of REE and AEE (47).

Patients wore a Move 4 actigraph (movisens GmbH; Karlsruhe, Germany) on the wrist of their non-dominant hand for 24 consecutive hours. The accelerometer produces voltage, whenever the device is moved in any direction (43). In order to determine the dominant hand, patients were assessed with the Edinburgh Handedness Inventory (48). Wearing the actigraph on the wrist of the non-dominant hand enables measuring general physical activity irrespective of manual work (43, 49).

Data analysis

The actigraphy data were extracted using the movisens DataAnalyzer program with the modules Base, Physical Activity Metrics, and Energy Expenditure. The Base module enables the extraction of the step count and AC. The module Physical Activity Metrics allows for the extraction of the activity counts per minute needed for the calculation of AL, MI, and MIP. Finally, the Energy Expenditure module is used for the extraction of different MET classes and energy expenditure measures. All data were stored in 1 min epochs. Non-wear time (automatically flagged by the extraction software) during the 24 h data acquisition was removed prior to further analysis. Sixty-one patients (70.9%) wore the actigraph for more than 23 h. Non-wear time was mainly due to showering or bathing. All values obtained in minutes were then calculated as percentage of total wear time of the respective patient. In addition, sleep time was removed from the data for parameters specific to wake time [steps, AL, movement index (MI), mean duration of uninterrupted immobility periods (MIP), activity class (AC)]. Sleep time (including naps) was identified by considering sleep log information provided by the patients and visually inspecting the actograms for any inconsistencies. If the sleep periods visible in the actogram failed to match the sleep periods indicated by the participant in the sleep record, the sleep time was adjusted accordingly. Inactive periods during the day were not considered as sleep time unless information about a nap was provided by the participant. The data were then transferred to our own Excel^® templates (31, 50) for further analysis.

Statistical analysis was conducted using IBM SPSS version 27. Apart from the following exceptions the data were complete for all participants: For one patient the single item rating of immobility/stupor and staring was not collected. For a second patient it was not possible to distinguish wake and sleep periods and no sleep record was available. Therefore, the parameters, AL, MI, MIP, steps, and AC could not be calculated. Finally, for a third patient AEE and therefore TEE could not be extracted correctly from the actigraphy data. Patients with missing data were excluded list wise from the respective analysis. Shapiro-Wilk tests showed that none of the data were normally distributed. We calculated Spearman's rank correlation controlling for age, OLZ eq., and body mass index (BMI) between actigraphy parameters and BFCRS as well as NCS total and subscores. Correlations were corrected for multiple comparisons using the false discovery rate (FDR). The parameters age, OLZ eq., and BMI were selected as covariates because they are known to influence physical activity in patients with severe mental illnesses (36). We further calculated non-parametric ANCOVAs (Quade's ANCOVAs) comparing actigraphy parameters between rating scores of severity (either 0, 1, 2, or 3) on all single items of the BFCRS, whilst controlling for age, OLZ eq., and BMI. In case of more than 2 groups/scores the Bonferroni method was used as a post-hoc test to correct for multiple comparisons. If <3 patients had the same rating on one item (see Table 2A for frequencies of BFCRS items), the comparison was considered to provide insufficient information and therefore the ratings of n <3 were not included in the post-hoc tests.

TABLE 2

Table 2. Frequencies of catatonia signs.

Results

Eighteen patients (15.5%) met criteria for catatonia according to DSM-5. According to the BFCSI 50 patients (58.1%) and according to the NCS 39 patients (45.3 %) of our sample could be diagnosed with catatonia syndrome. A total of 37 patients (43.0 %) could be diagnosed with catatonia syndrome by both the BFCSI and the NCS. Table 2 gives the frequencies of catatonia symptoms per scale. Most frequent items were rigidity, staring, and grimacing on the BFCRS and flat affect (affective domain), autism/withdrawal (behavioral domain), and rigidity (motor domain) on the NCS.

Catatonia rating scales total scores

The BFCRS total score and the NCS total score correlated with each other (r = 0.815, p < 0.001). In addition, the BFCRS total score correlated with NCS subscores (motor domain: r = 0.705, p < 0.001; affective domain: r = 0.589, p < 0.001; behavioral domain: r = 0.647, p < 0.001). BFCRS and NCS total scores as well as the NCS behavioral subscore further correlated with AL, MI, steps (Figure 1 for BFCRS total score), AC, and multiple MET classes. In addition, the BFCRS total score further correlated with AEE and TEE. Whereas, the NCS affective subscore only correlated with AL, the NCS motor subscore failed to correlate with any of the physical or metabolic parameters (Table 3).

FIGURE 1

Figure 1. Association between Steps/h (steps per hour) and Bush Francis catatonia Rating Scale (BFCRS) total scores controlling for age, medication (olanzapine equivalents), and body mass index (BMI).

TABLE 3

Table 3. Catatonia total and subscore correlations with actigraphy parameters controlling for age, medication (OLZ eq.), and body mass index (BMI).

Catatonia rating scales single item scores

Results of the relationship between single items of the BFCRS and actigraphy parameters are displayed in Table 4. The items immobility/stupor and staring showed the most impressive relationship between their different severity ratings and actigraphy parameters. Comparison of absence (rating 0) and occasional presence (rating 1) of immobility/stupor showed a significant difference in all actigraphy parameters, except for REE. Examples for group differences in AL, AEE, MI, and AC are displayed in Figure 2. For different ratings of the item staring all actigraphy parameters, except MIP, REE, and TEE differed between groups. A post-hoc test revealed that for most actigraphy parameters significant differences in the rating of the item staring are present between absent and frequent staring but not between absent and occasional or occasional and frequent staring (AL: p = 0.001; MI: p = 0.011; steps: p = 0.025; MPA: p = 0.005; VPA: p = 0.027; AEE: p = 0.031). However, for LPA a post-hoc tests revealed that significant group differences are not only present between absent and frequent staring (p = 0.005) but also between occasional and frequent staring (p = 0.045). Even though there was no significant difference between the groups for immobility/stupor and staring when analyzing REE, we could detect a significant group difference for the single items stereotypy (F = 10.994, p = 0.001, η² = 0.120 when only comparing absence and occasional presence), rigidity (no longer significant after post-hoc test), and Mitgehen. The latter also showed significant group differences for TEE. Finally, we detected significant group differences between absence and presence of ambitendency for all MET classes.

TABLE 4

Table 4. Relationship between single BFCRS item ratings and physical or metabolic parameters controlling for age, medication (OLZ eq.), and body mass index (BMI).

FIGURE 2

Figure 2. Group differences in AL/h (A), AEE (B), MI (C), and AC: inactive (D) between absence (rating 0) and occasional presence (rating 1) of the item immobility/stupor. **Denotes significant correlation p < 0.01. AL/h, activity level per hour; AEE, active energy expenditure; MI, motor index; AC, activity class.

Discussion

Catatonia remains a complex syndrome, challenging clinicians during detection and monitoring. Instrumental motor assessments such as actigraphy bear the potential to reduce complexity and add confidence in the clinical setting. This study aimed to test the correspondence of multiple actigraphy measures with two catatonia rating scales. In line with our hypothesis catatonia measured by both the BFCRS and the NCS is associated with instrumental measures of physical activity. Likewise, the NCS behavioral subscore correlated with different physical and metabolic parameters. Contrary to our hypothesis, the NCS motor subscore failed to correlate with any of the actigraphy measures, whereas the NCS affective subscore only correlated with the AL. On a single item level, actigraphy parameters differed most impressively between severity ratings of BFCRS items immobility/stupor and staring, indicating superior external validity of these items.

Correlations between catatonia severity and the amount of physical activity corroborate the only other study showing an association between a higher BFCRS total score and a lower AL in a different sample with a different actigraphy instrument than the current one (36). Additionally, our findings extend previous knowledge by considering novel parameters reflecting physical activity and examining both the BFCRS and the NCS. Differences in the definition and selection of catatonia symptoms are most likely the reasons why the BFCRS but not the NCS total score correlated with energy expenditure measures. Compared to the BFCRS items some of the NCS items are defined differently. For example, in the BCRS immobility/stupor is defined as extreme hypoactivity starting with a rating of 1 when patients sit abnormally still, whereas in the NCS stupor is defined as akinesia lasting for at least 30 min. Furthermore, compared to the BFCRS the NCS comprises more non-motor catatonia symptoms, e.g., affective symptoms (24). Indeed, not all catatonia symptom domains appear to be similarly measurable with actigraphy. Whereas, the NCS behavioral subscore correlated with parameters indicating the amount, duration, and intensity of physical activity, the NCS affective subscore only correlated with AL. Moreover, the NCS motor subscore failed to correlate with any of the actigraphy measures. It is important to note that some items of the NCS motor domain cover motor behaviors that are unlikely to alter total motor activity, e.g., muscular hypotonus, sudden changes of muscular tone, athetotic movements or festination. Thus, the selection of the NCS motor domain items might render associations with actigraphy measures difficult. Likewise, a study investigating the relationship between actigraphy parameters (AL, MI, MIP) and Positive and Negative Syndrome Scale (PANSS) scores did not detect any significant correlations between the PANSS motor retardation items and physical activity. Similarly, PANSS motor retardation items cover multiple issues including the speed of thoughts and speech and therefore extend core motor behavior (31). In line with our hypothesis the motor symptom immobility/stupor showed group differences in most actigraphy parameters, including the MIP. In fact, increased MIP, i.e., longer duration of immobility, has been proposed as a specific feature of catatonia in categorical comparisons (35). However, no correlation was found for MIP and subscores or total scores of catatonia rating scales, arguing for the analysis of single rating scale items or behaviors when investigating the pathophysiology of catatonia (2, 28). Regarding the single item staring the fact that group differences were only observed between absent and frequent staring implies that this symptom needs to be present at a more severe level in order to be measurable with actigraphy. Nonetheless, both immobility/stupor and staring were among the most frequent catatonia symptoms not only in our sample but also in a larger mixed clinical sample (51). Therefore, both single items should be taken into account in future investigations of the relationship between catatonia and physical activity.

Lower physical activity in schizophrenia patients with catatonia has been attributed to decreased motor output resulting from functional and structural abnormalities in the motor circuitry (6, 38, 50–59). Findings indicate that key parts of the motor circuit are also critically altered in catatonia, rendering the system less flexible for environmental adaptation. Furthermore, sedentary behavior might induce deterioration of the already decreased motor output due to lack of training (36). Indeed, a beneficial effect of exercise in chronic catatonia has been proposed anecdotally (15). Furthermore, motor abnormalities in catatonia comprise both hypokinetic and hyperkinetic movements, suggesting a dysfunction in multiple motor circuits (6). Moreover, as actigraphy provides a direct measure of motor behavior, it may critically inform studies on the neural correlates of motor abnormalities as demonstrated previously by our group and others (37, 50, 52, 53, 56, 60, 61). However, most research, including neuroimaging studies, focuses on motor and volitional symptoms of catatonia (2). Interestingly, studies relying on motor/behavioral rating scales such as the BFCRS show aberrant functioning of a core motor circuit including cortical and subcortical areas mediated by dopamine. In contrast, studies relying on the NCS show aberrant functioning in higher-order frontoparietal networks mediated by gamma-aminobutyric acid (GABA) and glutamate (38). This again underlines the importance of analyzing the heterogeneous catatonia symptoms separately in order to elucidate the underlying pathophysiology of catatonia behaviors.

Despite rich literature on actigraphy in the assessment of sleep or sleep-wake patterns and circadian rhythms (62), data on actigraphy measures in motor and psychomotor disorders is still limited. However, measuring catatonia symptoms with actigraphy might aid the detection and staging of catatonia in clinical settings. In schizophrenia, associations between physical activity and negative syndrome (30, 31, 63), dosage of antipsychotic medication (64), and the development of motor activity over the course of schizophrenia (65) have been investigated. Besides catatonia, actigraphy has been implemented in the investigation of other motor abnormalities such as (antipsychotic-induced) akathisia (32, 66), parkinsonism (36, 66), dystonia (66), and restless legs syndrome (67). Furthermore, psychomotor behaviors in other mental disorders such as major depressive disorder (MDD) have been investigated using actigraphy (68–70).

The strengths of the study include objective assessments of physical activity represented by multiple parameters and clinical assessments of catatonia with different rating scales. Furthermore, all results were controlled for medication (OLZ eq.), age, and BMI, all potential confounders of physical activity (36, 64). This study is limited by the moderate sample size, cross-sectional assessments, focus on schizophrenia spectrum disorders, and inclusion of a small number of severe catatonia cases. Specifically, since our data is derived from a randomized controlled trial on psychomotor slowing, all patients included consented to participating in a clinical trial, which is less likely than participation in our previous observational studies in catatonia (35, 36, 55–57). Therefore, generalization of our findings to all catatonia patients might be limited due to potential selection bias. Even though a large proportion of our patients already displayed reduced movement due to psychomotor slowing, associations between catatonia and physical activity were still present. This suggests that in samples of patients without psychomotor slowing associations between catatonia and physical activity might become even more prominent. On the other hand, the generalization of our findings might be also limited due to our sample comprising mostly patients with psychomotor slowing. Moreover, the observed associations between catatonia symptoms and physical activity mainly apply to hypokinetic forms of catatonia and require further testing in hyperkinetic catatonia. Finally, our data did not allow for the distinction between genuine and drug-related catatonia, and we were unable to investigate potential confounding effects on catatonia symptoms caused by other drug-related motor abnormalities such as parkinsonism. Future studies testing the application of actigraphy for screening and staging of catatonia should include catatonia patients with multiple underlying conditions and investigate different forms of catatonia. In addition, long-term assessments covering multiple days are needed to address the issue of fluctuating symptoms in catatonia (6). Finally, disease mechanisms of reduced physical activity in catatonia might be elucidated using brain stimulation and other interventional studies, e.g., combining physical exercise and neuroimaging (71, 72).

Conclusion

The severity of hypokinetic catatonia is associated with a decreased amount, duration, and intensity of physical activity as well as a decreased energy expenditure. Multiple actigraphy parameters offer important insights. Furthermore, our results suggest that actigraphy may capture specific symptoms better than composite scores of multiple items. Whereas, both BFCRS and NCS total scores were linked to physical activity, the optimal actigraphy parameters to monitor catatonia are yet to be determined. In the future, measuring catatonia symptoms with actigraphy may aid the detection and staging of catatonia in clinical settings as well as the monitoring of treatment effects in clinical trials.

Data availability statement

The datasets presented in this article are not readily available because not all participants of the studies consented to data sharing. As these are personal medical data, sharing is only possible upon informed consent. Requests to access the datasets should be directed to SW, c2ViYXN0aWFuLndhbHRoZXJAdXBkLnVuaWJlLmNo.

Ethics statement

The studies involving human participants were reviewed and approved by Kantonale Ethikkommission Bern (KEK). The patients/participants provided their written informed consent to participate in this study.

Author contributions

SK analyzed the data and wrote the first draft of the manuscript. NN recruited participants and conducted assessments. DA, DB, and AK conducted clinical assessments. SL supervised assessments. SW designed the study, obtained funding, wrote the protocol, supervised assessments, analyzed, and edited the manuscript. All authors discussed the findings and edited the manuscript.

Funding

This study received funding from the Swiss National Science Foundation, grant #182469 to SW. The funder had no access to the data or influence on the decision to publish.

Acknowledgments

We wish to thank the patients of the OCoPS-P trial for participation.

Conflict of interest

SW received honoraria from Janssen, Lundbeck, Mepha, Neurolite, and Sunovion, which were unrelated to this work.

The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

1. Ungvari GS, Caroff SN, Gerevich J. The catatonia conundrum: evidence of psychomotor phenomena as a symptom dimension in psychotic disorders. Schizophr Bull. (2010) 36:231–8. doi: 10.1093/schbul/sbp105

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Walther S, Strik W. Motor symptoms and schizophrenia. Neuropsychobiology. (2012) 66:77–92. doi: 10.1159/000339456

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Walther S, Strik W. Catatonia. CNS Spectr. (2016) 21:341–8. doi: 10.1017/S1092852916000274

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Fink M, Shorter E, Taylor MA. Catatonia is not schizophrenia: Kraepelins error and the need to recognize catatonia as an independent syndrome in medical nomenclature. Schizophr Bull. (2010) 36:314–20. doi: 10.1093/schbul/sbp059

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Tandon R, Heckers S, Bustillo J, Barch DM, Gaebel W, Gur RE, et al. Catatonia in DSM-5. Schizophr Res. (2013) 150:26–30. doi: 10.1016/j.schres.2013.04.034

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Walther S, Stegmayer K, Wilson JE, Heckers S. Structure and neural mechanisms of catatonia. Lancet Psychiatry. (2019) 6:610–9. doi: 10.1016/S2215-0366(18)30474-7

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Dhossche DM, Wachtel LE. Catatonia is hidden in plain sight among different pediatric disorders: a review article. Pediatr Neurol. (2010) 43:307–15. doi: 10.1016/j.pediatrneurol.2010.07.001

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Fink M. Rediscovering catatonia: the biography of a treatable syndrome. Acta Psychiatr Scand. (2013) 2013:1–47. doi: 10.1111/acps.12038

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Kruger S, Bagby RM, Hoffler J, Braunig P. Factor analysis of the catatonia rating scale and catatonic symptom distribution across four diagnostic groups. Compr Psychiatry. (2003) 44:472–82. doi: 10.1016/S0010-440X(03)00108-1

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Solmi M, Pigato GG, Roiter B, Guaglianone A, Martini L, Fornaro M, et al. Prevalence of Catatonia and Its Moderators in Clinical Samples: Results from a Meta-analysis and Meta-regression Analysis. Schizophr Bull. (2018) 44:1133–50. doi: 10.1093/schbul/sbx157

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Rogers JP, Pollak TA, Begum N, Griffin A, Carter B, Pritchard M, et al. Catatonia: demographic, clinical and laboratory associations. Psychol Med. (2021) 2021:1–11. doi: 10.1017/S0033291721004402

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Peralta V, Cuesta MJ. Motor abnormalities: from neurodevelopmental to neurodegenerative through “functional” (neuro)psychiatric disorders. Schizophr Bull. (2017) 43:956–71. doi: 10.1093/schbul/sbx089

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Pelzer AC, van der Heijden FM, den Boer E. Systematic review of catatonia treatment. Neuropsychiatr Dis Treat. (2018) 14:317–26. doi: 10.2147/NDT.S147897

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Rasmussen SA, Mazurek MF, Rosebush PI. Catatonia: Our current understanding of its diagnosis, treatment and pathophysiology. World J Psychiatry. (2016) 6:391–8. doi: 10.5498/wjp.v6.i4.391

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Heckers S, Walther S. Caring for the patient with catatonia. JAMA Psychiatry. (2021) 78:560–1. doi: 10.1001/jamapsychiatry.2021.0096

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Ungvari GS, Chiu HF, Chow LY, Lau BS, Tang WK. Lorazepam for chronic catatonia: a randomized, double-blind, placebo-controlled cross-over study. Psychopharmacology. (1999) 142:393–8. doi: 10.1007/s002130050904

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Fink M, Taylor MA. The catatonia syndrome: forgotten but not gone. Arch Gen Psychiatry. (2009) 66:1173–7. doi: 10.1001/archgenpsychiatry.2009.141

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Tuerlings JH, van Waarde JA, Verwey B. A retrospective study of 34 catatonic patients: analysis of clinical care and treatment. Gen Hosp Psychiatry. (2010) 32:631–5. doi: 10.1016/j.genhosppsych.2010.08.007

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Fink M, Taylor MA. Catatonia: A Clinicians Guide to Diagnosis and Treatment. Cambridge: Cambridge University Press (2003).

Google Scholar

20. Rogers D. The motor disorders of severe psychiatric illness: a conflict of paradigms. Br J Psychiatry. (1985) 147:221–32. doi: 10.1192/bjp.147.3.221

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Wortzel JR, Maeng DD, Francis A, Oldham MA. Prevalent gaps in understanding the features of catatonia among psychiatrists, psychiatry trainees, medical students. J Clin Psychiatry. (2021) 82:e4025. doi: 10.4088/JCP.21m14025

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Sienaert P, Rooseleer J, De Fruyt J. Measuring catatonia: a systematic review of rating scales. J Affect Disord. (2011) 135:1–9. doi: 10.1016/j.jad.2011.02.012

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Bush G, Fink M, Petrides G, Dowling F, Francis A. Catatonia. I. Rating scale and standardized examination. Acta Psychiatr Scand. (1996) 93:129–36. doi: 10.1111/j.1600-0447.1996.tb09814.x

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Northoff G, Koch A, Wenke J, Eckert J, Boker H, Pflug B, et al. Catatonia as a psychomotor syndrome: a rating scale and extrapyramidal motor symptoms. Mov Disord. (1999) 14:404–16. doi: 10.1002/1531-8257(199905)14:3<404::AID-MDS1004>3.0.CO;2-5

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Stubner S, Rustenbeck E, Grohmann R, Wagner G, Engel R, Neundorfer G, et al. Severe and uncommon involuntary movement disorders due to psychotropic drugs. Pharmacopsychiatry. (2004) 37:S54–64. doi: 10.1055/s-2004-815511

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Hirjak D, Sartorius A, Kubera KM, Wolf RC. [Antipsychotic-induced motor symptoms in schizophrenic psychoses-Part 2 : Catatonic symptoms and neuroleptic malignant syndrome]. Nervenarzt. (2019) 90:12–24. doi: 10.1007/s00115-018-0581-6

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Hirjak D, Sartorius A, Kubera KM, Wolf RC. Antipsychotic-induced catatonia and neuroleptic malignant syndrome: the dark side of the moon. Mol Psychiatry. (2021) 26:6112–4. doi: 10.1038/s41380-021-01158-2

PubMed Abstract | CrossRef Full Text | Google Scholar

28. van Harten PN, Walther S, Kent JS, Sponheim SR, Mittal VA. The clinical and prognostic value of motor abnormalities in psychosis, and the importance of instrumental assessment. Neurosci Biobehav Rev. (2017) 80:476–87. doi: 10.1016/j.neubiorev.2017.06.007

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Docx L, Morrens M, Bervoets C, Hulstijn W, Fransen E, De Hert M, et al. Parsing the components of the psychomotor syndrome in schizophrenia. Acta Psychiatr Scand. (2012) 126:256–65. doi: 10.1111/j.1600-0447.2012.01846.x

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Kluge A, Kirschner M, Hager OM, Bischof M, Habermeyer B, Seifritz E, et al. Combining actigraphy, ecological momentary assessment and neuroimaging to study apathy in patients with schizophrenia. Schizophr Res. (2018) 195:176–82. doi: 10.1016/j.schres.2017.09.034

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Walther S, Koschorke P, Horn H, Strik W. Objectively measured motor activity in schizophrenia challenges the validity of expert ratings. Psychiatry Res. (2009) 169:187–90. doi: 10.1016/j.psychres.2008.06.020

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Janno S, Holi MM, Tuisku K, Wahlbeck K. Neuroleptic-induced movement disorders in a naturalistic schizophrenia population: diagnostic value of actometric movement patterns. BMC Neurol. (2008) 8:10. doi: 10.1186/1471-2377-8-10

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Tuisku K, Lauerma H, Holi MM, Honkonen T, Rimon R. Akathisia masked by hypokinesia. Pharmacopsychiatry. (2000) 33:147–9. doi: 10.1055/s-2000-11294

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Walther S, Stegmayer K, Horn H, Razavi N, Muller TJ, Strik W. Physical activity in schizophrenia is higher in the first episode than in subsequent ones. Front Psychiatry. (2014) 5:191. doi: 10.3389/fpsyt.2014.00191

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Walther S, Horn H, Razavi N, Koschorke P, Muller TJ, Strik W. Quantitative motor activity differentiates schizophrenia subtypes. Neuropsychobiology. (2009) 60:80–6. doi: 10.1159/000236448

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Walther S, Vladimirova I, Alexaki D, Schappi L, Damme KSF, Mittal VA, et al. Low physical activity is associated with two hypokinetic motor abnormalities in psychosis. J Psychiatr Res. (2021) 146:258–63. doi: 10.1016/j.jpsychires.2021.11.014

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Mittal VA, Gupta T, Orr JM, Pelletier-Baldelli A, Dean DJ, Lunsford-Avery JR, et al. Physical activity level and medial temporal health in youth at ultra high-risk for psychosis. J Abnorm Psychol. (2013) 122:1101–10. doi: 10.1037/a0034085

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Hirjak D, Kubera KM, Wolf RC, Northoff G. Going back to kahlbaums psychomotor (and GABAergic) origins: Is catatonia more than just a motor and dopaminergic syndrome?. Schizophr Bull. (2020) 46:272–85. doi: 10.1093/schbul/sbz074

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Gardner DM, Murphy AL, ODonnell H, Centorrino F, Baldessarini RJ. International consensus study of antipsychotic dosing. Am J Psychiatry. (2010) 167:686–93. doi: 10.1176/appi.ajp.2009.09060802

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Leucht S, Crippa A, Siafis S, Patel MX, Orsini N, Davis JM. Dose-response meta-analysis of antipsychotic drugs for acute schizophrenia. Am J Psychiatry. (2020) 177:342–53. doi: 10.1176/appi.ajp.2019.19010034

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Leucht S, Samara M, Heres S, Davis JM. Dose equivalents for antipsychotic drugs: The DDD method. Schizophr Bull. (2016) 42:S90–4. doi: 10.1093/schbul/sbv167

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Leucht S, Samara M, Heres S, Patel MX, Furukawa T, Cipriani A, et al. Dose equivalents for second-generation antipsychotic drugs: The classical mean dose method. Schizophr Bull. (2015) 41:1397–402. doi: 10.1093/schbul/sbv037

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Middelkoop HA, van Dam EM, Smilde-van den Doel DA, Van Dijk G. 45-hour continuous quintuple-site actimetry: relations between trunk and limb movements and effects of circadian sleep-wake rhythmicity. Psychophysiology. (1997) 34:199–203. doi: 10.1111/j.1469-8986.1997.tb02132.x

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Anastasopoulou P, Tansella M, Stumpp J, Shammas L, Hey S. Classification of human physical activity and energy expenditure estimation by accelerometry and barometry. Annu Int Conf IEEE Eng Med Biol Soc. (2012) 2012:6451–4. doi: 10.1109/EMBC.2012.6347471

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Jette M, Sidney K, Blumchen G. Metabolic equivalents (METS) in exercise testing, exercise prescription, and evaluation of functional capacity. Clin Cardiol. (1990) 13:555–65. doi: 10.1002/clc.4960130809

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Haskell WL, Lee IM, Pate RR, Powell KE, Blair SN, Franklin BA, et al. Physical activity and public health: updated recommendation for adults from the American College of Sports Medicine and the American Heart Association. Med Sci Sports Exerc. (2007) 39:1423–34. doi: 10.1249/mss.0b013e3180616b27

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Westerterp KR. Control of energy expenditure in humans. Eur J Clin Nutr. (2017) 71:340–4. doi: 10.1038/ejcn.2016.237

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Oldfield RC. The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia. (1971) 9:97–113. doi: 10.1016/0028-3932(71)90067-4

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Hysenllari E, Ottenbacher J, McLennan D. Validation of human activity recognition using a convolutional neural network on accelerometer and gyroscope data. German J Exercise Sport Res. (2022) 52:248–52. doi: 10.1007/s12662-022-00817-y

CrossRef Full Text | Google Scholar

50. Walther S, Federspiel A, Horn H, Razavi N, Wiest R, Dierks T, et al. Alterations of white matter integrity related to motor activity in schizophrenia. Neurobiol Dis. (2011) 42:276–83. doi: 10.1016/j.nbd.2011.01.017

PubMed Abstract | CrossRef Full Text | Google Scholar

51. Wilson JE, Niu K, Nicolson SE, Levine SZ, Heckers S. The diagnostic criteria and structure of catatonia. Schizophr Res. (2015) 164:256–62. doi: 10.1016/j.schres.2014.12.036

PubMed Abstract | CrossRef Full Text | Google Scholar

52. Walther S, Federspiel A, Horn H, Razavi N, Wiest R, Dierks T, et al. Resting state cerebral blood flow and objective motor activity reveal basal ganglia dysfunction in schizophrenia. Psychiatry Res. (2011) 192:117–24. doi: 10.1016/j.pscychresns.2010.12.002

PubMed Abstract | CrossRef Full Text | Google Scholar

53. Bracht T, Schnell S, Federspiel A, Razavi N, Horn H, Strik W, et al. Altered cortico-basal ganglia motor pathways reflect reduced volitional motor activity in schizophrenia. Schizophr Res. (2013) 143:269–76. doi: 10.1016/j.schres.2012.12.004

PubMed Abstract | CrossRef Full Text | Google Scholar

54. Walther S. Psychomotor symptoms of schizophrenia map on the cerebral motor circuit. Psychiatry Res. (2015) 233:293–8. doi: 10.1016/j.pscychresns.2015.06.010

PubMed Abstract | CrossRef Full Text | Google Scholar

55. Walther S, Schappi L, Federspiel A, Bohlhalter S, Wiest R, Strik W, et al. Resting-state hyperperfusion of the supplementary motor area in catatonia. Schizophr Bull. (2017) 43:972–81. doi: 10.1093/schbul/sbw140

PubMed Abstract | CrossRef Full Text | Google Scholar

56. Walther S, Stegmayer K, Federspiel A, Bohlhalter S, Wiest R, Viher PV. Aberrant hyperconnectivity in the motor system at rest is linked to motor abnormalities in schizophrenia spectrum disorders. Schizophr Bull. (2017) 43:982–92. doi: 10.1093/schbul/sbx091

PubMed Abstract | CrossRef Full Text | Google Scholar

57. Viher PV, Stegmayer K, Federspiel A, Bohlhalter S, Wiest R, Walther S. Altered diffusion in motor white matter tracts in psychosis patients with catatonia. Schizophr Res. (2020) 220:210–7. doi: 10.1016/j.schres.2020.03.017

PubMed Abstract | CrossRef Full Text | Google Scholar

58. Wasserthal J, Maier-Hein KH, Neher PF, Northoff G, Kubera KM, Fritze S, et al. Multiparametric mapping of white matter microstructure in catatonia. Neuropsychopharmacology. (2020) 45:1750–7. doi: 10.1038/s41386-020-0691-2

PubMed Abstract | CrossRef Full Text | Google Scholar

59. Sambataro F, Hirjak D, Fritze S, Kubera KM, Northoff G, Calhoun VD, et al. Intrinsic neural network dynamics in catatonia. Hum Brain Mapp. (2021) 42:6087–98. doi: 10.1002/hbm.25671

PubMed Abstract | CrossRef Full Text | Google Scholar

60. Farrow TF, Hunter MD, Wilkinson ID, Green RD, Spence SA. Structural brain correlates of unconstrained motor activity in people with schizophrenia. Br J Psychiatry. (2005) 187:481–2. doi: 10.1192/bjp.187.5.481

PubMed Abstract | CrossRef Full Text | Google Scholar

61. Servaas MN, Kos C, Gravel N, Renken RJ, Marsman JC, van Tol MJ, et al. Rigidity in motor behavior and brain functioning in patients with schizophrenia and high levels of apathy. Schizophr Bull. (2019) 45:542–51. doi: 10.1093/schbul/sby108

PubMed Abstract | CrossRef Full Text | Google Scholar

62. Lujan MR, Perez-Pozuelo I, Grandner MA. Past, present, and future of multisensory wearable technology to monitor sleep and circadian rhythms. Front Digit Health. (2021) 3:721919. doi: 10.3389/fdgth.2021.721919

PubMed Abstract | CrossRef Full Text | Google Scholar

63. Walther S, Ramseyer F, Horn H, Strik W, Tschacher W. Less structured movement patterns predict severity of positive syndrome, excitement, and disorganization. Schizophr Bull. (2014) 40:585–91. doi: 10.1093/schbul/sbt038

PubMed Abstract | CrossRef Full Text | Google Scholar

64. Walther S, Horn H, Razavi N, Koschorke P, Wopfner A, Muller TJ, et al. Higher motor activity in schizophrenia patients treated with olanzapine versus risperidone. J Clin Psychopharmacol. (2010) 30:181–4. doi: 10.1097/JCP.0b013e3181d2ef6f

PubMed Abstract | CrossRef Full Text | Google Scholar

65. Walther S, Stegmayer K, Horn H, Rampa L, Razavi N, Muller TJ, et al. The longitudinal course of gross motor activity in schizophrenia - within and between episodes. Front Psychiatry. (2015) 6:e010. doi: 10.3389/fpsyt.2015.00010

PubMed Abstract | CrossRef Full Text | Google Scholar

66. Pieters LE, Deenik J, Tenback DE, van Oort J, van Harten NP. Exploring the relationship between movement disorders and physical activity in patients with schizophrenia: an actigraphy study. Schizophr Bull. (2021) 47:906–14. doi: 10.1093/schbul/sbab028

PubMed Abstract | CrossRef Full Text | Google Scholar

67. Tuisku K, Holi MM, Wahlbeck K, Ahlgren AJ, Lauerma H. Actometry in measuring the symptom severity of restless legs syndrome. Eur J Neurol. (2005) 12:385–7. doi: 10.1111/j.1468-1331.2004.00960.x

PubMed Abstract | CrossRef Full Text | Google Scholar

68. Cantisani A, Koenig T, Horn H, Muller T, Strik W, Walther S. Psychomotor retardation is linked to frontal alpha asymmetry in major depression. J Affect Disord. (2015) 188:167–72. doi: 10.1016/j.jad.2015.08.018

PubMed Abstract | CrossRef Full Text | Google Scholar

69. Razavi N, Horn H, Koschorke P, Hugli S, Hofle O, Muller T, et al. Measuring motor activity in major depression: the association between the Hamilton Depression Rating Scale and actigraphy. Psychiatry Res. (2011) 190:212–6. doi: 10.1016/j.psychres.2011.05.028

PubMed Abstract | CrossRef Full Text | Google Scholar

70. van Diermen L, Walther S, Cools O, Fransen E, Birkenhager TK, Sabbe BCG, et al. Observer-rated retardation but not agitation corresponds to objective motor measures in depression. Acta Neuropsychiatr. (2018) 30:359–64. doi: 10.1017/neu.2018.21

PubMed Abstract | CrossRef Full Text | Google Scholar

71. Lefebvre S, Pavlidou A, Walther S. What is the potential of neurostimulation in the treatment of motor symptoms in schizophrenia?. Expert Rev Neurother. (2020) 20:697–706. doi: 10.1080/14737175.2020.1775586

PubMed Abstract | CrossRef Full Text | Google Scholar

72. Walther S, Kunz M, Muller M, Zurcher C, Vladimirova I, Bachofner H, et al. Single session transcranial magnetic stimulation ameliorates hand gesture deficits in schizophrenia. Schizophr Bull. (2020) 46:286–93. doi: 10.1093/schbul/sbz078

PubMed Abstract | CrossRef Full Text | Google Scholar

73. Walther SV.A Mittal. Motor behavior is relevant for understanding mechanism, bolstering prediction, and improving treatment: A transdiagnostic perspective. Schizophr Bull. (2022) 48:741–48. doi: 10.1093/schbul/sbac003

PubMed Abstract | CrossRef Full Text | Google Scholar