Skip to main content

CLINICAL TRIAL article

Front. Psychiatry, 13 November 2020
Sec. Psychopharmacology
This article is part of the Research Topic Gone to Pot: Examining the Association Between Cannabis Use and Medical/Psychiatric Disorders View all 8 articles

Effects of Cannabidiol and Delta-9-Tetrahydrocannabinol on Emotion, Cognition, and Attention: A Double-Blind, Placebo-Controlled, Randomized Experimental Trial in Healthy Volunteers

  • 1Department of Psychiatry and Psychotherapy, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
  • 2Youth Mental Health Team, Brain and Mind Centre, Central Clinical School, Faculty of Medicine and Health, The University of Sydney, Sydney, NSW, Australia
  • 3Department of Psychiatry, Psychosomatics and Psychotherapy, Goethe University Frankfurt, Frankfurt, Germany
  • 4Department of Psychosomatics Medicine and Psychotherapy, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
  • 5Institute of Medical Statistics and Computational Biology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany

The two main phytocannabinoids—delta-9-tetrahydrocannabinol (THC) and cannabidiol (CBD)—have been extensively studied, and it has been shown that THC can induce transient psychosis. At the same time, CBD appears to have no psychotomimetic potential. On the contrary, emerging evidence for CBD's antipsychotic properties suggests that it may attenuate effects induced by THC. Thus, we investigated and compared the effects of THC and CBD administration on emotion, cognition, and attention as well as the impact of CBD pre-treatment on THC effects in healthy volunteers. We performed a placebo-controlled, double-blind, experimental trial (GEI-TCP II; ClinicalTrials.gov identifier: NCT02487381) with 60 healthy volunteers randomly allocated to four parallel intervention groups, receiving either placebo, 800 mg CBD, 20 mg THC, or both cannabinoids. Subjects underwent neuropsychological tests assessing working memory (Letter Number Sequencing test), cognitive processing speed (Digit Symbol Coding task), attention (d2 Test of Attention), and emotional state (adjective mood rating scale [EWL]). Administration of CBD alone did not influence the emotional state, cognitive performance, and attention. At the same time, THC affected two of six emotional categories—more precisely, the performance-related activity and extraversion—, reduced the cognitive processing speed and impaired the performance on the d2 Test of Attention. Interestingly, pre-treatment with CBD did not attenuate the effects induced by THC. These findings show that the acute intake of CBD itself has no effect per se in healthy volunteers and that a single dose of CBD prior to THC administration was insufficient to mitigate the detrimental impact of THC in the given setting. This is in support of a complex interaction between CBD and THC whose effects are not counterbalanced by CBD under all circumstances.

Introduction

Due to its relaxing and psychotropic properties, cannabis has been used for centuries for recreational purposes (1). It represents the worldwide most frequently used illicit drug (2) for decades, today, and probably in the years to come. Over the last years, a growing public debate on the legalization of cannabis for medical and recreational use took place. While in most regions, discussions about risks and chances are still ongoing, some countries or states (e.g., Uruguay, Colorado) already permitted a retail market of cannabis.

Most users consume cannabis only on a sporadic basis with a modest risk of severe adverse effects. However, cannabis use can cause severe impairments such as morphological brain changes (3, 4), cannabis use disorder (CUD) (5), persisting cognitive (6), memory (7), and behavioral (8) deficits as well as an increased risk of developing psychotic disorders (911). In particular, adolescents, who represent the majority of recreational users (3), are highly vulnerable, as the neuronal maturation of the brain is not yet completed. Furthermore, it must be considered that the content of the psychotomimetic ingredient delta-9-tetrahydrocannabinol (THC), is steadily rising from averaged 3% in the 1960s to 20% nowadays in high potency varieties in e.g., the Netherlands (11, 12), also contributing to the increased rate of CUD (5).

Various studies have shown that acute THC administration can induce transient psychosis in healthy volunteers as well as cognitive impairments and electroencephalography patterns comparable to psychosis (11). For this reason, THC can be used to induce a model psychosis, a term introduced in 1932 by Kurt Beringer (13) for psychotic-like symptoms intentionally caused by psychotomimetic drugs.

On the other hand, the therapeutic effects of the non-psychotomimetic phytocannabinoid cannabidiol (CBD) become more apparent (1417). Furthermore, it has been speculated that CBD is able to mitigate some effects of THC or nabilone, a synthetic THC analogon, as CBD reduced THC induced anxiety (18) and attenuated the impact of the psychotomimetic cannabinoids on binocular depth inversion (19), episodic memory (20), facial emotional recognition (21), and psychotic symptoms (22) in healthy volunteers. Besides, it has been reported that a high CBD content in smoked cannabis reduced self-reported psychotic symptoms (23, 24) as well as anxiety ratings (25), and attenuated episodic memory-impairing effects (25). However, CBD was unable to reduce cognitive processing speed and working memory deficits induced by THC (20). Furthermore, varying CBD concentrations in smoked cannabis did also not affect working memory and sustained attention (26) as well as psychotomimetic symptoms (25), electroencephalographic measures, and event-related potentials (26).

As this previous data suggest that CBD and THC interact on at least some cognitive domains and anxiety, we conducted a placebo-controlled trial investigating the effects of a single oral placebo, CBD or THC administration as well as THC effects after pre-treatment with CBD on cognitive processing speed, working memory, attention, and emotional states in healthy volunteers. Importantly, we stratified for functional catechol-o-methyltransferase (COMT) polymorphism to exclude the influence of different dopamine elimination rates, as it has already been shown that cannabis affects cognition (including memory performance) in a COMT genotype-dependent manner (27, 28).

Materials and Methods

This double-blind, randomized, parallel-group, placebo-controlled experimental trial (GEI-TCP II; ClinicalTrials.gov identifier: NCT02487381) was approved by the Ethics Committee II of the Medical Faculty Mannheim, Heidelberg University, Germany and the German Federal Institute for Drugs and Medical Devices (BfArM). All subjects gave written informed consent.

As summarized in the CONSORT Flow Diagram (Figure 1), we screened 75 potential participants and enrolled 61 healthy volunteers. Sixty male, right-handed, participants aged between 19 and 36, completed the study per protocol. None of the subjects had any severe medical or neurological illness or personal or family history of psychiatric disorder. Subjects with a positive history of recurrent substance abuse, or cannabis consumption more than 10 times or less than one time during their lifespan, or cannabis consumption in the previous 6 months were excluded. All subjects had a body mass index (BMI) between 18 and 30 (kg/m2), a negative urine drug screening (including barbiturates, benzodiazepines, cannabinoids, methadone, opiates, amphetamine, ecstasy, and cocaine), and regular blood pathology results. Furthermore, no caffeine, alcohol, and nicotine consumption was allowed while participating in the trial. Volunteers were asked to abstain from these compounds. This study was limited to male volunteers because it was designed to parallel an investigation administering radionuclides.

FIGURE 1
www.frontiersin.org

Figure 1. CONSORT Flow Diagram. CBD, cannabidiol; PLA, placebo; THC, delta-9-tetrahydrocannabinol.

Enrolled participants were stratified by their COMT Val158Met genotype to reduce the potential influence of different dopamine elimination rates and allocated to one of four parallel treatment groups, using computer-generated permuted blocks of varying length (allocation ratio 1:1:1:1).

Experimental Procedures

Baseline assessments of all neuropsychological tests were carried out 1 day before the interventional day (V1).

During the interventional day (V2), all subjects had standardized breakfast and lunch. After breakfast, the first venous blood collection took place, and volunteers received either 4 × 200 mg CBD (>99.8% pure, STI Pharmaceuticals, Brentwood, UK), or corresponding placebo capsules. Thirty minutes later, administration of 2 × 10 mg THC (>98.8% pure, THC pharm, Frankfurt, Germany) or corresponding placebo capsules was scheduled. Approximately 205 min after CBD or placebo administration, blood withdrawal for THC level analysis by LC-MS MS (29) took place, followed by neuropsychological assessments.

For safety reasons, all subjects were clinically examined on the following day (V3), and all neuropsychological tests were repeated.

Neuropsychological Assessments

All neuropsychological tests were carried out in paper-pencil versions.

To capture the participants' emotional state, we used a short version of the adjective mood rating scale (EWL) (30). This questionnaire comprises 60 adjectives and a four-point response format ranging from (0) not at all to (4) strongly. It covers the following six emotional categories: (a) performance-related activity, (b) general inactivation, (c) extroversion, (d) general well-being, (e) emotional excitability, and (f) depressiveness.

Cognitive processing speed was assessed using the Digit Symbol Coding task. Subjects were instructed to replace as many digits as possible in 90 s by given symbols, while the pairing table remained visible. Further, we evaluated working memory performance using the Letter-Number-Sequencing test. After reading an unordered sequence of numbers and letters aloud, subjects were asked to recall the numbers in ascending and the letters in alphabetical order. Both Digit Symbol Coding and Letter-Number-Sequencing are part of the Wechsler Adult Intelligence Scale (31).

In order to quantify changes in concentration and attention, the d2 Test of Attention (32) was used. During this paradigm, participants had to scan 14 test lines with 47 characters (“d” or “p” marked with a different number of dashes) and cross out all “d” characters marked with two dashed while ignoring all other characters. Volunteers were instructed to operate as fast as possible, but to minimize the error rate at the same time. The d2 Test of Attention provides multiple scores, of which we analyzed the following: error-corrected total number, and concentration capacity.

Statistical Analysis

Statistical data analysis was performed using the software R (33).

The sample size of 15 subjects per treatment group, i.e., 60 subjects in total, is sufficient to detect a standardized difference of about 1.1 between any two groups (80% power, two-sided type I error 5%, two-sample Wilcoxon rank sum test, no multiplicity correction).

Group differences of continuous demographic variables were assessed using the Kruskal-Wallis test, while Fisher's exact test was used for the categorical variable “smoking.”

Intraindividual difference scores (investigational day—baseline) were calculated to evaluate the changes from baseline to the interventional day (~205 min post CBD intake) in emotional and attentional state and cognitive performance. The difference scores of the neuropsychological tests were not normally distributed. Thus, changes were analyzed by the non-parametric Kruskal-Wallis test, followed by closed testing, i.e., a stepwise multiple testing procedure that strongly controls the familywise error (34). The significance level was set at α ≤ 0.05 (two-sided). The data are presented as median (mdn) and 0, 25, 75, and 100 percentiles.

Results

Sixty healthy volunteers participated in all sessions and completed the study per protocol. The four groups were adequately matched concerning age, BMI, cannabis lifetime use, intelligence, and smoking status (see Table 1).

TABLE 1
www.frontiersin.org

Table 1. Demographics.

In general, individuals who received CBD plus placebo (CBD/PLA) did not show relevant differences compared to the placebo plus placebo (PLA/PLA) group, while THC following placebo (PLA/THC) administration significantly affected cognitive performance. In addition, THC induced more extensive changes in emotional states than PLA/PLA and CBD/PLA, although these alterations did not reach significance. Interestingly, pre-treatment with CBD did not attenuate THC effects in the CBD/THC group. CBD/THC subjects showed impairments of cognitive abilities well comparable to PLA/THC subjects. Furthermore, the observed changes in emotional states in CBD/THC subjects were comparable to those observed in PLA/THC subjects and significantly larger compared to CBD/PLA and PLA/PLA subjects.

Effects of Exogenous Cannabinoids THC and CBD on Emotion

At the interventional day, treatment with phytocannabinoids changed subjects' self-evaluation of their emotional state in four of six categories. Ratings of general inactivation and general well-being did not differ between interventional groups.

All subjects showed slightly reduced performance-related activity compared to baseline. Interestingly, subjects who received CBD/THC showed significantly lower performance-related activity difference scores (mdn = −8, −12, −9, −5, −4 [median, percentiles 0, 25, 75, 100]) compared to PLA/PLA (mdn = −3, −12, −5, −1, 2, p = 0.002) or CBD/PLA (mdn = −2, −18, −7, −1,8, p = 0.035, see Figure 2A). The change in performance-related activity was solely lower by trend in CBD/THC. The difference score did not differ from those observed in the PLA/THC group but from those of the PLA/PLA and CBD/PLA group.

FIGURE 2
www.frontiersin.org

Figure 2. Changes of aspects of emotion from baseline to investigational assessment. From six emotional categories covered by the adjective mood rating scale (EWL), four categories were differentially affected by cannabinoid treatment. (A) Subjects who received the 800 mg of cannabidiol orally (CBD) prior to 20 mg of delta-9-tetrahydrocannabinol orally (THC; CBD/THC) showed significantly reduced performance-related activity difference scores (investigational day—baseline) in comparison to placebo (PLA) prior to placebo (PLA/PLA) (p = 0.002), and CBD prior to placebo (CBD/PLA) (p = 0.035) treated participants. Furthermore, the administration of CBD followed by THC (CBD/THC) led to significantly more pronounced self-rating of depressiveness compared to PLA/PLA (p = 0.015) and CBD/PLA (p = 0.026) at the investigational day (B). Rating of extraversion (C) was significantly lower in subjects treated with CBD/THC in comparison to PLA/PLA (p = 0.013) and CBD/PLA (p = 0.017), indicating a more introverted behavior. (D) Regarding emotional excitability, the overall group difference did not reach significance (p = 0.058). However, by trend, participants treated with CBD/PLA showed decreased excitability difference scores, while the administration of THC/CBD resulted in increased values. PLA/PLA, placebo/placebo; CBD/PLA, cannabidiol/placebo; THC/PLA, delta-9-tetrahydrocannabinol/placebo; CBD/THC, cannabidiol/ delta-9-tetrahydrocannabinol.

In the category depressiveness, CBD/PLA subjects showed similar scores compared to baseline. PLA/THC and CBD/THC led to higher depressiveness scores compared to baseline, although significance was only reached in CBD/THC subjects (mdn = 1, −1, 0, 6, 8) vs. PLA/PLA (mdn = 0, 4, 0, 1, 3, p = 0.015) and vs. CBD/PLA (mdn = 0, −4, 0, 1, 3, p = 0.026, Figure 2B).

A similar pattern was observed for the emotional category extraversion. While after PLA/PLA and CBD/PLA treatment the extraversion scores were comparable to baseline, PLA/THC and PLA/THC treatment resulted in a slight decrease of extraversion, representing a more introverted behavior in this group. However, only CBD/THC treatment led to a significant decline in extraversion scores (mdn = −3, −11, −8, −2, 0) vs. PLA/PLA (mdn = 0, −10, −2.5, 1, 6, p = 0.013) and vs. CBD/PLA (mdn = −1, −7, −3, 0.5, 4, p = 0.017, Figure 2C).

Regarding emotional excitability, the overall group difference did not reach significance (Kruskal-Wallis: p = 0.058). Nevertheless, by trend emotional irritability seemed to be lower after CBD/PLA treatment, while subjects who took CBD/THC showed increased excitability (Figure 2D).

Effects of Exogenous Cannabinoids THC and CBD on Cognition and Attention

Compared to the first assessment at the baseline visit (V1), subjects receiving PLA/PLA or CBD/PLA showed increased performance in both cognitive tests at the interventional day (Figures 3A,B).

FIGURE 3
www.frontiersin.org

Figure 3. Changes of cognition from baseline to investigational assessment. (A) While subjects treated with placebo (PLA) prior to placebo (PLA/PLA) and 800 mg cannabidiol orally (CBD) prior to placebo (CBD/PLA) improved their cognitive processing at the interventional day compared to baseline (reflected by positive difference scores in the Digit Symbol Coding task), subjects receiving 20 mg of delta-9-tetrahydrocannabinol orally (THC) proceeded by placebo (PLA/THC) or CBD (CBD/THC) showed a slightly reduced performance. The difference scores of both PLA/THC and CBD/THC) was significantly lower compared to the CBD/PLA group (PLA/THC: p = 0.039; CBD/THC: p = 0.016). (B) After CBD/PLA, the change in working memory performance (from baseline to 205 min post drug intake) assessed by the Letter Number Sequencing task seemed to be most pronounced. Interestingly the difference score observed for CBD/PLA was significantly higher than the score of the CBD/THC group (p = 0.005). (C) At the interventional day, we observed higher mean attentional d2 scores compared to baseline after PLA/PLA, CBD/PLA, and PLA/THC treatment. In subjects who received CBD/THC, an increased attentional performance was not observed, and the difference score was significantly lower compared to the PLA/PLA (p = 0.005) and CBD/THC (p = 0.010) group. PLA/PLA, placebo/placebo; CBD/PLA, cannabidiol/placebo; THC/PLA, delta-9-tetrahydrocannabinol/placebo; CBD/THC, cannabidiol/ delta-9-tetrahydrocannabinol.

On the other hand, negative digit symbol coding difference scores, indicating impaired cognitive processing, were found after PLA/THC and CBD/THC administration. However, this reduction was only significant in comparison of CBD/PLA (mdn = 6, −3, 5, 12, 20) vs. PLA/THC (mdn = 2, −79, −4.5, 6, 20, p = 0.039) and vs. CBD/THC (mdn = −2, −27, −12.5, 7, 11, p = 0.016; Figure 3A).

In addition, the working memory performance assessed by the Letter Number Sequencing test was significantly lower in the group receiving CBD/THC (mdn = 0, −4, −1.5, 1, 2) compared to CBD/PLA (mdn = 2, −2, 0.5, 3, 4, p = 0.005; Figure 3B).

The d2 Test of Attention was applied three times within 3 days and mean scores averaged over all participants increased continuously. Information processing speed displayed in this test by the error corrected total number (32) augmented from V1 (mdn = 536, 293, 461, 556.25, 618.00) over V2 (mdn = 539, 329.0, 456.5, 583.0, 652) 523.8 to V3 (mdn = 593.5, 414.0, 547, 639.5.653).

Like in the cognitive tests, we observed positive difference scores of concentration capacity in participants treated with PLA/PLA or CBD/PLA, indicating better test results at the interventional day compared to baseline testing. In addition, participants of the PLA/THC group showed higher concentration capacities at V2 than at baseline testing, while subjects receiving CBD/THC were less focused, indicated by negative difference scores. The reduction of attention after CBD/THC administration (mdn = −10, −55, −25, 15, 62) was significant compared to PLA/PLA (25, −20, 16, 33.5, 43, p = 0.005) and CBD/PLA treatment (mdn = 29, −48, 10.5, 35.5, 67, p = 0.010; Figure 3C).

THC Blood Levels

Subjects who received PLA/THC showed slightly lower THC blood levels (mdn = 0.954, 0.0, 0.817, 1.615, 9.690 pmol/ml) compared to subjects who received CBD/THC (mdn = 2.61, 0.614, 1.032, 3.960, 8.350 pmol/ml). However, this difference did not reach statistical significance.

Discussion

In the current study, we investigated the effects of a single oral PLA/PLA, CBD/PLA, PLA/THC, and CBD/THC time-shifted double-dummy administration (CBD or corresponding PLA prior to THC or corresponding PLA treatment) on cognitive processing speed, working memory, attention, and emotion in healthy volunteers. Although previous reports suggested that CBD and THC interact on at least some cognitive domains and anxiety, a single oral dose CBD, administered prior to THC, was insufficient to mitigate the detrimental effects of THC in our setting.

Effects of CBD and THC on Emotion

We observed no significant influence of PLA/PLA and CBD/PLA treatment on the six emotional categories (a) performance-related activity, (b) general inactivation, (c) extroversion, (d) general well-being, (e) emotional excitability, and (f) depressiveness. Slight reductions in performance-related activity in both groups could be most likely traced back to the intense investigational day. However, CBD/PLA might favor a slightly more relaxed emotional state compared to PLA/PLA, as the mean difference scores in emotional excitability were lower by trend. These findings are in line with a recent study, showing that a single CBD administration did not affect the three main dimensions of affect (hedonic tone, energetic arousal, and tense arousal) assessed by the University of Wales Mood Adjective Checklist (UMACL) (20). However, it has also been reported that subjects felt more quick-witted and clear-minded (18) after acute CBD treatment, while another study found increased Adjective Mood Rating Scale (Bf-S) scores, indicating a decline in general well-being, 3 h after CBD treatment (19). Hitherto, available literature on the emotional effects of CBD in humans focuses mainly on anxiolytic properties. Results of published studies indicate that CBD does not affect anxiety per se, as it has no effect on baseline anxiety (18, 19, 35, 36). Our results are consistent with these findings in the most general sense, although the used adjective mood rating scale does not retrieve anxiety, but depressiveness experience. However, it has been reported that CBD exhibits anxiolytic properties in experimental anxiogenic settings (18, 37) and seems to be effective in subjects with social phobia and generalized social anxiety disorder (38, 39). Recreational use of cannabis is mostly associated with feeling “high” and relaxing properties (40), while only a subset of naïve users reports dysphoria (41) and even paranoia (40). In the present study, we observed that THC administration reduced performance-related activity and extraversion by trend, while subjects felt slightly more depressive compared to PLA/PLA and CBD/PLA treated subjects. These results are consistent with previous studies, reporting that healthy volunteers acutely treated with THC feel anxious (18) and tense (35). Acute cannabis use has also been associated with an euphoriant effect (“high”), decreased anxiety, depression, and tension, as well as increased sociability if taken in friendly surroundings (40). This seems contradictory, but in line with a proposed biphasic effect of THC. While low doses [around 5–10 mg THC- in a joint (40)] have revealed anxiolytic effects, higher doses can induce dysphoric experiences (40).

As mentioned above, CBD may reduce experimentally induced anxiety. It has been shown that CBD also reverses the acute anxiogenic effects of THC when both cannabinoids were administered simultaneously (18, 35). Thus, we hypothesized that CBD pre-treatment might alleviate THC effects on depressiveness and extraversion. Surprisingly, the administration of THC subsequent to a single dose of CBD had nearly the same effect on emotional perception as the THC treatment following placebo, as reflected by significantly higher depressiveness and significantly lower extraversion scores. This finding is indicative of more complex pharmacodynamic interaction of THC and CBD, depending on the treatment regime and eventually, the dosages, and consistent with the observation that different compositions of THC and CBD content in medicinal cannabis influence anxiety, depression, and stress in different ways (42). Noteworthy, Cuttler et al. (42) also suggested a difference in acute and long-term effects, whereby initially reduced perceived symptoms of negative affect may exacerbate baseline symptoms of depression over time, further demonstrating the complexity of the phenomenon.

Effects of CBD and THC on Cognition and Attention

We observed that participants treated with PLA/PLA scored higher at the investigational day in both cognitive tasks and the d2 Test of Attention. This improvement might be due to learning- and training effects, even though the tasks were repeated in different versions for repeated measures. Similar results were observed for subjects treated with CBD/PLA, indicating that CBD did negatively influence cognitive processing speed and attention, although ameliorating working memory performance by trend.

PLA/THC administration resulted in reduced cognitive processing speed compared to CBD/PLA treatment, although the performance remained widely unaffected compared to baseline. This difference to CBD/PLA is likely due to the improvement of the latter group on the investigational day, also seen in PLA/PLA. Therefore, it may be speculated if THC reduced a potential learning effect or other factors are contributing to this finding. However, the observed group differences do probably not reflect difficulties in accessing working memory, which remained largely unaffected or long-term memory contents, as Ranganathan and D'Souza (43) showed that THC does not disrupt access to information learned before administration.

Subjects treated with PLA/THC or CBD/THC reported reduced subjective performance-related activity, with CBD/THC even becoming significant vs. PLA/PLA and CBD/PLA as another indicator of more pronounced THC effects in the CBD/THC group, potentially related to the reported higher THC plasma levels. This subjective reduction in performance-related activity is unlikely attributed to the intense investigational day, as this reduction was not apparent in the PLA/PLA and CBD/PLA groups. While a reduced subjective performance-related activity was reflected by the impairments in cognitive processing speed (Digit Symbol Coding Task) and concentration capacity (d2 Test of attention), a discrepancy between subjective experience and objective performance is noteworthy and has been observed before (44).

Interestingly, THC did not influence working memory performance. This finding is consistent with a study reporting that THC did not alter working memory whilst disturbing episodic memory and verbal learning (45). Unfortunately, the latter domains were not assessed by the tasks applied in the present study. However, other studies reported that intravenous as well as pulmonal THC administration induced working memory impairments, reflected by reduced performance in the Digit Span forward and reverse task (20), the Digit Symbol Substitution Task (46, 47), the Paced Auditory Serial Addition Task and the spatial N-back task (48).

Although subjects treated with PLA/THC still showed higher attentional scores than at baseline, this increase was less pronounced compared to PLA/PLA and CBD/PLA treatment. Again, it might be that learning effects superimpose impairments provoked by THC, as it has been previously reported that THC treatment resulted in a significant decrease of d2 test performance compared to placebo (49) and Divided Attention Task performance compared to baseline assessment (47). Furthermore, the synthetic THC analog nabilone led to a dose-dependent deterioration of attention in the Cognitive Drug Research computerized assessment system (50).

As already discussed with regard to emotional states, we hypothesized that CBD is able to counteract the effects of THC on cognition and attention. Interestingly, this was not the case in our setting. Subjects who received CBD/THC treatment showed no improvement in cognitive processing speed, working memory, and attention compared to subjects who received PLA/THC. Probably based on the slightly higher THC levels in the CBD/THC group, the effects of THC were more pronounced. We observed significantly reduced cognitive processing speed, working memory, and attention compared to CBD/PLA and PLA/PLA. At first, this is surprising, as it has been shown that CBD pre-treatment (600 mg orally) is able to diminish impairments of episodic memory induced by intravenously injected THC (20). However, the same study reported that CBD pre-treatment did not attenuate THC induced impairments on immediate recall, digit-span forward, and digit span backward (20). Furthermore, vaporized THC (8 mg) alone and combined with vaporized CBD (16 mg) showed the same level of impairment in episodic memory on prose recall in the story recall task from the Rivermead Behavioral Memory Test when compared to placebo (48). Interestingly, acute treatment with CBD (300 or 600 mg) did also not improve the performance of schizophrenia patients in the Stroop Color Word Test (51), and thus did not affect selective attention and processing speed in patients. It may well be that CBD pre-treatment is more effective on other cognitive domains than those applied in the present study, as it had been suggested that CBD, in particular, protects hippocampal-dependent memory performance from the impact of THC (20). On the other hand, it might also be that repeated CBD treatment is required to activate mechanisms, improving cognitive and attentional performance while acute CBD administration is not sufficient. However, Arkell et al. (46) observed a reduction of attention after a combined CBD/THC administration in the Divided Attention Task, while the task performance was not affected by THC alone.

Limitations to Our Study

Although we tried to address several issues affecting studies on THC and CBD in healthy volunteers (52), there are still a number of limitations to this study.

First, we only recruited male subjects due to the initially planned parallel study using radionuclides to investigate cannabinoid receptor availability after cannabinoid intake. However, due to regulatory changes, we had to halt this study indefinitely shortly before the initiation of our trial reported here. Thus, our data lacks generalisability with regard to gender.

Second, we observed substantial interindividual differences. The two major approaches to minimize standard deviations are increasing the number of subjects and homogenizing the sample cohort. The number of 60 participants was already higher than in the majority of comparable studies. Furthermore, our study was designed to reduce sample heterogeneity by stratifying for functional COMT polymorphism to exclude the influence of different dopamine elimination rates, as it has already been shown that cannabis affected cognition in a COMT genotype-dependent manner (27, 28).

Third, we included only subjects with body mass indices ranging from 18 to 30 and provided equivalent meals for all participants throughout the interventional day to achieve a comparable cannabinoid uptake. However, providing individual weight adapted dosing would be even better, but this was not feasible due to limitations of differential dosing per os. Further, oral administration of drugs is accompanied by a delayed digestion-dependent uptake and variable metabolization in the liver due to individual enzyme activities. Inhalative and intravenous applications of cannabinoids bypass the first-pass effect in the liver and result in faster peaks (43, 53), and may also reduce interindividual differences. However, oral administration leads to more consistent long-lasting peak concentrations and is also used in other clinical trials. They represent a route of administration more suitable for medical use. In particular, the latter is essential as CBD has recently been approved as an orphan drug for Dravet and Lennox-Gastault syndrome in children and is currently investigated regarding its beneficial effects in other diseases, e.g., schizophrenia. We have recently demonstrated in rodents that different pharmaceutical preparations of THC can influence its behavioral effects depending on the kinetics of the surge of THC (54), suggesting that the investigation of both oral as well as inhalative/intravenous administration of THC and CBD is justified.

Fourth, we investigated the change from baseline to post-drug intake to reduce general interindividual differences. However, multiple testing resulted in potential learning effects in both cognitive tasks and attention testing, even when using appropriate test/re-test paradigms. These learning effects might have superimposed some cannabinoid effects on cognition and attention.

Fifth, the potential use of caffeine, nicotine, and alcohol has been out of our rigid control between baseline (V1) and the following investigational day as subjects were not kept in a closed environment such as an experimental ward for compliance and funding reasons. However, subjects were thoroughly screened for any history of use or even abuse of these compounds and did neither report more pronounced use nor demonstrate any clinical signs related to it, particularly not during visits or the extensive time they were under direct observation during the trial.

Sixth, we tested only one dose of CBD and THC, respectively. The THC dose was chosen based on the recommended maximum daily dosage of dronabinol and the available oral dosage forms, while the dose of CBD was based on the dosage used in our previous clinical trial in schizophrenia (55), demonstrating the antipsychotic effects of CBD. However, it may be that the effects induced by the high THC dose were too strong to be controlled by CBD. Thus, future studies should investigate the effects of a broader range of CBD on various THC doses.

Conclusions

This study showed that CBD has no detrimental effects on emotion, cognition, and attention. However, our results do not provide further evidence that acute CBD administration improves impairments of cognitive functions and attention or alteration of emotional experience induced by THC in healthy volunteers under any circumstances.

As there is some evidence that CBD may be effective with regard to other cognitive domains than those investigated in the present study, further studies are needed to elucidate the intricate interrelation of both phytocannabinoids and cognition. Further, the effects of repeated or longer-term CBD administration should be investigated, particularly with regard to the increasing medical interest in CBD as an (investigational) medical drug.

Data Availability Statement

The datasets presented in this article are not readily available because Data belongs to the sponsor of the clinical trial (Central Institute of Mental Health) and requires previous consent of the sponsor. Requests to access the datasets should be directed to markus.leweke@sydney.edu.au.

Ethics Statement

The studies involving human participants were reviewed and approved by Ethics Committee II of the Medical Faculty Mannheim, Heidelberg University, Germany. The participants provided their written informed consent to participate in this study.

Author Contributions

FML and CR conceived and designed the experiments with input from DK, MH, BL, JKM, and AR. FML, JM, BL, AR, CR, AMS, and TW performed the experiments. TW and CR analyzed the data with input from FML and MH. TW and CR drafted the manuscript with input from MH and FML. All authors contributed to final manuscript preparation, read, and approved the final manuscript.

Funding

This study was supported by a grant from the European Community's Seventh Framework Programme [CORDIS: FP7 (2010-2015), project name: HEALTH-F2-2009-241909 Projects: Identifying genetic and environmental interactions in schizophrenia (EU-GEI)].

Conflict of Interest

FML is a shareholder of curantis UG (ltd).

The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

We thank Ulrike Galm, Franziska Hanke, Tobias Bender for their invaluable lab support and Dr. Carola Boost for taking care of the Δ9-THC analysis. We thank Jil Bailleux, Nelly Monzer, and Melany Richter for their engagement in the neuropsychological testing. We are also grateful to Dr. Frank Enning for his clinical support in this study.

References

1. Adams R. Marihuana: harvey lecture, February 19, 1942. Bull N Y Acad Med. (1942) 18:705–30.

PubMed Abstract | Google Scholar

2. UNODC. World Drug Report 2016. New York: United Nations Office on Drugs and Crime (2016).

3. Batalla A, Bhattacharyya S, Yucel M, Fusar-Poli P, Crippa JA, Nogue S, et al. Structural and functional imaging studies in chronic cannabis users: a systematic review of adolescent and adult findings. PLoS ONE. (2013) 8:e55821. doi: 10.1371/journal.pone.0055821

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Ashtari M, Avants B, Cyckowski L, Cervellione KL, Roofeh D, Cook P, et al. Medial temporal structures and memory functions in adolescents with heavy cannabis use. J Psychiatr Res. (2011) 45:1055–66. doi: 10.1016/j.jpsychires.2011.01.004

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Hasin DS, Shmulewitz D, Sarvet al. Time trends in US cannabis use and cannabis use disorders overall and by sociodemographic subgroups: a narrative review and new findings. Am J Drug Alcohol Abuse. (2019) 45:623–43. doi: 10.1080/00952990.2019.1569668

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Harvey MA, Sellman JD, Porter RJ, Frampton CM. The relationship between non-acute adolescent cannabis use and cognition. Drug Alcohol Rev. (2007) 26:309–19. doi: 10.1080/09595230701247772

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Solowij N, Stephens RS, Roffman RA, Babor T, Kadden R, Miller M, et al. Cognitive functioning of long-term heavy cannabis users seeking treatment. JAMA. (2002) 287:1123–31. doi: 10.1001/jama.287.9.1123

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Dougherty DM, Mathias CW, Dawes MA, Furr RM, Charles NE, Liguori A, et al. Impulsivity, attention, memory, and decision-making among adolescent marijuana users. Psychopharmacology. (2013) 226:307–19. doi: 10.1007/s00213-012-2908-5

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Moore TH, Zammit S, Lingford-Hughes A, Barnes TR, Jones PB, Burke M, et al. Cannabis use and risk of psychotic or affective mental health outcomes: a systematic review. Lancet. (2007) 370:319–28. doi: 10.1016/S0140-6736(07)61162-3

CrossRef Full Text | Google Scholar

10. Di Forti M, Marconi A, Carra E, Fraietta S, Trotta A, Bonomo M, et al. Proportion of patients in south London with first-episode psychosis attributable to use of high potency cannabis: a case-control study. Lancet Psychiatry. (2015) 2:233–8. doi: 10.1016/S2215-0366(14)00117-5

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Murray RM, Di Forti M. Cannabis and psychosis: what degree of proof do we require? Biol Psychiatry. (2016) 79:514–5. doi: 10.1016/j.biopsych.2016.02.005

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Adams IB, Martin BR. Cannabis: pharmacology and toxicology in animals and humans. Addiction. (1996) 91:1585–614. doi: 10.1111/j.1360-0443.1996.tb02264.x

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Kurt Beringer BW, Marx H. Zur klinik des haschischrausches. Nervenarzt. (1932) 5:33–41.

14. Rohleder C, Muller JK, Lange B, Leweke FM. Cannabidiol as a potential new type of an antipsychotic. A critical review of the evidence. Front Pharmacol. (2016) 7:422. doi: 10.3389/fphar.2016.00422

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Cassano T, Villani R, Pace L, Carbone A, Bukke VN, Orkisz S, et al. From cannabis sativa to cannabidiol: promising therapeutic candidate for the treatment of neurodegenerative diseases. Front Pharmacol. (2020) 11:124. doi: 10.3389/fphar.2020.00124

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Zhornitsky S, Potvin S. Cannabidiol in humans-the quest for therapeutic targets. Pharmaceuticals. (2012) 5:529–52. doi: 10.3390/ph5050529

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Mannucci C, Navarra M, Calapai F, Spagnolo EV, Busardò FP, Cas RD, et al. Neurological aspects of medical use of cannabidiol. CNS Neurol Disord Drug Targets. (2017) 16:541–53. doi: 10.2174/1871527316666170413114210

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Zuardi AW, Shirakawa I, Finkelfarb E, Karniol IG. Action of cannabidiol on the anxiety and other effects produced by delta 9-THC in normal subjects. Psychopharmacology. (1982) 76:245–50. doi: 10.1007/BF00432554

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Leweke FM, Schneider U, Radwan M, Schmidt E, Emrich HM. Different effects of nabilone and cannabidiol on binocular depth inversion in Man. Pharmacol Biochem Behav. (2000) 66:175–81. doi: 10.1016/S0091-3057(00)00201-X

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Englund A, Morrison PD, Nottage J, Hague D, Kane F, Bonaccorso S, et al. Cannabidiol inhibits THC-elicited paranoid symptoms and hippocampal-dependent memory impairment. J Psychopharmacol. (2013) 27:19–27. doi: 10.1177/0269881112460109

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Hindocha C, Freeman TP, Schafer G, Gardener C, Das RK, Morgan CJ, et al. Acute effects of delta-9-tetrahydrocannabinol, cannabidiol and their combination on facial emotion recognition: a randomised, double-blind, placebo-controlled study in cannabis users. Eur Neuropsychopharmacol. (2015) 25:325–34. doi: 10.1016/j.euroneuro.2014.11.014

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Bhattacharyya S, Morrison PD, Fusar-Poli P, Martin-Santos R, Borgwardt S, Winton-Brown T, et al. Opposite effects of delta-9-tetrahydrocannabinol and cannabidiol on human brain function and psychopathology. Neuropsychopharmacology. (2010) 35:764–74. doi: 10.1038/npp.2009.184

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Schubart CD, Sommer IE, van Gastel WA, Goetgebuer RL, Kahn RS, Boks MP. Cannabis with high cannabidiol content is associated with fewer psychotic experiences. Schizophr Res. (2011) 130:216–21. doi: 10.1016/j.schres.2011.04.017

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Morgan CJ, Curran HV. Effects of cannabidiol on schizophrenia-like symptoms in people who use cannabis. Br J Psychiatry. (2008) 192:306–7. doi: 10.1192/bjp.bp.107.046649

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Morgan CJ, Schafer G, Freeman TP, Curran HV. Impact of cannabidiol on the acute memory and psychotomimetic effects of smoked cannabis: naturalistic study: naturalistic study [corrected]. Br J Psychiatry. (2010) 197:285–90. doi: 10.1192/bjp.bp.110.077503

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Ilan AB, Gevins A, Coleman M, ElSohly MA, de Wit H. Neurophysiological and subjective profile of marijuana with varying concentrations of cannabinoids. Behav Pharmacol. (2005) 16:487–96. doi: 10.1097/00008877-200509000-00023

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Caspi A, Moffitt TE, Cannon M, McClay J, Murray R, Harrington H, et al. Moderation of the effect of adolescent-onset cannabis use on adult psychosis by a functional polymorphism in the catechol-O-methyltransferase gene: longitudinal evidence of a gene X environment interaction. Biol Psychiatry. (2005) 57:111–27. doi: 10.1016/j.biopsych.2005.01.026

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Caspi A, Moffitt TE. Gene-environment interactions in psychiatry: joining forces with neuroscience. Nat Rev Neurosci. (2006) 7:583–90. doi: 10.1038/nrn1925

CrossRef Full Text | Google Scholar

29. Grimm O, Loffler M, Kamping S, Hartmann A, Rohleder C, Leweke FM, et al. Probing the endocannabinoid system in healthy volunteers: cannabidiol alters fronto-striatal resting-state connectivity. Eur Neuropsychopharmacol. (2018) 28:841–9. doi: 10.1016/j.euroneuro.2018.04.004

CrossRef Full Text | Google Scholar

30. Janke W DG. Die Eigenschaftswörterliste (EWL-K)—Ein Verfahren zur Erfassung der Befindlichkeit. Göttingen: Hogrefe (1978).

31. Wechsler D. Wechsel Adult Intelligence Scale-Revised. New York, NY: The Psychological Corporation (1981).

Google Scholar

32. Brickenkamp R. d2 Aufmerksamkeits- Belastungs-Test. 4th ed. Göttingen: Verlag für Psychologie. Dr. C. J. Hogrefe (1972).

Google Scholar

33. R Core Team. R: A Language and Environment for Statistical Computing. Vienna: R Foundation for Statistical Computing (2015). Available online at: www.R-project.org

Google Scholar

34. Ruth Marcus EP, Gabriel KR. On closed testing procedures with special reference to ordered analysis of variance. Miometrika. (1967) 63:655–60. doi: 10.1093/biomet/63.3.655

CrossRef Full Text | Google Scholar

35. Karniol IG, Shirakawa I, Kasinski N, Pfeferman A, Carlini EA. Cannabidiol interferes with the effects of delta 9 - tetrahydrocannabinol in man. Eur J Pharmacol. (1974) 28:172–7. doi: 10.1016/0014-2999(74)90129-0

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Chadwick VL, Rohleder C, Koethe D, Leweke FM. Cannabinoids and the endocannabinoid system in anxiety, depression, and dysregulation of emotion in humans. Curr Opin Psychiatry. (2020) 33:20–42. doi: 10.1097/YCO.0000000000000562

CrossRef Full Text | Google Scholar

37. Zuardi AW, Cosme RA, Graeff FG, Guimaraes FS. Effects of ipsapirone and cannabidiol on human experimental anxiety. J Psychopharmacol. (1993) 7(Suppl. 1):82–8. doi: 10.1177/026988119300700112

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Bergamaschi MM, Queiroz RH, Chagas MH, de Oliveira DC, de Martinis BS, Kapczinski F, et al. Cannabidiol reduces the anxiety induced by simulated public speaking in treatment-naive social phobia patients. Neuropsychopharmacology. (2011) 36:1219–26. doi: 10.1038/npp.2011.6

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Crippa JA, Derenusson GN, Ferrari TB, Wichert-Ana L, Duran FL, Martin-Santos R, et al. Neural basis of anxiolytic effects of cannabidiol (CBD) in generalized social anxiety disorder: a preliminary report. J Psychopharmacol. (2011) 25:121–30. doi: 10.1177/0269881110379283

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Ashton CH. Pharmacology and effects of cannabis: a brief review. Br J Psychiatry. (2001) 178:101–6. doi: 10.1192/bjp.178.2.101

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Kleinloog D, Roozen F, de Winter W, Freijer J, Van Gerven J. Profiling the subjective effects of Delta(9)-tetrahydrocannabinol using visual analogue scales. Int J Methods Psychiatr Res. (2014) 23:245–56. doi: 10.1002/mpr.1424

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Cuttler C, Spradlin A, McLaughlin RJ. A naturalistic examination of the perceived effects of cannabis on negative affect. J Affect Disord. (2018) 235:198–205. doi: 10.1016/j.jad.2018.04.054

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Ranganathan M, D'Souza DC. The acute effects of cannabinoids on memory in humans: a review. Psychopharmacology. (2006) 188:425–44. doi: 10.1007/s00213-006-0508-y

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Leweke FM, Schneider U, Thies M, Münte TF, Emrich HM. Effects of synthetic Δ9-tetrahydrocannabinol on binocular depth inversion of natural and artificial objects in man. Psychopharmacology. (1999) 142:230–5. doi: 10.1007/s002130050884

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Curran HV, Brignell C, Fletcher S, Middleton P, Henry J. Cognitive and subjective dose-response effects of acute oral Delta 9-tetrahydrocannabinol (THC) in infrequent cannabis users. Psychopharmacology. (2002) 164:61–70. doi: 10.1007/s00213-002-1169-0

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Arkell TR, Lintzeris N, Kevin RC, Ramaekers JG, Vandrey R, Irwin C, et al. Cannabidiol (CBD) content in vaporized cannabis does not prevent tetrahydrocannabinol (THC)-induced impairment of driving and cognition. Psychopharmacology. (2019) 236:2713–24. doi: 10.1007/s00213-019-05246-8

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Spindle TR, Cone EJ, Schlienz NJ, Mitchell JM, Bigelow GE, Flegel R, et al. Acute effects of smoked and vaporized cannabis in healthy adults who infrequently use cannabis: a crossover trial. JAMA Netw Open. (2018) 1:e184841. doi: 10.1001/jamanetworkopen.2018.4841

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Morgan CJA, Freeman TP, Hindocha C, Schafer G, Gardner C, Curran HV. Individual and combined effects of acute delta-9-tetrahydrocannabinol and cannabidiol on psychotomimetic symptoms and memory function. Transl Psychiatry. (2018) 8:181. doi: 10.1038/s41398-018-0191-x

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Dittrich A, Battig K, von Zeppelin I. Effects of (-)delta 9-trans-tetrahydrocannabinol (delta 9-THC) on memory, attention and subjective state. A double blind study. Psychopharmacologia. (1973) 33:369–76. doi: 10.1007/BF00437515

PubMed Abstract | CrossRef Full Text | Google Scholar

50. Wesnes KA, Annas P, Edgar CJ, Deeprose C, Karlsten R, Philipp A, et al. Nabilone produces marked impairments to cognitive function and changes in subjective state in healthy volunteers. J Psychopharmacol. (2010) 24:1659–69. doi: 10.1177/0269881109105900

PubMed Abstract | CrossRef Full Text | Google Scholar

51. Hallak JE, Machado-de-Sousa JP, Crippa JA, Sanches RF, Trzesniak C, Chaves C, et al. Performance of schizophrenic patients in the stroop color word test and electrodermal responsiveness after acute administration of cannabidiol (CBD). Braz J Psychiatry. (2010) 32:56–61. doi: 10.1590/S1516-44462010000100011

PubMed Abstract | CrossRef Full Text | Google Scholar

52. Koethe D, Hoyer C, Leweke FM. The endocannabinoid system as a target for modelling psychosis. Psychopharmacology. (2009) 206:551–61. doi: 10.1007/s00213-009-1591-7

PubMed Abstract | CrossRef Full Text | Google Scholar

53. Broyd SJ, van Hell HH, Beale C, Yucel M, Solowij N. Acute and chronic effects of cannabinoids on human cognition-a systematic review. Biol Psychiatry. (2016) 79:557–67. doi: 10.1016/j.biopsych.2015.12.002

PubMed Abstract | CrossRef Full Text | Google Scholar

54. Rohleder C, Pahlisch F, Graf R, Endepols H, Leweke FM. Different pharmaceutical preparations of Delta(9) -tetrahydrocannabinol differentially affect its behavioral effects in rats. Addict Biol. (2020) 25:e12745. doi: 10.1111/adb.12745

PubMed Abstract | CrossRef Full Text | Google Scholar

55. Leweke FM, Piomelli D, Pahlisch F, Muhl D, Gerth CW, Hoyer C, et al. Cannabidiol enhances anandamide signaling and alleviates psychotic symptoms of schizophrenia. Transl Psychiatry. (2012) 2:e94. doi: 10.1038/tp.2012.15

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: cannabinoids, cannabis, tetrahydrocannabinol, cannabidiol, healthy subjects, model psychosis, rct

Citation: Woelfl T, Rohleder C, Mueller JK, Lange B, Reuter A, Schmidt AM, Koethe D, Hellmich M and Leweke FM (2020) Effects of Cannabidiol and Delta-9-Tetrahydrocannabinol on Emotion, Cognition, and Attention: A Double-Blind, Placebo-Controlled, Randomized Experimental Trial in Healthy Volunteers. Front. Psychiatry 11:576877. doi: 10.3389/fpsyt.2020.576877

Received: 27 June 2020; Accepted: 15 October 2020;
Published: 13 November 2020.

Edited by:

Sinan Guloksuz, Maastricht University Medical Centre, Netherlands

Reviewed by:

Jose M. Trigo, Battelle, United States
Hubertus Himmerich, King's College London, United Kingdom

Copyright © 2020 Woelfl, Rohleder, Mueller, Lange, Reuter, Schmidt, Koethe, Hellmich and Leweke. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: F. Markus Leweke, markus.leweke@sydney.edu.au

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.