Verbal Memory Impairment in Patients with Subsyndromal Bipolar Disorder

Backgrounds: Several domains of cognitive function, including learning memory and executive function, are impaired in mood disorders. Also, the relationship between disturbances of these two cognitive domains has been suggested. In line with the recent initiative to establish a standard measure of cognitive decline in bipolar disorder, the present study was conducted to (1) test the criterion-related validity and test–retest reliability of the California Verbal Learning Test (CVLT)-II Japanese version, and (2) determine if type of word learning tasks (i.e., with or without a category structure) affects severity of verbal memory deficits in patients with subsyndromal bipolar disorder.

Methods: Thirty-six patients with bipolar disorder with mild symptoms and 42 healthy volunteers participated in the study. We first compared effect sizes for memory deficits in patients among the CVLT-II, Brief Assessment of Cognition in Schizophrenia (BACS), and Hopkins Verbal Memory Tests-Revised (HVLT-R). We next evaluated the correlations between scores of the CVLT-II vs. those of the BACS and HVLT-R. Bipolar patients were re-assessed with the same (standard) or alternate forms of the CVLT-II and HVLT-R 1 month later.

Results: Scores on the CVLT-II 1–5 Free Recall and Long-delay Free Recall, as well as the HVLT-R Immediate Recall, but not the BACS List Learning were significantly lower for patients compared to control subjects. The effect sizes for cognitive decline due to the illness were comparable when measured by the CVLT-II and HVLT-R, ranging from 0.5 to 0.6. CVLT-II scores were significantly correlated with those of the HVLT-R and BACS. Test–retest reliability of the CVLT-II was acceptable, and no significant practice effect was observed when the alternate form was used. There was no consistent relationship between mood symptoms and performance on the CVLT-II.

Conclusion: These results suggest the CVLT-II Japanese version is able to discriminate between bipolar disorder patients and healthy controls with good sensitivity and validity. Data in this study also indicate that the degree of verbal memory deficits in bipolar disorder may be influenced by memory organizational strategy.

Introduction

Bipolar disorder is associated with poor psychosocial outcome not only in the manic or depressive state, but also in the subsyndromal state (1–3). Patients with the illness demonstrate impairments in several cognitive domains even during the euthymic phase (4). The profile of cognitive disturbances of bipolar disorder has been reported to be similar to that of schizophrenia (5–7), with less severity. Thus, the effect size of euthymic patients ranges from 0.4 to 0.7 compared to healthy controls (8). Specifically, Martínez-Arán et al. (9) demonstrated that duration of illness, a history of psychotic symptoms, number of hospitalizations, manic episodes, and suicide attempts were positively related to cognitive impairments. Importantly, cognitive impairments have been suggested to predict poor psychosocial outcome in bipolar disorder patients (10–12).

There may be interactions in the disturbances of key cognitive domains in bipolar disorder. For example, the contribution of executive function to learning memory has been reported in patients with the disease (13). Specifically, Deckersbach et al. (13) report that verbal learning memory deficits are mediated by semantic clustering encoding (memory organization) strategies. This finding may be important in understanding the nature of cognitive impairment of mood disorders.

To evaluate verbal memory in subjects with bipolar disorder, several tasks, including the Brief Assessment of Cognition in Schizophrenia (BACS) (14), Hopkins Verbal Learning Test-Revised (HVLT-R) (15), and the California Verbal Learning Test (CVLT) (16, 17) have been used. For example, the CVLT has been recommended to assess verbal learning in bipolar disorder (16). In this line, the reliability of the CVLT-II has been reported to be acceptable with good internal consistency, whose normative data have been shown to be more representative of the general population than that for the CVLT (18).

The effect size of cognitive decline in euthymic patients ranges from 0.66 to 0.90 (19). As verbal (learning) memory provides one of the important domains of cognition in psychiatric diseases (20), it is worthwhile to explore which factors contribute to its impairment in bipolar patients whose mood symptoms are not so eminent. Since executive function, another pivotal domain of cognition related to frontal lobe function, is impaired in euthymic bipolar patients (21), it is hypothesized that verbal memory deficits become evident when assessed with word list tasks that require memory organizational strategy, but not those that do not require it.

The main purpose of this study was to investigate the impact of memory organizational strategies on verbal (learning) memory, as measured by performance on word list tasks, in patients with bipolar disorder. For this aim, we sought to determine whether the CVLT-II and HVLT-R, but not the BACS would be able to discriminate between patients with subsyndromal bipolar disorder and normal control subjects. This is based on the assumption that only the former two tasks require subjects to use memory organization. Additionally, we investigated the validity and reliability of the Japanese version of CVLT-II using the BACS List Learning and HVLT-R as reference measures of verbal learning and memory. Preliminary analyses of the present data have been reported (22, 23).

Materials and Methods

Subjects

This was a multi-center collaborative study, whose design, characteristics of participants, and other information have been registered (UMIN ID: 000013623). The sample consisted of 78 participants; 36 individuals with bipolar disorder and 42 healthy control participants who were native Japanese and had no history of psychiatric disorders (Table 1). Bipolar disorder patients were diagnosed by clinicians according to DSM-IV criteria and showed a subsyndromal or non-significant clinical level of severity of mood symptoms, i.e., ratings with the Montgomery–Asberg Depression Rating Scale (MADRS) ≤14 and the Young Mania Rating Scale (YMRS) ≤14 (24). The patients were recruited from the National Center of Neurology and Psychiatry Hospital, Fujita Health University Hospital, Nagoya University Hospital and Hokkaido University Hospital. Healthy volunteers as a control group were recruited from the local community. They were matched with bipolar disorder patients in terms of age and sex (Table 1). There were no between-group differences in educated years and premorbid IQ estimated using the Japanese Adult Reading Test (25). Patients with comorbid neurological illness, previous traumatic brain injury with any known cognitive consequences or loss of consciousness for more than 5 min, or alcohol/substance abuse or addiction (except nicotine) were excluded. Six patients had a history of suicide attempt and two received electroconvulsive therapy. The patients were taking lamotrigine (for 16 cases), lithium (15), aripiprazole (14), valproate (11), quetiapine (9), olanzapine (3), carbamazepine (2), risperidone (2), sertraline (2) and levomepromazine (2), chlorpromazine (1), duloxetine (1), and maprotiline (1).

TABLE 1

Table 1. Clinical and demographic variables (mean ± SD).

Written consent was obtained from all participants, according to ethics guidelines set out by each participating site. The study protocol was approved by the ethics committees of participating institutions.

The Study Design

The subjects were administered three verbal learning tests twice with an interval of approximately 1 month. Mood symptoms were also assessed each time using the MADRS and YMRS. The CVLT-II, BACS, and HVLT-R forms were switched to alternate forms in 43 subjects (from Nagoya University Hospital and Hokkaido University Hospital) at the follow-up (19 patients and 24 controls), whereas 35 subjects (from National Center of Neurology and Psychiatry Hospital and Fujita Health University Hospital) were administered the same standard form at the follow-up (17 patients and 18 controls) as at the baseline. The same raters performed these cognitive tests at baseline and the 1-month follow-up assessments.

Development of the CVLT-II Japanese Version

To develop a Japanese version of the CVLT-II (26), one of the authors (Tomiki Sumiyoshi) translated the original CVLT-II from English to Japanese. Afterward, a person isolated from the translator performed a back-translation. Modifications of some terms were made to fit the local culture. The back-translation of the English version was approved by Pearson Education, Inc., the copyright owner.

Measures of Verbal Learning

California Verbal Learning Test-II

The CVLT-II measures both recall and recognition abilities using two word lists. In the first five trials, immediately after presentation of List A, the subject is asked to recall the words of the list. List A contains 4 words from each of 4 semantic categories, for a total of 16 words. This procedure enables evaluation of semantic clustering ability, the most effective strategy for learning non-systemized verbal information. Subsequently, an interference list (List B) containing 16 words is presented, followed by a recall test. The interference test is followed by a short-delay free recall test and a short-delay cued recall test using List A. Then, following 20-min interval, a long-delay free recall test, long-delay cued recall test, and yes/no recognition test are administered using List A. After the yes/no recognition test, a new approximately 10-min forced-choice recognition test is arbitrarily administered. In the present study, data obtained in the immediate recall test after the first five trials of List A (“1–5 free recall”) and a long-delay free recall test were adopted for analyses, which were the candidate measures to be incorporated in the International Society for Bipolar Disorders-Battery for Assessment of Neurocognition (4). We basically intended to use standardized measure for all cognitive tests; however, since it is not available only for the CVLT-II (Japanese version), we used raw scores for this test.

HVLT-R

The HVLT-R consists of a word list, containing 3 words from one of 4 semantic categories, for a total of 12 words. In the first three trials, immediately after presentation of the word list, the subject is asked to recall the words of the list. Subsequently, following a 20–25-min interval, a delayed recall test is administered. Immediately after the delayed recall test, a forced-choice recognition test is administered. In the present study, the delayed recall test and forced-choice recognition test were not included for brevity, and only a standardized measure in the immediate recall test after the first three trials was adopted for analyses, which is used in the MATRICS Consensus Cognitive Battery (the standardized measure was obtained by using the mean level of 28.2 and the SD of 4.3).

Brief Assessment of Cognition in Schizophrenia

The BACS List Learning test consists of a word list, containing 15 words. The subject is asked to recall the words of the list immediately after presentation of the word list, which was repeated five times. The words in the list were not semantically organized unlike the case in the CVLT-II and HVLT-R. In the present study, a standardized measure in the immediate recall test after the first five trials was adopted for analyses. (The standardized measure was obtained by using the mean level of 49.2 and the standard deviation of 9.9.) (27).

Statistical Analysis

Student’s t-test was performed to explore between-group differences for CVLT-II 1–5 free recall scores and long-delay free recall scores, HVLT-R immediate recall scores, and BACS list learning scores at baseline. If a significant between-group difference in either measure was found, the effect size was calculated using a Cohen’s d to explore its sensitivity. To examine the effect of mood symptoms, Spearman’s rank correlation was performed between CVLT-II 1–5 free recall or long-delay free recall scores vs. MADRS and YMRS scores. Test–retest reliability was evaluated using intraclass correlation coefficient (ICC) (28) between scores at baseline and 1-month follow-up for each measure. In addition, practice effect was evaluated using repeated measures ANOVA using “time” as an intra-individual factor and “Group” and “type (A-A, A-B)” as inter-individual factors. Secondary analyses were performed when a significant interaction between the factors was obtained.

To examine the criterion-related validity of the CVLT-II measures, Pearson’s product-moment correlation among scores of the CVLT-II 1–5 Free Recall and Long-Delay Free Recall, HVLT-R Immediate Recall, and BACS List Learning was calculated for patients.

Results

Between-Group Comparison of Verbal Learning Measures

Student’s t-test revealed a significant between-group difference for the CVLT-II 1–5 Free Recall (t = −2.28, P = 0.025) and Long-Delay Free Recall (t = −2.04, P = 0.035), and HVLT-R Immediate Recall (t = −2.47, P = 0.016), but not the BACS List Learning (t = −1.58, n.s.) (Figure 1). The effect sizes of performance on the measures that showed between-group differences were 0.52, 0.46, and 0.56, respectively. Significant positive correlations were noted between ratings with the MADRS vs. scores of the CVLT-II 1–5 Free Recall (Rho = 0.36, P = 0.029), and Long-Delay Free Recall (Rho = 0.34, P = 0.044). On the other hand, performances on these CVLT measures were not correlated with YMRS scores (1–5 Free Recall, Rho = 0.12, n.s.; Long-Delay Free Recall, Rho = 0.03, n.s.).

FIGURE 1

Figure 1. Between-group comparisons in performance on (A) the California Verbal Learning Test-II 1–5 free recall and long-delay free recall (presented in raw score), and (B) the Brief Assessment of Cognition in Schizophrenia (BACS) list learning and HVLT-R immediate recall (presented in z-score).

Test–Retest Reliability and Practice Effect of Verbal Learning Measures

The ICCs between the baseline and 1-month follow-up scores for the BACS List Learning, HVLT-R Immediate Recall, CVLT-II 1–5 Free Recall and Long-Delay Free Recall are summarized in Table 2. Good to excellent test–retest reliability was noted in most of the measures.

TABLE 2

Table 2. Intraclass correlation coefficients between the baseline and 1-month follow-up scores.

Practice Effects

A significant main effect of “group” (F [1, 74] = 6.58, P = 0.012) and “time” (F [1, 74] = 21.44, P < 0.0001) and a significant “type” × “time” interaction (F [1, 74] = 8.26, P = 0.005) were found on scores of the BACS List Learning (Figure 2). Accordingly, a secondary analysis was performed for each “type,” which revealed a significant main effect of “time” in type A-A (F [1, 33] = 49.60, P < 0.0001), but not type A-B (F [1, 41] = 1.23, n.s.). As for the HVLT-R, there was a significant main effect of “group” (F [1, 74] = 10.05, P = 0.002), while “time” effect did not reach a significant level (F [1, 74] = 3.94, P = 0.051). A secondary analysis for each “group” revealed no significant main effect of “time” or “time” × “type” interaction in either healthy controls (“time”: F [1, 40] = 0.84, n.s.; “time” × “type” interaction: F [1, 40] = 0.00, n.s.) or bipolar disorder patients (“time”: F [1, 34] = 2.56, n.s.; “time” × “type” interaction: F [1, 34] = 2.90, P = 0.097). Repeated measures ANOVA for CVLT-II 1–5 Free Recall revealed a significant effect of “group” (F [1, 74] = 8.24, P = 0.005) and “time” (F [1, 74] = 27.97, P < 0.0001). “Type” × “time” interaction was also significant (F [1, 74] = 28.42, P < 0.0001). Therefore, secondary analysis for each “type” was performed. There was a significant effect of “time” in type A-A (F [1, 33] = 67.71, P < 0.0001), but not type A-B (F [1, 41] = 0.00, n.s.). In addition, “group” × “time” interaction was not significant in either “type” (type A-A: F [1, 33] = 0.02, n.s.; type A-B: F [1, 41] = 1.94, n.s.). As for CVLT-II Long-Delay Free Recall, “group” effect (F [1, 74] = 6.76, P = 0.011) and “time” effect (F [1, 74] = 11.47, P = 0.001), as well as “type” × “time” interaction (F [1, 74] = 4.68, P = 0.034) were significant. Also, “group” × “type” × “time” interaction was significant (F [1, 74] = 6.37, P = 0.014). A secondary analysis revealed a significant effect of “time” in type A-A (F [1, 33] = 17.21, P = 0.0002), but not type A-B (F [1, 41] = 0.72, n.s.). Moreover, “group” × “time” interaction was not significant in either pattern (type A-A: F [1, 33] = 2.87, n.s.; type A-B: F [1, 41] = 3.72, n.s.).

FIGURE 2

Figure 2. Test–retest performance on (A) the Brief Assessment of Cognition in Schizophrenia (BACS) list learning and (B) HVLT-R immediate free recall (presented in z-score), and (C) CVLT-II 1–5 free recall and (D) delayed free recall (presented in raw score) in bipolar disorder patients and healthy controls. A-A, standard form–standard form pattern; A-B, standard form–alternate form pattern.

Criterion-Related Validity

The criterion-related validity of the CVLT-II 1–5 Free Recall and Long-Delay Free Recall tasks were examined using the HVLT-R Immediate Recall and BACS List Learning tasks in patients with bipolar disorder. Pearson’s product-moment correlation coefficients ranged from 0.68 to 0.81.

Discussion

The CVLT-II Japanese version and HVLT-R, but not BACS were found to discriminate between bipolar disorder patients and healthy individuals with a sensitivity comparable to that of the HVLT-R. Strong correlations with performances on the BACS List Learning and HVLT-R Immediate Recall suggest a good criterion-related validity of the CVLT-II as a tool to detect cognitive disturbances in patients with bipolar disorder. There was no consistent relationship between mood symptoms and performance on the CVLT-II in the subsyndromal patients.

Between-Group Differences

Interestingly, between-group differences were significant in scores of the CVLT-II 1–5 Free Recall and Long-Delay Free Recall, and HVLT-R Immediate Recall, but not BACS List Learning. One of the reasons may be that the word lists in the CVLT-II and HVLT-R are semantically organized while this is not the case with the BACS. It may be that bipolar disorder patients show impairment in semantic clustering, in agreement with previous suggestions that the impairment in verbal organizational strategies causes the difficulty in recalling words (13, 29).

The patient–control effect size of the CVLT-II 1–5 Free Recall (0.52) was smaller than those previously reported using the CVLT (0.73–0.82) (4). Meanwhile, the effect size for the HVLT-R Immediate Recall (0.56) was slightly larger than that reported in Schretlen et al. (30) for bipolar disorder patients (0.42) (30). The overall performance on the CVLT-II 1–5 Free Recall at baseline (0.73 for the healthy controls and 0.65 for the bipolar disorder patients) were still worse than that in the HVLT-R Immediate Recall (0.76 and 0.69), suggesting a satisfactory level of cognitive demands of the CVLT-II.

Test–Retest Reliability and Practice Effect of Verbal Learning Measures

We found moderate to good test–retest reliability in both CVLT-II 1–5 Free Recall and Long-Delay Free Recall scores in bipolar disorder patients and healthy controls. In a previous investigation on the CVLT-II,¹⁷ the reliability coefficients ranged from 0.72 to 0.79 in a sample of 288 healthy subjects, with a median interval of 21 days, similar to the ICC for the CVLT-II 1–5 free recall in healthy controls using an alternate form (0.70) in the present study (Table 2). Interestingly, the HVLT-R Immediate Recall generally showed greater ICC values than the other tests, attaining a good to excellent level.

Criterion-Related Validity

Both CVLT-II 1–5 Free Recall and Long-Delay Free Recall scores showed strong correlation with either the BACS List Learning or HVLT-R Immediate Recall scores, suggesting good criterion-related validity.

Relationship of Performance on the CVLT-II with Mood Symptoms

Meta-analytic studies generally report that bipolar patients with the more severe depressive or manic symptoms are likely to show the worse performance on tests of learning and memory [reviewed in Ref. (19)]. On the other hand, the lack of a significant relationship between manic symptoms, measured by the YMRS, and performance on the CVLT-II, reported here, may be related to the inclusion of subsyndromal patients. The positive correlations between ratings with the MADRS and CVLT-II scores, obtained in this study, seem somewhat contradictory and might be also due to the nature of the subjects studied.

Task-Specific Decline in Memory Performance in Bipolar Disorder

The CVLT-II is characterized by the (four category)/(four words per category) structure (26), while the HVLT-R consist of (three category)/(four words per category) (15). On the other hand, the BACS List Learning does not have such “internal category” structure. This difference may provide a major reason why only the former two tasks were able to discriminate between patients and control subjects. This concept may be partly supported by Deckersbach et al. (13), who found the contribution of memory organizational strategy to poor performance on the Long-Delay Free Recall Task of the CVLT. Further studies with data from other psychiatric conditions would help understand the nature of cognitive impairment of mood disorders.

Limitations

Unlike previous studies, patients with bipolar disorder studied here were not necessarily in the euthymic state, although all met the subsyndromal state criterion. There is a possibility that the patient-control effect sizes may have been overestimated due to residual depressive symptoms. However, a positive correlation between rating with the MADRS vs. CVLT-II 1–5 Free Recall and Long-Delay Free Recall scores may argue against this view.

Conclusion

The Japanese version of CVLT-II appeared to provide valid measures of verbal learning and memory function in bipolar disorder patients. The ability of the CVLT-II and HVLT-R, but not BACS List Learning, to discriminate between patients and control subjects may be related to the use of memory organization strategy specific to the CVLT-II and HVLT-R, which deserves further study.

Ethics Statement

This study was carried out in accordance with the recommendations of “name of guidelines, name of committee” with written informed consent from all subjects. All subjects gave written informed consent in accordance with the Declaration of Helsinki. The protocol was approved by ethics committees of the National Center of Neurology and Psychiatry Hospital, Fujita Health University Hospital, Nagoya University Hospital, and Hokkaido University Hospital.

Author Contributions

Contributions of each author are as follows: conception and design of the study (TS); acquisition of data (AT, NK, TK, IK, NO, and NI); analysis of data (KN and KS); and drafting of the manuscript (KN and TS).

Conflict of Interest Statement

There are no conflicts of interest for any of the authors of this paper. No author has any possible financial gain for the findings presented here.

Acknowledgments

This study was funded by the Labour Sciences Research Grants for Comprehensive Research on Disability, Health, and Welfare (H24-Seishin-Ippan-002 and H26-Seishin-Ippan-011), Intramural Research Grant for Neurological and Psychiatric Disorders of NCNP (27-1), and Japan Society for the Promotion of Science Grant-in-Aid for Scientific Research (C) No 17K10321.

References

1. MacQueen GM, Youngm LT, Joffe RT. A review of psychosocial outcome in patients with bipolar disorder. Acta Psychiatr Scand (2001) 103:163–70. doi:10.1034/j.1600-0447.2001.00059.x

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Huxley N, Baldessarini RJ. Disability and its treatment in bipolar disorder patients. Bipolar Disord (2007) 9:183–96. doi:10.1111/j.1399-5618.2007.00430.x

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Carlson GA, Kotin J, Davenport YB, Adland M. Follow-up of 53 bipolar manic-depressive patients. Br J Psychiatry (1974) 124:134–9. doi:10.1192/bjp.124.2.134

CrossRef Full Text | Google Scholar

4. Yatham LN, Torres IJ, Malhi GS, Frangou S, Glahn DC, Bearden CE, et al. The International Society for Bipolar Disorders-Battery for Assessment of Neurocognition (ISBD-BANC). Bipolar Disord (2010) 12:351–63. doi:10.1111/j.1399-5618.2010.00830.x

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Seidman LJ, Kremen WS, Koren D, Faraone SV, Goldstein JM, Tsuang MT. A comparative profile analysis of neuropsychological functioning in patients with schizophrenia and bipolar psychoses. Schizophr Res (2002) 53:31–44. doi:10.1016/S0920-9964(01)00162-1

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Kuswanto CN, Sum MY, Sim K. Neurocognitive functioning in schizophrenia and bipolar disorder: clarifying concepts of diagnostic dichotomy vs. continuum. Front Psychiatry (2013) 4:162. doi:10.3389/fpsyt.2013.00162

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Sánchez-Morla EM, Barabash A, Martínez-Vizcaíno V, Tabarés-Seisdedos R, Balanzá-Martínez V, Cabranes-Díaz JA, et al. Comparative study of neurocognitive function in euthymic bipolar patients and stabilized schizophrenic patients. Psychiatry Res (2009) 169:220–8. doi:10.1016/j.psychres.2008.06.032

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Mann-Wrobel MC, Carreno JT, Dickinson D. Meta-analysis of neuropsychological functioning in euthymic bipolar disorder: an update and investigation of moderator variables. Bipolar Disord (2011) 13:334–42. doi:10.1111/j.1399-5618.2011.00935.x

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Martínez-Arán A, Vieta E, Reinares M, Colom F, Torrent C, Sánchez-Moreno J, et al. Cognitive function across manic or hypomanic, depressed, and euthymic states in bipolar disorder. Am J Psychiatry (2004) 161:262–70. doi:10.1176/appi.ajp.161.2.262

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Tabarés-Seisdedos R, Balanzá-Martínez V, Sánchez-Moreno J, Martinez-Aran A, Salazar-Fraile J, Selva-Vera G, et al. Neurocognitive and clinical predictors of functional outcome in patients with schizophrenia and bipolar I disorder at one-year follow-up. J Affect Disord (2008) 109:286–99. doi:10.1016/j.jad.2007.12.234

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Mur M, Portella MJ, Martinez-Aran A, Pifarre J, Vieta E. Influence of clinical and neuropsychological variables on the psychosocial and occupational outcome of remitted bipolar patients. Psychopathology (2009) 42:148–56. doi:10.1159/000207456

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Laes JR, Sponheim SR. Does cognition predict community function only in schizophrenia? A study of schizophrenia patients, bipolar affective disorder patients, and community control subjects. Schizophr Res (2006) 84:121–31. doi:10.1016/j.schres.2005.11.023

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Deckersbach T, Savage CR, Reilly-Harrington N, Clark L, Sachs G, Rauch SL. Episodic memory impairment in bipolar disorder and obsessive-compulsive disorder: the role of memory strategies. Bipolar Disord (2004) 6:233–44. doi:10.1111/j.1399-5618.2004.00118.x

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Keefe RS, Goldberg TE, Harvey PD, Gold JM, Poe MP, Coughenour L.The brief assessment of cognition in schizophrenia: reliability, sensitivity, and comparison with a standard neurocognitive battery. Schizophr Res (2004) 68:283–97. doi:10.1016/j.schres.2003.09.011

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Nuechterlein KH, Green MF, Kern RS, Baade LE, Barch DM, Cohen JD, et al. The MATRICS consensus cognitive battery, part 1: test selection, reliability, and validity. Am J Psychiatry (2008) 165:203–13. doi:10.1176/appi.ajp.2007.07010042

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Delis DC, Kramer JH, Kaplan E, Ober BA. California Verbal Learning Test. San Antonio, TX: Psychological Corporation (1987).

Google Scholar

17. Delis DC, Kramer JH, Kaplan E, Ober BA. California Verbal Learning Test. 2nd ed. San Antonio, TX: Psychological Corporation (2000).

Google Scholar

18. Delis DC, Kramer JH, Kaplan E, Ober BA. CVLT-II, California Verbal Learning Test Second Edition-Adult Version Manual. San Antonio, TX: Psychological Corporation (2000).

Google Scholar

19. Tsitsipa E, Fountoulakis KN. The neurocognitive functioning in bipolar disorder: a systematic review of data. Ann Gen Psychiatry (2015) 1:14–42. doi:10.1186/s12991-015-0081-z

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Sumiyoshi T. Verbal memory. Handb Exp Pharmacol (2015) 228:237–47. doi:10.1007/978-3-319-16522-6_8

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Oertel-Knöchel V, Reinke B, Alves G, Jurcoane A, Wenzler S, Prvulovic D, et al. Frontal white matter alterations are associated with executive cognitive function in euthymic bipolar patients. J Affect Disord (2014) 155:223–33. doi:10.1016/j.jad.2013.11.004

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Sumiyoshi T, Toyomaki A, Kawano N, Kitajima T, Kusumi I, Ozaki N, et al. Verbal memory impairments in bipolar disorder; effect of type of word learning tasks. Psychiatry Clin Neurosci (2017) 71:570–1. doi:10.1111/pcn.12536

CrossRef Full Text | Google Scholar

23. Sumiyoshi T, Toyomaki A, Kawano N, Kitajima T, Kusumi I, Ozaki N, et al. Reliability and validity of the California verbal learning test-II – Japanese version. Psychiatry Clin Neurosci (2017) 71:417–8. doi:10.1111/pcn.12525

CrossRef Full Text | Google Scholar

24. Tohen M, Frank E, Bowden CL, Colom F, Ghaemi SN, Yatham LN, et al. The International Society for Bipolar Disorders (ISBD) task force report on the nomenclature of course and outcome in bipolar disorders. Bipolar Disord (2009) 11:453–73. doi:10.1111/j.1399-5618.2009.00726.x

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Matsuoka K, Uno M, Kasai K, Koyama K, Kim Y. Estimation of premorbid IQ in individuals with Alzheimer’s disease using Japanese ideographic script (Kanji) compound words: Japanese version of national adult reading test. Psychiatry Clin Neurosci (2006) 60:332–9. doi:10.1111/j.1440-1819.2006.01510.x

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Sumiyoshi T. California Verbal Learning Test. 2nd ed. San Antonio, TX: Psychological Corporation (2014).

Google Scholar

27. Kaneda Y, Sumiyoshi T, Nakagome K. Evaluation of cognitive functions in a normal population in Japan using the brief assessment of cognition in schizophrenia Japanese version. Clin Psychiatry (2013) 55:167–75.

Google Scholar

28. Kenneth O, Wong SP. Forming inferences about some intraclass correlation coefficients. Psychol Methods (1996) 1:30–4. doi:10.1037/1082-989X.1.1.30

CrossRef Full Text | Google Scholar

29. Ha TH, Kim JS, Chang JS, Oh SH, Her JY, Cho HS, et al. Verbal and visual memory impairments in bipolar I and II disorder. Psychiatry Investig (2012) 9:339–46. doi:10.4306/pi.2012.9.4.339

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Schretlen DJ, Cascella NG, Meyer SM, Kingery LR, Testa SM, Munro CA, et al. Neuropsychological functioning in bipolar disorder and schizophrenia. Biol Psychiatry (2007) 62:179–86. doi:10.1016/j.biopsych.2006.09.025

PubMed Abstract | CrossRef Full Text | Google Scholar