Skip to main content

REVIEW article

Front. Neurol., 31 August 2021
Sec. Dementia and Neurodegenerative Diseases

Overview of the Complex Figure Test and Its Clinical Application in Neuropsychiatric Disorders, Including Copying and Recall

\nXiaonan ZhangXiaonan ZhangLiangliang LvLiangliang LvGuowen MinGuowen MinQiuyan WangQiuyan WangYarong ZhaoYarong ZhaoYang Li
Yang Li*
  • Department of Neurology, First Hospital of Shanxi Medical University, Taiyuan, China

The Rey–Osterrieth Complex Figure (ROCF) test is a commonly used neuropsychological assessment tool. It is widely used to assess the visuo-constructional ability and visual memory of neuropsychiatric disorders, including copying and recall tests. By drawing the complex figure, the functional decline of a patient in multiple cognitive dimensions can be assessed, including attention and concentration, fine-motor coordination, visuospatial perception, non-verbal memory, planning and organization, and spatial orientation. This review first describes the different versions and scoring methods of ROCF. It then reviews the application of ROCF in the assessment of visuo-constructional ability in patients with dementia, other brain diseases, and psychiatric disorders. Finally, based on the scoring method of the digital system, future research hopes to develop a new digital ROCF scoring method combined with machine learning algorithms to standardize clinical practice and explore the characteristic neuropsychological structure information of different disorders.

Introduction

The Complex Figure Test was first designed by (1) in 1941 and then standardized by (2) in 1944, which provided preliminary standardized data for 230 children and 60 adults to form the widely used Rey–Osterrieth Complex Figure (ROCF) test (Figure 1A). The ROCF is mainly used to evaluate visuo-constructional ability and non-verbal memory in clinical practice and research. It includes immediate copy and delayed recall. Subjects copy complex geometric shapes and then reproduce them from memory. The neuropsychological dysfunction of a subject can be assessed by drawing performance, including attention and concentration, fine-motor coordination, visuospatial perception, non-verbal memory, planning and organization, and spatial orientation (3, 4). Graphomotor impressions are a product of complex cognition, perception, and motor skills (5). Moreover, graphics rendering makes the task more complicated, which involves organizing graphics into meaningful perceptual units. Therefore, ROCF is widely used to study the neural relevance of structural functions in healthy individuals and the mapping disorders of patients with dementia and other brain diseases (610).

FIGURE 1
www.frontiersin.org

Figure 1. Equivalent and simplified versions of Rey–Osterrieth Complex Figure (ROCF). In 1941, Rey developed the classic ROCF (A). To avoid the learning effect by using the same figure twice, some studies have developed multiple equivalent versions of the ROCF, such as the Taylor figure (B), the modified Taylor figure (C), the Mark figure (D), and various versions of the Medical College of Georgia Complex Figures (E–H). Subsequently, multiple simplified versions of ROCF (I, K, L) were developed. The Benson figure (I) is less affected by executive function. (K) has been proven to be suitable for the elderly. Kim developed (L) for digital assessment tools. Similarly, the simplified Taylor figure (J) has also been confirmed to suit the low-educated elderly.

Versions of Complex Figure Test

Equivalent Versions

At present, multiple equivalent and simplified versions of ROCF have been developed for different research purposes. The ROCF was initially used as a tool to assess the visuospatial abilities of brain injury, such as before and after the evaluation of the efficacy of brain trauma surgery, medication, and rehabilitation (11, 12). To avoid the learning effect of using the same figure twice, some studies have tried to develop multiple equivalent versions of the ROCF. In 1969 (13), developed a complex figure (Taylor figure; Figure 1B) as a postoperative memory test to study the influence of left and right temporal lobe resection on non-verbal task recall and recognition test, while the ROCF is a preoperative memory test. However, some studies have found that the Taylor figure is easier to organize and learn than the ROCF and is easier to remember in the recall. Tombaugh and Hubley (14) found that they produced similar scores in copying, but the Taylor figure had higher scores in recall. He further analyzed the differences in recall and interpreted it as the Taylor figure being easier to describe and memory-encode.

To solve this problem, Hubley reduced some distinct parts of the Taylor figure, added some lines to increase the complexity of the visual test, and adjusted the position of characteristic details. A subsequent verification of the equivalence between the modified Taylor figure (Figure 1C) and the ROCF shows that they have the same complexity in evaluating visual–spatial construction and visual memory (15). Some researchers have also developed the Mark figure (Figure 1D) (16) and various versions of the Medical College of Georgia Complex Figures (Figures 1E–H) (17, 18) and found that there was no significant difference between them and the ROCF in the copy and recall scores. It indicated that they are comparable and can be used interchangeably in clinical practice.

Simplified Versions

With the use of the ROCF and its equivalent versions in clinical practice, its shortcomings have gradually emerged (7, 1921). First, the standard of ROCF copying and recall of the elderly is very low. Twenty-seven points (total score of 36 points) is considered the expected standard, which is in the first percentile among 55–59 years old (19). Second, with the improvement of education level, the scores of immediate copy, delayed recall, and recognition of ROCF increased significantly (7, 21). Therefore, the educational level should be stratified when formulating the cutoff value of the scale. Third, when the mapping task is used for low-educated people (illiterate), the ability to distinguish between patients and non-patients will be lost (20). One should also be careful of the interpretation of the results of complex drawing tasks, even if the level of education is stratified. Some studies have developed multiple simplified versions of the ROCF to solve the above-mentioned problems. Poreh et al. (22) developed a simplified ROCF (Figure 1K) and found that its copying, recall, and strategy scores are well-distributed among healthy older people (over 60 years old), indicating that it is more suitable for the elderly than the classical ROCF. Similarly, de Paula et al. (23) developed a simplified Taylor figure (Figure 1J) and verified the validity and the reliability of its assessment of the visuospatial ability of the low-educated elderly (primary school). It was found that the figure had a high internal consistency for the copy (0.89), immediate recall (0.97), and delayed recall (0.96) components, providing evidence of test reliability, and had a significant correlation with Stick Design Test and DRS Constructional Praxis. It was suitable for the low-educated elderly.

Besides this, to reduce the impact of executive function on the ROCF replication performance (24), used a simplified ROCF (Benson figure, developed by Frank Benson, M.D; Figure 1I) to explore the difference in visuospatial impairment between Alzheimer's disease and behavioral variant frontotemporal dementia. It could distinguish them well (24). To also extract the parameters stably and accurately in digital and automated CFT assessment tool development (25), developed a simplified ROCF (Figure 1L). The figure has few strokes and is not easy to overlap in a small space.

In short, researchers can choose different equivalent and simplified versions of the ROCF according to various research objects and purposes and further promote the clinical application of the Complex Figure Test.

FIGURE 2
www.frontiersin.org

Figure 2. The 18 scoring units of the Rey–Osterrieth Complex Figure.

Clinical Application of Complex Figure Test

Traditional Scoring Methods

More than a dozen scoring methods have been developed for the Complex Figure Test (3), which are mainly divided into two categories: the accuracy scoring method and the process scoring method (26). This review here only introduces the scoring methods commonly used in clinical practice and research. The accuracy scoring methods (2, 2729), are used to quantitatively score the accuracy of each unit and the relative position in the figure, which reflects the matching degree of the drawn figure with the original design presented. It is mainly used to evaluate the visuo-constructional ability and visual memory. The process scoring methods Bennett-Levy (30), Boston Qualitative Scoring System (BQSS) (31), Developmental Scoring System (32), Denman (33), Savage (34), Booth's (35, 36), and Q-score (37, 38) are used to score the direction and order of drawing and the placement of figure units. Thus, they increase executive function and organizational strategy evaluation to evaluate cognitive function from multiple dimensions (26). These scoring methods are applicable to all equivalent and simplified versions of ROCF (see Table 1 for the specific scoring criteria).

TABLE 1
www.frontiersin.org

Table 1. Traditional scoring methods of the complex figure test.

The accuracy scoring method is a single quantitative scoring method. Although it has good clinical practicality and high inter-rater reliability (Osterrieth 99%, Meyers 94%), it cannot assess the organization strategy and executive function of drawing. Therefore, meaningful information about the drawing process will be missed, such as whether the figure is drawn in an organized and planned way or fragmented and chaotic (26). The process scoring method is a comprehensive scoring method that can comprehensively evaluate cognitive function. The executive variables of BQSS can distinguish executive disorders from normal people, including vascular dementia (9), Parkinson's disease (39), schizophrenia (40), attention deficit hyperactivity disorder (41), and senile depression (42), and it is more valuable in exploring poor performance in the recall—for example, a BQSS-based visuospatial memory study found that poor recall performance in schizophrenia is mediated by a defect in the organizational strategy of copying (40). However, due to the shortcomings of process scoring methods, such as time-consuming and standardized training, it is not widely used in clinical practice (31).

Clinical Application in Neurological Diseases

Neurodegenerative and cerebrovascular diseases can cause cognitive impairment, such as Alzheimer's disease, Lewy body dementia, frontotemporal dementia, Parkinson's disease dementia, and cerebral small vessel disease. The clinical subtypes of mild cognitive impairment (MCI) are the precursor forms of various dementias, and early recognition is of great significance for disease management (43). The ROCF is widely used to assess the visuo-constructional ability and visual memory of brain injury or cognitive disorders.

Alzheimer Disease

Alzheimer's disease (AD) is a neurodegenerative disease characterized by progressive cognitive impairment and behavioral disorders. Memory impairment is its core cognitive feature (44). The structure or function of the parietal lobe can be changed in the early stage, so the visuospatial ability test may be more accurate than other tests in distinguishing AD from non-AD (4). Some studies have confirmed that the Complex Figure Test has good diagnostic and prognostic potential for AD (9, 24). de Paula et al. (23) studied the performance of healthy elderly, MCI, and AD in the simplified Taylor figure (Figure 1J). It was found that there were statistical differences in the scores of copying, immediate recall, and delayed recall among the three groups, and there was a progressive damage pattern. Moreover, the impairment of the graphic recall test may help describe the characteristics of MCI and AD. At the same time, ROCF copy performance in AD patients is associated with low metabolism in bilateral temporal–parietal, occipital, and right frontal cortical areas (45), especially in the BA40 and BA7 zones (Brodmann zone) (46). It shows that the ROCF seems to reflect the function of the posterior temporal–parietal cortex and emphasizes the role of visuospatial processing in AD.

Vascular Dementia

Vascular dementia (VaD) is the second major cause of dementia after AD and can be prevented. Cerebral small vessel disease is a common cause of VaD, and the lesion is located in the subcortical area (47). It can lead to the destruction of the cortical striatal loop and decreased frontal lobe function, resulting in impaired attention and processing speed (48). Therefore, cognitive scale assessment should focus more on cognitive domains such as executive function, attention, and visuospatial ability. VaD and AD have common pathogenic factors and pathological mechanisms; especially when AD patients are mixed with vascular factors, clinical identification is more complex (4). Previous studies have found that patients with subcortical vascular mild cognitive impairment (v-MCI) performed poorly in ROCF copying (49). Salvadori et al. (9) used the Boston Qualitative Scoring System to explore the reasons further and found that v-MCI patients show more planning and organizational deficits than aMCI patients. Their reproductions are more fragmented and contain more perseverations. Therefore, the Complex Figure Test can distinguish them well.

Parkinson's Disease and Lewy Body Dementia

Parkinson's disease (PD) is a common neurodegenerative disease with complex clinical symptoms, including motor symptoms such as retardation, muscle rigidity, and resting tremor, non-motor symptoms such as hyposmia, constipation, and rapid eye movement sleep, behavior impairment and cognitive impairment, etc. (50). Cognitive impairment (PD-MCI) is more common, and 70–80% of PD patients can progress to dementia with severe executive dysfunction. Scarpina et al. (39) found that the Boston Qualitative Scoring System's copy total score can distinguish PD patients from normal people. The low planning and neatness scores of PD patients indicate that poor copying performance is related to executive function, especially planning and impulsivity, rather than impaired visuo-constructional ability (39). Since the subthalamic nucleus plays a vital role in optimal planning, planning defects are related to the dysfunction of the frontal basal ganglia network (regulatory response inhibition) (51). PD patients also performed poorly on the ROCF delayed recall, which was explained as memory retrieval failure due to the destruction of the frontostriatal loop (52). Visuospatial impairment is also an early feature of PD-MCI, and figure copying tests have been shown to predict the progressive cognitive decline of PD, such as pentagons and cubes (53). The ROCF also has good screening and diagnostic capabilities for PD-MCI and can be used as a predictive factor (54).

Lewy body dementia (DLB) is the second most common neurodegenerative dementia after AD, and its main manifestations are memory impairment, Parkinson's syndrome, and hallucinations. It has the same pathophysiological mechanism as PD and belongs to alpha- synucleinopathy (55). The diagnosis of typical PDD and DLB is based on the order of appearance of dementia and Parkinson's symptoms, but it is difficult to distinguish in clinical practice. This is because their symptoms overlap and are atypical. However, studies have found that DLB and PDD have different cognitive characteristics (56). DLB has more severe cognitive impairment than PDD, especially attention, visuospatial ability, and language. It is explained that they have different AD co-pathological levels (different β-amyloid content and location; PD <10%, PDD <40%, and DLB >70%), and the ROCF copying test can distinguish them well.

Frontotemporal Dementia

Frontotemporal dementia (FTLD) is a type of dementia with damage to the frontal and temporal lobes, which is clinically characterized by behavioral and language disorders (44). Previous studies on ROCF in AD and FTLD have been controversial (4, 57), which may be caused by different neuroanatomical bases and cognitive mechanisms. Poor copy performance in AD is significantly related to atrophy of the right parietal cortex, involving spatial perception and attention. In contrast, poor performance in FTLD is related to atrophy of the right dorsolateral prefrontal cortex, involving spatial planning and working memory. Based on the above-mentioned findings, (24), proposed an alternative evaluation method. He uses a simplified ROCF (Figure 1I) less affected by executive functions to evaluate visuospatial ability, which can better distinguish them. In addition, the delayed recall of ROCF can also distinguish them well (44).

Cerebellar Ataxia and Amyotrophic Lateral Sclerosis

The cerebellum not only coordinates movement but also involves cognitive processes, including visuospatial abilities. Cerebellar injury shows poor visuospatial skills. Resting-state functional connectivity studies show the connection between the cerebellum and the parietal lobe involved in visuospatial integration (58). The cerebellum may contribute to figuring organization to promote effective visuospatial integration and perception while encoding shapes. Slapik et al. (10) found that ROCF copying of cerebellar ataxia was poor, but the subsequent recall was normal, and recall accuracy is related to processing speed. It shows that copying strategy compensates for recall performance, and organizational strategy can affect ROCF performance more than visuospatial skills. The ROCF is also used to assess visuospatial memory in amyotrophic lateral sclerosis (59). The prefrontal lobe injury can appear in the early stage and manifests as reduced executive function. The more severe the executive dysfunction, the worse the ROCF performance. Some patients even meet the diagnostic criteria of frontotemporal dementia, which has been proved to be related to the destruction of the visual cortex striatal circuit and the prefrontal lobe circuit (60).

Traumatic Brain Injury and Brain Tumors

Mild traumatic brain injury (mTBI) can cause various cognitive, behavioral, physical, or emotional symptoms. The study found that, after the expected recovery period of 2–12 weeks, 10–20% of mTBI patients still experience persistent post-concussion symptoms, significantly impacting their quality of life and social integration (61). Visual and verbal memory processes are the two most severely impaired cognitive functions after mTBI (62). The ROCF helps distinguish different visual memory processes (including immediate recall, delayed recall, and recognition). L'Ecuyer-Giguere et al. (63) found that mTBI patients have short- and long-term visual memory impairment when drawing ROCF, while visual recognition function is relatively retained. Both verbal and performance IQ seem to be related to visual memory performance. It is explained that recall depends on the hippocampus, and familiarity depends on the medial temporal cortex. In addition, ROCF (or its equivalent) is also used to assess constructional apraxia in elderly patients with focal brain tumors (benign or malignant), which are common in parietal and parieto-occipital lesions (64). Constructional apraxia is a neuropsychological syndrome defined as the apparent impairment of the ability to build, assemble, or draw two- or three-dimensional models (simplex or complex), synthesizing its individual elements into a complete object. This task requires the analysis and reproduction of the spatial relationship between individual elements under the guidance of perceptual or mental models, which involve different areas of the brain (e.g., occipital lobe, parietal lobe, and frontal lobe) (65). ROCF, which involves multiple cognitive domains, is considered the most reliable test for determining constructional apraxia. Retrospective literature shows that focal brain tumors might cause overall cognitive deficits. ROCF may be affected by this general injury, and there is no specific correlation with the side and location of the lesion, making the processing task too difficult (64).

Clinical Application in Psychiatric Diseases

The ROCF has also been used to evaluate visuospatial abilities, learning, visual memory, and executive dysfunction in some psychiatric diseases, including attention deficit hyperactivity disorder, eating disorder, and schizophrenia.

Attention Deficit Hyperactivity Disorder

Attention deficit hyperactivity disorder (ADHD) is a neurodevelopmental disorder of children and adolescents. It has cognitive deficits in the dorsolateral prefrontal cortex that regulate executive functions, manifested by decreased working memory and attention (66). Hyun et al. (41) used digital ROCF to evaluate the visuospatial working memory of adolescents with ADHD. He found that the deviation value (the pixel difference between the original image and the template image) of ADHD was different from that of the control group and was negatively correlated with the visuospatial index and the working memory index. However, there was no difference in the deviation of immediate recall between the two groups, indicating no memory storage defect in ADHD patients. The ROCF has also been gradually used in the executive function training of children with ADHD. After training, the performance of ADHD patients in executive function tasks can be comparable to that of normal children (67). ROCF is a reliable measure to evaluate the executive function of children and adolescents (68).

Eating Disorder

The ROCF was also used to assess cognitive deficits in eating disorders (anorexia nervosa and bulimia nervosa), such as executive function, visuospatial ability, learning, memory, language, and attention. In recent years, studies have shown that they are related to weak center consistency (69). The weak center consistency hypothesis is a cognitive theory that refers to a processing style that focuses on details rather than the overall, which is common in patients with anorexia nervosa. Lang et al. (36) found that the center consistency index based on Booth's scoring can be better used to assess the weak center consistency of eating disorders. However, it pays too much attention to drawing element order, ignoring the overall figure, and the scoring method is too complicated. Subsequently, Weider et al. (38) used the Q-score to assess the weak central consistency of eating disorders and found that it has visual construction and visual memory defects, and the Q-score was strongly correlated with the center consistency index. Thus, it shows that the Q-score is suitable for measuring the weak center consistency of eating disorders.

Schizophrenia

Initially, Göder et al. (70) found that patients with schizophrenia performed poorly on the ROCF recall, which is consistent with the view of temporal lobe dysfunction. It will affect the connection between external stimuli and semantic meaning and then affect the visual–spatial memory ability. Subsequently, Kim et al. (40) used the Boston Qualitative Scoring System for further research and found that there were significant differences in some scoring variables (e.g., fragmentation in copying; configuration presence and planning in immediate recall; configuration presence, combination presence, detail presence, fragmentation, planning, and neatness in delayed recall) between the schizophrenia and control groups, and the organization strategy of copying mediates the difference between the two groups in immediate recall. It shows that organizational deficits seem to be related to visual memory deficits in schizophrenia. The ROCF has also been used to measure the learning potential of schizophrenia, which is defined as the ability to acquire cognitive skills and use them to solve problems under appropriate circumstances (71). The organizational strategy of ROCF copying can give it intensive guidance.

Digital Complex Figure Test

Dementia or other brain disease patients show different drawing behavior patterns (5)—for example, AD patients have a poor ability to integrate details and break the figure into fragmented parts instead of focusing on the overall structure. There is an increased tendency to exhibit abnormal behaviors when selecting drawing areas, organizing graphics, determining drawing order, and other activities. However, the traditional scoring methods based on pen and paper have limitations for detecting these abnormal behaviors. Therefore, it is necessary to establish a scoring method for a digital device to increase the scoring of the drawing process (25).

With the rapid development of technology, the digitization of traditional cognitive scales has become a hot spot in neuroscience. The digital clock drawing test (Figure 3) is relatively mature. Some studies use digital devices (Anoto Inc digital pen or Windows Surface Pro 4 tablet) to collect the physical parameters of drawing, including kinetics (time in air, time on surface, total time, drawing speed, etc.) and device–human interaction values (pressure, pressure/velocity relation, strokes per minute, pen-up stroke length, etc.) (7274). This method can more accurately reflect the drawing processing speed, motion control ability, and organization strategy and increase the understanding of the drawing strategy and executive function of the subject. Studies have shown that the digital clock drawing test can identify cognitive impairment with Alzheimer's disease (73), perioperative period (75), and Parkinson's disease (76). A recent study used the neural network employing information–theoretic feature selection approaches to perform machine learning analysis on the features collected by the digital clock drawing test. The results show that the classification accuracy between the two groups of different subtypes of MCI and AD is as high as 83.69% (43). Furthermore, it shows that applying machine learning technology to neuropsychological tests is expected to be an effective first-line screening method for classifying different types of cognitive impairment. This technique can measure subtle and discrete behaviors, including drawing delays, thinking decisions, and graphical motion output, which can better distinguish subtypes of dementia.

FIGURE 3
www.frontiersin.org

Figure 3. Clock and house drawing tasks.

Since the drawing of a clock, a house (Figure 3), and a tree involves ventral visual pathways that will elicit semantic knowledge, the use of abstract ROCF may be more objective. In addition, ROCF includes the recall test that requires visuospatial working memory before it can be translated into motor skills and executive plans, involving dorsal visual pathways (45). Therefore, the Digital Complex Figure Test has better application prospects.

Initially, Canham et al. (77) used computer vision technology to scan the ROCF offline and located the 18 units of the Osterrieth scoring. The results show that the positioning and perception grading of geometric features (large rectangle, triangle, and diamond) have a high success rate. Similarly, Hyun et al. (41) used a new Gaussian filter method to extract ROCF drawn on the tablet and analyzed the difference by comparing the pixel difference between filtered template images and filtered original images. It can be used to assess different patterns of visuospatial working memory in attention deficit hyperactivity disorder. Neither of these studies evaluated the drawing order but focused on identifying outlines and details related to traditional scoring methods.

Subsequently, Poreh et al. (22) used a new technology (digital pen) to capture the drawing process and recorded the movement of the pen to the laptop through an infrared receiver. It realized the semi-automatic analysis of Bennett-Levy scoring and found that the symmetry score can be a good marker for non-verbal executive function. To finely analyze drawing behavior patterns and establish a simple and objective digital scoring method, Kim et al. (25) used a tablet (Samsung Galaxy Book 12) to record the drawing process and automatically extract stroke parameters (time, speed, and length) and graphical space information (position of center and mass). It also uses 2D technology to analyze the shape similarity between the original and copied figures. The results found that AD patients copied the figure in a more fragmented way with a longer pause and were more inclined to move the figure closer to the target image with lower accuracy than normal control. Late-onset AD showed signs of leftward deviation when drawing the figure (25). The digital Complex Figure Test can quantitatively evaluate drawing performance and further clarify organizational strategies. The number of long strokes and the speed of the longest stroke can reflect the execution function because they are most likely to be used to build the skeleton of the figure. The position of the figure reflects the ability of spatial arrangement and can prompt signs of neglect and proximity on one side of the space.

Conclusion and Prospect

The ROCF is a comprehensive neuropsychological assessment tool involving multiple cognitive domains and is less affected by language and culture. At present, a variety of versions and scoring methods have been developed, and researchers can choose according to different clinical and research purposes. ROCF can study the cognitive deficits in patients with dementia and other brain diseases and further explore the reasons for poor performance in copying and recall. Especially the development of digital Complex Figure Test can quantitatively evaluate the drawing process and further clarify the drawing strategy of the patient by comparing the trajectory of the pen tip, the spatial arrangement, and the similarity of the completed drawing. Inspired by digital clock drawing technology, digital equipment can collect more physical parameters, such as drawing dynamics and device–human interaction, and then more refined analysis of drawing processing speed, motion control ability, and organization strategy. At the same time, combined with machine learning algorithms, it can build classification and diagnosis models of different diseases. A recent study used the deep learning algorithm to automate ROCF scoring, which has high performance and is close to the reliability of human raters (78). Future research should use machine learning technology to provide information about the neuropsychological structure of different neuropsychiatric diseases and gradually establish a new digital scoring method to standardize clinical practice, such as a digital ROCF feature selection analysis algorithm.

Author Contributions

YL developed the study concept and the study design. GM, QW, and YZ performed the literature review and produced figures and tables. XZ, LL, GM, QW, and YL wrote the manuscript. All authors contributed to the article and approved it for publication.

Funding

This study received assistance from special fund projects for the central government to guide local technological development (project number: YDZX20191400002563, project name: Multi-modal disease perception of chronic disease patients and construction of a big data platform for health care) and from key medical research projects in Shanxi Province (project number: 2020XM22, project name: development and demonstration application of a multi-modal intelligent assessment and intervention system for patients with dementia).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Acknowledgments

Thank you very much for all the efforts of the authors for this manuscript.

References

1. Rey A. L'examen psychologique dans les cas d'encéphalopathie traumatique. The psychological examination in cases of traumatic encepholopathy. Problems. Arch Psychol. (1941) 28:215–85.

Google Scholar

2. Osterrieth PA. Le test de copie d'une figure complexe; contribution à l'étude de la perception et de la mémoire. Test of copying a complex figure; contribution to the study of perception and memory. Arch Psychol. (1944) 30:206–356.

Google Scholar

3. Shin M-S, Park S-Y, Park S-R, Seol S-H, Kwon JS. Clinical and empirical applications of the rey–osterrieth complex figure test. Nat Protocol. (2006) 1:892–9. doi: 10.1038/nprot.2006.115

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Salimi S, Irish M, Foxe D, Hodges JR, Piguet O, Burrell JR. Can visuospatial measures improve the diagnosis of Alzheimer's disease? Alzheimers Dement. (2018) 10:66–74. doi: 10.1016/j.dadm.2017.10.004

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Nazar HB, Moetesum M, Ehsan S, Siddiqi I, Khurshid K, Vincent N, et al. Classification of graphomotor impressions using convolutional neural networks: an application to automated neuro-psychological screening tests. In: 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR). Islamabad (2017). p. 432–7.

Google Scholar

6. Cherrier MM, Mendez MF, Dave M, Perryman KM. Performance on the rey-osterrieth complex figure test in Alzheimer disease and vascular dementia. Neuropsychiatry Neuropsychol Behav Neurol. (1999) 12:95–101.

PubMed Abstract | Google Scholar

7. Rivera D, Perrin PB, Morlett-Paredes A, Galarza-Del-Angel J, Martínez C, Garza MT, et al. Rey-osterrieth complex figure - copy and immediate recall: normative data for the latin American spanish speaking adult population. Neuro Rehabil. (2015) 37:677–98. doi: 10.3233/NRE-151285

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Conson M, Siciliano M, Baiano C, Zappullo I, Senese VP, Santangelo G. Normative data of the rey-osterrieth complex figure for italian-speaking elementary school children. Neurol Sci. (2019) 40:2045–50. doi: 10.1007/s10072-019-03929-w

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Salvadori E, Dieci F, Caffarra P, Pantoni L. Qualitative evaluation of the immediate copy of the rey-osterrieth complex figure: comparison between vascular and degenerative MCI patients. Arch Clin Neuropsychol. (2019) 34:14–23. doi: 10.1093/arclin/acy010

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Slapik M, Kronemer SI, Morgan O, Bloes R, Lieberman S, Mandel J, et al. Visuospatial organization and recall in cerebellar ataxia. Cerebellum. (2019) 18:33–46. doi: 10.1007/s12311-018-0948-z

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Allen JB, Gross AM, Aloia MS, Billingsley C. The effects of glucose on nonmemory cognitive functioning in the elderly. Neuropsychologia. (1996) 34:459–65. doi: 10.1016/0028-3932(95)00115-8

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Sahin HA, Gurvit IH, Bilgi ç B, Hanagasi HA, Emre M. Therapeutic effects of an acetylcholinesterase inhibitor (donepezil) on memory in wernicke-korsakoff's disease. Clin Neuropharmacol. (2002) 25:16–20. doi: 10.1097/00002826-200201000-00003

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Taylor LB. Localisation of cerebral lesions by psychological testing. Clin Neuro. (1969) 16:269–87. doi: 10.1093/neurosurgery/16.CN_suppl_1.269

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Tombaugh TN, Hubley AM. Four studies comparing the rey-osterrieth and taylor complex figures. J Clin Exp Neuropsychol. (1991) 13:587–99. doi: 10.1080/01688639108401073

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Hubley AM, Jassal S. Comparability of the rey-osterrieth and modified taylor complex figures using total scores, completion times, construct validation. J Clin Exp Neuropsychol. (2006) 28:1482–97. doi: 10.1080/13803390500434441

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Frazier TW, Adams NL, Strauss ME, Redline S. Comparability of the rey and mack forms of the complex figure test. Clin Neuropsychol. (2001) 15:337–44. doi: 10.1076/clin.15.3.337.10274

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Yamashita H, Yasugi M. Comparison of the medical college of georgia complex figures and the rey-osterrieth complex figure tests in a normal sample of Japanese University students. Percept Mot Skills. (2008) 107:45–50. doi: 10.2466/pms.107.1.45-50

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Yasugi M, Yamashita H. Medical college of georgia complex figures in repeated memory testing: a preliminary study of healthy young adults. Percept Mot Skills. (2010) 110:181–4. doi: 10.2466/pms.110.1.181-184

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Boone KB, Lesser IM, Hill-gutierrez E, Berman NG, D'Elia LF. Rey-osterrieth complex figure performance in healthy, older adults: relationship to age, education, sex, and IQ. Clin Neuropsychol. (1993) 7:22–8. doi: 10.1080/13854049308401884

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Lourenço RA, Ribeiro-Filho ST, Moreira Ide F, Paradela EM, Miranda AS. The clock drawing test: performance among elderly with low educational level. Braz J Psychiatry. (2008) 30:309–15. doi: 10.1590/S1516-44462008000400002

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Tremblay M-P, Potvin O, Callahan BL, Belleville S, Gagnon J-F, Caza N, et al. Normative data for the rey–osterrieth and the taylor complex figure tests in quebec-french people. Arch Clin Neuropsychol. (2014) 30:78–87. doi: 10.1093/arclin/acu069

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Poreh A, Levin JB, Teaford M. Geriatric complex figure test: a test for the assessment of planning, visual spatial ability, and memory in older adults. Applied neuropsychology. Adult. (2020) 27:101–7. doi: 10.1080/23279095.2018.1490288

PubMed Abstract | CrossRef Full Text | Google Scholar

23. de Paula JJ, Costa MV, de Andrade GF, Ávila RT, Malloy-Diniz LF. Validity and reliability of a “simplified” version of the taylor complex figure test for the assessment of older adults with low formal education. Dement Neuropsychol. (2016) 10:52–7. doi: 10.1590/s1980-57642016dn10100010

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Possin KL, Laluz VR, Alcantar OZ, Miller BL, Kramer JH. Distinct neuroanatomical substrates and cognitive mechanisms of figure copy performance in Alzheimer's disease and behavioral variant frontotemporal dementia. Neuropsychologia. (2011) 49:43–8. doi: 10.1016/j.neuropsychologia.2010.10.026

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Kim KW, Lee SY, Choi J, Chin J, Lee BH, Na DL, et al. A comprehensive evaluation of the process of copying a complex figure in early- and late-onset alzheimer disease: a quantitative analysis of digital pen data. J Med Int Res. (2020) 22:e18136. doi: 10.2196/18136

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Davies SR, Field AR, Andersen T, Pestell C. The ecological validity of the rey-osterrieth complex figure: predicting everyday problems in children with neuropsychological disorders. J Clin Exp Neuropsychol. (2011) 33:820–31. doi: 10.1080/13803395.2011.574608

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Meyers JE, Meyers KR. Rey Complex Figure Test and Recognition Trial (RCFT). Odessa, FL: Psychological Assessment Resources (1995).

28. Awad N, Tsiakas M, Gagnon M, Mertens VB, Hill E, Messier CJJ, et al. Explicit and objective scoring criteria for the taylor complex figure test. J Clin Exp Neuropsychol. (2004) 26:405–15. doi: 10.1080/13803390490510112

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Taylor LJO. Scoring criteria for the rey-osterrieth complex figure test. In: Spreen O, Strauss E, editors. A Compendium of Neuropsychological Tests. Administration, Norms, and Commentary. New York, NY: Oxford University Press (1998). p. 350–1.

30. Bennett-Levy J. Determinants of performance on the rey-osterrieth complex figure test: an analysis, and a new technique for single-case assessment. Bri J Clin Psychol. (1984) 23:109–19. doi: 10.1111/j.2044-8260.1984.tb00634.x

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Somerville J, Tremont G, Stern RA. The boston qualitative scoring system as a measure of executive functioning in rey-osterrieth complex figure performance. J Clin Exp Neuropsychol. (2000) 22:613–21. doi: 10.1076/1380-3395(200010)22:5;1-9;FT613

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Waber DP, Holmes JM. Assessing children's copy productions of the rey-osterrieth complex figure. J Clin Exp Neuropsychol. (1985) 7:264–80. doi: 10.1080/01688638508401259

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Denman SB. Denman Neuropsychology Memory Scale: Norms. Charleston, SC (1987).

Google Scholar

34. Savage CR, Baer L, Keuthen NJ, Brown HD, Rauch SL, Jenike AJB, et al. Organizational strategies mediate nonverbal memory impairment in obsessive–compulsive. Disorder. (1999) 45:905–16. doi: 10.1016/S0006-3223(98)00278-9

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Booth RDL. Local-Global Processing and Cognitive Style in Autism Spectrum Disorders and Typical Development. London: University of London (2006).

Google Scholar

36. Lang K, Roberts M, Harrison A, Lopez C, Goddard E, Khondoker M, et al. Central coherence in eating disorders: a synthesis of studies using the rey osterrieth complex figure test. PLoS ONE. (2016) 11:e0165467. doi: 10.1371/journal.pone.0165467

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Bylsma FJU The Q-Score: A Brief Reliable Method for Coding How Subjects Copy the Rey-Osterrieth Complex Figure (Unpublished manuscript). Chicago, IL: Neuropsychological Services PC (2008).

38. Weider S, Indredavik MS, Lydersen S, Hestad K. Central coherence, visuoconstruction and visual memory in patients with eating disorders as measured by different scoring methods of the rey complex figure test. Eur Eat Disord Rev. (2016) 24:106–13. doi: 10.1002/erv.2385

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Scarpina F, Ambiel E, Albani G, Pradotto LG, Mauro A. Utility of boston qualitative scoring system for rey-osterrieth complex figure: evidence from a parkinson's diseases sample. Neurol Sci. (2016) 37:1603–11. doi: 10.1007/s10072-016-2631-9

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Kim MS, Namgoong Y, Youn T. Effect of organizational strategy on visual memory in patients with schizophrenia. Psychiatry Clin Neurosci. (2008) 62:427–34. doi: 10.1111/j.1440-1819.2008.01821.x

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Hyun GJ, Park JW, Kim JH, Min KJ, Lee YS, Kim SM, et al. Visuospatial working memory assessment using a digital tablet in adolescents with attention deficit hyperactivity disorder. Comput Meth Prog Biomed. (2018) 157:137–43. doi: 10.1016/j.cmpb.2018.01.022

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Elderkin-Thompson V, Boone KB, Kumar A, Mintz J. Validity of the boston qualitative scoring system for the rey-osterrieth complex figure among depressed elderly patients. J Clin Exp Neuropsychol. (2004) 26:598–607. doi: 10.1080/13803390409609784

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Binaco R, Calzaretto N, Epifano J, McGuire S, Umer M, Emrani S, et al. Machine learning analysis of digital clock drawing test performance for differential classification of mild cognitive impairment subtypes versus alzheimer's disease. J Int Neuropsychol Soc. (2020) 26:690–700. doi: 10.1017/S1355617720000144

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Porto CS, Bahia VS, Brucki SMD, Caramelli P, Nitrini R. Neuropsychological differences between frontotemporal lobar degeneration and Alzheimer's disease. Dement Neuropsychol. (2008) 2:223–7. doi: 10.1590/S1980-57642009DN20300011

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Melrose RJ, Harwood D, Khoo T, Mandelkern M, Sultzer DL. Association between cerebral metabolism and rey-osterrieth complex figure test performance in Alzheimer's disease. J Clin Exp Neuropsychol. (2013) 35:246–58. doi: 10.1080/13803395.2012.763113

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Chiaravalloti A, Ricci M, Di Biagio D, Filippi L, Martorana A, Schillaci O. The brain metabolic correlates of the main indices of neuropsychological assessment in alzheimer's disease. J Pers Med. (2020) 10:25. doi: 10.3390/jpm10020025

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Pantoni L, Poggesi A, Diciotti S, Valenti R, Orsolini S, Della Rocca E, et al. Effect of attention training in mild cognitive impairment patients with subcortical vascular changes: the RehAtt study. J Alzheimers Dis. (2017) 60:615–24. doi: 10.3233/JAD-170428

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Sachdev PS, Brodaty H, Looi JC. Vascular dementia: diagnosis, management and possible prevention. Med J Aust. (1999) 170:81–5. doi: 10.5694/j.1326-5377.1999.tb126889.x

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Salvadori E, Poggesi A, Valenti R, Pracucci G, Pescini F, Pasi M, et al. Operationalizing mild cognitive impairment criteria in small vessel disease: the VMCI-Tuscany study. Alzheimers Dement. (2016) 12:407–18. doi: 10.1016/j.jalz.2015.02.010

PubMed Abstract | CrossRef Full Text | Google Scholar

50. Kalia LV, Lang AE. Parkinson's disease. Lancet. (2015) 386:896–912. doi: 10.1016/S0140-6736(14)61393-3

PubMed Abstract | CrossRef Full Text | Google Scholar

51. Mirabella G, Iaconelli S, Modugno N, Giannini G, Lena F, Cantore G. Stimulation of subthalamic nuclei restores a near normal planning strategy in parkinson's patients. PLoS ONE. (2013) 8:e62793. doi: 10.1371/journal.pone.0062793

PubMed Abstract | CrossRef Full Text | Google Scholar

52. Kormas C, Zalonis I, Evdokimidis I, Kapaki E, Potagas C. The modality effect on delayed free recall in non-demented patients with mild parkinson's disease progression. Front Aging Neurosci. (2019) 11:189. doi: 10.3389/fnagi.2019.00189

PubMed Abstract | CrossRef Full Text | Google Scholar

53. Alty JE, Cosgrove J, Jamieson S, Smith SL, Possin KL. Which figure copy test is more sensitive for cognitive impairment in Parkinson's disease: wire cube or interlocking pentagons? Clin Neurol Neurosurg. (2015) 139:244–6. doi: 10.1016/j.clineuro.2015.10.019

PubMed Abstract | CrossRef Full Text | Google Scholar

54. Biundo R, Weis L, Pilleri M, Facchini S, Formento-Dojot P, Vallelunga A, et al. Diagnostic and screening power of neuropsychological testing in detecting mild cognitive impairment in Parkinson's disease. J Neural Transm. (2013) 120:627–33. doi: 10.1007/s00702-013-1004-2

PubMed Abstract | CrossRef Full Text | Google Scholar

55. McKeith IG, Boeve BF, Dickson DW, Halliday G, Taylor JP, Weintraub D, et al. Diagnosis and management of dementia with lewy bodies: fourth consensus report of the DLB consortium. Neurology. (2017) 89:88–100. doi: 10.1212/WNL.0000000000004058

PubMed Abstract | CrossRef Full Text | Google Scholar

56. Martini A, Weis L, Schifano R, Pistonesi F, Fiorenzato E, Antonini A, et al. Differences in cognitive profiles between lewy body and Parkinson's disease dementia. J Neural Transm. (2020) 127:323–30. doi: 10.1007/s00702-019-02129-2

PubMed Abstract | CrossRef Full Text | Google Scholar

57. Irish M, Piguet O, Hodges JR, Hornberger M. Common and unique gray matter correlates of episodic memory dysfunction in frontotemporal dementia and Alzheimer's disease. Human brain Mapp. (2014) 35:1422–35. doi: 10.1002/hbm.22263

PubMed Abstract | CrossRef Full Text | Google Scholar

58. Buckner RL, Krienen FM, Castellanos A, Diaz JC, Yeo BT. The organization of the human cerebellum estimated by intrinsic functional. Connectivity. (2011) 106:2322–45. doi: 10.1152/jn.00339.2011

PubMed Abstract | CrossRef Full Text | Google Scholar

59. Burke T, Lonergan K, Pinto-Grau M, Elamin M, Bede P, Madden C, et al. Visual encoding, consolidation, and retrieval in amyotrophic lateral sclerosis: executive function as a mediator, and predictor of performance. Amyotr Lateral Scler Front Deg. (2017) 18:193–201. doi: 10.1080/21678421.2016.1272615

PubMed Abstract | CrossRef Full Text | Google Scholar

60. Tsermentseli S, Leigh PN, Goldstein LH. The anatomy of cognitive impairment in amyotrophic lateral sclerosis: more than frontal lobe dysfunction. Cortex. (2012) 48:166–82. doi: 10.1016/j.cortex.2011.02.004

PubMed Abstract | CrossRef Full Text | Google Scholar

61. Pavlovic D, Pekic S, Stojanovic M, Popovic V. Traumatic brain injury: neuropathological, neurocognitive and neurobehavioral sequelae. Pituitary. (2019) 22:270–82. doi: 10.1007/s11102-019-00957-9

PubMed Abstract | CrossRef Full Text | Google Scholar

62. Karr JE, Areshenkoff CN, Garcia-Barrera MA. The neuropsychological outcomes of concussion: a systematic review of meta-analyses on the cognitive sequelae of mild traumatic brain injury. Neuropsychology. (2014) 28:321–36. doi: 10.1037/neu0000037

PubMed Abstract | CrossRef Full Text | Google Scholar

63. L'Ecuyer-Giguere F, Greffou S, Tabet S, Frenette LC, Tinawi S, Feyz M, et al. Visual memory performance following mild traumatic brain injury and its relationship with intellectual functioning. Appl Neuropsychol Adult. (2020) 27:219–31. doi: 10.1080/23279095.2018.1528263

PubMed Abstract | CrossRef Full Text | Google Scholar

64. Abete Fornara G, Di Cristofori A, Bertani GA, Carrabba G, Zarino B. Constructional apraxia in older patients with brain tumors: considerations with an up-to-date review of the literature. World Neurosurg. (2018) 114:e1130–7. doi: 10.1016/j.wneu.2018.03.159

PubMed Abstract | CrossRef Full Text | Google Scholar

65. Cubelli R, Della Sala S. Constructional apraxia. Cort J Dev Study Nerv Syst Behav. (2018) 104:127. doi: 10.1016/j.cortex.2018.02.015

PubMed Abstract | CrossRef Full Text | Google Scholar

66. Burgess GC, Depue BE, Ruzic L, Willcutt EG, Du YP, Banich MT. Attentional control activation relates to working memory in attention-deficit/hyperactivity disorder. Biol Psychiatry. (2010) 67:632–40. doi: 10.1016/j.biopsych.2009.10.036

PubMed Abstract | CrossRef Full Text | Google Scholar

67. Shuai L, Daley D, Wang YF, Zhang JS, Kong YT, Tan X, et al. Executive function training for children with attention deficit hyperactivity disorder. Chin Med J. (2017) 130:549–58. doi: 10.4103/0366-6999.200541

PubMed Abstract | CrossRef Full Text | Google Scholar

68. Nyongesa MK, Ssewanyana D, Mutua AM, Chongwo E, Scerif G, Newton C, et al. Assessing executive function in adolescence: a scoping review of existing measures and their psychometric robustness. Front Psychol. (2019) 10:311. doi: 10.3389/fpsyg.2019.00311

PubMed Abstract | CrossRef Full Text | Google Scholar

69. Lang K, Lopez C, Stahl D, Tchanturia K, Treasure J. Central coherence in eating disorders: an updated systematic review and meta-analysis. World J Biol Psychiatry. (2014) 15:586–98. doi: 10.3109/15622975.2014.909606

PubMed Abstract | CrossRef Full Text | Google Scholar

70. Göder R, Boigs M, Braun S, Friege L, Fritzer G, Aldenhoff JB, et al. Impairment of visuospatial memory is associated with decreased slow wave sleep in schizophrenia. J Psychiatr Res. (2004) 38:591–9. doi: 10.1016/j.jpsychires.2004.04.005

PubMed Abstract | CrossRef Full Text | Google Scholar

71. Rempfer MV, McDowd JM, Brown CE. Measuring learning potential in people with schizophrenia: a comparison of two tasks. Psychiatry Research. (2017) 258:316–21. doi: 10.1016/j.psychres.2017.08.057

PubMed Abstract | CrossRef Full Text | Google Scholar

72. Müller S, Preische O, Heymann P, Elbing U, Laske C. Increased diagnostic accuracy of digital vs. Conventional clock drawing test for discrimination of patients in the early course of alzheimer's disease from cognitively healthy individuals. Front Aging Neurosci. (2017) 9:101. doi: 10.3389/fnagi.2017.00101

PubMed Abstract | CrossRef Full Text | Google Scholar

73. Müller S, Herde L, Preische O, Zeller A, Heymann P, Robens S, et al. Diagnostic value of digital clock drawing test in comparison with CERAD neuropsychological battery total score for discrimination of patients in the early course of Alzheimer's disease from healthy individuals. Sci Rep. (2019) 9:3543. doi: 10.1038/s41598-019-40010-0

PubMed Abstract | CrossRef Full Text | Google Scholar

74. Dion C, Arias F, Amini S, Davis R, Penney D, Libon DJ, et al. Cognitive correlates of digital clock drawing metrics in older adults with and without mild cognitive impairment. J Alzheimers Dis. (2020) 75:73–83. doi: 10.3233/JAD-191089

PubMed Abstract | CrossRef Full Text | Google Scholar

75. Buckley RA, Atkins KJ, Fortunato E, Silbert B, Scott DA, Evered L. A novel digital clock drawing test as a screening tool for perioperative neurocognitive disorders: a feasibility study. Acta Anaesthesiol Scand. (2020) 65:473–80. doi: 10.1111/aas.13756

PubMed Abstract | CrossRef Full Text | Google Scholar

76. Dion C, Frank BE, Crowley SJ, Hizel LP, Rodriguez K, Tanner JJ, et al. Parkinson's disease cognitive phenotypes show unique clock drawing features when measured with digital technology. J Parkinsons Dis. (2021) 11:779–91. doi: 10.3233/JPD-202399

PubMed Abstract | CrossRef Full Text | Google Scholar

77. Canham RO, Smith SL, Tyrrell AM. Automated scoring of a neuropsychological test: the Rey Osterrieth complex figure. In: Proceedings of the 26th Euromicro Conference. York (2000). p. 406–13.

Google Scholar

78. Vogt J, Kloosterman H, Vermeent S, Van Elswijk G, Dotsch R, Schmand B. Automated scoring of the rey-osterrieth complex figure test using a deep-learning algorithm. Arch Clin Neuropsychol. (2019) 34:836. doi: 10.1093/arclin/acz035.04

CrossRef Full Text | Google Scholar

Keywords: complex figure test, visuospatial ability, digital scoring method, neuropsychological test, neuropsychiatric disorders

Citation: Zhang X, Lv L, Min G, Wang Q, Zhao Y and Li Y (2021) Overview of the Complex Figure Test and Its Clinical Application in Neuropsychiatric Disorders, Including Copying and Recall. Front. Neurol. 12:680474. doi: 10.3389/fneur.2021.680474

Received: 14 March 2021; Accepted: 05 July 2021;
Published: 31 August 2021.

Edited by:

Luigi Trojano, University of Campania Luigi Vanvitelli, Italy

Reviewed by:

Massimiliano Conson, University of Campania Luigi Vanvitelli, Italy
Bernardino Fernández-Calvo, University of Córdoba, Spain

Copyright © 2021 Zhang, Lv, Min, Wang, Zhao and Li. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Yang Li, MTUwMzUxODIwMDMmI3gwMDA0MDsxNjMuY29t

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.