Andrew P. Owens1*
Clive Ballard2
Mazda Beigi3
Chris Kalafatis1,3
Helen Brooker2,4
Grace Lavelle1
Kolbjørn K. Brønnick5,6
Justin Sauer1,3
Steve Boddington3Latha Velayudhan1
Dag Aarsland1,3,5- 1Department of Old Age Psychiatry, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, United Kingdom
- 2The University of Exeter Medical School, The University of Exeter, Exeter, United Kingdom
- 3Psychological Medicine and Older Adults, South London & Maudsley NHS Foundation Trust, London, United Kingdom
- 4Ecog Pro Ltd, Bristol, United Kingdom
- 5SESAM—Centre for Age-Related Medicine, Stavanger University Hospital, Stavanger, Norway
- 6Department of Public Health, Faculty of Health Sciences, University of Stavanger, Stavanger, Norway
Social isolation is likely to be recommended for older adults due to COVID-19, with ongoing reduced clinical contact suggested for this population. This has increased the need for remote memory clinics, we therefore review the literature, current practices and guidelines on organizing such remote memory clinics, focusing on assessment of cognition, function and other relevant measurements, proposing a novel pathway based on three levels of complexity: simple telephone or video-based interviews and testing using available tests (Level 1), digitized and validated methods based on standard pen-and-paper tests and scales (Level 2), and finally fully digitized cognitive batteries and remote measurement technologies (RMTs, Level 3). Pros and cons of these strategies are discussed. Remotely collected data negates the need for frail patients or carers to commute to clinic and offers valuable insights into progression over time, as well as treatment responses to therapeutic interventions, providing a more realistic and contextualized environment for data-collection. Notwithstanding several challenges related to internet access, computer skills, limited evidence base and regulatory and data protection issues, digital biomarkers collected remotely have significant potential for diagnosis and symptom management in older adults and we propose a framework and pathway for how technologies can be implemented to support remote memory clinics. These platforms are also well-placed for administration of digital cognitive training and other interventions. The individual, societal and public/private costs of COVID-19 are high and will continue to rise for some time but the challenges the pandemic has placed on memory services also provides an opportunity to embrace novel approaches. Remote memory clinics’ financial, logistical, clinical and practical benefits have been highlighted by COVID-19, supporting their use to not only be maintained when social distancing legislation is lifted but to be devoted extra resources and attention to fully potentiate this valuable arm of clinical assessment and care.
Introduction
Cognitive impairment and dementia increase with age and represent major challenges for patients, their families and society. Accurate diagnosis of cognitive impairment, the degree of impairment, such as subjective cognitive decline (SCD), mild cognitive impairment (MCI) and dementia, and underlying aetiologies in older people are important tasks for the healthcare system, requiring;
● collection of history to ascertain subjective cognitive impairment
● any potential impact on function via activities of daily living (ADLs)
● mental status examination, including objective assessment of cognition, mood and other psychiatric symptoms that can affect cognition and provide diagnostic information
● medical/neurological examination and biomarker analyses for aetiological diagnosis (1).
The COVID-19 pandemic has heighted the need for remote offsite (i.e., virtual) cognitive assessment. Older people are at higher risk from COVID-19, due to ongoing age-related psychosocial changes, existing physical and mental health conditions and smaller social networks, on whom they may be reliant. Older adults are therefore particularly recommended to minimize risk of infection by using social distancing measures, yet the importance of a timely diagnosis of dementia remains unchanged, or has arguably increased due to the high association between COVID-19 and dementia (2). In fact, unintended consequences of such distancing may lead to reduced physical and social activity, loneliness and depression - all factors associated with more rapid cognitive and functional decline - compounding the burden on individuals and healthcare services (3). Moreover, there is also the dilemma faced by many patients regarding their concerns about potentially having dementia and wanting to speak to a clinician, offset against concerns of contracting COVID-19 should they allow a clinician into their home or visit a clinic (4). Remote memory assessments can potentially resolve this dilemma and provide an opportunity to re-evaluate how existing methods can be adapted for remote assessment and how digital technology can be used to automate cognitive assessments and data collection.
Memory clinics can use a variety of approaches in this challenging situation. In the UK, regional and national guidelines have been provided (5, 6). At the simplest level, clinicians can use the telephone to interview patients and informants and ask simple questions to get an impression of mental status in addition to history. At a more systematic level, clinicians can employ structured telephone interviews [e.g. Telephone Interview for Cognitive Status (TICS) (7)] or remote versions of standardized assessment scales (e.g. eMontreal Cognitive Assessment [eMOCA (8)], telephone-Mini Mental State Examination [tMMSE (9)]. Finally, fully automated systems and related scalable digital technologies exist to measure cognition and function. Table 1 lists potential remote memory clinic assessments and Figure 1 provides an overview of how remote memory clinics can stratify these assessments into adapted standardized procedures (level 1), use already standardized remote instruments (level 2) or utilize automated batteries and remote measurement technologies (RMTs, level 3).
Table 1 An overview of how remote memory clinics can adapt standardized procedures (level 1), use already standardized remote instruments (level 2) or utilize automated batteries and remote measurement technologies (RMT, level 3).
Figure 1 Example of remote memory clinic care pathway. ACE, Addenbrooke’s cognitive examination; HADS, Hospital Anxiety and Depression Scale, IQCODE, Informant Questionnaire on Cognitive Decline in the Elderly; MCI, mild cognitive impairment; MMSE, Mini Mental State Exam; MoCA, Montreal Cognitive Assessment; SCD, subjective cognitive decline.
While physical examination provides information that cannot easily be captured remotely, the wealth of recent developments of digital devices and technologies represent unique opportunities for more efficient and accurate data collection, which are feasible and acceptable from the user-perspective. Remote memory clinics may also reduce the cost of face-to-face outpatient appointments, while improving the quality and relevance of cognitive monitoring and creating trial-ready cohorts for academic and commercial trials.
Active and passive digital biomarkers of cognitive domains can be collected using smartphones, tablets, personal computers (PCs), wearables and smart home sensors, virtual reality, augmented reality and even video games, that can detect changes in health status and quality of life (QoL), offering a unique opportunity to accurately and continuously track and assess changes in various physiological, motor and psychological domains. However, in terms of accuracy of measurement, acceptability and feasibility, implementation of novel strategies needs to be evidence-based and must comply with regulatory requirements, including data protection. When using adapted traditional tools, there is also some uncertainty about potentially invalidating tests by using smartphones and tablets. The device haptics usually will differ and user-interface interaction differences, as well as video and audio quality or screen size, may impact performance.
Therefore, the aim of this paper is to present a framework for virtual memory clinic assessment. To do this we will review recent practices, guidelines, scientific literature and our own experience of adapting procedures for virtual administration of diagnostic procedures relevant for memory clinics, digital cognitive assessment and RMTs for measuring function via ADLs, and other relevant features, such as mood and motor symptoms. Based on our experience of adapting practices for remote clinical assessments during COVID-19, the procedures for history taking, cognitive testing, functional assessment and other relevant assessments will be categorized according the three levels mentioned above:
Level 1: ad hoc adaptations of traditional assessments,
Level 2: specific adaptations with psychometric data available
Level 3: automated digital techniques, including RMTs.
Methods
There have been a handful of systematic reviews of RMT-based cognitive assessment (10, 11), the last of which, to our knowledge, was published in January 2019 (12), which included data until October 2018. A summation of these reviews is included in Table 2, along with an update of the field since the last review. A more detailed description of this update and related emerging RMTs is given below in, ‘Level 3: cognitive remote measurement technologies for remote memory clinics.’ We carried out a literature review to examine new candidate RMTs for cognitive testing in remote memory clinics since November 2019 until May 2020. Google (https://www.google.co.uk/) and PubMed (https://www.ncbi.nlm.nih.gov/pubmed/) literature were searched using relevant keywords, such as, ‘digital cognitive assessment’, ‘remote digital cognitive assessment’, ‘remote cognitive assessment’, ‘self-administered cognitive test’ and ‘mobile cognitive testing’. Searches were restricted to studies published in peer‐reviewed English‐language journals and no age or sample-size restrictions were placed on articles at this stage. Other studies were identified by reviewing relevant bibliographies in original papers and reviews, as well as recent guidelines that were available to us. Conference reports were also included. The initial 732 results were examined by the lead author (AO) for duplications before the authors with experience in memory clinics (CB, CK, KB, JS, LV, DA), clinical neuropsychological testing (MB, SB) and RMT-based clinical research (AO, GL, HB) independently reviewed and reached a consensus on the final 48 eligible articles. There was a particular focus on studies involving neurotypical older adults and MCI. MCI was of interest because, during disease progression, the patient’s proficiency to carry out instrumental ADLs will be increasingly impaired, yet remote testing requires self-regulation from the patient in order to comply with testing procedures. Moreover, test logistics may overwhelm the capacity of patients inexperienced with digital technology, and those at the predementia or mild dementia stages are likely to provide better uptake of technology-use than dementia cohorts. Therefore, our focus of RMTs centered on these cohorts to ensure the results were as relevant and applicable to a timely rolling out of a remote memory clinic service as possible. Relevant and accessible journal articles that assessed the use of cognitive assessments that could be deployed offsite from the clinical setting and allowed for test data to be collected by the clinician were considered.
Table 2 Potential remote measurement technologies for self-administered remote cognitive assessments.
We build these findings around a discussion of our experience of deploying remote assessments and internet-based cognitive testing in clinical practice, collection of health data and RMT assessment of function in elderly people with pre-dementia and dementia in two large ongoing multicentre studies, RADAR-AD and PROTECT and remote assessments during the COVID-19 pandemic, with a view of providing guidance into how remote memory clinics may be realized.
Results
Level 1: Ad Hoc Adaptations of Traditional Clinic Assessments
This is the simplest way of adapting to the need for remote assessments. Instruments used in pre-COVID-19 clinical settings are straightforwardly adapted for remote assessment. This has limitations if conducted telephonically as certain items cannot be performed, e.g., visual tasks in the Addenbrookes Cognitive Examination III (ACE III) and the Mini Mental State Exam (MMSE). This necessitates an adjusted score with changes in test validity. However, the benefits of this method are its ease, similarity to a standard clinical interview and simple technology and delivery. The clinician will be familiar and comfortable with this procedure, which requires no technological resources other than a telephone. Such technology is also likely to be accessible and acceptable to older populations.
The application of a standard clinical assessment via video call allows the use of tools already familiar to clinicians, as set out above, and can be applied in a manner more akin to the usual clinic. However, the authors experiences of such assessments via video is that it can take at least 50% more time. It can also be more challenging for patients due to increased cognitive load for those with attentional depletion, particularly if holding up instructions or images, although screen-sharing pre-prepared images or instructions can mitigate against this. Still, the possibility of underestimating the patients’ true cognitive level should always be considered. Mood symptoms can be easily addressed in an interview, with video providing important non-verbal information. Similarly, motor symptoms can be discussed verbally, and video offers the opportunity to observe and assess bradykinesia as well gait, stride, turning and tremor (rest and postural).
The limitations of such an approach includes the lack of standardization and evidence regarding the accuracy of paper-based tests being used in this way. In some cases, one is likely to lose sensitivity and is less likely to detect subtle changes of cognitive and functional decline, particularly in early phases of dementia. However, in cases of dementia with predominant attentional deficits, other cognitive domains may be underestimated due to the increased attentional demands inherent in the situation. Hearing or speech difficulties can add to the challenge. Hence, the clinician should evaluate the combination of sources of bias in each case.
Level 2: Specific Adaptations With Psychometric Data Available
The instructions and content of the electronic version of the Montreal Cognitive Assessment (eMoCA) (8) are identical to the original and it is available as a downloadable app on tablets. Studies comparing the eMoCA vs MoCA are limited, as are those validating the MoCA-Blind, which has also been proposed as a suitable cognitive screening tool for telephone administration. Snowden and colleagues (8) randomly allocated participants to the eMoCA (n=182) or MoCA (n=219) from nine primary care practices. The study concluded between-group significant differences in scores (MoCA group = 26.21, eMoCA group = 24.84) and completion times (MoCA group = 10.3 min, eMoCA group = 15.3 min). However, in a recent smaller-scale study in adults (n=43) presenting with memory concerns (mean age: 72 years), the eMOCA shows convergent validity (r=.84) with the original MOCA, indicating the eMOCA does not significantly alter the reliability of the original scale (38).
The MoCA-Blind removes the four visual items included in the original to for patients with visual impairments. Wittich and colleagues (39) report that based on absolute score ranges, the MoCA-Blind achieves poorer sensitivity for MCI (44%) in comparison to the original MoCA (90%) but provides improved sensitivity for Alzheimer’s disease (AD) (87%), although this was still inferior to the MoCA (100%). Although the MoCA-Blind has potential for remote use, it has not been designed or validated for these purposes. All versions of the MoCA are currently free to access.
Scores of the telephone version of the MMSE (tMMSE) strongly correlate (r=.85) with original MMSE scores across the spectrum of neurotypical to moderately demented participants (40) and the more recent 26-item tMMSE produces scores are even closer (r=.88) to in-person MMSE administration in AD (9). The tMMSE involves a three-step action-based response prior to cognitive assessment, which examines memory, attention, recall, orientation and calculation (9).
The Telephone Interview for Cognitive Status (TICS) (7) was designed to examine cognitive status in AD and was proposed as an alternative to the standard MMSE (41), as both have comparable cut point scores. The TICS examines attention, short-term memory, orientation to time and place, sentence repetition, naming to verbal description, immediate recall, word opposites and praxis and has become the most commonly used telephone cognitive assessment (42). The TICS-Modified (TICSM) includes an additional delayed verbal recall component. Both TICS (r=.94) and TICSM (r=.57) scores correlate with MMSE scores (43). To date, there are several versions of the TICSM that have been developed, including those scored out of 50, 41 and 39. The latter of these versions has developed a norms calculator that corrects for age, education and sex (44). The same study found that this version of the TICSM correlated well with the MMSE (r=.70) and ACE-Revised (r=.80).
In light of recent restrictions due to COVID-19, psychometric test battery copyrighters and regulators have issued updated guidance’s to assist clinicians with resuming administration of test batteries. For example, Pearson’s (https://www.pearsonassessments.com/) have issued instructions enabling clinicians to administer their tests remotely, using screen sharing techniques for a limited time. However, this comes with the caveat that tests must not be scanned but rather projected using equipment, such as visualizers. This has allowed clinicians to more easily adapt their administration of tests to computer-based presentations using their current test batteries. The Division of Neuropsychology (DoN) (https://www.bps.org.uk/) has taken this further by providing guidance on how clinicians may be able to facilitate remote, computerized assessments in a standardized fashion.
Remote neuropsychological testing eliminates the need to adapt to online-based platforms that may be unfamiliar to services and create difficulties when needing to re-assess clients that have previously been tested using face-to-face batteries. A recent systematic review and meta-analysis has indicated that neuropsychological assessments administered through videoconferencing produce comparable validity to that of face-to-face testing (45). Remote assessments may also help clinicians access clients who are unable to attend clinics and live in hard-to-reach areas or under conditions that make them anxious at the prospect of a clinician visiting them. To this end, a home-based assessment may introduce an additional level of security and comfort for patients.
The South London and Maudsley memory service has developed a new protocol incorporating videoconferencing in order to complete neuropsychological assessments during COVID-19, involving several extensive pathways to explore the potential for testing clients remotely. All pathways involve separate electronic devices for clients and clinicians, as well as a visualizer for administration of visual tests to maintain social distancing and avoid cross contamination of material. These measures, although helpful in identifying whether remote assessments will work, do result in clinicians having to dedicate additional time to each client they wish to test. Nevertheless, remote assessments using the short form of the Wechsler Abbreviated Scale of Intelligence, Rey Complex Figure and California Verbal Learning have been administered with relative ease. Pearson’s argue that clinicians should use two cameras to observe clients during remote assessments and while this would be ideal, it is rarely possible for patients to facilitate this. This disadvantage is evident when patients perform the Rey Complex Figure, as it is not possible to observe the informative strategies that are used when completing this task. Similarly, the Hayling and Brixton test batteries have been administered remotely, with little noticeable disadvantage to patient and clinician. Feedback from clients has been relatively positive with patients feeling that they have performed as they would had the assessment been face to face.
Level 3: Cognitive Remote Measurement Technologies for Remote Memory Clinics
The results of our literature review are listed in Table 2 and based on our experience of remotely collecting digital biomarkers in neurotypical and cognitively impaired older adults, the authors consensus opinion was to categorize our findings into;
● online platforms
● device-based tests
● wearable RMTs
● virtual and augmented reality and games consoles.
Below we list in more detail, some of the most recent examples since the last review of the literature (12) to bring together the latest additions to the field that can be readily deployed in remote memory clinics.
Online Platforms
Online platforms involving cognitive tests provide a valuable means of carrying out remote cognitive assessments. As PCs pre-date tablets and smartphones, online platforms tended to be the first digital medium through which cognitive tests were digitized and modified for self-assessment. Another benefit is the popularity of PCs and laptops within many homes. However, this may bring inherent limitations in hardware capabilities and internet access, particularly in more remote areas. Also, many older adults may not be able to engage with these platforms, therefore there is a risk of only reaching those who are more able but not necessarily most representative of the general population reducing the generalisability of the normative data and the utility of the assessment tool for clinical purposes.
PROTECT (https://www.protectstudy.org.uk/) is an online longitudinal study of a healthy aging (>50 years) population funded by the National Institute of Health and Research (NIHR) for 25 years with a recruitment target of 50,000 participants (19, 46). The PROTECT cognitive test platform includes, the paired association learning task, self-ordered search, digit span task, grammatical reasoning, trail-making test B (47). There is also the option to use the CogPro system that examines immediate word recall, pattern separation stages 1 and 2, simple reaction time, digit vigilance, choice reaction time, spatial working memory, numeric working memory, delayed word recall and word recognition (48, 49). The PROTECT platform also collects data on demographic characteristics, medical history, psychiatric symptoms, lifestyle, family history of dementia, and instrumental ADLs (50). PROTECT is a versatile, modifiable and long-term platform that offers a bespoke option for remote memory clinics in the UK and is currently also adapted for use in other countries.
MyCognition (https://mycognition.com/) is a new web-based cognitive assessment tool that negates the need for specialist supervision, is designed for self-administration online via PC or iPad. MyCognition assesses the five cognitive domains of, attention, psychomotor speed, working and episodic memory and executive functioning using 10 short subtests and has recently been validated against the CANTAB (18), however it is worth noting that the MyCognition has not been validated in any older adults for dementia. MyCognition Quotient total scores correlated with CANTAB total scores and psychomotor speed (r=.604), attention (r=.224) and episodic memory (r=.374) domains correlated with the corresponding CANTAB domains. However, executive function (r=.278) and working memory (r=.229) had limited divergent validity.
Device-Based
Device-based cognitive assessments have the benefit of being agile compared to bulkier computer-based testing. Apps can also be downloaded from the appropriate vendor onto any compatible tablets or smartphones that the patient may already own. However, the portability of such devices does mean that they are easier to misplace or damage, especially as cognitive impairment progresses, and the handheld nature of such devices, may also be a challenge in the presence of any motor symptoms.
The Integrated Cognitive Assessment (ICA, www.cognetivity.com) is a 5-min, self-administered, iPad-based, computerized cognitive assessment. It has been validated in patients with Mild-AD, MCI and multiple sclerosis and licensed as Software as Medical Device (SaMD) (51, 52). The ICA is a rapid image categorization task that measures attentional speed, accuracy and attentional speed and accuracy decay over time. It employs an artificial intelligence algorithm to improve its predictive accuracy by correlating age, gender and handedness with the composite score. The ICA does not demonstrate educational, interpretation bias or a practice effect (51) and integrates with electronic health systems. The use of the ICA aims at early detection, high-frequency monitoring of disease trajectory and response to treatment.
Mezurio [https://mezur.io] is a smartphone app that provides digital biomarkers targeting the cognitive symptoms of MCI by collecting data actively and passively via the patient’s smartphone with a user-friendly interface involving gamified tasks (28). Mezurio has been used in the PREVENT Dementia study and the UK Alzheimer’s Society GameChanger Study (53), with high user-compliance reported. Mezurio adapts to the user’s abilities when assessing memory (episodic, semantic, spatial memory), executive functions (attention, planning), verbal free-recall and fluency. Mezurio provides a broad spectrum of cognitive testing well-validated and easily deployable RMT in MCI cohorts.
BrainCheck Memory (https://braincheck.com/individuals/memory) is available on any Apple device and has been modified to detect age-related cognitive decline by measuring immediate and delayed recall, Trail Making Tests A and B, Stroop Test and Digit Symbol Substitution Task. In a recent large cohort study (54) in participants aged >49 years, BrainCheck Memory was administered by research staff, with scores significantly correlating with Saint Louis University Mental Status exam scores, Mini-Mental State Examination (MMSE) scores and MoCA scores. BrainCheck Memory was able to differentiate healthy controls from cognitively impaired participants (p=.02) and BrainCheck Memory composite scores were found to have a sensitivity of 81% and specificity of 94%.
The “Novel Assessment of Nutrition and Ageing” (NANA) touchscreen interface has been tested in 40 neurotypical elderly (mean age: 72 years) care home residents where it was deployed daily (55). Cognitive NANA data produced comparable validity and reliability to standard clinical measures, such as the MMSE, Symbol Digit Modalities Test and Digit Scan tests (55).Winterlight (https://winterlightlabs.com/) is a tablet-based cognitive assessment designed to detect cognitive impairment (56) by examining linguistic markers (57). The Mindmore (https://mindmore.com/) digitized cognitive test battery has been designed to examine global cognition, processing speed and attention, learning and memory (including working memory, executive function and language. Mindmore was recently tested in 81 healthy controls aged 21-85 years and was found to significantly correlate with traditional measures (median r=.53) (58).
The ‘Mobile Cognitive Screening’ (MCS) Android-based app is comprised of 33 questions over 14 tests examining the cognitive domains of executive functions, orientation, abstraction, arithmetic, memory, language, visual function and attention (29). In a sample of 23 healthy controls (mean age: 82 years) and 14 people with dementia (mean age: 73 years), MCS was able to differentiate MCI and controls participants in the cognitive domains of executive, visual, memory, attention, orientation functions (p=<0.05) 8. MCS scores also correlated (mean r2 = .57) with MoCA scores. Although providing interesting findings, the MCS has been tested in a small sample.
Wearables
Wearable sensors have the advantage of providing either passive data collection or short but repeated session of active data collection compared to online platforms and smartphone or tablet-based assessment. This provides an attractive alternative to memory services, who will want to use relatively short and simple measures/platforms. However, wearables can be expensive and are easier to misplace than other digital options.
The CANTAB’s n-back task has recently been adapted as part of the Cognition Kit app to be delivered via the Apple watch (https://www.apple.com/uk/watch/) in 30 mild-to-moderate depression participants (aged 19-63 years) (34). Participants were required to complete the n-back three times per day, in addition to mood surveys. Adherence, defined by participants completing the n-back as least once daily, was 95% and remained consistent over the 6 weeks of data collection. Daily n-back scores correlated (r=0.37-0.50) with standard cognitive assessments sensitive to depression (spatial working memory, rapid visual information processing).
Virtual Reality, Augmented Reality, and Games Consoles
Virtual reality, augmented reality and games consoles offer a unique and potentially more engaging approach to cognitive assessment and may negate any issues with poor eyesight if a headset or television screen is used. However, with this comes more user complexity, (potentially) additional devices and expense if the patient does not already have a compatible device.
The virtual reality platform, Smart Aging Serious Game (SASG), has recently been trialed in 32 amnestic MCI (aMCI) participants (mean age: 77 years) and 107 healthy controls (mean age: 77 years) (59). The SASG had a sensitivity of 84% and specificity of 74% and was superior than the MoCA, Free and Cued Selective Reminding Test and Trail Making Test for detecting right hippocampal neurodegeneration.
The Altoida Medical Device (https://altoida.com) has received Food and Drug Administration (FDA) class II medical device qualification. It provides digital biomarkers for detection of subtle microerrors in accuracy and micromovements in latency that can help detect if MCI will progress to dementia (35). The app employs a user-friendly augmented reality interface to recreate an advanced ADL in locating a recently concealed item in the immediate environment. Voice data, hands micromovements and microerrors, gait microerrors, posture changes, eye-tracking, visuospatial navigation microerrors data streams during task performance are combined to create the user’s Neuro Motor Index (NMI). In participants aged 55-95 years, the NMI provides diagnostic accuracy of 94% in predicting cognitive worsening in amyloid positive individuals who converted to Alzheimer’s disease (AD) from MCI after 5 years (60).
Game consoles have also been employed for dual-task paradigms. For example, Leach and colleagues (37) used the Nintendo Wii balance board (https://www.nintendo.co.uk/index.html) to examine sway distance, velocity, area, centroidal frequency and frequency dispersion as a single-task condition and dual-task paradigm in 20 neurotypical elderly care home residents (mean MMSE score = 28.6; mean age 87 years) over 30 days. The dual-task paradigm comprised of combined daily word search tasks administered via a tablet simultaneously with use of the Wii balance board. Postural sway related to global cognitive scale scores and poorer performance on the tablet-based daily word search related to a lower cognitive status. Greater variability in sway distance and area, and less variability in centroidal sway were associated with lower scores of single-task and dual-task conditions.
Neuro-World is a set of six mobile games designed to challenge visuospatial short-term memory and selective attention (61). These games allow the player to self-administer the assessment of his/her cognitive impairment level. Game-specific performance data was collected from 12 post-stroke patients at baseline and a three-month follow-up, which were used to train supervised machine learning models to estimate the corresponding MMSE scores, and were demonstrated to have great potential to be used to evaluate the cognitive impairment level and monitor long-term change (62).
Function
Accurately measuring function is crucial to distinguish between levels of cognitive decline (i.e., SCI, MCI and dementia) and also a key outcome in AD trials, especially at the earliest stages. Function is usually measured by self-report or caregiver reports regarding the person with dementia’s proficiency in executing basic, instrumental and advanced ADLs. Scales often neglect advanced ADLs, such as social functioning, despite social functioning, loneliness and social isolation’s contribution to dementia risk and morbidity (63–65). Indexing advanced ADLs are particularly relevant during the social distancing restrictions related to COVID-19, particularly in those more at risk of social isolation, such as the old and infirm.
Zygouris and colleagues (36) used the Virtual Super Market (VSM) to recreate an instrumental ADL for six healthy and six MCI participants (mean age: 64 years). Time of task completion was significantly longer for MCI participants and VSM scores provided a 92% classification rate for the detection of MCI. Mean VSM scores also significantly correlated with scores on the Functional Cognitive Assessment Scale, Test of Everyday Attention and Rey Osterrieth Complex Figure test.
The use of technology and devices itself has proven to be a valuable ADL for indexing functional decline in MCI, with computer-based behaviors, such as mouse clicks, typing speed and pauses corelating with cognitive scores in MCI and neurotypical users (66). Couth and colleagues identified 21 key technology behaviors sensitive to early cognitive impairment, such as text-based language use, incorrect passwords, mouse movements and difficulty opening correct items (67). Active and passive assessment of function across the full spectrum of basic, instrumental and advanced ADLs using RMTs is the primary purpose of ‘Remote Assessment of Disease and Relapse - Alzheimer’s disease’ (RADAR-AD, https://www.radar-ad.org/) to improve the assessment of functional decline in early-to-moderate AD. RADAR-AD’s main aim is the development and validation of technology-enabled, quantitative and sensitive measures of functional decline in AD and to evaluate if these new measures are more precise measures of function in a real-world environment across pre-clinical-to-moderate stages of AD compared to standard clinical rating scales. RADAR-AD’s leveraging of RMTs with real-life functional endpoints intends to improve methodologies for monitoring functional decline across the AD spectrum.
Mood Measurement for Remote Memory Clinics
Recent evidence has demonstrated that social disconnectedness, predicts higher perceived social isolation, leading to higher depression and anxiety symptoms among older people (68). The link between mood and sleep is also been well-established (69). Therefore, the potential negative psychological impact of COVID-19 may be compounded further by widely experienced sleep alterations, including disturbances in sleep quality and quantity, which also occur with increasing age and for those with dementia (70, 71).
Patient engagement with active smartphone applications, such as those developed by Remote Assessment of Disease and Relapse (RADAR) base (72, 73) offer a solution for the remote delivery of already validated questionnaires of sleep and mood (e.g., Patient Health Questionnaire, General Anxiety Disorder-7, Pittsburgh Sleep Quality Index). This type of RMT platform has the potential to provide easily accessible information to clinicians remotely, to better inform diagnoses and clinical decision making. This concept has already been developed among people with Major Depressive Disorder (MDD) to explore if longitudinal tracking using RMT can capture information predictive of depressive relapse and other key clinical outcomes (73). RMTs also offer a unique capability to provide continuous objective data, through passive data streaming methods (72). Sleep quality and quantity variables (e.g., duration of sleep and time spent in REM cycles) can be monitored remotely through actigraphy and consumer-wearable activity trackers (74, 75).
Motor Measurement for Remote Memory Clinics
Continuous day-to-day use of wearables are an ideal medium to collect large, well-powered data on motor symptoms, either by passive use of on-body sensors or “little but often” RMT-based active protocols. Wearable sensors for the detection of motor symptoms, such as The Personal KinetiGraph (PKG), have FDA approval and have been deployed and validated in clinical trials (76). Smartwatch-based sensors have been used predominantly in Parkinson’s disease (PD) to discriminate essential tremor from postural tremor (77). Other motor fluctuations, such as bradykinesia have been remotely assessed using wearable shoe sensors and watch-like sensors to measure gait patterns (78) and dyskinesia has been analyzed via home video recording (79) or using home diaries (80) for some time. Wearable gyroscopes and accelerometer sensors can passively collect data during standardized motor tasks, voluntary movements and ADLs to measure dyskinesia (78), for example, KinetiSense (https://kinetisense.com) wearable triaxial accelerometers and gyroscopes and have found that dyskinesia scores collected from KinetiSense highly correlated with clinician scores (r=.86) (81). The GAITRite (https://www.gaitrite.com) system has been employed to examine gait in aMCI (n=15), non-amnestic MCI (n=21) comparative to healthy controls HCs (n=21) to delineate that aMCI had greater gait variability than clinical and healthy controls (82).
Virtual Pathway for Memory Assessment
Outpatient-based remote memory clinics can carry-out further specialist diagnostic investigations to support accurate and timely diagnosis. Patients at risk of dementia can be followed up both remotely and in-clinic, while patients without evidence of a neurodegenerative disease (e.g., dementia biomarker-negative MCI) can be discharged to Primary Care. Patients diagnosed with prodromal dementia can be given the option of remote cognitive and functional assessments, even as part of a research framework, with these patients expected to have an annual face-to-face follow up in-clinic or until transition to clinical dementia (see Figure 2 for potential pathway). There is also increasing evidence the computerized cognitive training can have positive effects, and these may easily by administered from online testing platforms (47, 83).
Figure 2 Potential clinical pathway for remote memory clinics. GP, general practitioner; MCI, mild cognitive impairment.
Discussion
The COVID-19 pandemic has created major challenges for elderly people with cognitive impairment, as well as for memory clinics tasked with assessing and caring for this group. While the health systems in many countries are slowly moving back to normal, elderly people will still want to, or be expected, to reduce traveling and visiting hospitals for non-urgent causes, and in many countries infection rates are still increasing. Memory clinics therefore must adapt to this new situation and explore and offer new models and pathways for assessment and care. This situation also represents an opportunity to critically assess practices and to explore the many new technologies and methods available to assist clinicians in providing accurate, safe, and user-friendly ways of diagnosing elderly people with cognitive impairment. We have reviewed the literature and other sources, as well as reporting our own experience of deploying remote memory clinics and propose a new pathway that can be implemented immediately in memory clinics, at various levels of complexity.
As the simplest approach, Level 1 involves standard procedures, tests and questionnaires that can be administered by telephone, or, better, using available video-based platforms. While simple and requiring only a telephone, the limitations include that the psychometric characteristics may not immediately translate to this form of administration. At Level 2, we present several standardized measurements and instruments that have been digitized and have provided at least some degree of psychometric validity and reliability. Interestingly, many exciting new technologies are available to test not only cognition, but also mood and motor symptoms as well as daily functioning (Level 3). We believe that the recent challenges offer an opportunity to embrace new technology, devices, and wearables to accurately diagnose age-related cognitive disorders.
Digital biomarkers collected in remote memory clinics have significant potential for diagnosis and symptom management in older adults during and after COVID-19. Information is collected by RMTs in real-time, at a high frequency level and can also be delivered cost-effectively at a large scale. The collation of both active and passive RMT data in tandem, provides a more enriched clinical picture, while also providing a background of explanatory variables. Reduced participant burden and increased participant engagement are also among the potential benefits. Additionally, the frequency of data collected is incomparable to the momentary data capture currently employed in clinical settings. Such approaches provide accurate and continuous tracking of disease progression. These technologies may also be used to examine if some groups are more responsive than others to treatments. Such methodologies can be easily scaled-up to reach larger populations, including potentially primary care and will have relevance for future pandemics. Therefore, the scope of virtual memory clinics has significant potential to enhance current standards and should remain common practice after COVID-19.
The technologies discussed are particularly well-suited to measure and track cognitive and function and are thus excellent tools for identifying and staging cognitive impairment (i.e., SCD, MCI or dementia). However, an etiological diagnosis, i.e., identifying the disease causing the cognitive impairment, requires additional information. Although remote assessment of mood and motor symptoms, as well as the clinical history, can provide important information, biomarkers such as neuroimaging, cerebrospinal and blood markers and electroencephalogram (EEG) should be available.
Some of these biomarkers can be acquired remotely, such as EEG, sleep monitoring, and collection of saliva, urine and stools for microbiome and other analyses. For example, for the early differentiation of dementia with Lewy bodies (DLB) from AD, RMTs can enrich assessment of neuropsychiatric and dysautonomic symptoms typical in DLB (84) by capturing novel neurophysiological markers of fluctuating cognition (FC), visual hallucinations (VH), apathy or autonomic nervous system (ANS) impairments. By remotely measuring ANS function, RMTs can equip patients with person-specific protocols that complement their daily routines and lifestyle, in addition to integrating their clinical and psychosocial profiles to passively and actively collect objective contextualized data in day-to-day life over numerous timepoints. RMT-based EGG, such as Bytflies (https://www.byteflies.com), has begun to be used in epilepsy (85) and provides well-powered and contextualized data that we are using to remotely examine low-frequency spectral power in DLB (86), as longer EEG recordings in real-world settings will provide more sensitive signatures of brain changes and are more likely to capture acute episodes of FC or VH than lab-based EEG. We are also using RMTs to passively collect remote data on cardiovascular (e.g., orthostatic hypotension, postprandial hypotension) and thermoregulatory (e.g., anhidrosis, compensatory hyperhidrosis) ANS function in potential DLB cases to unmask any dysautonomia indicative of alpha-synucleinopathy. However, these biomarkers have not yet been established as diagnostic markers, thus, collection of diagnostic structural and functional neuroimaging and cerebrospinal fluid markers still requires attending a clinic.
We have provided an update on the landscape of RMT-based cognitive assessments that can be employed with immediate effect due to the urgent need to continue to deliver comprehensive memory clinic care and assessment during COVID-19, as well as a potential pathway for virtual memory assessment. Platforms, such as CANTAB and PROTECT Cognitive Test Battery offer validated and longitudinal follow-up in addition to agile design that allows for the addition of relevant tests. Other platforms, such as Neurotrack Memory Health Program (MHP, https://neurotrack.com/) combines interventions related to physical activity, diet, sleep, stress, social interaction and cognitive engagement but before any of these interventions can be used by the participant, they are required to carry out a visual paired comparison task that includes eye-tracking to provide a baseline sore of visual recognition memory. Neurotrack MHP has recently been validated in a feasibility investigation utilizing a quasi-experimental, single-arm, nonrandomized, longitudinal design in 242 healthy controls aged >51 years (31). MHP is more geared toward overarching health than cognitive testing, underlining how these online batteries can easily adapt interventions, such as cognitive behavioral therapy (CBT). Device-based cognitive assessments, such as Cognetivity and Mezurio are downloadable apps that are particularly targeted to detecting and tracking cognitive impairment. Altoida’s gamified augmented reality tasks on tablet or smartphone provides meaningful clinically relevant data and its use in largescale dementia trials makes it an ideal candidate RMT if the patient has access to the requisite hardware. The TICS has been well-validated and tested in the clinical environment (including in our clinics during the COVID-19 pandemic), producing strong construct validity compared to typical pen and paper and neuropsychological tests, aiding diagnosis while remaining a very cost-effective alternative to RMT-based assessments.
Ultimately the main argument for digital transformation in the memory services is being made for us due to COVID-19. Translating conventional pen-and-paper testing has accuracy and acceptability limitations and we believe this paper shows digital biomarkers are currently available and ready for use to this end. However, this will only be accessible for some and a key issue for memory clinics is providing a protocol and complete testing logistics chain involving caregivers or other proximal agents that can be applied to all patients. Long-term monitoring of people with MCI to identify progression to dementia is expensive and implementation of remote memory clinic pathways can provide a cost-efficient way of achieving this. Remote memory clinics can also improve research practices due to the integration of digital data onto electronic patient records that will improve data curation and availability.
A variety of computerized cognitive training interventions are available and there is increasing evidence supporting their efficacy, showing mild to moderate effect sizes in several cognitive domains in older people with MCI and dementia (83). Interestingly, several of the platforms and batteries for digital cognitive testing also offer interventions on the same platform, for example PROTECT (and its inbuilt cognitive test batteries) and MyCognition, which can often be directly tailored to the level of cognitive impairment (47). Given the lack of drug treatments for people with MCI, this is a particularly relevant feature for this group.
Although we argue the case for remote memory clinics, it is important not to neglect patients and carers who are unable to use technology for remote assessment or videoconferencing or have relevant disabilities, such as vision, speech or hearing difficulties, or other healthcare barriers related to race, economic status, disability and location. This also implies that only the more able members of the older adult community will access clinical assessment through this approach. However, arguments against digital solutions are often embedded in stereotyped views about tablet and computer use by older individuals, and there is evidence that the number of older people on line is growing fast and might even increase during COVID-19 (87). There are also limitations to rapport building and risk management should vulnerable clients become distressed during the assessment process. Clinicians should also be advised that facilitating remote testing should involve an additional pre-assessment screen to test suitability of video conferencing that factors in additional time requirements. Neuropsychological test batteries are designed and validated based on a strict set of instructions and protocols, meaning any adaptations or irregularity test administration risks invalidation. This has two major implications for clinicians. Firstly, invalidation may implicate licenses obtained through copyrighters and thus place clinicians in breach of signed agreements. Secondly, changes in administration may invalidate the norms on which scores and interpretations are based. Clinicians must therefore pay careful consideration to the implications of any adaptations for remote assessments as a result of these risks. The DoN caution that although research suggests some neuropsychological test batteries may have good reliability when administered remotely, there are still many measures that have not been assessed under these conditions, meaning the interpretation of such results must be conservative. Consideration must also be given to the risk of test material entering the public domain through remote assessments, thus undermining the validity of the tests themselves. Again, the DoN advised that clinicians must exercise caution when choosing to administer tests remotely and implement procedures that limit the risk of material entering the public domain. A further limitation to services committing to remote assessments is the publishers of tests have given notice that clinicians will need to complete training in order to qualify as registered administrators and the uncertainty regarding how long test manufacturers and licensors intend on allowing clinicians to administer their material remotely. The removal of any permission to share visual material on a computerized device would seriously hinder the potential use of visual tests. This means that, as well as a need for more research, testing the validity of remote assessments, greater flexibility on the part of test manufacturers will also be required. For example, during the COVID-19 pandemic, copyrighters have offered flexibility of how their tests can be administered, allowing the use of visualizers to share images of their tests during video calls for a limited time. It would be very beneficial for the sustainability of remote memory clinics to make such temporary permissions more permanent to allow for the development of more viable remote testing protocols. Patients’ lack of experience with RMTs and cognitive impairment present specific challenges, meaning remote memory clinics must be pragmatic (including relevant training for clinicians) and adhere to validated measures. Another consideration proving to be problematic in our experience is working with interpreters. This is already a challenge and will need separate and stratified approaches for both RMT and telephone consultations, as will sensory impairments, data protection, regulatory and feasibility issues. But the many challenges the COVID-19 pandemic has placed on memory services also provides an excellent opportunity to embrace novel technologies and approaches, both for cognitive testing and the tracking of functional status.
Future Implications and Needs
Several platforms and devices show good measurement accuracy in small groups, future research should include confirmatory studies demonstrating diagnostic accuracy in pre-dementia diagnosis in multicentre studies with large and diverse cohorts representative of the general clinic population, as well as sensitivity to change and utility in clinical trials. In addition, comprehensive assessments, including feasibility and acceptability involving user groups, cost-efficacy studies, and ensuring adherence to regulatory requirements are required to enable evidence-based selections and priorities of devices and platforms to be used for virtual memory clinic assessments. The Horizon2020/IMI2-supported RADAR projects (https://www.radar-ad.org, https://www.radar-cns.org/) are good examples for how to achieve this.
Conclusions
The individual, societal and public/private costs of COVID-19 are high and will continue to rise for some time but the many challenges COVID-19 has placed on memory services also provides an excellent opportunity to embrace novel technologies and approaches. A large number of possible solutions and technologies are available at different levels of sophistication. Remote memory clinics can be cost-effective and can enhance clinical assessment in the old and frail even during current or future social distancing measures. The financial, logistical, clinical and practical benefits of remote memory clinics have therefore been highlighted by COVID-19, supporting their use to not only be maintained when social distancing legislation is lifted but should be devoted extra resources and attention to fully potentiate this valuable arm of clinical assessment and care.
Data Availability Statement
The original contributions presented in the study are included in the article/supplementary material; further inquiries can be directed to the corresponding author.
Author Contributions
AO and DA: primary authors. CB, CK, HB, GL, KB, JS, SB, and LV: revisions and scientific content of MS. All authors contributed to the article and approved the submitted version.
Funding
This paper represents independent research partly funded by the National Institute for Health Research (NIHR) Biomedical Research Centre at South London and Maudsley NHS Foundation Trust and King’s College London.
Disclaimer
The views expressed are those of the authors and not necessarily those of the NHS, the NIHR, or the Department of Health and Social Care.
Conflict of Interest
DA has received research support and/or honoraria from Astra-Zeneca, H. Lundbeck, Novartis Pharmaceuticals, Biogen, and GE Health, and served as paid consultant for H. Lundbeck, Eisai, Heptares, and Mentis Cura. CB reports grants and personal fees from Acadia pharmaceutical company, grants and personal fees from Lundbeck, personal fees from Roche, personal fees from Otsuka, personal fees from Biogen, personal fees from Eli Lilly, personal fees from Novo Nordisk, personal fees from AARP, grants and personal fees from Synexus, and personal fees from Exciva, outside the submitted work. CK is the Chief Medical Officer of Cognetivity Ltd.
Author HB was employed by company Ecog Pro Ltd.
The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
DA is a Royal Society Wolfson Research Merit Award Holder and would like to thank the Wolfson Foundation and the Royal Society for their support.
References
1. Knopman DS, Petersen RC. Mild cognitive impairment and mild dementia: A clinical perspective. Mayo Clin Proc (2014) 89 (10):1452–9. doi: 10.1016/j.mayocp.2014.06.019
2. Kuo C-L, Pilling LC, Atkins JL, Masoli JAH, Delgado J, Kuchel GA, et al. APOE e4 Genotype Predicts Severe COVID-19 in the UK Biobank Community Cohort. J Gerontol Ser A (2020) glaa131. doi: 10.1093/gerona/glaa131
3. Steinman MA, Perry L, Perissinotto CM. Meeting the Care Needs of Older Adults Isolated at Home during the COVID-19 Pandemic. JAMA Internal Med (2020) 180 (6):819–20. doi: 10.1001/jamainternmed.2020.1661
4. Wang D, Hu B, Hu C, Zhu F, Liu X, Zhang J, et al. Clinical Characteristics of 138 Hospitalized Patients with 2019 Novel Coronavirus-Infected Pneumonia in Wuhan, China. JAMA - J Am Med Assoc (2020) 323 (11):1061–9. doi: 10.1001/jama.2020.1585
5. Royal College of Psychiatrists. Guidance on remote working for memory services during COVID-19. NHS England (2020). Available at: https://www.rcpsych.ac.uk/docs/default-source/members/faculties/old-age/guidance-on-remote-working-for-memory-services-during-covid-19.pdf?sfvrsn=ef9b27a9_2.
6. Ballard C, Banerjee S, Burns A, Cook J, Cook L, Clifford G, et al. Memory Service Assessments: A New Way Of Working. NHS England (2020).
7. Brandt J, Spencer M, Folstein M. The telephone interview for cognitive status. Neuropsychiatry. Neuropsychol Behav Neurol (1988) 1 (2):111–7.
8. Snowdon A, Hussein A, Kent R, Pino L, Hachinski V. Comparison of an electronic and paper-based montreal cognitive assessment tool. Alzheimer Dis Assoc Disord (2015) 29(4):325–9. doi: 10.1097/WAD.0000000000000069
9. Newkirk LA, Kim JM, Thompson JM, Tinklenberg JR, Yesavage JA, Taylor JL. Validation of a 26-point telephone version of the mini-mental state examination. J Geriatr Psychiatry Neurol (2004) 17(2):81–7. doi: 10.1177/0891988704264534
10. García-Casal JA, Franco-Martín M, Perea-Bartolomé MV, Toribio-Guzmán JM, García-Moja C, Goñi-Imizcoz M, et al. Electronic devices for cognitive impairment screening: A systematic literature review. Int J Technol Assess Health Care (2017) 33(6):654–73. doi: 10.1017/S0266462317000800
11. Aslam RW, Bates V, Dundar Y, Hounsome J, Richardson M, Krishan A, et al. A systematic review of the diagnostic accuracy of automated tests for cognitive impairment. Int J Geriatr Psychiatry (2018) 33(4):561–75. doi: 10.1002/gps.4852
12. Koo BM, Vizer LM. Mobile Technology for Cognitive Assessment of Older Adults: A Scoping Review. Innov Aging (2019) 3(1):igy038. doi: 10.1093/geroni/igy038
13. Blackwell AD, Sahakian BJ, Vesey R, Semple JM, Robbins TW, Hodges JR. Detecting dementia: Novel neuropsychological markers of preclinical Alzheimer’s disease. Dement Geriatr Cognit Disord (2004) 17(1–2):42–8. doi: 10.1159/000074081
14. Jacova C, McGrenere J, Lee HS, Wang WW, Le Huray S, Corenblith EF, et al. C-TOC (Cognitive Testing on Computer). Alzheimer Dis Assoc Disord (2015) 29(3):213–21. doi: 10.1097/WAD.0000000000000055
15. Wright DW, Nevárez H, Kilgo P, Laplaca M, Robinson A, Fowler S, et al. A novel technology to screen for cognitive impairment in the elderly. Am J Alzheimers Dis Other Demen (2011) 484–91. doi: 10.1177/1533317511426133
16. Brinkman SD, Reese RJ, Norsworthy LA, Dellaria DK, Kinkade JW, Benge J, et al. Validation of a self-administered computerized system to detect cognitive impairment in older adults. J Appl Gerontol (2014) 33 (8):942–62. doi: 10.1177/0733464812455099
17. D’Arcy S, Rapcan V, Gali A, Burke N, O’Connell GC, Robertson IH, et al. A study into the automation of cognitive assessment tasks for delivery via the telephone: Lessons for developing remote monitoring applications for the elderly. Technol Heal Care (2013) 21(4):387–96. doi: 10.3233/THC-130740
18. Domen AC, van de Weijer SCF, Jaspers MW, Denys D, Nieman DH. The validation of a new online cognitive assessment tool: The MyCognition Quotient. Int J Methods Psychiatr Res (2019) 28:e1775. doi: 10.1002/mpr.1775
19. Brooker H, Wesnes KA, Ballard C, Hampshire A, Aarsland D, Khan Z, et al. An online investigation of the relationship between the frequency of word puzzle use and cognitive function in a large sample of older adults. Int J Geriatr Psychiatry (2019) 34(7):921–31. doi: 10.1002/gps.5033
20. Bayer A, Phillips M, Porter G, Leonards U, Bompas A, Tales A. Abnormal inhibition of return in mild cognitive impairment: Is it specific to the presence of prodromal dementia? J Alzheimer’s Dis (2014) 40(1):177–89. doi: 10.3233/JAD-131934
21. Yang S, Flores B, Magal R, Harris K, Gross J, Ewbank A, et al. Diagnostic accuracy of tablet-based software for the detection of concussion. PloS One (2017) 12(7):e0179352. doi: 10.1371/journal.pone.0179352
22. Tierney MC, Lermer MA. Computerized cognitive assessment in primary care to identify patients with suspected cognitive impairment. J Alzheimer’s Dis (2010) 823–32. doi: 10.3233/JAD-2010-091672
23. Junkkila J, Oja S, Laine M, Karrasch M. Applicability of the CANTAB-PAL computerized memory test in identifying amnestic mild cognitive impairment and alzheimer’s disease. Dement Geriatr Cognit Disord (2012) 34(2):83–9. doi: 10.1159/000342116
24. Kim H, Hsiao CP, Do EYL. Home-based computerized cognitive assessment tool for dementia screening. J Ambient Intell Smart Environ (2012) 429–42. doi: 10.3233/AIS-2012-0165
25. Onoda K, Hamano T, Nabika Y, Aoyama A, Takayoshi H, Nakagawa T, et al. Validation of a new mass screening tool for cognitive impairment: Cognitive assessment for Dementia, iPad version. Clin Interv Aging (2013) 8:353–60. doi: 10.2147/CIA.S42342
26. Memória CM, Yassuda MS, Nakano EY, Forlenza OV. Contributions of the Computer-Administered Neuropsychological Screen for Mild Cognitive Impairment (CANS-MCI) for the diagnosis of MCI in Brazil. Int Psychogeriatr (2014) 1–9. doi: 10.1017/S1041610214000726
27. Ramratan WS, Rabin LA, Wang C, Zimmerman ME, Katz MJ, Lipton RB, et al. Level of recall, retrieval speed, and variability on the Cued-Recall Retrieval Speed Task (CRRST) in individuals with amnestic mild cognitive impairment. J Int Neuropsychol Soc (2012) 18(2):260–8. doi: 10.1037/t34666-000
28. Lancaster C, Koychev I, Blane J, Chinner A, Wolters L, Hinds C. Evaluating the feasibility of frequent cognitive assessment using the Mezurio smartphone app: Observational and interview study in adults with elevated dementia risk. JMIR mHealth uHealth (2020) 8(4):e16142. doi: 10.2196/preprints.16142
29. Zorluoglu G, Kamasak ME, Tavacioglu L, Ozanar PO. A mobile application for cognitive screening of dementia. Comput Methods Programs Biomed (2015) 118(2):252–62. doi: 10.1016/j.cmpb.2014.11.004
30. Makizako H, Shimada H, Park H, Doi T, Yoshida D, Uemura K, et al. Evaluation of multidimensional neurocognitive function using a tablet personal computer: Test-retest reliability and validity in community-dwelling older adults. Geriatr Gerontol Int (2013) 13(4):860–6. doi: 10.1111/ggi.12014
31. Glenn J, Madero EN, Gray M, Fuseya N, Ikeda M, Kawamura T, et al. Engagement with a digital platform for multimodal cognitive assessment and multidomain intervention in a Japanese population: Pilot, quasi-experimental, longitudinal study. JMIR mHealth uHealth (2019) 7(10):e15733. doi: 10.2196/15733
32. Satler C, Belham FS, Garcia A, Tomaz C, Tavares MCH. Computerized spatial delayed recognition span task: A specific tool to assess visuospatial working memory. Front Aging Neurosci (2015) 7:53. doi: 10.3389/fnagi.2015.00053
33. Ishiwata A, Kitamura S, Nomura T, Nemoto R, Ishii C, Wakamatsu N, et al. Early identification of cognitive impairment and dementia: Results from four years of the community consultation center. Arch Gerontol Geriatr (2013) 59 (2):457–61. doi: 10.1016/j.archger.2014.06.003
34. Cormack F, McCue M, Taptiklis N, Skirrow C, Glazer E, Panagopoulos E, et al. Wearable technology for high-frequency cognitive and mood assessment in major depressive disorder: Longitudinal observational study. J Med Internet Res (2019) 6(11):e12814. doi: 10.2196/preprints.12814
35. Gold M, Amatniek J, Carrillo MC, Cedarbaum JM, Hendrix JA, Miller BB, et al. Digital technologies as biomarkers, clinical outcomes assessment, and recruitment tools in Alzheimer’s disease clinical trials. Alzheimer’s Dement: Trans Res Clin Intervent (2018) 4:234–42. doi: 10.1016/j.trci.2018.04.003
36. Zygouris S, Ntovas K, Giakoumis D, Votis K, Doumpoulakis S, Segkouli S, et al. A Preliminary Study on the Feasibility of Using a Virtual Reality Cognitive Training Application for Remote Detection of Mild Cognitive Impairment. J Alzheimer’s Dis (2017) 56:619–27. doi: 10.3233/JAD-160518
37. Leach JM, Mancini M, Kaye JA, Hayes TL, Horak FB. Day-to-day variability of postural sway and its association with cognitive function in older adults: A pilot study. Front Aging Neurosci (2018) 10:126. doi: 10.3389/fnagi.2018.00126
38. Berg JL, Durant J, Léger GC, Cummings JL, Nasreddine Z, Miller JB. Comparing the Electronic and Standard Versions of the Montreal Cognitive Assessment in an Outpatient Memory Disorders Clinic: A Validation Study. J Alzheimer’s Dis (2018) 62(1):93–7. doi: 10.3233/JAD-170896
39. Wittich W, Phillips N, Nasreddine ZS, Chertkow H. Sensitivity and specificity of the Montreal cognitive assessment modified for individuals who are visually impaired. J Vis Impair Blind (2010) 104(6):360–8. doi: 10.1177/0145482X1010400606
40. Roccaforte WH, Burke WJ, Bayer BL, Wengel SP. Validation of a Telephone Version of the Mini-Mental State Examination. J Am Geriatr Soc (1992) 40 (7):697–702. doi: 10.1037/t49568-000
41. Fong TG, Fearing MA, Jones RN, Shi P, Marcantonio ER, Rudolph JL, et al. Telephone Interview for Cognitive Status: Creating a crosswalk with the Mini-Mental State Examination. Alzheimer’s Dement (2009) 5(6):492–7. doi: 10.1016/j.jalz.2009.02.007
42. Herr M, Ankri J. A critical review of the use of telephone tests to identify cognitive impairment in epidemiology and clinical research. J Telemed Telecare (2013) 19(1):45–54. doi: 10.1177/1357633X12474962
43. De Jager CA, Budge MM, Clarke R. Utility of TICS-M for the assessment of cognitive function in older adults. Int J Geriatr Psychiatry (2003) 18 (4):318–24. doi: 10.1002/gps.830
44. Bentvelzen AC, Crawford JD, Theobald A, Maston K, Slavin MJ, Reppermund S, et al. Validation and Normative Data for the Modified Telephone Interview for Cognitive Status: The Sydney Memory and Ageing Study. J Am Geriatr Soc (2019) 67(10):2108–15. doi: 10.1111/jgs.16033
45. Brearly TW, Shura RD, Martindale SL, Lazowski RA, Luxton DD, Shenal BV, et al. Neuropsychological Test Administration by Videoconference: A Systematic Review and Meta-Analysis. Neuropsychol Rev (2017) 27(2):174–86. doi: 10.1007/s11065-017-9349-1
46. Huntley J, Corbett A, Wesnes K, Brooker H, Stenton R, Hampshire A, et al. Online assessment of risk factors for dementia and cognitive function in healthy adults. Int J Geriatr Psychiatry (2018) 33(2):e286–93. doi: 10.1002/gps.4790
47. Corbett A, Owen A, Hampshire A, Grahn J, Stenton R, Dajani S, et al. The Effect of an Online Cognitive Training Package in Healthy Older Adults: An Online Randomized Controlled Trial. J Am Med Dir Assoc (2015) 16 (11):990–7. doi: 10.1016/j.jamda.2015.06.014
48. Wesnes KA, Brooker H, Ballard C, McCambridge L, Stenton R, Corbett A. Utility, reliability, sensitivity and validity of an online test system designed to monitor changes in cognitive function in clinical trials. Int J Geriatr Psychiatry (2017) 32(12):e83–92. doi: 10.1002/gps.4659
49. Kennedy DO, Scholey AB, Wesnes KA. The dose-dependent cognitive effects of acute administration of Ginkgo biloba to healthy young volunteers. Psychopharmacol (Berl) (2000) 151(4):416–23. doi: 10.1007/s002130000501
50. Creese B, Brooker H, Ismail Z, Wesnes KA, Hampshire A, Khan Z, et al. Mild Behavioral Impairment as a Marker of Cognitive Decline in Cognitively Normal Older Adults. Am J Geriatr Psychiatry (2019) 27(8):823–34. doi: 10.1016/j.jagp.2019.01.215
51. Khaligh-Razavi SM, Habibi S, Sadeghi M, Marefat H, Khanbagi M, Nabavi SM, et al. Integrated Cognitive Assessment: Speed and Accuracy of Visual Processing as a Reliable Proxy to Cognitive Performance. Sci Rep (2019) 9 (1):1102. doi: 10.1101/335463
52. Khaligh-Razavi SM, Sadeghi M, Khanbagi M, Kalafatis C, Nabavi SM. A self-administered, artificial intelligence (AI) platform for cognitive assessment in multiple sclerosis (MS). BMC Neurol (2020) 20(1):193. doi: 10.21203/rs.2.10768/v5
53. Lancaster C, Koychev I, Blane J, Chinner A, Chatham C, Taylor K, et al. Gallery Game: Smartphone-based assessment of long-term memory in adults at risk of Alzheimer’s disease. J Clin Exp Neuropsychol (2020) 42(4):329–43. doi: 10.1101/599175
54. Groppell S, Soto-Ruiz KM, Flores B, Dawkins W, Smith I, Eagleman DM, et al. A rapid, mobile neurocognitive screening test to aid in identifying cognitive impairment and dementia (braincheck): Cohort study. J Med Internet Res (2019) 2(1):e12615. doi: 10.2196/preprints.12615
55. Brown LJE, Adlam T, Hwang F, Khadra H, Maclean LM, Rudd B, et al. Computer-based tools for assessing micro-longitudinal patterns of cognitive function in older adults. Age (Omaha) (2016) 38(4):335–50. doi: 10.1007/s11357-016-9934-x
56. Yancheva M, Fraser K, Rudzicz F. Using linguistic features longitudinally to predict clinical scores for Alzheimer’s disease and related dementias. Proceedings of SPLAT 2015 6th Workshop on Speech and Language Processing for Assistive Technologies. Dresden, Germany (2015). p 134–39. doi: 10.18653/v1/W15-5123
57. Fraser KC, Meltzer JA, Rudzicz F. Linguistic features identify Alzheimer’s disease in narrative speech. J Alzheimer’s Dis (2015) 49(2):407–22. doi: 10.3233/JAD-150520
58. Björngrim S, van den Hurk W, Betancort M, Machado A, Lindau M. Comparing traditional and digitized cognitive tests used in standard clinical evaluation – a study of the digital application minnemera. Front Psychol (2019) 10:2327. doi: 10.3389/fpsyg.2019.02327
59. Cabinio M, Rossetto F, Isernia S, Saibene FL, Di Cesare M, Borgnis F, et al. The Use of a Virtual Reality Platform for the Assessment of the Memory Decline and the Hippocampal Neural Injury in Subjects with Mild Cognitive Impairment: The Validity of Smart Aging Serious Game (SASG). J Clin Med (2020) 9(5):1355. doi: 10.3390/jcm9051355
60. Tarnanas I, Tsolaki A, Wiederhold M, Wiederhold B, Tsolaki M. Five-year biomarker progression variability for Alzheimer’s disease dementia prediction: Can a complex instrumental activities of daily living marker fill in the gaps? Alzheimer’s Dement Diagnosis Assess Dis Monit (2015) 1(4):521–32. doi: 10.1016/j.dadm.2015.10.005
61. Jung HT, Lee H, Kim K, Kim B, Park S, Ryu T, et al. (2018). Estimating Mini Mental State Examination Scores using Game-Specific Performance Values: A Preliminary Study. Conf Proc IEEE Eng Med Biol Soc (2018) 2018:1518–21. doi: 10.1109/EMBC.2018.8512516
62. Jung HT, Daneault JF, Lee H, Kim K, Kim B, Park S, et al. Remote Assessment of Cognitive Impairment Level Based on Serious Mobile Game Performance: An Initial Proof of Concept. IEEE J BioMed Heal Inform (2019) 23(3):1269–77. doi: 10.1109/JBHI.2019.2893897
63. Zhang X, Li C, Zhang M. [Psychosocial risk factors of Alzheimer’s disease]. Zhonghua Yi Xue Za Zhi (1999) 79(5):335–8.
64. He YL, Zhang XK, Zhang MY. Psychosocial risk factors for Alzheimer’s disease. Hong Kong J Psychiatry (2000) 10(2):2–7.
65. Marioni RE, Proust-Lima C, Amieva H, Brayne C, Matthews FE, Dartigues JF, et al. Social activity, cognitive decline and dementia risk: A 20-year prospective cohort study Chronic Disease epidemiology. BMC Public Health (2015) 15:1089. doi: 10.1186/s12889-015-2426-6
66. Stringer G, Couth S, Brown LJE, Montaldi D, Gledson A, Mellor J, et al. Can you detect early dementia from an email? A proof of principle study of daily computer use to detect cognitive and functional decline. Int J Geriatr Psychiatry (2018) 33(7):867–74. doi: 10.1002/gps.4863
67. Couth S, Stringer G, Leroi I, Sutcliffe AG, Gledson A, Bruno D, et al. Which computer-use behaviours are most indicative of cognitive decline? Insights from an expert reference group. Health Inf J (2017) 25(3):1053–64. doi: 10.1177/1460458217739342
68. Santini ZI, Jose PE, York Cornwell E, Koyanagi A, Nielsen L, Hinrichsen C, et al. Social disconnectedness, perceived isolation, and symptoms of depression and anxiety among older Americans (NSHAP): a longitudinal mediation analysis. Lancet Public Heal (2020) 5(1):e62–e70. doi: 10.1016/S2468-2667(19)30230-0
69. Cole MG, Dendukuri N. Risk factors for depression among elderly community subjects: A systematic review and meta-analysis. Am J Psychiatry (2003) 160(6):1147–56. doi: 10.1176/appi.ajp.160.6.1147
70. Mander BA, Winer JR, Walker MP. Sleep and Human Aging. Neuron (2017) 94(1):19–36. doi: 10.1016/j.neuron.2017.02.004
71. Webster L, Gonzalez SC, Stringer A, Lineham A, Budgett J, Kyle S, et al. Measuring the prevalence of sleep disturbances in people with dementia living in care homes: A systematic review and meta-analysis. Sleep (2020) 43(4):zsz251. doi: 10.1093/sleep/zsz251
72. Ranjan Y, Rashid Z, Stewart C, Conde P, Begale M, Verbeeck D, et al. RADAR-base: Open source mobile health platform for collecting, monitoring, and analyzing data using sensors, wearables, and mobile devices. J Med Internet Res (2019) 7(8):e11734. doi: 10.2196/11734
73. Matcham F, Barattieri Di San Pietro C, Bulgari V, De Girolamo G, Dobson R, Eriksson H, et al. Remote assessment of disease and relapse in major depressive disorder (RADAR-MDD): A multi-centre prospective cohort study protocol. BMC Psychiatry (2019) 19(1):72. doi: 10.1186/s12888-019-2049-z
74. Evenson KR, Goto MM, Furberg RD. Systematic review of the validity and reliability of consumer-wearable activity trackers. Int J Behav Nutr Phys Activity (2015) 12:159. doi: 10.1186/s12966-015-0314-1
75. Ancoli-Israel S, Cole R, Alessi C, Chambers M, Moorcroft W, Pollak CP. The role of actigraphy in the study of sleep and circadian rhythms. Sleep (2003) 26(3):342–92. doi: 10.1093/sleep/26.3.342
76. Pahwa R, Isaacson SH, Torres-Russotto D, Nahab FB, Lynch PM, Kotschet KE. Role of the Personal KinetiGraph in the routine clinical assessment of Parkinson’s disease: recommendations from an expert panel. Expert Rev Neurotherapeutics (2018) 18(8):669–80. doi: 10.1080/14737175.2018.1503948
77. Wile DJ, Ranawaya R, Kiss ZHT. Smart watch accelerometry for analysis and diagnosis of tremor. J Neurosci Methods (2014) 230:1–4. doi: 10.1016/j.jneumeth.2014.04.021
78. Tsipouras MG, Tzallas AT, Rigas G, Tsouli S, Fotiadis DI, Konitsiotis S. An automated methodology for levodopa-induced dyskinesia: Assessment based on gyroscope and accelerometer signals. Artif Intell Med (2012) 55(2):127–35. doi: 10.1016/j.artmed.2012.03.003
79. Goetz CG, Leurgans S, Hinson VK, Blasucci LM, Zimmerman J, Fan W, et al. Evaluating parkinson’s disease patients at home: Utility of self-videotaping for objective motor, Dyskinesia, and ON-OFF assessments. Mov Disord (2008) 23 (10):1479–82. doi: 10.1002/mds.22127
80. Hauser RA, Russ H, Haeger DA, Bruguiere-Fontenille M, Müller T, Wenning GK. Patient evaluation of a home diary to assess duration and severity of dyskinesia in parkinson disease. Clin Neuropharmacol (2006) 29(6):322–30. doi: 10.1097/01.WNF.0000229546.81245.7F
81. Pulliam CL, Burack MA, Heldman DA, Giuffrida JP, Mera TO. Motion sensor dyskinesia assessment during activities of daily living. J Parkinsons Dis (2014) 4(4):609–15. doi: 10.3233/JPD-140348
82. Beauchet O, Allali G, Thiery S, Gautier J, Fantino B, Annweiler C. Association between high variability of gait speed and mild cognitive impairment: A cross-sectional pilot study. J Am Geriatr Soc (2011) 59(10):1973–74. doi: 10.1111/j.1532-5415.2011.03610_9.x
83. Hill NTM, Mowszowski L, Naismith SL, Chadwick VL, Valenzuela M, Lampit A. Computerized cognitive training in older adults with mild cognitive impairment or dementia: A systematic review and meta-analysis. Am J Psychiatry (2017) 174(4):329–40. doi: 10.1176/appi.ajp.2016.16030360
84. McKeith IG, Boeve BF, DIckson DW, Halliday G, Taylor JP, Weintraub D, et al. Diagnosis and management of dementia with Lewy bodies. Neurology (2017) 89(1):88–100. doi: 10.1212/WNL.0000000000004058
85. Nasseri M, Nurse E, Glasstetter M, Böttcher S, Gregg NM, Laks Nandakumar A, et al. Signal quality and patient experience with wearable devices for epilepsy management. Epilepsia (2020). doi: 10.1111/epi.16527
86. Bonanni L, Thomas A, Tiraboschi P, Perfetti B, Varanese S, Onofrj M. EEG comparisons in early Alzheimer’s disease, dementia with Lewy bodies and Parkinson’s disease with dementia patients with a 2-year follow-up. Brain (2008) 131(3):690–705. doi: 10.1093/brain/awm322
Keywords: dementia, cognitive impairment, telemedicine, neuropsychological assessment, geriatric psychiatry and aging, remote measurement technologies
Citation: Owens AP, Ballard C, Beigi M, Kalafatis C, Brooker H, Lavelle G, Brønnick KK, Sauer J, Boddington S, Velayudhan L and Aarsland D (2020) Implementing Remote Memory Clinics to Enhance Clinical Care During and After COVID-19. Front. Psychiatry 11:579934. doi: 10.3389/fpsyt.2020.579934
Received: 03 July 2020; Accepted: 31 August 2020;
Published: 18 September 2020.
Edited by:
Gianfranco Spalletta, Santa Lucia Foundation (IRCCS), ItalyReviewed by:
Valentina Ciullo, Santa Lucia Foundation (IRCCS), ItalyLuca Cravello, ASST Rhodense, Italy
Copyright © 2020 Owens, Ballard, Beigi, Kalafatis, Brooker, Lavelle, Brønnick, Sauer, Boddington, Velayudhan and Aarsland. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Andrew P. Owens, andrew.owens@kcl.ac.uk