Kelly Claire Simon1Chad Yucus1James Castle1Richard Chesis2Rebekah Lai2Laura Hillman2Samuel Tideman2Lisette Garduno1Steven Meyers1Roberta Frigerio1
Demetrius M. Maraganore1*- 1Department of Neurology, NorthShore University HealthSystem, Evanston, IL, United States
- 2Health Information Technology, NorthShore University HealthSystem, Evanston, IL, United States
The electronic medical record (EMR) presents an opportunity to standardize patient data collection based on quality guidelines and conduct practice-based research. We describe the development of a customized EMR “toolkit” that standardizes patient data collection with hundreds of discrete fields that supports Best Practices for treating patients with memory disorders. The toolkit also supports practice-based research. We describe the design and successful implementation of a customized EMR toolkit to support Best Practices in the care of patients with memory disorders. We discuss applications, including quality improvement projects and current research initiatives, using the toolkit. This toolkit is being shared with other departments of Neurology as part of the Neurology Practice-Based Research Network. Data collection is ongoing, including longitudinal follow-up. This toolkit will generate data that will allow for descriptive and hypothesis driven research as well-quality improvement among patients seen in a memory clinic.
Introduction
The prevalence of dementia worldwide in 2015 was estimated to be 47 million people and is projected to increase to 132 million by 2050. The financial burden is substantial, with the cost worldwide expected to grow to 2 trillion by 2030 (1). Alzheimer's disease (AD) is the most common form of dementia, affecting more than 5 million Americans (2). With the aging population of the US, there is likely to be a significant increase in the number of individuals living with AD. Projections suggest this number could grow to 16 million by 2050 (1), representing a more than three-fold increase in prevalence. In addition to considerable financial costs, dementia is a significant burden to patients, families, and caregivers.
Dementia represents the end of a spectrum of pathological changes resulting in significant impairment of memory, learning, thinking, language and judgment. MCI is an intermediate between normal age-related cognitive changes and dementia (3) and is categorized as either amnestic or non-amnestic (4). Further, these are subdivided into a single domain or multi-domain depending on the types of deficits present (3). Amnestic type is a strong prognostic factor for the subsequent development of AD. Prevalence estimates are challenging to ascertain for a variety of reasons, but in the population-based Mayo Clinic Study of Aging, the prevalence of MCI among non-demented individuals 70 and older was 16% (5), and the incidence rate was 68/1,000 person-years (6).
Delaying progression is crucial as dementia imposes a substantial burden beyond that of MCI. As such, early identification and intervention in individuals with MCI is of benefit for reducing future disease burden. Notably, patients with MCI and AD have an increased risk of behavioral and psychiatric symptoms (7–10). It has been estimated that up to 90% of dementia patients will experience these symptoms at some point during their disease (11, 12), and the presence of these is associated with worse outcomes, increased caregiver burden, longer hospitalizations and increased risk of medication misuse (13–18). Therefore, identifying these is crucial to providing early intervention and decreasing the risk of injury or worsening symptoms. Given the burden of dementia and the overall prevalence, even a small reduction in disease burden or small increase in symptom management could have an important population-level impact.
Providing care for dementia patients is complex and is often time-consuming for a thorough evaluation. Patients are frequently experiencing cognitive changes involving memory, thinking, language and judgment. Also, they may require a caregiver or proxy to conduct a thorough history. In a recent qualitative study, Jennings et al. found that patient and caregiver health goals change throughout the disease (19), emphasizing the importance of frequent re-assessment and ongoing care management. AAN guidelines have been published to address quality measures for patients with dementia (20–24), and more recently for MCI (25). Given the high need for intervention and support services for patients and their caregivers, integrating these Best Practices into routine clinical care represents optimal care. The degree, however, to which guidelines are implemented in practice and how frequently they are adhered to, is unclear.
Traditionally, electronic medical information has been entered in a non-standardized manner, frequently as free text. This makes data extraction challenging and hinders the ability to assess quality measures and conduct quality improvement initiatives and practice-based research. The electronic medical record (EMR) presents an opportunity to address these issues by standardizing care with discrete data collection. We have developed an EMR (Epic) “toolkit” that is customized to care of MCI/dementia patients to support Best Practices. The toolkit collects hundreds of fields of discrete data and includes progress notes with simple mouse clicks. Additionally, the toolkit supports practice-based research, at the point of care.
Methods
Toolkit Development and Building
The Department of Neurology at NorthShore University HealthSystem (NorthShore), located in the northern suburbs of Chicago, includes two cognitive disorder specialists practicing at four practice sites. Our seven-stage process for quality improvement and practice-based research using the electronic medical record has been previously described (26). We describe the development of our highly customized Memory SCDS “toolkit” that supports clinical evaluation at initial, annual or interval visits.
Content Development
Our goal was to build an EMR toolkit with the purpose of supporting Best Practices in treating patients with cognitive disorders. To achieve this goal, neurologists specializing in cognitive impairment at NorthShore held frequent meetings to discuss necessary elements to support Best Practices. This included not only specific elements but also specific instruments. A review of pertinent medical literature, AAN quality measures on Dementia (20–25) and the Alzheimer's Association Guidelines (27) was used to reach our physician consensus on the content for the toolkit.
Toolkit Building
After deciding on the content, we conducted meetings with programmers from NorthShore's EMR Optimization team every 2 weeks. Using our existing EMR platform (Epic), they built an SCDS toolkit that included navigators (a sidebar index of processes to choose from), electronic forms (which have the ability to auto-score and auto-interpret), and summary flow sheets. We included free text fields to allow for additional information. The content includes discretized fields to record detailed information regarding symptoms (past and current), medication history, and treatment response. Relevant imaging and imaging reports are also included. When possible, results of imaging reports are also entered as discretized fields. We also included several score test measures, including the Barthel Index (28), GDS (Geriatric Depression Score) (29), FAQ (Functional Activities Questionnaire) (30), MoCA (Montreal Cognitive Assessment) 8.1 (31), and STMS (Short Test of Mental Status) (32). These measures are auto scored (when appropriate) and provide interpretation to the clinician (for example, normal cognition vs. possible cognitive impairment). Concerning the MoCA and STMS, based on the physician's clinical judgment, one or the other may be administered depending on the particular patient. As such, we convert each to an MMSE-converted score (Mini-Mental State Examination-converted) (33). Both the MoCA and STMS can be converted to the MMSE and, thus, we use the MMSE as a standardized measure of cognitive assessment. Although there are many potentially relevant tests, these were chosen based on our physician's review of pertinent literature and clinical judgment to support their practice. We designed workflows (the order and assignment of tasks to a care team that included a medical assistant and a behavioral neurologist) and mapped items to the progress notes (the order and layout in which the content would write). Of importance was that the toolkit implementation did not extend our appointment times (60 min for initial visit). Although there is a learning curve, we have found that once physicians are familiar with the toolkit, these do not add to face-to-face physician time. However, because time is important, as discussed later, we continually evaluate the toolkits for opportunities to reduce time without compromising elements of Best Practices.
Toolkit Implementation
After the SCDS toolkit build was complete, the implementation phase began. We first used the toolkit in a development environment, to test the usability and allow physicians the opportunity to provide feedback on the toolkit flow and any potential issues with usage. Once all users were satisfied with the toolkits performance, it was moved to production. We continued to meet bi-weekly to discuss any new issues or potential opportunities to refine the toolkit.
Quality Monitoring
Following implementation, we continued to meet every 2 weeks with programmers specialized in extracting, transforming, and loading data from the EMR's data repository to specific data marts in NorthShore's Enterprise Data Warehouse (EDW). The EDW programmers created enrollment reports for tracking patients and produced data quality reports indicating which required data was missing from office visits. These data quality reports are distributed to the care team monthly. Physicians and other care team members have the opportunity to review missing data to determine the cause. When systematic errors occurred, the teams had the opportunity to improve their use of the toolkits or to request optimizations or a change in data requirements. Because the toolkit content was determined through a physician-led process, frequently missing data is likely due to a measure not to be testable by the nurse or the physicians. For this reason we have included “not tested” or “unable to test” options for tests to distinguish this from missing data when appropriate. If the physicians are not using an element, it presents an opportunity to make changes to the toolkit. The monthly reports produced only a few or no data checks per provider once the project was established. However, toolkit optimization is ongoing and providers have the opportunity to request changes as practice standards and diagnostics evolve continually. We also produce monthly de-identified descriptive reports of the data generated from patient encounters. Our research team reviews these for inconsistencies or errors.
Application
Examples of our screenshots from our toolkits are shown in Figures 1, 2. From the toolkits, we have productionalized de-identified descriptive reports. These reports are run monthly and provide visual displays of the data. For categorical variables, histograms with raw counts are presented (see Data Sheet 1 for full descriptive report). For continuous variables, this includes scatter plots as well as measures of central tendency and dispersion. Lastly, our productionalized reports include correlation plots and principal components analysis to examine the relationship between our continuous measures (see Data Sheet 2 for full analytical report). In addition to being of interest in understanding our patient population, these reports present opportunities for refinement of the toolkit. For example, if a variable has an extremely low frequency, we can consider whether it should be removed from the toolkit.
Figure 1. Screenshots of the Memory Disorders SDCS toolkit within the EMR. (A) Functional activities questionnaire, (B) Barthel Index.
Figure 2. Screenshots of the Memory Disorders SDCS toolkit within the EMR. (A) Current symptoms, (B) initial visit impression.
Similarly, if we find two measures are highly correlated, we can consider whether both need to be included. Additionally, these reports allow us to examine the data for expected relationships and to understand our patient population. For example, we can stratify these reports according to degree of impairment, producing one for patients with MCI and one for patients with dementia, for comparison.
We are also using the toolkit to identify quality improvement opportunities at the point-of-care, allowing the physician to take immediate action. As a department based initiative, we have developed Best Practice Advisories (BPAs) that alert the neurologist when a patient screens positive for depression and anxiety. When alerted, the neurologist must provide information on whether action was taken (referral, medication prescribed, etc.) or not. If not, a reason must be provided from a drop-down menu. We plan to evaluate the impact of our depression BPA by assessing clinical measures of depression and quality of life, before and after the implementation of this BPA. We are also planning similar BPAs specific to patients in our memory clinic. For example, when a patient's FAQ suggests difficulty with financial management tasks, we plan to assess the frequency that a social worker referral is ordered. Also, we plan to assess how frequently a driving evaluation is ordered if a patient has a positive driving safety screen.
Similarly we could consider whether patients with evidence of cognitive disorder as evidenced by the MoCA or STMS, have neuropsychiatric testing or advanced care planning documented. Lastly, in patients reporting falls within the past year, we plan to assess the frequency with which a physical therapy referral is ordered. Once these are implemented, we can assess the effectiveness by determining whether there is a change in physician behavior and how these changes relate to patient outcomes.
To complement the clinical data, we are also using the toolkit to enroll patients in our IRB approved DNA biobanking study. We developed a BPA that is triggered if patients meet the eligibility criteria for our DNA biobanking study. The BPA prompts the consenting of the patient and subsequent enrollment at the point of care (NorthShore IRB approved study EH10-139). These patients consent to a one-time blood draw, but otherwise, no study specific visits are required. Data is completely captured within the context of the office visit through use of the toolkit. Genome-wide SNP genotyping was recently completed on these patients and will be used to complement the clinical data and conduct novel studies of biomarkers and risk assessment. Lastly, we are actively sharing this toolkit through the Neurology Practice Based Research Network (NPBRN), which we created through a grant from AHRQ. The NPBRN partner sites adopt relevant toolkits at their site for the purposes of data sharing, to benchmark performance and to conduct quality improvement initiatives and practice-based research. For information regarding joining the NPBRN, please contact the corresponding author (DMM). Lastly, we are also enrolling patients in a point-of-care clinical trial for patients with MCI using a sub-group based adaptive design (SUBA) (NorthShore IRB approved study EH14-355) (34). We are comparing the effectiveness of three nootropic drugs. Although it is a randomized trial, it is conducted in a real clinical setting, with no study specific office visits. This trial is currently in progress.
Advantages and Limitations
We describe here our experience with creating and implementing a customized toolkit to care for patients presenting with cognitive complaints. The advantage of our approach is that it is a physician-driven process. The foundation of the toolkit is supporting Best Practices for clinical care. From this, we can conduct clinical research at the point-of-care, as described. Data extraction from clinical data is challenging because of heterogeneity in data entry. Our toolkit has the advantage of being highly discretized, collecting hundreds of fields of data at each encounter. This makes extraction, reporting and data analysis much more accessible. We also generate frequent descriptive and analytic reports providing feedback to clinicians on their patients and the utility of toolkit usage. The toolkit also streamlines the office visit by assigning tasks to different members of the care team. Standardization of care also makes longitudinal comparison easier. In the toolkit, repeated measures can be easily visualized, allowing the physician to see changes over time quickly. This also presents the opportunity for longitudinal research. We currently have almost 3 years of longitudinal data on these patients that can be examined for quality improvement and practice based-research studies. Lastly, the standardization of data allows for collaborative research initiatives through data sharing. Multi-site research is often challenging because of differences in data collection. Standardized data collection allows the opportunity to assess quality and research questions in diverse patient populations across geographic sites, all with comparable data.
Conclusion
The EMR presents a novel opportunity to improve patient care through quality assessment and research initiatives. We demonstrate here the creation of a standardized EMR that we are currently using in clinical practice to conduct quality initiatives and practice-based research. Through these projects, we strive to identify opportunities to improve care and outcomes for patients living with cognitive disorders.
Ethics Statement
Written informed consent was not obtained for assessment using the EMR toolkits, as this was done in the course of routine clinical practice. Written informed consent was obtained for the extraction and storage of DNA, as part of a separate study. The DNA collection protocol was approved by the NorthShore University HealthSystem Institutional Review Board.
Author Contributions
SM, RF, and DM developed the toolkit and contributed conception and design of the study. CY contributed data and study conception and design. Other data contributors are JC and LG. RC, RL, and LH also developed the toolkit. ST contributed statistical support. KS wrote the first draft of the manuscript. All authors contributed to manuscript revision, read, and approved the submitted version.
Funding
This work was supported by the Agency for Healthcare Research and Quality (R01HS024057) awarded to DM.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
The authors acknowledge the generous funding support of the Auxiliary of NorthShore University HealthSystem with respect to the initial building of electronic medical record (EMR) toolkits, and thank the medical assistants, nurses, neurologists, EMR Optimization, and Enterprise Data Warehouse programmers, administrators, and research personnel at NorthShore University HealthSystem who contributed to the quality improvement and practice-based research initiative using the EMR.
The authors thank Vimal Patel, Ph.D. and Hannah Moulthrop, M.S., for their assistance with editing, copy-editing, preparation of figures, formatting, and submitting the manuscript for publication.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fneur.2019.00161/full#supplementary-material
References
1. Alzheimer's Disease International. World Alzheimer Report 2015: The Global Impact of Dementia. Available online at: https://www.alz.co.uk/research/world-report-2015 (Accessed May 4, 2018).
2. Alzheimer's Association. 2016 Alzheimer's disease facts and figures. Alzheimers Dement. (2016) 12:459–509. doi: 10.1016/j.jalz.2016.03.001
3. Petersen RC. Mild cognitive impairment as a diagnostic entity. J Intern Med. (2004) 256:183–94. doi: 10.1111/j.1365-2796.2004.01388.x
4. Petersen RC, Morris JC. Mild cognitive impairment as a clinical entity and treatment target. Arch Neurol. (2005) 62:1160–3 doi: 10.1001/archneur.62.7.1160
5. Petersen RC, Roberts RO, Knopman DS, Geda YE, Cha RH, Pankratz VS, et al. Prevalence of mild cognitive impairment is higher in men. the mayo clinic study of aging. Neurology. (2010) 75:889–97. doi: 10.1212/WNL.0b013e3181f11d85
6. Geda YE, Roberts RO, Mielke MM, Knopman DS, Christianson TJ, Pankratz VS, et al. Baseline neuropsychiatric symptoms and the risk of incident mild cognitive impairment: a population-based study. Am J Psychiatry. (2014) 171:572–81. doi: 10.1176/appi.ajp.2014.13060821
7. Ismail Z, Elbayoumi H, Fischer CE, Hogan DB, Millikin CP, Schweizer T, et al. Prevalence of depression in patients with mild cognitive impairment: a systematic review and meta-analysis. JAMA Psychiatry. (2017) 74:58–67. doi: 10.1001/jamapsychiatry.2016.3162
8. Boccardi V, Conestabile Della Staffa M, Baroni M, Ercolani S, Croce MF, Ruggiero C, et al. ReGAL study group. prevalence and correlates of behavioral disorders in old age subjects with cognitive impairment: results from the ReGAl project. J Alzheimers Dis. (2017) 60:1275–83. doi: 10.3233/JAD-170494
9. Van der Mussele S, Mariën P, Saerens J, Somers N, Goeman J, De Deyn PP, et al. Behavioral syndromes in mild cognitive impairment and Alzheimer's disease. J Alzheimers Dis. (2014) 38:319–29. doi: 10.3233/JAD-130596
10. Gallagher D, Fischer CE, Iaboni A. Neuropsychiatric symptoms in mild cognitive impairment. Can J Psychiatry. (2017) 62:161–9. doi: 10.1177/0706743716648296
11. Cerejeira J, Lagarto L, Mukaetova-Ladinska EB. Behavioral and psychological symptoms of dementia. Front Neurol. (2012) 3:73. doi: 10.3389/fneur.2012.00073
13. Allegri RF, Sarasola D, Serrano CM, Taragano FE, Arizaga RL, Butman J, et al. Neuropsychiatric symptoms as a predictor of caregiver burden in Alzheimer's disease. Neuropsychiatr Dis Treat. (2006) 2:105–10.
14. Cheng ST. Dementia caregiver burden: a research update and critical analysis. Curr Psychiatry Rep. (2017) 19:64. doi: 10.1007/s11920-017-0818-2
15. Sheikh F, Ismail Z, Mortby ME, Barber P, Cieslak A, Fischer K, et al. PROMPT registry investigators. prevalence of mild behavioral impairment in mild cognitive impairment and subjective cognitive decline, and its association with caregiver burden. Int Psychogeriatr. (2018) 30:233–44. doi: 10.1017/S104161021700151X
16. Okura T, Plassman BL, Steffens DC, Llewellyn DJ, Potter GG, Langa KM. Prevalence of neuropsychiatric symptoms and their association with functional limitations in older adults in the United States: the aging, demographics, and memory study. J Am Geriatr Soc. (2010) 58:330–7. doi: 10.1111/j.1532-5415.2009.02680.x
17. Okura T, Plassman BL, Steffens DC, Llewellyn DJ, Potter GG, Langa KM. Neuropsychiatric symptoms and the risk of institutionalization and death: the aging, demographics, and memory study. J Am Geriatr Soc. (2011) 59:473–81. doi: 10.1111/j.1532-5415.2011.03314.x
18. Elliott RA, Goeman D, Beanland C, Koch S. Ability of older people with dementia or cognitive impairment to manage medicine regimens: a narrative review. Curr Clin Pharmacol. (2015) 10:213–21. doi: 10.2174/1574884710666150812141525
19. Jennings LA, Palimaru A, Corona MG, Cagigas XE, Ramirez KD, Zhao T, et al. Patient and caregiver goals for dementia care. Qual Life Res. (2017) 26:685–93. doi: 10.1007/s11136-016-1471-7
20. Doody RS, Stevens JC, Beck C, Dubinsky RM, Kaye JA, Gwyther L, et al. Practice parameter: management of dementia (an evidence-based review). Report of the quality standards subcommittee of the American Academy of Neurology. Neurology. (2001) 56:1154–66. doi: 10.1212/WNL.56.9.1154
21. Dubinsky RM, Stein AC, Lyons K. Practice parameter: risk of driving and Alzheimer's disease (an evidence-based review): report of the quality standards subcommittee of the American Academy of Neurology. Neurology. (2000) 54:2205–11. doi: 10.1212/WNL.54.12.2205
22. Iverson DJ, Gronseth GS, Reger MA, Classen S, Dubinsky RM, Rizzo M. Quality standards subcomittee of the American Academy of Neurology. Practice parameter update: evaluation and management of driving risk in dementia: report of the quality standards subcommittee of the American Academy of Neurology. Neurology. (2010) 74:1316–24. doi: 10.1212/WNL.0b013e3181da3b0f
23. Odenheimer G, Borson S, Sanders AE, Swain-Eng RJ, Kyomen HH, Tierney S, et al. Quality improvement in neurology: dementia management quality measures. Neurology. (2013) 81:1545–9. doi: 10.1212/WNL.0b013e3182a956bf
24. Thurman DJ, Stevens JA, Rao JK. Quality standards subcommittee of the American Academy of Neurology. Practice parameter: assessing patients in a neurology practice for risk of falls (an evidence-based review): report of the quality standards subcommittee of the American Academy of Neurology. Neurology. (2008) 70:473–9. doi: 10.1212/01.wnl.0000299085.18976.20
25. Petersen RC, Lopez O, Armstrong MJ, Getchius TSD, Ganguli M, Gloss D, et al. Practice guideline update summary: mild cognitive impairment: report of the guideline development, dissemination, and implementation subcommittee of the American Academy of Neurology. Neurology. (2018) 90:126–35. doi: 10.1212/WNL.0000000000004826
26. Maraganore DM, Frigerio R, Kazmi N, Meyers SL, Sefa M, Walters SA, et al. Quality improvement and practice-based research in neurology using the electronic medical record. Neurol Clin Pract. (2015) 5:419–29. doi: 10.1212/CPJ.0000000000000176
27. Alzheimer's Association. Health Care Professionals and Alzheimer's. Available online at: https://www.alz.org/health-care-professionals/clinical-guidelines-dementia-care.asp (Accessed May 4, 2018).
28. Mahoney FI, Barthel DW. Functional evaluation: the barthel index. Md State Med J. (1965) 14:61–5.
29. Yesavage JA, Brink TL, Rose TL, Lum O, Huang V, Adey M, et al. Development and validation of a geriatric depression screening scale: a preliminary report. J Psychiatr Res. (1982–1983) 17:37–49. doi: 10.1016/0022-3956(82)90033-4
30. Pfeffer RI, Kurosaki TT, Harrah CH Jr, Chance JM, Filos S. Measurement of functional activities in older adults in the community. J Gerontol. (1982) 37:323–9. doi: 10.1093/geronj/37.3.323
31. Nasreddine ZS, Phillips NA, Bédirian V, Charbonneau S, Whitehead V, Collin I, et al. The Montreal cognitive assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc. (2005) 53:695–9. doi: 10.1111/j.1532-5415.2005.53221.x
32. Kokmen E, Naessens JM, Offord KP. A short test of mental status: description and preliminary results. Mayo Clin Proc. (1987) 62:281–8. doi: 10.1016/S0025-6196(12)61905-3
33. Folstein MF, Folstein SE, McHugh PR. “Mini-mental state.” A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. (1975) 12:189–98. doi: 10.1016/0022-3956(75)90026-6
Keywords: quality improvement, cohort studies, electronic health records, data collection, research, neurology, memory disorders
Citation: Simon KC, Yucus C, Castle J, Chesis R, Lai R, Hillman L, Tideman S, Garduno L, Meyers S, Frigerio R and Maraganore DM (2019) Building of EMR Tools to Support Quality and Research in a Memory Disorders Clinic. Front. Neurol. 10:161. doi: 10.3389/fneur.2019.00161
Received: 21 November 2018; Accepted: 07 February 2019;
Published: 07 March 2019.
Edited by:
Keith Vossel, University of Minnesota Twin Cities, United StatesReviewed by:
Peter S. Pressman, University of Colorado Denver, United StatesArun Bokde, Trinity College Dublin, Ireland
Copyright © 2019 Simon, Yucus, Castle, Chesis, Lai, Hillman, Tideman, Garduno, Meyers, Frigerio and Maraganore. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Demetrius M. Maraganore, ZG1hcmFnYW5vcmVAbWUuY29t