- 1Health Sciences School, Polytechnic Institute of Guarda, Guarda, Portugal
- 2Local Health Unit of Guarda, Guarda, Portugal
- 3Research Unit for Inland Development, Polytechnic Institute of Guarda (UDI/IPG), Guarda, Portugal
- 4Consortium for Biomedical Research in Epidemiology and Public Health (CIBER en Epidemiología y Salud Pública- CIBERESP), Santiago de Compostela, Spain
- 5Health Research Institute of Santiago de Compostela (IDIS), Santiago de Compostela, Spain
- 6Department of Preventive Medicine and Public Health, University of Santiago de Compostela, Santiago de Compostela, Spain
- 7Department of Medical Sciences, Institute of Biomedicine (iBiMED-UA), University of Aveiro, Aveiro, Portugal
- 8Health Science Research Center (CICS/UBI), University of Beira Interior, Covilhã, Portugal
Background: Age-related comorbidities prone older adults to polypharmacy and to an increased risk of potentially inappropriate medication (PIM) use. This work aims to analyze the concordance and overlap among the EU(7)-PIM list, 2019 Beers criteria, and Screening Tool of Older Person’s Prescriptions (STOPP) version 2 criteria and also to analyze the prevalence of PIM.
Methods: A retrospective cohort study was conducted on older inpatients of an internal medicine ward. Demographic, clinical, and pharmacological data were collected, during March 2020. After PIM identification by the EU(7)-PIM list, Beers criteria, and STOPP v2 criteria, the concordance and overlap between criteria were analyzed. A descriptive analysis was performed, and all the results with a p-value lower than 0.05 were considered statistically significant.
Results: A total of 616 older patients were included in the study whose median age was 85 (Q1–Q3) (78–89) years. Most of the older patients were male (51.6%), and the median (Q1–Q3) number of days of hospitalization was 17 (13–22) days. According to the EU(7)-PIM list, Beers criteria, and STOPP criteria, 79.7, 92.0, and 76.5% of older adults, respectively, used at least one PIM. A poor concordance (<63.4%) among criteria was observed. An association between PIM and the number of prescribed medicines was found in all applied criteria. Moreover, an association between the number of PIMs and diagnoses of endocrine, nutritional, and metabolic diseases, mental, behavioral, and neurodevelopmental disorders, and circulatory system diseases and days of hospitalization was observed according to Beers criteria, and that with diseases of the circulatory system and musculoskeletal system and connective tissue was observed according to STOPP criteria.
Conclusion: Despite the poor concordance between the EU(7)-PIM list, 2019 Beers, and STOPP v2 criteria, this work highlights the need for more studies in inpatients to develop strategies to facilitate the identification of PIM to decrease the high prevalence of PIM in hospitalized patients. The poor concordance among criteria also highlights the need to develop new tools adapting the existing criteria to medical ward inpatients.
Introduction
Age-related pharmacokinetic and pharmacodynamics changes cause a decrease in the ability to adapt to external environment alterations, increased susceptibility to the disease, a lesser capacity to recovery that causes a modified response to medications, greater susceptibility to the occurrence of adverse drug reactions (ADRs) (Alvis and Hughes, 2015; Gutierrez Valencia et al., 2016; Giardina et al., 2018), and an upsurge need for health resources (Stegemann et al., 2010).
Polypharmacy, the use of five or more medicines (Lee et al., 2020), is quite common in patients with multiple comorbidities and is considered a factor for functional decline in older adults, which increases the chance of medication-related problems (Garcia-Caballero et al., 2018; Lee et al., 2020). Overall, polypharmacy is associated with increased consumption of potentially inappropriate medication (PIM) (Oktora et al., 2020).
In this context, medicines are considered appropriate for older adults, when there is a clear, evidence-based indication that these medicines are generally well tolerated and have a favorable benefit/risk ratio in older adults (Laroche et al., 2019).
PIMs are medicines in which the potential risk of occurrence of ADR may be greater than the clinical benefit (Renom-Guiteras et al., 2015) that can be driven from their use, particularly when there is scientific evidence of alternatives that may be safer, so it becomes essential to optimize the prescription of medicines in aged population (Renom-Guiteras et al., 2015; Grina and Briedis, 2017). Several tools using explicit or implicit criteria have been developed to allow the identification of PIM and prevent PIM-associated negative outcomes (Chang and Chan, 2010; Kaufmann et al., 2014; Lucchetti and Lucchetti, 2017; Motter et al., 2018). Because older inpatients are at particular risk of PIM (Sinvani et al., 2013; Nothelle et al., 2017), it is fundamental to understand what drives the use of PIM in hospitals to design interventions to restraint PIM use in this setting. According to our knowledge, the overlap and concordance among criteria remain poorly reported in all settings. Therefore, we sought to analyze the concordance and overlap between the EU(7)-PIM list, 2019 Beers criteria, and Screening Tool of Older Person’s Prescriptions (STOPP) version 2 (v2) criteria in the identification of PIM in older adult inpatients in a general internal medicine ward. Also, the prevalence of PIM, using the EU(7)-PIM list, Beers criteria, and STOPP criteria, will be analyzed.
Materials and Methods
Source of Data and Study Population
A retrospective cohort study was performed to examine the overlap and concordance between the EU(7)-PIM list, 2019 American Geriatric Society (AGS) Beers criteria, and STOPP v2 criteria on the detection of PIM among older inpatients of an internal medicine ward of a first-level hospital belonging to the NUTS II (Nomenclatura das Unidades Territoriais para Fins Estatísticos/Nomenclature of Territorial Units for Statistics) area of Portugal defined by the Regional Administration of Health Center (Administração Regional de Saúde do Centro/ARS-C). The hospital where the study takes place covers a total of 51243 older adults (PORDATA, 2020) and has a total of 68 beds in the general internal medicine ward.
Eligible to participate in the study were all older patients (aged ≥65) admitted in the internal medicine ward during 2019 and hospitalized for at least 4 days, during 2019. Data were encoded and retrospectively collected, during March 2020, from the hospital’s electronic medical record and included patient age, patient gender (male/female), patient diagnoses, hospitalization days, drugs prescribed, and also medical and laboratory tests. This study obtained the ethical approval of the hospital ethical committee and authorization from the hospital board (ref. 01167) on February 7, 2020. All data were retrospectively encoded without any possibility of identification and were treated according to the European Union (EU) General Data Protection Regulation (GDPR).
Data Collection
All drugs prescribed to older patients during the study period were analyzed and PIM identified by the three tools used by two independent researchers (CP and DR), and any disagreement regarding PIM classification was resolved by a third researcher (FR) (Supplementary Tables 1–10).
PIM detection tools used were as follows:
a) The EU(7)-PIM list was developed through the consensus of experts from seven European countries: Estonia, Finland, France, Germany, Holland, Spain, and Sweden (Renom-Guiteras et al., 2015). The purpose of this list is to enable the identification and comparison of PIM prescription profiles for the elderly across the European community. This list comprises 275 active substances, 7 classes of drugs, belonging to 55 therapeutic classes, and 34 pharmacotherapeutic groups. In this work, the list adapted to Portuguese reality was used (Rslbodrigues et al., 2020).
b) 2019 AGS Beers criteria (American Geriatrics Society Beers Criteria® Update Expert, 2019) developed in the United States are one of the most used tools and use explicit criteria. This tool has already undergone several revisions, the last being 2019, and includes six tables: table 2 listing “potentially inappropriate medications in older patients apart from the clinical condition,” table 3 “medication use in older adults due to drug–disease or drug–syndrome interactions that may exacerbate the disease or syndrome,” table 4 “potentially inappropriate medications in older patients considering the clinical condition,” table 5 listing “potentially inappropriate medications—drugs to be used with caution in older adults,” table 6 listing “potentially clinically important drug–drug interactions that should be avoided in older adults,” and table 7 listing “medications that should be avoided or have their dosage reduced with varying levels of kidney function in older adults” (American Geriatrics Society Beers Criteria Update Expert, 2019).
c) STOPP v2 criteria (O’mahony et al., 2015). The STOPP/START criteria were created in 2008 and also emerged as an European response to drug-related problems (DRPs), to identify whether the medical prescription is suitable for older adults (O’mahony et al., 2015). The list was revised in 2015 and is organized by physiological systems. The STOPP/START tool includes 114 criteria: 80 STOPP criteria and 34 START criteria (O’mahony et al., 2015).
Drugs were classified according to the Anatomical and Therapeutic Chemical Classification (WHO, 2021), and patients’ diagnoses were classified according to the International Statistical Classification of Diseases and Related Health Problems (ICD-10 Second Edition).
Statistical Analysis
Numerical and ordinal data were presented in frequency and percentage and using mean, median, percentile 25 and percentile 75, and standard error. A comparative analysis was performed between the results obtained for the three PIM identification tools, and the agreement between them was determined through the Lin coefficient. The prevalence of PIM was defined as the number of patients taking at least one PIM and was calculated using 95% CI. A medicine was considered a PIM if it is identified for at least one tool.
The pro package from the statistical software R was used to estimate the sample size. The sample size was computed using an estimated prevalence of 50% with a margin error of 4%. To ensure the precision of the data, the program reported that the sample should have at least 601 patients. This study included all the 616 patients that have been admitted to the internal medicine ward of the hospital, during 2019.
The free statistical software R (v4.0.0) was used to perform statistical analysis. A generalized linear model was developed for the dependent variables. Bivariate analysis was performed to select independent variables with a p-value < 0.2. The selected variables were studied in multivariate analysis, and those that had greater statistical significance were successively eliminated, on the condition that the coefficients of the main exposure variables did not change by more than 10% and that Schwarz’s Bayesian Information Criterion (BIC) improved. Considering hospitalization days as a dependent variable, a risk analysis was performed using Cox regression.
To correlate PIM identified with the multiple diagnoses of the patients, the total number of diagnoses per patient was added to the generalized linear model as the Independent variable and the number of PIMs identified as the dependent variable. The model was adjusted according to the sex and age of the patients.
Results
Study Population Characteristics
During the study period, 662 older patients were admitted to the internal medicine ward. Of these, 46 were excluded from the study because hospitalization was less than 4 days. Table 1 shows the characteristics of the 616 older patients included in the study. The median (Q1–Q3) age was 85.00 (78–89) years, and 48.16% of the participants were female. The median (Q1–Q3) number of hospitalization days was 12.00 (8–20), and the median (Q1–Q3) number of medicines taken per patient during the hospitalization period was 17.00 (13–22). Of the total number of older people included in the study, 547 (88.7%) were discharged from the hospital, 13 (2.1%) were transferred from another ward or another hospital, and 67 patients (9.1%) died.
A total of 3,873 diagnoses were registered for all the included patients. 21.4% of the diagnoses belong to the group of diseases related to the circulatory system, 16.4% to endocrine, nutritional, and metabolic diseases, and 10.7% to respiratory system diseases (Table 1).
Prevalence of PIM According to the EU(7)-PIM List and Beers and STOPP Criteria
Of 11159 prescribed medicines (mean per patient 18.12 ± 7.33), 285 were different active substances and were analyzed using the EU(7)-PIM list and Beers and STOPP criteria to evaluate the prevalence of PIM (Table 2 and Table 3).
TABLE 2. Number of PIMs identified in our sample according to the EU(7)-PIM list and Beers and STOPP criteria.
According to the EU(7)-PIM list adapted to Portuguese reality, 63 of the analyzed medicines were considered PIM, with a total of 1,146 PIMs detected in our sample. The median (Q1–Q3) number of PIMs per patient was 2 (1–3). It was also observed that 79.70% of the participants take at least one PIM (Table 2). The maximum number of PIMs per patient detected was 10, consumed by one patient (0.20%). The majority of the patients (51.30%) take one or two PIMs. Overall, the most consumed PIMs according to the EU(7)-PIM list were metoclopramide, haloperidol, and bisacodyl consumed by 31.2, 23.2, and 17.9% of our sample, respectively, representing a total of 38.9% of the PIMs identified by the EU(7)-PIM list (Table 3; Supplementary Table 1).
According to Beers criteria, considering 77 analyzed medicines, we have identified a total of 1,829 PIMs. It was also observed that 94.00% of the patients take at least one PIM, 17.20% of the participants take one PIM, and 0.20% take thirteen PIMs. Most of the patients (62.40%) take more than one and less than four PIMs (Table 2). The median (Q1–Q3) number of PIMs per patient observed was 3 (2–4). Furosemide, metoclopramide, and haloperidol were the most consumed PIMs, used by 71.0, 31.20, and 24.00% of the inpatients, respectively, representing a total of 42.50% of the PIMs detected by this tool (Table 3; Supplementary Table 2).
According to table 2 of the Beers criteria (“potentially inappropriate medications in older patients apart from the clinical condition”), the participants consumed a total of 979 PIMs (Supplementary Table 3), with metoclopramide and haloperidol being the most consumed, taken by 192 and 148 participants, respectively. The application of Table 3 (“potentially inappropriate medications in older patients considering the clinical condition”) of the Beers criteria detected a total of 221 PIMs (Supplementary Table 4). The application of table 4 of Beers criteria (“potentially inappropriate medications—drugs to be used with caution in older adults”) allows the detection of 1,226 drugs that should be used with caution in older adults (Supplementary Table 5). The application of table 5 of Beers criteria (potentially clinically important drug–drug interactions that should be avoided in older adults) identified 263 potential drug–drug interactions that should be avoided in older patients (Supplementary Table 6). The application of table 6 of Beers criteria (medications that should be avoided or have their dosage reduced with varying levels of kidney function in older adults) revealed the presence of six PIMs (Supplementary Table 7). The frequency of anticholinergic drugs was 133 (table 7 of Beers criteria) (Supplementary Table 8).
It was possible to apply 40 specific STOPP criteria to the prescribed medication, obtaining a total of 1156 PIMs. According to this tool, 76.50% of our sample consume at least one PIM, 26.80% of the sample consume one PIM, 8.30% of the sample consume five or more PIMs, and 0.50% consume ten PIMs (Table 3). The median (Q1–Q3) number of PIMs per participant was 2 (1–3). The section of the STOPP criteria where the highest number of PIMs was obtained was section K, which refers to drugs that predictably increase the risk of falls in elderly people by 42.3%. The amount of PIMs obtained when applying each of the criteria is greater than the amount of PIMs found in table 6 (1,156 PIMs) since several drugs can be PIMs due to multiple criteria (Supplementary Table 9).
Concordance and Overlap Among the EU(7)-PIM List, Beers Criteria, and STOPP Criteria
After the analysis of PIM by each tool, we observed that, according to the EU(7)-PIM list and Beers criteria, metoclopramide should be used with caution in older adults (EU(7)-PIM list) and is considered a PIM in older adults, and apart from the clinical condition (Beers criteria), this drug was considered a PIM in all patients that use it. According to STOPP criteria, metoclopramide can exacerbate Parkinsonian symptoms, in patients with Parkinson disease, so this drug is a PIM in 13 patients.
Haloperidol was the most prevalent PIM identified by the STOPP criteria, the second most prevalent according to the EU(7)-PIM list, and the third most observed according to Beers criteria. In the 148 patients that take haloperidol, 143 use a single dose superior to 2 mg or take more than 5 mg/d, and for these reasons, it was considered a PIM according to the EU(7)-PIM list. According to STOPP criteria, this drug predictably increases the risk of falls in older people (may cause gait dyspraxia, Parkinsonism), and according to the Beers criteria, haloperidol should be avoided in older adults, and this is the main reason for considering haloperidol a PIM in all patients that use it.
Bisacodyl was one of the most prevalent PIMs identified by the EU(7)-PIM list; due to the duration of treatment (>3 days), according to Beers and STOPP criteria, this drug is not a PIM. All applied criteria considered alprazolam a PIM, and the common reason according to the tools used is because this drug should be avoidable in older adults independently of their clinical condition. According to Beers criteria, furosemide should be avoided in older adults and is considered a PIM in all patients that use it. According to STOPP criteria, furosemide is a loop diuretic for dependent ankle edema without clinical, biochemical, or radiological evidence of heart and liver failure, nephrotic syndrome, or renal failure (leg elevation and/or compression hosiery usually being more appropriate) and may exacerbate incontinence.
Therefore, spironolactone being considered a PIM by all applied criteria, the reasons and the number of patients with this PIM are divergent. According to the EU(7)-PIM list of the 107 patients that use spironolactone, only 23 use a dose more than 25 mg/day (the reason for PIM); according to Beers criteria, this drug should be avoided in older adults, so it is considered a PIM in all patients (107) that use it. STOPP criteria considered that 79 patients use spironolactone as a PIM because in these patients’ serum, potassium was not regularly monitored. Beers and STOPP criteria considered quetiapine as a PIM in all patients that use it because this drug should be avoided in older adults (Beers criteria) and predictably increases the risk of falls in older people (STOPP criteria); according to the EU(7)-PIM list, this drug is not a PIM. Lorazepam is a PIM by all applied criteria, according to the EU(7)-PIM list in 31 of the 69 patients that use it due to the high dose (>1 mg/d). According to Beers criteria, this drug should be avoided in older adults and is considered a PIM in all patients (69) that use it. According to the STOPP criteria, lorazepam is a PIM in all patients because it may cause reduced sensorium and, in patients with acute or chronic respiratory failure, there is a risk of exacerbation of respiratory failure.
Considering the three PIM classification tools applied, the EU(7)-PIM list has 42 PIMs in common with the 2019 Beers criteria and 40 PIMs in common with version 2 of the STOPP criteria, whereas the 2019 Beers criteria have 59 PIMs in common with version 2 of the STOPP criteria. The three tools have in common 34 drugs (Figure 1).
FIGURE 1. PIM identified by the EU(7)-PIM list, AGS 2019 Beers criteria, and STOPP version 2 criteria.
PIM-Associated Therapeutic Groups According to the Applied Criteria
To better understand the concordance between the different tools, PIMs identified by each tool were grouped according to the anatomical group (Table 4), and it was observed that, of the 1,901 prescribed medicines belonging to the alimentary tract and metabolism, 19.52% were considered PIM according to the EU(7)-PIM list, 11.00% were PIM according to Beers criteria, and only 1.84% were classified as PIM by the STOPP criteria. The analysis of the 2,283 medicines belonging to the cardiovascular system group by the EU(7)-PIM list, Beers criteria, and STOPP criteria revealed that 9.33, 29.04, and 12.57%, respectively, are PIM.
According to the STOPP criteria, 11.36% of the 220 prescribed medicines of the group systemic hormonal preparations, except sex hormones and insulins, were PIM; according to the Beers criteria, only 0.9% of these groups of medicines are PIM; and according to the EU(7)-PIM list, none of them are PIM. Regarding the medicines from the musculoskeletal system group, 24.50% were PIM according to the EU(7)-PIM list, 25.83% were PIM according to the Beers criteria, and only 11.26% were PIM according to the STOPP criteria. We also observed that, of the 1,913 medicines belonging to the nervous system group, 24.26% were PIM according to the EU(7)-PIM list, 41.92% were PIM according to the Beers criteria, and 39.36% were PIM according to the STOPP criteria. According to the EU(7)-PIM list, the most prescribed PIM pharmacotherapeutic groups are the musculoskeletal system (24.50%), nervous system (24.26%), and alimentary tract and metabolism (19.56%). The most frequent PIM, according to Beers criteria, belongs to the nervous system group. According to the STOPP criteria, the most frequent PIM belongs to the pharmacotherapeutic groups—nervous system (39.36%), cardiovascular system (12.57%), and systemic hormonal preparations, except sex hormones and insulins (11.36%).
To analyze the agreement between the three criteria, we used Lin’s concordance correlation coefficient and observed a poor concordance between criteria (Table 5).
PIM-Associated Factors
An association between the PIM detected through the application of the Beers criteria and patients with diagnoses of endocrine, nutritional, and metabolic diseases (ICD-10; E00-E89), mental, behavioral, and neurodevelopmental disorders (ICD-10; F01-F99), and circulatory system diseases (ICD-10; I00-I99) was observed (Table 6). PIMs detected by STOPP criteria are associated with patients diagnosed with diseases of the circulatory system (ICD-10; I00-I99) and with diseases of the musculoskeletal system and connective tissue (ICD-10; M00-M99). It was observed that the variable days of hospitalization only obtained statistical significance in relation to the PIM obtained with the application of the Beers criteria. The impact of the number of diagnoses on the effect of PIM is found to be small (OR∼1) and statistically significant (Table 6).
Discussion
According to our knowledge, this is the first study assessing the concordance and overlap of three distinct PIM-detecting tools EU(7)-PIM list, 2019 AGS Beers criteria, and STOPP v2 criteria in hospitalized patients. The low overlap and concordance between tools highlight the need to develop a PIM-detecting tool for patients exposed to a high number of PIMs (
Despite the scarcity of studies comparing the use of PIM tools in all settings and the lack of studies in internal medicine inpatients, a study carried out in Chinese hospitalized patients reported a moderate concordance between 2015 Beers criteria and STOPP v2 criteria (Ma et al., 2019). Moreover, a Brazilian study performed in home-dwelling population of 60 or more years of age concluded that there was a high concordance among 2015 Beers criteria, STOPP v2 criteria, and the EU(7)-PIM list (Novaes et al., 2017). However, in a recent systematic review, a substantial difference was found between the individual medications identified by the Beers and STOPP/START criteria, highlighting the need for research in this area (Thomas and Thomas, 2019). The poor concordance among criteria observed in our sample of Portuguese internal medicine inpatients can be due to the applicability requirements of each list; theoretically, criteria with fewer applicability requirements might detect fewer PIMs than those using criteria that require more specific information, differential medication availability between countries (Chang and Chan, 2010; Thomas and Thomas, 2019). According to the EU(7)-PIM list, to consider the medicine as a PIM, it is only necessary to know the mediation profile of the patients including the duration of treatment and dosage of some medicine (Renom-Guiteras et al., 2015). The Beers criteria judge each medicine as a PIM based not only on the medication profile of a patient but also on the pathologies of the patients as well as the laboratory results (By the American Geriatrics Society Beers Criteria Update Expert, 2019). To apply the STOPP criteria, it is imperative to know the entire medication history, clinical information of the patient, and laboratory (O’mahony et al., 2015; By the American Geriatrics Society Beers Criteria Update Expert, 2019; Carvalho et al., 2019). The greater sensibility of previous versions of STOPP criteria was demonstrated by others (Gallagher and O’mahony, 2008; Hamilton et al., 2011; Wickop et al., 2016), but according to Blanco-Reina et al. (2019), STOPP v2 has a poor concordance with the previous version (Blanco-Reina et al., 2019).
The number of PIMs identified varies among criteria, and in the inpatient setting, the prevalence of PIM changes from 1% to as high as 50% and is highly dependent on the tool used to define PIM (Franceschi et al., 2008; Rothberg et al., 2008; Page et al., 2010). A study carried out in Portuguese nursing homes and day-care centers detected a PIM prevalence of 64.4% when applying the EU(7)-PIM list, 56% when applying the 2015 Beers criteria, and 85.5% when applying the STOPP v2 criteria (Monteiro et al., 2020). Another study carried out in Chinese inpatients reported a prevalence of PIM of 58.1 and 44.0% using 2015 Beers criteria and 2014 STOPP (Ma et al., 2019). A Brazilian study performed in a home-dwelling population of sixty or more years of age observed a prevalence of PIM of 50, 46.2, and 59.5% using, respectively, 2015 Beers criteria, 2015 STOPP criteria, and the EU(7)-PIM list (Novaes et al., 2017). In our study, the percentage of patients with at least one PIM also varied among criteria: according to the EU(7)-PIM list and STOPP criteria, near 80% of the patients had at least one PIM, and according to Beers criteria, more than 90% of the patients consume one PIM. Another study in patients discharged from a hospital using the EU(7)-PIM list and the STOPP criteria observed a prevalence of PIM similar to that observed in our study (Mucalo et al., 2017).
The overlap of three criteria revealed that the drugs that act on the nervous system are the most common, making a total of 20, and haloperidol is the most frequent PIM. Haloperidol is an antipsychotic drug that can help relieve disorders such as delusions or hallucinations in schizophrenic situations, but it can also be used in older patients with agitation or aggression, which thus may explain the high consumption of this medication in the study population (Potter et al., 2006). Several studies report that delirium is associated with substantial rates of morbidity and mortality in inpatients, which becomes a growing problem due to increased life expectancy. Haloperidol is currently the drug of choice for the treatment of delirium (Schrijver et al., 2014; Ostinelli et al., 2017; Herling et al., 2018a; Herling et al., 2018b).
The knowledge of the pharmacotherapeutic profile of each patient allowed the application of the EU(7)-PIM list and the identification of 63-PIM–related medicines, performing a total of 1,146 PIMs. These observations allowed concluding that the inpatients included in this study consume a high number of PIMs in comparison with other studies using this tool in European older inpatients (Mucalo et al., 2017; Bobrova et al., 2019; Wamil et al., 2019).
According to Beers criteria, our patients presented 1,829 PIMs related to the prescription of 77 different medicines. According to our knowledge, this is the first study that uses the AGS 2019 Beers criteria with inpatients. However, in comparison with studies using 2015 Beers criteria, our sample presented a very high prevalence of PIM (Juliano et al., 2018; Thomas et al., 2020; Zhang et al., 2020).
A Portuguese study reported that the STOPP/START criteria are useful tools to perform medication review in nursing home patients and changes of drug therapy because besides detecting PIM, they also allowed the detection of DRPs related to the non-drug treatment despite existing indication (Silva et al., 2014). The application of STOPP criteria allowed concluding that, according to these criteria, the number of PIMs prescribed to older inpatients follows that observed in studies from Canada (Thomas et al., 2020) and Spain (Martin et al., 2017) but is very high when compared with the number of PIMs observed in Malaysia (Loganathan et al., 2019) and Swiss (Urfer et al., 2016).
In our sample of older inpatients, it was observed that the number of PIMs per patient increases with the increased number of prescribed medicines and the time of hospitalization. According to Wickop et al. (2016), the number of medicines has a significant effect on the amount of PIMs detected. (Wickop et al., 2016).
The mean age of the included participants reflects the high life expectancy observed in Portugal (INE, 2017; PORDATA, 2020). The high number of prescribed medicines is probably due to the multiple comorbidities presented by the inpatients. According to the literature, the inpatient setting may predispose older adults to new prescriptions and probably unnecessary drugs (Page et al., 2010). In an acute care setting, it is difficult to convince physicians to change or discontinue chronic medication, particularly if the medication is not related to the reason for hospitalization (Page et al., 2010). Moreover, we observed a trend of increased polypharmacy with the length of stay in the hospital. Despite the scarcity of studies characterizing the medication profile of internal medicine inpatients, a study pointed out that the mean of prescribed drugs increases from 5.6 (at hospital admission) to 7.6 (at discharge) (Vonbach et al., 2008). Other studies demonstrate that the number of regular medicines in hospitalized older patients is high, and according to Connor et al. (2020), the median number can range from 11 (IGR 8 to 15) (at hospital admission) to 9 (at discharge). According to Hubbard et al. (2015), the mean number of regular medicines per day ranges from 7.1 to 7.6 at admission and discharge, respectively.
This study demonstrated that the number of medicines is associated with the use of PIM detected by the EU(7)-PIM list and Beers and STOPP criteria; indeed, polypharmacy is associated with the use of PIM in older adults (Steinman et al., 2006).
Although the consensus-based lists of medications, such as the EU(7)-PIM list, Beers criteria, and STOPP criteria, were valuable tools to detect PIM in older adults, the data of this study only represent the patients that have been admitted during 2019 to the internal medicine ward; for these reasons (specific setting and the limited number of samples), they cannot be generalized to the whole hospital population (Tanaka et al., 2015). Moreover, potential ADRs associated with PIM prescriptions were not evaluated because the hospital's electronic medical record used did not include information regarding ADRs.
However, the information collected in this study reinforces the need to optimize criteria adapted to the internal medicine and implement strategies that support the physician’s decision when prescribing a possible PIM but always leaving the possibility of judgment and medical decision. Adaptation of these tools to a consensus tool for specific condition was already done for the management of pain and inflammation in older adults (Motter et al., 2019).
The high number of PIMs observed during this study highlights the need for interventional studies to improve medication appropriateness among hospitalized older patients (Thomas and Thomas, 2019), particularly in internal medicine wards where there is a frequent need to change medication to achieve stabilization of patients. The increased risk of polypharmacy-related ADR (Schmiedl et al., 2018) in older patients demonstrates the need for clinical practice guidelines in polymedicated older patients and the development of educational interventions to promote and improve the use of PIM tools by healthcare professionals.
Data Availability Statement
All data generated or analysed during this study are included in the article/Supplementary Material, and further inquiries can be directed to the corresponding author.
Ethics Statement
The studies involving human participants were reviewed and approved by Comissão de Ética para a Saúde da ULS da Guarda, EPE. Written informed consent for participation was not required for this study in accordance with the national legislation and institutional requirements.
Author Contributions
All authors listed have made a substantial and direct contribution to the work and approved it for publication. FR and MH coordinated the project. CP and JA involved in acquisition of data. AF, AIP, CP, DR, FR, MP-L, and MH analyzed and interpreted data. AIP and CP drafted the article. AF, AIP, DR, FR, JA, MP-L, and MH critically revised the article.
Funding
This work was financially supported by the APIMedOlder project (PTDC/MED-FAR/31598/2017), funded by the Operational Programme of Competitiveness and Internationalization (POCI), in its FEDER/FNR component POCI-01-0145-FEDER-031598, and the Foundation for Science and Technology (FCT).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fphar.2021.676020/full#supplementary-material
References
Alvis, B. D., and Hughes, C. G. (2015). Physiology Considerations in Geriatric Patients. Anesthesiology Clin. 33, 447–456. doi:10.1016/j.anclin.2015.05.003
Blanc, A. L., Guignard, B., Desnoyer, A., Grosgurin, O., Marti, C., Samer, C., et al. (2018a). Prevention of Potentially Inappropriate Medication in Internal Medicine Patients: A Prospective Study Using the Electronic Application PIM-Check. J. Clin. Pharm. Ther. 43, 860–866. doi:10.1111/jcpt.12733
Blanc, A. L., Spasojevic, S., Leszek, A., Théodoloz, M., Bonnabry, P., Fumeaux, T., et al. (2018b). A Comparison of Two Tools to Screen Potentially Inappropriate Medication in Internal Medicine Patients. J. Clin. Pharm. Ther. 43, 232–239. doi:10.1111/jcpt.12638
Blanco-Reina, E., Valdellós, J., Aguilar-Cano, L., García-Merino, M. R., Ocaña-Riola, R., Ariza-Zafra, G., et al. (2019). 2015 Beers Criteria and STOPP V2 for Detecting Potentially Inappropriate Medication in Community-Dwelling Older People: Prevalence, Profile, and Risk Factors. Eur. J. Clin. Pharmacol. 75, 1459–1466. doi:10.1007/s00228-019-02722-0
Bobrova, V., Heinämäki, J., Honkanen, O., Desselle, S., Airaksinen, M., and Volmer, D. (2019). Older Adults Using Multi-Dose Dispensing Exposed to Risks of Potentially Inappropriate Medications. Res. Soc. Administrative Pharm. 15, 1102–1106. doi:10.1016/j.sapharm.2018.11.007
By the American Geriatrics Society Beers Criteria® Update Expert Panel, (2019). American Geriatrics Society 2019 Updated AGS Beers Criteria® for Potentially Inappropriate Medication Use in Older Adults. J. Am. Geriatr. Soc. 67, 674–694. doi:10.1111/jgs.15767
Carvalho, R., Lavrador, M., Cabral, A. C., Veríssimo, M. T., Figueiredo, I. V., Fernandez-Llimos, F., et al. (2019). Patients' Clinical Information Requirements to Apply the STOPP/START Criteria. Int. J. Clin. Pharm. 41, 1562–1569. doi:10.1007/s11096-019-00920-5
Chang, C. B., and Chan, D. C. (2010). Comparison of Published Explicit Criteria for Potentially Inappropriate Medications in Older Adults. Drugs & Aging 27, 947–957. doi:10.2165/11584850-000000000-00000
Connor, N., Woodward, S., Norwood, M., Sturrock, N., Woodard, J., Skelly, R., et al. (2020). The Potential to Quantify Polypharmacy in Older Adult Hospital Inpatients Using Electronic Prescribing Software: a Feasibility Study. Health Technol. 10, 823–826. doi:10.1007/s12553-020-00419-4
Franceschi, M., Scarcelli, C., Niro, V., Seripa, D., Pazienza, A. M., Pepe, G., et al. (2008). Prevalence, Clinical Features and Avoidability of Adverse Drug Reactions as Cause of Admission to a Geriatric Unit. Drug Saf. 31, 545–556. doi:10.2165/00002018-200831060-00009
Gallagher, P., and O'mahony, D. (2008). STOPP (Screening Tool of Older Persons' Potentially Inappropriate Prescriptions): Application to Acutely Ill Elderly Patients and Comparison with Beers' Criteria. Age and Ageing 37, 673–679. doi:10.1093/ageing/afn197
García-Caballero, T. M., Lojo, J., Menéndez, C., Fernández-Álvarez, R., Mateos, R., and Garcia-Caballero, A. (2018). Polimedication: Applicability of a Computer Tool to Reduce Polypharmacy in Nursing Homes. Int. Psychogeriatr. 30, 1001–1008. doi:10.1017/s1041610217002411
Giardina, C., Cutroneo, P. M., Mocciaro, E., Russo, G. T., Mandraffino, G., Basile, G., et al. (2018). Adverse Drug Reactions in Hospitalized Patients: Results of the FORWARD (Facilitation of Reporting in Hospital Ward) Study. Front. Pharmacol. 9, 350. doi:10.3389/fphar.2018.00350
Grina, D., and Briedis, V. (2017). The Use of Potentially Inappropriate Medications Among the Lithuanian Elderly According to Beers and EU(7)-PIM List - a Nationwide Cross-Sectional Study on Reimbursement Claims Data. J. Clin. Pharm. Ther. 42, 195–200. doi:10.1111/jcpt.12494
Gutierrez Valencia, M., Martinez Velilla, N., Lacalle Fabo, E., Beobide Telleria, I., Larrayoz Sola, B., and Tosato, M. (2016). [Interventions to Optimize Pharmacologic Treatment in Hospitalized Older Adults: a Systematic Review]. Revista Clinica Espanola 216, 16. doi:10.1016/j.rceng.2016.01.004
Hamilton, H., Gallagher, P., Ryan, C., Byrne, S., and O'mahony, D. (2011). Potentially Inappropriate Medications Defined by STOPP Criteria and the Risk of Adverse Drug Events in Older Hospitalized Patients. Arch. Intern. Med. 171, 1013–1019. doi:10.1001/archinternmed.2011.215
Herling, S. F., Greve, I. E., Vasilevskis, E. E., Egerod, I., Bekker Mortensen, C., Møller, A. M., et al. (2018a). Interventions for Preventing Intensive Care Unit Delirium in Adults. Cochrane Database Syst. Rev. 11, CD009783. doi:10.1002/14651858.CD009783.pub2
Herling, S. F., Greve, I. E., Vasilevskis, E. E., Egerod, I., Mortensen, C. B., Møller, A. M., et al. (2018b). Interventions for Preventing Intensive Care Unit Delirium in Adults. Cochrane Database Syst. Rev. 11 (11), CD009783. doi:10.1002/14651858.CD009783.pub2
Hubbard, R. E., Peel, N. M., Scott, I. A., Martin, J. H., Smith, A., Pillans, P. I., et al. (2015). Polypharmacy Among Inpatients Aged 70 Years or Older in Australia. Med. J. Aust. 202 (7), 373–377. doi:10.5694/mja13.00172.PMID.25877120
Hudhra, K., Beçi, E., Petrela, E., Xhafaj, D., García-Caballos, M., and Bueno-Cavanillas, A. (2016). Prevalence and Factors Associated with Potentially Inappropriate Prescriptions Among Older Patients at Hospital Discharge. J. Eval. Clin. Pract. 22, 707–713. doi:10.1111/jep.12521
INE (2017). Projeções de População Residente em Portugal. 2015-2080. Available at: https://www.ine.pt/xportal/xmain?xpid=INE&xpgid=ine_destaques&DESTAQUESdest_boui=277695619&DESTAQUESmodo=2&xlang=pt acessed on 5 february 2021.
Juliano, A. C. D. S. R. S., Lucchetti, A. L. G., Silva, J. T. S. D., Santos, L. G., Nunes, J. B. T., Fernandes, G. C., et al. (2018). Inappropriate Prescribing in Older Hospitalized Adults: A Comparison of Medical Specialties. J. Am. Geriatr. Soc. 66, 383–388. doi:10.1111/jgs.15138
Kaufmann, C. P., Tremp, R., Hersberger, K. E., and Lampert, M. L. (2014). Inappropriate Prescribing: a Systematic Overview of Published Assessment Tools. Eur. J. Clin. Pharmacol. 70, 1–11. doi:10.1007/s00228-013-1575-8
Laroche, M. L., Sirois, C., Reeve, E., Gnjidic, D., and Morin, L. (2019). Pharmacoepidemiology in Older People: Purposes and Future Directions. Therapies 74, 325–332. doi:10.1016/j.therap.2018.10.006
Lee, E. A., Brettler, J. W., Kanter, M. H., Steinberg, S. G., Khang, P., Distasio, C. C., et al. (2020). Refining the Definition of Polypharmacy and its Link to Disability in Older Adults: Conceptualizing Necessary Polypharmacy, Unnecessary Polypharmacy, and Polypharmacy of Unclear Benefit. Perm J. 24, 18212. doi:10.7812/TPP/18.212
Loganathan, M., Id, F., Azmy, M. T., and Usir, E. (2019). Inappropriate Prescribing Defined by STOPP and START Criteria and its Association with Adverse Drug Events Among Hospitalized Older Patients : A Multicentre , Prospective Study. PLOS ONE 14 (7), e0219898. doi:10.1371/journal.pone.0219898
Lucchetti, G., and Lucchetti, A. L. G. (2017). Inappropriate Prescribing in Older Persons: A Systematic Review of Medications Available in Different Criteria. Arch. Gerontol. Geriatr. 68, 55–61. doi:10.1016/j.archger.2016.09.003
Ma, Z., Zhang, C., Cui, X., and Liu, L. (2019). Comparison of Three Criteria for Potentially Inappropriate Medications in Chinese Older Adults. Clin. Interv. Aging 14, 65–72. doi:10.2147/CIA.S190983
Martin, J. H., Merino-Sanjuán, V., Peris-Martí, J., Correa-Ballester, M., Vial-Escolano, R., and Merino-Sanjuán, M. (2017). Applicability of the STOPP/START Criteria to Older Polypathological Patients in a Long-Term Care Hospital. Eur. J. Hosp. Pharm. 25 (6), 310–316. doi:10.1136/ejhpharm-2017-001262
Metelo de Nápoles Periquito, C., Cavaco Silva, P., Oliveira, P., Carneiro, C., Fernandes, A., and Alves da Costa, F. (2014). Revisão da medicação em idosos institucionalizados: aplicação dos critérios STOPP E START. Revista Portuguesa De Farmacoterapia 6 (4), 4–13. doi:10.25756/rpf.v6i4.20
Monteiro, C., Canário, C., Ribeiro, M. Â., Duarte, A. P., and Alves, G. (2020). Medication Evaluation in Portuguese Elderly Patients According to Beers, STOPP/START Criteria and EU(7)-PIM List - an Exploratory Study. Ppa 14, 795–802. doi:10.2147/ppa.s247013
Motter, F. R., Fritzen, J. S., Hilmer, S. N., Paniz, É. V., and Paniz, V. M. V. (2018). Potentially Inappropriate Medication in the Elderly: a Systematic Review of Validated Explicit Criteria. Eur. J. Clin. Pharmacol. 74, 679–700. doi:10.1007/s00228-018-2446-0
Motter, F. R., Hilmer, S. N., and Paniz, V. M. V. (2019). Pain and Inflammation Management in Older Adults: A Brazilian Consensus of Potentially Inappropriate Medication and Their Alternative Therapies. Front. Pharmacol. 10, 1408. doi:10.3389/fphar.2019.01408
Mucalo, I., Hadžiabdić, M. O., Brajković, A., Lukić, S., Marić, P., Marinović, I., et al. (2017). Potentially Inappropriate Medicines in Elderly Hospitalised Patients According to the EU(7)-PIM List, STOPP Version 2 Criteria and Comprehensive Protocol. Eur. J. Clin. Pharmacol. 73, 991–999. doi:10.1007/s00228-017-2246-y
Nothelle, S. K., Sharma, R., Oakes, A. H., Jackson, M., and Segal, J. B. (2017). Determinants of Potentially Inappropriate Medication Use in Long-Term and Acute Care Settings: A Systematic Review. J. Am. Med. Dir. Assoc. 18, 806e1–806e17. doi:10.1016/j.jamda.2017.06.005
Novaes, P. H., Da Cruz, D. T., Lucchetti, A. L. G., Leite, I. C. G., and Lucchetti, G. (2017). Comparison of Four Criteria for Potentially Inappropriate Medications in Brazilian Community-Dwelling Older Adults. Geriatr. Gerontol. Int. 17, 1628–1635. doi:10.1111/ggi.12944
O'mahony, D., O'sullivan, D., Byrne, S., O'connor, M. N., Ryan, C., and Gallagher, P. (2015). STOPP/START Criteria for Potentially Inappropriate Prescribing in Older People: Version 2. Age Ageing 44, 213–218. doi:10.1093/ageing/afu145
Oktora, M. P., Alfian, S. D., Bos, H. J., Schuiling-Veninga, C. C. M., Taxis, K., Hak, E., et al. (2020). Trends in Polypharmacy and Potentially Inappropriate Medication (PIM) in Older and Middle-Aged People Treated for Diabetes. Br. J. Clin. Pharmacol. 87 (7), 2807–2817. doi:10.1111/bcp.14685
Ostinelli, E. G., Brooke‐Powney, M. J., Li, X., and Adams, C. E. (2017). Haloperidol for Psychosis‐induced Aggression or Agitation (Rapid Tranquillisation). Cochrane database Syst. Rev. 7 (7), CD009377. doi:10.1002/14651858.cd009377.pub3
Page, R. L., Linnebur, S. A., Bryant, L. L., and Ruscin, J. M. (2010). Inappropriate Prescribing in the Hospitalized Elderly Patient: Defining the Problem, Evaluation Tools, and Possible Solutions. Clin. Interv. Aging 5, 75–87. doi:10.2147/cia.s9564
PORDATA (2020). RE: PORDATA - Base de Dados Portugal Contemporâneo- População residente: total e por grandes grupos etários. Available at: https://www.pordata.pt/Municipios/Popula%C3%A7%C3%A3o+residente+total+e+por+grandes+grupos+et%C3%A1rios-390, acessed on 5 february 2021.
Potter, J., George, J., and Guideline Development, G. (2006). The Prevention, Diagnosis and Management of Delirium in Older People: Concise Guidelines. Clin. Med. 6, 303–308. doi:10.7861/clinmedicine.6-3-303
Renom-Guiteras, A., Meyer, G., and Thürmann, P. A. (2015). The EU(7)-PIM List: a List of Potentially Inappropriate Medications for Older People Consented by Experts from Seven European Countries. Eur. J. Clin. Pharmacol. 71, 861–875. doi:10.1007/s00228-015-1860-9
Rothberg, M. B., Pekow, P. S., Liu, F., Korc-Grodzicki, B., Brennan, M. J., Bellantonio, S., et al. (2008). Potentially Inappropriate Medication Use in Hospitalized Elders. J. Hosp. Med. 3, 91–102. doi:10.1002/jhm.290
Schmiedl, S., Rottenkolber, M., Szymanski, J., Drewelow, B., Siegmund, W., Hippius, M., et al. (2018). German Net of Regional Pharmacovigilance, C.Preventable ADRs Leading to Hospitalization - Results of a Long-Term Prospective Safety Study with 6,427 ADR Cases Focusing on Elderly Patients. Expert Opin. Drug Saf. 17, 125–137. doi:10.1080/14740338.2018.1415322
Schrijver, E. J., De Vries, O. J., Verburg, A., De Graaf, K., Bet, P. M., Van De Ven, P. M., et al. (2014). Efficacy and Safety of Haloperidol Prophylaxis for Delirium Prevention in Older Medical and Surgical At-Risk Patients Acutely Admitted to Hospital through the Emergency Department: Study Protocol of a Multicenter, Randomised, Double-Blind, Placebo-Controlled Clinical Trial. BMC Geriatr. 14, 96. doi:10.1186/1471-2318-14-96
Sinvani, L. D., Beizer, J., Akerman, M., Pekmezaris, R., Nouryan, C., Lutsky, L., et al. (2013). Medication Reconciliation in Continuum of Care Transitions: a Moving Target. J. Am. Med. Directors Assoc. 14, 668–672. doi:10.1016/j.jamda.2013.02.021
Stegemann, S., Ecker, F., Maio, M., Kraahs, P., Wohlfart, R., Breitkreutz, J., et al. (2010). Geriatric Drug Therapy: Neglecting the Inevitable Majority. Ageing Res. Rev. 9, 384–398. doi:10.1016/j.arr.2010.04.005
Steinman, M. A., Seth Landefeld, C., Rosenthal, G. E., Berthenthal, D., Sen, S., and Kaboli, P. J. (2006). Polypharmacy and Prescribing Quality in Older People. J. Am. Geriatr. Soc. 54, 1516–1523. doi:10.1111/j.1532-5415.2006.00889.x
Tanaka, S., Tanaka, S., and Kawakami, K. (2015). Methodological Issues in Observational Studies and Non-randomized Controlled Trials in Oncology in the Era of Big Data. Jpn. J. Clin. Oncol. 45, 323–327. doi:10.1093/jjco/hyu220
Thomas, R. E., Nguyen, L. T., Jackson, D., and Naugler, C. (2020). Potentially Inappropriate Prescribing and Potential Prescribing Omissions in 82,935 Older Hospitalised Adults: Association with Hospital Readmission and Mortality within Six Months. Geriatrics 5, 37. doi:10.3390/geriatrics5020037
Thomas, R. E., and Thomas, B. C. (2019). A Systematic Review of Studies of the STOPP/START 2015 and American Geriatric Society Beers 2015 Criteria in Patients ≥ 65 Years. Cas 12 (2), 121–154. doi:10.2174/1874609812666190516093742.PMID.31096900
Urfer, M., Elzi, L., Dell-Kuster, S., and Bassetti, S. (2016). Intervention to Improve Appropriate Prescribing and Reduce Polypharmacy in Elderly Patients Admitted to an Internal Medicine Unit. PLoS One 11, e0166359. doi:10.1371/journal.pone.0166359
Vonbach, P., Dubied, A., Krähenbühl, S., and Beer, J. H. (2008). Prevalence of Drug-Drug Interactions at Hospital Entry and during Hospital Stay of Patients in Internal Medicine. Eur. J. Intern. Med. 19, 413–420. doi:10.1016/j.ejim.2007.12.002
Wamil, N., Mattsson, S., and Gustafsson, M. (2019). Assessment of Potentially Inappropriate Medications Using the EU ( 7 )- PIM List and the Swedish Quality Indicators. Int. J. Clin. Pharm. 41 (4), 903–912. doi:10.1007/s11096-019-00847-x
WHO (2021). WHO Collaborating Centre for Drug Statistics Methodology. [Online]. Available at: https://www.whocc.no/atc_ddd_methodology/who_collaborating_centre/ (Accessed february 2, 2021).
Wickop, B., Härterich, S., Sommer, C., Daubmann, A., Baehr, M., and Langebrake, C. (2016). Potentially Inappropriate Medication Use in Multimorbid Elderly Inpatients: Differences between the FORTA, PRISCUS and STOPP Ratings. Drugs - Real World Outcomes 3, 317–325. doi:10.1007/s40801-016-0085-2
Keywords: potentially inappropriate medication, internal medicine ward, older adults, EU(7)-PIM list, AGS 2019 Beers criteria, STOPP v2 criteria
Citation: Perpétuo C, Plácido AI, Rodrigues D, Aperta J, Piñeiro-Lamas M, Figueiras A, Herdeiro MT and Roque F (2021) Prescription of Potentially Inappropriate Medication in Older Inpatients of an Internal Medicine Ward: Concordance and Overlap Among the EU(7)-PIM List and Beers and STOPP Criteria. Front. Pharmacol. 12:676020. doi: 10.3389/fphar.2021.676020
Received: 04 March 2021; Accepted: 29 June 2021;
Published: 30 July 2021.
Edited by:
Marcio Galvão Oliveira, Federal University of Bahia, BrazilReviewed by:
Gaurav Deshpande, Bristol Myers Squibb, United StatesRoger E Thomas, University of Calgary, Canada
Copyright © 2021 Perpétuo, Plácido, Rodrigues, Aperta, Piñeiro-Lamas, Figueiras, Herdeiro and Roque. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Fátima Roque, ZnJvcXVlQGlwZy5wdA==