Process Evaluation of Implementing a Pharmacist-Led Intervention to Improve Adherence to Antihypertensive Drugs Among Patients with Type 2 Diabetes in Indonesian Community Health Centers

Introduction: A pharmacist-led intervention in Community Health Centers (CHCs) in Indonesia targeted at patients with type 2 diabetes non-adherent to antihypertensive drugs resulted in a significant improvement in adherence to these drugs. The aim of this study was to evaluate the process of implementation this intervention intended to improve adherence to antihypertensive drugs from both the pharmacist and the patient perspective.

Methods: Using the RE-AIM (Reach, Effectiveness, Adoption, Implementation and Maintenance) framework, we conducted a focus group among pharmacists (N = 5) and a survey among patients with complete follow-up (N = 44) participating in the intervention group.

Results: All pharmacists adopted the provided training and found support tools useful. The pharmacists implemented the intervention as intended (adequate intervention fidelity >69%). Factors relevant for implementation included having sufficient time and confidence, home visits for specific patients, multidisciplinary collaboration, and availability of a personal counseling room. To maintain the intervention, the need for practical guidance and support from health care authorities was mentioned. Most patients (96%) were satisfied with the information provided by the pharmacists and they believed the tailored counselling was helpful. Most patients (84%) reported that the duration of counselling was sufficient. The large majority of patients would like to receive the counselling regularly.

Conclusion: Positive effects of the pharmacist-led intervention can be explained by adequate levels of reach, adoption and implementation in the participating CHCs. For successful implementation and maintenance in Indonesia or other low-and middle-income countries, sufficient training, resources, multidisciplinary collaboration, guidance and support from health care authorities are expected to be important.

Introduction

Many interventions that have been developed for improving adherence to medication are evaluated in randomized controlled trial (RCT) settings focusing mostly on their clinical effectiveness (Nieuwlaat et al., 2014; Kini and Ho, 2018). Additionally, to inform scale-up of an intervention in real-world daily practice, insight into the implementation of interventions is critically important to understand what caused an intervention to succeed or fail (Carroll et al., 2007). However, an evaluation of the implementation process of adherence management interventions is not always provided (Glasgow et al., 2001; Breitenstein et al., 2010), especially in low and middle-income countries (LMIC) (Correia et al., 2019).

In 2019, we conducted a low-cost pharmacist-led intervention in Community Health Centers (CHCs) in Indonesia targeted at patients with type 2 diabetes non-adherent to antihypertensive medication (Alfian et al., 2021). This intervention resulted in a significant improvement in self-reported medication adherence to these antihypertensive drugs, but no significant changes in secondary outcomes, such as beliefs about antihypertensive drugs, were observed (Alfian et al., 2021). We aimed to evaluate the process of the implementation of this intervention intended to improve adherence to antihypertensive drugs using a structured evaluation.

Several evaluation frameworks have been developed to facilitate the translation of research findings (Tabak et al., 2012; Milat and Li, 2017). The RE-AIM framework is one of the most frequently used evaluation frameworks (Milat and Li, 2017) in a variety of settings and across a broad range of behavioral outcomes (Glasgow et al., 2019). The RE-AIM framework has been developed to evaluate public health interventions assessing five dimensions—Reach, Effectiveness, Adoption, Implementation and Maintenance—at multiple levels (e.g., individual or organization) (Glasgow et al., 1999; Glasgow et al., 2019). We will use the RE-AIM framework to evaluate the implementation process of the intervention from both the pharmacist and the patient perspective.

Methods

Study Design, Population and Setting

The process evaluation was part of a previously published cluster RCT performed in Bandung City, Indonesia (Alfian et al., 2020; Alfian et al., 2021). We applied a mixed-methods study design. All pharmacists from CHCs that were approached for the RCT participated in the study. Patients with type 2 diabetes using antihypertensives, aged at least 18 years old, who reported non-adherence to their antihypertensive drugs according to Medication Adherence Report Scale (MARS) and who were randomized to the pharmacist-led intervention group were eligible for the process evaluation. In addition, the pharmacists from the five CHCs that conducted the intervention were included in the process evaluation. The study design, the intervention and its effectiveness have been described in more detail elsewhere (Alfian et al., 2020; Alfian et al., 2021). The study was approved by the Health Research Ethics Committee of Universitas Padjadjaran No. 859/UN6.KEP/EC/2019 and was registered at clinicaltrials.gov under the identifier NCT04023734.

Summary of the Intervention

In short, the key aspects of the intervention included a 3-hours training on medication adherence management and practical support tools for pharmacists to help identifying patient-specific barriers for medication non-adherence, and providing personalized adherence support strategies (Alfian et al., 2020; Alfian et al., 2021). The adherence support strategies included: (1) reminders/habit-based strategies and involvement of family members to address forgetfulness, (2) counselling to increase knowledge, (3) counselling to increase motivation, and (4) counselling to address other drug-related problems. The support tools included simple flow-charts based on the patients’ responses to the MARS and additional questions derived from the Brief Medication Questionnaire, an adherence intervention wheel, and a personalized patient leaflet containing a self-management plan (Alfian et al., 2020). All patients randomized to the intervention group received pharmacist counselling based on their individual barrier(s) to adherence at baseline and at 1-month follow-up sessions.

Process Evaluation of the Intervention

The implementation process of the intervention was evaluated using the RE-AIM framework. The RE-AIM framework addresses both internal validity (Effectiveness, Implementation, and Maintenance) and external validity (Reach and Adoption) (Glasgow et al., 2019).

Reach was assessed by measuring the participation rates of patients. Participation rates were measured during the RCT and reasons for non-participation were recorded. Effectiveness has been reported separately, focusing on effects on medication adherence, patients’ beliefs about medication, and blood pressure levels (Alfian et al., 2021). Adoption was evaluated by exploring pharmacists’ and patients’ satisfaction with, and willingness to use various parts of the intervention based on the focus group discussion and survey responses. Implementation was evaluated by determining whether the intervention was delivered as intended (i.e., intervention fidelity), and by exploring pharmacists’ and patients’ suggestions for future implementation based on the focus group discussion and survey responses. Maintenance was assessed by determining whether and how the intervention could be maintained according to the pharmacists. Furthermore, the willingness of pharmacists to continue the intervention as part of routine clinical practice and the willingness of patients to receive adherence counselling at every visit or less often were assessed.

Data Collection

During and after completion of the RCT, data were collected to evaluate the implementation of the intervention. From the pharmacists, qualitative data were obtained by means of a focus group discussion with all five participating pharmacists. This discussion, led by one of the researchers (SDA), was held after all five pharmacists had delivered the second intervention at the 1-month follow-up session. Given the dynamic nature of the focus groups discussion, participating pharmacists had the opportunity to support opinions that had already been proposed by others, challenge these opinions, suggest new personal opinions, or discuss any disagreements regarding the implementations of the intervention. The outline and probing questions for the focus group discussion are presented in Supplementary Table S1 of the Supplementary data. From the patients, quantitative data were collected three months after their baseline session by means of a survey ( Supplementary Table S2 of the Supplementary data), based on a previously developed survey (Stuurman-Bieze et al., 2013). The survey was administered when the patients visited the CHC by trained research assistants.

Intervention fidelity, that is, the degree to which the intervention is implemented as intended, was assessed after each patient visit using a checklist, which contained the four adherence support strategies. Pharmacists indicated to what extent each adherence support strategy was implemented on a 5-point Likert scale, where 0 = “not at all,” 1 = “minimally,” 2 = “to some extent,” 3 = “a good deal,” and 4 = “a great extent” (Supplementary Table S3 of the Supplementary data). Adequate intervention fidelity was defined as achieving at least “a good deal” for the adherence support strategies that needed to be delivered given the identified barrier(s).

Data Analysis

The focus group discussion with the pharmacists was audio-taped, transcribed verbatim and analyzed by two researchers (SA, AI) using qualitative analysis software NVivo 12. Any disagreement was discussed between the two researchers until consensus was achieved. The statements in the transcripts were summarized and clustered using the thematic analysis approach based on the dimensions of the RE-AIM framework. The quantitative data from the patient survey were tabulated or presented in a figure as frequencies. Only the results of patients with complete follow-up were reported.

Results

In total, five pharmacists reporting on 57 enrolled intervention patients contributed to the process evaluation. From these patients, 49 participated in both intervention sessions and 44 out of these 49 completed the process evaluation questionnaire. Overall, most patients were female, aged between 60 and 69 years, and more than a quarter had a low level of formal education, regardless of having complete follow-up in our study (Table 1). The results of the Reach, Adoption, Implementation, and Maintenance dimensions of the RE-AIM framework are summarized in Figure 1.

TABLE 1

TABLE 1. Baseline sociodemographic characteristics of patients.

FIGURE 1

FIGURE 1. Reach, Adoption, Implementation, and Maintenance dimensions of the RE-AIM* framework from pharmacists’ and patients’ perspectives: main findings. Note: *: Effectiveness has been reported in more detail elsewhere (Alfian et al., 2021).

Reach

The intended amount of screening of at least 20 patients per CHC for eligibility was achieved in four out of the five CHCs (80%); in one CHC 17 patients were screened; resulting in a total of 111 patients screened. A high participation rate of more than 95% among patients for the first counselling session was observed. Patient reasons to decline participation were “having no time” and “not feeling well.” This screening resulted in identifying 57 eligible patients for the first counselling session. Forty-nine patients participated in the follow-up session, resulting in an overall complete participation rate among eligible patients of 86%.

Adoption

All five pharmacists reported that the 3-hours training was useful and clear. After the training, they were willing to use all parts of the intervention in diabetes patients receiving antihypertensive drugs. Regarding the conduct of the intervention, the pharmacists mentioned that they were able to identify patient-specific barriers to non-adherence and that they were easily guided to the corresponding adherence strategies using the support tools. These tools were reported to be clear, easy to use, and informative. All pharmacists agreed that their counselling of patients had become more focused.

The majority of the 44 patients with complete follow-up were (very) satisfied (42; 96%) with the information provided by the pharmacists (Table 2). Most of them agreed that the information provided was (very) important (41; 93%). Moreover, they assessed the atmosphere during the counselling as being (very) relaxed (44; 96%) (Table 2).

TABLE 2

TABLE 2. Satisfaction with the intervention in patients with complete follow-up (N = 44).

Implementation

During the focus group discussion, all pharmacists mentioned that in most cases the intervention was delivered as intended. According to pharmacists, most of patients were responsive during the counselling and truly willing to address the identified problems, while only a small number of patients seemed not very interested in making changes.

Out of the 57 patients who received the first adherence counseling session, 41 (72%) patients had one barrier for adherence identified and 14 (25%) patients had two or more barriers identified. The most common barrier was forgetfulness, followed by lack of knowledge and lack of motivation (Figure 2). Barrier(s) from two patients were not recorded due to management problems of the pharmacist. Reasons identified for adherence barriers are summarized in Table 3. Intervention fidelity for the first session was high (84%) for strategies addressing forgetfulness, and slightly lower (69%) for strategies addressing lack of knowledge or lack of motivation (Figure 2). Intervention fidelity for five patients was not recorded due to management problems of the pharmacist.

FIGURE 2

FIGURE 2. Flow chart of patients with identified adherence barriers and its intervention fidelity. Note: *Patients may have two or more barriers for adherence.

TABLE 3

TABLE 3. Reasons for non-adherence.

Among the 49 patients that participated in a 1-month follow-up session, 31 (63%) patients had become adherent according to their MARS scores. Particularly, problems with forgetfulness and lack of knowledge were reduced to a great extent (Figure 2). For the 18 patients who still reported non-adherence, forgetfulness and lack of motivation remained the most common barriers (Figure 2). Adequate intervention fidelity for the required adherence support strategies was high at follow-up session of counselling (Figure 2). Intervention fidelity for five patients was not recorded due to management problems of the pharmacist.

All pharmacists agreed that a follow-up session is necessary to evaluate the patient’s implementation of the agreed recommendation strategies. All pharmacists mentioned that the 3-hours training and the support tools facilitated the implementation of the intervention. Two pharmacists mentioned difficulties to manage time during counselling as well as a lack of confidence and lack of experience with patient counselling. For future implementation, three pharmacists suggested they would prefer to have their own counselling room in order to conduct counselling more comfortably. In three CHCs, the pharmacists shared the counselling room with others health care providers (nutritionist/nurse). Furthermore, two pharmacists indicated that the personalized patient leaflet was rather large, and suggested it should be more concise for practical reasons. Conducting home visits was suggested by three pharmacists in order to monitor medication adherence more objectively, especially for patients at risk of medication related problems. On the other hand, all pharmacists mentioned that the feasibility of conducting home visits is uncertain. Furthermore, one pharmacist mentioned that the pharmacist-led intervention should not be a stand-alone approach but rather a collaboration with other health care providers to optimize pharmaceutical care.

On average, the duration of counselling lasted for 14.2 min (range 5–20 min) and 10.6 min (range 3–18 min) at baseline and 1-month follow-up session, respectively. Most patients (84%) reported that the duration of counselling was sufficient. Only three patients expressed that the counseling was too short, whereas four patients said it was too long (Table 2). Most patients receiving strategies addressing forgetfulness (totally) agreed that formulating coping plans and asking support from family member was easy to implement. For those receiving tailored counselling, all patients (totally) agreed that this counselling improved their knowledge about the importance of medication adherence, improved their opinion regarding the necessity of antihypertensive drugs and/or reduced their concerns about their antihypertensive drugs (Figure 3).

FIGURE 3

FIGURE 3. Patients’ experiences with implementing each component of the intervention based on barrier(s) for adherence identified.

Maintenance

All pharmacists mentioned that the intervention can be maintained when the number of pharmacists in the CHC is sufficient regarding required time investment for the intervention. Furthermore, they would need support from health care authorities, that is, the head of the CHCs and the Department of Health of Bandung City, Indonesia, for conducting such a service. Particularly, the pharmacists wanted clear and practical guidelines on medication adherence counselling. All pharmacists were willing to continue the intervention as part of routine clinical practice in the future. Four of them also wanted to use the intervention for other diseases. When the intervention would be implemented in the future, all but one of the patients would like to receive the counselling either at every regular visit or at least once per six months (Table 2).

Discussion

The tailored pharmacist-led medication adherence intervention in patients with diabetes was well received and implemented in the participating Indonesian CHCs. It showed high participation rates and generally satisfied both pharmacists and patients. The pharmacists were able to identify individual patient adherence barriers and were easily guided to the corresponding adherence strategies using the support tools. In most cases, the elements of the intervention were carried out by pharmacists as intended, and the patients reported that the tailored intervention improved their knowledge and opinion about antihypertensive drugs. The training of pharmacists as well as having practical support tools, including a simple flow-chart, an adherence intervention wheel, and a personalized patient leaflet, seemed to have facilitated the implementation of the intervention in a routine care setting. All pharmacists were willing to continue the intervention as part of routine clinical practice in the future, and most patients would like to receive the counselling regularly. Some suggestions were made by the pharmacists for strengthening the intervention, such as having sufficient time, including home visits for specific patients, involving other health care providers, and availability of a personal counseling room. Furthermore, practical guidelines on medication adherence counseling and support of health care authorities would be helpful to maintain this service.

A systematic review in low- and middle-income Asian settings showed that pharmacists’ knowledge, tools and skills may not be sufficient to maintain pharmacist-led interventions in the long-term (Miller and Goodman, 2016). As mentioned by the pharmacists in our study, more explicit guidelines for pharmaceutical care may be important for maintaining the adherence intervention. Furthermore, lack of time is a common barrier to the provision of medication adherence support by community pharmacists (Fénélon-Dimanche et al., 2020). Therefore, offering a short training and practical tools that support pharmacists to quickly identify non-adherent patients and target only non-adherent patients using a tailored approach may be important elements of our intervention. Challenges can be, however, to provide the pharmacists with sufficient time and their own counselling room to conduct the targeted and tailored intervention. This may require support from authorities both at the level of the CHC as at a national level. In Indonesia, the national guidelines for pharmaceutical care state that pharmacists need to emphasize the importance of medication adherence during patient visits to the CHC (Kementerian Kesehatan Republik Indonesia, 2016). However, they lack explicit guidance on when and how to identify and improve medication non-adherence during patient counselling. In European countries, there are more comprehensive guidelines and resolutions on the implementation of pharmaceutical care including the role of the pharmacist to improve medication adherence by patient counselling (Committee of Ministers Council of Europe, 2020). This can be explained by the fact that pharmacist-led interventions have shown to improve medication adherence (Presley et al., 2019; Reeves et al., 2020). For some patients, home visits may be needed in order to monitor medication adherence more objectively, especially for patients at risk of medication related problems. In our study, several patients were lost to follow-up because they did not visit the CHCs to refill their medication. These patients are likely to have more adherence problems as compared to those who did visit the CHCs in time to refill their medication. Recognition and interventions to address adherence barriers observed during home visit may improve medication adherence (Williams et al., 2006; Renfro et al., 2019).

From the patient perspective, it seems the intervention was much appreciated and helpful. It became clear that a tailored intervention fulfilled a need, since a substantial number of patients had problems with forgetting their medication or had insufficient knowledge or insufficiently addressed concerns regarding their antihypertensive drugs. The high satisfaction reported by patients is important, since patients who are satisfied with pharmacy services are more likely to adhere to their medication (Gu et al., 2008). Our findings suggest that there are opportunities for scaling up the intervention to larger populations in Indonesia. Future research should focus on the optimal frequency of regular counselling since developing new habits may take up to one year (Lally et al., 2010).

This process evaluation also provides insights on specific effects of the tailored intervention. Previously, we found that the intervention significantly improved patients’ adherence, but not their beliefs about medication (Alfian et al., 2021). Overall, adequate levels of reach, adoption and implementation of the intervention explains its effect on adherence. The lack of an overall effect on beliefs about medication can be explained by the fact that our intervention was tailored to needs of the patients, and focused more on forgetfulness than on lack of knowledge or motivation. The patients with a lack of motivation did report that the counselling improved their opinion regarding the necessity of antihypertensive and reduced their concerns but it seemed that lack of motivation was more persistent. Changing lack of motivation and underlying negative beliefs about medication may require more than two sessions of counselling by a pharmacist (Zwikker et al., 2014; Scala et al., 2018). It might be that involvement of other health care providers, as suggested by one of the pharmacists in our study, could be of help.

A strength of this study is that we used the RE-AIM framework to systematically evaluate the implementation of the intervention. The advantage of the RE-AIM framework is that it captures both quantitative and qualitative measures of contextual factors (Farris et al., 2007). Furthermore, both pharmacists and patients’ perspectives were explored, allowing us to have a comprehensive evaluation during the implementation of the intervention. All pharmacists that were asked to participate in the intervention study were willing to do so. These were pharmacists on duty in CHCs with the highest number of diabetes patients in Bandung City, Indonesia. Some limitations need to be mentioned. The focus group discussion only included the five pharmacists randomized to the intervention who may not be fully representative of other pharmacists in Bandung City or in Indonesia. A larger group might have generated more views on the further implementation of the intervention. Furthermore, some of the included patients were lost to follow-up. These could in part be patients that were less interested in the intervention or had more difficulties with being adherent. Therefore, our included patients might be more willing to change their non-adherent behavior to antihypertensive drugs and be more satisfied with the intervention. Regarding their sociodemographic characteristics, however, the patients with one or two sessions appeared to be similar. We do not know to what extent our included patients were representative of all patients with diabetes and hypertension in Bandung City or in Indonesia but we included patients with a broad range in demographic characteristics. Importantly, we included both younger and older patients, patients with limited education and patients with different types of health insurance. Finally, the implementation of the different aspects of the intervention was measured using a pharmacist self-reported checklist and a patient questionnaire, which may lead to more socially desirable answers. Audio and/or video recordings would have allowed for a more objective assessment of the counselling.

Conclusion

The positive effects of the pharmacist-led intervention can be explained by adequate levels of reach, adoption and implementation in the setting of the participating CHCs. Tailoring the support strategies to the patients’ needs and using practical support tools resulted in positive responses from both pharmacists and patients. Scaling up the intervention to larger populations in Indonesia and other low- and middle-income countries may require additional actions. Relevant factors to consider include additional training of pharmacists in motivational counselling, sufficient time, home visits for specific patients, involving other health care providers to improve medication adherence and pharmaceutical care, providing pharmacists with their own counselling room, explicit guidance for pharmacists on medication adherence counselling, and support from health care authorities.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics Statement

The studies involving human participants were reviewed and approved by the Health Research Ethics Committee of Universitas Padjadjaran No. 859/UN6.KEP/EC/2019 and was registered at clinicaltrials.gov under the identifier NCT04023734. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

SA, wrote the first draft of this manuscript. SA, JB, RA, EH, and PD, participated in the design of the study. SA, JB, AI, EH, and PD, participated in data analysis and interpretation. SA, JB, AI, RA, EH, and PD, contributed to the revision of the manuscript. All authors approved the final manuscript.

Funding

SDA is supported by a scholarship from the Indonesia Endowment Fund for Education (LPDP No: PRJ-2361/LPDP/2015). This funding body did not have any role in designing the study, in writing this article, and in deciding to submit it for publication.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

We thank all patients, pharmacists, and research assistants for their effort and contribution.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fphar.2021.652018/full#supplementary-material

References

Alfian, S. D., Abdulah, R., Denig, P., van Boven, J. F. M., and Hak, E. (2020). Targeted and Tailored Pharmacist-Led Intervention to Improve Adherence to Antihypertensive Drugs Among Patients with Type 2 Diabetes in Indonesia: Study Protocol of a Cluster Randomised Controlled Trial. BMJ Open 10, e034507. doi:10.1136/bmjopen-2019-034507

PubMed Abstract | CrossRef Full Text | Google Scholar

Alfian, S. D., Boven, J. F. M., Abdulah, R., Sukandar, H., Denig, P., and Hak, E. (2021). Effectiveness of a Targeted and Tailored Pharmacist‐led Intervention to Improve Adherence to Antihypertensive Drugs Among Patients with Type 2 Diabetes in Indonesia: A Cluster Randomised Controlled Trial. Br. J. Clin. Pharmacol. 87, 2032–2042. doi:10.1111/bcp.14610

PubMed Abstract | CrossRef Full Text | Google Scholar

Breitenstein, S. M., Gross, D., Garvey, C. A., Hill, C., Fogg, L., and Resnick, B. (2010). Implementation Fidelity in Community-Based Interventions. Res. Nurs. Health 33, 164–173. doi:10.1002/nur.20373

PubMed Abstract | CrossRef Full Text | Google Scholar

Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J., and Balain, S. (2007). A Conceptual Framework for Implementation Fidelity. Implement. Sci. 2, 1–9. doi:10.1186/1748-5908-2-40

PubMed Abstract | CrossRef Full Text | Google Scholar

Committee of Ministers Council of Europe (2020). Resolution CM / Res ( 2020 ) 3 on the Implementation of Pharmaceutical Care for the Benefit of Patients and Health Services. London, United Kingdom: Committee of Ministers Council of Europe.

Correia, J. C., Lachat, S., Lachat, S., Lagger, G., Chappuis, F., Golay, A., et al. (2019). Interventions Targeting Hypertension and Diabetes Mellitus at Community and Primary Healthcare Level in Low- and Middle-Income Countries:a Scoping Review. BMC Public Health 19, 1542. doi:10.1186/s12889-019-7842-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Farris, R. P., Will, J. C., Khavjou, O., and Finkelstein, E. A. (2007). Beyond Effectiveness: Evaluating the Public Health Impact of the WISEWOMAN Program. Am. J. Public Health 97, 641–647. doi:10.2105/AJPH.2005.072264

PubMed Abstract | CrossRef Full Text | Google Scholar

Fénélon-Dimanche, R., Guénette, L., Trudel-Bourgault, F., Yousif, A., Lalonde, G., Beauchesne, M.-F., et al. (2021). Development of an Electronic Tool (E-AdPharm) to Address Unmet Needs and Barriers of Community Pharmacists to Provide Medication Adherence Support to Patients. Res. Soc. Administrative Pharm. 17, 506–513. In press. doi:10.1016/j.sapharm.2020.04.022

CrossRef Full Text | Google Scholar

Glasgow, R. E., Harden, S. M., Gaglio, B., Rabin, B., Smith, M. L., Porter, G. C., et al. (2019). RE-AIM Planning and Evaluation Framework: Adapting to New Science and Practice with a 20-year Review. Front. Public Health 7, 64. doi:10.3389/fpubh.2019.00064

PubMed Abstract | CrossRef Full Text | Google Scholar

Glasgow, R. E., McKay, H. G., Piette, J. D., and Reynolds, K. D. (2001). The RE-AIM Framework for Evaluating Interventions: what Can it Tell Us about Approaches to Chronic Illness Management? Patient Educ. Couns. 44, 119–127. doi:10.1016/S0738-3991(00)00186-5

PubMed Abstract | CrossRef Full Text | Google Scholar

Glasgow, R. E., Vogt, T. M., and Boles, S. M. (1999). Evaluating the Public Health Impact of Health Promotion Interventions: the RE-AIM Framework. Am. J. Public Health 89, 1322–1327. doi:10.2105/ajph.89.9.1322

PubMed Abstract | CrossRef Full Text | Google Scholar

Gu, N. Y., Gai, Y., and Hay, J. W. (2008). The Effect of Patient Satisfaction with Pharmacist Consultation on Medication Adherence: an Instrumental Variable Approach. Pharm. Pract. (Granada). 6, 201. doi:10.4321/s1886-36552008000400006

PubMed Abstract | CrossRef Full Text | Google Scholar

Kementerian Kesehatan Republik Indonesia (2016). Peraturan Menteri Kesehatan Republik Indonesia Nomor 74 Tahun 2016 tentang standar Pelayanan Kefarmasian di Puskesmas. Jakarta: Kementerian Kesehatan Republik Indonesia.

Kini, V., and Ho, P. M. (2018). Interventions to Improve Medication Adherence. JAMA 320, 2461. doi:10.1001/jama.2018.19271

PubMed Abstract | CrossRef Full Text | Google Scholar

Lally, P., van Jaarsveld, C. H. M., Potts, H. W. W., and Wardle, J. (2010). How Are Habits Formed: Modelling Habit Formation in the Real World. Eur. J. Soc. Psychol. 40, 998–1009. doi:10.1002/ejsp.674

CrossRef Full Text | Google Scholar

Milat, A. J., and Li, B. (2017). Narrative Review of Frameworks for Translating Research Evidence into Policy and Practice. Public Health Res. Pract. 27, 2711704. doi:10.17061/phrp2711704

PubMed Abstract | CrossRef Full Text | Google Scholar

Miller, R., and Goodman, C. (2016). Performance of Retail Pharmacies in Low- and Middle-Income Asian Settings: a Systematic Review. Health Policy Plan. 31, 940–953. doi:10.1093/heapol/czw007

PubMed Abstract | CrossRef Full Text | Google Scholar

Nieuwlaat, R., Wilczynski, N., Navarro, T., Hobson, N., Jeffery, R., Keepanasseril, A., et al. (2014). Interventions for Enhancing Medication Adherence. Cochrane Database Syst. Rev. 2014, CD000011. doi:10.1002/14651858.CD000011.pub4

PubMed Abstract | CrossRef Full Text | Google Scholar

Presley, B., Groot, W., and Pavlova, M. (2019). Pharmacy-led Interventions to Improve Medication Adherence Among Adults with Diabetes: A Systematic Review and Meta-Analysis. Res. Soc. Administrative Pharm. 15, 1057–1067. doi:10.1016/j.sapharm.2018.09.021

CrossRef Full Text | Google Scholar

Reeves, L., Robinson, K., McClelland, T., Adedoyin, C. A., Broeseker, A., and Adunlin, G. (2020). Pharmacist Interventions in the Management of Blood Pressure Control and Adherence to Antihypertensive Medications: A Systematic Review of Randomized Controlled Trials. J. Pharm. Pract., 1–13. doi:10.1177/0897190020903573

CrossRef Full Text | Google Scholar

Renfro, C. P., Urick, B. Y., Mansour, M. A., and Ferreri, S. P. (2019). Pharmacy Characteristics Correlating to Performance in a Community Pharmacy Network. J. Am. Pharm. Assoc. 59, 275–279. doi:10.1016/j.japh.2018.12.017

PubMed Abstract | CrossRef Full Text | Google Scholar

Scala, D., Menditto, E., Caruso, G., Monetti, V. M., Orlando, V., Guerriero, F., et al. (2018). Are You More Concerned about or Relieved by Medicines? an Explorative Randomized Study of the Impact of Telephone Counseling by Pharmacists on Patients' Beliefs Regarding Medicines and Blood Pressure Control. Patient Educ. Couns. 101, 679–686. doi:10.1016/j.pec.2017.12.006

PubMed Abstract | CrossRef Full Text | Google Scholar

Stuurman-Bieze, A. G. G., Hiddink, E. G., van Boven, J. F. M., and Vegter, S. (2013). Proactive Pharmaceutical Care Interventions Improve Patients' Adherence to Lipid-Lowering Medication. Ann. Pharmacother. 47, 1448–1456. doi:10.1177/1060028013501146

PubMed Abstract | CrossRef Full Text | Google Scholar

Tabak, R. G., Khoong, E. C., Chambers, D. A., and Brownson, R. C. (2012). Bridging Research and Practice. Am. J. Prev. Med. 43, 337–350. doi:10.1016/j.amepre.2012.05.024

PubMed Abstract | CrossRef Full Text | Google Scholar

Williams, A. B., Fennie, K. P., Bova, C. A., Burgess, J. D., Danvers, K. A., and Dieckhaus, K. D. (2006). Home Visits to Improve Adherence to Highly Active Antiretroviral Therapy. J. Acquir. Immune Defic. Syndr. 42, 314–321. doi:10.1097/01.qai.0000221681.60187.88

PubMed Abstract | CrossRef Full Text | Google Scholar

Zwikker, H. E., Van den Ende, C. H., Van Lankveld, W. G., Den Broeder, A. A., Van den Hoogen, F. H., Van de Mosselaar, B., et al. (2014). Effectiveness of a Group-Based Intervention to Change Medication Beliefs and Improve Medication Adherence in Patients with Rheumatoid Arthritis: A Randomized Controlled Trial. Patient Educ. Couns. 94, 356–361. doi:10.1016/j.pec.2013.12.002

PubMed Abstract | CrossRef Full Text | Google Scholar