Skip to main content

METHODS article

Front. Cardiovasc. Med., 01 May 2017
Sec. Pediatric Cardiology
This article is part of the Research Topic Neuro-Development and Psychological Issues in Congenital Heart Defects View all 11 articles

Development of an Online, Evidence-Based Patient Information Portal for Congenital Heart Disease: A Pilot Study

\r\nJonathan R. G. EtnelJonathan R. G. Etnel1Arie P. J. van DijkArie P. J. van Dijk2Jolanda Kluin,Jolanda Kluin3,4Robin A. BertelsRobin A. Bertels5Elisabeth M. W. J. Utens,,Elisabeth M. W. J. Utens6,7,8Eugene van GalenEugene van Galen9Regina TheRegina The10Ad J. J. C. BogersAd J. J. C. Bogers1Johanna J. M. Takkenberg*\r\nJohanna J. M. Takkenberg1*
  • 1Department of Cardiothoracic Surgery, Erasmus University Medical Center, Rotterdam, Netherlands
  • 2Department of Cardiology, Radboud University Medical Center, Nijmegen, Netherlands
  • 3Department of Cardiothoracic Surgery, Academic Medical Center, Amsterdam, Netherlands
  • 4Department of Cardiothoracic Surgery, Leiden University Medical Center, Leiden, Netherlands
  • 5Department of Pediatric Cardiology, Leiden University Medical Center, Leiden, Netherlands
  • 6Department of Child and Adolescent Psychiatry/Psychology, Erasmus University Medical Center – Sophia Children’s Hospital, Rotterdam, Netherlands
  • 7Research Institute of Child Development and Education, University of Amsterdam, Amsterdam, Netherlands
  • 8De Bascule, Academic Center for Child Psychiatry, Amsterdam, Netherlands
  • 9Patient Association ‘Patiëntenvereniging Aangeboren Hartafwijkingen’, Maarssen, Netherlands
  • 10ZorgKeuzeLab, Delft, Netherlands

Objectives: In response to an increased need for patient information on congenital heart disease in the Netherlands, we initiated a nationwide initiative to develop an online, evidence-based patient information portal, starting with a pilot project aimed at the subgroup of patients with congenital aortic and pulmonary valve disease.

Methods and results: We developed an information portal that aims to (1) improve patient knowledge and involvement and to subsequently reduce anxiety and decisional conflict and improve mental quality of life and (2) to support physicians in informing and communicating with their patients. The information portal was developed according to the systematic International Patient Decision Aid Standards development process employing Delphi techniques by a multidisciplinary workgroup of pediatric and adult congenital cardiologists, a congenital cardiothoracic surgeon, a psychologist, an epidemiologist, a patient representative, and web and industrial design experts. First, patients and physicians were surveyed and interviewed to assess the current state of patient information and explore their preferences and needs to determine the focus for the development of the information portal. We found that patient knowledge and numeracy are limited, reliable information is scarce, physicians inform patients selectively and patient involvement is suboptimal, and there is a need for more reliable, tailored, and multi-faceted information. Based on the findings of these surveys and interviews, a patient-tailored information portal was designed that presents evidence-based disease- and age-specific medical and psychosocial information about diagnosis, treatment, prognosis, and impact on daily life in a manner that is comprehensible and digestible for patients and that meets the needs expressed by both patients and physicians. The effect of the website on patient outcome is currently being assessed in a multicenter stepped-wedge implementation trial.

Conclusion: The present pilot project succeeded in developing an online, evidence-based information portal that is supported by both patients and physicians. The information portal will be further developed and expanded to include all other major forms of congenital heart disease, translations into other languages, and a public information portal to serve patients’ relatives and the general public at large.

Introduction

Congenital heart disease is the most common congenital birth defect with an incidence of approximately 1% of all live births (1, 2). Due to major advances in the treatment of congenital heart disease over the past decades, approximately 90% of these patients now reach adulthood (3). This has, however, made congenital heart disease a chronic illness with, for example, an estimated 2.4 million people currently living with a congenital heart defect in the United States of America alone and an estimated 65,000 in the Netherlands.

The consequences of congenital heart disease for the individual patient are complex, time varying, and heavily dependent on the specific defect(s), individual patient-related factors, and treatment options and decisions. These consequences may have a significant impact on many facets of the patients’ lives, both clinical and personal. Therefore, informing patients and their relatives in a complete, objective, and understandable manner is essential in optimizing patient quality of life, lifestyle, health behavior, treatment adherence, and patient involvement in treatment decisions (416).

In response to an increased need for patient information in congenital heart disease in the Netherlands, we therefore initiated a nationwide initiative to improve patient information, starting with a pilot project aimed at a subgroup of congenital heart disease patients with aortic or pulmonary valve disease, including Tetralogy of Fallot (1315, 1721).

The objective of this pilot project was to develop an online information portal that aims to (1) improve patient knowledge and involvement and to subsequently reduce anxiety, depression, and decisional conflict and improve mental quality of life and (2) to support physicians in informing and communicating with their patients.

Methods and Results

The present pilot study comprises a complete comprehensive development process for a target subgroup restricted to patients with congenital aortic and/or pulmonary valve disease and/or Tetralogy of Fallot as a proof of concept. The subsequent full-scale project will entail expansion to all other major forms of congenital heart disease, building on this proof of concept.

The focus of this pilot project was to develop a nationwide patient-tailored, evidence-based patient information tool to be incorporated into specialist congenital cardiac care developed by and for patients, caregivers, and physicians, based on both patient/caregiver and physician preferences.

First, we evaluated the current state of patient information in congenital heart disease in the Netherlands to determine key focus points for development. Next, we developed the information portal in a multidisciplinary national working group (Table 1) according to the systematic International Patient Decision Aid Standards (IPDAS) development process, employing Delphi techniques (22, 23). Finally, we designed and are currently conducting a stepped-wedge cluster randomized implementation trial. All three steps are described below.

TABLE 1
www.frontiersin.org

Table 1. Working group members.

Evaluation of the Current State of Patient Information

The first crucial step in the development of the portal was a thorough evaluation of the current state of patient information and information needs in congenital heart disease in the Netherlands. The results of this phase would define the key focus points for the development of the information portal and, thus, represent the primary input for the next phase of the project.

We carried out this phase by conducting comprehensive surveys and interviews among patients (N = 63), caregivers of pediatric patients (N = 10), and physicians (N = 32). A detailed report of these surveys will be published separately, but the main findings included the following:

Patient/caregiver knowledge is limited: although patients/caregivers think they are adequately informed, actual disease-specific knowledge was objectively sufficient in only half of the respondents, which is in line with previous findings (13, 14, 1721).

Reliable information is scarce: only 62% of patient/caregiver respondents agreed that reliable information was readily available to them. Subsequently, patients rely heavily on their physicians for information as evidenced by a mere 13% of patients citing sources other than their cardiologist or cardiac surgeon as one of their main sources of information.

Patient/caregiver numeracy is limited: only 46% of respondents were able to successfully complete a 3-question basic numeracy test adapted from the Numeracy Scale (24, 25).

Patient/caregiver involvement is suboptimal: both physicians and patients/caregivers agree that patients/caregivers are insufficiently involved. Physicians agree that most difficulty they experience in involving patients/caregivers is due to limited patient knowledge and comprehension.

Physicians inform patients/caregivers selectively: as self-reported by physicians, the information they convey is mostly based on their own judgment of what is important and comprehensible to each patient/caregiver. This may not always correspond with what patients/caregivers themselves think is important.

Patient information preferences and needs: in line with previous findings (26), the most important preferences and needs with regard to patient information expressed by patients/caregivers were as follows:

○ More (reliable) information on:

■ Implications for personal life (education, career, pregnancy, insurance, etc.)

■ Health behavior and lifestyle recommendations

■ Prognosis

■ Psychosocial aspects

■ Pros and cons of various treatment options

■ Recovery after surgery

○ Disease-specific information

○ Age-specific information

○ Non-contradictory information.

Whereas physicians expressed a strong need for:

○ A single, trusted, evidence-based source of reliable patient information to which they can refer their patients

○ Tools to aid communication with patients/caregivers.

Development of Information Portal

Based on the findings of the surveys and interviews and in response to the needs expressed by both patients and physicians therein, a first prototype of an information portal was drafted according to the IPDAS development process and employing Delphi techniques. This prototype was then internally reviewed and revised by all members of the working group in live meetings until a consensus was reached on all topics (Table 1) (alpha-testing). The resulting second prototype was then again extensively reviewed by independent adult patients (n = 2), caregivers of pediatric patients (n = 2), physicians (n = 6; two pediatric cardiologists, two adult congenital cardiologists and two congenital cardiac surgeons), and clinical psychologists (n = 2) from outside the working group, sampled from clinical practice (beta-testing). All testers were given specific instructions to focus on all aspects of the information portal, including information content, language, illustrations, design, and usability. Additionally, the patients/caregivers were also observed as they navigated the portal. The feedback from this beta-testing was the input for the final review and revision by the working group.

The product of this development process is a comprehensive patient information tool that corresponds with the preferences and needs expressed by patients and physicians and addresses the shortcomings identified in the surveys and interviews.

The implementation of the patient information portal in clinical care will take place as follows. Patients/caregivers that present to the cardiologist are invited to use the online information portal by the cardiologist who hands out a sketchpad during the consultation (Figure 1). This sketchpad offers a template for the cardiologist to provide a clear graphical representation of the patient’s heart defect as well as any other relevant notes for the patient/caregiver. On the sketchpad, the cardiologist also indicates which of the predefined diagnoses are applicable to the patient. The patients/caregivers can then take their sketch sheet home and review the cardiologist’s notes and drawings and visit the information portal using the link and personal private account details listed on the sketch sheet. When they do so, they enter a private information portal (Figure 2) with the following key characteristics.

FIGURE 1
www.frontiersin.org

Figure 1. Sketchpad.

FIGURE 2
www.frontiersin.org

Figure 2. Screenshot of the pilot online patient information portal.

Disease- and Age-Specific Information

All information on the portal is compiled and presented specifically and separately for each congenital heart defect and target group (teenagers, adults, or parents/caregivers) with regard to both content and language.

Upon their first visit to the website, users are prompted to select their target group and diagnosis (two simple multiple choice prompts). Based on the combination of these inputs, a tailored personal subportal is custom built for each user. Their personal subportal contains only the information that is relevant to them. In case of multiple congenital heart defects, all relevant information is automatically combined into a single tailored subportal for that unique combination of inputs.

Multi-Faceted Information Based on Patient/Caregiver Preferences

As patients/caregivers indicated a discrepancy between their own information needs and the information generally provided by physicians and other sources, the information provided by the portal is not based solely on what physicians think is important but rather represents both the clinical and the patient perspectives. Therefore, the information portal contains information on all aspects of disease that were found to be important to patients/caregivers and physicians in the surveys and interviews, such as diagnosis, treatment, prognosis, psychosocial aspects, and implications for daily life and future life planning.

Format That Is Comprehensible and Digestible

To maximize digestibility and comprehensibility, the information is fragmented into various frequently asked questions that correspond with the topics that patients/caregivers and physicians indicated to be important in the surveys and interviews. Comprehension is further enhanced by the liberal use of custom illustrations, designed to the specifications of the multidisciplinary working group by a professional medical illustrator. Additionally, a professional medical text writer was contracted to optimize the linguistics of the textual content for each target group separately to maximize comprehensibility, digestibility and attractiveness for users of all ages and education levels. Furthermore, to address the limited numeracy among the target audience, all numerical risks on the information portal are supported by risk visualizations, such as icon arrays.

Support Patient/Caregiver–Physician Communication

Patients/caregivers indicated that they are often unsure about which topics should be discussed with the physician. Throughout the information portal, we therefore provide numerous suggestions for important topics that should be discussed, as indicated by both physicians and patients/caregivers. Furthermore, there is a comment box on each page of the information portal in which patients/caregivers are encouraged to note any questions they may have about the information on that page. These questions are then saved in their personal account. Users can view, edit, and/or print a summary of their questions and optionally discuss this with their physicians.

Physicians and other involved health-care providers are also provided with their own personal accounts for the information portal, so that they can use the information portal to aid in explaining or illustrating disease-related information to patients/caregivers in the consulting room. Moreover, the sketchpad, as described above, is intended to further facilitate communication in the consulting room.

Evidence-Based Information

All information on the information portal is based on international guidelines and peer-reviewed published evidence where possible. Furthermore, all four centers for congenital cardiac surgery in the Netherlands have combined their prospective databases of early outcome after all congenital cardiac surgery performed in these centers in the past 10 years to allow conveyance of reliable, nationwide data on risks and recovery after contemporary cardiac surgery to patients/caregivers.

Implementation Trial

As the last phase of this pilot project, we are conducting a stepped-wedge cluster randomized (27, 28) implementation trial of the information portal in four large congenital cardiac centers in the Netherlands, which is ongoing as of writing.

The aim of this last phase of the pilot project is twofold:

• To gain insight into both the practical and cultural intricacies at each of the eight participating departments (departments of both adult and pediatric cardiology at each of the four participating centers) that need to be taken into account for effective implementation of the information portal and to subsequently develop individual implementation plans tailored to each of these departments and

• To evaluate the effect of the implementation of the information portal on patients and caregivers with regard to:

○ Disease-specific knowledge

○ Anxiety and depression

○ Mental quality of life

○ Patient/caregiver involvement and autonomy

○ Experiences with and views on patient information

○ Views on participation in decision-making

○ Decisional conflict.

Adult patients and caregivers of pediatric patients with congenital aortic and/or pulmonary valve disease and/or Tetralogy of Fallot that visit the outpatient clinic at one of the four participating centers are prospectively included. In total, at least 250 respondents will be included, 125 in the control group (no access to the information portal) and 125 in the intervention group (access to the information portal), all of whom will complete an online survey on the above topics 1 month after their visit to the outpatient clinic.

Discussion and Further Development

The present pilot project succeeded in developing and implementing a nationwide online, evidence-based, disease- and age-specific information portal for (caregivers of) patients with congenital heart disease, based on extensive input from all parties involved in congenital cardiac care in the Netherlands and addressing both patient and physician needs. Our extensive and meticulous nationwide multidisciplinary development process ensures broad nationwide acceptance into clinical practice by both patients/caregivers and health-care providers.

In various disease states, more informed and activated patients have been previously found to be associated not only with improved quality of life, treatment adherence, health behavior, and clinical outcome but also with more efficient health-care utilization and lower health-care costs (416). The implementation trial, the final phase of the current pilot project, will shed light on the effect of the implementation of our pilot information portal on short-term psychosocial patient outcome. In the further development of the information portal, we will also focus specifically on clinical and long-term psychosocial effects as well as physician, implementation, and health-care service outcomes.

We are currently planning the further refinement and expansion of this information portal to all major forms of congenital heart disease, in which we aim to cover >90% of all cases of congenital heart disease. This full-scale project will build on all the knowledge, expertise, methods, framework, and infrastructure gained in the pilot project and will also be carried out in a multidisciplinary fashion. Additionally, focus groups with specific expertise will be employed when beneficial. This full-scale project will also include translations into other common languages, first and foremost English. We are also exploring innovative and interactive methods for improving patient participation, particularly in teenagers and adolescents.

Besides the further development of the current patient-tailored information portal, the full-scale project will also include the parallel development of a public information portal suited for broader use by patients and caregivers before a definitive diagnosis has been made, as well as their relatives and friends and the general public at large.

In the interest of sustainability, all relevant Dutch physician associations and patient associations have committed to a long-term partnership in this initiative. A multidisciplinary national working group in which each of these partners is represented will remain instated to oversee continuous review, updating, enhancement, and expansion of the information portal to ensure that we continue to provide up-to-date, evidence-based patient information of the highest standard.

Future partnerships and (conceptual) dissemination beyond the field of congenital heart disease and internationally may provide unique opportunities for further enhancing quality, expertise, and sustainability in this initiative.

Ethics Statement

This study was approved by the institutional review board (MEC-2015-099), and all subjects gave written informed consent in accordance with the Declaration of Helsinki.

Author Note

Presented at the Psychosocial Care from Fetus to Adult Meeting (16–18 March 2016, Rotterdam) of the Association for European Paediatric and Congenital Cardiology (AEPC) and at the 50th Annual Meeting (1–4 June 2016, Rome) of the AEPC.

Author Contributions

Substantial contributions to the conception or design of the work; or the acquisition, analysis, or interpretation of data for the work; drafting the work or revising it critically for important intellectual content; final approval of the version to be published; and agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved: all authors (JE, AD, JK, RB, EU, EG, RT, AB, and JT).

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Funding

This work was supported by the Dutch Heart Foundation (2013T093).

References

1. van der Linde D, Konings EE, Slager MA, Witsenburg M, Helbing WA, Takkenberg JJ, et al. Birth prevalence of congenital heart disease worldwide: a systematic review and meta-analysis. J Am Coll Cardiol (2011) 58(21):2241–7. doi: 10.1016/j.jacc.2011.08.025

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Hoffman J. The global burden of congenital heart disease. Cardiovasc J Afr (2013) 24(4):141–5. doi:10.5830/CVJA-2013-028

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Warnes CA, Liberthson R, Danielson GK, Dore A, Harris L, Hoffman JI, et al. Task force 1: the changing profile of congenital heart disease in adult life. J Am Coll Cardiol (2001) 37(5):1170–5. doi:10.1016/S0735-1097(01)01272-4

CrossRef Full Text | Google Scholar

4. Dore A, de Guise P, Mercier LA. Transition of care to adult congenital heart centres: what do patients know about their heart condition? Can J Cardiol (2002) 18(2):141–6.

PubMed Abstract | Google Scholar

5. Saidi AS, Paolillo J, Fricker FJ, Sears SF, Kovacs AH. Biomedical and psychosocial evaluation of “cured” adults with congenital heart disease. Congenit Heart Dis (2007) 2(1):44–54. doi:10.1111/j.1747-0803.2007.00071.x

CrossRef Full Text | Google Scholar

6. Reid GJ, Webb GD, McCrindle BW, Irvine MJ, Siu SC. Health behaviors among adolescents and young adults with congenital heart disease. Congenit Heart Dis (2008) 3(1):16–25. doi:10.1111/j.1747-0803.2007.00161.x

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Horner T, Liberthson R, Jellinek MS. Psychosocial profile of adults with complex congenital heart disease. Mayo Clin Proc (2000) 75(1):31–6. doi:10.4065/75.1.31

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Gatzoulis MA. Adult congenital heart disease: education, education, education. Nat Clin Pract Cardiovasc Med (2006) 3(1):2–3. doi:10.1038/ncpcardio0382

CrossRef Full Text | Google Scholar

9. Moons P. Quality of Life in Adults with Congenital Heart Disease: Beyond the Quantity of Life. Leuven: KU Leuven (2004).

Google Scholar

10. Mosen DM, Schmittdiel J, Hibbard J, Sobel D, Remmers C, Bellows J. Is patient activation associated with outcomes of care for adults with chronic conditions? J Ambul Care Manage (2007) 30(1):21–9. doi:10.1097/00004479-200701000-00005

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Greene J, Hibbard JH. Why does patient activation matter? An examination of the relationships between patient activation and health-related outcomes. J Gen Intern Med (2012) 27(5):520–6. doi:10.1007/s11606-011-1931-2

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Janssens A, Goossens E, Luyckx K, Budts W, Gewillig M, Moons P, et al. Exploring the relationship between disease-related knowledge and health risk behaviours in young people with congenital heart disease. Eur J Cardiovasc Nurs (2016) 15(4):231–40. doi:10.1177/1474515114565214

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Goossens E, Fieuws S, Van Deyk K, Luyckx K, Gewillig M, Budts W, et al. Effectiveness of structured education on knowledge and health behaviors in patients with congenital heart disease. J Pediatr (2015) 166(6):1370–6e1. doi:10.1016/j.jpeds.2015.02.041

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Van Damme S, Van Deyk K, Budts W, Verhamme P, Moons P. Patient knowledge of and adherence to oral anticoagulation therapy after mechanical heart-valve replacement for congenital or acquired valve defects. Heart Lung (2011) 40(2):139–46. doi:10.1016/j.hrtlng.2009.11.005

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Levert EM, Helbing WA, Dulfer K, van Domburg RT, Utens EM. Psychosocial needs of children undergoing an invasive procedure for a CHD and their parents. Cardiol Young (2017) 27(2):243–54. doi:10.1017/S1047951116000391

CrossRef Full Text | Google Scholar

16. Hibbard JH, Greene J, Overton V. Patients with lower activation associated with higher costs; delivery systems should know their patients’ ‘scores’. Health Aff (Millwood) (2013) 32(2):216–22. doi:10.1377/hlthaff.2012.1064

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Moons P, De Volder E, Budts W, De Geest S, Elen J, Waeytens K, et al. What do adult patients with congenital heart disease know about their disease, treatment, and prevention of complications? A call for structured patient education. Heart (2001) 86(1):74–80. doi:10.1136/heart.86.1.74

CrossRef Full Text | Google Scholar

18. Goossens E, Van Deyk K, Zupancic N, Budts W, Moons P. Effectiveness of structured patient education on the knowledge level of adolescents and adults with congenital heart disease. Eur J Cardiovasc Nurs (2014) 13(1):63–70. doi:10.1177/1474515113479231

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Yang HL, Chen YC, Wang JK, Gau BS, Moons P. An evaluation of disease knowledge in dyads of parents and their adolescent children with congenital heart disease. J Cardiovasc Nurs (2013) 28(6):541–9. doi:10.1097/JCN.0b013e318260c308

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Yang HL, Chen YC, Wang JK, Gau BS, Chen CW, Moons P. Measuring knowledge of patients with congenital heart disease and their parents: validity of the ‘Leuven Knowledge Questionnaire for Congenital Heart Disease’. Eur J Cardiovasc Nurs (2012) 11(1):77–84. doi:10.1177/1474515111429662

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Van Deyk K, Moons P, Gewillig M, Budts W. Educational and behavioral issues in transitioning from pediatric cardiology to adult-centered health care. Nurs Clin North Am (2004) 39(4):755–68. doi:10.1016/j.cnur.2004.07.010

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Hsu C-C, Sandford BA. The Delphi technique: making sense of consensus. Pract Assess Res Eval (2007) 12(10):1–8.

Google Scholar

23. Coulter A, Stilwell D, Kryworuchko J, Mullen PD, Ng CJ, van der Weijden T. A systematic development process for patient decision aids. BMC Med Inform Decis Mak (2013) 13(Suppl 2):S2. doi:10.1186/1472-6947-13-S2-S2

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Korteland NM, Bras FJ, van Hout FM, Kluin J, Klautz RJ, Bogers AJ, et al. Prosthetic aortic valve selection: current patient experience, preferences and knowledge. Open Heart (2015) 2(1):e000237. doi:10.1136/openhrt-2015-000237

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Lipkus IM, Samsa G, Rimer BK. General performance on a Numeracy Scale among highly educated samples. Med Decis Making (2001) 21(1):37–44. doi:10.1177/0272989X0102100105

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Harrison JL, Silversides CK, Oechslin EN, Kovacs AH. Healthcare needs of adults with congenital heart disease: study of the patient perspective. J Cardiovasc Nurs (2011) 26(6):497–503. doi:10.1097/JCN.0b013e31820984c9

PubMed Abstract | CrossRef Full Text | Google Scholar

27. The Gambia Hepatitis Study Group. The Gambia Hepatitis Intervention Study. Cancer Res (1987) 47(21):5782–7.

Google Scholar

28. Mdege ND, Man MS, Taylor Nee Brown CA, Torgerson DJ. Systematic review of stepped wedge cluster randomized trials shows that design is particularly used to evaluate interventions during routine implementation. J Clin Epidemiol (2011) 64(9):936–48. doi:10.1016/j.jclinepi.2010.12.003

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: patient information, shared decision-making, congenital heart disease, patient education tools, patient information portal, multidisciplinary approach, International Patient Decision Aid Standards development process, Delphi technique

Citation: Etnel JRG, van Dijk APJ, Kluin J, Bertels RA, Utens EMWJ, van Galen E, Bogers AJJC and Takkenberg JJM (2017) Development of an Online, Evidence-Based Patient Information Portal for Congenital Heart Disease: A Pilot Study. Front. Cardiovasc. Med. 4:25. doi: 10.3389/fcvm.2017.00025

Received: 22 December 2016; Accepted: 10 April 2017;
Published: 01 May 2017

Edited by:

Oswin Grollmuss, Université Paris-Sud, France

Reviewed by:

Roman A. Gebauer, Leipzig University, Germany
Ioannis Germanakis, University of Crete, Greece

Copyright: © 2017 Etnel, van Dijk, Kluin, Bertels, Utens, van Galen, Bogers and Takkenberg. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Johanna J. M. Takkenberg, ai5qLm0udGFra2VuYmVyZyYjeDAwMDQwO2VyYXNtdXNtYy5ubA==

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.