Lara Counts1*
Jocelyn Rivera2Parima Wiphatphumiprates3
Maria Puerto-Torres4
Kim Prewitt1
Douglas A. Luke1
Dylan E. Graetz4
Sara Malone1
Asya Agulnik4- 1Brown School, Washington University in St. Louis, St. Louis, MO, United States
- 2Department of Pediatrics, Hospital Infantil Teletón de Oncología (HITO), Querétaro, Mexico
- 3Rhodes College, Memphis, TN, United States
- 4Global Pediatric Medicine, Critical Care, St. Jude Children’s Research Hospital, Memphis, TN, United States
Communication failures among clinicians in the ICU (intensive care unit) often lead to worse patient outcomes. CritCom is a bilingual (English and Spanish) tool to evaluate the quality of interdisciplinary communication around patient deterioration for pediatric oncology patients. The use of reports, such as the CritCom report, as dissemination methods lead to quicker knowledge translation and implementation of research findings into policy. Nurses and physicians at participating centers who care for patients at risk of deterioration completed the CritCom survey and center-specific reports were generated to communicate CritCom results. Focus groups were conducted with clinicians receiving CritCom reports in both English and Spanish to evaluate report clarity and usability. Participants found the reports to be useful and described the writing and design as clear and specific. Participants provided feedback to improve report design and requested actionable steps to improve communication at their center. Feedback illustrated that the report was easy to interpret and a useful way to disseminate information. Participants noted the utility of the report, illustrating that the use of reports can be a useful method to disseminate research findings back to participants in a way that is applicable to the local context. Communicating research findings through reports can minimize the significant time lag in knowledge translation and provide participants with actionable steps to implement in their setting.
1 Introduction
Outcomes for critically ill patients improve when clinicians work together and communicate effectively as a team (1–3). Communication between clinicians is particularly important in the care of children with cancer, who are at higher risk of deterioration and subsequent mortality (2, 3). High-quality interdisciplinary communication has been linked to earlier recognition of adverse events and decreased mortality (4). Communication failures, however, often impact clinicians understanding of patient care plans (4), resulting in worse patient outcomes by delaying treatment and causing injury (5). Thus, enhancing interprofessional communication is important to improve patient outcomes and quality of care delivery (4, 6).
Barriers to teamwork and communication between clinicians include feeling disempowered to speak up, issues with hierarchy, and negative interpersonal communication (7). Few studies have addressed the quality of team communication, especially in resource-diverse settings. The CritCom tool, developed to fill this gap, is a new reliable and valid bilingual survey to assess the quality of interdisciplinary communication around patient deterioration for pediatric oncology patients (8). CritCom is an anonymous electronic provider survey that evaluates communication between clinicians across six domains: actionable, clarity, tone, collaboration and teamwork, leadership, and empowerment. CritCom was initially piloted at 42 hospitals in 22 countries among clinicians who care for children with cancer at risk of deterioration (9). For centers with three or more participants, a center-specific report was created to summarize responses and communicate results. This study explains the development of the report, which includes the initial drafting, review using focus groups, and revision of the report. This study also evaluated the clarity and usability of the CritCom center reports.
Recently, emphasis has been placed on creating dissemination efforts that are adaptable to local contexts, engaging stakeholders and encouraging continuing collaboration between researchers and participants (10). The use of reports can aid in quicker knowledge translation, closing the significant gap between research and practice (11). Further, reports must be developed in a clear manner, tailored to the stakeholder with clear and actionable messages (12). If research findings are not disseminated, then the research efforts themselves are largely considered a waste of effort and resources (13).
Timely report development, publication, and dissemination are important to quickly inform survey participants and hospital administration of the strengths and weaknesses of communication at their center, which can ultimately be used to implement policy focused on interprofessional communication in critical care settings, improving patient outcomes.
2 Methods
2.1 Report development
For centers with three or more participants, a report summarizing all staff responses was generated (see Figure 1) in English or Spanish based on prior experience with center-level reports of staff assessments (14). The report described performance in each domain (average and range), the overall communication score (average of all domains), list of strengths and opportunities (highest and lowest scoring items), detailed performance in each survey item, and suggestions for next steps. This report was modeled after another report created and used by this team for a prior study (15). A first draft of the CritCom report was drafted by the study team and reviewed by all study team members. The CritCom report was distributed to all participants at each center.
Figure 1 CRITCOM report.
2.2 Report assessment
The CritCom report was assessed via focus groups consisting of participants from various centers. Participants were recruited among all individuals who completed the survey and received a hospital-based report. Focus groups were organized by participant profession (nurse vs. physician) and language (English vs. Spanish), with a total of four focus groups. The focus groups were structured using a facilitator guide to evaluate participant understanding about their center-specific report, as well as communication in their hospitals (see Additional File 1). The guide was initially developed in English based on prior work (14). A pilot focus group was conducted with five participants from St. Jude representative of the target audience. The guide was then revised based on feedback and translated to Spanish by bilingual team members (JR and MPT).
Focus groups were held via the web-conferencing platform Zoom. Participants were encouraged to participate with their video and engage as during an in-person discussion. Two individuals (PW and LC) who were not involved in CritCom report development facilitated the English focus groups. Bilingual members of the team (JR and MPT) facilitated the Spanish focus groups. Focus groups were audio-recorded, then were translated and transcribed by a professional service. Transcripts were deidentified and uploaded into MAXQDA for thematic analysis (16, maxqda.com). A codebook was developed from previous work and iteratively revised through review of two transcripts (see Additional File 1) (17). Two investigators (PW and LC) coded all transcripts with discrepancies resolved by two adjudicators (AA and SM). Thematic content analysis focused on participant experiences with communication and CritCom report feedback. The development and assessment process is depicted in Figure 2.
Figure 2 Report development and assessment process.
3 Results
Focus groups consisted of 11 English-speaking participants from five countries and 12 Spanish-speaking participants from four countries; these were 57% physicians and 43% nurses with a primary work area in the ward (65%) and intensive care unit (ICU) (35%). Identified themes included experiences with communication in their setting, report interpretation, and recommendations for improvement (Table 1).
Table 1 Focus group feedback.
Participants noted multiple examples of poor communication in their clinical settings: “Maybe with nurse and physicians is better, but don’t think the multidisciplinary team we don’t have the same language for everyone.” They also reported instances of good communication: “how we communicate with other people not only because it is a doctor, a nurse, or staff member. We have to go all on the side of good communication for us to have the results … well positive to be able to assist the patient.” Poor and good communication were noted to impact patient care: “Well, I consider that if we take a long time to report on the patient’s status, we also lengthen the patient’s treatment time.”
Overall, participants found the CritCom report to be clear, specific, and helpful to the strengths and weaknesses of communication between clinicians at their center. “It’s very well designed and the information is adequate, concrete and at the same time extensive within two to three pages with a lot of graphics.” Participants described the report scores and graphs easy to interpret. “We just have to improve in the few points that we failed and not drop points in those where we did well.” Participants also recognized the utility of the report to develop strategies to enhance communication within and between units: “What we must work on and where we can continue to apply the knowledge that we already have but only reinforce them and have greater empowerment which is where we scored the lowest.”
Additionally, participants offered several recommendations to improve the report, such as providing more information about participant demographics. Many also noted a need to include actionable steps: “It would also be good to add a box with recommendations from their experience that they elaborated this survey to improve that communication in at least the areas where the scores were the lowest.”
4 Discussion
This study describes the evaluation of the CritCom report to promote understanding of study findings by centers participating in the CritCom assessment. Our findings demonstrate that participants found the report to be clear, usable, and useful to visualize and understand their results.
The time lag between research and implementing findings into practice is too long (10, 18). Further, the percentage of research results that are implemented into practice is low, at approximately 14% (13, 18). Dissemination of information is necessary to adopt research findings into clinical practice (13).
Adapting research findings through the creation of reports is helpful to minimize this time lag by quickly transferring information from the researchers back to the clinical setting. Clear, easy to read, and descriptive reports describing communication can help hospital administration and unit leaders pinpoint areas of strength and weakness that can be targeted for intervention. Feedback from this report illustrates that participants could use the report to take actionable steps to improve communication at their hospital.
Studies have found that simply publishing research findings is often ineffective in actually changing practice, and thus the gap remains between research and practice (11). Targeted dissemination efforts, such as the CritCom report, are useful methods of translating information back into the hands of clinicians.
This work represents an example of how research findings can be made available to participants to promote local quality improvement and actionable change. Clinicians, researchers, and administrators can utilize the CritCom report to interpret CritCom results and improve interdisciplinary communication and, subsequently, patient outcomes. For example, the report can inform center-specific trainings or other strategies to improve the areas of communication that scored low. Providing clear and contextually appropriate reports of research findings allows participants to use study results to advocate to their hospital administration for local change.
This study has several limitations. Only nurses and physicians were invited to participate; members of the interprofessional team (respiratory therapists, etc.) were not included, as these roles did not exist at all centers. Additionally, this study was limited to English- and Spanish-speaking participants. This limits the generalizability of our findings regarding CritCom report usability to other professions and languages; future work should include these groups.
In summary, participant feedback illustrates that the CritCom report successfully provided clear and relevant findings regarding communication quality at each center. Using dissemination methods such as a summary report is useful to provide participants timely and actionable research data to inform strategies to improve team communication in their setting.
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics statement
Ethical review and approval were waived for this study due to determination of non-human subjects research as defined by the Common Rule at 45 CFR 46.102(I) and the Office for Human Research Protections (OHRP). It is under an exempt IRB from St. Jude Children’s Research Hospital. The written informed consent was waived by IRB from St. Jude Children’s Research Hospital.
Author contributions
LC: Writing – review & editing, Writing – original draft, Formal analysis, Data curation. JR: Writing – review & editing, Methodology, Funding acquisition, Data curation, Conceptualization. PW: Writing – review & editing, Formal analysis, Data curation. MP: Writing – review & editing, Project administration, Formal analysis, Data curation. KP: Writing – review & editing, Project administration, Conceptualization. DL: Writing – review & editing, Funding acquisition, Conceptualization. DG: Writing – review & editing, Methodology, Conceptualization. SM: Writing – review & editing, Supervision, Methodology, Funding acquisition, Conceptualization. AA: Writing – review & editing, Resources, Methodology, Investigation, Funding acquisition, Conceptualization.
Funding
The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This project was supported in part by the St. Jude Washington University in St. Louis joint implementation sciences collaboration, the National Cancer Institute (P50CA244431), and the American Lebanese Syrian Associated Charities (ALSAC/St. Jude Children’s Research Hospital).
Acknowledgments
We would like to acknowledge the help of everyone who completed the CritCom survey and participated in the focus groups.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
The author(s) declared that they were an editorial board member of Frontiers, at the time of submission. This had no impact on the peer review process and the final decision.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Author disclaimer
The findings and conclusions in this paper are those of the authors and do not necessarily represent the official positions of the National Institutes of Health.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fonc.2024.1384597/full#supplementary-material
References
1. Kim MM, Barnato AE, Angus DC, Fleisher LA, Kahn JM. The effect of multidisciplinary care teams on intensive care unit mortality. Arch Internal Med. (2010) 170:369–76. doi: 10.1001/ARCHINTERNMED.2009.521
2. Agulnik A, Cárdenas A, Carrillo AK, Bulsara P, Garza M, Alfonso Carreras Y, et al. Clinical and Organizational Risk Factors for Mortality during Deterioration Events among Pediatric Oncology Patients in Latin America: A Multicenter Prospective Cohort. Cancer. (2021) 127:1668–78. doi: 10.1002/cncr.33411
3. Agulnik A, Mahadeo KM, Steiner ME, McArthur JA. Editorial: critical complications in pediatric oncology and hematopoietic cell transplant – how far we have come and how much further we must go. Front Oncol. (2023) 13. doi: 10.3389/fonc.2023.1148321
4. O'Brien A, O'Reilly K, Dechen T, Demosthenes N, Kelly V, Mackinson L, et al. Redesigning rounds in the ICU: standardizing key elements improves interdisciplinary communication. Joint Commission J Qual Patient Saf. (2018) 44:590–98. doi: 10.1016/J.JCJQ.2018.01.006
5. Foronda C, MacWilliams B, McArthur E. Interprofessional communication in healthcare: an integrative review. Nurse Educ Pract. (2016) 19:36–40. doi: 10.1016/J.NEPR.2016.04.005
6. Graetz DE, Chen Y, Devidas M, Antillon-Klussmann F, Fu L, Quintero K, et al. Interdisciplinary care of pediatric oncology patients: A survey of clinicians in Central America and the caribbean. Pediatr Blood Cancer. (2023) 127:e30244. doi: 10.1002/PBC.30244
7. Thomas EJ, Sexton JB, Helmreich RL. Discrepant Attitudes about Teamwork among Critical Care Nurses and Physicians. Crit Care Med. (2003) 31:956–59. doi: 10.1097/01.CCM.0000056183.89175.76
8. Malone S, Rivera J, Puerto-Torres M, Prewitt K, Counts L, Wiphatphumiprates P, et al. (2022). “Measurement translation and linguistic validity: A case example in multiprofessional communication”. in: 15th Annual Conference on the Science of Dissemination and Implementation. Washington, DC.
9. Rivera J, Malone S, Puerto Torres M, Prewitt K, Sakaan F, Al Zebin Z, et al. PP154 [Quality and safety» Safety]: Development of a quantitative measure (CRITCOM) to assess the quality of interdisciplinary communication around patient deterioration in variably resourced hospitals. Pediatr Crit Care Med. (2022) 23. doi: 10.1097/01.pcc.0000900508.37832.25
10. Schlechter CR, Del Fiol G, Lam CY, Fernandez ME, Greene T, Yack M, et al. Application of community – engaged dissemination and implementation science to improve health equity. Prev Med Rep. (2021) 24. doi: 10.1016/j.pmedr.2021.101620
11. Edwards D. Dissemination of research results: on the path to practice change. CJHP. (2015) 68:465–9. doi: 10.4212/cjhp.v68i6.1503
12. Gagnon ML. Moving knowledge to action through dissemination and exchange. J Clin Epidemiol. (2011) 64:25–31. doi: 10.1016/j.jclinepi.2009.08.013
13. Derman RJ, Jaeger FJ. Overcoming challenges to dissemination and implementation of research findings in under-resourced countries. Reprod Health. (2018) 15:121–6. doi: 10.1186/s12978-018-0538-z
14. Agulnik A, Gonzalez Ruiz A, Muniz-Talavera H, Carrillo AK, Cárdenas A, Puerto-Torres MF, et al. Model for regional collaboration: successful strategy to implement a pediatric early warning system in 36 pediatric oncology centers in Latin America. Cancer. (2022) 128:4004–16. doi: 10.1002/cncr.34427
15. Center for Public Health Systems Science, Washington University in St. Louis. CSAT – PSAT/CSAT . Available online at: https://www.sustaintool.org/csat/ (Accessed May 13, 2024).
16. VERBI Software, MAXQDA 2022. Software. (2021). Available online at: maxqda.com.
17. Agulnik A, Malone S, Puerto-Torres M, Gonzalez-Ruiz A, Vedaraju Y, Wang H, et al. Reliability and validity of a spanish-language measure assessing clinical capacity to sustain paediatric early warning systems (PEWS) in resource-limited hospitals. BMJ Open. (2021) 11. doi: 10.1136/bmjopen-2021-053116
Keywords: report, interdisciplinary communication, deterioration, pediatric oncology, critical care
Citation: Counts L, Rivera J, Wiphatphumiprates P, Puerto-Torres M, Prewitt K, Luke DA, Graetz DE, Malone S and Agulnik A (2024) Assessment of the quality of interdisciplinary communication (CritCom): evaluation and refinement of a center summary report. Front. Oncol. 14:1384597. doi: 10.3389/fonc.2024.1384597
Received: 09 February 2024; Accepted: 27 May 2024;
Published: 11 June 2024.
Edited by:
Jaume Mora, Sant Joan de Déu Hospital, SpainReviewed by:
Milena Villarroel, Hospital Luis Calvo Mackenna, ChileFernando Rafael Aguirregomezcorta, Central University Hospital of Asturias, Spain
Copyright © 2024 Counts, Rivera, Wiphatphumiprates, Puerto-Torres, Prewitt, Luke, Graetz, Malone and Agulnik. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Lara Counts, bGFyYS5jb3VudHNAd3VzdGwuZWR1