- 1Universidade Federal da Bahia, Faculdade de Medicina da Bahia, Salvador, Brazil
- 2Instituto Gonçalo Moniz, Fundação Oswaldo Cruz, Salvador, Bahia, Brazil
- 3Multinational Organization Network Sponsoring Translational and Epidemiological Research (MONSTER) Initiative, Salvador, Bahia, Brazil
- 4Universidade Salvador (UNIFACS), Faculdade de Medicina, Salvador, Bahia, Brazil
- 5Universidade Do Estado da Bahia (UNEB), Departamento de Ciências da Vida, Salvador, Bahia, Brazil
- 6Intensive Care Unit, Hospital de Cidade, Salvador, Bahia, Brazil
- 7Division of Infectious Diseases and Pulmonary Critical Care and Sleep Medicine, Department of Medicine, University of California, San Diego, San Diego, CA, United States
- 8Escola Bahiana de Medicina e Saúde Pública (EBMSP), Salvador, Bahia, Brazil
Introduction: Unrecognized pain in the Intensive Care Unit (ICU), due to inadequate assessment and therapeutic management, is associated with increased morbidity and mortality. Despite the availability of validated pain monitoring tools, such as the Critical-Care Pain Observational Tool (CPOT), these scales are not commonly used in clinical practice, with healthcare professionals often relying on their clinical impression. Our study aims to determine the agreement between the pain examination performed by ICU professionals and the CPOT.
Methods: Prospective cohort study that included critically ill patients and physicians, nurses and physiotherapists from an ICU in Bahia, Brazil. During bedside clinical rounds, the CPOT score was applied to assess the pain of hospitalized patients, and health professionals were interviewed to ascertain their perception of the patient's pain for a maximum of five consecutive days. Correlations were assessed using the Spearman rank tests. Hierarchical cluster analysis was employed to show the results of CPOT score and pain assessment by healthcare professionals at each study time. And the Kappa statistic was calculated to assess the agreement between the CPOT score vs. the pain assessment by healthcare providers.
Results: One hundred one patients were included in the study with median age of 74 years (IQR 61.5–83.5), a predominance of women (55.4%) and a median SAPS 3 score of 45 (IQR 39.5–53.0). The correlation between the professional's pain assessment and the CPOT were mostly statistically significant, ranged from negligible to weak, being the highest index obtained in the evaluation of nurses on day 5 (Kappa index = 0.43, p = 0.005). Physician assessments were significant only in day 1. On the presence of pain, the professionals' assessments and CPOT revealed mild to a moderate agreement.
Conclusion: Healthcare professional's pain assessment displayed a weak positive correlation with a validated pain scale and poor agreement amongst members of the ICU team, particularly when the pain was felt to be absent. Thus, this study highlights the importance of routine tools for pain assessment in the ICU for all members of multidisciplinary teams.
Introduction
Pain is perhaps the most stressful event that patients experience during their stay in the intensive care unit (ICU). It is associated with an acute response to stress, characterized by changes in heart and respiratory rate, blood pressure and neuroendocrine secretion (1, 2). Appropriate assessment and treatment of pain in the ICU is critical, as it is associated with a better clinical outcomes (3). On the other hand, inadequate pain control significantly favors the post-intensive care syndrome, particularly related to common painful procedures, such as arterial line insertion or airway suctioning (4, 5).
While prior studies have highlighted the importance of pain in the ICU, many factors hinder caregiver's ability to communicate effectively with patients, including the use of sedative agents, mechanical ventilation, and changes in sensorium (6). In the absence of the patient's communication, observable behavioral and physiologic indicators become important proxies for pain assessment. Despite this, health professionals often rely on imprecise bedside assessments leading to excessive or insufficient sedation and analgesia (7).
Given the severity of life-threatening conditions in the critically ill, prompt recognition and management of pain may be overlooked. While there are validated and recommended pain assessment scales such as the Critical-Care Pain Observational Tool (CPOT) for critically ill patients, prior work demonstrates that these are rarely used routinely in the ICU (8). Recent studies indicate that the use of these scales improves care and therapeutic interventions in ICUs through the introduction of effective pain management protocols, reduction in the use of sedatives and reduced time of mechanical ventilation, thus benefiting the quality of care in these patients.
This study aims to assess the concordance between pain assessment performed by ICU professionals and a validated pain assessment scale in critically ill patients.
Materials and methods
Ethics approval
This research was approved by the Research Ethics Committee of the Federal University of Bahia under the number 2.249.687 and CAAE 73835317.5.0000.5577. And was conducted in compliance with the Helsinki declaration.
Design, site, and sample
Prospective observational and analytical cohort study conducted from September to October 2017 in a tertiary ICU in Salvador, Bahia, Brazil. All patients ≥18 years old, consecutively admitted to the ICU, who provided informed consent, were included in the study. The multidisciplinary team included 13 physicians, 18 nurses, and 16 physiotherapists who also provided informed consent. Patients with a stay of fewer than 24 h, conditions that compromised the expression of pain behaviors, such as decortication or decerebration, and use of neuromuscular blockers, were excluded.
Procedures
The demographic characteristics, clinical and laboratory data were obtained from the electronic medical records of the patients. These included: age, primary ICU admission diagnosis, comorbidities, vital signs, level of consciousness through the Glasgow Coma Scale (GCS) and the Richmond Agitation Sedation Scale (RASS) score, arterial blood gas test, hemogram, serum creatinine, total serum bilirubin, use of vasoactive drugs, analgesics, sedatives, or drugs with the potential to interfere in the patient's perception of pain, such as anxiolytics and anti-depressants. The total number and type of painful procedures performed were recorded every 24 h, including orotracheal suctioning, arterial puncture, wound care, thoracocentesis, and chest tube removal.
All researchers received the same rigorous training to properly apply the CPOT, in which each one applied the score to hospitalized patients and compared the responses to ensure that there was inter-observer agreement in order to reduce measurement bias. The behavioral parameters of CPOT included facial expression, body movements, body tension and ventilator compliance in intubated patients or vocalization in patients with spontaneous breathing. Each behavior was rated from 0 to 2, resulting in a possible total score ranging from 0 to 8, where >2 points represents the presence of pain (1). A CPOT SCORE of 3 or more was considered an unacceptable pain level, that is, pain that the healthcare team should consider additional or alternative analgesia and sedation.
In the studied ICU, daily clinical rounds are performed at the patient's bedside with the physician, physiotherapist and nurse responsible for the patient. Immediately before the visit, the researchers applied the CPOT to the patient. The study team also noted the presence or absence of tracheostomy, mechanical ventilation and ventilatory support. Then, after each patient visit, healthcare professionals were interviewed individually, being asked whether the patient was in pain and, if so, to rate the pain intensity from 0 to 10. There was no communication among the professionals regarding their pain evaluation. Patients and healthcare providers underwent daily evaluations by for up to 5 days.
Statistical analyses
Categorical data were presented as proportions and continuous data as medians and interquartile ranges (IQR). Correlations were assessed using the Spearman rank tests. Hierarchical cluster analysis (Ward's method) was employed to show the results of CPOT score and pain assessment by nurses, physicians and physiotherapists at each study time. A p < 0.05 was considered statistically significant. Statistical analyses were performed using SPSS 24.0 (IBM statistics), Graphpad Prism 7.0 (GraphPad Software, San Diego, CA) and JMP 12.0 (SAS, Cary, NC, USA). Finally, the Kappa (K) statistic was calculated to assess the agreement between the presence of an unacceptable amount pain according to CPOT score vs. the pain assessment by nurses, physicians, and physiotherapists at each study time. The Kappa statistic was interpreted by Landis and Koch criteria. Bland-Altman analyses were conducted to provide a visual representation of the concordance between the methods.
Results
There were 111 admissions over the study period and 10 exclusions (5 had a length of stay of <24 h, two discharged on the day of study start, two for conditions that compromised the expression of pain behaviors, and 1 for absence of a member of the multidisciplinary team during the collection period). Patients were followed up for a maximum of five consecutive days, with 336 pain assessments being performed (CPOT and the interview of professionals) (Figure 1). The median age was 74 years (IQR 61.5–83.5) with a predominance of women 56 (55.4%) and the median length of stay in the ICU and in the hospital was 4 days (2.0–8.0) and 7 days (4.0–17.50), respectively. The median SAPS 3 score was 45 (39.5–53.0). There were 17 (16.8%) hospital deaths, of which 14 (13.9%) occurred in the ICU. Ninety (89.1%) of the patients included in the study were functionally independent, whereas 3 (3%) required assistance and 8 (7.9%) were restricted/bedridden at the time of admission. Table 1 highlights additional demographic characteristics of the patients.
Figure 1. Flowchart of the study. (A) Distribution of healthcare professionals and (B) patient enrollment.
During the 5 days of evaluation, 7 patients (6.9%) required mechanical ventilation on day 1, 5 (6.1%) on day 2, 5 (7.8%) on day 3, 4 (8.5%) on day 4, and 4 (10.3%) on day 5. Analgesic use varied throughout hospitalization with 37 (36.6%) on the first day of evaluation, which increased until the third day of hospitalization. Opiate use on day 1 included 19 (18.8%) patients, though this similarly increased until the third day of evaluation. Sedatives were used in a minority of patients, the greatest use being on day 2 with 6 (7.3%) patients. The median RASS ranged from −1 to 0 on most study days. Arterial puncture was the most frequent procedure in patients (29.7, 24.4, 20.3, 17, 15.4%, on days 1, 2, 3, 4, and 5, respectively). In contrast, wound debridement was the least performed procedure (0, 1.2, 0, 2.1, 0, on days 1, 2, 3, 4, and 5, respectively). These findings are detailed in Table 2.
Multidisciplinary team members included 13 (27.7%) physicians, 18 (38.3%) nurses, and 16 (34%) respiratory therapists. Professionals' pain assessments correlated insignificantly with CPOT, ranging from negligible (14% of the evaluations) to weak (86% of the evaluations). Physician evaluations demonstrated poor correlation with CPOT, only achieving significant correlation on day 1 (r = 0.34, p < 0.001). Physiotherapists' evaluations suffered less daily variation of correlation with CPOT compared with nurses and physicians, though similarly did not reach statistical significance (Table 3). There is a high range in Bland-Altman analysis with a regression line with a negative trend (Supplementary Figure 1).
In the presence of pain, the overall agreement between professionals' assessments and CPOT was greater on the first day (Kappa Index = 0.36, 95% CI: 0.28–0.43; p < 0.001). The proportion of agreement in the presence or absence of pain varied daily between 67.1 and 76.9%, with the lowest kappa index of agreement observed in the evaluation of physicians on day 3 (Kappa Index = 0.13, p = 0.18) and the highest index obtained in the evaluation of nurses on day 5 (Kappa index = 0.43, p = 0.005).
There was a slight agreement among professionals in the first 2 days of evaluations (Day 1 Kappa index = 0.2, 95% CI: 0.14–0.26, p < 0.001; Day 2 Kappa index = 0.12, 95% CI: 0.06–0.19, p < 0.001; Figure 2). Moreover, there was a predominance of concordance in the evaluation of the absence of pain, but a wide variability in the evaluations when the pain is present.
Figure 2. Pain assessment profile by nurses, physicians and physiotherapists and results of CPOT score in ICU patients stratified by analgesics treatment and medical procedures. The kappa coefficient of agreement between the CPOT score and pain assessment by nurses, physicians, and physiotherapists on day 1 (A), day 2 (B), day 3 (C), day 4 (D), and day 5 (E). Statistically significant agreements are highlighted in orange. CPOT, Critical care pain observation tool; VAS, Visual analog scale for pain.
Discussion
The ICU may represent a threatening environment, with unfamiliar monitoring equipment, loss of day-night cycle orientation and invasive, often painful, procedures that are now recognized as contributing factors to the development of post-ICU syndrome in survivors (9, 10). Several studies address the importance of adequate recognition of pain, as it is critical to provide appropriate sedation and analgesia to mitigate psychological and physical complications. Pain may lead to deleterious physiologic effects including sympathetic hyperactivity with subsequent increased heart rate and myocardium oxygen consumption, increased respiratory rate and hypoxemia, altered gastrointestinal motility and urinary tract function, changes in blood viscosity, coagulation and platelet aggregation, as well as decreased immune function and wound healing (11). In contrast, excessive sedation may increase the risk of venous thrombosis, prolonged mechanical ventilation and hospital-acquired infections, decreased bowel mobility, hypotension, and reduced tissue oxygen extraction capacity, leading to prolonged ICU length of stay (12, 13). Despite having a broad understanding of the consequences of inadequate pain control, the PAINT study demonstrated that pain recording appears to be of low priority by doctors (7). Our study reinforces the multidisciplinary approach to the theme, considering that nurses and physiotherapists have their methods of pain relief, in addition to pharmacological therapy, and the joint action of the health team provides complete and optimized care (14).
In Europe, a multi-center study that sought to characterize the severity and determinants of pain, the most painful procedure was the removal of a chest tube, occurring at a rate of 6.1% of the total procedures, similar to that registered in this study (1). In a prospective cohort of 1,318 patients in 44 French ICUs, 90% of patients used opioids and sedatives on the first day of hospitalization, a much higher prevalence than that found in our study (15).
Both the CPOT and the professionals' evaluations showed a low average level of pain. Despite this, only a weakly positive correlation was found between subjective pain assessments and CPOT, highlighting that, even with minimal pain, members of a multidisciplinary team performed poorly in individual pain assessments. Surprisingly, although nurses had much more contact with patients at the bedside, this did not translate into better agreement with CPOT in pain assessments. These findings contrast with the original CPOT study that found a positive, moderate correlation between self-report of pain intensity and CPOT scores, while patients underwent an experimental pain procedure, suggesting that the higher the level of pain, the higher the CPOT score. Furthermore, a validation study of CPOT demonstrated high sensitivity (86.1%) of the CPOT scale in pain detection. The poor correlation and agreement between CPOT pain assessments and the multidisciplinary team found in our study suggest that subjective pain assessment performed by health professionals is inadequate to identify the existence of pain in ICU patients, especially in those unable to report their pain. The results of our study reinforce recommendations that a validated behavioral scale should be used as an alternative to detect pain and evaluate its intensity (16–18).
Our study found that physicians, nurses, and physiotherapists pain assessments demonstrated slightly positive agreement on days 1 and 2. In addition, subjective pain assessments by health professionals were in most agreement when no pain was noted, whereas pain assessments >0 demonstrated wide variability for the same patient at the same time. The lack of at least a moderate agreement in subjective pain evaluation by physicians, nurses, and respiratory therapists suggests the absence of a common standard in the assessment of pain performed by these professionals. Therefore, the establishment of a systematic pain assessment protocol throughout the stay in the ICU may have a beneficial effect, reducing the consequences of inadequate pain management.
Our study has several limitations including a small sample in a single center and the non-individualization of pain assessments by professionals. This is balanced with the ability to evaluate multiple members of a multidisciplinary team during the study period in a more granular way with the results that complement previous studies. A few patients in our study underwent mechanical ventilation combined with rare use of sedatives, leading to limited comparisons between subjective assessments and CPOT in sedated and intubated critically ill patients. While this patient population differs from prior studies, it nonetheless demonstrated similar limitations of subjective pain assessments when compared to CPOT, even in non-intubated and minimally sedated patient populations. The gold standard for assessing the presence of unacceptable levels of pain is still self-reported pain by the patient. The CPOT was developed from retrospective chart reviews and physiological parameters were excluded in the initial assessment. In addition, the application of the tool in specific situations, such as patients with delirium, requires further evidence (19).
Conclusion
This study identified no significant positive agreement between CPOT and bedside pain assessments by physicians, nurses and physiotherapists. The lack of agreement between interprofessional assessments in the presence of pain highlights the urgent need to properly address pain systematically in critically ill patients.
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics statement
The studies involving human participants were reviewed and approved by Research Ethics Committee of the Federal University of Bahia under the number 2.249.687 and CAAE 73835317.5.0000.5577. The patients/participants provided their written informed consent to participate in this study.
Author contributions
KA, NF, and BA were responsible for study design, implementation, manuscript preparation, and had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. RS, RM, IF, TC, VS, MO, AG, and SA contributed substantially to the study design, data analysis and interpretation, and writing and review of the manuscript. KA and MA were responsible for advanced statistical analysis, figure generation, and manuscript review and preparation. All authors contributed to the article and approved the submitted version.
Funding
This study was supported in part by the intramural research program of FIOCRUZ. The work of BA was supported by a grant from NIH. IF was supported by UNEB: PICIN/UNEB. KF received a fellowship from the Programa Nacional de Pós-Doutorado, The work of BA was supported by grants from NIH (U01AI115940 and U01AI069923). BA was a senior scientist from the Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq), Brazil. TC received a fellowship from Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (Finance code: 001). Fogarty International Center and National Institute of Child Health & Human Development of the National Institutes of Health under (Award Number D43 TW009763 through a research scholarship awarded to MA) and by the NIH (U01AI069923). MA received a research fellowship from the Fundação de Amparo à Pesquisa do Estado da Bahia (FAPESB), Brazil.
Acknowledgments
The authors thank the health workers and the patients that made this study possible.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpain.2022.960216/full#supplementary-material
References
1. Puntillo KA, Max A, Timsit JF, Vignoud L, Chanques G, Robleda G, et al. Determinants of procedural pain intensity in the intensive care unit: the Europain® registered study. Am J Respir Crit Care Med. (2014) 189:39–47. doi: 10.1164/rccm.201306-1174OC
2. Chanques G, Sebbane M, Barbotte E, Viel E, Eledjam J-J, Jaber S. A prospective study of pain at rest: incidence and characteristics of an unrecognized symptom in surgical and trauma versus medical intensive care unit patients. Anesthesiology. (2007) 107:858–60. doi: 10.1097/01.anes.0000287211.98642.51
3. Georgiou E, Hadjibalassi M, Lambrinou E, Andreou P, Papathanassoglou EDE. The impact of pain assessment on critically ill patients' outcomes: a systematic review. BioMed Res Int. (2015) 2015:503830. doi: 10.1155/2015/503830
4. Puntillo KA, Naidu R. Chronic pain disorders after critical illness and ICU-acquired opioid dependence: two clinical conundra. Curr Opin Crit Care. (2016) 22:506–12. doi: 10.1097/MCC.0000000000000343
5. Devine H, Quasim T, McPeake J, Shaw M, McCallum L, Mactavish P. Chronic pain in intensive care unit survivors: incidence, characteristics and side-effects up to one-year post-discharge. J Rehabil Med. (2019) 51:451–5. doi: 10.2340/16501977-2558
6. Puntillo K, Pasero C, Li D, Mularski RA, Grap MJ, Erstad BL, et al. Evaluation of pain in ICU patients. Chest. (2009) 135:1069–74. doi: 10.1378/chest.08-2369
7. Kemp HI, Bantel C, Gordon F, Brett SJ, Plan Search, et al. Pain assessment in INTensive care (PAINT): an observational study of physician-documented pain assessment in 45 intensive care units in the United Kingdom. Anaesthesia. (2017) 72:737–48. doi: 10.1111/anae.13786
8. Mascarenhas M, Beattie M, Roxburgh M, MacKintosh J, Clarke N, Srivastava D. Using the model for improvement to implement the critical-care pain observation tool in an adult intensive care unit. BMJ Open Qual. (2018) 7:e000304. doi: 10.1136/bmjoq-2017-000304
9. Rawal G, Yadav S, Kumar R. Post-intensive care syndrome: an overview. J Transl Int Med. (2017) 5:90–2. doi: 10.1515/jtim-2016-0016
10. Puntillo KA, Max A, Chaize M, Chanques G, Azoulay E. Patient recollection of ICU procedural pain and post ICU burden: the memory study. Crit Care Med. (2016) 44:1988–95. doi: 10.1097/CCM.0000000000001875
11. Middleton C. Understanding the physiological effects of unrelieved pain. Nurs Times. (2003) 99:28–31.
12. Shehabi Y, Chan L, Kadiman S, Alias A, Ismail WN, Tan MATI, et al. Sedation depth and long-term mortality in mechanically ventilated critically ill adults: a prospective longitudinal multicentre cohort study. Intensive Care Med. (2013) 39:910–8. doi: 10.1007/s00134-013-2830-2
13. Shehabi Y, Bellomo R, Reade MC, Bailey M, Bass F, Howe B, et al. Early intensive care sedation predicts long-term mortality in ventilated critically ill patients. Am J Respir Crit Care Med. (2012) 186:724–31. doi: 10.1164/rccm.201203-0522OC
14. Silva CCS, Vasconcelos J de MB, Nóbrega MML. Dor Em Pacientes Críticos Sob a Ótica De Enfermeiros Intensivistas : Avaliação E Intervenções Pain in Critical Patients From the Perspective of Intensive Care Nurses: Dolor En Pacientes CrBajo La Perspectiva De Enfermeras Intensivistas. (2011) 12:540–7.
15. Payen J-F, Chanques Gr, Mantz J, Hercule C, Auriant I, Leguillou J-L, et al. Current practices in sedation and analgesia for mechanically ventilated critically ill patients. Anesthesiology. (2007) 106:687–95. doi: 10.1097/01.anes.0000264747.09017.da
16. Tousignant-Laflamme Y, Bourgault P, Glinas C, Marchand S. Assessing pain behaviors in healthy subjects using the critical-care pain observation tool (CPOT): a pilot study. J Pain. (2010) 11:983–7. doi: 10.1016/j.jpain.2010.01.266
17. Glinas C, Johnston C. Pain assessment in the critically ill ventilated adult: validation of the critical-care pain observation tool and physiologic indicators. Clin J Pain. (2007) 23:497–505. doi: 10.1097/AJP.0b013e31806a23fb
18. Devlin JW, Skrobik Y, Glinas C, Needham DM, Slooter AJC, Pandharipande PP, et al. Clinical practice guidelines for the prevention and management of pain, agitation/sedation, delirium, immobility, and sleep disruption in adult patients in the ICU. Crit Care Med. (2018) 46:e825–73. doi: 10.1097/CCM.0000000000003299
Keywords: pain, critical care, pain management, Critical-Care Pain Observation Tool, pain examination
Citation: Menezes RC, Silva RLO, Arriaga MB, Ferreira IBB, Carmo TA, da Silva VR, Otero ML, Gobatto ALN, Agareno S, Filgueiras Filho NM, Akrami KM and Andrade BB (2022) A prospective comparison between multidisciplinary healthcare providers' clinical examination and a validated pain scale. Front. Pain Res. 3:960216. doi: 10.3389/fpain.2022.960216
Received: 02 June 2022; Accepted: 26 July 2022;
Published: 12 August 2022.
Edited by:
Caroline Hartley, University of Oxford, United KingdomReviewed by:
Emma Fisher, University of Bath, United KingdomPaul Michael Szumita, Brigham and Women's Hospital and Harvard Medical School, United States
Copyright © 2022 Menezes, Silva, Arriaga, Ferreira, Carmo, da Silva, Otero, Gobatto, Agareno, Filgueiras Filho, Akrami and Andrade. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Bruno B. Andrade, bruno.andrade@fiocruz.com.br
†These authors have contributed equally to this work
‡These authors have contributed equally to this work and share senior authorship