Skip to main content

ORIGINAL RESEARCH article

Front. Public Health, 19 February 2024
Sec. Children and Health

Validation of French versions of the 15-item picker patient experience questionnaire for adults, teenagers, and children inpatients

\r\nClement P. Buclin,
Clement P. Buclin1,2*Adriana UribeAdriana Uribe1Justine E. Daverio,Justine E. Daverio1,3Arnaud IseliArnaud Iseli1Johan N. Siebert,Johan N. Siebert2,4Guy Haller,Guy Haller1,2Stphane Cullati,Stéphane Cullati1,5Delphine S. Courvoisier,
Delphine S. Courvoisier1,2*
  • 1Division of Quality of Care, University Hospitals of Geneva, Geneva, Switzerland
  • 2Department of Medicine, University of Geneva, Geneva, Switzerland
  • 3Department of Sociology, Geneva School of Social Sciences, University of Geneva, Geneva, Switzerland
  • 4Division of Paediatric Emergency Medicine, Department of Women, Child and Adolescent, University Hospitals of Geneva, Geneva, Switzerland
  • 5Population Health Laboratory (#PopHealthLab), Faculty of Science and Medicine, University of Fribourg, Fribourg, Switzerland

Objectives: No French validated concise scales are available for measuring the experience of inpatients in pediatrics. This study aims to adapt the adult PPE-15 to a pediatric population, and translating it in French, as well as to establish reference values for adults, teenagers, and parents of young children.

Methods: Cultural adaptation involved forward and backward translations, along with pretests in all three populations. Dimensional structure and internal consistency were assessed using principal component analysis, exploratory factor analysis, and Cronbach's alpha. Construct validity was assessed by examining established associations between patient satisfaction and inpatient variables, including length of stay, and preventable readmission.

Results: A total of 25,626 adults, 293 teenagers and 1,640 parents of young children completed the French questionnaires. Factor analysis supported a single dimension (Cronbach's alpha: adults: 0.85, teenagers: 0.82, parents: 0.80). Construct validity showed the expected pattern of association, with dissatisfaction correlating with patient- and stay-related factors, notably length of stay, and readmission.

Conclusion: The French versions of the PPE-15 for adults, teenagers and parents of pediatric patients stand as valid and reliable instruments for gauging patient satisfaction regarding their hospital stay after discharge.

Background

In recent years, there has been an increasing emphasis on patients' satisfaction, widely acknowledged as an indicator for quality of care improvement (13). This aims at enhancing the quality of care in hospitals (4). Higher satisfaction of patients with the care provided has demonstrated associations with improved adherence (5), continuity (6) and intercontinuity of care (7), reduced care utilization (8), as well as more efficient care (9). Furthermore, patients' experience measures are excellent tools to benchmark hospitals and guide the development of programs aimed at enhancing patient satisfaction (10). They also provide a rapid and low-cost feedback to clinicians on the care provided (11). In response to these findings, a growing number of countries have included satisfaction measurement into their quality improvement processes (12). In the UK for instance all National Health Service (NHS) centers are assessing patient experience since 2002 through the NHS Patient Survey Program (13). Switzerland introduced nationwide surveys in acute care hospitals in 2009 and in rehabilitation clinics from 2013 (10).

Most surveys in these countries and others are based on self-developed questionnaires that often differ between or even within hospitals and other healthcare organizations (1416). This has several pitfalls. One is the absence of homogeneity of measurement tools resulting in unreliable benchmarks between hospitals. Another is the additional complexity for quality improvement teams to implement programs that are homogeneous and easy to implement within institutions. Furthermore, those homegrown satisfaction surveys often contain many questions and longer surveys have been shown to decrease both precision and participation (17). Therefore, there is a need for standardized short tools that possess robust psychometric attributes, especially in terms of validity and reliability.

In the pursuit of standardizing and continuously enhancing the quality of care, numerous organizations have developed and validated questionnaires that target various aspects of patients' satisfaction with care, commonly referred to as Patient-Reported Experiences Measures. These questionnaires serve diverse purposes, with some explicitly evaluating patient satisfaction, such as the Patient Satisfaction Questionnaire-18 (PSQ-18) or the Press Ganey, while others, like the Hospital Consumer Assessment of Healthcare Providers and Systems (HCAPS) or the Picker Patient Experience Questionnaire, are more focused on patient experience (1821). Patient experience differs from patient satisfaction; the former extends beyond the assessment of care quality to encompass a broader evaluation of patients' interactions with the healthcare system (22).

Over the past two decades, the Picker Institute has engaged in producing satisfaction questionnaires for inpatients that have robust psychometric properties (23). In 2002, the Institute developed the ≪ Picker Patient Experience Questionnaire 15 ≫ (PPE-15), a short set of 15 items validated for assessing the satisfaction of adult inpatients with their hospital stay after discharge (21). Its qualities and the fact that it explores seven different dimensions of patient care has led to its extensive use and translation in many non-English-speaking countries (24, 25).

However, there is currently no validated French translation of the PPE-15. Moreover, the PPE-15 primarily focuses on gauging satisfaction among adult inpatients, leaving a gap in concise instruments for evaluating the satisfaction of hospitalized children, their parents, and teenage inpatients. Due to its historical and recent popularity and its validation in several languages, developing and validating a French version of the PPE-15 adapted for all patients seen in our institution would not only allow a more extensive evaluation of patient satisfaction but also lead to benchmarking opportunities with the growing number of institutions using culturally adapted PPE-15.

The objectives of this study are threefold: (I) to adapt the adult PPE-15 for parents of young children inpatients and teenage inpatients, (II) to translate the adult PPE-15, as well as the newly adapted versions for pediatrics, into French, and (III) to establish reference values and conduct an initial comparative analysis of satisfaction across all three population groups.

Methods

Population

The University Hospitals of Geneva serves as a tertiary, academic, acute-care hospital with a capacity of over 2000 beds, encompassing a wide spectrum of medical specialties.

This study included three distinct inpatient populations. First, adult participants comprised patients aged over 16 years with a valid email or mobile phone number. The collection of email addresses or mobile phone numbers took place during hospital admission and was recorded by administrative clerks. Second, pediatric patients were categorized into two groups based on their age at discharge: patients older than 12 years received the teenager questionnaire, while patients 12 years or younger were administered the children's questionnaire, which was distributed to their parents.

Patients were contacted within a timeframe of 10 to 17 days following the discharge from the University Hospitals of Geneva. This period was selected to allow patients to address questions pertaining to the dimensions of care continuity and transition. Surveys were administered via a REDCap electronic data capture tool form hosted at the Geneva University Hospital (26, 27). The form was distributed to all discharged patients between October 2019 and December 2019, as well as from March 2020 to April 2023, with the aim of reaching an average of ~500 patients per week. Exclusion criteria included a hospital stay of < 24 h, absence of a cellphone number or email, and having already received a satisfaction survey in the last 3 months. As part of the process, up to two automated reminders were dispatched at 6-day intervals.

Cultural adaptation, and translation of the pediatric PPE-15

The process of culturally adapting and translating the pediatric PPE-15 involved a pilot procedure led by a group of experts, all of whom were native French speakers. The team consisted of a pediatric nurse, a pediatric emergency doctor, a health sociologist, a psychologist, and a parent of a young child. The procedure comprised two steps:

Selection of survey items for patient satisfaction assessment among teenagers and parents of children

The group of experts adopted a sequential approach in selecting items. First, as the adult English version of the PPE-15 already existed and included chosen items from the long Picker Patient Experience questionnaires, experts extended this selection to include items from the Children long PPE questionnaires. This step aimed to comprehensively assess all dimensions of patient satisfaction outlined in the PPE-15 across both adult and pediatric age categories. Subsequently, the experts, notably the pediatrician and the parent of a patient, identified a dimension of patient satisfaction specific to the pediatric population: parental involvement. To address this dimension, two additional items assessing parental involvement were selected from the long questionnaire for the pediatric population. Special attention was given to adapting the language for questions aimed at teenagers to directly engage with them, addressing them instead of their parents.

Scale translation

Two proficient translators with expertise in the healthcare sector independently conducted the translation for all three questionnaires from English to French (forward translation). Subsequently, the team of experts scrutinized these translations, opting for those that most accurately captured the intended essence of the questions, leading to the creation of a unified version. Following this, two native English translators independently rendered this French version back into English (backward translation). The translators performing the backward translation were not privy to the original English questionnaire. The team of experts reviewed and validated the resulting English translations, and in some, adjustments were made to realign the questions with their initial intended meaning.

Pre-test

The French versions of the PPE-15 underwent a pre-testing phase involving individual interviews conducted by three interviewers: a research nurse, a medical student, and a psychologist. These interviews were carried out at the University Hospitals of Geneva and involved voluntary inpatients arbitrarily chosen as representatives of the respective targeted populations. For the adult PPE-15, the pre-tests took place in rehabilitation, medicine, and surgery wards. As for the children and the teenagers' PPE-15, the pre-tests were held within various divisions of the pediatric department, including general medicine, surgery, orthopedics, neonatology, developmental medicine, haemato-oncology, and pediatric psychiatry. The aims of these interviews were twofold: to ensure that the translated items were clear and comprehensible across diverse inpatients populations, and to assess content validity by considering patient perspectives. After accepting to participate, patients had to answer the questionnaires as if in real conditions without interruptions. An investigator then elicited, for each item, any difficulties answering it. At the end, they were also asked about any item lacking to fully express their experience with their hospitalization. Feedbacks were obtained in 5 sessions for adults, and 7 for parents and adolescents. After each session, the questions were examined and modified if necessary, so that the next session would present the new formulation of the questions.

Measurements and construct validity

Collected variables were age, gender, nationality, self-reported primary language, length of hospital stay (LOS), hospital departments of stay, number of positive and negative comments left in the satisfaction questionnaires and preventable readmissions. Comments left by patients in an optional box of the questionnaires are coded as positive or negative in the normal workflow of the patient satisfaction team of the University Hospitals of Geneva. One comment could be flagged several times to account for several positive or negative complaints in the text left by the patient. For hospital departments, while the category of stay in the psychiatric department was expected to have a low number of cases compared for instance to surgery, its potential association with satisfaction warranted its collection and inclusion in our analyses. Preventable readmissions were defined according to the Swiss National Association for Quality Development in Hospitals and Clinics (ANQ) (10). It classifies as potentially preventable every unplanned readmission under 30 days of discharge for a pathology that was already known during the previous hospitalization.

Overall dissatisfaction was calculated as the sum of the item considered as unsatisfactory based on the Picker scheme. To determine a percentage value, this sum was divided by the total number of items and then multiplied by 100. A higher score indicated a greater level of dissatisfaction. This approach assumes that missing data implies an “absence of dissatisfaction.”

Construct validity was evaluated by considering established associations between patient satisfaction and demographic variables, hospital characteristics, and inpatient stay. Regarding demographic variables, age and male gender have been previously correlated with higher satisfaction (2833). In terms of hospital characteristics, we made the assumption that departments with higher risk levels, such as intensive care and emergency care, might exhibit a negative association with satisfaction. Concerning inpatient stay variables, previous research has indicated negative association between satisfaction and factors such as LOS and patients complaints (34, 35).

Statistical analyses

Descriptive statistics were counts and proportions for categorical variables and mean and standard deviation (SD) for continuous variables. Proportions of missing data were reported for every item across the three questionnaires.

To determine whether the data showed a similar number of components as the expected dimensions of the Picker patient experience questionnaire, we ran a Principal Component Analysis (PCA), using a screeplot and the Kaiser criterion to choose the number of components. Adequacy of PCA use was first assessed using the Kaiser–Meyer–Olkin and Bartlett tests.

To assess the adequacy and amount of information provided by each item, we used item response theory, with the information function for each value of the latent variable of patient satisfaction. Subsequently, the application of Rasch models, with a stringent threshold of 0.3, ensured a rigorous assessment of each item's fit within the overarching latent construct. The assessment of internal validity relied on Cronbach's alphas for each of the three questionnaires (adults, teenagers, children). Internal validity was computed on all questions, assuming an overall satisfaction latent variable. Construct validity was evaluated using univariable and multivariable linear regression, with patient satisfaction as the outcome. Both age and the count of negative and positive comments were treated as categorical variables to circumvent presuming linearity of their association. All analyses were performed using R version 4.2.2 (36).

Results

Cultural adaptation and pre-test

The forwards and backwards translation yielded minimal inconsistencies between translators and a general translation was agreed upon. The questionnaires were pretested on 34 adults, 23 parents, and 20 teenagers. During this pretest phase, feedback from numerous inpatients, particularly parents, suggested the addition of a question to evaluate the accessibility of care (including aspects such as accessibility via public transport, availability of parking facilities, both paid and free, etc.). Throughout the entire pre-test procedure, a sequence of five minor adjustments and updated questionnaire versions were introduced. For instance, feedback from parents of preschool-age children highlighted discomfort with a question inquiring about their child's participation in regular activities like sports or attending school, as their child was not yet attending. To address this, we incorporated a response option stating that the child was too young. All these modifications originated from suggestions provided by inpatients, aimed at refining the phrasing to ensure optimal item comprehensibility.

Sample characteristics

Adults: Of the 97,488 patients discharged, 20,378 (20.9%) did not have a valid email or mobile phone number on record. Consequently, 77,110 individuals were reached out to, and from this group, 27,075 (response rate: 35.1%) provided responses to at least 7 questions. Within this subset, 25,626 (94.6%) opted to complete the questionnaire in French.

Teenagers: Of the 1,094 patients who were discharged, 65 (5.9%) lacked a valid email or mobile phone number. Thus, 1,029 were contacted, and among them, 311 (response rate: 30.2%) answered at least 7 questions. Out of these respondents, 293 (94.2%) selected the French version of the questionnaire.

Children: Among the 5,924 patients who were discharged, 436 (7.36 %) were without a valid email or mobile phone number. This led to 5,488 patients being contacted, and among this group, 1,782 (response rate: 32.5%) provided answers to at least 7 questions. Within this subgroup, 1,640 (92.0%) chose to complete the questionnaire in French.

There were more women among adults, and more boys among children, and an equal proportion of boys and girls among teenagers. Among adults, the median age was relatively youthful, at 52. Across all three patient populations, ~17% identified as allophones, signifying that French was not their primary language. The distribution of stays within specific departments was similar across all populations, except for emergency care, which was more frequent among teenagers (62.9%) and children (50.2%) compared to adults (29.1%) respondents. As anticipated, the proportion of patients admitted in psychiatry was low across all population groups (Table 1).

Table 1
www.frontiersin.org

Table 1. Patients characteristics.

Questionnaires characteristics

Among adults, there was a notable level of dissatisfaction with continuity of care, as ~45% expressed not receiving information about (1) drug side effects, or (2) warnings and signals pertaining to their condition. Moreover, nearly 40% reported dissatisfaction with their level of engagement in treatment and care, as well as the coordination of care, which involved instances where healthcare professionals offered contradictory information. To a lesser extent (around 25% of dissatisfaction), respondents reported receiving inadequate emotional support across all three items within this dimension (Table 2).

Table 2
www.frontiersin.org

Table 2. French version of the adults PPE-15 questionnaire: questions and loadings.

Results were relatively similar for teenagers, who were also frequently unsatisfied with continuity of care and the presentation of contradictory information by healthcare professionals. In addition, over 30% of teenagers expressed discontent with how doctors addressed their concerns. Parents also reported issues related to contradictory information, although they displayed a slightly lower level of dissatisfaction with continuity of care. However, over 40% of parents conveyed dissatisfaction with their involvement in the care of their children (Table 3).

Table 3
www.frontiersin.org

Table 3. French version of the teenagers and children PPE-15 questionnaires: questions and loadings.

Within the subset of patients who provided responses to the questionnaires, instances of missing answers were infrequent, with a notable exception for the question regarding information about drug side effects for both adults and teenagers (6.0% and 8.2% respectively, as indicated in Tables 2, 3). Interestingly, nearly all parents responded to this specific question, and their reported dissatisfaction level was relatively high.

Principal component analysis and factor analysis

There were strong inter-items correlations in each population with Bartlett's tests always strongly significant (ps < 0.001) and Kaiser-Meyer-Olkin tests of 0.91 for adults, 0.87 for teenagers and 0.89 for children (Figure 1). Across each of the examined populations, PCA consistently yielded congruent outcomes, with a single prominent component evident. The loadings (Tables 2, 3), representing the correlation between the items and the underlying satisfaction construct, were predominantly satisfactory, often exceeding the threshold of 0.4. There were exceptions. The question regarding respect (“doctors speak in front of me as if I wasn't there”) exhibited poor performance across all categories. Furthermore, among teenagers and children, the item pertaining to emotional support (“nurses addressing concerns”) had low loading. Among parents of children, two continuity and transition-related items, “being told about side effects” and “being told about physical activity,” also displayed low association with the overall scale. Cronbach's alphas were 0.85 for adults, 0.82 for teenagers, and 0.80 for children.

Figure 1
www.frontiersin.org

Figure 1. Principal component analysis for each population.

Rasch models

Most items had good information content and covered together a large range of dissatisfaction. Nevertheless, a few items demonstrated low information content. The question on coordination of care (“Sometimes in a hospital, one doctor or nurse will say one thing, and another will say something quite different. Did this happen to you?”) had low information for all three populations. Questions such as “Did you feel that friends and family were welcome to visit your child?” (emo2 on Figure 2) and “Did doctors talk to other hospital staff in front of you and your child, as if you were not there?” (resp1 on Figure 2) yielded minimal information for children and teenagers. This corroborated the findings obtained from the factor analysis.

Figure 2
www.frontiersin.org

Figure 2. Information index for each population. Items are identified by their dimension: Inf = Information and education (2 items), coord, Coordination of care; emo, Emotional support; dol, Physical comfort; resp, Respect of patient preferences; inv, Involvement of family and friends; dis, Continuity and transitions; parent, Involvement of parents.

While the overall level of satisfaction remained relatively similar across the three population groups, notable variability emerged within populations. This observation is exemplified by the responses to questions such as “When you had important questions to ask a doctor, did you get answers that you could understand?” and “When you had important questions to ask a nurse, did you get answers that you could understand?” Similarly, variation was also evident between questions, particularly in the context of the “Sometimes in a hospital, one doctor or nurse will say one thing, and another will say something quite different. Did this happen to you?” question, as indicated in Figure 3.

Figure 3
www.frontiersin.org

Figure 3. Distribution of dissatisfaction among populations overall (top panel) and for the specific three items (bottom panel).

Among adults, dissatisfaction was more pronounced in terms of the clarity of responses received from nurses or doctors, in contrast to parents of children. Teenagers demonstrated a higher level of satisfaction than adults, though lower than parents. Conversely, adults expressed a slightly higher satisfaction level in relation to care coordination, with teenagers reporting lower satisfaction, and parents even lower levels.

Construct validity

Among adults, dissatisfaction was higher among older patients (>80 years old), and patients with longer length of stay or preventable readmission. As could be expected, patients who wrote negative comments also rated satisfaction more negatively. These associations remained similar in the adjusted analysis, except for age, with patients over 40 years old reporting more satisfaction than younger adult patients, though this difference was smaller for patients 80 years or older.

Regarding specific departments, patients who stayed in the emergency care, intensive care, psychiatry, and rehabilitation departments reported higher levels of dissatisfaction, whereas patients who stayed in the gynecology and obstetrics department indicated lower levels of dissatisfaction.

Raw and adjusted analyses in both teenagers and parents of children showed a similar pattern of results than for adults, with negative comments, length of stay and preventable readmissions associated with higher dissatisfaction. The main difference related to the departments, with dissatisfaction lower in surgery and higher in general pediatrics. Passage in emergency care was associated with higher dissatisfaction among teenagers, but not among children. A difference specific to children was the strength of the association between preventable readmission and dissatisfaction, which was much lower and even became non-significant in the adjusted analysis (Table 4).

Table 4
www.frontiersin.org

Table 4. Univariable and multivariable analysis association with dissatisfaction.

Discussion

This validation study encompassed the translation and adapation of the PPE-15 satisfaction scale for three distinct French-speaking populations : adults, teenagers, and children. The scales exhibited good internal consistency for an overall dissatisfaction score with Cronbach's alpha values ≥ 0.8 across all three scales. The PCA yielded a single latent variable for each scale. Thus, the original seven dimensions were not observed in the set of 15 questions. While a validation study involving a Spanish version of the PPE-15 reported four components to satisfaction (24) their loadings displayed a primary component incorporating most items, along with three components with minimal loadings surpassing their selected threshold (0.32). Collectively, these findings support the existence of a single general latent satisfaction variable present across all three populations and underscore the potential limitation of the 15 items to accurately assess specific dimensions of satisfaction. Though this implies that the PPE-15 does not measure reliably each satisfaction dimension, individual items could still be used, but at the risk of having imprecise measures of specific dimension.

Item performance discrepancies were evident among each population group. In the adult population, all items were relevant, except the item concerning patient respect (“Doctors speaking as if I wasn't there”), which exhibited low informativeness and a weak loading. This item also demonstrated limited reliability for both pediatric populations. This finding replicates the original PPE-15 validation article findings (21), where the item displayed a relatively high loading in Germany and Switzerland but failed to meet the threshold in Sweden and the USA. In that original study, the item was retained in the final questionnaire due to its strong face validity. Nevertheless, this recurring finding suggests the potential necessity for reformulation. This might be attributed to the fact that patients may not consistently view doctors speaking as if they were not there as unsatisfactory, across cultures and contexts. This question was initially designed to assess respect. Considering the observed performance issues, we propose rephrasing the question to incorporate a negative aspect that could potentially better reflect patient dissatisfaction. For instance, the question could be reformulated as follows: “Did you feel doctors were ignoring you while speaking in front of you as if you weren't there?” This modification aims to enhance the question's sensitivity to patient dissatisfaction with the specific situation. Instances arise where questions possess high face validity a priori, yet their formulation results in low reliability. For instance, the question addressing one's involvement in their own care was modified to emphasize dissatisfaction with the extent of involvement. Despite this, we opted to retain this item as is, aiming to maintain consistency and comparability with the other PPE-15 versions.

In both pediatric populations, an additional item performed poorly (Emotion support – Nurses addressing concerns), underlining the importance of a validation in specific populations. The variation in item functioning for different age groups is expected, as their care-related expectations differ substantially (37, 38). Teenagers and parents of young children may be more accepting of the nurses not addressing the concerns of the pediatric patient because they talk to the parents, allowing the latter to provide support. Rasch models showed that several questions delivered minimal information to an overall satisfaction construct, particularly in the case of children and teenagers. Despite these questions' limited utility for the overall satisfaction measure, they were retained to preserve questionnaire integrity and consistency with existing literature, but also to maintain content validity by assessing all dimensions of satisfaction. Our findings open the way to produce an even shorter satisfaction questionnaire, aimed at measuring only the overall satisfaction, and not specific dimensions.

During the pretest phase, patients and parents suggested that certain essential topics influencing their hospitalization satisfaction were missing. For example, the accessibility of hospital infrastructure supporting ease of access for their family was raised in both children and teenager situations. Concrete examples of questions regarding parking accessibility were suggested. While these questions are relevant, they don't assess experience with care and thus were not included in the scale.

Overall, associations with other constructs were aligned with anticipated relationships. Factors most consistently associated to dissatisfaction included LOS, preventable readmissions, and the presence of negative and positive comments. The positive association with LOS supports the idea that extended hospital stays increase the likelihood of negative events at some point. The commonly observed age-related association with dissatisfaction was similarly identified in adults as well as a strong association between preventable readmissions and dissatisfaction, reinforcing the construct validity of the adapted questionnaire. Gender associations with dissatisfaction appeared inconsistent, with differences between univariable and multivariable analyses in adults and conflicting associations when comparing children, teenagers, and adults. This finding parallels those reported in literature reviews on factors associated with patient satisfaction (16, 32) and highlight the complexity of gender associations, particularly within pediatric population where the gender of the child may differ from the gender of the person completing the questionnaire.

Strengths and limitations

The main strength of this study is the substantial patient sample and the concurrent measurement of satisfaction in three distinct populations. Indeed, residents and nurses rotate across divisions and departments. Thus, a concurrent evaluation for all populations in the same hospital provides stronger evidence for a similar or different item functioning across populations. The substantial sample size provides greater confidence in the good construct validity, mirroring the established correlations between satisfaction and independent variables. The main limitation lies in the use of data from a single hospital, potentially constraining the generalizability of our findings, especially to other French-speaking region in Europe, North America, or Africa. Further studies should be conducted in other French-speaking centers to ensure the questionnaire's cross-cultural validity prior to implementing in different settings. A second limitation is the lack of test-retest reliability due to the absence of longitudinal data. While the adult version of the PPE-15 showed good test-retest reliability, with an ICC of 0.9, further investigation should be conducted to attempt to replicate this finding with the French culturally adapted PPE-15 in all three populations (39). Another limitation is selection bias due to the nature of the data collection. Contact by email or text message, the electronic response format, and a relatively low response rate may result in the selection of a different population compared to the overall patient population. Response rates are often lower among men and individuals with low socio-economic status (40, 41). To mitigate the potential effect of this selection bias on test clarity, particular attention was paid to including patients from various socioeconomic statuses in the pretest phase.

Conclusion

The French adaptations of the PPE-15 scales for adults, teenagers and parents of children inpatients have proven to be valid and reliable for evaluating the general level of satisfaction among hospitalized individuals regarding their stay after discharge. Nonetheless, some questions might benefit from rephrasing to enhance their reliability. Implementing this tool in other French-speaking hospitals would contribute to a more comprehensive understanding of the effects of quality improvement programs and facilitate benchmarking.

Data availability statement

The data analyzed in this study is subject to the following licenses/restrictions: Due to patient data confidentiality the datasets analyzed aren't available. The French culturally adapted questionnaires are in the Supplementary material. Requests to access these datasets should be directed to clement.buclin@hcuge.ch.

Ethics statement

Ethical approval was not required for the study involving humans in accordance with the local legislation and institutional requirements. Written informed consent to participate in this study was not required from the participants or the participants' legal guardians/next of kin in accordance with the national legislation and the institutional requirements.

Author contributions

CB: Writing—original draft, Writing—review & editing. AU: Writing—review & editing. JD: Writing—review & editing. AI: Writing—review & editing. JS: Writing—review & editing. GH: Writing—review & editing. SC: Conceptualization, Writing—review & editing. DC: Conceptualization, Writing—original draft, Writing—review & editing.

Funding

The author(s) declare that financial support was received for the research, authorship, and/or publication of this article. Open access funding was provided by the University of Geneva.

Acknowledgments

The authors thank Catia De Sa Ferreira, Research Nurse, and Stéphane Grimaud, Data Engineer, for their help in data collection and extraction.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpubh.2024.1297769/full#supplementary-material

References

1. Donabedian A. The quality of care: how can it be assessed? JAMA. (1988) 260:1743–8. doi: 10.1001/jama.260.12.1743

Crossref Full Text | Google Scholar

2. Patrick JT. The Hospitalist. Patient Satisfaction: The Hospitalist's Role. (2005). Available online at: https://www.the-hospitalist.org/hospitalist/article/122984/patient-satisfaction-hospitalists-role (accessed August 19, 2020).

Google Scholar

3. Smith C, McCreadie M, Unsworth J, Wickings HI, Harrison A. Patient satisfaction: an indicator of quality in disablement services centres. BMJ Qual Saf. (1995) 4:31–6. doi: 10.1136/qshc.4.1.31

PubMed Abstract | Crossref Full Text | Google Scholar

4. Catalyst N. Patient Satisfaction Surveys. NEJM Catalyst. (2018). Available online at: https://catalyst.nejm.org/doi/abs/10.1056/CAT.18.0288 (accessed August 31, 2018).

Google Scholar

5. Barbosa CD, Balp MM, Kulich K, Germain N, Rofail D, A. literature review to explore the link between treatment satisfaction and adherence, compliance, and persistence. Patient Prefer Adherence. (2012) 6:39–48. doi: 10.2147/PPA.S24752

PubMed Abstract | Crossref Full Text | Google Scholar

6. Marquis MS, Davies AR, Ware JE. Patient satisfaction and change in medical care provider: a longitudinal study. Med Care. (1983) 21:821–9. doi: 10.1097/00005650-198308000-00006

PubMed Abstract | Crossref Full Text | Google Scholar

7. Saultz JW, Albedaiwi W. Interpersonal continuity of care and patient satisfaction: a critical review. Ann Fam Med. (2004) 2:445–51. doi: 10.1370/afm.91

Crossref Full Text | Google Scholar

8. Fenton JJ, Jerant AF, Bertakis KD, Franks P. The cost of satisfaction: a national study of patient satisfaction, health care utilization, expenditures, and mortality. Arch Intern Med. (2012) 172:405–11. doi: 10.1001/archinternmed.2011.1662

PubMed Abstract | Crossref Full Text | Google Scholar

9. Linn LS, Brook RH, Clark VA, Davies AR, Fink A, Kosecoff J. Physician and patient satisfaction as factors related to the organization of internal medicine group practices. Med Care. (1985) 23:1171–8. doi: 10.1097/00005650-198510000-00006

PubMed Abstract | Crossref Full Text | Google Scholar

10. ANQ. ANQ – Swiss National Association for Quality Development in Hospitals and Clinics. (2019). Available online at: https://www.anq.ch/en/ (accessed August 19, 2020).

Google Scholar

11. OECD World Health Organization. Improving Healthcare Quality in Europe: Characteristics, Effectiveness and Implementation of Different Strategies. (2019). Available online at: https://www.oecd-ilibrary.org/social-issues-migration-health/improving-healthcare-quality-in-europe_b11a6e8f-en (accessed August 31, 2020).

Google Scholar

12. Aiken LH, Sermeus W, Van den Heede K, Sloane DM, Busse R, McKee M, et al. Patient safety, satisfaction, and quality of hospital care: cross sectional surveys of nurses and patients in 12 countries in Europe and the United States. BMJ. (2012) 344:e1717–e1717. doi: 10.1136/bmj.e1717

PubMed Abstract | Crossref Full Text | Google Scholar

13. Department of Health. The National Archives. The NHS Plan: A Plan for Investment, a Plan for Reform : Department of Health - Publications. (2000). Available online at: https://webarchive.nationalarchives.gov.uk/$+$/http://www.dh.gov.uk/en/Publicationsandstatistics/Publications/PublicationsPolicyAndGuidance/DH_4002960 (accessed August 30, 2020).

Google Scholar

14. Castle NG, Brown J, Hepner KA, Hays RD. Review of the literature on survey instruments used to collect data on hospital patients' perceptions of care. Health Serv Res. (2005) 40:1996–2017. doi: 10.1111/j.1475-6773.2005.00475.x

PubMed Abstract | Crossref Full Text | Google Scholar

15. Edwards K, Walker K, Duff J. Instruments to measure the inpatient hospital experience: a literature review. Patient Exp J. (2015) 2:77–85. doi: 10.35680/2372-0247.1088

Crossref Full Text | Google Scholar

16. Beattie M, Murphy DJ, Atherton I, Lauder W. Instruments to measure patient experience of healthcare quality in hospitals: a systematic review. Syst Rev. (2015) 4:97. doi: 10.1186/s13643-015-0089-0

Crossref Full Text | Google Scholar

17. Voutilainen A, Pitkäaho T, Vehviläinen-Julkunen K, Sherwood PR. Meta-analysis: methodological confounders in measuring patient satisfaction. J Res Nurs. (2015) 20:698–714. doi: 10.1177/1744987115619209

Crossref Full Text | Google Scholar

18. Thayaparan AJ, Mahdi E. The patient satisfaction questionnaire short form (PSQ-18) as an adaptable, reliable, and validated tool for use in various settings. Med Educ Online. (2013) 18:21747. doi: 10.3402/meo.v18i0.21747

PubMed Abstract | Crossref Full Text | Google Scholar

19. Westbrook KW, Babakus E, Grant CC. Measuring patient-perceived hospital service quality: validity and managerial usefulness of HCAHPS scales. Health Mark Q. (2014) 31:97–114. doi: 10.1080/07359683.2014.907114

PubMed Abstract | Crossref Full Text | Google Scholar

20. Mao G, Gigliotti MJ, Dupre D. The use of hospital consumer assessment of healthcare services and the Press Ganey medical practice surveys in guiding surgical patient care practices. Surg Neurol Intl. (2020) 11:1–18. doi: 10.25259/SNI_29_2020

PubMed Abstract | Crossref Full Text | Google Scholar

21. Jenkinson C, Coulter A, Bruster S. The picker patient experience questionnaire: development and validation using data from in-patient surveys in five countries. Int J Qual Health Care. (2002) 14:353–8. doi: 10.1093/intqhc/14.5.353

PubMed Abstract | Crossref Full Text | Google Scholar

22. Larson E, Sharma J, Bohren MA, Tunçalp Ö. When the patient is the expert: measuring patient experience and satisfaction with care. Bull World Health Organ. (2019) 97:563–9. doi: 10.2471/BLT.18.225201

PubMed Abstract | Crossref Full Text | Google Scholar

23. Picker. Person Centred Care to Deliver High-Quality Healthcare Experiences. (2020). Available online at: https://www.picker.org/ (accessed August 19, 2020).

Google Scholar

24. Bertran MJ, Viñarás M, Salamero M, Garcia F, Graham C, McCulloch A, et al. Spanish and Catalan translation, cultural adaptation and validation of the picker patient experience questionnaire-15. J Healthc Qual Res. (2018) 33:10–7. doi: 10.1016/j.cali.2017.12.004

PubMed Abstract | Crossref Full Text | Google Scholar

25. Leonardsen ACL, Grøndahl VA, Ghanima W, Storeheier E, Schönbeck A, Løken TA, et al. Evaluating patient experiences in decentralised acute care using the picker patient experience questionnaire; methodological and clinical findings. BMC Health Serv Res. (2017) 17:685. doi: 10.1186/s12913-017-2614-4

PubMed Abstract | Crossref Full Text | Google Scholar

26. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)–a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. (2009) 42:377–81. doi: 10.1016/j.jbi.2008.08.010

PubMed Abstract | Crossref Full Text | Google Scholar

27. Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O'Neal L, et al. The REDCap consortium: building an international community of software platform partners. J Biomed Inform. (2019) 95:103208. doi: 10.1016/j.jbi.2019.103208

PubMed Abstract | Crossref Full Text | Google Scholar

28. Naunheim MR, Xu L, Zhou G, Agarwala A. Patient satisfaction with otolaryngology care: stratification by race, age, gender, income, and language. Otolaryngol Head Neck Surg. (2022) 166:1055–61. doi: 10.1177/01945998221076797

PubMed Abstract | Crossref Full Text | Google Scholar

29. Christian Z, Curley KL, Richards AE, Zhang N, Lyons MK, Bendok BR, et al. Factors associated with greater patient satisfaction in outpatient neurosurgical clinics: recommendation for surgery, older age, cranial chief complaint, and public health insurance. Clin Neurol Neurosurg. (2022) 222:107436. doi: 10.1016/j.clineuro.2022.107436

PubMed Abstract | Crossref Full Text | Google Scholar

30. Li Y, Gong W, Kong X, Mueller O, Lu G. Factors associated with outpatient satisfaction in tertiary hospitals in china: a systematic review. Int J Environ Res Public Health. (2020) 17:7070. doi: 10.3390/ijerph17197070

Crossref Full Text | Google Scholar

31. Woods SE, Heidari Z. The influence of gender on patient satisfaction. J Gend Specif Med. (2003) 6:30–5.

Google Scholar

32. Hekkert KD, Cihangir S, Kleefstra SM, van den Berg B, Kool RB. Patient satisfaction revisited: a multilevel approach. Soc Sci Med. (2009) 69:68–75. doi: 10.1016/j.socscimed.2009.04.016

PubMed Abstract | Crossref Full Text | Google Scholar

33. Chen H, Li M, Wang J, Xue C, Ding T, Nong X, et al. Factors influencing inpatients' satisfaction with hospitalization service in public hospitals in Shanghai, People's Republic of China. Patient Prefer Adherence. (2016) 10:469–77. doi: 10.2147/PPA.S98095

PubMed Abstract | Crossref Full Text | Google Scholar

34. Quintana JM, González N, Bilbao A, Aizpuru F, Escobar A, Esteban C, et al. Predictors of patient satisfaction with hospital health care. BMC Health Serv Res. (2006) 6:102. doi: 10.1186/1472-6963-6-102

PubMed Abstract | Crossref Full Text | Google Scholar

35. Stelfox HT, Gandhi TK, Orav EJ, Gustafson ML. The relation of patient satisfaction with complaints against physicians and malpractice lawsuits. Am J Med. (2005) 118:1126–33. doi: 10.1016/j.amjmed.2005.01.060

PubMed Abstract | Crossref Full Text | Google Scholar

36. R Core Team. R: A Language and Environment for Statistical Computing. Vienna: R Foundation for Statistical Computing (2017).

Google Scholar

37. Gray WN, Schaefer MR, Resmini-Rawlinson A, Wagoner ST. Barriers to transition from pediatric to adult care: a systematic review. J Pediatr Psychol. (2018) 43:488–502. doi: 10.1093/jpepsy/jsx142

Crossref Full Text | Google Scholar

38. Callahan ST, Winitzer RF, Keenan P. Transition from pediatric to adult-oriented health care: a challenge for patients with chronic disease. Curr Opin Pediatr. (2001) 13:310. doi: 10.1097/00008480-200108000-00004

PubMed Abstract | Crossref Full Text | Google Scholar

39. Leonardsen ACL, Jelsness-Jørgensen LP. Patient experiences and predictors in an acute geriatric ward: a cross-sectional study. J Clin Nurs. (2017) 26:4567–73. doi: 10.1111/jocn.13796

PubMed Abstract | Crossref Full Text | Google Scholar

40. Fernández-Sanlés A, Smith D, Clayton GL, Northstone K, Carter AR, Millard LA, et al. Bias from questionnaire invitation and response in COVID-19 research: an example using ALSPAC. Wellcome Open Res. (2022) 6:184. doi: 10.12688/wellcomeopenres.17041.2

PubMed Abstract | Crossref Full Text | Google Scholar

41. Boström G, Hallqvist J, Haglund BJA, Romelsjö A, Svanström L, Diderichsen F. Socioeconomic differences in smoking in an urban swedish population: the bias introduced by non-participation in a mailed questionnaire. Scand J Soc Med. (1993) 21:77–82. doi: 10.1177/140349489302100204

PubMed Abstract | Crossref Full Text | Google Scholar

Keywords: patient satisfaction, hospitals, healthcare quality, healthcare access, healthcare evaluation, validation study, inpatients background

Citation: Buclin CP, Uribe A, Daverio JE, Iseli A, Siebert JN, Haller G, Cullati S and Courvoisier DS (2024) Validation of French versions of the 15-item picker patient experience questionnaire for adults, teenagers, and children inpatients. Front. Public Health 12:1297769. doi: 10.3389/fpubh.2024.1297769

Received: 20 September 2023; Accepted: 30 January 2024;
Published: 19 February 2024.

Edited by:

Huixuan Zhou, Beijing Sport University, China

Reviewed by:

Hilde Hestad Iversen, Norwegian Institute of Public Health (NIPH), Norway
Thu Nguyen, Hanoi Medical University, Vietnam

Copyright © 2024 Buclin, Uribe, Daverio, Iseli, Siebert, Haller, Cullati and Courvoisier. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Clement P. Buclin, clementbuclin@gmail.com; Delphine S. Courvoisier, delphine.courvoisier@hcuge.ch

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.