Parents' Experience and Satisfaction in Neonatal Intensive Care Units in Ethiopia: A Multicenter Cross-Sectional Study Using an Adapted Version of EMPATHIC-N

Background: In neonatal intensive care units (NICU) setting, parents' experience and satisfaction permit to evaluate clinical practice and improve the care of infants and parents. Little is known about this topic in low resource settings. The aim of this study was to (1) translate, adapt and validate the EMpowerment of PArents in THe Intensive Care-Neonatology (EMPHATIC-N) questionnaire in two languages in Ethiopia (2) explore parents' satisfaction with the care received in the NICUs in three hospitals; and, (3) explore socio-demographic characteristics and level of the NICU influence on the EMPATHIC-N domains.

Methods: This was a cross-sectional multicenter study. Participants were recruited from three different NICUs in Ethiopia upon discharge. We reduced the original EMPATHIC-N instrument to 38 items, culturally adapted and validated it in two local languages. Confirmatory Factor Analysis (CFA) was applied to verify the factor structure of the questionnaire, investigating the relationship between items and the five latent domains. Single item scores and the aggregate scores of the domains were investigated across NICUs and in the sample overall. Differences in the distribution of the domain scores were tested according to socio-demographic participants' characteristics. The scores of four general questions about overall experience and satisfaction were investigated in relation to the participant's characteristics and NICU levels. Qualitative data were collected using four open-ended questions and a synthesis of results was provided.

Results: Almost all the parents answered to the questionnaire (92%, n = 386). Questionnaire items on satisfaction on average scored more than four. The highest mean scores were obtained for Parental participation (median: 5.17; iqr: 4.67–5.62), while they were lower for Organization/Hospital environment (median: 4.67; iqr:4.33–5.17). Different levels of parent satisfaction were observed across the NICU levels showing a statistically higher satisfaction in level II NICU compared to the other levels. Education, place of residence and length of stay were associated with parental satisfaction and experience.

Conclusion: This study validated two Ethiopian versions of the EMPATHIC-N questionnaire to assess parents' experience and satisfaction during their child's stay in the NICU. The differences found across the three levels of NICU suggest the need to further investigate the determinants of satisfaction.

Introduction

Parental experience is a crucial measure of service quality and could point to ways of improving health care delivery (1, 2). Particularly in the neonatal intensive care unit (NICU) setting, parent satisfaction is one of the quality care indicators mainly concerned with fulfilling parents' positive expectations of the perceived factors of the child's care (1).

Parent involvement and empowerment play an important role in building a family-centered care (FCC) environment (3) with beneficial effects for both infants and parents (4). The attributes of FCC in the NICU have been recognized as participation of the family (in care planning, decision making, and providing care from routine to specialized care), family's respect and dignity, and knowledge transformation (information sharing between healthcare providers and families, complete information sharing according to the family's learning style) (5).

Studies have shown significant associations between parental satisfaction with health care in NICUs and their ability to provide appropriate care for their infants. Generally, higher satisfaction with health care is reported to yield better treatment compliance (1, 3). Interaction with healthcare professionals (HCPs) is crucial for parental experience (6). For health workers, it is important to understand parents' expectations when infants are admitted to the NICU, to meet their needs and concerns and increase their satisfaction, which will promote more appropriate attachment and bonding (7).

The EMpowerment of PArents in THe Intensive Care-Neonatology (EMPATHIC-N) questionnaire was developed in the Netherlands to measure NICU parent satisfaction and experience (3) and has been translated and culturally adapted in several countries (2, 8–10). A similar questionnaire related to the pediatric intensive care unit was culturally translated in South Africa (11). Although parents' experiences in pediatric health services have already been evaluated by other authors in Ethiopia (12, 13), currently a validated instrument to specifically evaluate the NICU context is still not available in that country.

In the last 10 years, the Ethiopian Ministry of Health has worked hard to establish new NICUs in hospitals, and strengthen existing ones through training and continued support for newborn HCPs providers and managers, ensuring the equipment and supplies are in place, and strengthening the facility infrastructure and the referral system (14, 15).

The Ethiopian Federal Ministry of Health (FMOH) is formalizing the guidelines regarding the level of neonatal care services, defining the standards in terms of space, personnel, quantity of NICU supplies and equipment. The draft of this document, shared by the FMOH to the authors, divides NICUs into 3 levels. Level-I NICUs are supposed to have personnel and equipment to perform neonatal resuscitation, evaluate and provide postnatal care for healthy and sick newborn infants, stabilize and provide care for infants born between 35 and 37 weeks of gestation and should be guaranteed by all district hospitals. Level-II NICUs should provide care to infants born after 32 weeks of gestation and weighing more than 1500 g (managing problems caused by physiologic immaturity) and should be found at least in all regional referral hospitals. Specialized teaching hospitals should have a Level-III NICU to provide life support and comprehensive care for extremely high-risk newborn infants and those with complex and critical illnesses (16).

The three levels of complexity imply different structural organizations and different expectations of the population which can greatly influence the parental experience. Investigating these differences can be helpful when planning specific interventions depending on the level of NICU.

This study was conducted within the framework of a 3-year project implemented by Doctors with Africa CUAMM (University College for Aspiring Missionary Doctors) that aimed at improving the quality of NICU services in the three selected hospitals. The project, designed together with the FMOH, started in 2018 and included operational research and surveys on newborn care to generate evidence to enable the FMOH to make informed decisions.

Since sociocultural and economic contexts may have a strong influence on parents' experiences (17), it is important to take into account the peculiarities of the context both during the validation process of the tool and the interpretation of the data.

The complexity of applying a user assessment tool in the Ethiopian context is increased by the many different languages spoken by the population in Ethiopia.

The aim of this study was to (1) translate, adapt and validate the EMPHATIC-N in two spoken languages in Ethiopia (2) explore parents' satisfaction with the care and treatment received in the NICUs in three hospitals and (3) explore socio-demographic characteristics and level of the NICU influence on the EMPATHIC-N domains.

Materials and Methods

Design

This is was multi-center cross-sectional quantitative study that measured client satisfaction with NICU services. The study included a qualitative section to explore the parents' answers to the open questions.

Ethical Issues

The medical research ethics review board of one of the hospitals (an Academic Hospital) and of the Oromia Regional Health Bureau approved the study protocol. Considering the local cultural context (18), a verbal informed consent was obtained from all study participants (19–21). Parents were informed about the study objectives and data were collected anonymously. The interviewer gave the respondents enough information so that they could provide an informed decision on whether to participate in part or in the entire interview. Afterwards, the consent forms were signed by the interviewer as evidence that informed consent had been obtained from the interviewer.

Setting

The study was conducted in three different types of NICUs in Ethiopia: a Level I NICU with 8 beds run by one General Practitioner and 7 Nurses (4 of them with a 1-month training session for NICU care); a Level II NICU with 6 beds run by a Pediatrician, a Health Officer and 12 Nurses (4 of them with a 1-month training session for NICU care); a Level III NICU with 14 beds run by 2 Neonatologists, 2 Pediatricians, 9 Resident Doctors, 8 Neonatal Nurses, 48 Nurses (12 of them with a 1-month training session on NICU care). The average number of monthly admissions in the first semester of 2019 was 23, 81, and 168 for Level I, II, and III, respectively. Level I and II were located in the Oromia region, while Level III, an Academic Hospital, was located in Addis Abebe, the capital city. Level I and Level III NICUs were located in government hospitals, while Level II NICU was located in a private not-for-profit hospital supported by Doctors with Africa CUAMM. Admission and treatment costs in all the NICUs were free of charge as per national policy.

Sample

Study participants were all parents whose newborns had been discharged from one of the three NICUs or transferred to another unit during the study period.

Only the parents of the newborns admitted to the NICUs for more than 2 days were included in the study. Parents with multiple births discharged on the same day, received only one satisfaction questionnaire. Parents whose infants died while in the unit were excluded from this study.

If both parents were present, only one of the parents was interviewed, leaving the decision to the couple.

Sample size was determined conservatively by considering 10 respondents for each of the items (22) and a possible 10% non-response rate was calculated, with N = 418 parents to be interviewed.

The sample size was divided proportionally across the three hospitals considering the average monthly admissions of newborns. All the eligible respondents were interviewed until the desired sample size was achieved.

Study Variables and Operational Definition

Socio-demographic variables such as age, sex, educational level (high level of education was considered from secondary schools, high school, grade 9–12 in Ethiopia), occupation (housekeeping or any type of occupation) and place of residence (urban or rural, based on the country's administrative arrangements), were collected from the parents interviewed. Moreover, infants' sex and length of hospital stay were collected from inpatients' clinical records.

Five specific dimensions (Communication-Information and Education, Care & treatment, Organization/ Hospital Environment, Parental participation, and Professional Attitude) related to parent satisfaction were investigated.

A 6-point Likert scale, from one, “not at all satisfied,” to six, “all the time satisfied,” was used to assess the 38 questionnaire items -responses, with higher scores indicating greater parent satisfaction.

General experience outcomes answers (items Q39 and Q40), “Recommend this NICU to anyone” and “Would you come back” were conveniently dichotomized from the above 6-point scale to “Not at all/a little/to some extent” if 1–4 points were scored and to “Most of the time /always” if items were scored 5–6 points. Answers “in some extend/largely satisfied” were included in the first level together with the “not and little satisfied” to have more balanced groups, because almost every parent was answering “very largely/all the time satisfied” to these questions.

Answers about general impression (items Q41 and Q42 were dichotomized conveniently from a 5-point scale into “Very dissatisfied, quite dissatisfied, and neither satisfied nor dissatisfied” if 1–3 points were scored and “Quite satisfied and very satisfied” if 4–5 points were scored.

The Instrument

The questionnaire was adapted from an internationally validated tool for the assessment of parent experience and satisfaction in the NICUs called the EMPATHIC-N Instrument, which consisted of 57 items (3). Permission to translate and adapt the original questionnaire was obtained from the author. A short version of the instrument was developed, considering the previous experience in reducing a similar questionnaire related to the Pediatric Intensive Care Unit (23). During the reduction process, attention was paid to keep the original balance among the different items for each domain of the questionnaire. The project team working on quality improvement in the three NICUs was involved in this reduction process. Moreover, the medical director of one of the involved hospitals, a NICU pediatrician and President of the Ethiopian Pediatric Society participated in this task.

All the suggested steps for translation and cultural adaptation were followed (24, 25). Starting from the 57 items of the EMPATHIC-N questionnaire (English version), 19 items were considered inappropriate for the Ethiopian setting both for cultural and organizational reasons. The reasons for the removal of the items are reported in Supplementary File 1. Similarly, the original final questions regarding overall satisfaction with physicians and nurses (Q41 and Q42) from the original EMPATHIC-N were substituted with more general questions evaluating care and treatment received from HCPs by the infant and the parent, retrieved from another validated questionnaire on NICU parents' satisfaction, the NSS-13 tool (26). The questionnaire also included four open questions to collect comments or suggestions from the parents about their experience with care received in the NICU during admission, stay, and discharge plus a general comment on the service received.

The instrument was translated into the two languages mainly spoken in the areas where the three hospitals were located—Afan Oromo and Amharic—and back-translated into English to check for consistency. Finally, a pre-test was administered on a small sample (n = 10) of the target population to assess the comprehensibility of the instrument questions in the two language versions.

Data Collection

The study was conducted between July and October 2019. Three health care providers, who had no direct connection with the service, were recruited as data collectors and received a 1-day training session about the study tool and methodology. The principal investigator supervised the data collection processes. The interviewer invited the parents to participate in the survey and to complete the questionnaire upon discharge from the NICU. The interview was conducted in a previously identified quiet location within the hospital and lasted on average of 20–30 min. The interviewer marked the respondent's response on paper questionnaires and literally transcribed the answers given to the open-ended questions. Then the data collector copied the answers into an electronic database. The interviews were not audio recorded. A number code was sequentially assigned to the enrolled parents to ensure anonymity.

Data Analysis

Statistical analysis was conducted with R software (R version 4.0.3). Data coding, clearance and entry to the designed format was done after completing data collection.

Descriptive analyses exploring participants' characteristics were included for the total sample and separately for the three NICU levels. Frequencies and percentages were reported for categorical variables, and medians with the interquartile range (iqr) for continuous variables. Raw means and standard deviations were included to describe single item results in the sample.

The Kaiser-Meyer-Olkin (KMO) test of factorial adequacy and Bartlett's test were used to measure the factorability of the correlation matrix.

Confirmatory factor analysis (CFA) was conducted to examine the validity of EMPATHIC-N in this study. Five construct domains were identified as latent variables, which had been defined according to correspondent items in the original EMPATHIC-N instrument. Goodness of fit was investigated considering standard measures such as Comparative Fit Index (CFI;), Root Mean Square Error of Approximation (RMSEA), and Standardized Root Mean Square Residual (SRMR) (27). The reliability of each factor was examined through internal consistency using Cronbach's alpha coefficients. Congruent validity was examined by correlating the domains of the questionnaire with the four general questions on parents' overall experience and impression.

Univariate associations between participants' sociodemographic characteristics and mean scores for the five domains and for a total satisfaction score (calculated as overall mean for all item scores), and for the dichotomized general questions on overall experience and impression (Q39–Q42) were investigated. The Wilcoxon rank-sum and Kruskal Wallis tests were used for continuous variables and Fisher's exact tests was used for categorical variables. Multiple median regression and logistic regression models were additionally implemented to model multivariate associations between parents and patients' characteristics (age, residence, education, occupation, length of hospital stay) and the outcomes (domain scores and binary outcomes representing the four general satisfaction items agreement). The level of statistical significance was set at p < 0.05.

Qualitative data were collected from the open-ended questions and analyzed through inductive content analysis (28). The contents of the answers were compiled and coded into subthemes independently by the principal investigator and a co-investigator. The researchers created a consolidated checklist that was used to independently apply the coding. The subthemes were categorized into 6 themes: General reaction, Communication, Relationship with Health Workers, Clinical management, Organizational aspects and Environmental factors.

Results

Characteristics of the Study Participants

Of the 418 parents who were invited to participate in the study, 386 accepted. Therefore, the overall response rate was 92%. Specifically 91% (n = 32 out of 35) in NICU Level I, 94% (n = 117 out of 124) in Level II and 92% (n = 237 out of 258) in Level III. Most of the questionnaires were filled in Amharic (71.8%, n. 277). Almost all the respondents were the mothers (98.7%, n. 381), most of them were married (97.7%, n. 378) and were housewives (64%, n. 248). Table 1 reports the distribution of participants' socio-demographic characteristics both in the whole sample and across the NICU levels. Only the 9.8% of the responders' infants were hospitalized for more than 2 weeks.

TABLE 1

Table 1. Socio-demographic characteristics of the respondents and child admission variables (N = 386) in the whole sample and across the three NICU levels.

Parents' spoken language, place of residence, education level and children's length of stay were found to be differently distributed across the NICU levels (Table 1).

Instrument Validation

Questions 12 (“We were daily informed about the physicians and the nurses who were in charge of our child”) and 29 (“Nurses and physician always identified themselves saying their name and their role”) were not answered consistently. Low item-total correlations (r = 0.02 and r = 0.03 respectively) and higher “alpha-drop” estimates (Cronbach's alpha for a group of items if each item were dropped) showed that items were not correlating well with the scale overall.

The Kaiser-Meyer-Olkin (KMO) statistic measure was 0.94 and Bartlett's test resulted significative. Confirmatory factor analysis (CFA) was performed for the whole sample and separately for the two languages.

In line with the original instrument (3) and with the following adapted versions (2, 8, 29, 30), five latent factors were specified (Communication, Care & Treatment, Parental Participation, Organization, Professional Attitude). Since all factors were highly correlated (Supplementary File 2; Supplementary Table 1), the model was re-specified by defining a second order factor measured by the five domains of the questionnaire. Model goodness of fit is reported in Table 2, indices were not optimal but comparable with results from previous studies (29). Second-order CFA Factor loadings are available in the Supplementary File 2; Supplementary Table 2.

TABLE 2

Table 2. Confirmatory factor analyses results.

Cronbach's alpha coefficients for the two language sub-samples and for the whole sample analyses (Afan Oromo and Amharic questionnaires combined) were very high (>0.70), confirming the reliability of all the five construct domains across the three combinations (Table 3).

TABLE 3

Table 3. Cronbach's alpha internal consistency for each of the five construct domains, separately for the two language sample subsets and for the total sample.

There was congruence between the results obtained in the two language samples and in the combined sample. For this reason, the authors decided to describe the questionnaire outputs in the overall sample of respondents, without distinguishing them by language.

Finally, correlations between the five domain scores and the scores of items Q39–Q42, regarding general questions on parents' overall experience and impression, were all significant (Supplementary File 2; Supplementary Table 5).

Parent Satisfaction and Association With the NICU Level

For almost all the items, parent satisfaction with the quality of care received in the NICU, the mean scores were higher than four on the 6-point Likert scale (Supplementary File 2; Supplementary Table 3).

The parents of children in the Level II NICU consistently reported higher mean scores in all the questionnaire items and for all the five domains. In the analysis of the five item-aggregated latent domains (Q12 and Q29 excluded) the highest mean scores were obtained (in descendent order) for Parental participation [median 5.17; iqr (4.67, 5.62)], Professional Attitude [median 5.11; iqr (4.67, 5.67)] and Care and Treatment [median 5.00; iqr (4.62, 5.50)]; while the total scores were relatively lower for the domain areas of Communication [median 4.71; iqr (4.00, 5.14)] and Organization/Hospital environment [median 4.67; iqr (4.33, 5.17)] (Table 4).

TABLE 4

Table 4. Domains Scores and total satisfaction score per each site (N = 386).

Table 5 shows statistic of the domain scores according to the participants' characteristics. The total satisfaction score varied according to participants' language, place of residence, and level of education. Multivariate analyses showed consistent results with univariate analyses (Supplementary File 2; Supplementary Table 6). The language variable was not considered in the models because Afan Oromo was not spoken in one of the three hospitals (Table 1). Satisfaction scores were always reported to be significantly lower in Level I and Level III NICUs compared to Level II NICU (reference category).

TABLE 5

Table 5. Statistics of the domain scores according to participants' characteristics.

Table 6 reports frequencies and percentages for the four general questions, concerning parents' overall experience and impression. For the two “general experience” questions and the two “general impression” questions, the percentage of parents satisfied with the level of care in Level II NICU was higher than 90%. In the Level II NICU, for questions 39 and 40 almost 100% of the parents were very or totally satisfied, and for questions 41 and 42, 95 and 90%, respectively, of the parents were quite satisfied or very satisfied. Descriptions of the overall experience and impression scores in the original undichotomized scales are reported in Supplementary File 2; Supplementary Table 4.

TABLE 6

Table 6. General questions on parents' experience and impression.

NICU level, level of education and occupation were found to be possibly associated to a different resulting outcome in general question outcomes (Supplementary File 2; Supplementary Table 7). Additionally, language and place of residence were found to be possibly associated with answers to question Q40. Multivariate logistic regression analyses (Supplementary File 2; Supplementary Table 8) confirmed, for the four outcomes, that the odds of being very largely/all the time in agreement with Q39 and Q40 and quite/largely satisfied with Q41 and Q42 were lower in Level I and III NICUs compared to the Level II NICU, while holding the other variables constant.

Open Questions About Parents' Experience

All the participants answered to at least three of the four open-ended questions, providing 1,541 answers. Fourteen comments contained two different subthemes generating a total of 1,555 comments.

Aspects related to admission, stay and discharge were often reported in the “General experience” question, therefore the authors decided to code together all the comments given to the four questions.

Most of the comments were simple opinions or statements about personal feelings. The main aspects commented in relation to the experience were: information received (227 respondents), speed of treatment (207 respondents), and HCPs' behavior (110 respondents). The complete list of the subthemes is reported in Table 7.

TABLE 7

Table 7. Themes and selected verbatim responses to open questions about parents' experience.

Discussion

This study aimed to investigate parents' experience and satisfaction with the care received in three different level NICUs in Ethiopia. Therefore, two language translations, cultural adaptation and validation of the questionnaire EMPATHIC-N (3) were performed in this setting.

The lack of attention of parents in distinguishing the health professional figures who were responsible for the care of the newborn had already been taken into account during the adaptation of the questionnaire, but was further confirmed by the non-correlation of questions 12 and 29 relating to the identification of health personnel. This study had a higher response rate (94%) compared to other studies (2, 23), similarly to one study conducted in a Pediatric ICU in Spain where the questionnaire was administered at the time of discharge (30). This high response rate could be partly explained by the data collection method (direct interviews instead of self-compilation) and by the level of satisfaction across all the sites, confirming that people who report high satisfaction levels are more likely to participate in a survey (31).

Most of the respondents were mothers. Such a high percentage of mothers compared to fathers was also revealed in the validation of EMPATHIC in Turkey (29) where—unlike other contexts where both parents were given the opportunity to respond together (2, 10, 11)—the couple was free to choose whether the mother or the father wished to answer. This may also because mothers are more present in hospitals and more involved in the care of newborns, especially in low-resource settings.

In the whole sample, parents resulted to be altogether satisfied with the care received in NICUs. Questionnaire items scored similarly to those of previous studies conducted in different international contexts with average scores even higher than the averages we found (2, 11, 30). These results may suggest a possible ceiling effect that could be due to the parents' feelings of gratitude at the time of their infant's discharge. The implementation of a different scale could be tested in future studies for EMPATHIC-N.

In this study setting, parental participation scored highest among all the five questionnaire domains, whereas the organization/hospital environment domain received the lowest scores for parent satisfaction. This was not highlighted in other study settings (2, 8, 29, 30, 32).

The scores across the five domains were found to vary significantly across the three NICU levels (Level I, II, and III).

Parents of infants assisted in the Level II NICU, expressed a higher level of satisfaction, in all domains, after adjusting the results for parents' socio-demographic characteristics. Instead, satisfaction with Level I NICU resulted in scores lower than four, especially for Communication and Professional Attitude domains. This evidence might be due to the different NICU levels, to whether the hospitals were public or private and to the intervention in the level II NICU supported by CUAMM.

From the point of view of the NICU level it can be assumed that the intermediate level was the one that satisfied parents most, because it offered more services than level I, but did not suffer from heavy workload like in level III (33).

In the literature it has been shown how drugs and medical equipment availability (13), availability of laboratory, radiology services and rooms for accommodation (19) can influence patients' satisfaction. On the other hand, there is evidence that parental satisfaction in provincial centers is higher than in national specialist centers, probably due to the lower severity of cases and less stressful working conditions (34, 35). Moreover, a greater satisfaction of patients in hospitals with a private-public-partnership than in public hospitals has already been previously reported (36). Among other aspects this may have influenced parental satisfaction with discharge preparation (37) and health workers' care and behavior (38, 39). In fact, there is also evidence that the working environment and infrastructure could motivate HCPs to deliver high quality of care (40).

The respondents' level of education was found to be inversely associated with the level of satisfaction, as already reported by other authors (12, 41). This might indicate that parents with a higher level of education have a greater expectations regarding the quality of care provided to their newborn.

Similarly, it has been shown that place of residence might influence satisfaction, whereby people living in rural areas tend to be more satisfied compared to those living in urban areas (12, 41). Levels of parent satisfaction in Care and Treatment for their children were also found to be lower for longer lengths of hospital stay. As also reported by other authors, longer hospitalization tends to be associated to lower satisfaction ratings (42). This could also be due to the greater seriousness of the clinical conditions of the infants who stayed longer in the NICU, and parents had more time to observe the NICU environment and its weaknesses. Therefore, the evaluations by parents who were older, more educated, lived in urban areas, and whose child had a longer length of stay in the NICU, should be used as benchmarks to guide the improvement interventions. In fact, the needs of this population should constitute the basis for more targeted health services for infants and parents in NICUs also in Ethiopia.

In the open questions, parents often gave either positive or negative opinions, but there were many who pointed out possible areas for improvement, even without expressing a direct judgment.

Much attention was paid to the relationships they built with the hospital staff (information received and HCPs' behavior) as also highlighted in other contexts (11).

Positive comments can be very useful to share with the staff to reinforce trust in the HCPs. On the other hand, criticism can be useful to policy makers to improve and make specific interventions. These findings could be used to prompt further discussion, consideration and evaluation for themes such as the cultural approach methodology to apply in these settings. The staff would then be invited to evaluate the parents' feedback, understand any issues and gaps they might encounter and find solutions to address them.

Comments to open questions have also been made available in disaggregate versions (for each study site) to stakeholders and policy makers, but were not presented in this paper.

Limitations

This survey was conducted upon discharge of the patient from the NICU. Although investigators tried to conduct the interview only after discharge was completed, guaranteeing the anonymity of the interview, being still in the hospital setting may have induced fear of retaliation from the medical and nursing staff for negative or non-favorable reports on the care they provided (11).

The study design provided for a long period (45–60 days) of data collection. This could have led the data collector to develop emotional attachment with the NICU staff and therefore could have prompted staff to improve in their actions and impressions with the parents. To minimize it, data collectors were asked to limit their interactions with staff.

Despite the attempt to guarantee the privacy of the parents during the data collection interview, it could be possible that noise and distractions in the NICU may have led to environmental bias, not allowing the parent to fully concentrate on the questions of the survey. Moreover, collecting data in the same day the infants were discharged could have overwhelmed the parents, but this was the same timing used in similar studies (2).

The data collection tool used in this study, the 6 point-likert scale questionnaire, was not originally designed to be administered by interviewer (3, 23), but as a self-administered questionnaire. The approach/questioning of the interviewer to make clarification on the scales combined with the low level of educational status of the respondents may have led to response bias. To minimize this issue, the interviewers were oriented prior to data collection to suggest respondents to choose between numbers 1 to 6 indicating that 1 for “Not at all” to 6 for “All the time”.

When comparing satisfaction across the different NICU levels, the health personnel staffing levels and their job satisfaction, which may have affected their care activities, were not taken into consideration. Future studies on this issue will also need to take these aspects into account.

The role played by public or private hospital ownership in the provision of care was not been investigated in the present study. Further insights are needed to distinguish whether private non-profit NICU facilities led to better parent satisfaction than the public ones investigated in this paper.

In addition, some of the parents' characteristics that may have influenced their experience were not considered in our study, such as having other children at home to care for or having had previous experience with NICU services.

Conclusion

In the present study, we found that the EMPATHIC-N questionnaire can be applied to measure parental satisfaction and can be adapted to different cultural contexts. This study investigated parents' satisfaction in Ethiopia, also comparing results across three different NICU levels. Parents' overall level of satisfaction with the care provided to their child was good, in particular with regard to “Parental participation.” Another interesting finding of this study was that healthcare workers tended not to give much importance to introducing themselves to the patients and their parents. In addition, we found that different domains in the healthcare service might influence the level of parent satisfaction according to characteristics such as education and place of residence. Healthcare team members need to be aware of the increasing importance of identifying parental expectations and understanding its significance. In addition to the clinical care they provide to the newborn, the healthcare staff must also consider the needs of parents as part of their daily practice.

Further studies are needed to improve staff awareness about parent satisfaction and more precisely on their evaluation of aspects related to the care provided across the different NICU levels. Long-term investigation is also recommended to better evaluate and understand differences in the way care is provided across the different NICU levels in Ethiopia.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics Statement

The studies involving human participants were reviewed and approved by St. Paul's Hospital Millennium Medical College/Oromia Regional Health Bureau. Verbal informed consent was obtained from all participants for their participation in this study.

Author Contributions

BG and LM conceived and implemented the study, collected data, participated in the data analysis, and drafted the manuscript. FT drafted and edited the manuscript and participated in the interpretation of the findings. SP performed the data analysis, gave a substantial contribution to the interpretation of the data, and drafted and edited the manuscript. AT and FM supervised all the phases of study and made a substantial contribution to the interpretation of the data. TA reviewed and gave substantial contribution to the manuscript. ID conceived, designed and supervised all the phases of study, and drafted and revised the manuscript for important intellectual content. All authors contributed, read, and approved the final manuscript.

Funding

This research was conducted in the framework of project supported by Italian Agency for Development Cooperation (AICS) (Grant No. AID 11512/CUAMM/ETH). The project supported the research costs and the publication fees. The founders had no role in study design, data collection, data analysis, data interpretation, or writing of the report.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

The Handling Editor declared a past collaboration with one of the authors, ID.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Acknowledgments

The authors thank the parents who participated in our study and the staff of the hospitals involved for their availability and collaboration. We are also grateful to Dr. Andrea Dotta, MD, MS, Ph.D., Head of the NICU, Prof. Andrea Finocchi, MD, MS, Ph.D. Head of the Unit of Immuno-infectivology, the staff working in their units and the International Activities Department of Bambino Gesù Children's Hospital IRCCS for the support to the quality improvement project in the Ethiopian NICUs. A special thanks goes to Prof. Worku Bogale, of the Ethiopian Pediatric Society, for his suggestions during the implementation of the study and to Dr. Meseret Zelalem, the Mother and Child Health Director FMoH, for her support and collaboration. Finally, we thank Jos M. Latour, Professor in Clinical Nursing at the University of Plymouth, author of the original EMPATHIC-N for granting us the permission to translate and adapt the questionnaire to the Ethiopian context.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fped.2021.738863/full#supplementary-material

References

1. Latour JM, van Goudoever JB, Hazelzet JA. Parent Satisfaction in the Pediatric ICU. Pediatr Clin North Am. (2008) 55:779–90. doi: 10.1016/j.pcl.2008.02.013

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Dall'Oglio I, Fiori M, Tiozzo E, Mascolo R, Portanova A, Gawronski O, et al. Neonatal intensive care parent satisfaction: a multicenter study translating and validating the Italian EMPATHIC-N questionnaire. Ital J Pediatr. (2018) 44:5. doi: 10.1186/s13052-017-0439-8

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Latour J, Hazelzet J, Goudoever J. Development and validation of a neonatal intensive care parent satisfaction instrument. Pediatr Crit Care Med. (2012) 13:554–9. doi: 10.1097/PCC.0b013e318238b80a

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Tsironi S, Bovaretos N, Tsoumakas K, Giannakopoulou M, Matziou V. Factors affecting parental satisfaction in the neonatal intensive care unit. J Neonatal Nurs. (2012) 18:183–92. doi: 10.1016/j.jnn.2011.11.005

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Ramezani T, Hadian Shirazi Z, Sabet Sarvestani R, Moattari M. Family-Centered care in neonatal intensive care unit: a concept analysis. Int J Community Based Nurs Midwifery. (2014) 2:268–78. Available online at: https://ijcbnm.sums.ac.ir/

PubMed Abstract | Google Scholar

6. Gallagher K, Shaw C, Aladangady N, Marlow N. Parental experience of interaction with healthcare professionals during their infant's stay in the neonatal intensive care unit. Arch Dis Child - Fetal Neonatal Ed. (2018) 103:F343–8. doi: 10.1136/archdischild-2016-312278

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Obeidat HM, Bond EA, Callister LC. The parental experience of having an infant in the newborn intensive care unit. J Perinat Educ. (2009) 18:23–9. doi: 10.1624/105812409X461199

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Gomez D, Vidal S, Lima L. Brazilian adaptation and validation of the Empowerment of Parents in the Intensive Care-Neonatology (EMPATHIC-N) questionnaire. J Pediatr. (2016) 93:156–64. doi: 10.1016/j.jped.2016.06.007

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Papamichael E, Ioannou M, Talias MA. EMPATHIC-N in a Greek-Cypriot sample: confirming its factorial structure. BMC Health Serv Res. (2018) 18:968. doi: 10.1186/s12913-018-3793-3

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Lake ET, Smith JG, Staiger DO, Schoenauer KM, Rogowski JA. Measuring parent satisfaction with care in neonatal intensive care units: the EMPATHIC-NICU-USA questionnaire. Front Pediatr. (2020) 8: 541573. doi: 10.3389/fped.2020.541573

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Mol C, Argent A, Morrow B. Parental satisfaction with the quality of care in a South African paediatric intensive care unit. South Afr J Crit Care. (2018) 34:51–8. doi: 10.7196/SAJCC.2018.v34i2.366

CrossRef Full Text | Google Scholar

12. Mengesha EW, Zelellw D, Asfaw L, Tesfa M, Debela M, Ambaw F. Parental Experiences in Neonatal Intensive Care Unit at Felege Hiwot Comprehensive Specialized Hospital, Bahir Dar, Ethiopia: A Phenomenological Study. (2020). doi: 10.21203/rs.3.rs-127179/v1

CrossRef Full Text | Google Scholar

13. Alemu AT, Walle AA, Atnafu DD. Quality of pediatric healthcare services and associated factors in Felege-Hiwot comprehensive specialized hospital, North-West Ethiopia: parental perception. Patient Prefer Adherence. (2020) 14:1649–58. doi: 10.2147/PPA.S264106

PubMed Abstract | CrossRef Full Text | Google Scholar

14. The Federal Democratic Republic of Ethiopia Ministry of Health. Health Sector Transformation Plan: 2015/16–2019/20. (2015). Available online at: https://ehia.gov.et/sites/default/files/Resources/HSTP%20Final%20Print%202015-11-27%20Print%20size.pdf (accessed: February 28, 2021).

Google Scholar

15. Asrat D, Girum S, Yohannes G, Yeshi B, Amina N, Askal A, et al. Clinical audit on neonatal care unit structure in five selected governmental hospitals of Addis Ababa, Ethiopia 2019. Int Arch Nurs Health Care. (2020) 6:140. doi: 10.23937/2469-5823/1510140

CrossRef Full Text | Google Scholar

16. Maternal and Child Health Directorate - Federal Ministry of Health. National Strategy for Newborn and Child Survival in Ethiopia. Available online at: https://www.healthynewbornnetwork.org/resource/national-strategy-newborn-child-survival-ethiopia/ (accessed: February 2, 2021).

Google Scholar

17. Irlam LK, Bruce JC. Family-Centred care in paediatric and neonatal nursing- a literature review. Curationis. (2002) 25:28–34. doi: 10.4102/curationis.v25i3.781

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Abay S, Addissie A, Davey G, Farsides B, Addissie T. Rapid ethical assessment on informed consent content and procedure in Hintalo-Wajirat, Northern Ethiopia: a qualitative study. PLoS ONE. (2016) 11:e0157056. doi: 10.1371/journal.pone.0157056

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Asamrew N, Endris AA, Tadesse M. Level of patient satisfaction with inpatient services and its determinants: a study of a specialized hospital in Ethiopia. J Environ Public Health. (2020) 2020:e2473469. doi: 10.1155/2020/2473469

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Getachew S, Tesfaw A, Kaba M, Wienke A, Taylor L, Kantelhardt EJ, et al. Perceived barriers to early diagnosis of breast Cancer in south and southwestern Ethiopia: a qualitative study. BMC Womens Health. (2020) 20:38. doi: 10.1186/s12905-020-00909-7

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Malako D, Yoseph F, Bekele ML. Assessment of knowledge, attitude and practice and associated factors of blood donation among health care workers in Ethiopia: a cross-sectional study. BMC Hematol. (2019) 19:10. doi: 10.1186/s12878-019-0140-9

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Hair JF Jr, Black WC, Babin BJ, Anderson RE. Multivariate Data Analisys. 7th Edn. Upper Saddle River, NJ: Prentice Hall (2009).

Google Scholar

23. Latour JM, Duivenvoorden HJ, Tibboel D, Hazelzet JA, EMPATHIC Study Group. The shortened EMpowerment of PArents in THe Intensive Care 30 questionnaire adequately measured parent satisfaction in pediatric intensive care units. J Clin Epidemiol. (2013) 66:1045–50. doi: 10.1016/j.jclinepi.2013.02.010

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, et al. Principles of good practice for the translation and cultural adaptation process for Patient-Reported Outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation. Value Health. (2005) 8:94–104. doi: 10.1111/j.1524-4733.2005.04054.x

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Gjersing L, Caplehorn JRM, Clausen T. Cross-cultural adaptation of research instruments: language, setting, time and statistical considerations. BMC Med Res Methodol. (2010) 10:13. doi: 10.1186/1471-2288-10-13

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Hagen IH, Vadset TB, Barstad J, Svindseth MF. Development and validation of neonatal satisfaction survey – NSS-13. Scand J Caring Sci. (2015) 29:395–406. doi: 10.1111/scs.12156

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Bentler PM. Comparative fit indexes in structural models. Psychol Bull. (1990) 107:238–46. doi: 10.1037/0033-2909.107.2.238

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Elo S, Kyngäs H. The qualitative content analysis process. J Adv Nurs. (2008) 62:107–15. doi: 10.1111/j.1365-2648.2007.04569.x

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Tiryaki Ö, Zengin H, Çinar N, Umaroglu MM, Latour JM. Turkish adaptation and validation of the EMpowerment of PArents in THe Intensive Care (EMPATHIC-30) questionnaire to measure parent satisfaction in neonatal intensive care units. Front Pediatr. (2020) 8:421. doi: 10.3389/fped.2020.00421

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Pilar Orive FJ, Basabe Lozano J, López Zuñiga A, López Fernández YM, Escudero Argaluza J, Latour JM. Spanish translation and validation of the EMPATHIC-30 questionnaire to measure parental satisfaction in intensive care units. An Pediatría Engl Ed. (2018) 89:50–7. doi: 10.1016/j.anpede.2017.08.006

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Perneger TV, Peytremann-Bridevaux I, Combescure C. Patient satisfaction and survey response in 717 hospital surveys in Switzerland: a cross-sectional study. BMC Health Serv Res. (2020) 20:158. doi: 10.1186/s12913-020-5012-2

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Gill FJ, Wilson S, Aydon L, Leslie GD, Latour JM. Empowering parents of Australian infants and children in hospital: translation, cultural adaptation, and validation of the EMpowerment of PArents in The Intensive Care-30-AUS questionnaire. Pediatr Crit Care Med. (2017) 18:e506–13. doi: 10.1097/PCC.0000000000001309

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Corchia C, Fanelli S, Gagliardi L, Bellù R, Zangrandi A, Persico A, Zanini R, SONAR-Nurse Study Group. Work environment, volume of activity and staffing in neonatal intensive care units in Italy: results of the SONAR-nurse study. Ital J Pediatr. (2016) 42:34. doi: 10.1186/s13052-016-0247-6

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Nguyen ATB, Nguyen NTK, Phan PH, van Eeuwijk P, Fink G. Parental satisfaction with quality of neonatal care in different level hospitals: evidence from Vietnam. BMC Health Serv Res. (2020) 20:238. doi: 10.1186/s12913-020-5070-5

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Negash AK, Negussie WD, Demissie AF. Patients' satisfaction and associated factors with nursing care services in selected hospitals, Northwest Ethiopia. Am J Nurs Sci. (2014) 3:34–42. doi: 10.11648/j.ajns.20140303.12

CrossRef Full Text | Google Scholar

36. Baliga BS, Ravikiran SR, Rao SS, Coutinho A, Jain A. Public-Private partnership in health care: a comparative cross-sectional study of perceived quality of care among parents of children admitted in two government district-hospitals, Southern India. J Clin Diagn Res JCDR. (2016) 10:SC05–09. doi: 10.7860/JCDR/2016/17124.7250

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Smith VC, Mao W, McCormick MC. Changes in assessment of and satisfaction with discharge preparation from the neonatal intensive care unit. Adv Neonatal Care. (2021) 21:E144–51. doi: 10.1097/ANC.0000000000000862

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Lake ET, Smith JG, Staiger DO, Hatfield LA, Cramer E, Kalisch BJ, et al. Parent satisfaction with care and treatment relates to missed nursing care in neonatal intensive care units. Front Pediatr. (2020) 8:74. doi: 10.3389/fped.2020.00074

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Keiza EM, Chege MN, Omuga BO. Assessment of parents' perception of quality of pediatric oncology inpatient care at Kenyatta National Hospital. Asia Pac J Oncol Nurs. (2017) 4:29–37. doi: 10.4103/2347-5625.199071

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Remtullah AZ, Sirili N, Anaeli A, Massawe A, Manji K, Sunguya BF. Quality of healthcare in acute pediatric care unit in a tertiary hospital in Tanzania: a case of Muhimbili National Hospital. Front Pediatr. (2020) 8:496. doi: 10.3389/fped.2020.00496

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Beyene W, Jira C, Sudhakar M. Assessment of quality of health care in Jimma Zone, Southwest Ethiopia. Ethiop J Health Sci. (2011) 21:49–58. Available online at: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3275883/ (Accessed May 11, 2021).

PubMed Abstract | Google Scholar

42. Hagen IH, Iversen VC, Nesset E, Orner R, Svindseth MF. Parental satisfaction with neonatal intensive care units: a quantitative cross-sectional study. BMC Health Serv Res. (2019) 19:37. doi: 10.1186/s12913-018-3854-7

PubMed Abstract | CrossRef Full Text | Google Scholar