- 1Department of Public Health, College of Health Sciences, Debre Tabor University, Debre Tabor, Ethiopia
- 2Department of Epidemiology and Biostatics, Institute of Public Health, College of Medicine and Health Sciences, University of Gondar, Gondar, Ethiopia
- 3Department of Public Health, College of Health Sciences, Woldia University, Woldia, Ethiopia
Background: Adverse birth outcomes are unfavorable outcomes of pregnancy that are particularly common in low- and middle-income countries. At least one ultrasound is recommended to predict adverse birth outcomes in early pregnancy. However, in low-income countries, imaging equipment and trained manpower are scarce. According to our search of the literature, there is no validated risk prediction model for predicting adverse birth outcomes in Ethiopia. Hence, we developed and validated a model and risk score to predict adverse birth outcomes using maternal characteristics during pregnancy for use in resource-limited settings.
Methods: A retrospective follow-up study was conducted from 1 January 2016 to 31 May 2021, and a total of 910 pregnant women were included in this study. Participants were selected using a simple random sampling technique. Stepwise, backward multivariable analysis was conducted. The model's accuracy was assessed using density plots, discrimination, and calibration. The developed model was assessed for internal validity using bootstrapping techniques and evaluated for clinical utility using decision curve analysis across various threshold probabilities.
Results: Premature rupture of Membrane, number of fetuses, residence, pregnancy-induced hypertension, antepartum hemorrhage, hemoglobin level, and labor onset remained in the final multivariable prediction model. The area under the curve of the model was 0.77 (95% confidence interval: 0.73–0.812). The developed risk prediction model had a good performance and was well-calibrated and valid. The decision curve analysis indicated the model provides a higher net benefit across the ranges of threshold probabilities.
Conclusion: In general, this study showed the possibility of predicting adverse birth outcomes using maternal characteristics during pregnancy. The risk prediction model using a simplified risk score helps identify high-risk pregnant women for specific interventions. A feasible score would reduce neonatal morbidity and mortality and improve maternal and child health in low-resource settings.
Background
Pregnancy outcomes can be positive or negative (adverse) (1). Adverse birth outcomes (ABO) are undesirable outcomes of pregnancy, which include low birth weight (LBW), birth asphyxia, small for gestational age, congenital anomalies, sepsis, intrauterine growth restriction (IUGR), preterm birth, and admission to the neonatal intensive care unit (2–4). Stillbirth, LBW, and preterm birth are the most common adverse pregnancy outcomes in low- and middle-income countries (LMICs), including Ethiopia (5–7).
Adverse birth outcomes are indicators of maternal health during pregnancy and at birth (8). Maternal health and nutritional status before and during pregnancy determine pregnancy outcomes (9). Globally, an estimated 210 million women become pregnant each year, and over 75 million pregnancies end in stillbirth or preterm birth (10). The literature shows that congenital anomalies, LBW, preterm birth, and maternal complications are responsible for 50.9% of infant deaths (11).
The chances of a newborn surviving, growing, maintaining long-term health, and developing psychosocially can all be predicted based on birth outcomes (12). The majority of the survivors experience frequent infections, sleep apnea, persistent lung diseases, anemia, jaundice, and respiratory distress (13). Adverse birth outcomes are also associated with increased fetal and neonatal morbidity and mortality, chronic disease in life, and long-term physical and psychological problems (14), and are strong biological predictors of developmental outcomes (15, 16). They also impose significant social and economic consequences on the family (17).
Adverse birth outcomes are significant public health problems and a leading cause of under-5 morbidity and mortality worldwide. The problem is highly prevalent in developing countries, including Ethiopia. Across the globe, an estimated 15 and over 20 million newborns are born preterm or with low birth weight, respectively (15, 16, 18). More than one million of these babies died shortly after birth, and countless others suffered from lifelong physical, neurological, psychological, and educational disabilities (15).
The most frequently reported causal factors linked to adverse birth outcomes include medical conditions and nutritional status of the mother or fetus, genetic influences, environmental exposure; infertility treatments, behavioral, socioeconomic and socio-demographic factors, and past and recent obstetric conditions (15, 19–22). Underlying maternal medical conditions and poor nutrition during pregnancy are responsible for 1.4 million stillbirths and 98% of perinatal mortalities in low- and middle-income countries (10, 23, 24). These are the most preventable and treatable contributors to adverse birth outcomes (5).
Government policies in recent years have emphasized maternal and child health by increasing input into the health system (25). Following the failure to achieve the Millennium Development Goal (reduction of under-5 mortality by two-thirds), a sustainable development goal (SDG) was established. The SDG targets the “end of preventable deaths of newborns and children under five, with all countries aiming to reduce neonatal mortality at least as low as 12 per 1,000 live births and under-five mortality as low as 25 per 1,000 live births” (26). According to the Ethiopia Demographic Health Survey (EDHS) report, neonatal mortality in Ethiopia showed a slight decline (from 39% to 33%) between 2005 and 2019 (27).
Various studies have been conducted on the prevalence of adverse birth outcomes and their contributing factors. However, according to our review of the literature, there are scarce studies on the forecasting of unfavorable Ethiopian birth outcomes. Numerous researchers have also recommended further research to identify novel ways to manage third-trimester pregnant women in low-resource settings who are more likely to have an unfavorable pregnancy outcome (28).
Risk prediction models for adverse birth outcomes have been developed in high-resource settings. In a study conducted to develop a risk score model for predicting the risk of adverse birth outcomes, the discriminative power of the area under the receiver operating characteristics curve (AUROC) was 0.79 and the cutoff point was 20%, with a sensitivity of 29%, specificity of 82%, and positive and negative predictive values of 22% and 85%, respectively (29). A Ugandan study found that it was impossible to predict adverse perinatal outcomes, and the model performance AUROC was 0.66 (30). However, in low-resource contexts, such as Ethiopia, the predictors they utilized, such as laboratory markers, are not typically carried out. Therefore, it is crucial to create a risk prediction model for adverse birth outcomes in the context of our nation, Ethiopia. As a result, our goal was to develop and validate a model for predicting the likelihood of unfavorable delivery outcomes in pregnant women who attend antenatal care (ANC) visits at the Comprehensive and Specialized Hospital of the University of Gondar (UOGCSH). Therefore, researching the risk of adverse birth outcomes in pregnant women plays a crucial role in diagnosis, prediction, and the creation and implementation of effective interventions among high-risk populations. To ensure positive outcomes, it is beneficial for healthcare professionals to plan, launch, and intervene with healthcare services early rather than late during an emergency. It aids in the planning and delivery of quality healthcare services by policymakers. In addition, by recognizing high-risk mothers and offering them care, it is possible to lower the prevalence of poor newborn outcomes, preventable neonatal illness, and mortality at the local, regional, national, and worldwide levels.
Methods
Study aim, design, and setting
The aim of the research was to develop and validate a model for predicting the likelihood of unfavorable delivery outcomes in pregnant women who attend ANC visits at the UOGCSH. A retrospective follow-up study design was applied. The hospital is one of the largest tertiary-level teaching and referral hospitals in Ethiopia and is found in Gondar Town. Gondar is located 737 km away from Addis Ababa, the capital city of Ethiopia. The study was conducted from 1 January 2016 to 21 May 2021. The hospital serves as a referral center for 7 million people in the administrative zone and the residents in the surrounding areas. Gynecology and Obstetrics is one of the major departments in the School of Medicine in the hospital. Antenatal care and delivery services are among the services provided in the hospital at no cost. During the study period, 15,680 women received prenatal care at UOGCSH. There were 9,040 pregnant women who received antenatal care and gave birth there in total. The hospital has 20 senior gynecologists, 58 residents, and 178 midwives.
Study variables and data collection procedure
Adverse birth outcome (Yes or No) was the dependent variable for this study. The independent variables were socio-demographic characteristics (maternal age, marital status, and place of residence), antenatal characteristics [time of initiating ANC visit, hemoglobin (HGB) level during pregnancy, pregnancy status, amniotic fluid index, number of ANC visits, antepartum hemorrhage (APH), premature rupture of membranes (PROM), pregnancy-induced hypertension (PIH), gestational diabetes mellitus (GDM), number of the fetuses, presentation, and lie of the fetus], medical conditions [urinary tract infection (UTI), human immune virus (HIV), chronic hypertension, and other comorbidities], and labor and delivery characteristics (duration of labor, onset of labor, and mode of delivery).
After receiving ethical approval from the University of Gondar's Institutional Review Board (IRB) and consent from the UOGCSH's medical director and midwifery department head, the data were accessed from the records. We could not obtain consent from study subjects because it was secondary data. From 20 March to 21 May 2021, eight BSc midwives collected data by evaluating charts from individual records using a structured data extraction checklist and were supervised by two recruited MSc midwives and a primary investigator.
Operational definition
ABO: Women who had at least one of the following birth outcomes: stillbirth, low birth weight, preterm birth, and congenital anomaly (31).
Preterm birth: Defined as the birth of a neonate with a gestational age above 28 weeks but below 37 weeks (20).
Congenital anomaly: Refers to when a newborn is recorded as having any body parts with congenital defects (32).
Stillbirth: A baby born with no signs of breathing after weeks gestation (31)
Low birth weight: Defined as a birth weight less than 2,500 g (33).
Data processing and analysis
The collected data were cleaned and cross-checked for completeness and consistency. The data were entered into Epi-Data version 4.6 statistical software and exported to STATA version 14 and R version 4.05 for analysis. Since missing data occurred at random, multiple imputations were used to fill up the gaps. Hemoglobin level, family planning, marital status, the start of labor, amniotic fluid index, and pregnancy status were among the predictors that were imputed, with 34 (3.7%), 20 (2.2%), 13 (1.4%), 13 (1.4%), 87 (9.6%), and 16 (1.8%) missing values respectively. The variance inflation factor was used to check for multicollinearity among the independent predictors.
To identify the predictors of adverse birth outcomes, a binary logistic regression model was used. The multivariable binary logistic regression analysis took into account variables from the bivariate binary logistic regression analysis with p-values <0.25. Using the log-likelihood ratio test >0.15, a stepwise backward multivariable analysis was performed starting with the full model to obtain the final reduced model. Given that the prognostic model was similar to a full multivariable model for the outcome variable, a p-value cutoff value of 0.15 was created to prevent the rejection of potentially significant variables in the absence of confounding adjustment.
Risk prediction model development and validation for ABO
The developed risk prediction model was used to predict the risk of adverse birth outcomes. The occurrence relationship was established based on the identified predictor variables:
The determinants were PIH, APH, PROM, number of fetuses, hemoglobin level, the onset of labor, and residence, and the domain was pregnant women.
The significant factors from the final reduced model were used to create a simple risk score that served as the foundation for the risk prediction model. The coefficients were divided by the lowest coefficient and rounded to the nearest integer for the purpose of creating easily usable adverse birth outcome risk prediction scores from the findings of the multivariable binary logistic regression
Finally, total risk scores were determined by adding up the scores of each variable effect for individuals (29, 34). The Youden index was used to estimate the cutoff point for the predicted probability of an adverse birth outcome and risk stratification based on the developed clinical prediction model (35). Sensitivity analysis was conducted on the different cutoff points to classify low-risk and high-risk pregnant women. Sensitivity, specificity, negative predictive value, and positive predictive value were calculated for the clinical performance evaluation of the model (36).
The model performance was evaluated by its discrimination and calibration ability. Calibration characterized model performance in terms of the agreement between predicted and observed risk for adverse birth outcomes using the “givitiR” package in “R” software. The calibration ability of the model was statistically evaluated, if it was significant it had good predictive ability. This was depicted graphically with a calibration plot with a 45° inclination at the intercept of 0 and slope 1 [ratio of observed and expected equal to one (O/E = 1)] as the best possible calibration (29).
Discrimination (ability to discriminate adverse outcomes from no adverse outcomes) was evaluated based on AUROC with a 95% confidence interval (CI). A ROC curve is used to assess the performance of the categorical classifiers using the “ROCit” and “pROC” packages in R software with the plot of sensitivity (true positive rate) vs. 1 − specificity (false positive rate). Bootstrapping with 10,000 samples was resampled with replacements from the dataset with complete predictors to assess the internal validation. A decision curve for our model was included to aid clinical decision-making based on a risk threshold preference (37) for public health impact and clinical utility of the developed model. Finally, the results were presented using statements, tables, and figures and reported according to the transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD) statement (38).
Results
Baseline socio-demographic, reproductive history, and medical characteristics of the study participants
A total of 910 pregnant women who had an ANC visit were included in this study, with a response rate of 98.5%. The median age of the mothers was 26 years, with an interquartile range (IQR) of 22–30 years. The majority (746, 81.98%) of the mothers were between the ages of 20 and 34 years. More than three-fourths (809, 88.90%) of the mothers were urban residents, and 868 (95.38%) mothers were also married. Furthermore, 93 (10.22%) participants had medical illnesses. Of these, 59 (63.4%) and 31 (33.3%) mothers had urinary tract infections and were seropositive for HIV, respectively (Tables 1–3).
Table 1. Socio-demographic characteristics of the pregnant women who had ANC visits at UOGCSH, Ethiopia, 2016–2020 (n = 910).
Table 2. Maternal reproductive history and birth characteristics of the pregnant women who had ANC visits at UOGCSH, 2016–2020.
Recent antenatal characteristics, pregnancy complications, and labor and delivery characteristics
In this study, 491 (53.96%) of the mothers initiated ANC visits in the second trimester of their pregnancy. Nearly two-thirds (571, 62.5%) of the mothers had four or more ANC visits for their most recent pregnancy. Furthermore, 65 (7.14%) had low hemoglobin levels and 857 (94.2%) women had pregnancies that were planned and wanted. Moreover, 202 (22.2%) of the mothers had recent pregnancy complications, of which 74 had PIH (36.6%), 67 had PROM (33.2%), and 57 had APH (27.2%). In total, 888 (97.58%) pregnant women had singleton pregnancies and 866 (95.16%) had a normal presentation (vertex). A majority, (816, 89.67%) of the mothers initiated their labor spontaneously and 305 (33%) mothers had prolonged labor (Tables 4,5).
Table 4. Antenatal characteristics of the pregnant women in their recent pregnancy who attended the ANC unit at the UOGCSH, 2016–2020.
Table 5. Recent pregnancy complications and labor and delivery characteristics of the pregnant women who had ANC visits at UOGCSH, 2016–2020.
Incidence of adverse birth outcome
The incidence of adverse birth outcomes was 21.43% (95% CI: 18.79–24.2), of which approximately 14.29% had one adverse birth outcome. The most common adverse birth outcomes were low birth weight (12.42%), preterm delivery (11.87%), stillbirth (5.16%), and congenital anomaly (1.65%). Anencephaly and hydrocephalus are the most common congenital anomalies (Table 6).
Table 6. The incidence of adverse birth outcomes among pregnant women who had ANC visits at UOGCSH from 2016 to 2020.
Model development and validation
The demographic, medical, recent antenatal care and related conditions, delivery, and labor characteristics of the mothers were considered for the development of a prediction model for adverse birth outcomes. Underlying medical illness, PROM, number of fetuses, residence, PIH, APH, hemoglobin level, gestational diabetes mellitus, prolonged labor, and presentation had a p-value of equal or less than 0.25 in the bivariable binary logistic regression analysis. However, underlying medical illness, prolonged labor, presentation (Table 7), and GDM were excluded from the multivariable binary logistic regression analysis using the likelihood ratio test at a p-value >0.15. The goodness of fit test for the fitted model resulted in an insignificant value of 0.999 (Table 8).
Table 7. The univariable analysis for adverse birth outcomes among the pregnant women who had ANC visits at UOGCSH, 2016–2020.
Table 8. Multivariable binary logistic regression coefficients and risk scores for variables retained in the final reduced model for the prediction of adverse birth outcomes among the pregnant women attending the ANC at UOGCSH, 2016–2020.
Risk prediction model development
The model was created using the original beta coefficient and a simplified risk score. The calibration and discrimination of the developed model were evaluated. Discrimination (the capacity to distinguish between a bad outcome and no negative consequence) was evaluated using the AUROC with a 95% CI. The final model we examined was more capable of discrimination.
AUROC and calibration
Individual predictors in the final reduced model performed poorly in identifying pregnant women at risk for adverse birth outcomes, with AUROC values ranging from 0.57 to 0.65. However, when combined, they showed good discrimination. When the APH, PROM, and hemoglobin level AUROC values were combined, the predictive performance was 0.69 (95% CI: 0.64–0.72); when APH, PIH, HGB, and PROM were combined, it was 0.72 (95% CI: 0.67–0.76). Finally, the area under the ROC of the final reduced model using seven predictors was 76.85% (95% CI: 72.7%–80.97%) using the original beta coefficients (Figure 1). The linear predictors using the beta coefficient were calculated as follows:
Figure 1. The ROC curve represents the probability of risk for adverse birth outcomes among women who had ANC visits at UOGCSH, 2016–2021.
The developed model was well-calibrated (p = 0.66), which indicates that the model well represented the data (there was agreement between the observed outcomes and the predicted probability) (Figure 2).
Figure 2. Calibration plot for the developed model based on the original beta coefficients for the risk prediction model for pregnant women who received ANC at UOGCSH, 2026–2021.
The cutoff point for the probability of ABO
The best cutoff point for the predicted probability of an adverse birth outcome using the beta coefficients of the predictor variables was 0.2139 (Table 9), and the specificity, sensitivity, negative predictive, and positive predictive values were, respectively, 83.9%, 67.54%, 90%, and 53%. In addition, the accuracy was 83.3%, and the kappa was 0.4 (Figure 3).
Table 9. Performance of the prediction model based on the original beta coefficients at different cutoff points for the pregnant women who received ANC at UOGCSH, 2016–2020.
Figure 3. Prediction density plot for developed model using original beta coefficients at UOGCSH, 2016–2020.
Prediction model development using simplified risk scores
The final reduced model's significant regression coefficients were all employed to construct a model with a streamlined risk score. The calibration had a p-value of 0.782, and the AUROC for the condensed risk score prediction model was 77% (95% CI: 73%–81.2%) (Figure 4). For the development of the prediction model, we selected the simplified risk score over the original beta coefficient since it was simpler, needed little adjustment, and was simple to apply.
Model validation
The bootstrapping technique was employed to validate the model to check for overfitting and bias. Based on the bootstrap dataset coefficients, the AUROC was evaluated while taking the risk score and bias into account. Actual performance minus expected performance, which was 0.01, was also used to construct the optimism-corrected estimate. The optimistic coefficient (pooled bias) for the model with the coefficient result was 0.009137, and the area under the curve (AUC) was 0.769 (95% CI: 0.7299–0.8076). The model's performance was 0.769 (95% CI: 0.730–0.808), after optimism was corrected for (Figure 5).
Figure 5. Area under the ROC curve for the prediction model for the bootstrapped sample, UOGCSH, 2016–2021.
Risk classification for ABO using a simplified risk score
We created a simplified risk score from the model using all the regression coefficients in the reduced model for easy practical utility. The model developed using the risk score outperforms the model developed using the original beta coefficient, with an AUC of 0.77.4 (95% CI: 0.73.6–0.812). The minimum and maximum possible scores were 0 and 13. The proportion of adverse birth outcomes in the group of pregnant women at low-risk (score 2) was 55 (9.04%), there were 74 (35.1%) in the intermediate-risk (scores 2–4) group, and 66 (72.5%) in the high-risk group (score 4) (Table 10).
Table 10. Risk classification for adverse birth outcome based on the simplified risk scores (n = 910) among the pregnant women who received ANC at UOGCSH, 2016–2020.
The optimal cutoff point was suggested by the Youden index, and thus, pregnant women who scored 2 were classified as low-risk, and pregnant women who scored 2 and above were classified as having a higher risk of an adverse birth outcome. When we dichotomized high-risk (2) and low-risk (2) based on the risk scores, 302 (33.2%) pregnant mothers were at high risk and 608 (66.8%) pregnant mothers were at low risk for an adverse birth outcome. The sensitivity, specificity, positive predictive, and negative predictive values of the risk scores at the optimal cutoff value were 71.79%, 77.79%, 46.4%, and 90%, respectively, with a positive likelihood ratio of 3.16 and a negative likelihood ratio of 0.36 (Table 11).
Table 11. Performance of the risk score at different cutoff points for adverse birth outcomes among the pregnant women who attended the antenatal care unit at UOCSH from 2016 to 2020.
Decision curve analysis
The AUC, sensitivity, specificity, and accuracy were used to assess the model's performance, but decision curve analysis (DCA) was used to assess the model's clinical and public health utility. Using a probability threshold of greater than 0.15, the developed model (Model 5) demonstrates the highest net benefit compared to two alternative strategies: referring all individuals regardless of risk (represented by the horizontal black line) and referring none (illustrated by the vertical line close to the red line). The model has a similar net benefit to those referring to all patients regardless of their risk across thresholds ranging from 0 to 0.15 (Figure 6).
Figure 6. Decision curve analysis of the developed model. The net benefit vs. threshold probability between the model and two extreme scenarios at UOGCSH, 2016–2021, is plotted.
Discussion
The incidence of adverse birth outcomes was 21.43% (95% CI: 18.79%–24.2%). The most common adverse birth outcomes were low birth weight (12.42%), preterm birth (11.87%), stillbirth (5.16%), and congenital anomaly (1.65%). The incidence of adverse birth outcomes in this study was high even when we excluded the referred pregnant women from the study population (39). However, the overall and individual outcome incidences in Ethiopia are consistent with findings from other systematic reviews and meta-analyses: 26.88% (32) and 23% (15) in Gondar. The finding in this study was lower than in studies conducted in North Wollo, with 31.8% (32), and Gondar, with 23% (15). The finding in this study was also lower than studies conducted in North Wollo, with 31.8% (40), Dessie, with 32.5% (31), and Brazil, with 41.8% (41). However, it was higher than findings from Hawassa, with 18.5% (42), and Kembata Tembaro, with 13.5% (43). This disparity might be due to differences in the study period and design, place of delivery, quality of maternal service utilization, and population included in the study (43).
The combined maternal characteristics used to predict the risk of an adverse birth outcome were residence, antepartum hemorrhage, pregnancy-induced hypertension, premature rupture of membranes, hemoglobin level during pregnancy, multiple gestations, and the onset of labor.
In this study, pregnancy-induced hypertension was a significant predictor for adverse birth outcomes; women who had pregnancy-induced hypertension were at increased risk for an adverse birth outcome. The finding was supported by studies conducted in Tigray, Dessie, China, Iran, and Zimbabwe (2, 31, 44–46). Pregnancy-induced hypertension puts women at a higher risk for organ failure and cardiovascular disorders, both of which affect maternal and fetal health outcomes (47).
Premature rupture of membranes also had a significant association with adverse birth outcomes. Women who had premature rupture of membranes are more likely to have an adverse birth outcome than women who do not. The finding is supported by studies conducted in Kembata in the southern part of Ethiopia, and Debre Tabor (43, 48). This could be due to amniotic fluid, which is necessary for fetal movement and lung expansion and may influence birth outcomes (49).
Low hemoglobin (anemia) during a recent pregnancy was also linked to a poor birth outcome. Similarly, studies conducted in Gondar, Hosanna, and Tigray (10, 15, 50) reported that anemia was significantly associated with adverse birth outcomes. Similarly, this finding is also consistent with findings from Ghana and Pakistan (6, 51). This might be due to the poor nutritional status of the mother and not having sufficient meals during pregnancy, which might cause micronutrient deficiency during pregnancy that has been shown to have serious implications for fetal outcomes. As a result, mothers with anemia or low hemoglobin were more likely to have an adverse birth outcome.
Multiple gestation was a significant predictor for adverse birth outcomes. The finding was consistent with studies conducted in Brazil (29, 52, 53), and it also had a predictive effect when combined with other predictors according to a study by Medicaid in the United States of America (29). Having multiple gestation causes pregnancy complications that cause unfavorable maternal and fetal outcomes. This implies that all requirements (such as nutrition) during a multiple gestation pregnancy are greater than during a singleton pregnancy.
An antepartum hemorrhage in a recent pregnancy was a significant predictor of having an adverse birth outcome. This finding was consistent with previous research, which found that having an antepartum hemorrhage was associated with a higher risk of adverse birth outcomes than not having an antepartum hemorrhage (40, 54, 55).
Induced labor was associated with a poor birth outcome. Pregnant women who were induced were more likely to have an adverse pregnancy outcome than women who went into labor naturally. The finding was consistent with a study from Australia that showed that the induction of labor was associated with an adverse pregnancy outcome (56, 57).
The WHO recommends at least one ultrasound for every pregnant woman before 24 weeks of gestation to estimate fetal outcomes (58, 59). This retrospective follow-up study was conducted to develop a prediction model for adverse birth outcomes for pregnant women attending an antenatal care visit at UOGCSH using maternal characteristics. Even though a risk prediction model cannot replace ultrasound for assessing adverse birth outcomes, we can apply it in clinical settings that do not have access to ultrasound or other invasive procedures or investigations.
Individual predictors with discriminating ability in pregnant women for risk of an adverse birth outcome performed poorly, but their combined effect performed well. The final model had good discriminative power, with an AUROC of 0.768 based on the coefficients, and when the internal validity bias was corrected for the performance was 0.769. When based on the risk score, the performance of the predictive model was 0.774. When using the simplified risk score, its ability to discriminate between pregnant women at higher and lower risk for adverse birth outcomes was 77%.
We prefer a simplified risk score predictive model for the sake of simplicity, ease of use in clinical settings, particularly in our country, and improved performance. This could aid in identifying women at higher risk of adverse birth outcomes who require additional management, monitoring, and intervention.
In a study conducted for the prediction of adverse pregnancy outcomes by Medicaid, a prediction model was created with development and validation AUROCs of 0.79 and 0.63, respectively (29). In addition, they validated the model using the sample-split technique, and the performance in validation was lower than the performance in development (the sample sizes were 146 vs. 263). The reason for this could be that sample splitting has limitations due to its inability to quantify the optimism coefficient and the small sample size with many predictors, which results in model over- or underestimation. However, the bootstrapping validation technique was used to validate our model, which measures performance by quantifying the optimism coefficient and also by making the results valid with an adequate sample size (29).
Another study found an AUROC of 0.596 for predicting adverse pregnancy outcomes (60). Internal validation with bootstrapped AUROC was 0.593, and in both development and validation the discrimination performance was poor and the predictors used for the model development were serum biomarkers, including alpha-fetoprotein, human chronic gonadotrophin, and unconjugated estriol. Similarly, in a study conducted in Brazil, the model performance for predicting adverse birth outcomes was 0.699 (41). Our model has higher predictive performance than these studies; this might be due to the fact that the predictors used for model development had a lower contribution to risk discrimination. Furthermore, in the aforementioned studies, the predictors were not easily accessible, needed additional investigation, and were difficult to apply in our setting even if they had good performance.
In a study conducted to validate a risk prediction model for adverse perinatal outcomes in the Netherlands, the development performance was 0.58 and the validation performance was 0.61 (61). Even if the model were valid, its performance in discriminating between low and high risk was poor, but our model has good performance.
The cutoff point for the probability of risk for adverse birth outcomes in our model based on the coefficients was 21% with specificity, sensitivity, negative predictive, and positive predictive values of 83.9%, 67.54%, 90%, and 53%, respectively. The positive likelihood ratio was 4.2 and the negative likelihood ratio was 0.38. The accuracy was 80.3%. In the study conducted by Medicaid, the cutoff point for risk of adverse outcomes was 20% with a sensitivity of 29% and specificity of 82% (29). This finding exhibited lower sensitivity compared to our study, which could result in a higher number of false negatives. This limitation makes it challenging to rule out a high likelihood of an adverse birth outcome (ABO). Consequently, the increased false negatives could significantly hinder the prevention of adverse outcomes, even if the cutoff point is similar to that of our model.
To evaluate the clinical and public health impact of our model, we performed DCA. Even though the model performance was assessed in terms of discrimination and calibration, it may not be used in clinical settings unless it has clinical importance. Our model assumes the referral of pregnant women who are at higher risk of adverse pregnancy outcomes for further management and control. DCA compares the developed model with two extreme scenarios, namely, referring all women and not referring all women regardless of their risk. The developed model had the highest net benefit ratio starting from a threshold probability >0.15 compared to not referring all and referring all regardless of their risk. The model had a similar net benefit to the model referring all regardless of their risk across thresholds ranging from 0 to 0.15. This indicates that a referral decision can be made based on the developed model for optimal treatment and that the model has clinical and public health value.
Strengths and limitations of the study
The strengths of this study include the fact that we used an adequate sample size (adequate number of participant outcomes) for predicting adverse birth outcomes. Second, the model was developed based on easily accessible and measurable maternal characteristics and is applicable in any clinical setting. Third, the internal validity of the developed model was assessed by bootstrapping. Even though the study was conducted as a follow-up study, there were limitations due to the fact that it was based on secondary data. Some variables were omitted, but they have been reported in the literature as important predictors of adverse birth outcomes. The second limitation was that a mother could be counted twice if she had two pregnancies with different card numbers. There were also missed registrations in the logbooks that were used to create a picture of the study population. The final limitation was that we developed the model in a single area. Thus, we need external validation to confirm the model’s transportability and be able to apply it in other areas, especially primary healthcare institutions.
Conclusion
This study revealed that the incidence of adverse birth outcomes was high. Residence, hemoglobin level, antepartum hemorrhage, pregnancy-induced hypertension, premature mature rupture of membranes, multiple gestation, and onset of labor were all found to be significant predictors of adverse birth outcomes and were retained in the final reduced model for model development.
The risk prediction model was developed based on readily available maternal characteristics using the original beta coefficients and a simplified risk score. The model had good predictive performance and was well-calibrated in both prediction models. The model was internally valid with a low optimism coefficient. The final model used for risk stratification was a simplified risk score model. A feasible risk score would reduce neonatal morbidity and mortality and improve maternal and child health. The developed model has clinical and public health potential for referring high-risk pregnant women for specific management aimed at promoting favorable birth outcomes.
The risk score for predicting adverse birth outcomes can be integrated into maternal health programs by assessing risk during antenatal care, offering targeted interventions, using digital tools such as mobile health applications, training healthcare workers, and incorporating it into national and global health guidelines to improve maternal and child health outcomes.
Therefore, the predictive model using a simplified risk score will help stratify the risk of ABOs among pregnant women for future management and promote favorable outcomes.
Data availability statement
The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author.
Ethics statement
The studies involving humans were approved by the Institutional Review Board of University of Gondar (reference number: IPH/1458/2013. A formal letter of cooperation was written to UOGCSH and permission was obtained from the chief executive director of the University of Gondar Comprehensive and Specialized Hospital. Personal identifiers were not used on the data collection checklist. The studies were conducted in accordance with the local legislation and institutional requirements. Written informed consent for participation was not required from the participants or the participants' legal guardians/next of kin in accordance with the national legislation and institutional requirements.
Author contributions
RA: Methodology, Writing – original draft, Writing – review & editing, Conceptualization, Data curation, Formal Analysis, Investigation, Software. GT: Methodology, Writing – original draft, Writing – review & editing, Supervision, Visualization. AL: Methodology, Supervision, Visualization, Writing – original draft, Writing – review & editing, Validation. SF: Methodology, Supervision, Visualization, Writing – original draft, Writing – review & editing.
Funding
The author(s) declare that no financial support was received for the research, authorship, and/or publication of this article.
Acknowledgments
We would like to acknowledge the University of Gondar and Debre Tabor University, College of Medicine and Health Science, Institute of Public Health, for giving us the chance to develop this thesis and for providing Internet access. Finally, we would like to extend our thanks to all data collectors and the University of Gondar staff.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fgwh.2024.1458457/full#supplementary-material
Abbreviations
ABO, adverse birth outcome; AIDS, acquired immune deficiency syndrome; APH, antepartum hemorrhage; AUROC, area under the receiver operating characteristic curve; DCA, decision curve analysis; EDHS, Ethiopia Demographic Health Survey; HGB, hemoglobin; HIV, human immune virus; IUGR, intrauterine growth restriction; LBW, low birth weight; LMIC, low- and middle-income country; PIH, pregnancy-induced hypertension; PROM, premature rupture of membranes; UOGCSH, University of Gondar Comprehensive and Specialized Hospital.
References
1. Yeshialem E, Abera M, Tesfay A. Determinants of adverse pregnancy outcomes among mothers who gave birth from Jan 1-Dec 31/2015 in Jimma University specialized hospital, case control study, 2016. Ethiopian J Reprod Health. (2019) 11(1):10. doi: 10.69614/ejrh.v11i1.235
2. Berhe AK, Ilesanmi AO, Aimakhu CO, Mulugeta A. Effect of pregnancy induced hypertension on adverse perinatal outcomes in Tigray regional state, Ethiopia: a prospective cohort study. BMC Pregnancy Childbirth. (2020) 20(1):1–11. doi: 10.1186/s12884-019-2708-6
3. Amjad S, MacDonald I, Chambers T, Osornio-Vargas A, Chandra S, Voaklander D, et al. Social determinants of health and adverse maternal and birth outcomes in adolescent pregnancies: a systematic review and meta-analysis. Paediatr Perinat Epidemiol. (2019) 33(1):88–99. doi: 10.1111/ppe.12529
4. Agrawal S, Khoiwal S, Jayant K, Agarwal R. Predicting adverse maternal and perinatal outcome after threatened miscarriage. Open J Obstet Gynecol. (2014) 4(1):1–7. doi: 10.4236/ojog.2014.41001
5. Mekonnen M, Bekele K, Tasew A, Beker J, Kadir M, Kibru M, et al. Prevalence and risk factor for poor pregnancy outcome among married women, in Fafan zone, Somali region, eastern Ethiopia. Health Sci J (2018) 12(6):610. doi: 10.21767/1791-809X.1000610
6. Abubakari A, Taabia FZ, Ali Z. Maternal determinants of low birth weight and neonatal asphyxia in the upper west region of Ghana. Midwifery. (2019) 73:1–7. doi: 10.1016/j.midw.2019.02.012
7. Althabe F, Bhutta Z, Blencowe H, Chandra-Mouli V, Chou D, Costello A, et al. In: Christopher Howson MK, Joy L, editors. Born Too Soon: The Global Action Report on Preterm Birth. Geneva, Switzerland: WHO (2012).
8. Mitra M, Clements KM, Zhang J, Iezzoni LI, Smeltzer SC, Long-Bellil LM. Maternal characteristics, pregnancy complications and adverse birth outcomes among women with disabilities. Med Care. (2015) 53(12):1027–32. doi: 10.1097/MLR.0000000000000427
9. Abu-Saad K, Fraser D. Maternal nutrition and birth outcomes. Epidemiol Rev. (2010) 32:5–25. doi: 10.1093/epirev/mxq001
10. Abdo RA, Endalemaw TB, Tesso FY. Prevalence and associated factors of adverse birth outcomes among women attended maternity ward at Negest Elene Mohammed Memorial General Hospital in Hosanna Town, SNNPR, Ethiopia. J Women’s Health Care. (2016) 5(4):1000324. doi: 10.4172/2167-0420.1000324
11. Anderson JE, Ebrahim S, Floyd L, Atrash H. Prevalence of risk factors for adverse pregnancy outcomes during pregnancy and the preconception period—United States, 2002–2004. Matern Child Health J. (2006) 10(5 Suppl):S101–106. doi: 10.1007/s10995-006-0093-z
12. Zenebe K, Awoke TA, Birhan N. Low birth weight & associated factors among newborns in Gondar town, north west Ethiopia: institutional based cross-sectional study. Indo Global Journal of Pharmaceutical Sciences. (2014) 4(2):74–80. doi: 10.35652/IGJPS.2014.110
13. Forest S. Epidemiology (Centers for Disease Control and Prevention [CDC], 2017; March of Dimes, 2018). Core Curriculum for Neonatal Intensive Care Nursing E-Book. (2020) 22:377.
14. Chaibva BV. Determinants of Adverse Pregnant Outcomes in Mutare District Clinics, Manicaland Province, Zimbabwe. Pretoria: University of Pretoria (2014).
15. Adane AA, Ayele TA, Ararsa LG, Bitew BD, Zeleke BM. Adverse birth outcomes among deliveries at Gondar University hospital, northwest Ethiopia. BMC Pregnancy Childbirth. (2014) 14:90. doi: 10.1186/1471-2393-14-90
16. Bailey BA, Byrom AR. Factors predicting birth weight in a low-risk sample: the role of modifiable pregnancy health behaviors. Matern Child Health J. (2007) 11(2):173–9. doi: 10.1007/s10995-006-0150-7
17. Ashford L. Hidden Suffering: Disabilities from Pregnancy and Childbirth in Less Developed Countries. Washington, DC: Population Reference Bureau (2002).
18. Howson CP, Kinney MV, McDougall L, Lawn JE, Born Too Soon Preterm Birth Action Group. Born too soon: preterm birth matters. Reprod Health. (2013) 10(Suppl 1):S1. doi: 10.1186/1742-4755-10-S1-S1
19. Beck S, Wojdyla D, Say L, Betran AP, Merialdi M, Requejo JH, et al. The worldwide incidence of preterm birth: a systematic review of maternal mortality and morbidity. Bull World Health Organ. (2010) 88(1):31–8. doi: 10.2471/BLT.08.062554
20. Goldenberg RL, Culhane JF, Iams JD, Romero R. Epidemiology and causes of preterm birth. Lancet. (2008) 371(9606):75–84. doi: 10.1016/S0140-6736(08)60074-4
21. Lakew D, Tesfaye D, Mekonnen H. Determinants of stillbirth among women deliveries at Amhara region, Ethiopia. BMC Pregnancy Childbirth. (2017) 17:35. doi: 10.1186/s12884-017-1573-4
22. Lolaso T, Oljira D, Dessie D. Magnitude of Adverse Birth Outcome and Associated Factors among Mothers Delivering in Public Health Institutions of Kembata Tembaro Zone, Southern Ethiopia. Harar: Haramaya University (2017).
23. Yeshambel A, Anmut W. Prevalence of Eclampsia and its Maternal-fetal outcomes at Gandhi Memorial Hospital, Addis Ababa Ethiopia, 2019. Retrospective study. Res Sq. (2020). doi: 10.21203/rs.3.rs-33298/v1
24. Hornstra G, Uauy R, Yang X. The Impact of Maternal Nutrition on the Offspring, Vol. 55. Basel: Karger Medical and Scientific Publishers (2005).
25. Rono J, Kamau L, Mangwana J, Waruguru J, Aluoch P, Njoroge M. A policy analysis of policies and strategic plans on Maternal, Newborn and Child Health in Ethiopia. Int J Equity Health. (2022) 21:73. doi: 10.1186/s12939-022-01656-x
26. Ethiopian Health sector transformation plan II (2020/21–2024/25). (2021). Available online at: https://www.globalfinancingfacility.org/sites/default/files/Ethiopia-HSTP-II.pdf (accessed December 11, 2024).
27. World Health Organization. A Vision for Primary Health Care in The 21st Century: Towards Universal Health Coverage and The Sustainable Development Goals. Geneva: World Health Organization (2018).
28. Ephi I. Ethiopia Mini Demographic and Health Survey 2019: Key Indicators. Rockville, MD: EPHI and ICF (2019).
29. Raghuraman N, March MI, Hacker MR, Modest AM, Wenger J, Narcisse R, et al. Adverse maternal and fetal outcomes and deaths related to preeclampsia and eclampsia in Haiti. Pregnancy Hypertens. (2014) 4(4):279–86. doi: 10.1016/j.preghy.2014.09.002
30. Goyal NK, Hall ES, Greenberg JM, Kelly EA. Risk prediction for adverse pregnancy outcomes in a Medicaid population. J Womens Health (Larchmt). (2015) 24(8):681–8. doi: 10.1089/jwh.2014.5069
31. Ngwenya S, Jones B, Mwembe D, Nare H, Heazell A. The predictive value of signs and symptoms in predicting adverse maternal and perinatal outcomes in severe preeclampsia in a low-resource setting, findings from a cross-sectional study at Mpilo Central Hospital, Bulawayo, Zimbabwe. Pregnancy Hypertens. (2020) 21:77–83. doi: 10.1016/j.preghy.2020.05.004
32. Cherie N, Mebratu A. Adverse birth out comes and associated factors among delivered mothers in Dessie Referral Hospital. North East Ethiopia. (2018):1–6.
33. Gedefaw G, Alemnew B, Demis A. Adverse fetal outcomes and its associated factors in Ethiopia: a systematic review and meta-analysis. BMC Pediatr. (2020) 20(1):269. doi: 10.1186/s12887-020-02176-9
34. Lee AC, Katz J, Blencowe H, Cousens S, Kozuki N, Vogel JP, et al. National and regional estimates of term and preterm babies born small for gestational age in 138 low-income and middle-income countries in 2010. Lancet Glob Health. (2013) 1(1):e26–36. doi: 10.1016/S2214-109X(13)70006-8
35. Muche AA, Olayemi OO, Gete YK. Predictors of postpartum glucose intolerance in women with gestational diabetes mellitus: a prospective cohort study in Ethiopia based on the updated diagnostic criteria. BMJ Open. (2020) 10(8):e036882. doi: 10.1136/bmjopen-2020-036882
36. Bademkiran MH, Bademkiran C, Ege S, Peker N, Sucu S, Obut M, et al. Explanatory variables and nomogram of a clinical prediction model to estimate the risk of caesarean section after term induction. J Obstet Gynaecol. (2021) 41(3):367–73. doi: 10.1080/01443615.2020.1798902
37. Agrawal S, Maitra N. Prediction of adverse maternal outcomes in preeclampsia using a risk prediction model. J Obstet Gynaecol India. (2016) 66(Suppl 1):104–11. doi: 10.1007/s13224-015-0779-5
38. Vickers AJ, Elkin EB. Decision curve analysis: a novel method for evaluating prediction models. Med Decis Making. (2006) 26(6):565–74. doi: 10.1177/0272989X06295361
39. Collins GS, Reitsma JB, Altman DG, Moons K. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. BMC Med. (2015) 13:1. doi: 10.1186/s12916-014-0241-z
40. Yeshialem E, Alemnew N, Abera M, Tesfay A. Determinants of adverse pregnancy outcomes among mothers who gave birth from Jan 1-Dec 31/2015 in Jimma University Specialized Hospital, case control study, 2016. Med Clin Rev. (2017) 3(4):22. doi: 10.21767/2471-299X.1000063
41. Kassahun EA, Mitku HD, Getu MA. Adverse birth outcomes and its associated factors among women who delivered in North Wollo zone, northeast Ethiopia: a facility based cross-sectional study. BMC Res Notes. (2019) 12(1):357. doi: 10.1186/s13104-019-4387-9
42. Guida JPS, Cralcev C, Santos JC, Marangoni-Junior M, Sanchez MP, Costa ML. Validation of the fullPIERS model for prediction of adverse outcomes in preeclampsia at a referral center. Pregnancy Hypertens. (2021) 23:112–5. doi: 10.1016/j.preghy.2020.11.013
43. Tsegaye B, Kassa A. Prevalence of adverse birth outcome and associated factors among women who delivered in Hawassa town governmental health institutions, south Ethiopia, in 2017. Reprod Health. (2018) 15(1):193. doi: 10.1186/s12978-018-0631-3
44. Lisonkova S, Sheps SB, Janssen PA, Lee SK, Dahlgren L, MacNab YC. Birth outcomes among older mothers in rural versus urban areas: a residence-based approach. J Rural Health. (2011) 27(2):211–9. doi: 10.1111/j.1748-0361.2010.00332.x
45. Liu L, Liu J-M, Liu Y-H, Li Z-W, Ye R-C, Zheng J, et al. Prevalence of preterm birth among singletons in 10 counties (cities) of China, 1993–2005. Zhonghua Liu Xing Bing Xue Za Zhi. (2007) 28(11):1051–4.18396653
46. Dadras O, Nakayama T, Kihara M, Ono-Kihara M, Seyedalinaghi S, Dadras F. The prevalence and associated factors of adverse pregnancy outcomes among Afghan women in Iran; findings from community-based survey. PLoS One. (2021) 16(1):e0245007. doi: 10.1371/journal.pone.0245007
47. Muti M, Tshimanga M, Notion GT, Bangure D, Chonzi P. Prevalence of pregnancy induced hypertension and pregnancy outcomes among women seeking maternity services in Harare, Zimbabwe. BMC Cardiovasc Disord. (2015) 15(1):111. doi: 10.1186/s12872-015-0110-5
48. Bokslag A, van Weissenbruch M, Mol BW, de Groot CJM. Preeclampsia; short and long-term consequences for mother and neonate. Early Hum Dev. (2016) 102:47–50. doi: 10.1016/j.earlhumdev.2016.09.007
49. Mekonen DG, Yismaw AE, Nigussie TS, Ambaw WM. Proportion of preterm birth and associated factors among mothers who gave birth in Debretabor town health institutions, northwest, Ethiopia. BMC Res Notes. (2019) 12(1):2. doi: 10.1186/s13104-018-4037-7
50. Ross MG, Beall MH. Physiology of Amniotic Fluid Volume Regulation. Wellesley, MA: UpToDate (2012).
51. Aboye W, Berhe T, Birhane T, Gerensea H. Prevalence and associated factors of low birth weight in Axum town, Tigray, North Ethiopia. BMC Res Notes. (2018) 11(1):684. doi: 10.1186/s13104-018-3801-z
52. Lone FW, Qureshi RN, Emanuel F. Maternal anaemia and its impact on perinatal outcome. Trop Med Int Health. (2004) 9(4):486–90. doi: 10.1111/j.1365-3156.2004.01222.x
53. do Carmo Leal M, Esteves-Pereira AP, Nakamura-Pereira M, Torres JA, Theme-Filha M, Domingues RMSM, et al. Prevalence and risk factors related to preterm birth in Brazil. Reprod Health. (2016) 13(3):124. doi: 10.1186/s12978-016-0230-0
54. Keag OE, Norman JE, Stock SJ. Long-term risks and benefits associated with cesarean delivery for mother, baby, and subsequent pregnancies: systematic review and meta-analysis. PLoS Med. (2018) 15(1):e1002494. doi: 10.1371/journal.pmed.1002494
55. Hailu LD, Kebede DL. Determinants of low birth weight among deliveries at a referral Hospital in Northern Ethiopia. Biomed Res Int. (2018) 2018:8169615. doi: 10.1155/2018/8169615
56. Tamirat KS, Sisay MM, Tesema GA, Tessema TZ. Determinants of adverse birth outcome in Sub-Saharan Africa: analysis of recent demographic and health surveys. BMC Public Health. (2021) 21(1):1092. doi: 10.1186/s12889-021-11113-z
57. Lolaso T, Oljira L, Dessie Y, Gebremedhin M, Wakgari N. Adverse birth outcome and associated factors among newborns delivered in public health institutions, southern Ethiopia. East Afr J Health Biomed Sci. (2019) 3(2):35–44.
58. Grivell RM, Reilly AJ, Oakey H, Chan A, Dodd JM. Maternal and neonatal outcomes following induction of labor: a cohort study. Acta Obstet Gynecol Scand. (2012) 91(2):198–203. doi: 10.1111/j.1600-0412.2011.01298.x
59. Lagendijk J, Steyerberg EW, Daalderop LA, Been JV, Steegers EA, Posthumus AG. Validation of a prognostic model for adverse perinatal health outcomes. Sci Rep. (2020) 10:11243. doi: 10.1038/s41598-020-68101-3
60. World Health organizations. WHO recommendations on Antenatal Care for a Positive Pregnancy Experience. Geneva, Switzerland: World Health Organization (2016).
Keywords: adverse birth outcome, model, risk score, pregnant women, Ethiopia
Citation: Anteneh RM, Tesema GA, Lakew AM and Feleke SF (2024) Development and validation of a risk score to predict adverse birth outcomes using maternal characteristics in northwest Ethiopia: a retrospective follow-up study. Front. Glob. Womens Health 5:1458457. doi: 10.3389/fgwh.2024.1458457
Received: 3 July 2024; Accepted: 4 November 2024;
Published: 18 December 2024.
Edited by:
Leandro De Oliveira, Sao Paulo State University, BrazilReviewed by:
Ana Afonso, NOVA University of Lisbon, PortugalYudhy Dharmawan, Diponegoro University, Indonesia
Copyright: © 2024 Anteneh, Tesema, Lakew and Feleke. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Sefineh Fenta Feleke, ZmVudGFzZWZpbmVoMjFAZ21haWwuY29t