- 1Key Laboratory of Endocrinology of National Health Commission, Department of Endocrinology, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Science and Peking Union Medical College, Beijing, China
- 2DHC Mediway Technology Co., Ltd, Beijing, China
Background: The association between prenatal pesticide exposures and a higher incidence of small-for-gestational-age (SGA) births has been reported. No prediction model has been developed for SGA neonates in pregnant women exposed to pesticides prior to pregnancy.
Methods: A retrospective cohort study was conducted using information from the National Free Preconception Health Examination Project between 2010 and 2012. A development set (n = 606) and a validation set (n = 151) of the dataset were split at random. Traditional logistic regression (LR) method and six machine learning classifiers were used to develop prediction models for SGA neonates. The Shapley Additive Explanation (SHAP) model was applied to determine the most influential variables that contributed to the outcome of the prediction.
Results: 757 neonates in total were analyzed. SGA occurred in 12.9% (n = 98) of cases overall. With an area under the receiver-operating-characteristic curve (AUC) of 0.855 [95% confidence interval (CI): 0.752–0.959], the model based on category boosting (CatBoost) algorithm obtained the best performance in the validation set. With the exception of the LR model (AUC: 0.691, 95% CI: 0.554–0.828), all models had good AUCs. Using recursive feature elimination (RFE) approach to perform the feature selection, we included 15 variables in the final model based on CatBoost classifier, achieving the AUC of 0.811 (95% CI: 0.675–0.947).
Conclusions: Machine learning algorithms can develop satisfactory tools for SGA prediction in mothers exposed to pesticides prior to pregnancy, which might become a tool to predict SGA neonates in the high-risk population.
Introduction
Small-for-gestational-age (SGA) newborns are defined as birth weight below the 10th percentile of gestational age standards based on a specific population (1, 2). Infants born SGA are at increased risk for perinatal morbidity and mortality (3, 4). Unrecognized SGA before birth is a major risk factor for stillbirth (5), highlighting the importance of prenatal prediction of SGA because it permits closer surveillance and timely delivery to decrease adverse birth outcomes. In fact, the risk of stillbirth can be significantly decreased, even by four times, if SGA newborns can be detected before delivery (6).
Adverse environmental factors have been related to a reduction in birth weight (7–9). The association between prenatal pesticide exposures and reduced birth weight has been reported in human studies. Women exposed to the highest quartile of 4-nitrophenol were at increased risk of delivering SGA neonates, with a relative risk of 3.81 (1.10, 13.21) (10). Also, a case-control study in India demonstrated that prenatal exposure to some organochlorine pesticides might impair fetal anthropometric development, reducing birth weight, length, head circumference, and chest circumference (11). Additionally, it has been reported that pyrethroids exposure was associated with a slower rate of fetal development at birth with SGA (12). Fetuses could appear to be more susceptible to pesticide residues than adults because of their rapid growth, developing organ systems, and immature metabolic pathways (13). However, there are no studies developing a tool for SGA prediction in mothers exposed to pesticides prior to pregnancy.
Because of the inherent constraints of not incorporating the underlying interactions between variables, risk prediction models based on traditional statistical approaches have a negative impact on their use and efficacy in big datasets with numerous features (14, 15). However, machine learning (ML) techniques, which could handle complicated relationships and optimize prediction performance from complicated dataset, can overcome these restrictions (16, 17). As for predicting the risk of SGA, in a few studies, ML classifiers were used to develop SGA prediction tools in the overall population (18–22). Unfortunately, the prediction tools did not perform well, with a maximum area under the receiver operating characteristic (ROC) curve (AUC) of 0.7+. Besides, several paternal features and maternal exposure to PM2.5 in pregnancy have been reported as independent risk factors for SGA neonates (23–26). Despite the fact that these associations have been confirmed, the combination of them has not previously been included in prediction tools.
In our study, based on a prospective cohort study from the National Free Preconception Health Examination Project (NFPHEP) in China, multiple ML algorithms were applied to establish and validate prediction models for SGA neonates in mothers exposed to pesticides in a living or working environment prior to pregnancy.
Materials and methods
Dataset source
Data were obtained from the NFPHEP, a three-year project initiated by the National Health Commission of the People's Republic of China and conducted in 220 counties across 31 provinces or municipalities from 1 January 2010 to 31 December 2012. The general design and implementation of the NFPHEP were reported in previous publications (27–29). The goal of the NFPHEP was to explore risk factors for poor birth and to promote the health of mothers and their babies. The National Quality Inspection Center for Family Planning Techniques performed the quality control on all data before uploading them to a nationwide electronic data collecting system. The Institutional Review Committee of the National Research Institute for Family Planning in Beijing, China, approved this study (protocol code 2017101702), and all participants gave their informed consent.
Study participants and features
This study included all singleton neonates with a full birth record and a gestational age > 24 weeks, after which cases whose mothers had self-reported exposure to pesticides in their living or working environment prior to pregnancy were selected. The final analysis comprised 757 newborns after records with incomplete data and extreme characteristic values were removed.
A pre-pregnancy checkup was performed, as well as a pregnancy and postpartum follow-up. 142 features about the parental demographic factors, style of living, family medical history, existing health issues, laboratory tests, and newborn birth data were obtained by face-to-face inquiry and assessment conducted by experienced and certified personnel. Specifically, the sociodemographic features including pregnancy history, disease history, family history, medication status, living habits, diet and nutrition status, occupational status, working and living environment features, social-psychological features, and interpersonal relationships of the participants were obtained through medical history inquiry. Height, body mass index, blood pressure, heart rate, thyroid palpation, cardiopulmonary auscultation, abdominal palpation, limb spinal examination, and reproductive system examination were obtained by physical examination. Blood routine, urine routine, vaginal secretions, blood type, blood sugar, liver function, kidney function, thyroid function, hepatitis B test, rubella virus, cytomegalovirus, toxoplasma, and treponema pallidum screening were obtained through laboratory tests. The Chinese Center for Disease Control and Prevention reported PM2.5 values for all counties included, based on a historical PM2.5 estimate hindcast model created by satellite-retrieved aerosol optical depth (30). Based on Chinese Neonatal Network, SGA was defined as neonates having a birth weight below the 10th percentile for the gestational age and sex (31).
Study design
Figure 1 depicts the data processing flow. Python (version 3.8.5) was used to perform all of the analyses. For the generation and testing of ML prediction models, the dataset was randomly divided into a training set (80%, n = 606) and a testing set (20%, n = 151). Initially, ML algorithms included 142 related features (Supplementary Table S1) as candidate predictor variables. Seven ML classifiers were used to establish prediction models in this study. AUC, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) were used to assess the performances of the seven ML algorithms. The results of the AUC metric were used as the major parameter for evaluating the efficacy of the ML algorithms.
Figure 1. The overall process of data extraction, training, and testing. NFPHEP, National Free Preconception Health Examination Project; RFE, recursive feature elimination; SHAP, Shapley Additive Explanation.
The category boosting (CatBoost), gradient boosting decision tree (GBDT), and extreme gradient boosting (XGBoost) algorithms were chosen for the final prediction model since they were the top three performing algorithms. To lower the computational cost of modeling, recursive feature elimination (RFE) was used to select 15 variables that contributed significantly to the outcome from 142 variables, using CatBoost, GBDT, and XGBoost as the estimators, respectively. The efficacy of the RFE method has been confirmed in a variety of medical studies (32–35). The 15 most important features were chosen using a 5-fold cross-validation method. These 15 features were added to prediction models and the model which performed best among the three algorithms was chosen as the final prediction model. The tuning of the hyperparameters utilized grid search, and the used hyperparameters of the most effective ML classifier (CatBoost) were learning rate = [0.001, 0.005, 0.01, 0.05, 0.1, 0.2, 0.3, 0.4, 0.5], max depth = [2, 3, 4, 5, 6, 7, 8], l2_leaf_reg = range (1, 50, 1), max leaves = range (1, 50, 1). The features of the final model's hyperparameter tunning were learning rate = 0.01, depth = 5, l2_leaf_reg = 40, loss function = Logloss, eval metric = Accuracy, grow policy = SymmetricTree, model size reg = 0.5, max leaves = 32, random state = 0.
In addition, we used the Shapley Additive Explanation (SHAP) method to apply the post hoc explainability on the prediction models based on CatBoost, GBDT and XGBoost classifiers, in order to interpret the impact of variables on the prediction outcome. SHAP uses game theory for evaluating the impact of specific input variables to the outcome of a certain model (36). Moreover, decision curve analysis (DCA) was applied to evaluate the net benefit of the prediction models based on CatBoost, GBDT and XGBoost algorithms.
ML algorithms
A traditional logistic regression (LR) approach and six widely used ML classifiers, including random forest (RF), GBDT, XGBoost, light gradient boosting machine (LGBM), CatBoost, and support vector machine (SVM), were used in this study for data modeling. All these classifiers are the most prevalent supervised ML approaches handling categorization problems. Utilizing a sigmoid function to calculate logistic transformation of the likelihood, the LR method is applied to estimate the likelihood of the binary dependent variable (37). SVM aims to generate a hyperplane. SVM's primary purpose is to optimize the distance between each class's nearest points, known as support vectors (38, 39). RF is an ensemble classification process which uses majority voting to aggregate multiple decision trees (40, 41). GBDT is built on decision tree ensembles and is known for its precision, effectiveness, and interpretability. The residue between the current prediction and the ground truth is matched by a new decision tree that is trained for each step (42). LGBM uses a histogram to aggregate gradient information, which greatly increases the training efficiency (43). XGBoost is a high-speed, high-performance distributed gradient boosting library. It makes use of the second-order gradient, which improves the approximation greedy search, parallel learning, and hyperparameters (44). CatBoost provides a novel categorical feature handling approach that can address gradient bias and prediction shift (45).
Statistical analyses
The Chi-square or Fisher's exact test was used to compare categorical features that were expressed as numbers (%). The two-tailed Student's t-test was used to compare continuous features that had a normal distribution, expressed as mean [standard deviation (SD)]; otherwise, the median (interquartile range [IQR]) and Wilcoxon Mann-Whitney U test were applied. Models' AUC, sensitivity, specificity, PPV, and NPV were evaluated. The performances of the ML classifiers were assessed by the AUCs in the development and validation sets. Statistical significance was defined as a two-sided p-value < 0.05. All statistical analyses were performed using Python (version 3.8.5).
Results
Baseline characteristics
From 1 January 2010, to 31 December 2012, the NFPHEP database recorded 757 neonates whose mothers were exposed to pesticides prior to pregnancy. There were 98 SGA births (12.9%) among the 757 neonates. Table 1 displays the demographic features of the study subjects. The findings of comparing the 142 candidate features for predictors in the database are listed in Supplementary Table S1. Overall, the neonates in the cohort had a median gestational age of 39.0 weeks (IQR: 39.0–40.0). SGA neonates had a significantly lower birth weight [2.5 kg (2.2–2.7)] than non-SGA neonates [3.5 kg (3.2–3.7)]. In comparison to the non-SGA group, significant lower paternal height was observed in the SGA group [170.0 cm (165.0–172.0) vs. 170.0 cm (167.0–173.0)]. In addition, proportion of fathers who did not quit smoking during pregnancy in the SGA group was significantly higher than that in the non-SGA group (25.5% vs. 14.0%). Moreover, the proportion of fathers with severe interpersonal pressure in the SGA group was significantly higher than that in the non-SGA group (8.2% vs. 3.2%).
Table 1. Demographic characteristics of the subjects by the status of small for gestational age (SGA).
Performance evaluation of classification models
The training dataset (n = 606) was used to develop the models based on LR, RF, GBDT, XGBoost, LGBM, CatBoost, and SVM algorithms, and the testing dataset (n = 151) was used to evaluate their SGA prediction performances. The ROC curve assessment of ML classifiers in the validation set is shown in Figure 2. Overall, the CatBoost model achieved the top AUC value in the testing set, with an AUC of 0.855 [95% confidence interval (CI): 0.752–0.959]. For SGA prediction, all models had a acceptable AUC: CatBoost (AUC: 0.855, 95% CI: 0.752–0.959), GBDT (AUC: 0.831, 95% CI: 0.704–0.958), XGBoost (AUC: 0.791, 95% CI: 0.662–0.921), RF (AUC: 0.787, 95% CI: 0.647–0.928), LGBM (AUC: 0.778, 95% CI: 0.643–0.912), and SVM (AUC: 0.752, 95% CI: 0.610–0.894), with the exception of LR (AUC: 0.691, 95% CI: 0.554–0.828). Furthermore, Table 2 includes the AUCs in the development and validation sets, as well as sensitivity, specificity, PPV, and NPV of each model. Model sensitivity, specificity, PPV, and NPV varied from 0.600 to 0.733, 0.650 to 0.956, 0.186 to 0.625, and 0.952 to 0.964, respectively.
Figure 2. Receiver operating characteristic (ROC) curves of the seven machine learning (ML) models in predicting small for gestational age (SGA) in the testing dataset. SVM, support vector machine; GBDT, gradient boosting decision tree; LGBM, light gradient boosting machine; XGBoost, extreme gradient boosting; CatBoost, category boosting.
Table 2. Performance of models by different algorithms in predicting small for gestational age (SGA) neonates.
Feature selection and final prediction model
The RFE approach was applied to choose 15 features that contributed significantly to the prediction outcome from the 142 features to lower the modeling's computational expense. CatBoost, GBDT, and XGBoost classifiers were chosen as the estimators for RFE since they were the top three performing algorithms. After selecting 15 features using these three algorithms to model, respectively, the AUC values in the testing set of the models based on CatBoost, GBDT, and XGBoost were 0.811 (95% CI: 0.675–0.947), 0.803 (95% CI: 0.665–0.942), and 0.789 (95% CI: 0.643–0.935), respectively. Therefore, the CatBoost model, which achieved the highest AUC result in the comparison of the three models, was chosen as the final prediction model. The 15 variables in the final model were maternal blood type, paternal blood type, maternal exposure to PM2.5 during the late pregnancy, maternal alanine aminotransferase (ALT) prior to pregnancy, paternal smoking status in the first trimester, maternal folacin intake, maternal thyroid-stimulating hormone (TSH) prior to pregnancy, maternal economic pressure prior to pregnancy, paternal life/work stress prior to pregnancy, paternal ALT prior to pregnancy, maternal age, maternal secondhand smoking prior to pregnancy, paternal economic pressure prior to pregnancy, paternal secondhand smoking prior to pregnancy, and maternal contraception prior to pregnancy. The final prediction model's ROC curve results in the development and validation set are shown in Figure 3. The AUC results in the development and validation dataset, sensitivity, specificity, PPV, and NPV in the validation dataset were 0.962 (95% CI: 0.943–0.980), 0.811 (95% CI: 0.675–0.947), 0.667, 0.898, 0.417 and 0.961, respectively, demonstrating the effectiveness of the utilized ML algorithm and feature selection method. Additionally, the DCA result demonstrated the benefit of the final ML model for the prediction of SGA newborns (Supplementary Figure S1). Moreover, the ROC curves, feature selection results, and DCA results of the GBDT and XGBoost models are shown in Supplementary Figure S1 and Supplementary Figures S3–6. Most of the features in the final CatBoost prediction model, including maternal blood type, paternal blood type, maternal exposure to PM2.5 during the late pregnancy, paternal smoking status in the first trimester, maternal ALT, maternal TSH, paternal ALT, maternal economic pressure and paternal economic pressure prior to pregnancy, also contributed significantly in the GBDT and XGBoost model.
Figure 3. Receiver operating characteristic (ROC) curves of the final machine learning (ML) model using CatBoost algorithm generated after recursive feature elimination (RFE) in predicting small for gestational age (SGA).
Post-hoc interpretation results
The final prediction model's SHAP graphic based on CatBoost algorithm was drawn to determine the variables with the most impact on the outcome (Figure 4). The importance of the features was shown on the y-axis from top to bottom, while mean SHAP values were exhibited on the x-axis. Each dot was a sample. If the variable had a high (low) value, the plot was highlighted in red (blue). The 5 most critical variables were maternal blood type, paternal blood type, maternal exposure to PM2.5 during the late pregnancy, maternal ALT prior to pregnancy, and paternal smoking status in the first trimester. The mean SHAP value of each feature in the final prediction model is shown in Supplementary Figure S2.
Figure 4. The Shapley Additive Explanation (SHAP) values for the most important predictors of SGA in the final model. The abscissa is the SHAP value, which shows the degree of impact on the outcome. Each dot represents a case. If the feature's value is high (low), the plot is colored red (blue). ALT, alanine aminotransferase; TSH, thyroid stimulating hormone.
Discussion
This is the first research to apply ML classifiers in the establishment and testing of tools for SGA prediction in mothers who were exposed to pesticides prior to pregnancy. Paternal features and maternal pregnancy exposure to PM2.5 were also creatively incorporated as prediction features in our ML models. The results demonstrate that in comparison to the traditional LR method, ML classifiers can generate more accurate prediction models, with the CatBoost model showing the top SGA prediction performance (AUC: 0.855), indicating the use of ML classifiers to predict SGA is a viable method. The ML prediction model might be used to provide a prenatal prediction of SGA neonates in order to improve perinatal outcomes and effectively manage at-risk pregnancies.
To safeguard crops in the agricultural planting region, pesticides are extensively utilized. Pesticide usage is estimated to be over 3.5 million tons per year globally, with China using 1.8 million tons of pesticides in 2015, making it one of the countries with the highest overall pesticide usage (46). Among them, common pesticide types include organophosphorus pesticides, carbamate pesticides and organochlorine pesticides (46, 47). With increased exposure to pesticides, the percentage of SGA newborns rose. Prenatal exposure to pesticides, such as 4-nitrophenol, organochlorine, organophosphate, and pyrethroid pesticides, could impair fetal anthropometric development and reduce birth weight, resulting in an increased risk of delivering SGA neonates (10–12, 48, 49). Pesticides have been found in amniotic fluid, demonstrating they may pass the placenta and cause non-negligible fetal exposures (50–52). Fetuses could appear to be more susceptible to pesticide residues than adults because of their rapid growth, growing organ systems, and immature metabolic pathways (13). Specifically, organochlorine pesticides have been linked to growth retardation due to their genotoxic, immunotoxic, endocrine disrupting, cytotoxic, and fetotoxic effects (53). Through disrupting glyceraldehyde, organophosphorus pesticides could have a negative impact on birth weight (54). However, to the best of our knowledge, no prediction tool has been established for SGA neonates in mothers who were exposed to pesticides prior to pregnancy. We compared seven ML classifiers' performances for SGA (Table 2). CatBoost algorithm achieved the greatest AUC value (0.855) among these models, followed by GBDT, XGBoost, RF, and LGBM. But with an AUC of 0.691, the LR model got the lowest AUC. This might be as a result of the LR approach's sensitivity to outliers and need for a big dataset in order to function well. Furthermore, LR model's performance might be harmed by the unbalanced dataset. Our findings demonstrated that in comparison to traditional LR method, the ML algorithms were more effective in predicting SGA neonates in women who had been exposed to pesticides prior to pregnancy (AUC: 0.855 vs. 0.691).
The prediction of SGA newborns held considerable promise with the help of advanced ML classifiers. The cause behind it was that traditional modeling approaches failed to discover interactions between predictors that may occur. The advanced ML algorithms explored in our present work might resolve such problems. The automated handling of multidimensional and multivariable data by ML algorithms might uncover unique correlations between certain features and SGA outcomes, as well as discover trends that would otherwise be ignored by researchers (55). In addition, a robust SGA prediction model (AUC: 0.811, Figure 3) could be established using only 15 features, including parental demographic features, accessible medical test indices, and local PM2.5 exposure, suggesting suitable variables were chosen from 142 candidate variables using the RFE method. The RFE approach is a backward elimination technique based on wrappers that recursively computes the learning function to generate a recursive ranking of a given feature set (56). The efficacy of the RFE algorithm has been fully confirmed in a variety of medical studies (32–35, 57, 58).
Although there is evidence of familial influence in the cause of SGA births, the majority of studies have focused on maternal factors. Paternal factors, which can also potentially predict adverse birth outcomes, have received far less attention. In fact, several paternal determinants, including paternal age, height, race, level of education, and smoking status, are proven to be risk factors for SGA births (23, 24, 59–62). Furthermore, high-level ambient PM2.5 has been associated with an increased risk of SGA, proving the adverse effect of ambient PM2.5 on fetal growth (25, 26). These features, however, were not taken into account in prior SGA prediction tools developed in the overall population. We found that paternal blood type, smoking status, life/work stress, ALT, economic pressure, secondhand smoking status, and maternal exposure to PM2.5 during the late pregnancy were all among the 15 most important variables, implying that paternal factors and pregnant women's exposure to PM2.5 played an important role in SGA newborns prediction in the study subjects.
SHAP method was applied to explain the influence of the selected features on the outcomes of prediction models. The SHAP values reflected the influence distribution of each variable on the model outcome (Figure 4). For example, a high maternal ALT level increased the risk of SGA newborns. A similar pattern was shown by the variables maternal economic pressure and paternal economic pressure. Also, A lower level of maternal TSH before pregnancy decreased the risk of SGA. On the contrary, a lower level of maternal PM2.5 exposure in the last trimester was associated with an increased risk of SGA. Besides, paternal continued smoking during pregnancy, maternal secondhand smoking before pregnancy, and paternal secondhand smoking before pregnancy were also associated with an increased risk of SGA newborns. Maternal blood type O was related with an increased risk of SGA. Blood type O has been reported to be an independent risk factor for preeclampsia and gestational diabetes mellitus, which may explain the relationship between maternal blood type and SGA (63, 64). Also, reduced fetal growth has been related to increased maternal ALT level in recent studies (65). Additionally, both maternal and paternal smoking have been considered to be linked to an increased risk of delivering SGA newborns (66–68), which is consistent with our results. Chronic fetal hypoxia caused by smoking as well as placental vasoconstriction and increased apoptosis of placental syncytiotrophoblasts caused by nicotine have been proposed as the hypothesized mechanisms (69, 70). A higher maternal TSH concentration has also been proven to be associated with a lower birth weight (71). Moreover, lower income and less-privileged social class have been associated with higher risk of having SGA births because of the fact that fetal development could be affected by maternal emotional and psychological environment (72, 73). However, the association between maternal PM2.5 exposure and SGA contradicts previous studies, which may be caused by the difference of PM2.5 concentrations. The average PM2.5 concentration in previous studies from developed countries ranged from 1.82 to 22.11 μg/m3, which is less than one-third of the mean level of our study (74).
There are several limitations in this study. Firstly, despite the fact that the data was obtained nationally, the sample size was small, which might imply bias. Secondly, the dataset lacked information on the type of pesticides and average daily exposure in mothers' living or working environment prior to pregnancy. Besides, data lacked information on the ultrasonic biometric measurements. Including these data in the prediction model might increase the model's accuracy and applicability. To better understand the real value of the ML model in predicting SGA neonates, the ML prediction model still has to be tested and used in actual clinical settings.
Conclusions
In this work, seven ML algorithms were used to build prediction models for SGA neonates in mothers exposed to pesticides prior to pregnancy. The results suggest that ML algorithms perform well in the classification of SGA neonates. Using feature selection and optimization approaches, the final prediction model using the CatBoost algorithm shows good performance on the prediction for SGA (AUC: 0.811) solely utilizing 15 variables, including parental demographic features, accessible medical test indices, and local PM2.5 exposure. Moreover, SHAP analysis enhanced the interpretation of the impact of the chosen variables to the categorization of SGA neonates, complementing the prediction findings. In high-risk populations, the prediction model based on ML algorithms might be a potentially effective tool for predicting the delivery of SGA neonates.
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics statement
The studies involving human participants were reviewed and approved by the Institutional Review Board of the National Research Institute for Family Planning, Beijing, China (protocol code 2017101702). Written informed consent to participate in this study was provided by the participants' legal guardian/next of kin.
Author contributions
Conceptualization: XB, SC, and HP. Methodology: XB, MS, LY, KL, and HY. Software: XB and ZZ. Validation: XB and YL. Resources, supervision, and funding acquisition: HP. Data curation: XB and SC. Writing—original draft preparation: XB. Writing—review and editing: SC and HP. Visualization: HZ. Project administration: XB and HP. All authors have read and agreed to the published version of the manuscript.
Funding
This work was funded by the Chinese Academy of Medical Sciences Innovation Fund for Medical Sciences (2021-I2M-1-023).
Conflict of interest
Authors MS, YL, LY, and KL were employed by DHC Mediway Technology Co. Ltd.
The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpubh.2022.940182/full#supplementary-material
Supplementary Figure 1. Decision curve analysis (DCA) of the three prediction models based on CatBoost, GBDT and XGBoost after feature selection. X-axis indicates the threshold probability for SGA outcome and Y-axis indicates the net benefit.
Supplementary Figure 2. The mean Shapley Additive Explanation (SHAP) value of each feature in the final prediction model based on CatBoost.
Supplementary Figure 3. Receiver operating characteristic (ROC) curves of the model using GBDT algorithm generated after recursive feature elimination (RFE) in predicting SGA.
Supplementary Figure 4. The Shapley Additive Explanation (SHAP) values for the most important predictors of SGA in the GBDT model.
Supplementary Figure 5. Receiver operating characteristic (ROC) curves of the model using XGBoost algorithm generated after recursive feature elimination (RFE) in predicting SGA.
Supplementary Figure 6. The Shapley Additive Explanation (SHAP) values for the most important predictors of SGA in the XGBoost model.
Supplementary Table 1. One hundred forty-two features included in machine learning models as candidate features for predictors.
References
1. Wilcox AJ, Cortese M, McConnaughey DR, Moster D, Basso O. The limits of small-for-gestational-age as a high-risk category. Eur J Epidemiol. (2021) 36:985–91. doi: 10.1007/s10654-021-00810-z
2. McCowan LM, Figueras F, Anderson NH. Evidence-based national guidelines for the management of suspected fetal growth restriction: comparison, consensus, and controversy. Am J Obstet Gynecol. (2018) 218:S855–68. doi: 10.1016/j.ajog.2017.12.004
3. Ray JG, Park AL, Fell DB. Mortality in infants affected by preterm birth and severe small-for-gestational age birth weight. Pediatrics. (2017) 140:e20171881. doi: 10.1542/peds.2017-1881
4. Katz J, Lee AC, Kozuki N, Lawn JE, Cousens S, Blencowe H, et al. Mortality risk in preterm and small-for-gestational-age infants in low-income and middle-income countries: a pooled country analysis. Lancet. (2013) 382:417–25. doi: 10.1016/S0140-6736(13)60993-9
5. Gardosi J, Madurasinghe V, Williams M, Malik A, Francis A. Maternal and fetal risk factors for stillbirth: population based study. BMJ. (2013) 346:f108. doi: 10.1136/bmj.f108
6. Lindqvist PG, Molin J. Does antenatal identification of small-for-gestational age fetuses significantly improve their outcome? Ultrasound Obstet Gynecol. (2005) 25:258–64. doi: 10.1002/uog.1806
7. Dugandzic R, Dodds L, Stieb D, Smith-Doiron M. The association between low level exposures to ambient air pollution and term low birth weight: a retrospective cohort study. Environ Health. (2006) 5:3. doi: 10.1186/1476-069X-5-3
8. Grazuleviciene R, Nieuwenhuijsen MJ, Vencloviene J, Kostopoulou-Karadanelli M, Krasner SW, Danileviciute A, et al. Individual exposures to drinking water trihalomethanes, low birth weight and small for gestational age risk: a prospective Kaunas cohort study. Environ Health. (2011) 10:32. doi: 10.1186/1476-069X-10-32
9. Morello-Frosch R, Jesdale BM, Sadd JL, Pastor M. Ambient air pollution exposure and full-term birth weight in California. Environ Health. (2010) 9:44. doi: 10.1186/1476-069X-9-44
10. Jaacks LM, Diao N, Calafat AM, Ospina M, Mazumdar M, Ibne Hasan MOS, et al. Association of prenatal pesticide exposures with adverse pregnancy outcomes and stunting in rural Bangladesh. Environ Int. (2019) 133:105243. doi: 10.1016/j.envint.2019.105243
11. Dewan P, Jain V, Gupta P, Banerjee BD. Organochlorine pesticide residues in maternal blood, cord blood, placenta, and breastmilk and their relation to birth size. Chemosphere. (2013) 90:1704–10. doi: 10.1016/j.chemosphere.2012.09.083
12. Hanke W, Romitti P, Fuortes L, Sobala W, Mikulski M. The use of pesticides in a Polish rural population and its effect on birth weight. Int Arch Occup Environ Health. (2003) 76:614–20. doi: 10.1007/s00420-003-0471-4
13. Berkowitz GS, Wetmur JG, Birman-Deych E, Obel J, Lapinski RH, Godbold JH, et al. In utero pesticide exposure, maternal paraoxonase activity, and head circumference. Environ Health Perspect. (2004) 112:388–91. doi: 10.1289/ehp.6414
14. Shouval R, Bondi O, Mishan H, Shimoni A, Unger R, Nagler A. Application of machine learning algorithms for clinical predictive modeling: a data-mining approach in SCT. Bone Marrow Transplant. (2014) 49:332–7. doi: 10.1038/bmt.2013.146
15. Wu Q, Nasoz F, Jung J, Bhattarai B, Han MV. Machine learning approaches for fracture risk assessment: a comparative analysis of genomic and phenotypic data in 5130 older men. Calcif Tissue Int. (2020) 107:353–61. doi: 10.1007/s00223-020-00734-y
16. Deo RC. Machine learning in medicine. Circulation. (2015) 132:1920–30. doi: 10.1161/CIRCULATIONAHA.115.001593
17. Shouval R, Hadanny A, Shlomo N, Iakobishvili Z, Unger R, Zahger D, et al. Machine learning for prediction of 30-day mortality after ST elevation myocardial infraction: an acute coronary syndrome Israeli survey data mining study. Int J Cardiol. (2017) 246:7–13. doi: 10.1016/j.ijcard.2017.05.067
18. Kuhle S, Maguire B, Zhang H, Hamilton D, Allen AC, Joseph KS, et al. Comparison of logistic regression with machine learning methods for the prediction of fetal growth abnormalities: a retrospective cohort study. BMC Pregnancy Childbirth. (2018) 18:333. doi: 10.1186/s12884-018-1971-2
19. Papastefanou I, Wright D, Nicolaides KH. Competing-risks model for prediction of small-for-gestational-age neonate from maternal characteristics and medical history. Ultrasound Obstet Gynecol. (2020) 56:196–205. doi: 10.1002/uog.22129
20. Saw SN, Biswas A, Mattar CNZ, Lee HK, Yap CH. Machine learning improves early prediction of small-for-gestational-age births and reveals nuchal fold thickness as unexpected predictor. Prenat Diagn. (2021) 41:505–16. doi: 10.1002/pd.5903
21. Li J, Liu L, Zhou M, Yang J-J, Chen S, Liu H, et al. Feature selection and prediction of small-for-gestational-age infants. J Ambient Intell Humaniz Comput. (2018). doi: 10.1007/s12652-018-0892-2
22. Chang CK, Chiari L, Cao Y, Jin H, Mokhtari M, Aloulou H. Inclusive smart cities and digital health. In: Mo H, Li J, Chen S, Pan H, Yang J-J, Wang Q, . editors. SVM Based Predictive Model for SGA Detection. Cham: Springer International Publishing (2016).
23. Shah PS. Paternal factors and low birthweight, preterm, and small for gestational age births: a systematic review. Am J Obstet Gynecol. (2010) 202:103–23. doi: 10.1016/j.ajog.2009.08.026
24. Shapiro GD, Bushnik T, Sheppard AJ, Kramer MS, Kaufman JS, Yang S. Paternal education and adverse birth outcomes in Canada. J Epidemiol Commun Health. (2017) 71:67–72. doi: 10.1136/jech-2015-206894
25. Chen J, Li PH, Fan H, Li C, Zhang Y, Ju D, et al. Weekly-specific ambient fine particular matter exposures before and during pregnancy were associated with risks of small for gestational age and large for gestational age: results from project ELEFANT. Int J Epidemiol. (2022) 51:202–12. doi: 10.1093/ije/dyab166
26. Kloog I, Melly SJ, Ridgway WL, Coull BA, Schwartz J. Using new satellite based exposure methods to study the association between pregnancy PM2. 5 exposure, premature birth and birth weight in Massachusetts. Environ Health. (2012) 11:40. doi: 10.1186/1476-069X-11-40
27. Pan Y, Zhang S, Wang Q, Shen H, Zhang Y, Li Y, et al. Investigating the association between prepregnancy body mass index and adverse pregnancy outcomes: a large cohort study of 536 098 Chinese pregnant women in rural China. BMJ Open. (2016) 6:e011227. doi: 10.1136/bmjopen-2016-011227
28. Wang YY, Li Q, Guo Y, Zhou H, Wang X, Wang Q, et al. Association of long-term exposure to airborne particulate matter of 1 μm or less with preterm birth in China. JAMA Pediatr. (2018) 172:e174872. doi: 10.1001/jamapediatrics.2017.4872
29. Zhang S, Wang Q, Shen H. [Design of the national free proception health examination project in China]. Zhonghua yi xue za zhi. (2015) 95:162–5.
30. Xiao Q, Chang HH, Geng G, Liu Y. An ensemble machine-learning model to predict historical PM(2. 5) concentrations in China from satellite data. Environ Sci Technol. (2018) 52:13260–9. doi: 10.1021/acs.est.8b02917
31. Zhu L, Zhang R, Zhang S, Shi W, Yan W, Wang X, et al. [Chinese neonatal birth weight curve for different gestational age]. Zhonghua er ke za zhi. (2015) 53:97–103. doi: 10.3760/cma.j.issn.0578-1310.2015.02.007
32. Lu C, Song J, Li H, Yu W, Hao Y, Xu K, et al. Predicting venous thrombosis in osteoarthritis using a machine learning algorithm: a population-based cohort study. J Pers Med. (2022) 12:114. doi: 10.3390/jpm12010114
33. Pinal-Fernandez I, Casal-Dominguez M, Derfoul A, Pak K, Miller FW, Milisenda JC, et al. Machine learning algorithms reveal unique gene expression profiles in muscle biopsies from patients with different types of myositis. Ann Rheum Dis. (2020) 79:1234–42. doi: 10.1136/annrheumdis-2019-216599
34. Li Z, Kaiser L, Holzgreve A, Ruf VC, Suchorska B, Wenter V, et al. Prediction of TERTp-mutation status in IDH-wildtype high-grade gliomas using pre-treatment dynamic [(18)F]FET PET radiomics. Eur J Nucl Med Mol Imaging. (2021) 48:4415–25. doi: 10.1007/s00259-021-05526-6
35. Jung CR, Nishihama Y, Nakayama SF, Tamura K, Isobe T, Michikawa T, et al. Indoor air quality of 5,000 households and its determinants. Part B: volatile organic compounds and inorganic gaseous pollutants in the Japan environment and children's study. Environ Res. (2021) 197:111135. doi: 10.1016/j.envres.2021.111135
36. Bloch L, Friedrich CM. Data analysis with Shapley values for automatic subject selection in Alzheimer's disease data sets using interpretable machine learning. Alzheimer Res Ther. (2021) 13:155. doi: 10.1186/s13195-021-00879-4
37. Stoltzfus JC. Logistic regression: a brief primer. Acad Emerg Med. (2011) 18:1099–104. doi: 10.1111/j.1553-2712.2011.01185.x
38. Huang S, Cai N, Pacheco PP, Narrandes S, Wang Y, Xu W. Applications of Support Vector Machine (SVM) learning in cancer genomics. Cancer Genomics Proteomics. (2018) 15:41–51. doi: 10.21873/cgp.20063
39. Long Z, Jing B, Yan H, Dong J, Liu H, Mo X, et al. A support vector machine-based method to identify mild cognitive impairment with multi-level characteristics of magnetic resonance imaging. Neuroscience. (2016) 331:169–76. doi: 10.1016/j.neuroscience.2016.06.025
40. Pratheeba C, Singh NN. A novel approach for detection of hard exudates using random forest classifier. J Med Syst. (2019) 43:180. doi: 10.1007/s10916-019-1310-9
41. Ishwaran H. The effect of splitting on random forests. Mach Learn. (2015) 99:75–118. doi: 10.1007/s10994-014-5451-2
42. Zhang Z, Jung C. GBDT-MO Gradient-boosted decision trees for multiple outputs. IEEE Trans Neural Netw Learn Syst. (2021) 32:3156–67. doi: 10.1109/TNNLS.2020.3009776
43. Kobayashi Y, Yoshida K. Quantitative structure-property relationships for the calculation of the soil adsorption coefficient using machine learning algorithms with calculated chemical properties from open-source software. Environ Res. (2021) 196:110363. doi: 10.1016/j.envres.2020.110363
44. Li Y, Li M, Li C, Liu Z. Forest aboveground biomass estimation using Landsat 8 and Sentinel-1A data with machine learning algorithms. Sci Rep. (2020) 10:9952. doi: 10.1038/s41598-020-67024-3
45. Hancock JT, Khoshgoftaar TM. CatBoost for big data: an interdisciplinary review. J Big Data. (2020) 7:94. doi: 10.1186/s40537-020-00369-8
46. Huang F, Li Z, Zhang C, Habumugisha T, Liu F, Luo X. Pesticides in the typical agricultural groundwater in Songnen plain, northeast China: occurrence, spatial distribution and health risks. Environ Geochem Health. (2019) 41:2681–95. doi: 10.1007/s10653-019-00331-5
47. Wu C, Luo Y, Gui T, Huang Y. Concentrations and potential health hazards of organochlorine pesticides in (shallow) groundwater of Taihu Lake region, China. Sci Total Environ. (2014) 470:1047–55. doi: 10.1016/j.scitotenv.2013.10.056
48. Rauch SA, Braun JM, Barr DB, Calafat AM, Khoury J, Montesano AM, et al. Associations of prenatal exposure to organophosphate pesticide metabolites with gestational age and birth weight. Environ Health Perspect. (2012) 120:1055–60. doi: 10.1289/ehp.1104615
49. Whyatt RM, Rauh V, Barr DB, Camann DE, Andrews HF, Garfinkel R, et al. Prenatal insecticide exposures and birth weight and length among an urban minority cohort. Environ Health Perspect. (2004) 112:1125–32. doi: 10.1289/ehp.6641
50. Luzardo OP, Mahtani V, Troyano JM, Alvarez de. la Rosa M, Padilla-Pérez AI, Zumbado M, et al. Determinants of organochlorine levels detectable in the amniotic fluid of women from Tenerife Island (Canary Islands, Spain). Environ Res. (2009) 109:607–13. doi: 10.1016/j.envres.2009.03.008
51. Bradman A, Barr DB, Claus Henn BG, Drumheller T, Curry C, Eskenazi B. Measurement of pesticides and other toxicants in amniotic fluid as a potential biomarker of prenatal exposure: a validation study. Environ Health Perspect. (2003) 111:1779–82. doi: 10.1289/ehp.6259
52. Perera FP, Rauh V, Tsai WY, Kinney P, Camann D, Barr D, et al. Effects of transplacental exposure to environmental pollutants on birth outcomes in a multiethnic population. Environ Health Perspect. (2003) 111:201–5. doi: 10.1289/ehp.5742
53. Pathak R, Mustafa MD, Ahmed T, Ahmed RS, Tripathi AK, Guleria K, et al. Intra uterine growth retardation: association with organochlorine pesticide residue levels and oxidative stress markers. Reprod Toxicol. (2011) 31:534–9. doi: 10.1016/j.reprotox.2011.02.007
54. Yang X, Zhang M, Lu T, Chen S, Sun X, Guan Y, et al. Metabolomics study and meta-analysis on the association between maternal pesticide exposome and birth outcomes. Environ Res. (2020) 182:109087. doi: 10.1016/j.envres.2019.109087
55. Hernandez-Suarez DF, Kim Y, Villablanca P, Gupta T, Wiley J, Nieves-Rodriguez BG, et al. Machine learning prediction models for in-hospital mortality after transcatheter aortic valve replacement. JACC Cardiovasc Interv. (2019) 12:1328–38. doi: 10.1016/j.jcin.2019.06.013
56. Dasgupta S, Goldberg Y, Kosorok MR. Feature elimination in kernel machines in moderately high dimensions. Ann Stat. (2019) 47:497–526. doi: 10.1214/18-AOS1696
57. Dean KR, Hammamieh R, Mellon SH, Abu-Amara D, Flory JD, Guffanti G, et al. Multi-omic biomarker identification and validation for diagnosing warzone-related post-traumatic stress disorder. Mol Psychiatry. (2020) 25:3337–49. doi: 10.1038/s41380-019-0496-z
58. Dong Z, Wang Q, Ke Y, Zhang W, Hong Q, Liu C, et al. Prediction of 3-year risk of diabetic kidney disease using machine learning based on electronic medical records. J Transl Med. (2022) 20:143. doi: 10.1186/s12967-022-03339-1
59. Miletić T, Stoini E, Mikulandra F, Tadin I, Roje D, Milić N. Effect of parental anthropometric parameters on neonatal birth weight and birth length. Coll Antropol. (2007) 31:993–7.
60. Banderali G, Martelli A, Landi M, Moretti F, Betti F, Radaelli G, et al. Short and long term health effects of parental tobacco smoking during pregnancy and lactation: a descriptive review. J Transl Med. (2015) 13:327. doi: 10.1186/s12967-015-0690-y
61. Myklestad K, Vatten LJ, Magnussen EB, Salvesen K, Romundstad PR. Do parental heights influence pregnancy length?: a population-based prospective study, HUNT 2 BMC Pregnancy Childbirth. (2013) 13:33. doi: 10.1186/1471-2393-13-33
62. Meng Y, Groth SW. Fathers count: the impact of paternal risk factors on birth outcomes. Matern Child Health J. (2018) 22:401–8. doi: 10.1007/s10995-017-2407-8
63. Mahasub N, Boriboonhirunsarn D. Relationship between ABO blood groups and preeclampsia. Hypertens Pregnancy. (2020) 39:348–53. doi: 10.1080/10641955.2020.1777298
64. Sapanont K, Sunsaneevithayakul P, Boriboonhirunsarn D. Relationship between ABO blood group and gestational diabetes mellitus. J Matern Fetal Neonatal Med. (2021) 34:1255–9. doi: 10.1080/14767058.2019.1633299
65. Harville EW, Chen W, Bazzano L, Oikonen M, Hutri-Kähönen N, Raitakari O. Indicators of fetal growth and adult liver enzymes: the Bogalusa heart study and the cardiovascular risk in young finns study. J Dev Orig Health Dis. (2017) 8:226–35. doi: 10.1017/S2040174416000635
66. Oldereid NB, Wennerholm UB, Pinborg A, Loft A, Laivuori H, Petzold M, et al. The effect of paternal factors on perinatal and paediatric outcomes: a systematic review and meta-analysis. Hum Reprod Update. (2018) 24:320–89. doi: 10.1093/humupd/dmy005
67. Alio AP, Salihu HM, Kornosky JL, Richman AM, Marty PJ. Feto-infant health and survival: does paternal involvement matter? Matern Child Health J. (2010) 14:931–7. doi: 10.1007/s10995-009-0531-9
68. Suter MA, Anders AM, Aagaard KM. Maternal smoking as a model for environmental epigenetic changes affecting birthweight and fetal programming. Mol Hum Reprod. (2013) 19:1–6. doi: 10.1093/molehr/gas050
69. Rogers JM. Tobacco and pregnancy. Reprod Toxicol. (2009) 28:152–60. doi: 10.1016/j.reprotox.2009.03.012
70. Voigt M, Briese V, Jorch G, Henrich W, Schneider KT, Straube S. The influence of smoking during pregnancy on fetal growth. Considering daily cigarette consumption and the SGA rate according to length of gestation. Z Geburtshilfe Neonatol. (2009) 213:194–200. doi: 10.1055/s-0029-1214405
71. Zhang C, Yang X, Zhang Y, Guo F, Yang S, Peeters RP, et al. Association between maternal thyroid hormones and birth weight at early and late pregnancy. J Clin Endocrinol Metab. (2019) 104:5853–63. doi: 10.1210/jc.2019-00390
72. Garcia-Subirats I, Pérez G, Rodríguez-Sanz M, Ruiz-Muñoz D, Salvador J. Neighborhood inequalities in adverse pregnancy outcomes in an urban setting in Spain: a multilevel approach. J Urban Health. (2012) 89:447–63. doi: 10.1007/s11524-011-9648-4
73. Eiríksdóttir VH, Ásgeirsdóttir TL, Bjarnadóttir RI, Kaestner R, Cnattingius S, Valdimarsdóttir UA. Low birth weight, small for gestational age and preterm births before and after the economic collapse in Iceland: a population based cohort study. PLoS ONE. (2013) 8:e80499. doi: 10.1371/journal.pone.0080499
Keywords: small for gestational age, exposure to pesticides, machine learning, prediction, environmental pollution
Citation: Bai X, Zhou Z, Su M, Li Y, Yang L, Liu K, Yang H, Zhu H, Chen S and Pan H (2022) Predictive models for small-for-gestational-age births in women exposed to pesticides before pregnancy based on multiple machine learning algorithms. Front. Public Health 10:940182. doi: 10.3389/fpubh.2022.940182
Received: 10 May 2022; Accepted: 19 July 2022;
Published: 08 August 2022.
Edited by:
Jing Wei, University of Maryland, College Park, United StatesReviewed by:
Joris Hemelaar, University of Oxford, United KingdomJi-Jiang Yang, Tsinghua University, China
Copyright © 2022 Bai, Zhou, Su, Li, Yang, Liu, Yang, Zhu, Chen and Pan. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Hui Pan, cGFuaHVpMjAxMTExMTEmI3gwMDA0MDsxNjMuY29t; Shi Chen, Y3NwdW1jaCYjeDAwMDQwOzE2My5jb20=