Nomogram for Predicting Bone Development State of Female Children and Adolescents–A Fast Screening Approach Based on Pubes Stages for Growth and Development

Objective: To develop a nomogram for predicting bone development state (BDS) of female children and adolescents in a large scale.

Methods: Four hundred forty-seven female students were designated as the training cohort to develop the predictive model, whereas 196 female students were used as the validation cohort to verify the established model. Bone age, height, body mass, body fat percentage, and secondary sexual characteristics were recorded, and BDS was determined with the chronological age and bone age. Multivariate logistic regression was conducted to determine the factors, and nomogram was developed and validated with the training and validation cohorts, respectively.

Results: One hundred forty-seven female students were identified as BDS abnormal in the training cohort (32.9%), and 104 were determined in the validation cohort (53.1%). Age, height, weight, and pubes stage were selected for the predictive model. A nomogram was developed and showed a good estimation, with a C-index of 0.78 and a good calibration in the training cohort. Application of the nomogram to the validation cohort showed a similar C-index of 0.75 and a good calibration.

Conclusion: A nomogram for predicting bone development was developed, which can provide a relatively good estimation of BDS for female children and adolescents in Chinese metropolis.

Introduction

Human growth and development is a rather complex process, affected by many factors. The level of growth and development can be reflected by some indicators in children and adolescents (1). Bone growth and development state is one of the factors, which can be determined by using the difference between bone age and chronological age.

Bone age, or skeletal age, needs to be assessed with specialized techniques, such as X-ray photography (2–4). However, application of X-ray photography in large-scale screening can be challenging in children and adolescents, due to the requirement of professionals and its cost associated with the interpretation of X-ray photography (5). Moreover, exposure to X-ray radiation might be harmful to children and adolescents. Therefore, alternative approaches are required to evaluate the bone development state (BDS) of children and adolescents in large-scale screening.

Some studies have reported that there was a high correlation between the secondary sexual characteristics and bone age or bone maturation state in children and adolescents (6–9). Testing of secondary sexual characteristics is relatively simple and feasible compared to X-ray photography; thus, it is worth exploring whether those characteristics can be used to predict bone age, so as to evaluate the BDS in children and adolescents.

In this study, we aimed to establish a model for predicting the BDS of female children and adolescents in Shanghai by using nomogram, which is commonly used in medical diagnosis as an approach for large-scale screening in Chinese metropolis.

Materials and Methods

Ethics Approval

This is part of a large study, which was approved by the ethics committee of School of Life Sciences Fudan University, Shanghai, China. Written consent forms were obtained from the parents of all participants.

Participants

Seven hundred twenty-five female students (aged 6–17 years) from two primary schools and two junior high schools in the urban area of Shanghai were selected by cluster sampling. After exclusion of those with endocrine diseases or chronic diseases, 643 students were included in the study. Among them, 447 female students from one primary school and one junior high school were tested and studied to develop the predictive model as the training cohort, whereas 196 students from another primary school and another junior high school were used as the validation cohort to verify the model (Figure 1). The description of participants' characteristics is shown in Table 1.

FIGURE 1

Figure 1. Flowchart of study design.

TABLE 1

Table 1. Participant characteristics.

Data Collection

Birth date and parents' height were obtained from each participant, as well as bone age, height, weight, body fat percentage, and secondary sexual characteristics (pubes and breast stage). Bone age was tested by a digital X-ray machine (CXDI-50G, Canon, Japan), and X-ray films were interpreted to determine the bone age with radius, ulna and short bone, (RUS); China (CHN) method (10–12). Height was measured with a height measuring instrument (Beijing Jianmin, China). Body weight and fat percentage were measured with a body composition instrument (Inbody 720, Inbody Corp., Korea). The secondary sexual characteristics were evaluated with Tanner stages method (13, 14). The BDS was determined by the difference between chronological age and bone age. The BDS was considered as normal if the difference was <2; otherwise, it was considered abnormal.

Data Analysis

Data were analyzed using the SPSS 26.0 for Windows and the R Programming Language 4.0.5 version. Univariate logistic regression analysis was used to calculate the significance and strength of the association between each factor and BDS. Factor p < 0.10 was considered to have statistical significance and included in multivariate logistic regression analysis subsequently. Multivariate logistic regression analysis was also conducted to determine the factors independently associated with BDS. The results of multivariate analysis were reported as odds ratios and 95% confidence intervals, and p < 0.05 was considered to indicate statistical significance in the multivariate analysis. After these analyses, nomogram was built based on the results of the training cohort and validated with the validation cohort.

Results

Determination of BDS

Difference between chronological age and bone age was calculated, and the BDS was identified in both the training and the validation cohort. One hundred forty-seven participants (32.9%) from the training cohort and 104 participants (53.1%) from the validation cohort were identified as abnormal for BDS, respectively (Figure 1).

Screening of Predictive Factors and Creating the Model

All variables listed in Table 1 were used for univariate logistic regression in the training cohort, and the ones with p < 0.10 were used for stepwise multivariate logistic regression analysis (Table 2). For the multivariate analysis, pubes stage was an independent factor (OR = 1.709, 95% CI = 1.166–2.504) associated with BDS in the training cohort. Finally, the model with pubes stage and three covariates including age, height, and body mass fitted the data well (Hosmer–Lemeshow test p = 0.578) (Table 3).

TABLE 2

Table 2. Univariate logistic regression analysis of bone development state in the training cohort.

TABLE 3

Table 3. Multivariate logistic regression analysis of bone development state in the training cohort.

The receiver operating characteristic (ROC) curve was analyzed and internally validated using bootstrap method for the predictive model, of which the area under the curve (AUC) was 0.78 (95% CI = 0.73–0.83). In the ROC curve, the threshold value was 0.299, with a specificity of 69.0% and sensitivity of 78.2% (Figure 2A). In the validation cohort, the predictive model showed an AUC value of 0.75 (95% CI, 0.68–0.82), with a threshold of 0.694 (specificity: 59.8%, sensitivity: 88.5%) (Figure 2B). The specificity, sensitivity, positive predictive value, negative predictive value, positive likelihood ratio, and negative likelihood ratio were calculated with the data of training cohort and validation cohort, respectively (Table 4).

FIGURE 2

Figure 2. ROC analysis for the predictive model with data sets of training and validation cohorts. (A) The ROC curve for the predictive model with data set of training cohort, AUC = 0.78 (95% CI = 0.73–0.83). (B) The ROC curve for the predictive model with the data set of validation cohort, AUC = 0.75 (95% CI = 0.68–0.82).

TABLE 4

Table 4. Accuracy of the model for predicting bone development state.

Development and Validation of a BDS-Predicting Nomogram

Based on the predictive model with pubes stage and the three covariates, a BDS-predicting nomogram was created (Figure 3A). The calibration curves of the training cohort and the validation cohort showed good agreement graphically, suggesting comparable BDS between the nomogram prediction and the bone age confirmed by the X-ray method (Figures 3B,C).

FIGURE 3

Figure 3. Nomogram for the predictive model and the calibration curves of the training and validation cohorts. (A) Nomogram for predicting bone development state of female children and adolescents. (B) The calibration curve of the nomogram for the training cohort. (C) The calibration curve of the nomogram for the validation cohort.

Discussion

With the rapid development of social economy and the improvement of individuals' living quality, the growth and development characteristics of children and adolescents, especially those in big cities, have changed greatly compared to the past in China (15). The changes of environmental factors brought about by social development, such as air quality, water quality, and dietary habits, also have tremendous impacts on the growth and development of children and adolescents (16, 17). As a result, it is important to screen and evaluate the growth and development of children and adolescents regularly, so as to formulate appropriate health strategies and timely intervention for abnormal individuals. At present, in metropolitan area of China, such as Shanghai, the acquisition of growth and development status was screened and evaluated by using indicators such as height, body weight, and fat percentage (18). Bone age is also an important index for screening and evaluating growth and development, which can reflect BDS in children and adolescents. It has been applied in many fields, such as talent identification of juvenile athletes (19, 20). Bone age is a biological age, which is closely related to the growth and development of children and adolescents. In comparison with height, weight, and other indicators, which are mainly affected by chronological age but not the biological age, bone age may better reflect the growth and development state. Thus, it is reasonable to screen the growth and development level of children and adolescents. However, bone age is determined by X-ray photography; the associated risk of radiation hazards and difficulties in film interpretation make it not accessible for large-scale screening. With the development of digital photographing technology, the steps of photographing and imaging are greatly simplified, and individual X-ray photographing becomes more convenient. However, because of the complexity of X-ray film interpretation, the film interpreter should have certain professional skills and experience, and the film interpretation team should be relatively fixed, and the consistency should be checked frequently. If X-ray is used to screen a large population, the progress of film interpretation will be limited. Because of the rapid and convenient examination of secondary sexual characteristics, it is especially suitable for the screening of a large sample population. In the practical work of specific scenes, such as the primary screening of the growth and development of children and adolescents in the talent identification of athletes in Shanghai, the secondary sexual characteristics are generally used for the primary screening. In order to reduce the subjectivity of the second sexual characteristics examination, the staff are selected with the criteria of evaluating at least 10,000 cases every year. The work position is relatively fixed, and the consistency test between multiple people will be carried out regularly to ensure the accuracy of the examination.

Secondary sexual characteristics are highly correlated with bone age, and the examination is simple and feasible, with a unified international standard that has been implemented in China for several years (13, 14). Therefore, it is a better alternative to use the second sexual characteristics to predict bone age and BDS. The result of multivariate regression analysis in this study was also consistent with a previous study. Yang et al. (9) reported a correlation between bone age and secondary sexual characteristics in children and adolescents aged 7–18 years in Shanghai urban area. In that report, the bone age of male and female children and that of adolescents were significantly correlated with the secondary sexual characteristics, and the bone age of females had a high positive correlation with the pubes and breast stages with the same bone age criteria as our study. Regarding the correlation, the study established a univariate regression equation for bone age and pubes and breast of females, but did not take into account the influence of other confounding factors. In contrast, our current study was also based on the correlation between bone age and secondary sexual characteristics, but using the multiple regression analysis method and correcting for the confounding factors. Our study reflected the true relationship between bone age and secondary sexual characteristics of female children and adolescent more accurately. There were also similar reports in different ethnic populations. Susman et al. (21) reported the relationship between secondary sexual characteristics and the stage of growth and development in 9$\frac{1}{2}$- to 15$\frac{1}{2}$-year-old American white and black children and adolescents. In this study, each sexual maturity stage for genital (boys) or breast (girls) and pubes (boys and girls) was used to predict age, and the synchronous or asynchronous state of growth and development was determined (21). Compared with our study, Tanner original criteria were used in the identification and assessment of secondary sexual characteristics, so the results of the two studies could be compared horizontally. There was a correlation between secondary sexual characteristics and age (chronological age or bone age) in two different ethnic populations of female children and adolescents, and the synchronous or asynchronous state of growth and development was predicted, which were mostly consistent in two studies. The different results in the two studies lay on whether the dependent variable was chronological age or bone age. We believed that bone age could better reflect the real state of growth and development than chronological age. Growth and development are affected by race, social living environment, and economic development level, which may affect the reference data collected. With different reference data, the research result may not accurately reflect the real situation of the studied population or may be biased, which should be treated with caution. For example, the results obtained from the data of children and adolescents in less developed areas of China cannot be applied in metropolis such as Shanghai, because there are differences in social living environment and economic development level between the two populations.

Because the specific indicators of the secondary sexual characteristics are distinguished by gender, it is not appropriate to put the secondary sexual characteristics of both males and females into a predictive model at the same time. For this reason, this study focused only on females to establish a predictive model of BDS.

Nomograms are a pictorial representation of a complex mathematical formula widely used in biological, medical, and clinical fields especially in oncology (22–24). Generally, nomograms use biological and clinical variables, such as participants' age, height, weight, and other measurable variables, to establish a statistical prognostic or predictive model that can generate a probability of a clinical event (25). According to the standard method of establishing multivariate prediction model and nomogram (25, 26), a training and a validation cohort were used with to create the model and nomogram, which was verified by internal cross-validation and external data sets. Therefore, the predictive model has better reliability and repeatability in this study than that with only internal validation.

In this study, C-index (AUC) of nomogram was 0.78 in the training, and it was 0.75 in the validation cohort, which was in the range of 0.7–0.9, and had a relatively good discrimination ability. It has been reported that the AUC values of ROC curves in many cancer predictive models were from 0.6 to 0.9, which was consistent with the result of this study (25).

Based on our results, the model or nomogram has a good discrimination in the large-scale screening of the growth and development in urban female children and adolescents. Some possible limitations should be acknowledged for this study. Because bone development in children and adolescents will be affected by many aspects, there may be many confounding factors in the prediction model. The effect estimates in the predictive model are based on measured observation indices. Because of the limitations of some objective conditions, the measurement indicators may not be able to fully reflect all the bone development characteristics of female children and adolescents. There are no indicators such as blood routine examination or growth and development–related hormone levels that may be closely related to the bone development status. These indicators are likely to be confounding factors that affect the prediction of the model. If they are not corrected, the estimated accuracy of the model may be compromised. In the follow-up in-depth study, the research team will try to measure and acquire more indicators that may be associated with bone maturation state. Our study is a cross-sectional study of the population only in the urban area of Shanghai without multicenter study design. The research results may be applicable only to the urban area of Shanghai or China's metropolitan areas with similar development status. There may be regional and economic development restrictions on the applicability of the whole Chinese female children and adolescent population. In contrast, a similar study in the United States has done a better job in this regard. The multicenter population well-represented various regions and states all over the United States (21). Based on this limitation, we are planning to expand the sampling population to cities and villages with different economic development in different regions of China and strive to achieve the representative coverage and the universality of the application of the results.

In summary, we have developed a nomogram to predict BDS in female children and adolescents, based on pubes stage, chronological age, height, and body mass. The predictive model can provide a relatively good estimation of BDS for female children and adolescents in Chinese metropolis. It is worth exploring its application in other Chinese metropolises in and outside.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics Statement

The studies involving human participants were reviewed and approved by the ethics committee of School of Life Sciences Fudan University, Shanghai, China. Written informed consent to participate in this study was provided by the participants' legal guardian/next of kin.

Author Contributions

RY, LW, and CW designed the study. RY, HS, JH, QZ, SJ, XL, and YL conducted the study and collected the data. RY, XY, and MC analyzed the data. RY and CJ drafted the manuscript. XY, JW, and HW revised the manuscript. All authors contributed to the article and approved the submitted version.

Funding

This study was supported by Scientific Research Foundation of SUMHS, Grant No. SSF-21-03-004, Shanghai sports science and technology plan: Eagle Project, Grant No. 20C008, Project of Clinical Outstanding Clinical Discipline Construction in Shanghai Pudong New Area (No. PWYgy2018-07), Project of Shanghai Municipality Key Medical Specialties Construction (No. ZK2019C08), and Leading Talent Training in Shanghai Pudong New Area Health System (No. PWRl2018-08).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

1. Palanisamy V, Rao A, Shenoy R, Baranya SS. Correlation of dental age, skeletal age, and chronological age among children aged 9-14 years: a retrospective study. J Indian Soc Pedod Prev Dent. (2016) 34:310–4. doi: 10.4103/0970-4388.191408

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Dahlberg PS, Mosdøl A, Ding Y, Bleka Ø, Rolseth V, Straumann GH, et al. A systematic review of the agreement between chronological age and skeletal age based on the Greulich and Pyle atlas. Eur Radiol. (2019) 29:2936–48. doi: 10.1007/s00330-018-5718-2

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Kvaal SI, Haugen M. Comparisons between skeletal and dental age assessment in unaccompanied asylum seeking children. J Forensic Odontostomatol. (2017) 35:109–16.

PubMed Abstract | Google Scholar

4. Macha M, Lamba B, Avula JSS, Muthineni S, Margana PGJS, Chitoori P. Estimation of correlation between chronological age, skeletal age and dental age in children- a cross-sectional study. J Clin Diagn Res. (2017) 11:ZC01–ZC04. doi: 10.7860/JCDR/2017/25175.10537

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Thukral BB. Problems and preferences in pediatric imaging. Indian J Radiol Imaging. (2015) 25:359–64. doi: 10.4103/0971-3026.169466

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Vandewalle S, Van Caenegem E, Craen M, Taes Y, Kaufman JM, T'Sjoen G. Growth, sexual and bone development in a boy with bilateral anorchia under testosterone treatment guided by the development of his monozygotic twin. J Pediatr Endocrinol Metab. (2018) 1:361–7. doi: 10.1515/jpem-2017-0126

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Piloya-Were T Odongkara-Mpora B Namusoke H Idro R. Physical growth, puberty and hormones in adolescents with Nodding Syndrome; a pilot study. BMC Res Notes. (2014) 7:858. doi: 10.1186/1756-0500-7-858

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Cheuiche AV, da Silveira LG, de Paula LCP, Lucena IRS, Silveiro SP. Diagnosis and management of precocious sexual maturation: an updated review. Eur J Pediatr. (2021). doi: 10.1007/s00431-021-04022-1. [Epub ahead of print].

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Yang R, Zhan Q, Li L. Correlation between bone age and secondary sex characteristics in 7-18 years old adolescent in Shanghai. Chin J Sch Health. (2013) 34:68–70. doi: 10.16835/j.cnki.1000-9817.2013.01.025

CrossRef Full Text

10. Zhang S, Liu L, Wu Z, Liu G, Ma Z, Shen X, et al. The skeletal development standards of hand and wrist for Chinese children-China 05 I. TW3-C RUS, TW3-C Carpal, and RUS-CHN methods. Chin J Sports Med. (2006) 25:509–16. doi: 10.16038/j.1000-6710.2006.05.001

CrossRef Full Text | Google Scholar

11. Zhang S, Jin C, Shen S, He Z, Liang J, Li X, et al. The retest on reliability of assessing skeletal age by China 05 RUS-CHN method. China Sport Sci. (2014) 34:92–6. doi: 10.16469/j.css.2014.04.002

CrossRef Full Text

12. Yao L. Comparative study of three common digital radiograph bone age evaluation criteria. J Beijing Sport Univ. (2018) 41:75–81. doi: 10.19582/j.cnki.11-3785/g8.2018.01.011

CrossRef Full Text

13. Fatima T, Hussain Chandio S, Muzaffar K, Mumtaz H, Jahan N. Pituitary stalk interruption syndrome. Cureus. (2020) 12:e10518. doi: 10.7759/cureus.10518

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Emmanuel M, Bokor BR. Tanner Stages. Treasure Island, FL: StatPearls Publishing (2021).

Google Scholar

15. Zong XN, Li H. Physical growth of children and adolescents in China over the past 35 years. Bull World Health Organ. (2014) 92:555–64. doi: 10.2471/BLT.13.126243

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Zhang Y, Wang H, Wang X, Liu M, Wang Y, Wang Y, et al. The association between urbanization and child height: a multilevel study in China. BMC Public Health. (2019) 191:569. doi: 10.1186/s12889-019-6921-z

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Dong Y, Jan C, Ma Y, Dong B, Zou Z, Yang Y, et al. Economic development and the nutritional status of Chinese school-aged children and adolescents from 1995 to 2014: an analysis of five successive national surveys. Lancet Diabetes Endocrinol. (2019) 7:288–99. doi: 10.1016/S2213-8587(19)30075-0

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Zong X, Li H, Zhang Y, Wu H. Weight-for-length/height growth curves for children and adolescents in China in comparison with body mass index in prevalence estimates of malnutrition. Ann Hum Biol. (2017) 44:214–22. doi: 10.1080/03014460.2016.1232750

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Romann M, Fuchslocher J. Assessment of skeletal age on the basis of DXA-derived hand scans in elite youth soccer. Res Sports Med. (2016) 24:200–11. doi: 10.1080/15438627.2016.1191490

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Malina RM, Rogol AD, Cumming SP, Coelho e Silva MJ, Figueiredo AJ. Biological maturation of youth athletes: assessment and implications. Br J Sports Med. (2015) 49:852–9. doi: 10.1136/bjsports-2015-094623

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Susman EJ, Houts RM, Steinberg L, Belsky J, Cauffman E, Dehart G, et al. Longitudinal development of secondary sexual characteristics in girls and boys between ages 91/2 and 151/2 years. Arch Pediatr Adolesc Med. (2010) 164:166–73. doi: 10.1001/archpediatrics.2009.261

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Li W, Li Y, Zhang Z, Xia K, Shang X, Yang X, et al. Predictive nomogram of RAGE genetic polymorphisms and metabolic risk factors for myocardial infarction risk in a han Chinese population. Angiology. (2017) 68:877–83. doi: 10.1177/0003319717696622

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Lei Z, Li J, Wu D, Xia Y, Wang Q, Si A, et al. Nomogram for preoperative estimation of microvascular invasion risk in hepatitis B virus-related hepatocellular carcinoma within the Milan criteria. JAMA Surg. (2016) 151:356–63. doi: 10.1001/jamasurg.2015.4257

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Huang YQ, Liang CH, He L, Tian J, Liang CS, Chen X, et al. Development and validation of a radiomics nomogram for preoperative prediction of lymph node metastasis in colorectal cancer. J Clin Oncol. (2016) 34:2157–64. doi: 10.1200/JCO.2015.65.9128

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Balachandran VP, Gonen M, Smith JJ, DeMatteo RP. Nomograms in oncology: more than meets the eye. Lancet Oncol. (2015) 16:e173–80. doi: 10.1016/S1470-2045(14)71116-7

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Collins GS, Reitsma JB, Altman DG, Moons KG. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. BMJ. (2015) 350:g7594. doi: 10.1136/bmj.g7594

PubMed Abstract | CrossRef Full Text | Google Scholar