- 1Doctoral Program in Clinical Medicine and Public Health, University of Granada, Granada, Spain
- 2Department of Ophthalmology, San Cecilio University Hospital, Granada, Spain
- 3Bachelor of Medicine, University of Granada, Granada, Spain
- 4Department of Paediatrics, University Hospital Virgen de las Nieves, Granada, Spain
- 5Department of Paediatrics, San Cecilio University Hospital, Granada, Spain
Importance: Vascular delay that occurs early in the development of retinopathy of prematurity (ROP) is a risk factor that can be compensated by ensuring a good rate of retinal vascularization to avoid ROP that requires treatment.
Background: The objective of the present study was to determine the association between ROP that requires treatment and risk factors such as the extent of the temporal avascular area of the retina and the number of days of mechanical ventilation (MV).
Design: Observational retrospective case-control study.
Participants: Two hundred and twenty-eight premature newborns included in the screening protocol for retinopathy of prematurity.
Methods: Subjects underwent retinal examination in the 4 and 6th postnatal weeks.
Main Outcome Measures: The temporal avascular area was measured in disc diameters (DD), while the MV time was measured in days of treatment.
Results: Patients with a longer MV time had a higher risk of treatment (R2: 24.7, p < 0.0001; increase in risk of 8.1% for each additional day), as did those who showed greater avascular area (R2: 24.7, p < 0.0001; increase in risk of 111% for each additional DD). An online calculator system and a table are presented for calculating the risk of ROP requiring treatment as a function of these two risk factors.
Conclusions and Relevance: The temporal avascular area of the retina and MV time must be taken into account in the first examination of the newborn to predict the need for ROP treatment.
Introduction
Retinopathy of prematurity (ROP) is currently the world's second leading cause of preventable child blindness (1, 2). For this reason, numerous studies have been carried out to identify the main risk factors for ROP (3) and incorporate them into early ROP detection algorithms (4). Current screening algorithms are mainly based on birth weight and gestational age (3). However, several other related factors are involved, such as the avascular area of the retina, the rate of retinal vascularization, and the time spent by the premature newborn under mechanical ventilation (MV) (3–6).
Various ROP predictive models to identify newborns requiring ophthalmologic screenings are reported in the literature. Majority show high sensitivity and medium to low specificity (7–10). Authors themselves have made clarifications regarding their own models, claiming that no predictive model will work properly at a universal level (11); in many cases newborns of ≥31 weeks or <24 weeks of pregnancy, who quite often show a wide area of non-vascularized retina after birth, are excluded (12). However, there is not a single model of practical applicability and adaptability currently available in the usual clinical practice (13) that helps physicians identify newborns with higher risk of severe ROP requiring treatment and guides the planning of checkup frequency.
The DIGIROP model concluded that one of the best variables for predicting risk of requiring ROP treatment is postnatal chronologicalage (12). Conversely, the Early Treatment for Retinopathy Of Prematurity Study showed that the wider the avascular area (zone I), the higher the risk of requiring treatment (14). The more severe a ROP is, the larger the peripheral area of retinal ischemia is, and this is associated with a greater need for revascularization and recovery time (15). Specifically, the revascularization time required to reverse ROP in zone I is significantly longer than that required in zone II, which in turn is longer than that required in zone III (16, 17). A retinal vascularization rate of <0.5 disc diameters (DD) per week (18) has been identified as an indication for ROP treatment (5). Therefore, why not study the temporal avascular area of the retina as a risk factor?
Both bronchopulmonary dysplasia and the need for MV in the premature newborn (19) are closely related to ROP. Longer MV times are associated with greater risk of ROP requiring treatment (6, 20). Recently, new oxygen therapy control measures have been implemented in neonatal intensive care units (NICUs) (21), as has early treatment by intravitreal bevacizumab or laser diode. Both these techniques have contributed to an improved prognosis for newborns with ROP (22).
The objective of the present study was to determine the risk factors for ROP requiring treatment, and to develop a system for calculating the risk of ROP requiring treatment that is based on the main risk factors and can be applied in clinical practice at the first examination of the newborn.
Materials and Methods
The present study was approved by the Biomedical Research Ethics Committee of Andalusia and was carried out in accordance with the ethical principles of the Declaration of Helsinki for medical research. All medical data were collected anonymously after informed consent was given and after the parents or legal guardians of the study participants gave express authorization.
Subjects of the Study
An observational, retrospective case-control study was conducted on 228 premature newborns who were examined between 1999 and 2019 at the NICU of the San Cecilio University Hospital in Granada, Spain. One eye of each patient was included in the study.
Inclusion criteria were: (1) birth weight <1,500 g or GA ≤ 32 weeks, (2) birth weight between 1,501 and 2,000 g and GA ≥ 32 weeks with oxygen supply > 72 h or unstable clinical course as determined by the NICU neonatologist (apneas, neonatal acidosis, twin death, intraventricular hemorrhage, persistent ductus, sepsis, necrotizing enterocolitis, or concurrent surgical interventions), (3) preterm newborns that could be examined between the fourth and sixth postnatal weeks, and (4) preterm newborns with at least three examinations performed. Participants were excluded from the study when (1) they could not be examined between the 4 and 6th weeks after delivery, (2) they underwent fewer than three examinations, (3) they had complete retinal vascularization in the first examination, and (4) they showed medial opacity.
Eye Examination
All patients were examined by the same pediatric ophthalmologist between the 4 and 6th postnatal weeks. The examinations used indirect ophthalmoscopy with indentation and were carried out under pharmacological mydriasis with topical anesthesia using a 20 diopter lens. This technique provides an approximate field of vision of 8 DD, which is equivalent to 45°. First, estimation of the vascular caliber is carried out and presence or absence of dilation or vascular tortuosity found in the vessels of the central retina is evaluated. Subsequently, the ROP stage and compromised area are identified. Next, eyeball indentation is performed in order to observe the peripheral retina by aligning the binocular ophthalmoscope until the raised gray line corresponding to the indentation is visible. Indentation is moved in parallel until the first temporal vessel is visualized in the periphery.
In each examination, the following data were collected: ROP stage according to the International Classification of Retinopathy of Prematurity (16), affected retinal area (zones I, II, and III), time extension, presence of preplus and plus disease, and extent of retinal avascular area (in DD) from the periphery to the center of the retina. Examinations were performed weekly or every 2 weeks until the retina was completely vascularized, except in patients with preplus or plus disease, in those with limited vascularization in zone I or posterior zone II, or in those with stage 3 ROP in any zone. In such cases, examination was carried out weekly.
Eye selection for the study (right or left) was carried out through random allocation.
The need for ROP treatment was recorded as a dependent variable, while the following parameters were recorded as independent variables: temporal avascular area of the retina in DD, GA (weeks), and MV time (days). We also collected weight gain in the first 4 weeks of postnatal life (g/day), Apgar score (23), degree of bronchopulmonary dysplasia (19), number of blood transfusions received, presence of apnea (24), persistence of arterial ductus, presence of sepsis (25), presence of necrotizing enterocolitis, presence of intraventricular hemorrhage and presence of periventricular leukomalacia.
Disc diameters: The measurement unit used to quantify non-vascularized area of the retina was the disc diameter (DD). The horizontal diameter of the subject's optic nerve can be quickly and easily identified during fundus exploration. Once the optic disc diameter is known, extension of any retinal territory can be quantified in DDs. This measurement unit has been used by several authors to quantify the territory of retinal immaturity (26, 27).
Mechanical ventilation time (MV) was defined as the treatment time using endotracheal intubation. MV time was measured in days. However, between 2009 and 2012, the oxygen supply protocols were modified. Saturation levels were maintained at ~95% during the years 2000–2009; from 2009–2012 they varied between 85 and 93% (6).
Postnatal weight gain was defined as the weight gained from birth up to week 4. It is expressed in g/day and is the result of the weekly weight gain average measured during routine neonate screenings.
The Apgar Scale was described by Virginia Apgar to assess the newborn's overall condition based on heart rate, breathing effort, response to stimuli, muscles tone, and skin color of the newborn. Apgar Scale at minute 1 of birth reflects the newborn's tolerance to birth, and Apgar at minute 5 reflects their adaptability level to the environment (23, 28).
Bronchopulmonary dysplasia was defined as a preterm infant chronical pulmonary disease with limited respiratory function caused by airway immaturity and exposure to high oxygen saturation due to mechanical ventilation (19). Three levels of severity (mild, moderate, and severe) were established based on gestational age (over or under 32 weeks of pregnancy) and ability to breathe room air or require oxygen at a concentration above or below 30% (29).
Presence of neonatal apnea was defined as the absence of respiratory effort for more than 20 s, or for more than 10 s with bradycardia or desaturation in newborns within the first 28 days of life (30).
Anemia and the need for blood transfusions are two conditions that have been related to ROP severity. The literature shows conflicting results. Some studies show that receiving a higher amount of blood supply has no significant impact on ROP severity (31). However, other studies show that receiving a low number of blood transfusions could result in a higher percentage of fetal hemoglobin, instead of adult hemoglobin, which could be a ROP protective factor (32).
Presence or absence of patent ductus arteriosus was confirmed in all of the cases using echocardiography. Rate of spontaneous closure of ductus arteriosus decreases considerably in newborns of <28 weeks and/or <1,000 g at birth, and its presence has been associated with several pathologies, such as ROP (33).
Sepsis was defined as a life-threatening organ dysfunction caused by a dysregulated host response to infection. Organ dysfunction can be identified as an acute change in total SOFA (Sequential Organ Failure Assessment) score ≥2 points consequent to the infection (25).
Necrotizing enterocolitis was defined as an abdominal distention with pneumatosis intestinalis, portal venous gas, or both; or presence of other radiographic signs, such as fixed, dilated intestinal loops and ileus patterns (34). Most published articles show a higher risk of ROP in preterm infants with necrotizing enterocolitis. However, some authors claim that this relation could be caused by the impact of prolonged treatment with oxygen (3).
Presence of cerebral hemorrhage with intraventricular extension diagnosed by a pediatrician or neuropediatrician and confirmed through imaging was included in the study. Severity was classified using the Graeb Score (35). The presence of intraventricular hemorrhage has been associated with severe stages of ROP (36) and as one of the pathologies with higher morbidity and mortality in preterm newborns.
Presence of periventricular leukomalacia was determined using neuroimaging (primarily, ultrasonography, and/or magnetic resonance imaging) (37).
Identified cases included eyes that received treatment for threshold retinopathy of prematurity (ROP) or type 1 prethreshold ROP. Identified controls included other eyes that did not receive treatment for ROP or those presenting progression-free type 2 prethreshold ROP.
Statistical Analysis
Statistical analysis was performed using the Statistical Package for Social Sciences (SPSS 25.0; IBM Corp. Armonk, NY: IBM Corp). The variables were analyzed descriptively and expressed as means ± standard deviation. Cuantitative variables were compared using Mann-Whitney U-test. Qualitative variables were compared using Pearson's χ2 test. The predictive risk model was implemented using binary logistic regression between the dependent variable (ROP requiring treatment) and each of the independent variables.
Results
Descriptive Analysis
A total of 683 premature newborns were screened, of which 455 were excluded because they did not meet the inclusion criteria. Of the 228 newborns ultimately included in the study, 38 (16.7%) received treatment, while 190 (83.3%) did not.
The mean GA of the study population was 28.83 ± 2.03 weeks; 34.6% of the newborns had a gestational age of 24–27 weeks, 47.4% of 28–30 weeks, and 18% of 31–34 weeks. The lowest GA in the study sample was 24 weeks, while the highest was 34 weeks.
The mean MV time of the entire sample was 9.4 ± 13.64 days; 28.07% of the newborns did not require MV, 42.98% required ≤ 10 days of MV, and 28.95% required > 10 days of MV.
The mean temporal avascular retinal area in the study sample was 3.46 ± 1.63 DD; 40.4% of the newborns had a temporal avascular area of <3 DD, while 37.7% had an avascular area between 3–4 DD and 21.9% had an avascular area of ≥ 5.00 DD (Table 1).
Table 1. Descriptive statistics of the study sample, average difference in continuous variables (Mann–Whitney U-test) and percentage difference in qualitative variables (Pearson's chi-square test) within treated and untreated ROP groups.
Relationship Between ROP Requiring Treatment and Study Variables
Table 2 shows the results of the binary logistic regression analysis between ROP requiring treatment and the risk factors related to retinal vascular development in ROP identified in the study.
Table 2. Analysis of the risk factors for severe ROP requiring treatment (assuming that the other variables remain constant in the sample).
Relationship Between ROP Requiring Treatment Retinal Temporal Avascular Area
Greater retinal avascular area was significantly associated with greater risk of ROP requiring treatment (Nagelkerke's R2: 30.1%, p < 0.0001). The first patients who were treated presented with 2.00 DD without vascularization. Of the patients with ≥ 6 DD of retinal avascular area, 58.83% required treatment (Table 3, Figure 1).
Table 3. Relationship between retinal temporal avascular area and ROP requiring treatment in the sample. As avascular area increases, so did the percentage of individuals requiring treatment.
Figure 1. Relationship between retinal avascular area and ROP requiring treatment, adjusted by gestational age. U Mann Whitney medium range differences: ROP no requiring treatment, 101.78; ROP requiring treatment, 178.08 (p < 0.0001).
Relationship Between ROP Requiring Treatment and Mechanical Ventilation Time
Longer MV times were significantly associated with greater risk of ROP requiring treatment (Nagelkerke's R2 = 24.7%, p < 0.001), as shown in Table 4. After 31 days of MV, 72.7% of the newborns required treatment (Table 4, Figure 2).
Table 4. Relationship between MV time and ROP requiring treatment. As the MV time increases, so does the percentage of individuals treated.
Figure 2. Relationship between mechanical ventilation time and ROP requiring treatment, adjusted by gestational age. U Mann Whitney medium range differences: ROP no requiring treatment, 104.98; ROP requiring treatment, 162.09 (p < 0.0001).
Models for Calculating the Probability of ROP Requiring Treatment
Binary Logistic Regression Between ROP Requiring Treatment and Gestational Age at Birth
According to the logistic regression analysis, newborns with lower GA had a greater probability of requiring treatment (Nagelkerke's R2 = 16.1%, p < 0.001; OR: 0.631, 95% confidence interval [CI]: 0.513–0.775, p = 0.005]. Applying the logistic regression model between the dependent variable (ROP requiring treatment) and GA in weeks yielded the following:
The probability of treatment decreased by 36.9% for each additional week of GA, if the rest of the variables remained constant.
Binary Logistic Regression Between ROP Requiring Treatment and Duration of MV
The risk of requiring treatment for ROP is directly proportional to the days of duration of MV (Nagelkerke's R2: 24.7%, p < 0.001) [OR:1.08 (CI: 1.049, 1.115), p = 0.005]. As in the previous section, following the logistic regression equations between ROP requiring treatment and the days of duration of MV:
For each additional day of MV, the probability of ROP requiring treatment was increased by 8.1% provided the rest of the variables remained constant.
Logistic Regression Between ROP Requiring Treatment and Temporal Avascular Area
A directly proportional relationship was observed between risk of ROP requiring treatment and size of retinal temporal avascular area. That is, larger avascular area was associated with greater risk of requiring treatment (Nagelkerke's R2 = 30.1%, p < 0.001; OR: 2.11, 95% CI: 1.648–2.701, p = 0.005). Again, following the logistic regression equations, we concluded that:
For every DD of additional retinal temporal avascular area in the premature newborn, the probability of requiring treatment increased by 111% provided the rest of the variables remained constant.
Risk Calculator for ROP Requiring Treatment Based on the Retinal Temporal Avascular Area and MV Time
According to the multiple logistic regression model, longer MV time was significantly associated with greater avascular area and greater likelihood of ROP requiring treatment (Nagelkerke's R2 = 42.9%, p < 0.001; OR for avascular area in DD: 1.986, 95% CI: 1.527–2.582, p = 0.005; OR for MV time in days: 1.067, 95% CI: 1.033–1.101, p = 0.005).
On the basis of the equations of this analysis, we can conclude the results shown in Table 5. An automatic online calculator system for predicting ROP requiring treatment was created (available on: www.roprequiringtreatment.com).
Table 5. Table for calculating risk of ROP requiring treatment based on the retinal temporal avascular area in DD and the MV time in days, according to the ET-ROP study (38, 39).
The risk calculator sensitivity and specificity for predicting severe ROP requiring treatment, based on the levels of probability are shown in Table 6.
Table 6. Model sensitivity and specificity for predicting severe ROP requiring treatment, based on the three different levels of probability in Table 5 (low risk—green; moderate risk—yellow; high risk—red).
Discussion
The clinical examinations performed during the present study were carried out by a single pediatric ophthalmologist based on the guidelines of the screening program for ROP in Spain (40). Fundus examination was performed using indirect binocular ophthalmoscopy with scleral indentation, which is currently considered the gold standard technique for complete evaluation of the retina. Unlike other automated techniques such as the use of RetCam®, indirect binocular ophthalmoscopy with scleral indentation enables adequate evaluation of the peripheral retina, which is extremely important in the initial stages of ROP (41–43). However, this method does not allow photographic images to be recorded, as the RetCam® does. This limitation was partially resolved using real time video recordings of the images obtained by the binocular ophthalmoscope.
Examination instruments such as RetCam®, retinoscopy, or wide-field angiography have allowed repeated examination and analysis of retinal images in numerous studies (41–44). However, these techniques are rarely available in hospitals, so the indirect binocular ophthalmoscope continues to be used by numerous specialists. Many previous authors have measured the extent of retinal vascularization in patients with ROP to identify ROP stage and evaluate treatment efficacy (26, 45, 46).
Pediatric ophthalmology experts have a great ability to distinguish vascular dilation, ROP stages in poorly dilated eyes, and color and traction morphology of injuries. Several authors have previously measured the degree of retinal vascularization in patients with ROP to identify the ROP stage and evaluate treatment efficacy (26, 45–47). We believe that, with additional practice, indenting the temporal periphery retina and obtaining the avascular area in the DD observed during each neonatal screening should be easy. This information collected all throughout screening also allowed us to identify another progression marker: vascularization speed. Thus, insufficient vascularization speed of <0.5 DD is an indicator of ROP requiring treatment (48).
In our series, two children treated for ROP (5%) had a birth weight equal or above 1,501 g, or a gestational age of more than 30 weeks, implying that they would not have been detected by any predictive factor model, such as G-ROP (49). Two preterm infants with 2.5 DD of non-vascularized temporal retina were treated for ROP. Retinal vascularization of zone III without prior ROP of zone I or II must be accomplished to be discharged from the screening program (if screener has doubts regarding the zone, confirmatory tests may be justified) (50).
Postnatal weight gain was expressed in g/day and is the result of the weekly weight gain average measured during routine neonate screenings. After a thorough analysis of the literature (7, 10, 51–53), the measurement unit chosen for postnatal weight gain was g/day instead of g/kg/day. Newborns who are underweight at birth have been traditionally associated with a lower weight gain during neonatal period and delays in neurological development. However, a lower birth weight is not a pathogenic factor of retinopathy of prematurity (ROP) in itself, but rather, majority of cases reported in the literature are related to gestational factors (delays in fetal growth from maternal, placental or fetal causes, and prioritization of development of vital organs at the expense of other secondary structures, such as the retina) (54, 55) and newborn comorbidity, which can be the cause of lower birth weight (54, 56, 57).
Risk factors that could be related to or derived from treatment with oxygen (presence/absence of apnea and degree of bronchopulmonary dysplasia, which did not show significant differences between the groups with treated and untreated ROP) were excluded from the predictive model for calculating severe ROP requiring treatment, as these factors could be influenced by duration of mechanical ventilation (19, 29), which is indeed included in the model. It was also decided to exclude neonatal comorbidity (number of transfusions, sepsis, necrotizing enterocolitis, intraventricular hemorrhage, and periventricular leukomalacia) from the model (3, 31, 33, 37). In our study, statistically significant differences were found between the presence of those comorbidity factors and the degree of ROP. However, results described in the literature are heterogeneous, and extrapolating the prediction of this sample to other study populations that showed different results would be difficult. We believe that neonatal comorbidity must be valued individually, and that it is closely related to gestational age and birth weight.
A first model of logistic regression, including avascular area, duration of mechanical ventilation, gestational age and birth weight, was elaborated. Ninety-five percent (95%) confidence intervals deriving from this logistic regression for gestational age and birth weight were 0.74–1.37 and 0.99–1.01, respectively. As confidence intervals include the value 0, these were excluded from the calculator tool due to their low statistical significance value in the predictive model. This lack of significance could be the result of patients already being selected at the beginning of the study based on their gestational age and birth weight, according to the Screening Program for Retinopathy of Prematurity in Spain (40).
In our model, avascular area replaces gestational age given that both variables are strongly correlated, as the avascular area of the first test collects information on the pre and postnatal vascular delay. Thus, the calculator tool was developed based on two variables: avascular area and duration of mechanical ventilation. Gestational age and birth weight are the two most relevant variables considered to select newborns requiring screenings for ROP. Both variables are included in the Screening Program for Retinopathy of Prematurity in Spain (40), and most countries have their own screening criteria (40, 50, 58–60).
However, the calculator tool cannot be used to determine which neonate must be screened, but rather to customize the frequency of ophthalmological checkups. The calculation model's main use is to identify neonates that while participating in the screening program must be subject to more frequent screenings and a more intensified comorbidity control, due to a high risk of severe ROP requiring early treatment; or, neonates that can be subject to less frequent screenings due to low risk of severe ROP.
The simple design of the table based on only two variables allows for a quick and easy observation and interpretation by clinicians during their usual clinical practice, in case of unavailability of electronic device at hand. However, this calculator must be improved in the future as these variables only explain 41% of the outcome and must be validated through studies executed at other centers.
ROP has a hereditary component that ranges between 70 and 73% (61, 62). Furthermore, the vascularization of the choroid, vitreous, and retina occurs alongside the development of nutritional supply to these structures (63). In premature newborns, vascular development of the retina occurs parallel to neurological development (64). Genetics and the environment can interact during pregnancy, birth, or in the postnatal period. However, numerous factors, such as oxygen concentration, can influence vascular delay or inhibition of the retina during phase I of ROP. The resulting retinal ischemia may subsequently contribute to the development of neovessels during phase II of ROP (3).
Michaelson reported that the growth rate of the superficial retinal vessels was 100 μm/day in the human fetus (65). Factors such as low GA and other vascular development inhibitors may lead to a greater avascular area in the temporal retina (5, 48). Premature newborns who present with absence of vascularization in zone I at the first examination have a higher risk of ROP requiring treatment than those who present with absence of vascularization in zone II or III (38).
Various models of ROP screening, such as WINROP (7), CHOP-ROP (66), PINT-ROP (51), NED-ROP (67), and CO-ROP (68), have been proposed to identify newborns at risk of ROP and minimize unnecessary examinations in newborns at low risk. However, ROP cannot always be seen to its fullest extent at the first examination of the newborn (69). Therefore, once newborns are selected to undergo ophthalmological examination, clinicians must take into account the above risk factors, especially the avascular area (in DDs) and the MV time (in days). In so doing, at the first examination they will be able to identify newborns at higher risk of requiring treatment. Therefore, the risk calculation model presented in the present study may be useful for pediatric ophthalmologists during clinical practice.
The objective of this study differs from that of most studies published in the literature in a sense that it is not an ROP or severe ROP screening tool, but rather a tool to be used after the first screening, following the screening criteria of each country. By using the screening criteria of each center or country, newborns that are subjected to serial ophthalmologic screening are identified. In each country or center, screenings are carried out on a weekly or biweekly basis (40, 50), or customized to the severity of each newborn. By applying the model for predicting the risk of severe ROP requiring early treatment on the cohort of neonates, we will be able to adapt the periodicity of checkups.
Each country has its own ROP screening program based on gestational age, birth weight, and neonatal comorbidity, although almost all of them share common characteristics. Gestational age threshold is between week 30 (50, 58) and 32 (40, 59) for most countries, and birth weight is around 1,500 g (40, 50, 58, 59). However, in many developing countries, screening criteria are broader, reaching week 34 of pregnancy and 1,850 g of birth weight (60).
Previous studies carried out at our center on a preliminary patient cohort have shown the usefulness of measuring the vascular/avascular area (5, 48). Thus, vascularization speed from the temporal avascular area to the posterior pole below 0.5 DD/week has been identified as an independent risk factor for severe ROP requiring treatment (5). A study carried out at another center on a different patient cohort analyzed the impact of the risk factors for ROP and the effect of control measures of oxygen saturation levels implemented through the Oxygen With Love (OWL) program. This study revealed that the implementation of the OWL program had a significantly positive impact on the reduction of the number of days of tracheal intubation, and reduction of sepsis rates and extremely low postnatal weight gain (<7 g/day) (6).
Many severe ROP screening or early diagnosis tools have been described in the literature in the past few years. However, most of them are proposed as an initial screening tool to minimize screenings in newborns (7–10, 67, 68). whereas the model described in this study is proposed as a tool to be used on neonates who have already been selected for screenings, following the screening criteria of the country involved–in our case, Spain (40). Neonatal algorithms consider risk factors other than gestational age, postmenstrual age, birth weight, and weight gain. However, when models include ocular fundus data, other risk factors appear, such as pre-plus disease, or prolonged use of mechanical ventilator, which also contribute to a higher risk of guaranteed ROP (70).
The WINROP (Weight, IGF-I, Neonatal, ROP) study was carried out by Hellström et al. (71) to identify preterm newborns with risk of severe ROP early on and avoid unnecessary screenings on other neonates. Initially, this algorithm was based on birth weight, gestational age, and serum insulin-like growth factor-1 levels (IGF1) (7), which were later substituted by weekly weight gain (71, 72). This screening tool, like the calculator proposed by our team, can be checked online.
Another screening model, described with the purpose of identifying newborns that need ophthalmologic screenings due to risk of ROP, is the Children's Hospital of Philadelphia Retinopathy of Prematurity Risk Model. A total of 524 neonates of ≤ 30 weeks of pregnancy (WOP) or <1,501 g of weight were included in this retrospective study to determine, through multivariate logistic regression techniques, the cut-off point of each parameter that allowed an adequate identification of subjects with risk of type 1 or 2 ROP (8, 66).
On the other hand, the ROP Score algorithm, introduced by Eckert, Fortes Filho et al., was based on the aggregate risk of its risk factors. This algorithm was compared with the individual use of birth weight and gestational age in a cohort of 474 neonates of ≤ 1,500 g and/or ≤ 32 WOP. Risk factors included in the algorithm were the following: birth weight, gestational age, postnatal weight gain during the first 6 weeks, treatment with oxygen and need for blood transfusion in the first 6 weeks (9).
The Premature Infants in Need of Transfusion (PINT) study was created to analyze the effect of blood transfusions and level of hemoglobin on the morbidity and mortality of preterm infants (10). However, a model of early diagnosis in newborns with extremely low birth weight was developed from a patient cohort of the PINT study, based on gestational age, birth weight, and daily weight gain (51). The CO-ROP model, developed at the University of Colorado, describes a new ROP screening algorithm based on birth weight, gestational age and postnatal weight gain. The algorithm included newborns of ≤ 30 WOP and ≤ 1,500 g at birth and a net weight gain of ≤ 650 g during the 1st month of postnatal life (68). The Netherlands Retinopathy of Prematurity Study Model (NEDROP) studied several ROP screening strategies and concluded that the strategy that most efficiently diagnosed ROP was the one including newborns of ≤ 30 WOP and ≤ 1,250 g of birth weight and neonates of gestational age between 30–32 WOP and 1,250–1,500 g of birth weight, with at least one risk factor (treatment with oxygen or corticosteroids, sepsis, necrotizing enterocolitis, or heart disease) (73).
Gopal suspects intuitively that the extension of the avascular retina at birth should be a predictive factor for the need for treatment of ROP (74). Meanwhile, Jayadev classifies the temporal avascular area of the retina into three degrees: (a) mild: vessels reach posterior zone III; (b) moderate: vessels enter anterior zone II; (c) severe: vessels in posterior zone I or zone II. Thus, type 1 and type 2 ROP are predicted during the first screening visit (27). Jayadev and we have determined that the avascular area of the retina is the main risk factor for ROP requiring treatment. Jayadev's multivariate analysis also includes gestational age, birth weight and sex, whereas our new model includes duration of mechanical ventilation.
Limitations of the Study
As previously mentioned, our examination method did not allow quality photographic images to be collected. However, we were able to capture the examination images obtained. The examinations were performed by a single pediatric ophthalmologist during routine clinical practice, and the images or scans were not repeated or analyzed by multiple observers. On the other hand, over the course of the study, from 2009 to 2012, the oxygen therapy protocols underwent a drastic change, because the Oxygen with Love (OWL) program was implemented in the NICU. The application of this program significantly reduced the duration of MV, and therefore the rates of sepsis and ROP (6).
One of the strengths of our study is the wide sampling size, which provides more reliable results. However, one of the limitations is that more studies are needed to confirm the results and validate them in other populations. Additionally, this calculator model does not include every ROP risk factor, for the reasons stated above.
Conclusion
Premature newborns should be evaluated in a multifactorial manner, taking into account all ROP risk factors, and the neonatal comorbidities such as presence of sepsis, apnea, bronchopulmonary dysplasia, arteriovenous ductus, and blood transfusions. The MV time and the extent of the retinal avascular area in the first examination are crucial for the development and evolution of ROP, so both should be taken into account when predicting ROP severity and the need for treatment. The risk calculator can identify the premature newborns with risk of ROP that requires treatment from their first examination in order to adapt the frequency of examinations according to the level of risk.
The calculator is not a substitute for ROP screening programs or gestational age and birth weight thresholds in each country. It is rather an additional tool to be used for neonates who are already included in the screening to identify those needing closer follow-up or special care. More studies involving a larger number of patients, different centers and a specific cohort of individuals with extremely-low birth weight are needed to confirm and validate these results.
Data Availability Statement
The datasets generated for this study are available on request to the corresponding author.
Ethics Statement
The studies involving human participants were reviewed and approved by Biomedical Research Ethics Committee of Andalusia. Written informed consent to participate in this study was provided by the participants' legal guardian/next of kin.
Author Contributions
All authors have contributed significantly to the work, have read the manuscript, attest to the validity, legitimacy of the data, its interpretation, and agree to its submission to this journal.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
The present article was carried out as part of the Doctoral Thesis project of María Jesús Chaves Samaniego, who is enrolled in the Doctoral Program in Clinical Medicine and Public Health of the University of Granada, Spain.
Abbreviations
ROP, retinopathy of prematurity; MV, mechanical ventilation; DD, disc diameters; GA, gestational age; NICU, neonatal intensive care unit.
References
1. Beligere N, Perumalswamy V, Tandon M, Mittal A, Floora J, Vijayakumar B, et al. Retinopathy of prematurity and neurodevelopmental disabilities in premature infants. Semin Fetal Neonatal Med. (2015)20:346–53. doi: 10.1016/j.siny.2015.06.004
2. Wu C, Löfqvist C, Smith LEH, Vander Veen DK, Hellström A WINROP Consortium for the importance of early postnatal weight gain for normal retinal angiogenesis in very preterm infants. Arch Ophthal Mol. (2012) 130:992–9. doi: 10.1001/archophthalmol.2012.243
3. Kim SJ, Port AD, Swan R, Campbell JP, Chan RVP, Chiang MF. Retinopathy of prematurity: a review of risk factors and their clinical significance. Surv Ophthalmol. (2018) 63:618–37. doi: 10.1016/j.survophthal.2018.04.002
4. Binenbaum G. Algorithms for the prediction of retinopathy of prematurity based on postnatal weight gain. Clin Perinatol. (2013) 40:261–70. doi: 10.1016/j.clp.2013.02.004
5. Solans AM, Ortega JM, Fernández JU, Escudero J, Salgado AD, Chaves-Samaniego MJ, et al. Retinal vascular speed <0.5 disc diameter per week as an early sign of retinopathy of prematurity requiring treatment. Eur J Ophthalmol. (2018) 28:441–5. doi: 10.1177/1120672118761328
6. Garcia-Serrano JL, Uberos Fernández J, Anaya-Alaminos R, Jerez-Calero A, Padilla-Torres JF, Ramírez-Garcia MC, et al. Oxygen with love; and diode laser treatment decreases comorbidity and avoidable blindness due to retinopathy of prematurity: results achieved in the past 12 years. Pediatr Neonatol. (2013) 54:397–401. doi: 10.1016/j.pedneo.2013.05.003
7. Löfqvist C, Hansen-Pupp I, Andersson E, Holm K, Smith LEH, Ley D, et al. Validation of a new retinopathy of prematurity screening method monitoring longitudinal postnatal weight and insulinlike growth factori. Arch Ophthalmol. (2009) 127:622. doi: 10.1001/archophthalmol.2009.69
8. Binenbaum G, Ying GS, Quinn GE, Huang J, Dreiseitl S, Antigua J, et al. The CHOP postnatal weight gain, birth weight, and gestational age retinopathy of prematurity risk model. Arch Ophthalmol. (2012) 130:1560–5. doi: 10.1001/archophthalmol.2012.2524
9. Eckert GU, Fortes-Filho JB, Maia M, Procianoy RS. A predictive score for retinopathy of prematurity in very low birth weight preterm infants. Eye. (2012) 26:400–6. doi: 10.1038/eye.2011.334
10. Kirpalani H, Whyte RK, Andersen C, Asztalos E V, Heddle N, Blajchman MA, et al. The premature infants in need of transfusion (pint) study: a randomized, controlled trial of a restrictive (LOW) versus liberal (HIGH) transfusion threshold for extremely low birth weight infants. J Pediatr. (2006) 149:301–7.e3. doi: 10.1016/j.jpeds.2006.05.011
11. Melia BM. Time to consider adoption of new retinopathy of prematurity screening guidelines in the united states. JAMA Ophthalmol. (2020) 138:38–9. doi: 10.1001/jamaophthalmol.2019.4622
12. Pivodic A, Hård AL, Löfqvist C, Smith LEH, Wu C, Bründer MC, et al. Individual risk prediction for sight-threatening retinopathy of prematurity using birth characteristics. JAMA Ophthalmol. (2020) 138:21–9. doi: 10.1001/jamaophthalmol.2019.4502
13. Hutchinson AK, Melia M, Yang MB, Vanderveen DK, Wilson LB, Lambert SR, et al. Clinical models and algorithms for the prediction of retinopathy of prematurity: a report by the american academy of ophthalmology. Ophthalmology. (2016) 123:804–16. doi: 10.1016/j.ophtha.2015.11.003
14. Good WV, Flynn JT, Flach AJ, Cibis GW, Raab EL, Beauchamp GR. Final results of the early treatment for retinopathy of prematurity (ETROP) randomized trial. Trans Am Ophthalmol Soc. (2004) 102:233–50.
15. Ni Y-Q, Huang X, Xue K, Yu J, Ruan L, Shan H-D, et al. Natural involution of acute retinopathy of prematurity not requiring treatment: factors associated with the time course of involution. Investig Opthalmology Vis Sci. (2014) 55:3165. doi: 10.1167/iovs.13-13744
16. Committee for the Classification of Retinopathy of Prematurity. The International Classification of Retinopathy of Prematurity Revisited. Arch Ophthalmol. (2005) 123:991. doi: 10.1001/archopht.123.7.991
17. Mintz-Hittner HA, Kennedy KA, Chuang AZ. Efficacy of intravitreal bevacizumab for stage 3+retinopathy of prematurity. N Engl J Med. (2011) 364:603–15. doi: 10.1056/NEJMoa1007374
18. Mintz-Hittner HA, Geloneck MM, Chuang AZ. Clinical management of recurrent retinopathy of prematurity after intravitreal bevacizumab monotherapy. Ophthalmology. (2016) 123:1845–55. doi: 10.1016/j.ophtha.2016.04.028
19. Bancalari E, Jain D. Bronchopulmonary dysplasia: 50 years after the original description. Neonatology. (2019) 115:384–91. doi: 10.1159/000497422
20. Chang JW. Risk factor analysis for the development and progression of retinopathy of prematurity. PLoS ONE. (2019) 14:e0219934. doi: 10.1371/journal.pone.0219934
21. Dhaliwal C, Fleck B, Wright E, Graham C, Mc Intosh N. Incidence of retinopathy of prematurity in Lothian, Scotland, from 1990 to 2004. Arch Dis Child Fetal Neonatal Ed. (2008) 93:F422–6. doi: 10.1136/adc.2007.134791
22. Kennedy KA, Mintz-Hittner HA, BEAT-ROP Cooperative Group. Medical and developmental outcomes of bevacizumab versus laser for retinopathy of prematurity. J Am Assoc Pediatr Ophthalmol Strabismus. (2018) 22:61–5.e1. doi: 10.1016/j.jaapos.2017.10.006
23. Apgar V. A proposal for a new method of evaluation of the newborn infant. Originally published in July 1953, volume 32, pages 250–259. Anesth Analg. (2015) 120:1056–9. doi: 10.1213/ANE.0b013e31829bdc5c
25. Singer M, Deutschman CS, Seymour C, Shankar-Hari M, Annane D, Bauer M, et al. The third international consensus definitions for sepsis and septic shock (sepsis-3). JAMA. (2016) 315:801–10. doi: 10.1001/jama.2016.0287
26. Fleck BW. Where is the junction of zone 2 and zone 3 temporal retina in ret cam images of acute retinopathy of prematurity? Eye. (2015) 29:981. doi: 10.1038/eye.2015.41
27. Jayadev C, Vinekar A, Bharamshetter R, Mangalesh S, Rao H, Dogra M, et al. Retinal immaturity at first screening and retinopathy of prematurity: image-based validation of 1202 eyes of premature infants to predict disease progression. Indian J Ophthalmol. (2019) 67:846–53. doi: 10.4103/ijo.IJO_469_19
28. Montgomery KS. Apgar scores: examining the long-term significance. J Perinat Educ. (2005) 9:5–9. doi: 10.1624/105812400X87716
29. Jobe AH, Bancalari E. Bronchopulmonary dysplasia. Am J Resp Crit Care Med. 163:1723–9. doi: 10.1164/ajrccm.163.7.2011060
30. Elder DE, Campbell AJ, Galletly D. Current definitions for neonatal apnoea:are they evidence based? J Paediatr Child Health. (2013) 49:E388–96. doi: 10.1111/jpc.12247
31. Brooks SE, Marcus DM, Gillis D, Pirie E, Johnson MH, Bhatia J. The effect of blood transfusion protocol on retinopathy of prematurity: a prospective, randomized study. Pediatrics. (1999) 104:514–8. doi: 10.1542/peds.104.3.514
32. Stutchfield CJ, Jain A, Odd D, Williams C, Markham R. Foetal haemoglobin, blood transfusion, and retinopathy of prematurity in very preterm infants: a pilot prospective cohort study. Eye. (2017) 31:1451–5. doi: 10.1038/eye.2017.76
33. Benitz WE. Patent ductus arteriosus in preterm infants. Pediatrics. (2016) 137:3730. doi: 10.1542/peds.2015-3730
34. Neu J, Walker WA. Necrotizing enterocolitis. N Engl J Med. (2011) 364:255–64. doi: 10.1056/NEJMra1005408
35. Hinson HE, Hanley DF, Ziai WC. Management of intraventricular hemorrhage. Curr Neurol Neurosci Rep. (2010) 10:73–82. doi: 10.1007/s11910-010-0086-6
36. Watts P, Adams GGW, Thomas RM, Bunce C. Intraventricular haemorrhage and stage 3 retinopathy of prematurity. Br J Ophthalmol. (2000) 84:596–9. doi: 10.1136/bjo.84.6.596
37. Huang HM, Lin SA, Chang YC, Kuo HK. Correlation between periventricular leukomalacia and retinopathy of prematurity. Eur J Ophthalmol. (2012) 22:980–4. doi: 10.5301/ejo.5000129
38. Good W V, Flynn JT, Flach AJ, Cibis GW, Raab EL, Beauchamp GR. Final results of the early treatment for retinopathy of prematurity (ETROP) randomized trial. Trans Am Ophthalmol Soc. (2004)102:233–50.
39. Good WV. Early treatment for retinopathy of prematurity cooperative group. the early treatment for retinopathy of prematurity study: structural findings at age 2 years. Br J Ophthalmol. (2006) 90:1378–82. doi: 10.1136/bjo.2006.098582
40. Ferrer-Novella C, González-Viejo I, Pueyo-Royo V, Martínez R, Galdós M, Peralta-Calvo J, et al. A protocol for the treatment of retinopathy of prematurity in Spain. Arch Soc Esp Oftalmol. (2013) 88:231–6. doi: 10.1016/j.oftal.2012.07.028
41. Witmer MT, Kiss S. Wide-field imaging of the retina. Surv Ophthalmol. (2013) 58:143–54. doi: 10.1016/j.survophthal.2012.07.003
42. Wu C, Petersen RA, Vander Veen DK. Ret cam imaging for retinopathy of prematurity screening. J AAPOS. (2006) 10:107–11. doi: 10.1016/j.jaapos.2005.11.019
43. Calvo CM, Hartnett ME. The utility of ultra-widefield fluorescein angiography in pediatric retinal diseases. Int J Retin Vitr. (2018) 4:21. doi: 10.1186/s40942-018-0122-2
44. Chen F, Cheng D, Pan J, Huang C, Cai X, Tian Z, et al. The efficacy and safety of retcam in detecting neonatal retinal hemorrhages. BMC Ophthalmol. (2018) 18:202. doi: 10.1186/s12886-018-0887-y
45. Isaac M, Mireskandari K, Tehrani N. Does bevacizumab alter vascularization potential in retinopathy of prematurity? Ophthalmology. (2016) 123:2042–3. doi: 10.1016/j.ophtha.2016.04.024
46. Tahija SG, Hersetyati R, Lam GC, Kusaka S, Mc Menamin PG. Fluorescein angiographic observations of peripheral retinal vessel growth in infants after intravitreal injection of bevacizumab as sole therapy for zone i and posterior zone II retinopathy of prematurity. Br J Ophthalmol. (2014) 98:507–12. doi: 10.1136/bjophthalmol-2013-304109
47. Lorenz B, Stieger K, Jäger M, Mais C, Stieger S, Andrassi-Darida M. Retinal vascular development with 0.312 mg intravitreal bevacizumab to treat severe posterior retinopathy of prematurity. Retina. (2017) 37:97–111. doi: 10.1097/IAE.0000000000001126
48. Solans AM, Ortega JM, Uberos J, González AR, García-Serrano JL. Speed of retinal vascularization in retinopathy of prematurity: risk and protective factors. Biomed Res Int. (2019) 2019:2721578. doi: 10.1155/2019/2721578
49. Binenbaum G, Tomlinson LA, De Alba Campomanes AG, Bell EF, Donohue P, Morrison D, et al. Validation of the postnatal growth and retinopathy of prematurity screening criteria. JAMA Ophthalmol. (2020) 138:31–37. doi: 10.1001/jamaophthalmol.2019.4517
50. American academy of pediatrics section on ophthalmology american academy of ophthalmology. Screening examination of premature infants for retinopathy of prematurity. Pediatrics. (2013) 131:189–95. doi: 10.1542/peds.2012-2996
51. Binenbaum G, Ying GS, Quinn GE, Dreiseitl S, Karp K, Roberts RS, et al. A clinical prediction model to stratify retinopathy of prematurity risk using postnatal weight gain. Pediatrics. (2011) 127:2240. doi: 10.1542/peds.2010-2240
52. Filho JBF, Bonomo PP, Maia M, Procianoy RS. Weight gain measured at 6 weeks after birth as a predictor for severe retinopathy of prematurity: study with 317 very low birth weight preterm babies. Graefe Arch Clin Exp Ophthalmol. (2009) 247:831–6. doi: 10.1007/s00417-008-1012-3
53. Allegaert K, Vanhole C, Casteels I, Naulaers G, Debeer A, Cossey V, et al. Perinatal growth characteristics and associated risk of developing threshold retinopathy of prematurity. J Am Assoc Pediatr Ophthalmol Strabismus. (2003) 7:34–7. doi: 10.1067/mpa.2003.S1091853102420150
54. Paisán L, Sota I, Muga I. El recién nacido de bajo peso. Protocolos de la Asociación Española de Pediatría. Asociación Española de Pediatría, Sociedad Española de Neonatología; (2008).p. 78–9.
55. García-Serrano JL, Ramírez-García MC, Piñar-Molina R. Retinopathy of prematurity in multiple births: risk analysis for plus disease. Arch Soc Esp Oftalmol. (2009) 84:191–8. doi: 10.4321/S0365-66912009000400005
56. Sáenz M. El crecimiento intrahospitalario del recién nacido de muy bajo peso en España. Anales de Pediatria. (2008) 68:203–5. doi: 10.1157/13116697
57. García-Muñoz F, Figueras J, Saavedra P, García-Alix A. Crecimiento posnatal hasta el alta hospitalaria en recién nacidos extremadamente prematuros españoles. An Pediatría. (2017) 87:301–10. doi: 10.1016/j.anpedi.2016.10.011
58. Jefferies AL. Retinopathy of prematurity: an update on screening and management. Paediatr Child Health. (2016) 21:101. doi: 10.1093/pch/21.2.101
59. Wilkinson AR, Haines L, Head K, Fielder AR. UK retinopathy of prematurity guideline. Eye. (2009) 23:2137–39. doi: 10.1038/eye.2008.128
60. Akman I, Demirel U, Yenice Ö, Ilerisoy H, Kazokoglu H, Özek E. Screening criteria for retinopathy of prematurity in developing countries. Eur J Ophthalmol. (2010) 20:931–7. doi: 10.1177/112067211002000519
61. Bizzarro MJ, Hussain N, Jonsson B, Feng R, Ment LR, Gruen JR, et al. Genetic susceptibility to retinopathy of prematurity. Pediatrics. (2006) 118:1858–63. doi: 10.1542/peds.2006-1088
62. Ortega-Molina JM, Anaya-Alaminos R, Uberos-Fernández J, Solans-Pérez De Larraya A, Chaves-Samaniego MJ, Salgado-Miranda A, et al. Genetic and environmental influences on retinopathy of prematurity. Mediators Inflammation. (2015) 2015:764159. doi: 10.1155/2015/764159
63. Lutty GA, McLeod DS. Development of the hyaloid, choroidal and retinal vasculatures in the fetal human eye. Prog Retin Eye Res. (2018) 62:58–76. doi: 10.1016/j.preteyeres.2017.10.001
64. Gariano RF. Special features of human retinal angiogenesis. Eye. (2009). 24:401–7. doi: 10.1038/eye.2009.324
65. Patz A. Isaac C. Michaelson Lecture. Ocul Circ Neovascularization. Documenta Ophthalmologica Proceedings Series. (1987) 3:10. doi: 10.1007/978-94-009-3337-8_2
66. Binenbaum G, Ying GS, Tomlinson LA. Validation of the children's hospital of philadelphia retinopathy of prematurity (CHOPROP) model. JAMA Ophthalmol. (2017) 135:871–7. doi: 10.1001/jamaophthalmol.2017.2295
67. Van Sorge AJ, Termote JUM, Simonsz HJ, Kerkhoff FT, Van Rijn LJ, Lemmens WAJG, et al. Outcome and quality of screening in a nationwide survey on retinopathy of prematurity in the Netherlands. Br J Ophthalmol. (2014) 98:1056–1060. doi: 10.1136/bjophthalmol-2013-304493
68. Cao JH, Wagner BD, Mc Court EA, Cerda A, Sillau S, Palestine A, et al. The colorado-retinopathy of prematurity model (CO-ROP): postnatal weight gain screening algorithm. J AAPOS. (2016) 20:19–24. doi: 10.1016/j.jaapos.2015.10.017
69. Flynn JT, Bancalari E, Bawol R, Goldberg R, Cassady J, Schiffman J, et al. Retinopathy of prematurity:a randomized,prospective trial of transcutaneous oxygen monitoring. Ophthalmology. (1987) 94:630–8. doi: 10.1016/S0161-6420(87)33400-1
70. Ying GS, Quinn GE, Wade KC, Repka MX, Baumritter A, Daniel E. Predictors for the development of referral-warranted retinopathy of prematurity in the telemedicine approaches to evaluating acute-phase retinopathy of prematurity (e-ROP) study. JAMA Ophthalmol. (2015) 133:304–11. doi: 10.1001/jamaophthalmol.2014.5185
71. Hellström A, Hård A-L, Engström E, Niklasson A, Andersson E, Smith L, et al. Early weight gain predicts retinopathy in preterm infants: new, simple, efficient approach to screening. Pediatrics. (2009) 123:e638–45. doi: 10.1542/peds.2008-2697
72. Wu C, Vander Veen DK, Hellström A, Löfqvist C, Smith LEH. longitudinal postnatal weight measurements for the prediction of retinopathy of prematurity. Arch Ophthalmol. (2010) 128:443. doi: 10.1001/archophthalmol.2010.31
73. Van Den Akker-Van Marle ME, Van Sorge AJ, Schalij-Delfos NE. Cost and effects of risk factor guided screening strategies for retinopathy of prematurity for different treatment strategies. Acta Ophthalmol. (2015) 93:706–712. doi: 10.1111/aos.12798
Keywords: retinopathy of prematurity, retinal vessel, oxygen-induced retinopathy, risk factors, bronchopulmonary dysplasia
Citation: Chaves-Samaniego MJ, García Castejón M, Chaves-Samaniego MC, Solans Perez Larraya A, Ortega Molina JM, Muñoz Hoyos A and García-Serrano JL (2020) Risk Calculator for Retinopathy of Prematurity Requiring Treatment. Front. Pediatr. 8:529639. doi: 10.3389/fped.2020.529639
Received: 25 January 2020; Accepted: 13 August 2020;
Published: 18 September 2020.
Edited by:
Sinno Simons, Erasmus Medical Center, NetherlandsReviewed by:
Naveed Hussain, University of Connecticut Health Center, United StatesDaniele Trevisanuto, University Hospital of Padua, Italy
Copyright © 2020 Chaves-Samaniego, García Castejón, Chaves-Samaniego, Solans Perez Larraya, Ortega Molina, Muñoz Hoyos and García-Serrano. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Maria J. Chaves-Samaniego, mjchavessamaniego@gmail.com