- 1Graduate Institute of Biomedical Sciences and School of Medicine, College of Medicine, China Medical University, Taichung, Taiwan
- 2Division of Nephrology and Kidney Institute, China Medical University Hospital, Taichung, Taiwan
- 3Management Office for Health Data, China Medical University Hospital, Taichung, Taiwan
- 4College of Medicine, China Medical University, Taichung, Taiwan
- 5Department of Family Medicine, China Medical University Hospital, Taichung, Taiwan
- 6Department of Gynecology, China Medical University Hospital, Taichung, Taiwan
- 7Department of Chest Medicine, China Medical University Hospital, Taichung, Taiwan
- 8Department Teaching, China Medical University Hospital, Taichung, Taiwan
- 9Department Otolaryngology, China Medical University Hospital, Taichung, Taiwan
- 10Department of Nuclear Medicine and PET Center, China Medical University Hospital, Taichung, Taiwan
- 11Department of Bioinformatics and Medical Engineering, Asia University, Taichung, Taiwan
- 12Center of Augmented Intelligence in Healthcare, China Medical University Hospital, Taichung, Taiwan
Background: Air pollution is speculated to affect the reproductive health of women. However, a longitudinal association between exposure to air pollution and dysmenorrhea has not been identified, which this study aimed to examine this point.
Methods: Two nationwide databases, namely the Taiwan Air Quality Monitoring database and the Taiwan National Health Research Institutes database were linked. Women with a history of dysmenorrhea (International Classification of Disease, Ninth Revision, Clinical Modification code 625.3) before 2000 were excluded. All participants were followed from January 1, 2000 until the diagnosis of dysmenorrhea, withdrawal from National Health Insurance, or December 31, 2013. Furthermore, air pollutants were categorized into quartiles with three cut-off points (25th, 50th, and 75th percentiles). The Cox regression model was used to calculate the hazard ratios of dysmenorrhea.
Results: This study enrolled 296,078 women. The mean concentrations of yearly air pollutants were 28.2 (±12.6) ppb for nitric oxides (NOx), 8.91 (±7.93) ppb for nitric oxide (NO), 19.3 (±5.49) ppb for nitrogen dioxide (NO2), 0.54 (±0.18) ppm for carbon monoxide (CO), and 31.8 (±6.80) μg/m3 for PM2.5. In total, 12,514 individuals developed dysmenorrhea during the 12-year follow-up. Relative to women exposed to Q1 concentrations of NOx, women exposed to Q4 concentrations exhibited a significantly higher dysmenorrhea risk [adjusted hazard ratio (aHR)= 27.9, 95% confidence interval (CI) = 21.6–31.3]; similarly higher risk was found for exposure to NO (aHR = 16.7, 95% CI = 15.4–18.4) and NO2 (aHR = 33.1, 95% CI = 30.9–37.4). For CO, the relative dysmenorrhea risk in women with Q4 level exposure was 28.7 (95% CI = 25.4–33.6). For PM2.5, women at the Q4 exposure level were 27.6 times (95% CI = 23.1–29.1) more likely to develop dysmenorrhea than those at the Q1 exposure level.
Conclusion: Our results showed that women would have higher dysmenorrhea incidences while exposure to high concentrations of NO, NO2, NOx, CO, and PM2.5.
Introduction
Dysmenorrhea, characterized by painful cramps of the uterus during menstruation, affects 45–95% of menstruating women. Dysmenorrhea is the leading morbidity among gynecological disorders and the leading cause of pelvic pain (1), thus representing the greatest burden for menstruating women (2, 3). Moreover, dysmenorrhea is related to negative performance in school and social and sports activities as well as short-term school absenteeism among adolescents (4). Furthermore, dysmenorrhea affects the economy insofar as it impairs work productivity (5), and almost 600 million working hours are lost yearly due to dysmenorrhea (6). It is classified as either primary dysmenorrhea, which does not involve a related organic disease, or secondary dysmenorrhea, which is related to attributable causes such as endometriosis (7). Although the actual causes of primary dysmenorrhea are unclear, the most well-known pathogenesis is prostaglandin overproduction in the uterus, particularly overproduction of PGF2a and PGF2 (8). Therefore, the mechanism of primary dysmenorrhea involves arachidonic acid (AA) and inflammation (9), and thus, the effective treatment for primary dysmenorrhea is non-steroidal anti-inflammatory drugs and cyclooxygenase (COX) inhibitors (10, 11).
Mahalingaiah et al. (12) and Carré et al. (13) observed that all size fractions of particulate matter (PM) exposure and traffic-related air pollution are associated with incidence of infertility and adverse reproductive health (14). Merklinger-Gruchala et al. (15) and Mahalingaiah et al. (16) showed that the mean concentrations of the air pollutants particles 10 microns and below(PM10), Sulfur dioxide(SO2), Nitrogen Oxides (NOx), and Carbon monoxide (CO) were associated with shortening of the luteal phase, an irregular menstrual cycle, menstrual disorders and menstrual irregularity, respectively. The above evidence suggested that although infertility and irregular menstrual cycle had many different anatomic or hormonal causes, they would be affected by air pollutants. Therefore, air pollutants might have effect on menstruation. However, to the best of our knowledge, no epidemiological study has investigated the association between primary dysmenorrhea and air pollutants.
Therefore, we used nationwide medical records and nationwide air pollution monitoring databases to conduct a retrospective cohort study to determine whether exposure to air pollutants is associated with high dysmenorrhea risk.
Methods
Data Source
To clarify dysmenorrhea risk in participants exposed to air pollutants, we used the Longitudinal Health Insurance Database 2000 (LHID 2000) from the Taiwan National Health Insurance Research Database (NHIRD), which includes ~99% of the population in Taiwan. The LHID 2000 consists of 1 million patients who were randomly selected from NHIRD in 2000. LHID 2000 contains comprehensive deidentified health care information regarding patient demographics, outpatient visits, inpatient care, prescription drugs, and medical procedures from 1996 to 2013. The National Health Research Institutes confirmed that no significant differences were evident in the distribution of age, sex, or health care costs between the population in the LHID 2000 and that in the NHIRD. This study used the International Classification of Disease, Ninth Revision, Clinical Modification (ICD-9-CM) to categorize disease diagnoses based on inpatient data.
Taiwan Environmental Protection Administration (EPA) have set up 76 air quality observation stations nationwide for the Air Quality Observation and Forecast Network at the end of 2006 (17) (Supplementary Figure 1) According to different pollution characteristics, weather conditions, and observational purposes of EPA, the air quality observation stations were distributed reasonably in cities and countries and divided into seven main island regions and three outlying islands regions (18) (Supplementary Figure 1). Geographic information system (GIS) (ArcGIS version 10; ESRI, Redlands, CA, USA) was used to identify and manage the locations of the monitoring stations and air pollution sources. The monitoring data were integrated into yearly point data and interpolated to pollutant surfaces using inverse distance weighting method (IDW) (19).
We obtained air pollution data [nitric oxides (NOx), nitric oxide (NO), nitrogen dioxide (NO2), carbon monoxide (CO), and PM2.5. from the Taiwan Air Quality Monitoring Database (TAQMD). The TAQMD provides daily air pollution data from community-based monitoring sites that are available in real-time on the organizations' website. We downloaded data for the pollutants NOx, NO, NO2, CO, and PM2.5 and calculated their annual mean levels from January 2000 to December 2012. To define average exposure duration of women to these pollutants is really an issue. If exposure duration to air pollutants was defined too shorter (e.g., <1 year or only several months), the results that air pollutants is associated with risks of dysmenorrheal would not be convincing. In the other aspect, if duration was defined too long (e.g., longer than 10 or 5 years), the unknown and uncontrolled bias (i.e., body weight change, take hormone, change of residence, or pregnancy, etc) would be too much to make the results convincing. To avoid and minimize such bias, we defined duration of average exposure levels of women to these pollutants as 2 years. Then, we computed the average exposure levels of women to these pollutants for 2 years before the diagnosis of dysmenorrhea or end of the study period for each individual.
Sample Participants
Women residing in areas with air quality monitoring stations were the focus of this study, which representative of exposure. However, women with a history of dysmenorrhea (ICD-9-CM code 625.3) (http://www.icd9data.com/2012/Volume1/580-629/617-629/625/625.3.htm) before 2000 were excluded. All participants were 16–55 years-old and were followed from January 1, 2000 until dysmenorrhea diagnosis (ICD-9-CM code 625.3), withdrawal from National Health Insurance, or December 31, 2013 (Figure 1). The confounding factors were age, sex, urbanization level of residence, monthly income, occupational class (20, 21), and comorbidities such as hypertension (ICD-9-CM 401–405), diabetes mellitus (ICD-9-CM 250), hyperlipidemia (ICD-9-CM 272), heart disease (ICD-9-CM 410–414), Chronic obstructive pulmonary disease (COPD) (ICD-9-CM 490–496), chronic kidney disease (ICD-9-CM 580–589), stroke (ICD-9-CM 430–438), depression (ICD-9-CM 296.2, 296.3, 296.82, 300.4, 309.0, 309.1, 309.28, and 311), chronic liver disease, and cirrhosis (ICD-9-CM 070.6, 070.9, 570, 571, 573.3, 573.4, 573.8, 573.9, and V42.7). Causes of secondary dysmenorrhea were also considered as covariates included endometriosis (ICD-9-CM 617), pelvic inflammatory disease (ICD-9-CM 614 and 615), ovarian cancer (ICD-9-CM 183.0), inflammatory bowel disease (ICD-9-CM 555 and 556), and intramural fibroids or intracavitary fibroids (ICD-9-CM 218). The National Health Research Institutes has stratified all city districts and townships in Taiwan into seven urbanization levels on the basis of population density (people/km2); the proportion of residents with higher education, and who work in agriculture; and the number of physicians per 100,000 people in each area. Level 1 represents areas with a high population density and socioeconomic status, and level 7 represents areas with the lowest socioeconomic status. Because few people live in the rural areas classified as levels 4–7, our study grouped these areas into level 4. Monthly income was classified into 3 groups: < NT$15,000, NT$15,000–29,999, and >NT$30,000. Occupational class was divided into three classes: white collar, blue collar, and other class. White-collar occupations involve working in an office and doing work that requires mental rather than physical effort. Blue-collar workers, such as farmers or fishermen, do work that requires strength or physical skill. The other class includes unemployed people, soldiers, and religious people.
Outcome and Exposure Measurement
The study endpoint was the diagnosis of dysmenorrhea (ICD-9-CM code 625.3). We integrated daily concentrations of air pollutants corresponding to residential zip codes to calculate 2-year average exposure before the diagnosis of dysmenorrhea and the year of diagnosis of dysmenorrhea from 2000 to 2012.To estimate the effect of air pollutants on dysmenorrhea, we investigated the daily concentrations of NOx, NO, NO2, CO, and PM2.5 by using the inverse distance weighting (IDW) method. IDW is a common and simple spatial interpolation method. It predicts values of unknown points on the basis of the similarity of two objects in terms of distance (22). Its principle is to use distance measurement to perform the weighted analysis of the interpolation. When the unknown point is estimated to be closer to the known point, the weighted value of the unknown point will be higher. Hence, when the distribution of the known measuring point is balanced, the value estimated using the IDW method will be more accurate (Supplementary Table 1; Supplementary Figure 1) (23, 24). In this study, the generalized additive model (GAM) was used to quantitatively evaluate the acute effects of air pollution including NOx, NO, NO2, PM2.5, and CO concentrations and interquartile range on the incidence of dysmenorrhea in Taiwan. We found that the plots of the generalized additive model for interquartile range more linear than the plots of generalized additive model for air pollution concentrations. In this study, the air pollutant exposure levels were scaled to the interquartile range (IQR). Furthermore, Air pollutants were also categorized into quartiles with three cut-off point (25th, 50th and 75th percentiles) for NOx (Quartile 1, <19.1 ppb; Quartile 2, 19.1–24.7 ppb; Quartile 3, 24.8–34.5 ppb; Quartile 4, >34.6 ppb), NO (Quartile 1, <4.0 ppb; Quartile 2, 4.0–5.52 ppb; Quartile 3, 5.53-11.5 ppb; Quartile 4, >11.6 ppb), NO2 (Quartile 1, <15.2 ppb; Quartile 2, 15.2–18.8 ppb; Quartile 3, 18.9–22.8 ppb; Quartile 4, >22.9 ppb), PM2.5 (Quartile 1, <27.1 μg/m3; Quartile 2, 27.1–32.0 μg/m3; Quartile 3, 32.1–35.3 μg/m3; Quartile 4, > 35.4 μg/m3), and CO (Quartile 1, <0.42 ppm; Quartile 2, 0.42–0.49 ppm; Quartile 3, 0.50–0.59 ppm; Quartile 4, > 0.60 ppm).
Statistical Analysis
We conducted a Cox proportional hazards regression for the multivariable analysis of dysmenorrhea diagnosis through increase in IQR (μg/m3 or ppb) of long-term exposure to NOx, NO, NO2, CO, and PM2.5 from 2000 to dysmenorrhea development or the end of the study period (25).
Dysmenorrhea incidence (per 10,000 person-years) was calculated at each level of air pollutant concentration. The relative risk of dysmenorrhea in participants who were exposed to Q2–Q4 levels of air pollutant concentrations relative to those exposed to the Q1 level of air pollutant concentrations was estimated using the Cox proportional hazards regression model. The potential confounders, namely age, monthly income, urbanization level, occupational class, and comorbidities, were defined as determinants of dysmenorrhea and associated with air pollution concentrations and further incorporated into models. Furthermore, we used the Cox regression model, which is stratified by age, urbanization level, monthly income, and occupational class, for analyzing dysmenorrhea risk between various yearly average concentrations of air pollutants. This study uses Generalized additive model (GAM) to analyze the impact of air pollutant on dysmenorrhea (26, 27). GAM is a non-parametric extension of Generalized linear model (GLM) (28). It not only retains the basic framework of GLM, but also has many assumptions as other linear models (such as normal assumption or variance homogeneity), and its ability to handle non-linear models is better than other models (29). It is powerful and suitable for dealing with overly complex and non-linear relationships among many variables. In this study, air pollution data are usually non-linear, which limits the application of GLM, so it can be solved through GAM (30). The aim of this study was to use GAM to evaluate the relation between air pollution and dysmenorrheal by using data from the NHIR database and TAQM database (296,078 participants of whom 12,514 died during 11.7 years follow-up). Using GAM, we found that strong positive association between air pollution and dysmenorrhea, the association also appeared in low concentrations of air pollution (Supplementary Figure 2).
Results
There were total 296,078 participants in this study, and there were 12,514 participants had diagnosis of dysmenorrhea. Table 1 demonstrates the baseline characteristics and air pollutant exposure of the study cohort. Among the 296,078 female subjects, insured persons in 30–44 years of age (41.7%), living in north area (48.0%), living in urbanization level 1 (33.4%), monthly income <15,000–29,999 (47.3%), and white collar class worker (57.9%) were dominant. The mean age of the study subjects was 33.7 (±10.4) years old. The mean of the follow up time was 11.7 (±1.37) years. The mean of yearly air pollutants concentration was 28.2 (±12.6) ppb for NOx, 8.91 (±7.93) ppb for NO, 19.3 (±5.49) ppb for NO2, 31.8 (±6.80) μg/m3 for PM2.5, and 0.54 (±0.18) ppm for CO. There were 12,514 subjects developed dysmenorrhea after mean 11.7-years follow-up. Among 296,078 patients, there were 44,384 patients (14.9%) used oral contraceptives.
The distribution of urbanization level among different quartile of air pollutant levels was displayed in Supplementary Table 2. Participants exposed to the Q4 level air pollutant including NOx, NO, NO2, PM2.5, and CO mostly lived in the level 1 urbanization area.
Table 2 shows the incidence rate of dysmenorrhea among levels of all air pollutant concentrations. After controlling for potential confounding factors, Q4 air pollutant level exposure had higher risk of dysmenorrhea significantly compared with Q1 level of air pollutants. For NOx, relative to Q1 concentrations, the Q4 (adjusted = 27.9, 95%CI = 21.6–31.3) concentrations were had a significant higher risk of dysmenorrhea. Relative to Q1 NO concentrations, the Q4 (adjusted = 16.7, 95% CI = 15.4–18.4) also had a significant higher risk of dysmenorrhea. Relative to Q1 NO2 concentrations, the Q4 (adjusted = 33.1, 95% CI = 30.9–37.4) also had a significant higher risk of dysmenorrhea. The relative risks of dysmenorrhea in Q4 level exposure were 27.6 (95% CI = 23.1–29.1) for PM2.5. People under Q4 CO level exposure had 28.7 (95% CI = 25.4–33.6) fold increased risk to develop dysmenorrhea than those under Q1 level.
Table 2. Difference in dysmenorrhea incidences and associated HRs in participant exposed to various daily average concentration of air pollutants.
Table 3 showed the result of stratified Cox regression analysis by considering subject exposed to Q1 level of air pollutants as reference group. Relative to Q1 concentrations of NOx, NO, NO2, PM2.5, and CO, the participants who exposed in Q4 level of air pollutants had a significant higher risk of dysmenorrhea in each age group, monthly income, occupational class, and urbanization level 1, 2, and 3. Participants who aged 30–44 exposed to Q4 quartile of NOx and NO had 33.7 (95% CI = 28.4–36.5) fold increased risk and 21.0 (95% CI = 14.7–23.9) fold increased risk to develop dysmenorrhea, respectively, than those under Q1 level. Participants who aged <30 exposed to Q4 quartile of PM2.5 and CO had 29.1 (95% CI = 26.7–35.5) fold increased risk and 27.7 (95% CI = 23.6–33.5) fold increased risk, respectively, to develop dysmenorrhea than those under Q1 level. Participants lived in urbanization level 4 (low) exposing to Q 4 level of NOx, NO, and CO had highest risk of dysmenorrhea with 31.3 (95% CI = 19.3–36.7) fold, 63.2 (95% CI = 48.5–89.9) fold, 51.7 (95% CI = 33.3–60.1) fold, and 48.4 (95% CI = 26.7–54.8) accordingly, compared with exposing to Q1 level. Participants with monthly income 15000-29999 exposing to Q4 level of PM2.5 had 37.0 (95% CI = 27.8–53.2) fold risk of dysmenorrhea compared with exposing to Q1 level of PM2.5. Participants with monthly income <15,000 exposing to Q4 level of NOx had 38.1 (95% CI = 29.1–41.7) fold risk of dysmenorrhea compared with exposing to Q1 level of PM2.5.
Table 3. Incidence rate and hazard ratio of dysmenorrhea between various daily average concentrations of NOx, NO, NO2, PM2.5, CO stratified by gender, age, and comorbidities.
Participants whose occupational class as others exposed to Q4 quartile of NOx, NO, and NO2 had increased risk of dysmenorrheal up to 34.5 (95% CI = 29.2–84.5), 48.6 (95% CI = 43.5–69.8), 64.5 (95% CI = 49.4–87.8) fold accordingly compared with those under Q1 level. Supplementary Figures 3–7 provides illustrations of these results.
Table 4 showed associated HRs in participants exposed to every increment of one unit of yearly average concentrations of air pollutants. For every increment of 1 unit yearly average of NOX, the adjusted HR of dysmenorrhea would be increased to 1.51. For every increment of 1 unit yearly average of NO2, the adjusted HR of dysmenorrhea would be increased to 1.72. For every increment of 1 unit yearly average of NO, the adjusted HR of dysmenorrhea would be increased to 1.53. For every increment of 1 unit yearly average of CO, the adjusted HR of dysmenorrhea would be increased to 1.009. For every increment of 1 unit yearly average of PM2.5, the adjusted HR of dysmenorrhea would be increased to 1.81.
Table 4. Associated HRs in participants exposed to every increment of one unit of yearly average concentrations of air pollutants.
Table 5 showed the synergy effects of PM2.3 and NOx, NO, NO2, and CO on the risks of dysmenorrhea. The cut value was median value of air pollutant which exposure concentration being less than median value was defined as low and being more than median value was defined as high. Women exposed to low PM2.5 and high NOx had 1.30-fold adjusted risk of dysmenorrhea (95% CI = 1.21–1.39), compared with those exposure to low PM2.5 and low NOx. Women exposed to low PM2.5 and high NO had 2.64-fold adjusted risk of dysmenorrhea (95% CI = 2.46–2.84), compared with those exposure to low PM2.5 and low NO. Women exposed to low PM2.5 and high NO2 had 3.75-fold adjusted risk of dysmenorrhea (95% CI = 3.84–4.05), compared with those exposure to low PM2.5 and low NO2. Women exposed to low PM2.5 and high CO had 5.03-fold adjusted risk of dysmenorrhea (95% CI = 4.67–5.42), compared with those exposure to low PM2.5 and low CO. Women exposed to high PM2.5 and high concentrations of NOx, NO, NO2, and CO had highest risk of dysmenorrhea in each category, which 10.8-fold adjusted risk of dysmenorrhea (95% CI = 10.0–11.7) for NOX, 6.46-fold adjusted risk of dysmenorrhea (95% CI = 6.01–6.94) for NO, 9.77-fold adjusted risk of dysmenorrhea (95% CI = 9.06–10.5) for NO2, and 13.0-fold adjusted risk of dysmenorrhea (95% CI = 12.1–13.9) for CO.
Table 5. Cox proportional hazard regression analysis for the interactive effects of PM2.5 with NOx, NO, NO2, and CO on the risk of dysmenorrhea association.
Discussion
Our results demonstrated that women exposed to relatively high concentrations of NO, NO2, NOx, CO, and PM2.5 had relatively high incidences of dysmenorrhea. This was the first cohort study to identify the association between dysmenorrhea and exposure to certain air pollutants.
Since no previous studies have reported association between air pollution and dysmenorrhea, there was no available direct information to be cited scientifically for our findings. However, in recent years, air pollution has been reported to be associated with many diseases, which resulting from direct injures to lung as well as provoking systematic inflammation (31, 32). Pope et al. reported that exposure to PM2.5 was associated with endothelial injury and systemic inflammation, which involves increased thrombotic propensity, loss of apoptosis of endothelial cells, and changes in cytokines (33). Chen et al. showed that exposure to fine-particle air pollutants was associated with increased urinary metabolites, namely AA, which is indicative of the inflammatory property of air pollution (34). Therefore, systematic inflammation and associated increasing oxidative stress would be plausible pathway for association between air pollution and dysmenorrhea.
We proposed several possible mechanisms accounting for our research findings: (1) increased prostaglandin synthesis (35, 36); (2) increased oxidative stress as well as myeloperoxidase activation (37–42); (3)irregular menstrual cycle (15, 16); and (4) increased emotional stress in those patients exposed to higher concentrations of air pollutions (43).
First, increased levels of 8-epi-PGF2α have been detected in exhaled breath and urine after exposure to air pollution PM2.5 (44–48). Furthermore, Schneider et al. and Samet et al. found that air pollution could activate macrophages, leading to the production of prostaglandin E2 and induce induce prostaglandin H synthase 2 (35, 49). Yan et al. found that NO2 inhalation could promote COX-2 elevation-mediated prostaglandin E2 production (36). Sang et al. showed that sulfur dioxide (SO2) could induce cyclooxygenases-2-derived prostaglandin E2 production and its downstream signaling pathway in neurons (50). Therefore, exposing to air pollution NOx, NO2, and PM2.5 could cause increasing levels of prostaglandin E2 production within body. Since increasing levels of prostaglandin E2 had been related with dysmenorrhea (51, 52), we supposed that it would be one possible explanation pathway for our findings.
Second, myeloperoxidase activation plays a role in the association between air pollution and increased incidence of dysmenorrhea. Kaplan et al. summarized that myeloperoxidase as well as oxidative stress and calcium ion levels are involved in the pathogenesis of primary dysmenorrhea (53). Also, oxidative stress and increased serum levels of the cytokines malondialdehyde and interleukin-6 are associated with dysmenorrhea (54). Constantin showed that SO2 and NO2 induce oxidative burst and myeloperoxidase activation (37). Moreover, several studies have shown an association between air pollution and oxidative stress in humans (38–42). Szmidt et al. have systematic reviewed that oxidative stress was associated with development of dysmenorrhea (55). Results of Szmidt et al. indicated an elevated level of oxidative stress, especially of lipid peroxidation existed among dysmenorrhea women (55). Yang et al. have found that exposure to PM2.5 will cause dysregulation of lipid metabolism and oxidation (56). Therefore, women exposure to NO2, NOX, as well as PM2.5 might lead to increasing oxidative stress, therefore had higher risks of dysmenorrhea.
Third, an irregular menstrual cycle is also associated with dysmenorrhea in women exposed to high concentrations of the air pollutants SO2 and NOx. Merklinger-Gruchala et al. (15) and Mahalingaiah et al. (16) found that the concentrations of the air pollutants were associated with shortening of the luteal phase, an irregular menstrual cycle, and menstrual irregularity. An irregular menstrual cycle is also a risk factor for dysmenorrhea (57), and therefore, air pollution might lead to dysmenorrhea through irregular menstruation. Additionally, Beck revealed that CO intoxication is related to dysmenorrhea, menorrhagia, and amenorrhea in women (58). Although we have adjusted for irregular menses, irregular menses might also be speculated as one plausible pathway for air pollution related dysmenorrhea since not all patients with irregular menses would seek for medical therapy.
Finally, emotional stress resulting from exposure to air pollution may contribute to increased incidence of dysmenorrhea. Power et al. reported that exposure to fine particulate air pollution was associated with anxiety (43). Further, extensive long-term exposure to air pollution may increase the odds of depression, antidepressant use, and mental health problems in children (59, 60). Since mental stress has been reported to be a risk factor for dysmenorrhea (61–64), therefore exposure to air pollution might increase mental stress and then dysmenorrhea occurrs.
Another novel interesting finding is that our results showed synergy effects of PM2.5 and NO, NO2, NOx, CO on the risks of dysmenorrheal. The risks of dysmenorrhea appeared to be highest in women exposed to high concentrations of NO, NO2, NOx, CO and high PM2.5. We supposed that it would be that high concentrations of PM2.5 and high concentrations of acid gases could provoke the highest oxidative stress as well as systemic inflammation. Further, the risk of dysmenorrhea would be generally higher if women exposed to high concentrations of NO, NO2, NOx, or CO, despite women exposed to low or high concentrations of PM2.5. This observational finding warrants attention since it implied that NO, NO2, NOx, or CO would have more harms for risks of dysmenorrheal. We suppose that high concentrations of NO, NO2, NOx, or CO would also have effects on epigenetic modifications (65). Further studies are required to explore the underlying mechanisms.
This study has several limitations. First, the NHIRD does not provide information regarding risk factors for dysmenorrhea, including family history of dysmenorrhea, an early age of menarche (younger than 12 years), nulliparity, heavy menses or irregular menses, smoking, obesity, dietary habits, life stress, use of oral contraceptives, and social network support (20, 66). Second, although National Health Insurance covers up to 99% of the population, patients with dysmenorrhea might take over-the-counter medications instead of visiting a doctor. Therefore, the incidences of dysmenorrhea would be underdiagnosed in all quartiles of air pollutants. Therefore, it should be cautious in interpreting results of this study. Third, although we have considered pelvic inflammatory disease, cervical stenosis and polyps, functional ovarian cysts, malignant ovarian tumors, and inflammatory bowel disease, we did not consider adenomyosis, inflammation and scarring of uterus, intracavity or intramural fibroids, functional ovarian cysts, and intrauterine devices, which are also associated with dysmenorrhea (67). Forth, although there is considerable difference between primary and secondary dysmenorrhea, information about hormone measurement, regularity of menses, distribution of body fat, and signs of hirsutism were unavailable in NHIRD. Fifth, although we have used zip codes to define individual exposure to air pollutants, misclassification of exposure measurement should occur in this study since each participant was free mobile. Sixth, considerations for analyzing designs inclusive 1-year exposure average window, IDW methods, as well as GAM for categorical variables should be announced here. Since this is a retrospective study, it would be many uncontrolled variables generating during this exposure window such as those causes of secondary dysmenorrhea. If exposure window was too long, it would be more hardly to convince the association between air pollution and dysmenorrhea even if results are of statistical significance. Thus, although a 1-year exposure average window seems too short for dysmenorrhea investigation, we decided 1-year as exposure average window. The association between air pollution and primary dysmenorrhea would be more convincing on the basis on current design of 1-year exposure average window. The advantage of using IDW method is that IDW is assumed substantially that the rate of correlations and similarities between neighbors is proportional to the distance between them that can be defined as a distance reverse function of every point from neighboring points. However, on an area of 36,193 square kilometers of Taiwan, the density of 78 air quality monitoring stations is not very high. Thus, another limitation of this study would be limited numbers of air pollution monitoring stations. The principal advantage of GAM is its ability to model highly complex non-linear relationships when the number of potential predictors is large. The disadvantage of GAM is that like other non-parametric methods, GAM has a high propensity for overfitting. Finally, this retrospective study was based on analysis of existing database, therefore the level of internal bias of this study would be more compared with those prospective randomized control trial studies. However, our study demonstrated real-world observational results.
In conclusion, our study showed that exposure to high concentrations of the air pollutants SO2, NOx, NO, and NO2 was associated with increased incidences of dysmenorrhea. Whether personal protection against air pollution could help lessen the risk of dysmenorrhea will require further investigations.
Data Availability Statement
The datasets presented in this article are not readily available because The dataset used in this study is held by the Taiwan Ministry of Health and Welfare (MOHW). The Ministry of Health and Welfare must approve our application to access this data. Any researcher interested in accessing this dataset can submit an application form to the Ministry of Health and Welfare requesting access. Please contact the staff of MOHW (email: stcarolwu@mohw.gov.tw) for further assistance. Taiwan Ministry of Health and Welfare Address: No. 488, Sec. 6, Zhongxiao E. Rd., Nangang Dist., Taipei City 115, Taiwan (R.O.C.). Phone: +886-2-8590-6848. All relevant data are within the paper. Requests to access the datasets should be directed to Please contact the staff of MOHW (email: stcarolwu@mohw.gov.tw) for further assistance.
Ethics Statement
This study was approved to fulfill the condition for exemption by the Institutional Review Board (IRB) of China Medical University (CMUH104-REC2-115-CR4). The IRB also specifically waived the consent requirement. Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.
Author Contributions
S-YL and C-HK: conception/design and collection and/or assembly of data. C-HK: provision of study materials. S-YL, W-HH, C-CL, I-KW, and C-HK: data analysis and interpretation. S-YL, Y-CY, C-CL, CC, W-HH, I-KW, C-DL, C-YH, and C-HK: manuscript writing and final approval of manuscript. All authors contributed to the article and approved the submitted version.
Funding
This study was supported in part by Taiwan Ministry of Health and Welfare Clinical Trial Center (MOHW109-TDU-B-212-114004), China Medical University Hospital (CMU107-ASIA-19); MOST Clinical Trial Consortium for Stroke (MOST 108-2321-B-039-003-), Tseng-Lien Lin Foundation, Taichung, Taiwan. The funders had no role in the study design, data collection and analysis, the decision to publish, or preparation of the manuscript. No additional external funding was received for this study.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpubh.2021.682341/full#supplementary-material
Supplementary Figure 1. Maps of monitoring stations of air pollutants in Taiwan.
Supplementary Figure 2. The plots of the generalized additive models showed great deviation from a linear relationship.
Supplementary Figure 3. Kaplan-Meier curve about NOx exposure and dysmenorrhea risk.
Supplementary Figure 4. Kaplan-Meier curve about NO exposure and dysmenorrhea risk.
Supplementary Figure 5. Kaplan-Meier curve about NO2 exposure and dysmenorrhea risk.
Supplementary Figure 6. Kaplan-Meier curve about CO exposure and dysmenorrhea risk.
Supplementary Figure 7. Kaplan-Meier curve about PM2.5 exposure and dysmenorrhea risk.
Supplementary Table 1. Description correlation matrix for air pollutants. ***correlation is significant at the <0.0001 level (two tails).
Supplementary Table 2. Baseline urbanization level among quartiles of daily average concentration of air pollutants in Taiwan. P-value using chi-square for the comparisons between urbanization level among quartiles of daily average concentration of air pollutants. The urbanization level was categorized by the population density of the residential area into 4 levels, with level 1 as the most urbanized and level 4 as the last urbanized. The daily average air pollutant concentrations were categorized based on quartiles for each air pollutants.
References
1. Latthe P, Latthe M, Say L, Gulmezoglu M, Khan KS. WHO systematic review of prevalence of chronic pelvic pain: a neglected reproductive health morbidity. BMC Public Health. (2006) 6:177. doi: 10.1186/1471-2458-6-177
2. Patel V, Tanksale V, Sahasrabhojanee M, Gupte S, Nevrekar P. The burden and determinants of dysmenorrhoea: a population-based survey of 2262 women in Goa, India. BJOG. (2006) 113:453–63. doi: 10.1111/j.1471-0528.2006.00874.x
3. Bernardi M, Lazzeri L, Perelli F, Reis FM, Petraglia F. Dysmenorrhea and related disorders. F1000Research. (2017) 6:1645. doi: 10.12688/f1000research.11682.1
4. Banikarim C, Chacko MR, Kelder SH. Prevalence and impact of dysmenorrhea on hispanic female adolescents. Arch Pediatr Adolesc Med. (2000) 154:1226–9. doi: 10.1001/archpedi.154.12.1226
5. Kanwal R, Masood T, Awan WA. Association between symptoms of primary dysmenorrhea, physical functions and work productivity. Rehabil J. (2019) 3:90–3. doi: 10.52567/trj.v3i01.23
6. Davis AR, Westhoff CL. Primary dysmenorrhea in adolescent girls and treatment with oral contraceptives. J Pediatr Adolesc Gynecol. (2001) 14:3–8. doi: 10.1016/S1083-3188(00)00076-0
7. Durain D. Primary dysmenorrhea: assessment and management update. J Midwif Womens Health. (2004) 49:520–8. doi: 10.1016/j.jmwh.2004.08.013
8. Dawood MY. Dysmenorrhoea and prostaglandins: pharmacological and therapeutic considerations. Drugs. (1981) 22:42–56. doi: 10.2165/00003495-198122010-00003
9. Ricciotti E, FitzGerald GA. Prostaglandins and inflammation. Arterioscler Thromb Vasc Biol. (2011) 31:986–1000. doi: 10.1161/ATVBAHA.110.207449
10. Proctor M, Farquhar C. Drugs for dysmenorrhea. In: Gynecological Drug Therapy. CRC Press (2016). p. 35–46. doi: 10.3109/9781420016345-7
11. Ruoff G, Lema M. Strategies in pain management: new and potential indications for COX-2 specific inhibitors. J. Pain Symptom Manage. (2003) 25:21–31. doi: 10.1016/S0885-3924(02)00628-0
12. Mahalingaiah S, Hart JE, Laden F, Farland LV, Hewlett MM, Chavarro J, et al. Adult air pollution exposure and risk of infertility in the nurses' health study II. Hum Reprod. (2016) 31:638–47. doi: 10.1093/humrep/dev330
13. Carr, é J, Gatimel N, Moreau J, Parinaud J, Léandri R. Does air pollution play a role in infertility?: a systematic review. Environ Health. (2017) 16:82. doi: 10.1186/s12940-017-0291-8
14. Srám R. Impact of air pollution on reproductive health. Environ Health Perspect. (1999) 107:A542–3. doi: 10.1289/ehp.107-1566709
15. Merklinger-Gruchala A, Jasienska G, Kapiszewska M. Effect of air pollution on menstrual cycle length-a prognostic factor of women's reproductive health. Int J Environ Res Public Health. (2017) 14:816. doi: 10.3390/ijerph14070816
16. Mahalingaiah S, Missmer SE, Cheng JJ, Chavarro J, Laden F, Hart JE. Perimenarchal air pollution exposure and menstrual disorders. Hum Reproduct. (2018) 33:512–9. doi: 10.1093/humrep/dey005
17. Environmental Protection Administration. (2018). Air Quality Observation and Forecast Network(空氣品質監測站網). Available online at: https://www.epa.gov.tw/eng/72014105B1616E36
18. Kuo CY, Pan RH, Chan CK, Wu CY, Phan DV, Chan CL. Application of a time-stratified case-crossover design to explore the effects of air pollution and season on childhood asthma hospitalization in cities of differing urban patterns: big data analytics of government open data. Int J Environ Res Public Health. (2018) 15:647. doi: 10.3390/ijerph15040647
19. Jung CR, Lin YT, Hwang BF. Air pollution and newly diagnostic autism spectrum disorders: a population-based cohort study in Taiwan. PLoS ONE. (2013) 8:e75510. doi: 10.1371/journal.pone.0075510
20. Hailemeskel S, Demissie A, Assefa N. Primary dysmenorrhea magnitude, associated risk factors, and its effect on academic performance: evidence from female university students in Ethiopia. Int J Womens Health. (2016) 8:489–96. doi: 10.2147/IJWH.S112768
21. Hu Z, Tang L, Chen L, Kaminga AC, Xu H. Prevalence and risk factors associated with primary dysmenorrhea among Chinese female university students: a cross-sectional study. J Pediatr Adolesc Gynecol. (2020) 33:15–22. doi: 10.1016/j.jpag.2019.09.004
22. Chen FW, Liu CW. Estimation of the spatial rainfall distribution using inverse distance weighting (IDW) in the middle of Taiwan. Paddy Water Environ. (2012) 10:209–22. doi: 10.1007/s10333-012-0319-1
23. Agung Setianto AS, Tamia Triandini TT. Comparison of kriging and inverse distance weighted (IDW) interpolation methods in lineament extraction and analysis. J Southeast Asian Appl Geol. (2013) 5:21–9. doi: 10.22146/jag.7204
24. Jumaah HJ, Ameen MH, Kalantar B, Rizeei HM, Jumaah SJ. Air quality index prediction using IDW geostatistical technique and OLS-based GIS technique in Kuala Lumpur, Malaysia. Geomat Nat Hazards Risk. (2019) 10:2185–99. doi: 10.1080/19475705.2019.1683084
25. Fox J, Weisberg S. An R Companion to Applied Regression. 3rd ed. Thousand Oaks, CA: Sage (2019).
26. Pearce JL, Beringer J, Nicholls N, Hyndman RJ, Tapper NJ. Quantifying the influence of local meteorology on air quality using generalized additive models. Atmosph Environ. (2011) 45:1328–36. doi: 10.1016/j.atmosenv.2010.11.051
27. Souza JB, Reisen VA, Franco GC, Ispány M, Bondon P, Santos JM. Generalized additive models with principal component analysis: an application to time series of respiratory disease and air pollution data. J R Stat Soc Ser C. (2018) 67:453–80. doi: 10.1111/rssc.12239
28. Grego JM. Generalized additive models. In: El-Shaarawi AH, Piegorsch WW, Zidek J, editors. Encyclopedia of Environmetrics (2006). doi: 10.1002/9780470057339.vag007
29. McLean MW, Hooker G, Staicu AM, Scheipl F, Ruppert D. Functional generalized additive models. J Comput Graph Stat. (2014) 23:249–69. doi: 10.1080/10618600.2012.729985
30. Dominici F, McDermott A, Zeger SL, Samet JM. On the use of generalized additive models in time-series studies of air pollution and health. Am J Epidemiology. (2002) 156:193–203. doi: 10.1093/aje/kwf062
31. Zhang M, Song Y, Cai X, Zhou J. Economic assessment of the health effects related to particulate matter pollution in 111 Chinese cities by using economic burden of disease analysis. J Environ Manage. (2008) 88:947–54. doi: 10.1016/j.jenvman.2007.04.019
32. Chen X, Shao S, Tian Z, Xie Z, Yin P. Impacts of air pollution and its spatial spillover effect on public health based on China's big data sample. J Clean Product. (2017) 142:915–25. doi: 10.1016/j.jclepro.2016.02.119
33. Pope AC III, Bhatnagar A, McCracken JP, Abplanalp W, Conlin DJ, O'Toole T. Exposure to fine particulate air pollution is associated with endothelial injury and systemic inflammation. Circul Res. (2016) 119:1204–14. doi: 10.1161/CIRCRESAHA.116.309279
34. Chen C, Li H, Niu Y, Liu C, Lin Z, Cai J, et al. Impact of short-term exposure to fine particulate matter air pollution on urinary metabolome: a randomized, double-blind, crossover trial. Environ Int. (2019) 130:104878. doi: 10.1016/j.envint.2019.05.072
35. Schneider JC, Card GL, Pfau JC, Holian A. Air pollution particulate SRM 1648 causes oxidative stress in RAW 264.7 macrophages leading to production of prostaglandin E2, a potential Th2 mediator. Inhalat Toxicol. (2005) 17:871–7. doi: 10.1080/08958370500244498
36. Yan W, Yun Y, Ku T, Li G, Sang N. NO2 inhalation promotes Alzheimer's disease-like progression: cyclooxygenase-2-derived prostaglandin E2 modulation and monoacylglycerol lipase inhibition-targeted medication. Sci Rep. (2016) 6:22429. doi: 10.1038/srep22429
37. Constantin D, Mehrotra K, Rahimtula A, Moldéus P, Jernström B. Stimulatory effects of sulfur and nitrogen oxides on carcinogen activation in human polymorphonuclear leukocytes. Environ Health Perspect. (1994) 102:161–4. doi: 10.1289/ehp.94102s4161
38. Risom L, Møller P, Loft S. Oxidative stress-induced DNA damage by particulate air pollution. Mutat Res. (2005) 592:119–37. doi: 10.1016/j.mrfmmm.2005.06.012
39. Kelly FJ. Oxidative stress: its role in air pollution and adverse health effects. Occupat Environ Med. (2003) 60:612–6. doi: 10.1136/oem.60.8.612
40. Lodovici M, Bigagli E. Oxidative stress and air pollution exposure. J Toxicol. (2011) 2011:487074. doi: 10.1155/2011/487074
41. Yang W, Omaye ST. Air pollutants, oxidative stress and human health. Mutat Res. (2009) 674:45–54. doi: 10.1016/j.mrgentox.2008.10.005
42. Ghio AJ, Carraway MS, Madden MC. Composition of air pollution particles and oxidative stress in cells, tissues, living systems. J Toxicol Environ Health Part B. (2012) 15:1–21. doi: 10.1080/10937404.2012.632359
43. Power MC, Kioumourtzoglou MA, Hart JE, Okereke OI, Laden F, Weisskopf MG. The relation between past exposure to fine particulate air pollution and prevalent anxiety: observational cohort study. BMJ. (2015) 350:h1111. doi: 10.1136/bmj.h1111
44. De Prins S, Dons E, Van Poppel M, Int Panis L, Van de Mieroop E, Nelen V, et al. Airway oxidative stress and inflammation markers in exhaled breath from children are linked with exposure to black carbon. Environ Int. (2014) 73:440–6. doi: 10.1016/j.envint.2014.06.017
45. Rosa MJ, Yan B, Chillrud SN, Acosta LM, Divjan A, Jacobson JS, et al. Domestic airborne black carbon levels and 8-isoprostane in exhaled breath condensate among children in New York city. Environ Res. (2014) 135:105–10. doi: 10.1016/j.envres.2014.09.003
46. Patel MM, Chillrud SN, Deepti K, Ross JM, Kinney PL. Traffic-related air pollutants and exhaled markers of airway inflammation and oxidative stress in New York city adolescents. Environ Res. (2013) 121:71–8. doi: 10.1016/j.envres.2012.10.012
47. Huang W, Wang G, Lu SE, Kipen H, Wang Y, Hu M, et al. Inflammatory and oxidative stress responses of healthy young adults to changes in air quality during the Beijing Olympics. Am J Respir Crit Care Med. (2012) 186:1150–9. doi: 10.1164/rccm.201205-0850OC
48. Nuernberg AM, Boyce PD, Cavallari JM, Fang SC, Eisen EA, Christiani DC. Urinary 8-isoprostane and 8-OHdG concentrations in boilermakers with welding exposure. J Occupat Environ Med. (2008) 50:182–9. doi: 10.1097/JOM.0b013e31815cf6cc
49. Samet JM, Reed W, Ghio AJ, Devlin RB, Carter JD, Dailey LA, et al. Induction of prostaglandin H synthase 2 in human airway epithelial cells exposed to residual oil fly ash. Toxicol Appl Pharmacol. (1996) 141:159–68. doi: 10.1016/S0041-008X(96)80021-4
50. Sang N, Yun Y, Yao GY, Li HY, Guo L, Li GK. SO2-induced neurotoxicity is mediated by cyclooxygenases-2-derived prostaglandin E2 and its downstream signaling pathway in rat hippocampal neurons. Toxicol Sci. (2011) 124:400–13. doi: 10.1093/toxsci/kfr224
51. Iacovides S, Avidon I, Baker FC. What we know about primary dysmenorrhea today: a critical review. Hum Reproduct Update. (2015) 21:762–78. doi: 10.1093/humupd/dmv039
52. Sharghi M, Mansurkhani SM, Larky DA, Kooti W, Niksefat M, Firoozbakht M, et al. An update and systematic review on the treatment of primary dysmenorrhea. JBRA Assis Reproduct. (2019) 23:51. doi: 10.5935/1518-0557.20180083
53. Kaplan Ö, Naziroglu M, Güney M, Aykur M. Non-steroidal anti-inflammatory drug modulates oxidative stress and calcium ion levels in the neutrophils of patients with primary dysmenorrhea. J Reproduct Immunol. (2013) 100:87–92. doi: 10.1016/j.jri.2013.10.004
54. Yeh ML, Chen HH, So EC, Liu F. A study of serum malondialdehyde and interleukin-6 levels in young women with dysmenorrhea in Taiwan. Life Sci. (2004) 75:669–73. doi: 10.1016/j.lfs.2003.11.034
55. Szmidt MK, Granda D, Sicinska E, Kaluza J. Primary dysmenorrhea in relation to oxidative stress and antioxidant status: a systematic review of case-control studies. Antioxidants. (2020) 9:994. doi: 10.3390/antiox9100994
56. Yang S, Chen R, Zhang L, Sun Q, Li R, Gu W, et al. Lipid metabolic adaption to long-term ambient PM2. 5 exposure in mice. Environ Pollut. (2021) 269:116193. doi: 10.1016/j.envpol.2020.116193
57. Fujiwara T, Nakata R. Young Japanese college students with dysmenorrhea have high frequency of irregular menstruation and premenstrual symptoms. Open Med Informat J. (2007) 1:8. doi: 10.2174/1874431100701010008
58. Beck HG. Slow carbon monoxide asphyxiation: a neglected clinical problem. J Am Med Assoc. (1936) 107:1025–9. doi: 10.1001/jama.1936.02770390017006
59. Vert C, Sánchez-Benavides G, Martínez D, Gotsens X, Gramunt N, Cirach M, et al. Effect of long-term exposure to air pollution on anxiety and depression in adults: a cross-sectional study. Int J Hyg Environ Health. (2017) 220:1074–80. doi: 10.1016/j.ijheh.2017.06.009
60. Roberts S, Arseneault L, Barratt B, Beevers S, Danese A, Odgers CL, et al. Exploration of NO2 and PM2.5 air pollution and mental health problems using high-resolution data in London-based children from a UK longitudinal cohort study. Psychiatry Res. (2019) 272:8–17. doi: 10.1016/j.psychres.2018.12.050
61. Kordi M, Mohamadirizi S, Shakeri MT. The relationship between occupational stress and dysmenorrhea in midwives employed at public and private hospitals and health care centers in Iran (Mashhad) in the years 2010 and 2011. Iran J Nurs Midwif Res. (2013) 18:316–22. doi: 10.22038/JMRH.2014.2792
62. Bajalan Z, Moafi F, MoradiBaglooei M, Alimoradi Z. Mental health and primary dysmenorrhea: a systematic review. J Psychosom Obstetr Gynecol. (2019) 40:185–94. doi: 10.1080/0167482X.2018.1470619
63. Takeda T, Tadakawa M, Koga S, Nagase S, Yaegashi N. Relationship between dysmenorrhea and posttraumatic stress disorder in Japanese high school students 9 months after the Great East Japan Earthquake. J Pediatr Adolesc Gynecol. (2013) 26:355–7. doi: 10.1016/j.jpag.2013.06.020
64. Wang L, Wang X, Wang W, Chen C, Ronnennberg AG, Guang W, et al. Stress and dysmenorrhoea: a population based prospective study. Occupat Environ Med. (2004) 61:1021–6. doi: 10.1136/oem.2003.012302
65. Romieu I, Moreno-Macias H, London SJ. Gene by environment interaction and ambient air pollution. Proc Am Thorac Soc. (2010) 7:116–22. doi: 10.1513/pats.200909-097RM
66. Ju H, Jones M, Mishra G. The prevalence and risk factors of dysmenorrhea. Epidemiology Rev. (2013) 36:104–13. doi: 10.1093/epirev/mxt009
Keywords: air pollution, dysmenorrhea, Taiwan air quality monitoring database, national health insurance research database, NOX, CO, PM2.5
Citation: Lin S-Y, Yang Y-C, Lin C-C, Chang CY-Y, Hsu W-H, Wang I-K, Lin C-D, Hsu C-Y and Kao C-H (2021) Increased Incidence of Dysmenorrhea in Women Exposed to Higher Concentrations of NO, NO2, NOx, CO, and PM2.5: A Nationwide Population-Based Study. Front. Public Health 9:682341. doi: 10.3389/fpubh.2021.682341
Received: 18 March 2021; Accepted: 25 May 2021;
Published: 17 June 2021.
Edited by:
Dimirios Nikolopoulos, University of West Attica, GreeceReviewed by:
Konstantinos P. Moustris, University of West Attica, GreeceErmioni Petraki, University of West Attica, Greece
Copyright © 2021 Lin, Yang, Lin, Chang, Hsu, Wang, Lin, Hsu and Kao. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Chia-Hung Kao, d10040@mail.cmuh.org.tw; dr.kaochiahung@gmail.com