- 1Division of Pharmacology, Department of Biomedical Sciences, Nihon University School of Medicine, Itabashi-ku, Tokyo, Japan
- 2Division of Genomic Epidemiology and Clinical Trials, Clinical Trials Research Center, Nihon University School of Medicine, Itabashi-ku, Tokyo, Japan
Background: Acute kidney injury (AKI), with an increase in serum creatinine, is a common adverse drug event. Although various clinical studies have investigated whether a combination of two nephrotoxic drugs has an increased risk of AKI using traditional statistical models such as multivariable logistic regression (MLR), the evaluation metrics have not been evaluated despite the fact that traditional statistical models may over-fit the data. The aim of the present study was to detect drug-drug interactions with an increased risk of AKI by interpreting machine-learning models to avoid overfitting.
Methods: We developed six machine-learning models trained using electronic medical records: MLR, logistic least absolute shrinkage and selection operator regression (LLR), random forest, extreme gradient boosting (XGB) tree, and two support vector machine models (kernel = linear function and radial basis function). In order to detect drug-drug interactions, the XGB and LLR models that showed good predictive performance were interpreted by SHapley Additive exPlanations (SHAP) and relative excess risk due to interaction (RERI), respectively.
Results: Among approximately 2.5 million patients, 65,667 patients were extracted from the electronic medical records, and assigned to case (N = 5,319) and control (N = 60,348) groups. In the XGB model, a combination of loop diuretic and histamine H2 blocker [mean (|SHAP|) = 0.011] was identified as a relatively important risk factor for AKI. The combination of loop diuretic and H2 blocker showed a significant synergistic interaction on an additive scale (RERI 1.289, 95% confidence interval 0.226–5.591) also in the LLR model.
Conclusion: The present population-based case-control study using interpretable machine-learning models suggested that although the relative importance of the individual and combined effects of loop diuretics and H2 blockers is lower than that of well-known risk factors such as older age and sex, concomitant use of a loop diuretic and histamine H2 blocker is associated with increased risk of AKI.
1 Introduction
Acute kidney injury (AKI) is one of four phenotypes of drug-induced kidney disease (DIKD), and is diagnosed by serum creatinine (SCr)-based definitions proposed in the Kidney Disease: Improving Global Outcomes (KDIGO) 2012 guidelines (Mehta et al., 2015; Ostermann et al., 2020). Various clinical studies have been conducted to assess the effect of individual drugs (e.g., platinum-based agents and antibiotics) on risk of AKI, and those drugs associated with increased risk of AKI are listed as nephrotoxic drugs (Usui et al., 2016; Huang et al., 2022). Recently, Gray et al. (2022) have classified the nephrotoxic potential of 167 medications into seven phased nephrotoxicity categories (ranging from “No potential” to “Definite”), and 41 medications (25%) had nephrotoxic potential (rating ≥ 1). In Japan, society is aging rapidly because of the declining birth rate, and while individuals aged 20–34 account for 4.9% of total cases of polypharmacy, individuals aged 65 and older account for 69.0% (Onoue et al., 2018). Therefore, it is possible that multiple drugs with nephrotoxic potential are prescribed to patients, especially elderly patients. In fact, it has been reported that in elderly patients, concomitant use of two drug classes with nephrotoxic potential, for example, antibiotics and proton pump inhibitors, is the 3rd leading cause of acute interstitial nephritis (AIN), which is an important cause of AKI (Muriithi et al., 2015; Pierson-Marchandise et al., 2017). Hence, it is important to evaluate the combined effect of two drug classes on the risk of AKI.
In 2000, a case report of two patients who had taken a diuretic, angiotensin receptor blocker, and non-steroidal anti-inflammatory drug (NSAID) in combination, so-called “triple whammy,” and experienced a rise in SCr was published (Thomas, 2000). Subsequently, a number of clinical studies worldwide have investigated whether concurrent use of these drug classes increases SCr level and decreases estimated glomerular filtration rate (Loboz and Shenfield, 2005; Lapi et al., 2013; Camin et al., 2015; Kunitsu et al., 2019; Imai et al., 2022). Besides the triple whammy, clinical studies have tried to detect drug-drug interactions between two or more drug classes in acute kidney injury (Bird et al., 2013; Gandhi et al., 2013; Gul et al., 2016; Inaba et al., 2019; Okada et al., 2019; Liu et al., 2021; Salerno et al., 2021). However, most of these studies used a multivariable logistic regression (MLR) model, which is a traditional statistical model, and evaluation metrics such as discrimination, calibration, and robustness of the regression model have not been evaluated. Machine learning (ML) is an alternative analytical approach that can handle complex relationships between a number of variables in real-world big data. ML algorithms have been used to predict AKI, and the predictive performance of ML models is often superior to that of traditional statistical models (Song et al., 2021; Peng et al., 2022; Yue et al., 2022). Furthermore, interpretable ML has been applied to detect variables affecting the development of an outcome (Jiang et al., 2023). Hence, the aim of the present study was to investigate whether there is a combination of two drug classes that has combined effects on the increased risk of AKI, by mining electronic medical records using interpretable ML models.
2 Materials and methods
2.1 Data source
The present study was based on a population-based case-control study utilizing electronic medical records from the Nihon University School of Medicine’s Clinical Data Warehouse (NUSM’s CDW) between 1 April 2004 and 1 September 2021. NUSM’s CDW is a centralized data repository that integrates separate databases, including patient demographics, diagnoses, and laboratory data of approximately 2.5 million patients, from the hospital information systems at three hospitals affiliated with the NUSM; Nihon University Itabashi Hospital, Nerima Hikarigaoka Hospital, and Surugadai Nihon University Hospital. To protect patient privacy, patient identifiers are replaced by anonymous identifiers in all databases of the CDW.
2.2 Definition of acute kidney injury as binary outcome
Sample size flow in this study is shown in Figure 1. Firstly, 74,016 Japanese patients who underwent kidney function tests at least three times within 14 days (the interval between each measurement date was 7 days or less) and whose serum creatinine (SCr) showed a <50% change between the 1st and 2nd measurement dates were extracted from NUSM’s CDW, and the 2nd measurement date was regarded as baseline. Among the 74,016 patients, those who met any of the following two conditions were regarded as patients with acute kidney injury complying with the KDIGO criteria: 1) SCr increased by 0.3 mg/dL within 48 h from baseline, or 2) SCr increased to ≥1.5 times higher than baseline within the prior 7 days. These patients with acute kidney injury were assigned to the case group (N = 7,203; outcome = 1) and the date that AKI occurred was regarded as the event date. On the other hand, the remaining 66,813 patients were assigned to the control group (outcome = 0), and the 3rd measurement date was regarded as the reference date in the control group. Next, patients who met the following exclusion criteria were excluded: 1) under 18 years old, 2) baseline SCr >5.0 mg/dL, and 3) patients with pre-existing kidney disease [chronic kidney disease stage ≥3, diabetic nephropathy, other kidney disease; International Classification of Disease 10 (ICD-10) codes are shown in Supplementary Table S1A]. Then the clinical information from 65,667 patients was used for training and testing of ML models.
FIGURE 1. Sample size flowchart. Abbreviations: NUSM’s CDW, Nihon University School of Medicine’s Clinical Data Warehouse; SCr, serum creatinine; CKD, chronic kidney disease; CI, confidence interval; LLR, logistic least absolute shrinkage and selection operator regression; CV, cross-validation; ML, machine-learning; MLR, multivariable logistic regression; RF, random forest; SVM-L, support vector machine (linear function); SVM-R, support vector machine (radial basis function); XGB, extreme gradient boosting.
2.3 Features
In order to detect interactions between two drug classes for risk of AKI, we obtained use or non-use of 32 therapeutic drug classes, and 496 (=32C2) product terms of these drug classes as features from the eligible patients. However, because none of the 88 product terms included patients who developed AKI (i.e., these product terms contained only “0”), the number of product terms reduced to 408. The drug classes were classified based on the Anatomical Therapeutic Chemical (ATC) code published by the WHO Collaborating Centre for Drug Statistics Methodology (Supplementary Table S2). AKI tends to occur within 7 days from the initiation of a culprit drug, and sub-acute kidney injury occurs within 4 weeks (Mehta et al., 2015). In fact, it has been reported that several nephrotoxic drugs are more likely to induce acute kidney injury within 7 days, and most cases of acute kidney injury occur within 30 days from the initiation of the drug (Khalili et al., 2013; Miano et al., 2018; Ide et al., 2019; Kunitsu et al., 2022; Wu et al., 2022). Hence, if a drug class was newly started within 1–7 days before the event date, the drug class was regarded as “use.” If a drug class was newly started on the event date, the drug class was regarded as “non-use,” to prevent reverse causality bias. A drug class newly started within 8+ days before the event date was regarded as “non-use.” When the included product term is “1,” it means that the two drug classes were newly started at about the same time within 7 days before the event date, whereas when it is “0,” it means that one of the two drug classes was used or neither of them was newly started. That is, the present study detected whether any of the 408 combinations of the 32 drug classes had an interaction for increased risk of AKI.
Five demographic characteristics and medical history which included seven diagnoses as features were obtained to adjust for the effect of these features on the risk of AKI. The demographic information was composed of age, sex, and three hospitals (Itabashi, Hikarigaoka, and Surugadai; dummy variables). The medical history was composed of hypertension, diabetes, heart failure, anemia, sepsis, chronic kidney disease (stage ≤2), and chronic liver disease, which are known risk factors for AKI (ICD-10 codes are shown in Supplementary Table S1B) (Poston and Koyner, 2019; Ostermann et al., 2020; Yu et al., 2020; Cullaro et al., 2022). A diagnosis was regarded as “present” if there was a diagnosis before baseline. We investigated 32 therapeutic drug classes commonly associated with risk of acute kidney injury (Usui et al., 2016; Nast, 2017; Ostermann et al., 2020). Finally, a two-dimensional dataset (65,667 patients × 452 features) for ML was generated. Data imputation was not performed because all the observations in the dataset had no missing values.
2.4 Construction of ML models and model evaluation
The dataset for ML was randomly split into a training set for the development of ML models (80%; N = 52,533) and a testing set for evaluation (20%; N = 13,134). To evaluate the effects of individual drug classes and their product terms on the risk of AKI, six ML models were utilized in this study: 1) MLR model and 2) logistic least absolute shrinkage and selection operator regression (LLR) model which are linear algorithms, 3) random forest (RF) model and 4) extreme gradient boosting (XGB) tree model which are tree-based algorithms, and 5) and 6) two support vector machine models [kernel = linear function (SVM-L) and radial basis function (SVM-R)]. All the supervised ML models were developed using R software (version 4.1.2; R Foundation for Statistical Computing, Vienna, Austria).
The supervised ML models were performed with AKI occurring as a binary dependent variable and the 452 features as independent variables; that is, 449 features excluding the individual effects of the two drug classes of interest and their product terms were regarded as co-variables. When constructing the four ML models except for the MLR model, we ran 10-fold cross-validation to perform hyperparameter tuning. In the LLR model, a lambda (λ) value, which is the penalty term in the loss function, was determined to minimize misclassification error for the training set and to avoid over-fitting to the training set using the R “glmnet” package. A regularized logistic regression equation was obtained using the optimized λ value (Supplementary Figure S1). The RF model was constructed using the R “randomForest” package. Hyperparameters such as the number of features randomly sampled as candidates at each tree (mtry) and the number of trees to grow (ntree) were optimized by grid search (Supplementary Table S3). The XGB model was constructed using the R “xgboost” package. The hyperparameters of the XGB model are roughly divided into the following four parameters: general, booster, learning task, and command line parameters. Of these parameters, booster parameters were optimized by grid search. Finally, the XGB model with the optimized hyperparameters was constructed (Supplementary Table S4). The two SVM models were constructed using the R “e1071” package, and the hyperparameters were optimized using a grid search (Supplementary Table S5).
Area under the receiver operating characteristic curve (AUROC) and area under the precision-recall curve (AUPR) were calculated to evaluate the discrimination and robustness of each ML model. To evaluate model calibration, the calibration slope and intercept were calculated for each ML model from a calibration plot with actual probabilities on the X-axis and log odds on the Y-axis. The calibration slope and intercept have target values of 1 and 0, respectively. A slope <1 indicates that predictive risk is too extreme, i.e., too high for patients who are at high risk and too low for patients who are at low risk, and an intercept <0 indicates overestimation of predicted risk (Van Calster et al., 2019). Additionally, Brier score, which is an evaluation metric to verify the accuracy of predicted probabilities, was calculated for model calibration using the R “scoring” package. Brier score is the mean squared error between the actual binary outcome and the predicted probabilities, as shown in Formula 1 (Huang et al., 2020):
where
2.5 Detection of drug-drug interactions for risk of acute kidney injury
In the present study, the following two ML models were interpreted to detect interactions between two drug classes for increased risk of AKI: 1) the XGB model, which had the best predictive performance, and 2) the LLR model, which had the second-best predictive performance and can detect synergistic interactions on an additive scale. Although the complexity of the models of ML makes it hard to provide interpretability, some interpretation algorithms such as SHapley Additive exPlanations (SHAP) and Local Interpretable Model-Agnostic Explanations (LIME) have been used (Hu et al., 2022). In this study, SHAP values were calculated to detect features that affect the increased risk of AKI using the R “SHAPforxgboost” package.
In the LLR model, relative excess risk due to interaction (RERI) was used to evaluate synergistic interaction on an additive scale between two drug classes. RERI has been used to detect whether there are combined effects of two exposures on an outcome and can be calculated by substituting coefficients in the regression equation into the following Formulas 2, 3 (Knol et al., 2007; Knol and VanderWeele, 2012). RERI of 0 indicates no interaction on an additive scale.
and
However, in the LLR model built using the glmnet package, a point estimate for each feature is calculated, but its standard error is not. Hence, 95% confidence intervals (95% CIs) of regression coefficients, adjusted odds ratio (OR), and RERI were estimated with a percentile bootstrap method (Figure 1) (Jung et al., 2019). To calculate 95% CIs, 2,000 bootstrap samples, each of which was the same size as the training set, were generated by resampling with replacement from the training set. After a parameter estimate was calculated from each bootstrap sample, 2,000 parameter estimates in all the bootstrap samples were sorted in ascending order. The interval between the 50th and 1950th quantile values of the 2,000 parameter estimates was regarded as the 95% CI. In this study, combinations that had a product term with a lower limit of adjusted OR 95% CI > 1 and had a lower limit of RERI 95% CI > 0 were considered to have a positive interaction for the risk of AKI. However, it is invalid to calculate RERI if the adjusted OR for at least one of two drug classes in a combination is less than 1.
2.6 Statistical analysis
To compare the patient characteristics between the case and control groups and between the training and testing sets, unpaired two-tailed Welch’s t-test or Wilcoxon rank-sum test for continuous data and chi-squared test for categorical data were performed. DeLong’s test and bootstrap test were performed to compare AUROC and AUPR, respectively. The level of statistical significance was set at 5.0% for all statistical analyses. All statistical analyses were performed using R software.
2.7 Sensitivity analyses
Sensitivity analyses were performed to evaluate the robustness of the detected potential drug-drug interactions. Since most cases of AKI occur within 4 weeks regardless of drug class, we redefined new exposures to the drug classes within 1–14 and 1–30 days from the event date as “use” and reconstructed the XGB and LLR models using the same procedure as above. SHAP and RERI values were calculated from the two reconstructed models, and potential interactions between two drug classes of interest were evaluated.
3 Results
3.1 Patients’ characteristics
A total of 65,667 eligible patients were extracted from NUSM’s CDW and assigned to the case (N = 5,319) and control (N = 60,348) groups. Their clinical characteristics are presented in Table 1. Age in the case group was significantly older than that in the control group (p < 0.001), and the case group contained significantly more male patients than the control group (p < 0.001). All seven medical diagnoses were significantly more prevalent in the case group than in the control group (all p < 0.001). With regard to therapeutic drug classes, most of the drug classes were significantly different between the case and control groups. SCr levels on the event date were within normal range (male, 0.65–1.07 mg/dL; female, 0.46–0.79 mg/dL) for both male and female subjects in the control group. On the other hand, most patients in the case group had SCr levels above the normal range, and SCr levels in the case group were significantly higher than those in the control group regardless of sex (p < 0.001, respectively). Additionally, patients’ characteristics were homogeneous between the training and testing sets in both the case and control groups (Supplementary Tables S6, S7).
3.2 Comparison of predictive performance among six ML models
Discrimination, robustness, and calibration of each ML model are shown in Figure 2, and other classification metrics are shown in Table 2. Among the six ML models, the XGB model had the highest AUROC (0.827, 95% CI 0.814–0.840), and the LLR model had the second highest AUROC (0.801, 0.787–0.816) (Figure 2A). The XGB model had the highest AUPR (0.384, 0.352–0.414) followed by the LLR (0.348, 0.319–0.379) and RF (0.336, 0.305–0.367) models (Figure 2B). The XGB model had the highest classification performance, with sensitivity of 77.4%, PPV of 20.5%, specificity of 72.9%, NPV of 97.3%, and F1-score of 0.324 (Table 2). After this model, the LLR model had sensitivity of 77.6%, PPV of 18.9%, specificity of 70.3%, NPV of 97.1%, and F1-score of 0.303. As for model robustness, the XGB and LLR models maintained high AUROC and AUPR even with small training sample sizes (10%–30% of the training set). The MLR model had low AUPR for very small training sample sizes, such as 10% of the training set, and the SVM-L model showed a lack of robustness (Figures 2C, D). With regard to model calibration, the LLR and SVM-L models had a good calibration slope (1.06, 1.00–1.12; 0.99, 0.86–1.13, respectively), and the latter also had a good calibration intercept (0.01, −0.32 to 0.35). On the other hand, the MLR, RF, XGB, and SVM-R models had slopes less than 1, and these three models other than the RF model had intercepts less than 0 (Figures 2E, F). The XGB model had the lowest Brier score (0.063, 0.059–0.066), followed by the LLR model (0.065, 0.061–0.068) (Figure 2G). Therefore, the XGB and LLR models, which had the best and second-best evaluation metrics, were interpreted to detect interactions between two drug classes with increased risk of AKI.
FIGURE 2. Comparison of evaluation metrics among six machine-learning models. (A) Each point indicates area under the receiver operating characteristic curve (AUROC) and error bar indicates 95% confidence interval (CI). There were significant differences between all six machine-learning models (p < 0.001, respectively). (B) Each point indicates area under the precision-recall curve (AUPR) and error bar indicates 95% CI. There were significant differences between all machine-learning models (p < 0.01, respectively) except between MLR and SVM-R models (p = 0.435), between MLR and RF models (p = 0.466), and between RF and LASSO model (p = 0.222). Robustness of the machine-learning models in AUROC (C) and AUPR (D), respectively. AUROC for each training sample size was calculated by increasing the sample size by 10%. Calibration slope (E) and intercept (F) were calculated from the calibration curve, and error bar indicates 95% CI. (G) Brier score in each machine-learning model. Error bar indicates 95% CI and smaller Brier score indicates a stronger fit of the model. Abbreviations: LLR, logistic least absolute shrinkage and selection operator regression; MLR, multivariable logistic regression; RF, random forest; SVM-L, support vector machine (linear function); SVM-R, support vector machine (radial basis function); XGB, extreme gradient boosting.
Supplementary Figure S2 shows the effect of the 408 product terms on model discrimination of the six ML models. AUROC values of the five models, except for the MLR model, with these product terms were significantly higher than those of the models without them. AUPR values of the LLR, SVM-L, and SVM-R models with these product terms in the training set were significantly higher than those of the models without them. That is, the product terms between two drug classes affected model discrimination.
3.3 Evaluation of features affecting increased risk of AKI in XGB model
A SHAP summary plot of the XGB model was made to identify features that affect the risk of AKI in the prediction model, and the top 30 important features are shown in Figure 3. All 110 features with non-zero mean (|SHAP|) values are shown in Supplementary Figure S3. This plot shows how strongly or weakly the features were related to the SHAP values. For example, the older the patient, the more purple it becomes. As another example, in the case of binary features such as sex and use or non-use of the drug classes, “male” and “use” are shown in purple. Age, male, hypertension, heart failure, and sepsis were detected as the most important predictors of increased risk of AKI, and their feature importance scores, as measured by mean (|SHAP|), were 0.309, 0.225, 0.166, 0.140, and 0.114, respectively. In particular, the locally-weighted scatterplot smoothing curve exceeded the SHAP value of 0 for ages from 60 to 93 years according to the SHAP dependence plot (Supplementary Figure S4). Regarding the individual drug classes, loop diuretics, glycopeptides, aldosterone antagonists, platinum-based agents, and sulfamethoxazole/trimethoprim were identified as important predictors of increased risk of AKI. Of the five product terms in the top 30 important features, the product term of loop diuretics and histamine H2 blockers [mean (|SHAP|) = 0.011], and that of cephalosporins and proton pump inhibitors (0.010) were identified as relatively important risk factors for AKI because SHAP values of most of the patients with these product terms were positive.
FIGURE 3. Effect of features on increased risk of AKI in XGB model (SHAP summary plot). * indicates product term of two drug classes. When a feature is continuous, the higher the feature value, the more purple it is. When a feature is binary, it is represented in purple if the feature is present. Each dot represents one patient on the line for each feature. Mean absolute SHAP value is shown to the right of a feature. Abbreviations: ARB, angiotensin receptor blocker; H2 blocker, histamine H2 receptor blocker; HOS, hospital; MH, medical history; NSAID, non-steroidal anti-inflammatory drug; PPI, proton pump inhibitor; SHAP, SHapley Additive exPlanation; SMX/TMP, sulfamethoxazole/trimethoprim.
Supplementary Figure S5 shows the SHAP values of the reconstructed XGB models in which the drug classes newly started within 1–14 and 1–30 days were considered “use.” The product term of loop diuretics and H2 blockers was consistently included in the top 30 important features in the reconstructed models, and rather the SHAP values tended to be higher than those in the original model. Moreover, the individual effects of these drug classes on increased risk of AKI in the reconstructed models were also greater than those in the original model: mean (|SHAP|) of loop diuretics = 0.083 within 1–7 days, 0.116 within 1–14 days, and 0.161 within 1–30 days; that of H2 blockers = 0.045, 0.051, and 0.071, respectively.
3.4 Detection of drug-drug interactions for increased risk of AKI in LLR model
One hundred and thirty-four features were selected in the LLR model, with an optimized value λ of 0.0015275. All the selected features are shown in Supplementary Table S8. Of the 408 combinations, four combinations had a product term with a lower limit of adjusted OR 95% CI > 1 (Figure 4A): penicillins*cephalosporins (adjusted OR 2.414, 95% CI 1.453–5.425), cephalosporins*loop diuretics (1.880, 1.339–4.100), loop diuretics*H2 blockers (1.639, 1.047–3.159), and aldosterone antagonists*non-steroidal anti-inflammatory drugs (NSAIDs; 1.599, 1.053–3.672). Among the four combinations, only the combination of loop diuretics and histamine H2 blockers had a lower limit of RERI 95% CI > 0 (RERI 1.289, 95% CI 0.226 to 5.591 in Figure 4B): individual effect of loop diuretics,
FIGURE 4. Combined effects of two drug classes on increased risk of AKI. (A) Adjusted odds ratio for six individual drug classes and their four product terms. Blue and red circles represent estimated adjusted odds ratio in the original training set and median of adjusted odds ratio in 2,000 bootstrap replicates, respectively. Red horizon indicates adjusted odds ratio 95% confidence interval calculated by a percentile bootstrap method. (B) Relative excess risk due to interaction (RERI) between histamine H2 blockers and loop diuretics. Gray bar indicates background (i.e., non-use of H2 blockers and loop diuretics). White and green bars indicate relative excess risk due to H2 blockers (
Supplementary Figure S6 shows the adjusted ORs for the four combinations of the six individual drug classes in the reconstructed LLR models. Similarly to the XGB model, the product term of loop diuretics and histamine H2 blockers and the individual effect of loop diuretics were consistently associated with increased risk of AKI in the reconstructed models. Moreover, exposure to H2 blockers within 1–30 days before the event date was significantly associated with increased risk of AKI (adjusted OR 1.485, 95% CI 1.089, 1.790).
4 Discussion
In the present study, six ML models were constructed for the prediction of AKI. Although the XGB model tended to overestimate the risk of AKI, this model had the best discrimination and the lowest Brier score among the six ML models. After the XGB model, the LLR model showed good discrimination and low Brier score. On the other hand, AUROC and AUPR of the SVM-L model were the lowest among these ML models. The reason for this is thought to be that the sample size was extremely large compared to the number of features, making it difficult to calculate a hyperplane that can clearly discriminate the presence or absence of AKI in the feature space. In fact, the SVM-R model, which maps the 452-dimensional feature space (input space) to a higher-dimensional feature space by using the radial basis function kernel, had significantly greater AUROC and AUPR than the SVM-L model. Therefore, we detected the combined effect of two therapeutic drug classes on increased risk of AKI by interpreting the XGB and LLR models, with good predictive performance.
In the XGB model, well-known risk factors for AKI such as older age (Xu et al., 2021), male sex (Neugarten, et al., 2018), and six medical diagnoses (Poston and Koyner, 2019; Ostermann et al., 2020; Yu et al., 2020; Cullaro et al., 2022) were included in the top 30 important predictors. Especially, the risk of AKI increased in Japanese elderly patients aged 60–93 years (Supplementary Figure S4). Similarly to the XGB model, age, male, and five diagnoses except for diabetes and chronic kidney disease were significantly associated with increased risk of AKI in the LLR model (Supplementary Table S8). Since life expectancy at birth in Japan is 81.1 years for men and 87.1 years for women (Tsugane, 2021), the range from 60 to 93 years associated with increased risk of AKI covers most of the Japanese elderly population; that is, Japanese elderly patients are at high risk of AKI. Regarding individual drug classes, five drug classes (loop diuretics, glycopeptides, aldosterone antagonists, platinum-based agents, and sulfamethoxazole/trimethoprim) were associated with increased risk of AKI in the XGB model. Furthermore, all of these drug classes associated with the risk of AKI in the XGB model were also significantly associated with the risk of AKI in the LLR model. The five drug classes associated with increased risk of AKI are known to be nephrotoxic drug classes (Usui et al., 2016; Nast, 2017; Ostermann et al., 2020). On the other hand, NSAIDs were associated with decreased risk of AKI in both the XGB and LLR models. Although NSAIDs are well-known risk factors for DIKD, recent studies suggest that the coexistence of other risk factors in patients who take NSAIDs contributes to the development of AKI. For example, the risk of NSAID-induced AKI in patients with CKD and elderly people tended to be higher than that in the general population (Zhang et al., 2017). Moreover, adding NSAIDs in patients with hypertension further increases blood pressure due to reduction of renal vasodilator prostanoids such as prostaglandin E2 (PGE2) and PGI2, which are formed predominantly by cyclooxygenase (COX)-2, leading to renal vascular damage (Drożdżal et al., 2021; Spence et al., 2022). Because these factors that modify the risk of NSAID-induced AKI were adjusted in this study, NSAIDs may not be associated with increased risk of AKI. Therefore, it is conceivable that the ML models constructed using electronic medical records can successfully explain the factors that affect the increased risk of AKI reported in various clinical studies to date.
In the LLR model, four product terms were significantly associated with increased risk of AKI. However, of these product terms, since three included a drug class with an adjusted OR <1 (e.g., NSAIDs and cephalosporins), RERI could not be calculated, suggesting that these three combinations are unlikely to have an interaction for the risk of AKI. In the XGB model, two product terms were identified as relatively important risk factors for AKI: loop diuretics * H2 blockers and cephalosporins * proton pump inhibitors. Although the product term of cephalosporins and proton pump inhibitors tended to be associated with increased risk of AKI, the individual effects of cephalosporins were suggested to reduce the risk, contrary to the product term. Therefore, this combination may not have an interaction for the risk of AKI. The product term of loop diuretics and H2 blockers was identified as an important predictor in both the XGB and LLR models, and the latter model suggested that concomitant use of these drug classes has a potential drug-drug interaction for AKI. Furthermore, the individual and combined effects of these drug classes on the risk of AKI were robust in the sensitivity analyses. To our knowledge, no clinical studies have evaluated the association between H2 blockers and AKI in a large population, but Fisher et al. have summarized more than 20 case reports of H2 blocker-induced AIN (Fisher and Le Couteur, 2001). Since drug-induced AIN is a common cause of AKI (Perazella and Markowitz, 2010), it is not surprising that H2 blockers are one of the risk factors for AKI. According to the drug-drug interaction checker by DrugBank, the combination of loop diuretic and H2 blocker is suggested to have a drug-drug interaction that affects organic anion transporter 3 (OAT3), and its severity is moderate. SCr is excreted into urine through renal drug transporters such as OAT2, organic cation transporter 2 (OCT2), OCT3, multidrug and toxin extrusion protein 1 (MATE1), and MATE2-K (Nakada et al., 2019). Loop diuretics including furosemide and torasemide are known to be human OAT1 (hOAT1), hOAT3, and hOAT4 inhibitors (Vormfelde et al., 2006; Jeong et al., 2015; Gharibkandi et al., 2022), and it has been reported that uptake of H2 blockers such as famotidine and cimetidine into hOAT3-expressing cells decreases in the presence of an hOAT3 inhibitor (Tahara et al., 2005). That is, concomitant use of loop diuretics, which are OAT inhibitors, with H2 blockers may increase the concentration of H2 blockers in the blood. H2 blockers including famotidine, cimetidine, and nizatidine are known as in vitro OAT2-, OCT2-, OCT3-, MATE1-, and MATE2-K-inhibitors, and these drugs increase SCr in healthy subjects (Nakada et al., 2019). For these reasons, we speculate that loop diuretics reduce renal excretion of H2 blockers, and then OATs and OCTs expressed at the basolateral membrane of proximal tubule cells of the human kidney are inhibited by these drugs, resulting in elevated SCr. Therefore, although the relative importance of the individual and combined effects of loop diuretics and H2 blockers in the XGB model was lower than that of well-known risk factors such as older age, sex, and medical history, it was suggested that the interaction between loop diuretics and H2 blockers can increase the risk of AKI.
The present study has several limitations. First, there is a possibility of sampling bias because this study was a case-control study design using non-randomized data. Second, this study controlled potential confounding factors that were available and measurable, but failed to adjust for non-observed risk factors. For example, AKI is a common complication after cardiac surgery, and percutaneous coronary intervention is a known risk factor for AKI, and the incidence of cardiac surgery-induced AKI in Japanese patients is similar to that in other countries (Marenzi et al., 2013; Karrowni et al., 2016; Ikemura et al., 2020). However, no surgical information is recorded in NUSM’s CDW. As another example, acute physiologic assessment and chronic health evaluation (APACHE) Ⅱ, which is a scoring system for assessing the severity of ICU inpatients, is a risk factor for AKI in patients with severe sepsis (Chawla et al., 2007). Unfortunately, since there are no APACHE 2 scores recorded in our database, it is very difficult to adjust for APACHE II score as a covariate in this study. Finally, the database cannot access clinical information stored at other medical institutions. In this study, drug classes that were newly started within 1–7 days from the event date in the three hospitals were considered as suspected drug classes for AKI, but the drug classes may have been previously prescribed by another medical institution. However, the two ML models showed better predictive performance than the traditional statistical model, and the clear drug-drug interactions detected by interpreting these models may be useful for drug prescribing decision making.
Data availability statement
The raw data supporting the conclusion of this article will be made available by the authors, without undue reservation.
Ethics statement
The studies involving human participants were reviewed and approved by The Ethics Committee of the Nihon University School of Medicine. Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.
Author contributions
HA and SA contributed to the conception of the study. HA and TH performed data analysis. All authors were involved in the interpretation of the results. HA wrote the first version of the manuscript. All authors listed have made a substantial, direct, and intellectual contribution to the work and approved it for publication.
Funding
This research was supported by the Ministry of Education, Culture, Sports, Sciences and Technology (MEXT) of Japanese government and the Japan Agency for Medical Research and Development (AMED) under grant numbers JP18km0605001 and JP223fa627011, and by JSPS KAKENHI grant number JP22K15347.
Acknowledgments
We would like to express special thanks to 4DIN Ltd. (Tokyo, Japan) and Phenogen Medical Corporation (Tokyo, Japan) for financial support. Both companies had no role in research design, analysis, data collection, interpretation of data, or review of the manuscript, and no honoraria or payments were made for authorship.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fphar.2023.1176096/full#supplementary-material
References
Bird, S. T., Etminan, M., Brophy, J. M., Hartzema, A. G., and Delaney, J. A. (2013). Risk of acute kidney injury associated with the use of fluoroquinolones. CMAJ 185, E475–E482. doi:10.1503/cmaj.121730
Camin, R. M., Cols, M., Chevarria, J. L., Osuna, R. G., Carreras, M., Lisbona, J. M., et al. (2015). Acute kidney injury secondary to a combination of renin-angiotensin system inhibitors, diuretics and NSAIDS: "the triple whammy. Nefrologia 35, 197–206. doi:10.1016/j.nefro.2015.05.021
Chawla, L. S., Seneff, M. G., Nelson, D. R., Williams, M., Levy, H., Kimmel, P. L., et al. (2007). Elevated plasma concentrations of IL-6 and elevated Apache II score predict acute kidney injury in patients with severe sepsis. Clin. J. Am. Soc. Nephrol. 2, 22–30. doi:10.2215/CJN.02510706
Cullaro, G., Kanduri, S. R., and Velez, J. C. Q. (2022). Acute kidney injury in patients with liver disease. Clin. J. Am. Soc. Nephrol. 17, 1674–1684. doi:10.2215/CJN.03040322
Drożdżal, S., Lechowicz, K., Szostak, B., Rosik, J., Kotfis, K., Machoy-Mokrzyńska, A., et al. (2021). Kidney damage from nonsteroidal anti-inflammatory drugs - myth or truth? Review of selected literature. Pharmacol. Res. Perspect. 9, e00817. doi:10.1002/prp2.817
Fisher, A. A., and Le Couteur, D. G. (2001). Nephrotoxicity and hepatotoxicity of histamine H2 receptor antagonists. Drug Saf. 24, 39–57. doi:10.2165/00002018-200124010-00004
Gandhi, S., Fleet, J. L., Bailey, D. G., McArthur, E., Wald, R., Rehman, F., et al. (2013). Calcium-channel blocker-clarithromycin drug interactions and acute kidney injury. JAMA 310, 2544–2553. doi:10.1001/jama.2013.282426
Gharibkandi, N. A., Molavipordanjani, S., Mardanshahi, A., and Hosseinimehr, S. J. (2022). The influence of kidneys ion transport inhibitors on the pharmacokinetic and tumor uptake behaviors of a HER2-targeted small size radiolabeled peptide. Curr. Drug Metab. 23, 82–87. doi:10.2174/1389200223666220113101004
Gray, M. P., Barreto, E. F., Schreier, D. J., Kellum, J. A., Suh, K., Kashani, K. B., et al. (2022). Consensus obtained for the nephrotoxic potential of 167 drugs in adult critically ill patients using a modified Delphi method. Drug Saf. 45, 389–398. doi:10.1007/s40264-022-01173-4
Gul, S., Kuscu, F., Aydemir, H., Ozturk, D. B., Deveci, O., Duygu, F., et al. (2016). Risk factors for colistin-associated acute kidney injury: A multicenter study from Turkey. Jpn. J. Infect. Dis. 69, 109–112. doi:10.7883/yoken.JJID.2014.501
Hu, C., Tan, Q., Zhang, Q., Li, Y., Wang, F., Zou, X., et al. (2022). Application of interpretable machine learning for early prediction of prognosis in acute kidney injury. Comput. Struct. Biotechnol. J. 20, 2861–2870. doi:10.1016/j.csbj.2022.06.003
Huang, W. C., Wang, M. T., Lai, T. S., Lee, K. H., Shao, S. C., Chen, C. H., et al. (2022). Nephrotoxins and acute kidney injury - the consensus of the Taiwan acute kidney injury Task Force. J. Formos. Med. Assoc. 121, 886–895. doi:10.1016/j.jfma.2021.12.007
Huang, Y., Li, W., Macheret, F., Gabriel, R. A., and Ohno-Machado, L. (2020). A tutorial on calibration measurements and calibration models for clinical prediction models. J. Am. Med. Inf. Assoc. 27, 621–633. doi:10.1093/jamia/ocz228
Ide, N., Sato, S., and Sawaguchi, K. (2019). Risk of acute kidney injury in patients treated with vancomycin and piperacillin/tazobactam compared to vancomycin and meropenem or doripenem: A retrospective cohort study. Yakugaku Zasshi 139, 1609–1614. doi:10.1248/yakushi.19-00137
Ikemura, N., Shiraishi, Y., Sawano, M., Ueda, I., Numasawa, Y., Noma, S., et al. (2020). Exploring triaging and short-term outcomes of early invasive strategy in non-ST segment elevation acute coronary syndrome: A report from Japanese multicenter registry. J. Clin. Med. 9, 1106. doi:10.3390/jcm9041106
Imai, S., Kadomura, S., Miyai, T., Kashiwagi, H., Sato, Y., Sugawara, M., et al. (2022). Using Japanese big data to investigate novel factors and their high-risk combinations that affect vancomycin-induced nephrotoxicity. Br. J. Clin. Pharmacol. 88, 3241–3255. doi:10.1111/bcp.15252
Inaba, I., Kondo, Y., Iwasaki, S., Tsuruhashi, S., Akaishi, A., Morita, K., et al. (2019). Risk evaluation for acute kidney injury induced by the concomitant use of valacyclovir, analgesics, and renin-angiotensin system inhibitors: The detection of signals of drug-drug interactions. Front. Pharmacol. 10, 874. doi:10.3389/fphar.2019.00874
Jeong, H. U., Kwon, M., Lee, Y., Yoo, J. S., Shin, D. H., Song, I. S., et al. (2015). Organic anion transporter 3- and organic anion transporting polypeptides 1B1- and 1B3-mediated transport of catalposide. Drug Des. Devel Ther. 9, 643–653. doi:10.2147/DDDT.S75400
Jiang, M., Pan, C. Q., Li, J., Xu, L. G., and Li, C. L. (2023). Explainable machine learning model for predicting furosemide responsiveness in patients with oliguric acute kidney injury. Ren. Fail 45, 2151468. doi:10.1080/0886022X.2022.2151468
Jung, K., Lee, J., Gupta, V., and Cho, G. (2019). Comparison of bootstrap confidence interval methods for GSCA using a Monte Carlo simulation. Front. Psychol. 10, 2215. doi:10.3389/fpsyg.2019.02215
Karrowni, W., Vora, A. N., Dai, D., Wojdyla, D., Dakik, H., and Rao, S. V. (2016). Blood transfusion and the risk of acute kidney injury among patients with acute coronary syndrome undergoing percutaneous coronary intervention. Circ. Cardiovasc Interv. 9, e003279. doi:10.1161/CIRCINTERVENTIONS.115.003279
Khalili, H., Bairami, S., and Kargar, M. (2013). Antibiotics induced acute kidney injury: Incidence, risk factors, onset time and outcome. Acta Med. Iran. 51, 871–878.
Knol, M. J., van der Tweel, I., Grobbee, D. E., Numans, M. E., and Geerlings, M. I. (2007). Estimating interaction on an additive scale between continuous determinants in a logistic regression model. Int. J. Epidemiol. 36, 1111–1118. doi:10.1093/ije/dym157
Knol, M. J., and VanderWeele, T. J. (2012). Recommendations for presenting analyses of effect modification and interaction. Int. J. Epidemiol. 41, 514–520. doi:10.1093/ije/dyr218
Kunitsu, Y., Hira, D., Morikochi, A., Ueda, T., Isono, T., Morita, S. Y., et al. (2022). Time until onset of acute kidney injury by combination therapy with "Triple Whammy" drugs obtained from Japanese Adverse Drug Event Report database. PLoS One 17, e0263682. doi:10.1371/journal.pone.0263682
Kunitsu, Y., Isono, T., Hira, D., and Terada, T. (2019). Chronic effects on kidney function by "triple whammy" (combination of renin and angiotensin type inhibitor, diuretic drug and nonsteroidal anti-inflammatory drug). Yakugaku Zasshi 139, 1457–1462. doi:10.1248/yakushi.19-00096
Lapi, F., Azoulay, L., Yin, H., Nessim, S. J., and Suissa, S. (2013). Concurrent use of diuretics, angiotensin converting enzyme inhibitors, and angiotensin receptor blockers with non-steroidal anti-inflammatory drugs and risk of acute kidney injury: Nested case-control study. BMJ 346, e8525. doi:10.1136/bmj.e8525
Liu, K., Zhang, Y., Xu, X., Wu, B., Ni, J., Li, T., et al. (2021). Comparative prevalence of acute kidney injury in Chinese patients receiving vancomycin with concurrent β-lactam antibiotics: A retrospective cohort study. Clin. Ther. 43, e319–e351. doi:10.1016/j.clinthera.2021.08.008
Loboz, K. K., and Shenfield, G. M. (2005). Drug combinations and impaired renal function - the 'triple whammy. Br. J. Clin. Pharmacol. 59, 239–243. doi:10.1111/j.0306-5251.2004.2188.x
Marenzi, G., Cabiati, A., Bertoli, S. V., Assanelli, E., Marana, I., De Metrio, M., et al. (2013). Incidence and relevance of acute kidney injury in patients hospitalized with acute coronary syndromes. Am. J. Cardiol. 111, 816–822. doi:10.1016/j.amjcard.2012.11.046
Mehta, R. L., Awdishu, L., Davenport, A., Murray, P. T., Macedo, E., Cerda, J., et al. (2015). Phenotype standardization for drug-induced kidney disease. Kidney Int. 88, 226–234. doi:10.1038/ki.2015.115
Miano, T. A., Lautenbach, E., Wilson, F. P., Guo, W., Borovskiy, Y., and Hennessy, S. (2018). Attributable risk and time course of colistin-associated acute kidney injury. Clin. J. Am. Soc. Nephrol. 13, 542–550. doi:10.2215/CJN.06980717
Muriithi, A. K., Leung, N., Valeri, A. M., Cornell, L. D., Sethi, S., Fidler, M. E., et al. (2015). Clinical characteristics, causes and outcomes of acute interstitial nephritis in the elderly. Kidney Int. 87, 458–464. doi:10.1038/ki.2014.294
Nakada, T., Kudo, T., Kume, T., Kusuhara, H., and Ito, K. (2019). Estimation of changes in serum creatinine and creatinine clearance caused by renal transporter inhibition in healthy subjects. Drug Metab. Pharmacokinet. 34, 233–238. doi:10.1016/j.dmpk.2019.02.006
Nast, C. C. (2017). Medication-induced interstitial nephritis in the 21st century. Adv. Chronic Kidney Dis. 24, 72–79. doi:10.1053/j.ackd.2016.11.016
Neugarten, J., Golestaneh, L., and Kolhe, N. V. (2018). Sex differences in acute kidney injury requiring dialysis. BMC Nephrol. 19, 131. doi:10.1186/s12882-018-0937-y
Okada, N., Chuma, M., Azuma, M., Nakamura, S., Miki, H., Hamano, H., et al. (2019). Effect of serum concentration and concomitant drugs on vancomycin-induced acute kidney injury in haematologic patients: A single-centre retrospective study. Eur. J. Clin. Pharmacol. 75, 1695–1704. doi:10.1007/s00228-019-02756-4
Onoue, H., Koyama, T., Zamami, Y., Hagiya, H., Tatebe, Y., Mikami, N., et al. (2018). Trends in polypharmacy in Japan: A nationwide retrospective study. J. Am. Geriatr. Soc. 66, 2267–2273. doi:10.1111/jgs.15569
Ostermann, M., Bellomo, R., Burdmann, E. A., Doi, K., Endre, Z. H., Goldstein, S. L., et al. (2020). Controversies in acute kidney injury: Conclusions from a kidney disease: Improving global outcomes (KDIGO) conference. Kidney Int. 98, 294–309. doi:10.1016/j.kint.2020.04.020
Peng, X., Li, L., Wang, X., and Zhang, H. (2022). A machine learning-based prediction model for acute kidney injury in patients with congestive heart failure. Front. Cardiovasc Med. 9, 842873. doi:10.3389/fcvm.2022.842873
Perazella, M. A., and Markowitz, G. S. (2010). Drug-induced acute interstitial nephritis. Nat. Rev. Nephrol. 6, 461–470. doi:10.1038/nrneph.2010.71
Pierson-Marchandise, M., Gras, V., Moragny, J., Micallef, J., Gaboriau, L., Picard, S., et al. (2017). The drugs that mostly frequently induce acute kidney injury: A case-noncase study of a pharmacovigilance database. Br. J. Clin. Pharmacol. 83, 1341–1349. doi:10.1111/bcp.13216
Poston, J. T., and Koyner, J. L. (2019). Sepsis associated acute kidney injury. BMJ 364, k4891. doi:10.1136/bmj.k4891
Salerno, S. N., Liao, Y., Jackson, W., Greenberg, R. G., McKinzie, C. J., McCallister, A., et al. (2021). Association between nephrotoxic drug combinations and acute kidney injury in the neonatal intensive care unit. J. Pediatr. 228, 213–219. doi:10.1016/j.jpeds.2020.08.035
Song, X., Liu, X., Liu, F., and Wang, C. (2021). Comparison of machine learning and logistic regression models in predicting acute kidney injury: A systematic review and meta-analysis. Int. J. Med. Inf. 151, 104484. doi:10.1016/j.ijmedinf.2021.104484
Spence, J. D., Grosser, T., and FitzGerald, G. A. (2022). Acetaminophen, nonsteroidal anti-inflammatory drugs, and hypertension. Hypertension 79, 1922–1926. doi:10.1161/HYPERTENSIONAHA.122.19315
Tahara, H., Kusuhara, H., Endou, H., Koepsell, H., Imaoka, T., Fuse, E., et al. (2005). A species difference in the transport activities of H2 receptor antagonists by rat and human renal organic anion and cation transporters. J. Pharmacol. Exp. Ther. 315, 337–345. doi:10.1124/jpet.105.088104
Thomas, M. C. (2000). Diuretics, ACE inhibitors and NSAIDs-the triple whammy. Med. J. Aust. 172, 184–185. doi:10.5694/j.1326-5377.2000.tb125548.x
Tsugane, S. (2021). Why has Japan become the world's most long-lived country: Insights from a food and nutrition perspective. Eur. J. Clin. Nutr. 75, 921–928. doi:10.1038/s41430-020-0677-5
Usui, J., Yamagata, K., Imai, E., Okuyama, H., Kajiyama, H., Kanamori, H., et al. (2016). Clinical practice guideline for drug-induced kidney injury in Japan 2016: Digest version. Clin. Exp. Nephrol. 20, 827–831. doi:10.1007/s10157-016-1334-0
Van Calster, B., McLernon, D. J., van Smeden, M., Wynants, L., and Steyerberg, E. W. (2019). Calibration: The achilles heel of predictive analytics. BMC Med. 17, 230. doi:10.1186/s12916-019-1466-7
Vormfelde, S. V., Schirmer, M., Hagos, Y., Toliat, M. R., Engelhardt, S., Meineke, I., et al. (2006). Torsemide renal clearance and genetic variation in luminal and basolateral organic anion transporters. Br. J. Clin. Pharmacol. 62, 323–335. doi:10.1111/j.1365-2125.2006.02655.x
Wu, B., Luo, M., Wu, F., He, Z., Li, Y., and Xu, T. (2022). Acute kidney injury associated with remdesivir: A comprehensive pharmacovigilance analysis of COVID-19 reports in FAERS. Front. Pharmacol. 13, 692828. doi:10.3389/fphar.2022.692828
Xu, L., Wu, Y., Chen, Y., Li, R., Wang, Z., Li, Z., et al. (2021). Is acute kidney injury age-dependent in older adults: An observational study in two centers from north China. BMC Geriatr. 21, 7. doi:10.1186/s12877-020-01906-z
Yu, C., Guo, D., Yao, C., Yang, H., Liu, S., Zhu, Y., et al. (2020). Clinical characteristics of hospitalized patients with drug-induced acute kidney injury and associated risk factors: A case-control study. Biomed. Res. Int. 2020, 9742754. doi:10.1155/2020/9742754
Yue, S., Li, S., Huang, X., Liu, J., Hou, X., Zhao, Y., et al. (2022). Machine learning for the prediction of acute kidney injury in patients with sepsis. J. Transl. Med. 20, 215. doi:10.1186/s12967-022-03364-0
Keywords: drug-drug interaction (DDI), machine learning, artificial inteligence, relative excess risk due to interaction, nephrotoxic drugs, acute kidney injury
Citation: Akimoto H, Hayakawa T, Nagashima T, Minagawa K, Takahashi Y and Asai S (2023) Detection of potential drug-drug interactions for risk of acute kidney injury: a population-based case-control study using interpretable machine-learning models. Front. Pharmacol. 14:1176096. doi: 10.3389/fphar.2023.1176096
Received: 28 February 2023; Accepted: 09 May 2023;
Published: 23 May 2023.
Edited by:
Eugene Van Puijenbroek, Netherlands Pharmacovigilance Centre Lareb, NetherlandsReviewed by:
Hongjian Ji, Jiangsu Vocational College of Medicine, ChinaDaisuke Kobayashi, Josai University, Japan
Copyright © 2023 Akimoto, Hayakawa, Nagashima, Minagawa, Takahashi and Asai. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Hayato Akimoto, akimoto.hayato@nihon-u.ac.jp