Skip to main content

SYSTEMATIC REVIEW article

Front. Med., 06 January 2022
Sec. Nephrology
This article is part of the Research Topic The Kidney in Auto-Immune and Auto-Inflammatory Processes: Definitions, Mechanisms, and Biomarkers View all 17 articles

Meta-Analytical Accuracy of ANCA Renal Risk Score for Prediction of Renal Outcome in Patients With ANCA-Associated Glomerulonephritis

\nMengdi Xia&#x;Mengdi Xia1Ruiran Yu&#x;Ruiran Yu2Zaiqiong ZhengZaiqiong Zheng1Huan LiHuan Li1Jie FengJie Feng1Xisheng Xie
Xisheng Xie1*Dongming Chen
Dongming Chen3*
  • 1Nanchong Key Laboratory of Basic Science and Clinical Research on Chronic Kidney Disease, Department of Nephrology, The Second Clinical Medical Institution of North Sichuan Medical College (Nanchong Central Hospital), Nanchong, China
  • 2Department of Oncology, Anqing First People's Hospital of Anhui Medical University, Anqing, China
  • 3Department of Neurosurgery, The First Affiliated Hospital of Anhui University of Traditional Chinese Medicine, Hefei, China

Background: To evaluate the diagnostic accuracy of antineutrophil cytoplasmic antibody (ANCA) renal risk score (ARRS) for prediction of renal outcome in patients with ANCA-associated glomerulonephritis (ANCA-GN).

Methods: We searched PubMed, EMBASE, Ovid, Web of Science, the Cochrane Library, and ClinicalTrials.gov for studies, which used ARRS to predict end-stage renal disease (ESRD) in patients with ANCA-GN. Two reviewers independently screened articles for inclusion, assessed the quality of studies with both an adapted Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) tool. We calculated the combined patients with ESRD in the ARRS categories and presented the summary and individual estimates based on the ARRS categories. Then, the sensitivity, specificity, diagnostic odds ratio (DOR), positive/negative likelihood ratio, and the area under the receiver operating characteristic (AUROC) curves of the pooled data for ARRS were used to assess the accuracy of the “above the low-risk threshold” (ARRS ≥ 2) and “high-risk grade” (ARRS ≥ 8) for renal outcome of patients with ANCA-GN. The hierarchical summary ROC (HSROC) was used to verify the accuracy value. The clinical utility of ARRS was evaluated by the Fagan plot. Heterogeneity was explored using meta-regression and subgroup analysis.

Results: A total of 12 distinct cohorts from 11 articles involving 1,568 patients with ANCA-GN were analyzed. The cumulative patients with ESRD at the maximum follow-up of 60 months was 5% (95% CI: 0.02–0.07; p < 0.001) for ANCA-GN with low ARRS (0–1 points) and significantly increased to 22% (95% CI: 0.15–0.29; p < 0.001) medium ARRS (2–7 points). The combined cumulative patients with ESRD was 59% (95% CI: 0.49–0.69; p < 0.001) high ARRS (8–11 points). The pooled sensitivity of ARRS ≥ 2 in predicting ESRD was 98% with a specificity of 30% and a DOR of 15.08 and the mean AUROC value was 0.82. The pooled sensitivity of ARRS ≥ 8 in predicting ESRD was 58% with a specificity of 86% and a DOR of 7.59. The meta-regression and subgroup analysis indicated that variation in the geographic regions, study design, index risk, follow-up time, age of patient, publication year, and number of patient could be the potential sources of heterogeneity in the diagnosis of ARRS ≥ 8.

Conclusion: This meta-analysis emphasized the good performance of the ARRS score in predicting the renal outcome in patients with ANCA-GN. However, these findings should be verified by future large-scale prospective studies.

Introduction

Antineutrophil cytoplasmic antibody (ANCA)-associated vasculitis (AAV) is a group of life-threatening systemic autoimmune diseases characterized by inflammation, which included granulomatous polyangiitis (GPA), microscopic polyangiitis (MPA), eosinophilic granulomatous polyangiitis (EGPA), and renal-limited vasculitis (RLV) (1). Renal involvement of AAV, which is called ANCA-associated glomerulonephritis (ANCA-GN), occurs in more than 75% of patients with AAV (2, 3), presenting as a pauci-immune necrotizing crescentic ANCA-GN on renal biopsy sample histology and likely to be further developed as end-stage renal disease (ESRD) (4). Renal survival is closely related to prognosis and outcome of patient (5), so identification of the predictive factors for renal survival and outcome in patients with ANCA-GN is very important.

Renal biopsy is a well-established diagnostic modality for the diagnosis of kidney diseases and assessment of activity in ANCA-GN, but the predictive value of renal outcome of ANCA-GN is still controversial (6). In 2010, an international working group of renal pathologists published a histological classification for ANCA-GN based on kidney biopsy. This classification divided patients to four subgroups: focal (>50% normal glomeruli), crescentic (>50% cellular crescents), sclerotic (>50% sclerotic glomeruli), and mixed (any other combination) and the probability of progressing to ESRD increased in ascending order of focal, crescentic, mixed, and sclerotic (7). Some studies have validated that this classification system can reflect the severity of the initial kidney involvement and independently predict the renal outcome (810), but lack the influence of clinical factors and interstitial fibrosis (IF) on the prognosis of renal survival.

In the recent years, Brix et al. proposed a validated and predictive tool for ANCA-associated renal vasculitis to estimate the renal survival at baseline, called ANCA renal risk score (ARRS) (11). It is a scoring system that consists of histopathological findings (including the percentage of normal glomeruli, tubular atrophy/interstitial fibrosis) and baseline estimated glomerular filtration rate (eGFR), which ranges from 0 to 11 and three risk groups, from low (0–1 points), medium (2–7 points), and high (8–11 points) probability of ESRD.

The RRS has been validated in several studies among patients with ANCA-GN, though its comprehensive predictive value needs to be confirmed. Therefore, the objective of this systematic review and meta-analysis was to identify and determine the accuracy of ARRS to predict ESRD with patients with ANCA-GN in the baseline.

Methods

Search Strategy

The structure of this systematic review conformed to the recommendations from the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement (www.prisma-statement.org) (12) and the “Cochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy” was for reviews of diagnostic accuracy (13). The protocol for this systematic review was registered in the International Prospective Register of Systematic Reviews (PROSPERO) database, (Registered No. CRD42021254072).

We performed a systematic search in PubMed, EMBASE, Ovid, Web of Science, the Cochrane Library, and ClinicalTrials.gov from their inception to June 30, 2021. The term was used for (“antineutrophil cytoplasmic antibody” or “ANCA”) and (“ARRS” or “RRS” or “ANCA renal risk score” or “renal risk score”). We did not impose any filter with respect to text availability and there is no restriction placed on language or publication status.

Eligibility Criteria

The criteria for inclusion of a study in the meta-analysis were as follows: (1) Full-text articles, which investigated the predictive value of ARRS for ESRD in patients with ANCA-GN; (2) original research articles that were written in English; (3) prospective or retrospective studies; and (4) provided sufficient data to calculate the true positive (TP), false positive (FP), true negative (TN), and false negative (FN). We excluded the following studies: (1) meeting abstracts and review articles; (2) case series, case reports, editorials, or letters to the editor that did not include complete data; and (3) lack of adequate information to accurately calculate the test estimates. If there were duplicate publications, we included the most complete version or the article with the highest number of subjects.

Data Extraction

The included articles will be selected by two independent reviewers (M Xia and D Chen). First, both will review titles and abstracts; second, they will cross-check all the information and disagreements were resolved through consensus. All the extracted data were independently verified by a third investigator (D Chen). From each included study report, we identified the first author, publication year, country, study design, sample size, percentage of male fetuses, follow-up duration, characteristics of included patients (age, histologic class, clinical diagnosis, and antibody subtype), and the number of patients with ANCA-GN who became ESRD. We also extracted data on the index test (including TP, FP, TN, and FN results), accuracy estimates, and data for 2 × 2 tables.

Quality Assessment

Risk of bias and concerns about applicability was assessed by two authors (M Xia and R Yu) with the Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) tool (14).

Data Synthesis

The primary outcome of this systematic review was renal outcome, which we defined as the number of patients with ANCA-GN who became ESRD. The ARRS score was stratified into three categories and we calculated the combined patients with ESRD in the ARRS categories. Summary and individual estimates (proportion of patients with ESRD) were presented graphically with the 95% CIs by a forest plot based on the ARRS categories. We also conducted a diagnostic meta-analysis of the studies that met the criteria and had been screened. Calculate the Spearman's correlation coefficient p between the TP rate and the FP rate and analyze whether there is a threshold effect. If there was no significant threshold effect, the diagnostic accuracy was estimated by pooled statistics. We used summary receiver operating characteristic (SROC) plots to present the results of each study in ROC space, with each study plotted as a single sensitivity specificity point. This produced an SROC curve, with a summary operating point (showing summary sensitivity and specificity values), a summary area under the curve (AUC) value, 95% confidence region, and 95% prediction region. We obtained summary accuracy estimates for the sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), diagnostic odds ratio (DOR), and the AUC value and used hierarchical summary ROCs (HSROC) to verify the accuracy value. Using Fagan plot analysis, the post-test probability was calculated under the assumption that the pretest probability was 25, 50, and 75%, respectively. PLR is the ratio of the likelihood of ESRD in those with a positive test vs. those with a negative test. A PLR above 1 indicates increased evidence of ESRD; the farther higher from 1, the more chance of ESRD. NLR is the ratio of the likelihood of ESRD in those with a negative test vs. those with a positive test. NLR below 0.1 is very strong evidence to rule out an ESRD. DOR is the quotient between PLR and NLR. DOR can be calculated as the ratio of the odds of positivity in an ESRD relative to the odds of positivity in the non-ESRD, with higher values, indicating better discriminatory test performance.

Investigation of Heterogeneity

Heterogeneity among included studies was evaluated using the I2 and Q-statistic and p < 0.10 was considered to show significant heterogeneity, I2 values of 0–40, 40–70, and 70–100% indicate low, moderate, and high heterogeneity, respectively (15). A fixed-effects model was applied when I2 < 50%, while a random-effects model was applied when I2 > 50% (16, 17). In the diagnostic meta-analysis, if I2 > 50% and/or p < 0.05 was found, considerable heterogeneity was considered, and in this case, sources of heterogeneity were explored by a subsequent subgroup analysis to identify the potential covariates. Deeks' funnel plot was applied to examine the potential publication bias caused by the asymmetry of the tests. Meta-regression analysis was performed for studies included in the meta-analysis and explored possible sources of heterogeneity (18). We planned to investigate any significant findings on meta-regression using subgroup analyses. Sensitivity analysis was performed to identify the influence of an individual study on pooled estimates by removing one study at a time (17).

Statistical Analysis

Risk of bias was assessed using the Review Manager version 5.3 (RevMan version 5.3, Copenhagen; The Nordic Cochrane Center, The Cochrane Collaboration, 2014), threshold effect was tested by the Meta-Disc software (version 1.4, Clinical Biostatistics, Ramony Cajal Hospital, Madrid, Spain), and other analysis was conducted on the Stata software (version 14.0, StataCorp, College Station TX).

Results

Search Results

Selection process is given in Figure 1. Of the 141 articles searched, 111 articles were excluded due to duplication (n = 40) and irrelevance (n = 71) following title and abstract screening. The remaining 30 potentially eligible reports were further evaluated. After excluding the articles with irrelevant contents and articles with no full-text and insufficient data, we included 12 distinct cohorts from 11 articles (11, 1928) in the meta-analysis.

FIGURE 1
www.frontiersin.org

Figure 1. The preferred reporting items for systematic reviews and meta-analyses (PRISMA) flow diagram of this study.

Study Characteristics

These 12 studies involving 1,568 patients with ANCA-GN were performed in different geographic regions including Europe (n = 6), Asia (n = 3), North America (n = 1), Africa (n = 1), and multicenter (n = 1). There was only one prospective cohort and the rest were retrospective cohorts. All the 12 cohort studies of 11 articles evaluated the ARRS score for more than 3 years incidence of ESRD in patients with ANCA-GN. In 12 studies, nine studies described the histologic class of patients. Six studies classified clinical diagnostic subtypes and nine studies detailed antibody subtypes. In these studies, the grading for renal risk was assessed by the ARRS based on the data obtained from baseline estimated glomerular filtration rate (eGFR), the percentage of normal glomeruli, and tubular atrophy/interstitial fibrosis of renal biopsy, as shown in Table 1.

TABLE 1
www.frontiersin.org

Table 1. Base characteristics of included studies.

Quality Assessment

Quality assessments using the QUADAS-2 criteria are shown in Figure 2. One study was assessed as “high risk” for index test and one study was assessed for flow and timing in the risk of bias. Some studies were estimated as “suboptimal” for unclear risk in the following domains: selection of patient, index test, flow and timing in the risk of bias and selection of patient, index test, and reference standard in the applicability concerns. Most of the studies were identified as having low risk of bias for reference standard in the risk of bias.

FIGURE 2
www.frontiersin.org

Figure 2. Quality assessment of the included studies.

Cumulative ESRD on ARRS Classification

We identified 12 published cohort studies that reported the cumulative patients with ESRD in three ARRS grades. The cumulative patients with ESRD at the maximum follow-up of 60 months was 5% (95% CI: 0.02–0.07; p < 0.001) with low heterogeneity (I2 = 0%, p = 0.958) for ANCA-GN with low ARRS (0–1 points) and significantly increased to 22% (95% CI: 0.15–0.29; p < 0.001) with high heterogeneity (I2 = 85.7%, p < 0.001) for ANCA-GN with medium ARRS (2–7 points) and the combined cumulative patients with ESRD was 59% (95% CI: 0.49–0.69; p < 0.001) with high heterogeneity (I2 = 77.4%, p < 0.001) for ANCA-GN with high ARRS (8–11 points), as shown in Figure 3.

FIGURE 3
www.frontiersin.org

Figure 3. Forest plot displaying the cumulative ESRD with 95% CIs, classified by ARRS scores: (A) ARRS scores 0–1; (B) ARRS scores 2–7; and (C) ARRS scores 8–11. ESRD, end-stage renal disease; ARRS, antineutrophil cytoplasmic antibody renal risk score.

Overall Predictive Accuracy of ARRS for ESRD

Table 2 shows that the pooled sensitivity of ARRS score ≥ 2 (above the low-risk threshold) across all the included studies was 0.98 (95% CI: 0.94–0.99, Figure 4A) and specificity was 0.30 (95% CI: 0.22–0.39, Figure 4A). The DOR for positive ESRD was 15.08 (95% CI: 8.87–25.63, Figure 5A), the pooled PLR was 1.42 (95% CI: 1.26–1.61, Figure 6A), the NLR was 0.13 (95% CI: 0.08–0.20, Figure 6B), and the AUC was 0.82 (95% CI: 0.78–0.85, Figure 7A).

TABLE 2
www.frontiersin.org

Table 2. Predictive accuracies of ARRS.

FIGURE 4
www.frontiersin.org

Figure 4. Forest plots of pooled sensitivity and specificity of ARRS ≥ 2 (A) and ARRS ≥ 8 and (B) for prediction ESRD. ESRD, end-stage renal disease; ARRS, antineutrophil cytoplasmic antibody renal risk score; FN, false negative; TN, true negative; FP, false positive; TP, true positive.

FIGURE 5
www.frontiersin.org

Figure 5. Forest plots of DOR of ARRS ≥ 2 (A) and ARRS ≥ 8 and (B) for prediction ESRD. ESRD, end-stage renal disease; ARRS, antineutrophil cytoplasmic antibody renal risk score; DOR, diagnostic odds ratio; FN, false negative; TN, true negative; FP, false positive; TP, true positive.

FIGURE 6
www.frontiersin.org

Figure 6. Forest plots of LR of ARRS for prediction ESRD. (A) PLR for ARRS ≥ 2; (B) NLR for ARRS ≥ 2; (C) PLR for ARRS ≥ 8; and (D) NLR for ARRS ≥ 8. ESRD, end-stage renal disease; ARRS, antineutrophil cytoplasmic antibody renal risk score; PLR, positive likelihood ratio; NLR, negative likelihood ratio.

FIGURE 7
www.frontiersin.org

Figure 7. SROC curve and HSROC curve of ARRS ≥ 2 (A) and ARRS ≥ 8 and (B) for prediction ESRD. ESRD, end-stage renal disease; ARRS, antineutrophil cytoplasmic antibody renal risk score; SROC, summary receiver operating characteristic; HSROC, hierarchical summary receiver operating characteristic.

The sensitivity of high-risk ARRS score ≥ 8 for prediction ESRD was 0.58 (95% CI: 0.51–0.65, Figure 4B) and the specificity was 0.86 (95% CI: 0.81–0.89, Figure 4B). The DOR for positive ESRD was 7.59 (95% CI: 5.82–9.90, Figure 5B), the pooled PLR was 3.81 (95% CI: 2.88–5.05, Figure 6C), the NLR was 0.51 (95% CI: 0.43–0.61, Figure 6D), and the AUC was 0.77 (95% CI: 0.73–0.80, Figure 7B). However, these estimates should be interpreted with caution, since considerable heterogeneity was observed in some results.

Corresponding curves from the HSROC model are given in Figure 7. The estimated value of beta was 0.41 (95% CI: −0.54 to 1.45), Z was 0.85, and p > 0.01 for ARRS score ≥ 8, which indicated the symmetrical of SROC curve. 1.84 (95% CI: 1.22–2.45) of lambda verified that the high-risk ARRS score has a high accuracy for predicting ESRD.

Clinical Utility of ARRS for ESRD

In suspected patients with ESRD with score ≥ 2, the Fagan plot analysis revealed the PLR and NLR of 1 and 0.08, respectively. Thus, in this group of patients with 25% pretest probability (based on clinical suspicion), a positive ESRD value revealed a 32% probability of correct diagnosis and a negative ESRD value revealed a 3% probability of wrong diagnosis (Figure 8A). When the pretest probability (based on clinical suspicion) was set to 50%, a positive ESRD value yielded 58% probability of correct diagnosis and a negative ESRD value yielded 8% probability of wrong diagnosis (Figure 8B). When the pretest probability (based on clinical suspicion) was set to 75%, a positive ESRD value showed 81% probability of correct diagnosis and a negative ESRD value showed 20% probability of wrong diagnosis (Figure 8C).

FIGURE 8
www.frontiersin.org

Figure 8. Fagan's nomogram of the post-test probability of ARRS prediction ESRD, based on (A) pretest probability = 25%; (B) pretest probability = 50%; (C) pretest probability = 75% in ARRS ≥ 2; (D) pretest probability = 25%; (E) pretest probability = 50%; (F) pretest probability = 75% in ARRS ≥ 8. ESRD, end-stage renal disease; ARRS, antineutrophil cytoplasmic antibody renal risk score.

In suspected patients with ESRD with scores 8–11, the Fagan plot analysis revealed the PLR and NLR of 4 and 0.49, respectively. Thus, in this subset of patients with 25% pretest probability (based on clinical suspicion), a positive ESRD value represented a 57% probability of correct diagnosis and a negative ESRD value indicated a 14% probability of wrong diagnosis (Figure 8D). When the pretest probability (based on clinical suspicion) was set to 50%, a positive ESRD value showed 80% probability of correct diagnosis and a negative ESRD value showed 33% probability of wrong diagnosis (Figure 8E). When the pretest probability (based on clinical suspicion) was set to 75%, a positive ESRD value showed 92% probability of correct diagnosis and a negative ESRD value showed 60% probability of wrong diagnosis (Figure 8F).

Threshold Effect

Calculate the Spearman's correlation coefficient p between the sensitivity logarithm and the (1-specificity) logarithm and the p of score ≥ 2 and score ≥ 8, the values were 0.389 (p = 0.212) and 0.308 (p = 0.331), respectively. p > 0.05 indicated that there was no threshold effect.

Meta-Regression and Subgroup Analysis

Overall, result of specificity showed significant heterogeneity; we explored the potential sources of heterogeneity from the region (Europe vs. non-Europe), study design (prospective vs. retrospective), index risk (low risk vs. non-low risk), follow-up (<36 vs. ≥36 months), age of patient (<65 vs. ≥65 years), publication year (<2021 vs. ≥2021), and number of patient (<100 vs. ≥100). The meta-regression analyses showed that all of these values were associated with greater heterogeneity in specificity among ARRS score ≥8 (except for age of patient), as shown in Figure 9.

FIGURE 9
www.frontiersin.org

Figure 9. Meta-regression analysis examining heterogeneity.

Table 3 also shows the results of the subgroup analyses. In subgroup analyses, the predictive performance of ARRS was approximately consistent across the multiple subgroups.

TABLE 3
www.frontiersin.org

Table 3. Analysis of subgroups.

Sensitivity Analysis

The sensitivity analysis was performed by reducing one article each time to evaluate the impact of a single study on this meta-analysis. Sensitivity analyses for the proportion of patients with ESRD and the result showed that removing single studies that did not have any significant impact on the final outcome. The combined DOR after each elimination had not changed significantly, showing that the results of this analysis are not excessively dependent on a certain study and the conclusion is stable.

Publication Bias

Based on the Deeks' Funnel plot, publication bias was also not detected in the studies where ESRD was used to detect ARRS score ≥ 2 (p = 0.25, Figure 10A) and ARRS score ≥ 8 (p = 0.78, Figure 10B).

FIGURE 10
www.frontiersin.org

Figure 10. Estimation of the publication bias by Deeks' funnel plots. (A) Analysis on the publications concerning ARRS ≥ 2 and (B) Analysis on the publications concerning ARRS ≥ 8. ARRS, antineutrophil cytoplasmic antibody renal risk score; ESS, effective sample size.

Discussion

Associated vasculitis has a high proportion of kidney injury (29). Despite current therapy improving the prognosis of patients, ANCA-GN still results in a rapid or gradual deterioration in renal function (30). ESRD caused by kidney involvement is an important adverse prognostic factor and is associated with high mortality (1, 31). In the past few decades, scholars have tried to specify the characteristics of renal involvement to determine the factors that affect the prognosis of the kidney (32, 33) and have recently developed an ARRS scoring system for predicting renal outcome.

To the best of our knowledge, this is the first systematic review and meta-analysis to report the renal outcome prediction in patients with ANCA-GN using ARRS. Our results confirmed that the pooled incidence rate of ESRD was 4, 22, and 58% in the low-, medium-, and high-risk groups, respectively. It means that patients with the higher ARRS score had a higher probability of suffering ESRD in the next 3–5 years and who had low-risk grade (ARRS score of 0) should be informed about the low possibility of suffering ESRD; this was consistent with previous validation studies. In the meta-analysis of diagnostic tests part, the diagnostic performance of ARRS in different risk grades of ESRD was evaluated in patients with ANCA-GN. Our data revealed that the AUROC of ARRS exhibited a fair diagnostic value for predicting ESRD in ARRS both for ≥ 2 and ≥ 8. Through pooled sensitivity and specificity, it was revealed that ARRS ≥ 2 had a high sensitivity of identifying the potential ESRD and ARRS ≥ 8 had a high accurate predictability of ESRD in patients with ANCA-GN. Fagan plot analysis showed that ARRS ≥ 2 had a low negative LR and wrong diagnosis rate when predicting ESRD, thus reflecting that when ARRS < 2, few developed ESRD, laterally reflecting the good performance of ARRS < 2 (low-risk class) in detecting renal survival. This analysis also set the good predictive value of ARRS ≥ 8 (high-risk grade) for ESRD.

The present scoring system has an advantage of high sensitivity to potential patients with ESRD above the low-risk threshold and high positive predictive value in the high-risk grade of ESRD and these advantages were thought to come from the characteristics of the composition. Kidney biopsy, the “gold standard” in the diagnosis of kidney disease, was reported as a predictor of kidney prognosis in patients with ANCA-GN in 1999. Bajema et al. (34) performed an observational cohort study in biopsies from 157 patients with clinically and histologically confirmed ANCA-GN. Results indicated that the proportion of normal glomeruli in initial renal biopsy is an excellent predictor of renal function in patients with ANCA-GN. They also proposed that the only active lesion that predicts renal function is from the interstitium. The number of diffuse interstitial infiltrates correlated with serum creatinine values at enrollment and during follow-up. Subsequently. Berden et al. (7) proposed a classical histopathological classification based on renal biopsy. They studied 100 biopsies with ANCA-GN, lesions were classified according to their predominant glomerular state, and diagnosed from March, 1995 to September, 2002. This validation study showed focal type, with more than 50% of common glomeruli, has relatively the most intact renal function with better renal outcome. The sclerosing type, with more than 50% sclerosing glomeruli, has a high risk of irreversible severe renal impairment and death at the 1-year follow-up period. In the meantime, the predictive role of the renal interstitium for renal outcome has been repeatedly mentioned. Studies have revealed that the presence of diffuse interstitial fibrosis and high tubular atrophy predicted impaired renal function for patients with ANCA-GN during follow-up and tubular atrophy was important predictors of recovery of renal function and renal outcome, independent of initial renal function (35, 36). The third component of ARRS is the initial eGFR. A European multicenter prospective study confirmed that patients with ANCA-GN with GFR < 50 ml/min/1.73 m2 had a 50% chance of developing ESRD (37) and other data from China also suggested that patients with ANCA-GN with serum creatinine (SCr) levels ≥ 4 mg/dl have a nearly three-fold increased risk of ESRD (38). In addition, severe insufficiency of baseline renal function affects the outcome of subsequent AAV treatment. It has been established that patients with severe renal dysfunction were less likely to respond to treatment, have an increased risk of adverse immunotherapy reactions, and an increased risk of ESRD compared to those with preserved renal function (39).

In the diagnostic meta-analysis section, we observed that the heterogeneity between studies was more pronounced in pooled specificity. Meta-regression analyses indicated that region, study design, index risk, age of patient, publication year, number of patient, and subject risk could be the source of heterogeneity. First of all, the ARRS scoring system was proposed in the recent years and the studies validated so far were more scattered and influenced by multiple variables such as geography and population. It can be found in subgroup analysis that heterogeneity can be reduced, but not completely eliminated when analyzed by a single variable. Furthermore, the composition of the scoring system itself may affect the results. It is known that renal outcomes are influenced not only by pathology and initial renal function, but also by multiple factors such as age, genetics, baseline proteinuria, ANCA serology, ANCA antibody subtypes, and treatment (6, 4043); although some studies have described a possible correlation between these factors and renal pathology histology and baseline renal function (33, 44, 45), the potential influence of these factors may also account for heterogeneity in including studies.

Limitations and Future Directions

Several limitations of this study should be noted. First, there was significant heterogeneity in the pooled specificity, which may affect its accuracy. We were able to identify some sources of heterogeneity through subgroup analysis and meta-regression analysis. Second, we were unable to adequately assess the associations between subgroups and other factors due to inadequate descriptions of some of the included studies. Third, the limited sample size of the included studies may also affect data interpretation. Therefore, the generalizability of our findings needs further confirmation. Fourth, several included studies were not provided the description of remission induction and maintenance regimens. We, therefore, did not explore the potential influence of remission induction and maintenance regimens on the outcomes of ESRD; however, future studies should explore this issue.

Conclusion

In summary, this study emphasized the merits of ARRS having a predictive ability for ESRD events in ANCA-GN. This new grading system is associated with moderate to good diagnostic value for predicting ESRD in ANCA-GN and also predicts ESRD rates in different risk patients. Future large-scale prospective studies should be conducted to verify the accurate assessment of the diagnostic value of ARRS for predicting ESRD events that could result in screening high-risk individuals for preparing the renal replacement therapy in advance and assessing the survival prognosis.

Data Availability Statement

The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding authors.

Author Contributions

MX, RY, and DC developed the study question. MX and DC wrote the first draft of the manuscript. DC and XX critically read and revised the final version of the manuscript before submission. All the authors contributed to the development of the review protocol, search strategies, refining of the manuscript, and approved the final manuscript.

Funding

This study was supported by grant from the Nanchong School Science and Technology Strategic Cooperation Project (20SXQT0117) and the Sichuan Traditional Chinese Medicine Research Project (2020LC0146).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Acknowledgments

This study benefited from previous cohort studies. The author sincerely thanks all the relevant researchers for the data shared and published.

References

1. Barut K, Sahin S, Adroviç A, Kasapçopur Ö. Diagnostic approach and current treatment options in childhood vasculitis. Turk pediatri arsivi. (2015) 50:194–205. doi: 10.5152/TurkPediatriArs.2015.2363

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Geetha D, Jefferson JA. ANCA-associated vasculitis: core curriculum 2020. Am J Kidney Dis. (2020) 75:124–37. doi: 10.1053/j.ajkd.2019.04.031

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Chen M, Jayne DRW, Zhao MH. Complement in ANCA-associated vasculitis: mechanisms and implications for management. Nat Rev Nephrol. (2017) 13:359–67. doi: 10.1038/nrneph.2017.37

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Berti A, Cornec D, Crowson CS, Specks U, Matteson EL. The epidemiology of antineutrophil cytoplasmic autoantibody-associated vasculitis in Olmsted County, Minnesota: a twenty-year US population-based study. Arthritis Rheumatol. (2017) 69:2338–50. doi: 10.1002/art.40313

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Tumer NE, Clark WG, Tabor GJ, Hironaka CM, Fraley RT, Shah DM. The genes encoding the small subunit of ribulose-1,5-bisphosphate carboxylase are expressed differentially in petunia leaves. Nucleic Acids Res. (1986) 14:3325–42. doi: 10.1093/nar/14.8.3325

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Ge Y, Yang G, Yu X, Sun B, Zhang B, Yuan Y, et al. Outcome predictors of biopsy-proven myeloperoxidase-anti-neutrophil cytoplasmic antibody-associated glomerulonephritis. Front Immunol. (2020) 11:607261. doi: 10.3389/fimmu.2020.607261

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Berden AE, Ferrario F, Hagen EC, Jayne DR, Jennette JC, Joh K, et al. Histopathologic classification of ANCA-associated glomerulonephritis. J Am Soc Nephrol. (2010) 21:1628–36. doi: 10.1681/asn.2010050477

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Quintana LF, Peréz NS, De Sousa E, Rodas LM, Griffiths MH, Solé M, et al. ANCA serotype and histopathological classification for the prediction of renal outcome in ANCA-associated glomerulonephritis. Nephrology. (2014) 29:1764–9. doi: 10.1093/ndt/gfu084

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Solbakken V, Fismen AS, Bostad L, Bjørneklett R. Impact of proteinase 3 versus myeloperoxidase positivity on risk of end-stage renal disease in ANCA-associated glomerulonephritis stratified by histological classification: a population-based cohort study. Dis Markers. (2018) 2018:3251517. doi: 10.1155/2018/3251517

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Bjørneklett R, Bostad L, Fismen AS. Prognosis and histological classification in elderly patients with ANCA-glomerulonephritis: a registry-based cohort study. Biomed Res Int. (2018) 2018:7581567. doi: 10.1155/2018/7581567

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Brix SR, Noriega M, Tennstedt P, Vettorazzi E, Busch M, Nitschke M, et al. Development and validation of a renal risk score in ANCA-associated glomerulonephritis. Kidney Int. (2018) 94:1177–88. doi: 10.1016/j.kint.2018.07.020

PubMed Abstract | CrossRef Full Text | Google Scholar

12. McInnes MDF, Moher D, Thombs BD, McGrath TA, Bossuyt PM, Clifford T, et al. Preferred reporting items for a systematic review and meta-analysis of diagnostic test accuracy studies: the PRISMA-DTA statement. JAMA. (2018) 319:388–96. doi: 10.1001/jama.2017.19163

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Leeflang MM, Deeks JJ, Gatsonis C, Bossuyt PM. Systematic reviews of diagnostic test accuracy. Ann Intern Med. (2008) 149:889–97. doi: 10.7326/0003-4819-149-12-200812160-00008

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Whiting PF, Rutjes AW, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. (2011) 155:529–36. doi: 10.7326/0003-4819-155-8-201110180-00009

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Deeks JJ, Macaskill P, Irwig L. The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed. J Clin Epidemiol. (2005) 58:882–93. doi: 10.1016/j.jclinepi.2005.01.016

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Higgins JP, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat Med. (2002) 21:1539–58. doi: 10.1002/sim.1186

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ. (2003) 327:557–60. doi: 10.1136/bmj.327.7414.557

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Thompson SG, Sharp SJ. Explaining heterogeneity in meta-analysis: a comparison of methods. Stat Med. (1999) 18:2693–708. doi: 10.1002/(sici)1097-0258(19991030)18:20<2693::aid-sim235>3.0.co;2-v

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Boudhabhay I, Delestre F, Coutance G, Gnemmi V, Quéméneur T, Vandenbussche C, et al. Reappraisal of renal arteritis in ANCA-associated vasculitis: clinical characteristics, pathology, and outcome. J Am Soc Nephrol. (2021) 32:2362–74.doi: 10.1681/asn.2020071074

PubMed Abstract | CrossRef Full Text | Google Scholar

20. You X, Zhang J, Ding X, Zhang J, Zhou Q, Lu G. Predictors of renal outcomes in crescentic and mixed class of ANCA-associated glomerulonephritis. Clin Nephrol. (2021) 95:81–6. doi: 10.5414/cn110221

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Villacorta J, Diaz-Crespo F, Guerrero C, Acevedo M, Cavero T, Fernandez-Juarez G. Long-term validation of the renal risk score for vasculitis in a Southern European population. Clin Kidney J. (2021) 14:220–5. doi: 10.1093/ckj/sfaa073

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Tan PG, O'Brien J, Pusey CD, McAdoo SP. Validation of the ANCA renal risk score in a London cohort: potential impact of treatment on prediction outcome. Kidney Int. (2021) 99:488–9. doi: 10.1016/j.kint.2020.04.061

PubMed Abstract | CrossRef Full Text | Google Scholar

23. An XN, Wei ZN, Yao XY, Xu J, Qian WT, Pan XX, et al. Evaluating renal outcome of ANCA-associated renal vasculitis: comparative study of two histopathological scoring systems. Clin Exp Rheumatol. (2021) 39 Suppl 129:39–45. Available online at: https://www.clinexprheumatol.org/abstract.asp?a=15591

PubMed Abstract | Google Scholar

24. Mejía-Vilet JM, Martín-Nares E, Cano-Verduzco ML, Pérez-Arias AA, Sedano-Montoya MA, Hinojosa-Azaola A. Validation of a renal risk score in a cohort of ANCA-associated vasculitis patients with severe kidney damage. Clin Rheumatol. (2020) 39:1935–43. doi: 10.1007/s10067-020-04936-5

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Jebali H, Khadhar M, Mami I, Beji S, Sellami M, Hassen M, et al. Predictors of renal outcomes in anti-neutrophil cytoplasmic antibody glomerulonephritis. Saudi J Kidney Dis Transpl. (2020) 31:182–90. doi: 10.4103/1319-2442.279939

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Gercik O, Bilgin E, Solmaz D, Cakalagaoglu F, Saglam A, Aybi O, et al. Histopathological subgrouping versus renal risk score for the prediction of end-stage renal disease in ANCA-associated vasculitis. Ann Rheum Dis. (2020) 79:675–6. doi: 10.1136/annrheumdis-2019-216742

PubMed Abstract | CrossRef Full Text | Google Scholar

27. van Daalen EE, Wester Trejo MAC, Göçeroglu A, Ferrario F, Joh K, Noël LH, et al. Developments in the histopathological classification of ANCA-associated glomerulonephritis. Clin J Am Soc Nephrology. (2020) 15:1103–11. doi: 10.2215/cjn.14561119

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Li AS, Saleh C, Denley H, Patel M, Brix SR. ANCA renal risk score predicts outcome in the Manchester cohort. Kidney Int. (2019) 96:246–7. doi: 10.1016/j.kint.2019.03.022

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Xu PC, Chen T, Gao S, Hu SY, Wei L, Yan TK. Clinical and pathologic characteristics of pauci-immune anti-myeloperoxidase antibody associated glomerulonephritis with nephrotic range proteinuria. Ren Fail. (2018) 40:554–60. doi: 10.1080/0886022x.2018.1487865

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Zou R, Wang SX, Liu G, Yu F, Chen M, Zhao MH. Podocyte detachment is associated with renal prognosis in anca-associated glomerulonephritis: a retrospective cohort study. Medicine. (2016) 95:e3294. doi: 10.1097/md.0000000000003294

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Uyama S, Ohashi N, Iwakura T, Ono M, Fujikura T, Sakao Y, et al. A case presenting with the possible relationship between myeloperoxidase-antineutrophil cytoplasmic antibody-associated glomerulonephritis and membranous changes of the glomerular basement membrane. CEN Case Rep. (2013) 2:53–8. doi: 10.1007/s13730-012-0039-9

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Kristensen T, Gregersen JW, Krag SR, Ivarsen P. The relation between histopathological classification and renal outcome, ANCA subtype and treatment regimens in ANCA-associated vasculitis. Clin Exp Rheumatol. (2016) 34(3 Suppl 97):S105–10. Available online at: https://www.clinexprheumatol.org/abstract.asp?a=10317

PubMed Abstract | Google Scholar

33. Kronbichler A, Jayne DRW ANCA. Renal Risk Score: is prediction of end-stage renal disease at baseline possible? Kidney Int. (2018) 94:1045–7. doi: 10.1016/j.kint.2018.10.001

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Bajema IM, Hagen EC, Hermans J, Noël LH, Waldherr R, Ferrario F, et al. Kidney biopsy as a predictor for renal outcome in ANCA-associated necrotizing glomerulonephritis. Kidney Int. (1999) 56:1751–8. doi: 10.1046/j.1523-1755.1999.00758.x

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Berden AE, Jones RB, Erasmus DD, Walsh M, Noël LH, Ferrario F, et al. Tubular lesions predict renal outcome in antineutrophil cytoplasmic antibody-associated glomerulonephritis after rituximab therapy. J Am Soc Nephrol. (2012) 23:313–21. doi: 10.1681/asn.2011040330

PubMed Abstract | CrossRef Full Text | Google Scholar

36. de Lind van Wijngaarden RA, Hauer HA, Wolterbeek R, Jayne DR, Gaskin G, Rasmussen N, et al. Clinical and histologic determinants of renal outcome in ANCA-associated vasculitis: a prospective analysis of 100 patients with severe renal involvement. J Am Soc Nephrol. (2006) 17:2264–74.doi: 10.1681/asn.2005080870

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Flossmann O, Berden A, de Groot K, Hagen C, Harper L, Heijl C, et al. Long-term patient survival in ANCA-associated vasculitis. Ann Rheum Dis. (2011) 70:488–94. doi: 10.1136/ard.2010.137778

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Chen Y, Bao H, Liu Z, Liu X, Gao E, Zeng C, et al. Risk Factors for Renal Survival in Chinese Patients with Myeloperoxidase-ANCA-Associated GN. Clin J Am Soc Nephrol. (2017) 12:417–25. doi: 10.2215/cjn.06200616

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Lee T, Gasim A, Derebail VK, Chung Y, McGregor JG, Lionaki S, et al. Predictors of treatment outcomes in ANCA-associated vasculitis with severe kidney failure. Clin J Am Soc Nephrol. (2014) 9:905–13. doi: 10.2215/cjn.08290813

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Casal Moura M, Irazabal MV, Eirin A, Zand L, Sethi S, Borah BJ, et al. Efficacy of rituximab and plasma exchange in antineutrophil cytoplasmic antibody-associated vasculitis with severe kidney disease. J Am Soc Nephrol. (2020) 31:2688–704. doi: 10.1681/asn.2019111197

PubMed Abstract | CrossRef Full Text | Google Scholar

41. McAdoo SP, Tanna A, Hrušková Z, Holm L, Weiner M, Arulkumaran N, et al. Patients double-seropositive for ANCA and anti-GBM antibodies have varied renal survival, frequency of relapse, and outcomes compared to single-seropositive patients. Kidney Int. (2017) 92:693–702. doi: 10.1016/j.kint.2017.03.014

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Lyons PA, Rayner TF, Trivedi S, Holle JU, Watts RA, Jayne DR, et al. Genetically distinct subsets within ANCA-associated vasculitis. N Engl J Med. (2012) 367:214–23. doi: 10.1056/NEJMoa1108735

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Tanna A, Pusey CD. The Histopathological classification of ANCA-associated glomerulonephritis comes of age. J Rheumatol. (2017) 44:265–7. doi: 10.3899/jrheum.170006

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Menez S, Hruskova Z, Scott J, Cormican S, Chen M, Salama AD, et al. Predictors of renal outcomes in sclerotic class anti-neutrophil cytoplasmic antibody glomerulonephritis. Am J Nephrol. (2018) 48:465–71. doi: 10.1159/000494840

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Tampe D, Korsten P, Ströbel P, Hakroush S, Tampe B. Proteinuria indicates decreased normal glomeruli in ANCA-associated glomerulonephritis independent of systemic disease activity. J Clin Med. (2021) 10:1538.doi: 10.3390/jcm10071538

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: ANCA-GN, end-stage renal disease (ESRD), renal risk score, meta-analysis, predictive value

Citation: Xia M, Yu R, Zheng Z, Li H, Feng J, Xie X and Chen D (2022) Meta-Analytical Accuracy of ANCA Renal Risk Score for Prediction of Renal Outcome in Patients With ANCA-Associated Glomerulonephritis. Front. Med. 8:736754. doi: 10.3389/fmed.2021.736754

Received: 05 July 2021; Accepted: 30 November 2021;
Published: 06 January 2022.

Edited by:

Gian Marco Ghiggeri, Giannina Gaslini Institute (IRCCS), Italy

Reviewed by:

Karl Martin Wissing, University Hospital Brussels, Belgium
Björn Tampe, University Medical Center Göttingen, Germany
Li Zhi-Ying, Peking University, China

Copyright © 2022 Xia, Yu, Zheng, Li, Feng, Xie and Chen. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Xisheng Xie, eGlzaGVuZ3gmI3gwMDA0MDsxMjYuY29t; Dongming Chen, Y2hlbnk5MDg2JiN4MDAwNDA7MTYzLmNvbQ==

These authors have contributed equally to this work and share first authorship

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.