Skip to main content

ORIGINAL RESEARCH article

Front. Pediatr., 19 June 2024
Sec. Pediatric Rheumatology

Diagnostic accuracy of serum calprotectin measured by CLIA and EIA in juvenile idiopathic arthritis: a proof-of-concept study

\r\nHelena Codes-Mndez,&#x;Helena Codes-Méndez1,†Berta Magallares-Lpez,,,&#x;Berta Magallares-López1,2,3,†Hye-Sang Park,,
Hye-Sang Park1,2,3*Anaís Mariscal,Anaís Mariscal2,4Cndido Jurez,Cándido Juárez2,4Susana Boronat,,Susana Boronat2,3,5Laura Martínez-Martínez,,
Laura Martínez-Martínez2,3,4*Hector Corominas,,\r\nHector Corominas1,2,3
  • 1Rheumatology Department, Hospital de la Santa Creu I Sant Pau, Barcelona, Spain
  • 2Department of Medicine, Institut de Recerca Sant Pau (IR SANT PAU), Barcelona, Spain
  • 3Universitat Autònoma de Barcelona, Bellaterra, Spain
  • 4Immunology Department, Hospital de la Santa Creu I Sant Pau, Barcelona, Spain
  • 5Pediatric Department, Hospital de de la Santa Creu I Sant Pau, Barcelona, Spain

Objective: C-reactive protein (CRP) and erythrocyte sedimentation rate (ESR) are used to assess disease activity in juvenile idiopathic arthritis (JIA). However, because these biomarkers do not always differentiate between active and inactive disease, there is a need for alternative markers such as serum calprotectin (sCal). The main aim of this proof-of-concept study was to assess the diagnostic accuracy of sCal in patients with JIA. Secondary aims were to identify the optimal sCal cut-off levels to define active disease and evaluate the association between these biomarkers and disease activity status.

Methods: Serum samples were obtained from 25 pediatric patients with JIA. Serum calprotectin levels were determined by two different assays, the QUANTA FLASH chemiluminescence immunoassay (CLIA) from Inova Diagnostics and the solid-phase enzyme immunoassay (EIA) from Bühlmann Laboratories. Diagnostic accuracy was assessed for sCal CLIA, sCal EIA, CRP, and ESR. The results obtained by the CLIA and EIA methodologies were compared. We also evaluated the association between the individual each biomarkers (sCal CLIA, sCal EIA, CRP, and ESR) and disease activity (according to JADAS-27 criteria and the ACR criteria modified by Anink and colleagues).

Results: For both sCal assays (CLIA and EIA), the optimal cut-off level (ROC analysis) was the same (2.3 µg/ml). Serum calprotectin levels measured by CLIA and EIA were strongly correlated with each other (Kendall's tau-b, 0.71; p < 0.001). Compared to ESR and CRP, sCal CLIA and EIA were both more accurate (i.e., greater sensitivity) in identifying patients with active disease. By contrast, ESR and CRP were more effective in identifying patients in remission (i.e., better specificity).

Conclusion: This proof-of-concept study shows that determination of serum calprotectin levels with CLIA or EIA can accurately identify the presence of active disease in patients with JIA.

1 Introduction

Juvenile idiopathic arthritis (JIA) is a group of diseases characterized by arthritis of unknown etiology persisting for at least 6 weeks, with onset occurring before age 16 (1). It is the most common childhood inflammatory rheumatic condition, with an estimated annual incidence of 7.8/100.000 (1, 2). According to the International League of Associations for Rheumatology (ILAR), there are seven differing subtypes of JIA: (1) oligoarthritis; (2) rheumatoid factor (RF)-positive polyarthritis; (3) RF-negative polyarthritis; (4) enthesitis-related arthritis (ERA); (5) psoriatic arthritis (PsA); (6) systemic arthritis; and (7) undifferentiated arthritis (3). Although the ILAR criteria are still considered the standard, it is worth noting that several groups have sought to revise these criteria in recent years (4, 5).

Due to the highly heterogenous nature of JIA—as evidenced by the seven different subtypes and by the controversy surrounding the classification system—it has been challenging to identify simple measures that can be used to monitor the course of the disease, establish prognosis, and predict the likelihood of disease progression into adulthood (6). The management of JIA depends on a range of different factors, including the number of affected joints, the presence of uveitis, sacroiliitis or enthesitis, and laboratory biomarkers, including positive antinuclear antibodies, positive rheumatoid factor, and anti-citrullinated protein antibodies (79). Conventional acute phase reactants such as C-reactive protein (CRP) and erythrocyte sedimentation rate (ESR) are widely used to assess inflammatory status in JIA, and both of these measures are key components of composite disease activity indices, including the Juvenile Arthritis Disease Activity Score (JADAS-27) (10, 11). However, these biomarkers—or indices based on them—may not be accurately differentiate between patients with active and inactive disease, especially in patients with oligoarthritis (4, 6). In fact, patients commonly present normal ESR and/or CRP values despite clinical signs of active disease. Despite these limitations, both of these measures are good predictors of disease progression (6, 9, 12).

Given the limitations of ESR and CRP in JIA, numerous authors have proposed serum calprotectin (sCal) as an alternative biomarker of inflammatory activity (6, 1218). Serum calprotectin levels have been shown to correlate well with disease activity—especially in systemic JIA—and the available data suggests that sCal is a more specific biomarker of disease activity than either ESR or CRP (1922). Several different commercial tests are available to determine sCal levels, including chemiluminescence immunoassay (CLIA), solid-phase enzyme immunoassay (EIA), and enzyme-linked immunosorbent assay (ELISA). However, the diagnostic accuracy of these tests—that is, their capacity to distinguish between active and inactive disease in JIA—has not been well-established. Similarly, the optimal cut-off point (sCal level) to determine the presence of disease activity in patients with JIA has not been established. In addition, to our knowledge, these different methods of determining sCal levels in JIA have not been compared to date.

In this context, the present proof-of-concept study had two main aims: 1) to assess the diagnostic accuracy of serum calprotectin as a biomarker of disease activity status in patients with JIA, and 2) to determine the optimal sCal cut-off values, as measured by CLIA and EIA, to differentiate between active and inactive disease. In addition, we also sought to determine the association between these biomarkers (sCal CLIA, sCal EIA, CRP, and ESR) and disease activity.

2 Materials and methods

2.1 Study population

This was a cross-sectional study carried out at a pediatric rheumatology outpatient clinic at a tertiary referral hospital in Barcelona, Spain.

All patients who met ILAR criteria for JIA (3) were consecutively included from June 2020 through June 2021. The patients (n = 25) were classified into four clinically-homogeneous groups based on the 2019 American College of Rheumatology/Arthritis Foundation guidelines for the treatment of JIA (8) and on the 2019 Printo criteria (4). The four groups were as follows: (1) systemic JIA (same criteria as ILAR systemic JIA); (2) oligoarticular JIA (non-systemic arthritis with <5 joints ever involved); (3) polyarticular JIA (non-systemic arthritis with ≥5 joints ever involved); and (4) enthesitis/spondylitis-related JIA (sacroiliitis or enthesitis-related arthritis). Serum samples (n = 25) were collected from the 25 patients as part of routine clinical practice. Patients with other concomitant diseases such as cancer or chronic infectious diseases that might interfere with biomarker interpretation were excluded.

The study was approved by the institutional ethics committee of Hospital de la Santa Creu I Sant Pau (code: IIBSP-BIR-2017-07). The study was conducted in accordance with the Helsinki Declaration.

2.2 Data collection and study variables

Patient data were obtained from the hospital's electronic healthcare records. Demographic data (sex and date of birth) and disease-related variables, including JIA subtype classification, were also collected. The following clinical variables were also recorded: number of joints with active disease based on physical examination (active joint count), JADAS-27 score, laboratory parameters, and prescribed treatment.

Serum calprotectin levels were measured by both CLIA and EIA. CRP and ESR were measured as part of routine clinical practice and used as a benchmark for comparison with the sCal values.

Disease activity was assessed by two different sets of criteria, those described by Anink et al. (18) and JADAS-27 (10). First, we used the modified interpretation of the American College of Rheumatology (ACR) pediatric response criteria term “inactive disease” as defined by Anink et al. (18), referred to in the manuscript as “ACR-modified” criteria.

Those authors defined inactive disease as follows: no active arthritis; absence of systemic features and uveitis; normal ESR (≤ 20 mm/h), and physician's global assessment (PGA) indicating absence of disease activity (score ≤10 on a 0–100 mm scale). We chose to use the ACR-modified definition of disease inactivity because it is consistent with the findings of recent studies that have investigated sCal levels in patients with JIA (23). Furthermore, this definition is more comprehensive than the JADAS-27 scale, as it covers a broader spectrum of disease by including eye involvement (uveitis), and it also accommodates a more pragmatic PGA (higher cut-off), which makes it more feasible in the context of routine clinical practice. Second, we applied the inactive disease criteria from JADAS-27 (10), which is the standard approach for assessing disease activity in patients with JIA. However, JADAS-27 has an important limitation: disease activity is mainly based on the presence of clinical arthritis. The JADAS-27 score was categorized as an ordinal variable in order to group patients into four different levels of disease activity, as follows: inactive, low, moderate, and high. The specific cut-off levels varied according to the JIA subtype (24).

We evaluated the diagnostic accuracy—defined as the test's ability to differentiate between inactive and active disease—of sCal measured by CLIA and EIA. Disease activity was assessed according to the ACR-modified criteria and JADAS-27.

2.3 Determination of serum biomarkers

Blood samples were collected from one to seven days before the clinical evaluation. Serum calprotectin was measured by the QUANTA Flash® CLIA assay (Inova Diagnostics) and by solid-phase EIA (Bühlmann Laboratories AG). Given that serum sCal concentrations may increase significantly if centrifugation is performed ≥6 h after extraction (21) (neutrophils in the serum continue to release sCal even after sample collection), strict preanalytical test conditions were established and all serum samples were centrifuged and stored at −80°C within 2 h of extraction.

For the evaluation of ESR and CRP, the upper limit for normal levels was set at 20 mm/h for ESR and 5 mg/L for CRP.

2.4 Statistical analysis

Descriptive statistics are presented as absolute frequencies with medians and interquartile range (IQR) or as means with standard deviation (SD), as appropriate. The Shapiro-Wilk test and box plots were used to check the distribution of the variables.

The cut-off levels for sCal (CLIA and EIA), CRP, and ESR were evaluated according to both JADAS-27 and ACR-modified criteria using receiver operating characteristic (ROC) curves. Optimal cut-off values were based on the area under the curve (AUC), sensitivity, specificity, and the likelihood ratio.

The association between each biomarker (sCal CLIA, sCal EIA, ESR, CRP) and disease activity (assessed by JADAS-27 and ACR-modified criteria) was evaluated. Odds ratios (OR) for these associations were determined for each biomarker through logistic regression analysis. Finally, a multinomial logistic regression model was used to evaluate the relationship between each sCal determination technique (CLIA and EIA) and disease activity status based on JADAS-27 score. Two-sided 95% confidence intervals (CI) were calculated. Statistical significance was set at p < 0.05. Stata 16.0 (Statacorp, College Station, TX, USA) was used to perform all statistical analyses.

3 Results

3.1 Baseline clinical characteristics and biomarker distribution according to disease activity status

A total of 25 patients diagnosed with JIA (ILAR criteria) (3) were included in the study. The clinical and serological characteristics of these patients are shown in Table 1.

Table 1
www.frontiersin.org

Table 1 Patient characteristics according to diagnostic criteria (ACR-modified vs. JADAS-27).

According to JADAS-27 criteria, 11 patients (44%) had active disease, distributed by activity level as follows: low (n = 6; 56%), moderate (n = 1, 9.1%), and high (n = 4; 36%). The remaining 14 patients were considered to have inactive disease.

Two patients developed uveitis after diagnosis. At the time of data collection, both of these patients were considered to have active disease according to ACR-modified criteria, but only one was active based on the JADAS-27 criteria.

3.1.1 Treatment

Six patients received prednisone (mean daily dose, 4.5 mg). Thirteen patients were treated with conventional disease-modifying antirheumatic drugs (cDMARDs). Of these, 8 (61.5%) received methotrexate, 4 (30.7%) received leflunomide, and 1 (7.7%) received sulfasalazine (Salazopyrine). Six patients received biological DMARDs (bDMARDs), as follows: anakinra and tocilizumab (n = 2 patients with systemic JIA); adalimumab (n = 2, enthesitis-related arthritis JIA); and etanercept and abatacept (n = 2, polyarticular JIA).

The distribution of serum biomarker concentrations based on disease activity is shown in Figure 1. As that figure shows, the thresholds for these biomarkers were within the IQR for the subgroup with active disease. In the patients with active disease (ACR-modified and JADAS-27), sCal levels measured by EIA surpassed the 2.3 µg/ml cut-off in >75% of cases (Figures 1A,B); by contrast, sCal CLIA, CRP, and ESR levels only exceeded their respective cut-off values in <50% of cases with active disease (Figures 1C–F). Finally, CRP and ESR had a greater capacity than sCal (regardless of the specific technique, CLIA or EIA) to identify patients with inactive disease.

Figure 1
www.frontiersin.org

Figure 1 Distribution of biomarkers according to disease activity subgroup. Serum calprotectin (sCal) levels measured by QUANTA flash ® CLIA and Bühlmann® EIA and depending on disease activity state as assessed by ACR-modified criteria (A) of JADAS-27 (B), with the cut-off value of 2.3μg/ml represented in a line. Serum concentrations of CRP in inactive and active disease by ACR-modified criteria (C) and JADAS-27 (D), with a cut-off level of 5 mg/L. Serum ESR levels by disease activity subgroups by ACR-modified criteria (E) and JADAS-27 (F), with a cut-off value of 20 mm/h.

A contingency table showing the true-positive, true-negative, false positive, and false-negative counts for inactive disease status (according to the proposed cut-off values) is shown in the supplementary material (Supplementary Table S1).

3.2 Diagnostic accuracy of sCal levels measured by CLIA and EIA

We evaluated the diagnostic accuracy of sCal CLIA, sCal EIA, CRP, and ESR, with the latter two measures used as the reference standard.

Tables 2, 3 show the proposed cut-off values with the diagnostic performance (maximum efficiency and ROC curves) to predict disease activity according to the ACR-modified and JADAS-27 criteria, respectively. Optimal cut-off levels for each biomarker were identified using ROC curves (Figure 2), and cut-off levels for maximum efficiency were also determined.

Table 2
www.frontiersin.org

Table 2 Performance of the four biomarkers based on ACR-modified criteria.

Table 3
www.frontiersin.org

Table 3 Performance of the four biomarkers according to JADAS-27.

Figure 2
www.frontiersin.org

Figure 2 ROC curve analysis of sCal CLIA, sCal EIA, CRP, and ESR for the differentiation between active and inactive disease according to ACR-modified criteria and JADAS-27. ROC curves of sCal EIA (A), sCal CLIA (B), CRP (E) and ESR (G) for disease activity by JADAS; and ROC curves of sCal EIA (C), sCal CLIA (D), CRP (F) and ESR (H) for disease activity by ACR-modified criteria are shown. ROC: receiver operating characteristic; sCal: serum calprotectin. CRP: C-reactive protein. ESR: erythrocyte sedimentation rate.

Based on the suggested cut-off values for disease activity according to the ACR-modified criteria (Table 2), the optimal cut-off values were as follows: 2.0 µg/ml for sCal CLIA (positive predictive value [PPV] and negative predictive value [NPV] of 60% and 70%, respectively) and 2.9 µg/ml for sCal EIA (PPV and NPV, 60% and 70%, respectively).

The optimal threshold for sCal CLIA (2.0 µg/ml, Table 2) was the same as recommended by the manufacturer of the CLIA kit. Serum calprotectin, whether measured by EIA or CLIA, was more sensitive (75%) than CRP and ESR, although the specificity was lower. Using the 2.3 µg/ml threshold to indicate active disease (ACR-modified criteria), sCal CLIA had a sensitivity of 58.3% and specificity of 53.9% (PPV, 57.8%; NPV, 53.9%); by comparison, the sensitivity and specificity for sCal EIA was 83.3% and 46.2%, respectively (PPV, 58.8%; NPV, 75%).

Conversely, utilizing the recommended cut-off values for disease activity according to the JADAS-27 criteria, the optimal sCal cut-off value for both techniques (CLIA and EIA) was 2.3 µg/ml (Table 3). The PPV and NPV values for CLIA were 53.8% and 66.7%, respectively vs. 58.8% and 87.5% for EIA. For this cut-off value (2.3 µg/ml), the sensitivity of EIA was 90.9%, which was superior to the sensitivity obtained for CRP, ESR and sCal CLIA. For sCal CLIA, the corresponding sensitivity was 63.6%, which was lower than the sensitivity obtained for CRP, ESR, and sCal EIA. The specificity for both sCal CLIA and EIA was lower than CRP and ESR (Table 3).

For CRP and ESR, the standard cut-off values for disease activity are 5 mg/L and 20 mm/h, respectively. Using these cut-off values, both CRP and ESR had a lower sensitivity but better specificity than sCal EIA and sCal CLIA (Table 3). The AUC for CRP was 0.75 (sensitivity, 50%; specificity, 100%); for ESR, the AUC was 0.73 (sensitivity, 41.7%; specificity, 100%). The optimal cut-off values for CRP and ESR (ROC analysis) were significantly lower (3.1 mg/L and 10 mm/h, respectively) than the standard clinical thresholds. However, both CRP and ESR were less sensitive and more specific than sCal when using those lower thresholds.

3.3 Association between biomarkers and disease activity

3.3.1 Odds ratio for inactive disease according to ACR-modified and JADAS-27 criteria

The OR was computed to assess the association between disease activity and each biomarker (Table 4). CRP showed a moderate to high association with disease activity (as measured by both ACR-modified criteria and JADAS-27); in both cases, the association was statistically significant. Serum calprotectin (EIA) showed a moderate association with disease activity (OR: 1.52 [ACR-modified] and 1.79 [JADAS-27]), but this association was not statistically significant, despite the high precision indicated by the 95% CI. By contrast, sCal CLIA showed a weaker association with disease activity (OR: 1.19 [ ACR-modified criteria] and 1.26 [JADAS-27]). The association between ESR and disease activity was also weak, with an OR of 1.11 [ACR-modified] and 1.13 [JADAS-27]. These findings did not reach statistical significance, although the 95% CI indicated good precision.

Table 4
www.frontiersin.org

Table 4 Association between the four biomarkers and disease activity according to ACR-modified criteria and the JADAS-27 criteria.

Serum calprotectin levels measured by CLIA and EIA were strongly correlated (Kendall's tau-b, 0.71; p < 0.001). The scatter plot depicting this correlation is shown in Supplementary Figure S1.

3.3.2 Multinomial logistic regression for JADAS-27

Both sCal EIA (ß=0.69, p = 0.04) and CRP (ß=0.74, p = 0.01) were significantly associated with high disease activity (JADAS-27 criteria). However, neither of these two biomarkers showed a significant association with mild disease (i.e., low activity) (Table 5).

Table 5
www.frontiersin.org

Table 5 Correlation between the four biomarkers and disease activity according to JADAS-27 (mild, moderate, or high).

Neither sCal CLIA (ß=0.28, p = 0.27) nor ESR (ß=0.13, p = 0.05) were associated with high disease activity or mild disease activity as measured by JADAS-27 (ß=0.02, p = 0.95 and ß=0.07, p = 0.47, respectively).

4 Discussion

In the present proof-of-concept study, we aimed to assess the diagnostic accuracy of sCal measured by two different commercial assays, QUANTA Flash CLIA (Inova Diagnostics) and EIA (Bühlmann Laboratories). The ROC analysis based on JADAS-27 showed that the optimal cut-off value for disease activity was 2.3 µg/ml for both techniques. Remarkably, this threshold was consistent with the one established in our clinical practice. However, on the ROC analysis based on ACR-modified criteria, the optimal cut-off was 2.0 µg/ml for sCal CLIA—the same value recommended by the commercial kit—and 2.9 µg/ml for sCal EIA. By contrast, the optimal cut-off values for CRP and ESR (3.1 mg/L and 10 mm/h, respectively), according to both JADAS-27 and ACR-modified criteria were lower than the values commonly applied in routine clinical practice (5 mg/L and 20 mm/h, respectively). This finding demonstrates the limited sensitivity of these measures in identifying active disease when the standard thresholds are used.

When we used the ROC-derived cut-off of 10 mm/h for ESR (Tables 2, 3), the diagnostic accuracy was poor (both sensitivity and specificity <75%). However, when we applied the standard cut-off value (20 mm/h), the specificity was 100%, although sensitivity decreased (< 50%). For maximum efficiency, the optimal ESR cut-off was 20 mm/h, which is consistent with the values commonly used in routine clinical practice.

Serum calprotectin was more sensitive than both CRP and ESR (Tables 2, 3), although the specificity was lower. We compared the four biomarkers using both the JADAS-27 and ACR-modified criteria to assess disease activity. Based on JADAS-27, sCal EIA was more sensitive than sCal CLIA, CRP, and ESR. Based on the ACR-modified criteria, both sCal CLIA and EIA had a higher sensitivity than CRP and ESR. The higher sensitivity of sCal CLIA (ACR-modified criteria) suggests that this technique may be useful to evaluate extra-articular manifestations of JIA such as uveitis. Overall, in patients with active disease, sCal was more sensitive than CRP and ESR. For example, CRP and ESR were within the normal range (i.e., less than 5 mg/L or 20 mm/h, respectively) in more than 50% of patients with active disease. By contrast, sCal levels measured by EIA were only normal (i.e., below the cut-off for active disease) in two of 12 active patients (ACR-modified criteria) and 1 of 11 patients (JADAS-27). For sCal CLIA, the sCal values were considered normal in 5 of 12 patients (ACR-modified criteria) with active disease and 4 of 11 patients (JADAS-27).

At the time of data collection and biomarker assessment, one patient with active disease was experiencing an ongoing flare (simultaneous arthritis and uveitis). Although this patient presented elevated sCal levels (≥2.3 µg/ml)—indicative of active disease—there was no corresponding increase in either CRP or ESR, which suggests that sCal is better than CRP and ESR in identifying disease activity involving arthritis and/or uveitis, a finding that is consistent with prior research (6, 25). Alberdi et al. (12) recently examined the role of CRP as a predictor of long-term outcomes in JIA. In that study, CRP values >10 mg/L—which is double the standard cut-off value (5 mg/L)—were predictive of poor prognosis.

By contrast, in our study, both CRP and ESR had greater specificity than sCal at their standard thresholds, but a lower sensitivity. This lower sensitivity, together with the lower NPV, underscore the potential risk of these biomarkers to fail to identify disease activity in a substantial proportion of patients, a finding that is consistent with previous reports (6). In this regard, Sarkar et al. (26) found that CRP and ESR levels in patients with active JIA often remained below the cut-off levels for active disease, thus demonstrating that the presence of normal levels of these inflammatory markers does not necessarily indicate the absence of disease activity.

D'Angelo el al. (16). measured sCal using a different type of immunoenzymatic assay (Calprest NG from Eurospital Diagnostics). In that study, patients with active disease had higher sCal levels than those with inactive disease. That study also demonstrated a strong correlation between sCal and JADAS-27 (i.e., sCal levels were significantly elevated in active patients), a finding that is consistent with our results. Nonetheless, our findings suggest that sCal EIA may be less useful in differentiating between inactive and mild disease (low disease activity), as evidenced by the results of the multinomial regression analysis. By contrast to our results, D’Angelo et al. found that both CRP and ESR effectively differentiated between active and inactive disease.

In our study, both sCal EIA and CRP yielded similar results in terms of their capacity to identify the active disease (Tables 2, 3). By contrast, ESR was weaker (i.e., less able to distinguish disease activity), as evidenced by the lower sensitivity of this biomarker compared to the other three biomarkers. The lower sensitivity of ESR vs. CRP was somewhat surprising given that ESR—but not CRP—is a key component of the JADAS-27, the scale commonly used to assess disease activity status and to guide treatment decisions.

CLIA and EIA were closely correlated in terms of the quantification of sCal levels (Supplementary Figure S1), a finding that supports the reliability of these two techniques. Although the diagnostic accuracy (Table 3) of EIA was slightly better than CLIA (JADAS-27 criteria), the difference was not statistically significant.

One potential drawback of using sCal instead of CRP or ESR is the higher cost. However, sCal is probably more cost-effective than either CRP or ESR given the potential expenses related to suboptimal therapeutic decisions. Another potential disadvantage is the perception of CLIA and EIA as potentially more time-consuming than traditional biomarkers. Nevertheless, we found that turnaround time for both techniques was comparable to each other and similar to the immediate results obtained with traditional biomarkers. In this regard, it is worth noting that both of these assays are substantially faster than ELISA. An important advantage of CLIA over EIA is that CLIA is fully automated whereas EIA requires manual intervention.

4.1 Strengths and limitations

The main limitation of this proof-of-concept study is the small sample size (n = 25). Due to this limited sample, we were unable to perform multivariate or stratified analyses. Instead, we performed univariate regression analyses. However, we used non-parametric tests, which is a robust method to compare distributions without imposing specific distributional assumptions. Moreover, despite the small sample size, our findings were consistent with previous reports (6, 22).Another limitation is the single center study design, which could limit the generalizability of our findings. However, this limitation is mitigated in part by the type of hospital—a tertiary care hospital being a referral center for rheumatic diseases in Catalonia—and the large catchment area (> 450,000 inhabitants).

The main strength of this study is that it is the first to compare the diagnostic accuracy of two different methods (CLIA and EIA) to determine sCal levels and disease activity in a real-world population with JIA. Another strength is that we consistently followed a standardized protocol to measure sCal levels, thus minimizing potential variability, and that we have identified specific cut-off values to differentiate between active and inactive disease for both CLIA and EIA, thus providing clinicians with clear guidelines to accurately assess disease activity in real-world clinical settings.

The findings of this proof-of-concept study confirm the potential role of sCal as an inflammatory biomarker to monitor disease activity in patients with JIA. The prognostic value of sCal is notable, especially when remission status is unclear and there is a need to differentiate between inactive and active disease status. This is highly relevant given that both CRP and ESR often fall within the normal range despite the presence (or likely future development) of clinical signs of disease activity, such as uveitis or clinical arthritis (12, 27). In this regard, sCal could potentially serve as an indicator of the presence of mild persistent disease activity, even in the absence of clinical and/or biological indications of sustained inflammation. Moreover, sCal could also be used for the early detection of disease activity, which could have important clinical implications as it would allow clinicians to implement an effective treat-to-target strategy within a small window of opportunity, thus potentially preventing disease progression and/or complications (28). Similarly, determination of sCal levels could help to identify patients in treatment-supported remission who are likely to achieve sustained remission, thereby providing data that could support treatment discontinuation or tapering with minimal risk of relapse (29).

This study also shows that commercially available CLIA and EIA kits yield comparable sCal values, which supports the potential of both assays to evaluate disease activity in JIA patients. The analogous performance of these clinically-validated, commercially-available assays might enable clinicians to use this tool in routine clinical practice, in contrast to traditional biomarkers.

5 Conclusion

This study shows that determination of serum calprotectin levels, whether by CLIA or EIA, can accurately differentiate between active and inactive disease status, thus supporting the use of these assays in routine clinical practice. However, more studies are needed to better assess the diagnostic accuracy of sCal levels according to the specific JIA subtype. In particular, prospective studies are needed to evaluate the role of sCal to predict disease flares and treatment response. Ideally, multicenter studies should be performed to obtain more robust data and to confirm our findings across different patient cohorts and healthcare settings.

Data availability statement

The datasets presented in this study can be found in online repositories. The names of the repository/repositories and accession number(s) can be found in the article/Supplementary Material.

Ethics statement

The studies involving humans were approved by Institutional Ethics Committee of Hospital de la Santa Creu I Sant Pau, Barcelona, Spain. The studies were conducted in accordance with the local legislation and institutional requirements. Written informed consent for participation in this study was provided by the participants’ legal guardians/next of kin.

Author contributions

HC-M: Conceptualization, Data curation, Formal Analysis, Investigation, Methodology, Project administration, Resources, Validation, Visualization, Writing – original draft, Writing – review & editing. BM-L: Conceptualization, Data curation, Formal Analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing. H-SP: Conceptualization, Data curation, Formal Analysis, Investigation, Methodology, Software, Supervision, Validation, Writing – original draft, Writing – review & editing. AM: Conceptualization, Investigation, Project administration, Validation, Writing – original draft, Writing – review & editing. CJ: Project administration, Validation, Writing – original draft, Writing – review & editing. SB: Project administration, Validation, Writing – original draft, Writing – review & editing. LM-M: Conceptualization, Data curation, Formal Analysis, Investigation, Methodology, Project administration, Supervision, Validation, Writing – original draft, Writing – review & editing. HC: Conceptualization, Investigation, Project administration, Validation, Writing – original draft, Writing – review & editing.

Funding

The author(s) declare financial support was received for the research, authorship, and/or publication of this article.

This research was partially funded by a grant (year 2023) from the Spanish Society of Pediatric Rheumatology.

Acknowledgments

We thank Bradley Londres for professional language editing.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fped.2024.1422916/full#supplementary-material

References

1. Ravelli A, Martini A. Juvenile idiopathic arthritis. Lancet. (2007) 369(9563):767–78. doi: 10.1016/S0140-6736(07)60363-8

PubMed Abstract | Crossref Full Text | Google Scholar

2. Thierry S, Fautrel B, Lemelle I, Guillemin F. Prevalence and incidence of juvenile idiopathic arthritis: a systematic review. Joint Bone Spine. (2014) 81(2):112–7. doi: 10.1016/j.jbspin.2013.09.003

PubMed Abstract | Crossref Full Text | Google Scholar

3. Petty RE, Southwood TR, Manners P, Baum J, Glass DN, Goldenberg J, et al. International league of associations for rheumatology classification of juvenile idiopathic arthritis: second revision, Edmonton, 2001. J Rheumatol. (2004) 31(2):390–2. PMID: 14760812.14760812

PubMed Abstract | Google Scholar

4. Martini A, Ravelli A, Avcin T, Beresford MW, Burgos-Vargas R, Cuttica R, et al. Toward new classification criteria for juvenile idiopathic arthritis: first steps, pediatric rheumatology international trials organization international consensus. J Rheumatol. (2019) 46(2):190–7. doi: 10.3899/jrheum.180168

PubMed Abstract | Crossref Full Text | Google Scholar

5. Giancane G, Ruperto N. Treatment of juvenile idiopathic arthritis: what’s new? Curr Opin Rheumatol. (2019) 31(5):428–35. doi: 10.1097/BOR.0000000000000632

PubMed Abstract | Crossref Full Text | Google Scholar

6. Rosina S, Natoli V, Santaniello S, Trincianti C, Consolaro A, Ravelli A. Novel biomarkers for prediction of outcome and therapeutic response in juvenile idiopathic arthritis. Expert Rev Clin Immunol. (2021) 17(8):853–70. doi: 10.1080/1744666X.2021.1945441

PubMed Abstract | Crossref Full Text | Google Scholar

7. Beukelman T, Patkar NM, Saag KG, Tolleson-Rinehart S, Cron RQ, DeWitt EM, et al. 2011 American college of rheumatology recommendations for the treatment of juvenile idiopathic arthritis: initiation and safety monitoring of therapeutic agents for the treatment of arthritis and systemic features. Arthritis Care Res (Hoboken). (2011) 63(4):465–82. doi: 10.1002/acr.20460

PubMed Abstract | Crossref Full Text | Google Scholar

8. Ringold S, Angeles-Han ST, Beukelman T, Lovell D, Cuello CA, Becker ML, et al. 2019 American college of rheumatology/arthritis foundation guideline for the treatment of juvenile idiopathic arthritis: therapeutic approaches for non-systemic polyarthritis, sacroiliitis, and enthesitis. Arthritis Rheumatol. (2019) 71(6):846–63. doi: 10.1002/art.40884

PubMed Abstract | Crossref Full Text | Google Scholar

9. Martini A, Lovell DJ, Albani S, Brunner HI, Hyrich KL, Thompson SD, et al. Juvenile idiopathic arthritis. Nat Rev Dis Primers. (2022) 8(1):5. doi: 10.1038/s41572-021-00332-8

PubMed Abstract | Crossref Full Text | Google Scholar

10. Consolaro A, Ruperto N, Bazso A, Pistorio A, Magni-Manzoni S, Filocamo G, et al. Development and validation of a composite disease activity score for juvenile idiopathic arthritis. Arthritis Rheum. (2009) 61(5):658–66. doi: 10.1002/art.24516

PubMed Abstract | Crossref Full Text | Google Scholar

11. Trincianti C, Van Dijkhuizen EHP, Alongi A, Mazzoni M, Swart JF, Nikishina I, et al. Definition and validation of the American college of rheumatology 2021 juvenile arthritis disease activity score cutoffs for disease activity states in juvenile idiopathic arthritis. Arthritis Rheum. (2021) 73(11):1966–75. doi: 10.1002/art.41879

Crossref Full Text | Google Scholar

12. Alberdi-Saugstrup M, Zak M, Nielsen S, Herlin T, Nordal E, Berntson L, et al. High-sensitive CRP as a predictive marker of long-term outcome in juvenile idiopathic arthritis. Rheumatol Int. (2017) 37(5):695–703. doi: 10.1007/s00296-017-3657-x

PubMed Abstract | Crossref Full Text | Google Scholar

13. La C, Lê PQ, Ferster A, Goffin L, Spruyt D, Lauwerys B, et al. Serum calprotectin (S100A8/A9): a promising biomarker in diagnosis and follow-up in different subgroups of juvenile idiopathic arthritis. RMD Open. (2021) 7(2):e001646. doi: 10.1136/rmdopen-2021-001646

PubMed Abstract | Crossref Full Text | Google Scholar

14. Barendregt AM, Veldkamp SR, Hissink Muller PCE, van de Geer A, Aarts C, van Gulik EC, et al. MRP8/14 And neutrophil elastase for predicting treatment response and occurrence of flare in patients with juvenile idiopathic arthritis. Rheumatology (Oxford). (2020) 59(9):2392–401. doi: 10.1093/rheumatology/kez590

PubMed Abstract | Crossref Full Text | Google Scholar

15. Romano M, Gerloni V, De Lucia O, Piskin D, Giani T, Gattinara M, et al. Serum calprotectin (S100A8/9), clinical and ultrasound assessment in patients with juvenile idiopathic arthritis. Clin Exp Rheumatol. (2021) 39(5):1132–40. doi: 10.55563/clinexprheumatol/5tckci

PubMed Abstract | Crossref Full Text | Google Scholar

16. d'Angelo DM, Attanasi M, Di Donato G, Lapergola G, Flacco M, Chiarelli F, et al. The role of Serum calprotectin in defining disease outcomes in non-systemic juvenile idiopathic arthritis: a pilot study. Int J Mol Sci. (2023) 24(2):1671–86. doi: 10.3390/ijms24021671

Crossref Full Text | Google Scholar

17. Frosch M, Strey A, Vogl T, Wulffraat NM, Kuis W, Sunderkötter C, et al. Myeloid-related proteins 8 and 14 are specifically secreted during interaction of phagocytes and activated endothelium and are useful markers for monitoring disease activity in pauciarticular-onset juvenile rheumatoid arthritis. Arthritis Rheum. (2000) 43(3):628–37. doi: 10.1002/1529-0131(200003)43:3%3C628::AID-ANR20%3E3.0.CO;2-X

PubMed Abstract | Crossref Full Text | Google Scholar

18. Anink J, Van Suijlekom-Smit LW, Otten MH, Prince FH, van Rossum MA, Dolman KM, et al. MRP8/14 serum levels as a predictor of response to starting and stopping anti-TNF treatment in juvenile idiopathic arthritis. Arthritis Res Ther. (2015) 17(1):200. doi: 10.1186/s13075-015-0723-1

PubMed Abstract | Crossref Full Text | Google Scholar

19. Frosch M, Vogl T, Seeliger S, Wulffraat N, Kuis W, Viemann D, et al. Expression of myeloid-related proteins 8 and 14 in systemic-onset juvenile rheumatoid arthritis. Arthritis Rheum. (2003) 48(9):2622–6. doi: 10.1002/art.11177

PubMed Abstract | Crossref Full Text | Google Scholar

20. Mariani A, Marsili M, Nozzi M, Faricelli R, Chiarelli F, Breda L. Serum calprotectin: review of its usefulness and validity in paediatric rheumatic diseases. Clin Exp Rheumatol. (2015) 33(1):109–14. PMID: 25535818. 25535818

PubMed Abstract | Google Scholar

21. Mylemans M, Nevejan L, Van Den Bremt S, Stubbe M, Cruyssen BV, Moulakakis C, et al. Circulating calprotectin as biomarker in neutrophil-related inflammation: pre-analytical recommendations and reference values according to sample type. Clin Chim Acta. (2021) 517:149–55. doi: 10.1016/j.cca.2021.02.022

PubMed Abstract | Crossref Full Text | Google Scholar

22. Altobelli E, Angeletti PM, Petrocelli R, Lapergola G, Farello G, Cannataro G, et al. Serum calprotectin a potential biomarker in juvenile idiopathic arthritis: a meta-analysis. J Clin Med. (2021) 10(21):4861. doi: 10.3390/jcm10214861

PubMed Abstract | Crossref Full Text | Google Scholar

23. Gohar F, Anink J, Moncrieffe H, Van Suijlekom-Smit LWA, Prince FHM, van Rossum MAJ, et al. S100a12 is associated with response to therapy in juvenile idiopathic arthritis. J Rheumatol. (2018) 45(4):547–54. doi: 10.3899/jrheum.170438

PubMed Abstract | Crossref Full Text | Google Scholar

24. Consolaro A, Ruperto N, Bracciolini G, Frisina A, Gallo MC, Pistorio A, et al. Defining criteria for high disease activity in juvenile idiopathic arthritis based on the juvenile arthritis disease activity score. Ann Rheum Dis. (2014) 73(7):1380–3. doi: 10.1136/annrheumdis-2013-204186

PubMed Abstract | Crossref Full Text | Google Scholar

25. Angeles-Han ST, Utz VM, Thornton S, Schulert G, Rodriguez-Smith J, Kauffman A, et al. S100 proteins, cytokines, and chemokines as tear biomarkers in children with juvenile idiopathic arthritis-associated uveitis. Ocul Immunol Inflamm. (2021) 29(7-8):1616–20. doi: 10.1080/09273948.2020.1758731

PubMed Abstract | Crossref Full Text | Google Scholar

26. Sarkar S, Alam MM, Das G, Datta S. Inflammatory markers and disease activity in juvenile idiopathic arthritis. Indian J Pediatr. (2017) 84(5):349–56. doi: 10.1007/s12098-017-2292-6

PubMed Abstract | Crossref Full Text | Google Scholar

27. Park C, Miranda-Garcia M, Berendes R, Horneff G, Kuemmerle-Deschner J, Ganser G, et al. MRP8/14 serum levels as diagnostic markers for systemic juvenile idiopathic arthritis in children with prolonged fever. Rheumatology (Oxford). (2022) 61(7):3082–92. doi: 10.1093/rheumatology/keab729

PubMed Abstract | Crossref Full Text | Google Scholar

28. Burrone M, Mazzoni M, Naddei R, Pistorio A, Spelta M, Scala S, et al. Looking for the best strategy to treat children with new onset juvenile idiopathic arthritis: presentation of the “comparison of STep-up and step-down therapeutic strategies in childhood ARthritiS” (STARS) trial. Pediatr Rheumatol Online J. (2022) 20(1):80. doi: 10.1186/s12969-022-00739-x

PubMed Abstract | Crossref Full Text | Google Scholar

29. Currie GR, Pham T, Twilt M, IJzerman MJ, Hull PM, Kip MMA, et al. Perspectives of pediatric rheumatologists on initiating and tapering biologics in patients with juvenile idiopathic arthritis: a formative qualitative study. Patient. (2022) 15(5):599–609. doi: 10.1007/s40271-022-00575-x

PubMed Abstract | Crossref Full Text | Google Scholar

Keywords: juvenile idiopathic arthritis, serum calprotectin, biomarkers, s100 protein, s100A8/S100A9, calcium-binding myeloid protein p8/14

Citation: Codes-Méndez H, Magallares-López B, Park H-S, Mariscal A, Juárez C, Boronat S, Martínez-Martínez L and Corominas H (2024) Diagnostic accuracy of serum calprotectin measured by CLIA and EIA in juvenile idiopathic arthritis: a proof-of-concept study. Front. Pediatr. 12:1422916. doi: 10.3389/fped.2024.1422916

Received: 24 April 2024; Accepted: 7 June 2024;
Published: 19 June 2024.

Edited by:

Lovro Lamot, University of Zagreb, Croatia

Reviewed by:

Sezgin Sahin, Istanbul University-Cerrahpasa, Türkiye
Chris Pruunsild, Tartu University Hospital, Estonia

© 2024 Codes Méndez, Magallares-López, Park, Mariscal, Juárez, Boronat, Martínez-Martínez and Corominas. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Hye-Sang Park, hsang@santpau.cat; Laura Martínez-Martínez, lmartinezma@santpau.cat

These authors have contributed equally to this work and share first authorship

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.