Abstract
Objectives: Standardization of myositis specific antibody (MSA) detection is of high importance because these antibodies are relevant for diagnosis and stratification of patients with idiopathic inflammatory myositis (IIM) and have the potential to be used in classification criteria. Many laboratories rely on immunoprecipitation (IP) for the detection of MSA but this approach is compromised by logistic, standardization, and regulatory challenges. Therefore, reliable alternatives to IP are mandatory. Here we aimed to compare three methods for the detection of MSA.
Methods: Our study initiated from a cohort of 1,619 IIM patients (BIRD/University of Bath serology service and UKMyoNet cohorts) and resulted in 157 unique serum samples enriched for higher prevalence of MSA characterized by the laboratory's routine methods, IP and line immunoassay (LIA: Euroimmun). All samples were tested using a novel fully automated particle-based multi-analyte technology (PMAT, Inova Diagnostics, research use only). Analyses included antibodies to PL-7, PL-12, SRP, NXP2, Mi-2, SAE, EJ, MDA5, TIF1γ, SRP, NXP2.
Results: Overall high agreements were observed between novel methods (LIA and PMAT) and IP (Cohen's kappa 0.46–0.96) for the detection of MSA. Lowest level of agreement was found for EJ and highest for SAE.
Conclusion: The data hold promise for advancements in standardization of MSA assays as well as for the potential inclusion of MSA in future classification criteria.
Introduction
Myositis specific (MSA) and myositis associated antibodies (MAA) have been used as an aid in the diagnosis of idiopathic inflammatory myopathies (IIM) for decades (1). Since many of the MSA (e.g., anti-synthetase antibodies), partly depending on the screening dilution, are accompanied by limited sensitivity of the indirect immunofluorescence (IIF) test, this method has limited utility as a screening test for suspected myositis (2–6). Especially during the past 10–15 years, many novel and clinically relevant MSA have been identified (1) which can help in the diagnosis and stratification of IIM. Since the publication of updated classification criteria for IIM (7, 8), a debate has been triggered about the exclusion of MSA (except anti-Jo-1 antibodies), which was eventually explained by the lack of standardization of autoantibody assays and missing data derived from large multi-centric studies (9, 10). Shortly afterwards, an alternative classification approach was proposed that leverages both clinical and autoantibody data (11). The aim of the present study was to compare the results from three methods for the detection of MSA, including radiolabeled protein immunoprecipitation (IP), a commonly used line immunoassay (LIA), and a newly developed particle-based multi-analyte technology (PMAT) using a large cohort of IIM patients.
Methods
From an original cohort of 1,619 IIM patients (Bath Institute for Rheumatic Diseases (BIRD)/University of Bath serology service and UKMyoNet cohorts) (12), a total of 157 patients were selected based on MSA characterized by the laboratory's routine methods, IP [as described in (13)] and line immunoassay (LIA: Euroimmun not FDA approved; OJ, EJ, PL-12, PL-7, SRP, Jo-1, Ro52, PM-75, PM-100, Ku, SAE1, NXP2, MDA5, TIF1γ, Mi-2β, Mi-2α). Demographic data was available for the majority of the patients: Median age (of 118 patients with age data available) was 53.0 years (range 4.0–83.0 years), 101 were female, 43 males (of 144 patients with gender data available). The clinical phenotypes of patients were dermatomyositis (DM, n = 76), polymyositis (PM, n = 31), myositis of unknown subtype (UM, n = 15), overlap syndromes (n = 11), juvenile DM (JDM, n = 8), anti-synthetase syndrome (ASS, n = 7), clinically amyopathic DM (CADM, n = 5), and immune-mediated necrotizing myopathy (IMNM, n = 4). Written consent to participate and to provide biological samples was obtained from all subjects according to the Declaration of Helsinki, under the local ethical committee regulations of each participating center. The study of autoantibodies in myositis patients was reviewed and approved by the North West Research Multi-center Research Ethics Committee 98/8/86. LIA results were interpreted semi-quantitatively by estimating intensities (0–3) according to instructions for use and samples >0 were defined as positive. All samples were tested using a novel PMAT system (Inova Diagnostics, research use only; PL-7, PL-12, SRP, NXP2, Mi-2, SAE, EJ, OJ, MDA5, TIF1γ and HMGCR). For the PMAT, antigens were coupled to paramagnetic particles that carry unique signatures and incubated with diluted patient samples (final sample dilution of 1:200). After 9.5 min incubation at 37°C, particles were washed and incubated 9.5 min at 37°C with anti-human IgG conjugated to phycoeryhtrin (PE). Finally, after another washing cycle, particles were analyzed through digital imaging technology. The cut-off values were previously established using IIM patients (n > 250) as well as healthy and disease controls (n = 840) using receiver operating characteristic (ROC) analysis. Best combination of sensitivity and specificity was selected. Precision of the novel PMAT system was assessed by testing samples in triplicate in three independent runs over 3 days. Coefficient of variation was expressed in percent. Antibodies to antigens only contained in the LIA and anti-OJ and anti-HMGCR antibodies were not analyzed due to the lack of positive samples or lack of IP data.
Results
When comparing the three assays IP, LIA and PMAT, the comparison showed varying qualitative agreement between the different methods (Cohen's kappa 0.46–0.96, see Table 1). Most significant differences among the methods were found for anti-PL-7, anti-Mi-2, anti-EJ, and anti-TIF1γ antibodies. When the results obtained by IP were used as reference (binary classifier) for ROC curve analysis, good discrimination and high area under the curve (AUC) values were found for the PMAT (AUC ≥ 0.82) and for most of the LIA analytes (except Mi-2, AUC = 0.68). For all analytes, the AUC values for PMAT were higher compared to LIA (see Figure 1). The precision study on PMAT demonstrated high consistency with CV% ranging from 1.8 to 5.0% with an average of 3.4%. When the results obtained with the different methods were deciphered in light of the clinical phenotype, IP and PMAT demonstrated agreement with known IIM subsets (see Supplement Table).
Table 1
| Analyte (n = IP positives) | PMAT vs. IP | LIA vs. IP | PMAT vs. LIA | |||
|---|---|---|---|---|---|---|
| NPA/PPA/TPA | Kappa (95% CI) | NPA/PPA/TPA | Kappa (95% CI) | NPA/PPA/TPA | Kappa (95% CI) | |
| PL-7 (n = 15) | 98.6/100.0/98.7 | 0.93 (0.83–1.00) | 100.0/80.0/98.1 | 0.88 (0.74–1.00) | 96.6/100.0/96.8 | 0.81 (0.65–0.97) |
| PL-12 (n = 15) | 99.3/93.3/98.7 | 0.93 (0.82–1.00) | 96.5/93.3/96.2 | 0.80 (0.65–0.96) | 99.3/73.7/96.2 | 0.80 (0.65–0.96) |
| SRP (n = 15) | 99.3/93.3/98.7 | 0.93 (0.82–1.00) | 99.4/93.3/94.3 | 0.73 (0.56–0.89) | 99.3/63.6/94.3 | 0.73 (0.56–0.89) |
| NXP2 (n = 15) | 98.6/93.3/98.1 | 0.89 (0.77–1.00) | 100.0/86.7/98.7 | 0.92 (0.81–1.00) | 97.9/100.0/98.1 | 0.89 (0.76–1.00) |
| Mi-2 (n = 15) | 100.0/93.3/99.4 | 0.96 (0.89–1.00) | 93.7/80.0/92.4 | 0.62 (0.43–0.82) | 97.8/52.4/91.7 | 0.58 (0.38–0.79) |
| SAE (n = 15) | 99.3/100.0/99.4 | 0.96 (0.89–1.00) | 97.9/100.0/98.1 | 0.90 (0.79–1.00) | 100.0/88.9/98.7 | 0.93 (0.84–1.00) |
| EJ (n = 10) | 95.2/90.0/94.9 | 0.67 (0.45–0.88) | 99.3/70.0/97.5 | 0.76 (0.54–0.99) | 93.3/75.0/92.4 | 0.46 (0.21–0.72) |
| MDA5 (n = 15) | 97.2/100.0/97.5 | 0.87 (0.74–0.99) | 96.5/93.3/96.2 | 0.80 (0.65–0.96) | 97.1/78.9/94.9 | 0.76 (0.60–0.92) |
| TIF1γ (n = 15) | 97.2/93.3/96.8 | 0.83 (0.69–0.98) | 97.2/73.3/94.9 | 0.71 (0.51–0.90) | 95.1/73.3/92.4 | 0.63 (0.43–0.83) |
Method comparison of particle-based multi-analyte technology (PMAT) vs. immunoprecipitation (IP) and line immunoassay (LIA).
NPA, negative percent agreement; PPA, positive percent agreement; TPA, total percent agreement; PMAT, particle-based multi-analyte technology; LIA, line immunoassay; IP, immunoprecipitation; SRP, signal recognition particle; TIF1γ, transcriptional intermediary factor 1 gamma; MDA5, Melanoma differentiation-associated protein 5; NXP2, nuclear matrix protein 2; SAE, small ubiquitin-like modifier activating enzyme.
Figure 1
Discussion
Careful evaluation of autoantibody assays for the detection of MSA and MAA is of utmost importance since some of these antibodies are included or being considered for IIM classification criteria (1, 8–10, 14, 15). Although only anti-Jo-1 antibodies have been included in the recent EULAR/ACR classification criteria for IIM, it was acknowledged that several other MSA also carry clinical value. In addition, several autoantibodies showed relevance for a novel approach to classify IIM (11). Consequently, the markers are not only relevant as an aid in the diagnosis, but also in the stratification to specific disease subsets (1, 11, 15). Since most of the clinical associations of MSA and MAA have been established using IP, it is important to also compare newer technologies, such as LIA and PMAT to IP (10). At present, besides IP, mostly LIA and dot blot (DB) assays are routinely used for the detection of MSA, which are convenient tools for the simultaneous detection of various antibodies, but are also accompanied by some limitations including the lack of true quality controls (14), lack of sensitivity for some analytes and subjectivity in interpretation (16). To address the subjectivity of LIA and DB, automated scanning systems have been developed and introduced (16, 17) that allow for a ‘semi-quantitative’ assessment and thus for the estimation of antibody levels (titers).
Several studies have evaluated LIAs for the detection of MSA (17–21), but only a few compared the results to IP. Of relevance, two recent studies comparing LIA and IP demonstrated different levels of agreement for several MSA (19, 22). Whilst IP may not be correct in all instances, it is commonly regarded as the “Gold Standard” technique for IIM autoantibody detection making comparative data invaluable (23). Along those lines, there is no standardized protocol of IP for the detection of autoantibodies.
One of the main challenges for the evaluation of MSA assays is the low prevalence and incidence of IIM and the low prevalence of the individual markers within IIM cohorts, especially the autoantibodies directed to the tRNA synthetases (24). Therefore, most of the conducted comparison studies only included < 5 positive samples for some of the analytes (17–19). In contrast, our study started with a large cohort of 1,619 individual IIM patients which resulted in at least ten positive cases for each of the analytes.
In the present study, we compare results obtained from three methods for the detection of MSA including IP, LIA and a newly developed PMAT. All three methods used significant different technologies and assay protocols. IP is based on the concept of antibody-antigen complexes forming in solution and the precipitated proteins visualized following polyacrylamide gel separation and autoradiography. This approach is able to detect direct and indirect antibody-antigen interactions. LIA are based on membranes (often nitrocellulose) as the solid phase which is able to passively absorb proteins. The detection is based on colorimetric precipitation on the membrane that can be (semi)-quantified. The PMAT system is based on paramagnetic particles with unique signatures with covalently coupled antigens. Read-out of the results is based on digital image analysis. All incubations are carried out under controlled temperature 37°C. Despite the technological differences, overall, we observed mostly high levels of agreement among all the methods. When comparing the kappa agreement of PMAT and LIA with IP, for 7/9 analytes PMAT demonstrated higher kappa agreement. For the remaining two analytes (NXP2 and EJ), when considering the ROC curves, the cut-off of the PMAT might be too low for EJ resulting in lower negative percent agreement and therefore in a lower kappa value. The most pronounced differences between PMAT and LIA were found for anti-SRP, anti-Mi-2, anti-EJ, and anti-TIF1γ antibodies. Underlying reasons for differences might include different antigen sources, epitope exposure, and/or assay conditions. In contrast, SAE showed high level of agreement among all methods which is in line with a previous study (20). In summary, the agreement among the methods was relatively high, especially when compared to other autoantibody assays that are part of classification criteria and are daily used to aid in the diagnosis of autoimmune diseases. As an example, anti-dsDNA antibodies are a classification criteria marker and used in the diagnosis of systemic lupus erythematosus, but the correlation among methods is relatively limited (25). When the results derived from the individual methods were compared with the well-established IIM phenotypes, PMAT and IP showed close correlation. Further studies on unselected patient cohorts are needed to further study the clinical performance for IIM.
The lack of analyte specific calibrators and controls might represent a serious concern. Consequently, reproducibility studies (intra and interassay as well as lot-to-lot) are required to exclude inter-manufacturer variability that may be derived from limited precision and reproducibility. Ideally, those studies should include sufficient samples around the cut-off and follow Clinical and Laboratory Standards Institute (CLSI) guidelines (https://clsi.org/). Another aspect toward better standardization of MSA assays is the access to proficiency testing initiatives as performed for many diagnostic tests. All those needs depend on the availability of control material. Close collaboration between research networks (12), patient groups and kit manufacturers is required to supply serum samples for calibration and quality control. Since it can be challenging to obtain large volume bulk samples, pooling of patient samples or the generation of human monoclonal antibodies could provide viable alternatives (26, 27).
Statements
Ethics statement
Study was performed using leftover patient sample and study was approved by Bath Institute for Rheumatic Diseases (BIRD)/University of Bath serology service and UKMyoNet cohorts.
Author contributions
MM, ZB, and NM established study design. HC contributed data for immunoprecipitation. CB, MR, and AS provided data on the particle-based multi-analyte technology system.
Acknowledgments
We thank Sílvia Casas for the coordination of the study. The work was also supported in part by grants from CURE JM and the Bath Institute for Rheumatic Diseases. This study includes funding from the Medical Research Council (MR/N003322/1) and Arthritis Research UK Programme Grant 18474. This report includes independent research supported by the NIHR Biomedical Research Centre Funding Scheme. The views expressed in this publication are those of the authors and not necessarily those of the NHS, the National Institute for Health Research or the Department of Health.
Conflict of interest
MM, CB, MR, and AS are employees of Inova Diagnostics (no stocks or shares). The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fimmu.2019.00848/full#supplementary-material
References
1.
McHughNJTansleySL. Autoantibodies in myositis. Nat Rev Rheumatol. (2018) 14:290–302. 10.1038/nrrheum.2018.56
2.
FritzlerMJChoiMYMahlerM. The antinuclear antibody test in the diagnosis of antisynthetase syndrome and other autoimmune myopathies. J Rheumatol. (2018) 45:444–5. 10.3899/jrheum.170258
3.
TampoiaMNotarnicolaAAbbracciaventoLFontanaAGianniniMLouisHRet al. A new immunodot assay for multiplex detection of autoantibodies in a cohort of Italian patients with idiopathic inflammatory myopathies. J Clin Lab Anal. (2016) 30:859–66. 10.1002/jcla.21948
4.
Agmon-LevinNDamoiseauxJKallenbergCSackUWitteTHeroldMet al. International recommendations for the assessment of autoantibodies to cellular antigens referred to as anti-nuclear antibodies. Ann Rheum Dis. (2014) 73:17–23. 10.1136/annrheumdis-2013-203863
5.
AggarwalRDhillonNFertigNKoontzDQiZOddisCV. A negative antinuclear antibody does not indicate autoantibody negativity in myositis: role of anticytoplasmic antibody as a screening test for antisynthetase syndrome. J Rheumatol. (2017) 44:223–9. 10.3899/jrheum.160618
6.
AggarwalROddisCV. Drs. Aggarwal and Oddis reply. J Rheumatol. (2018) 45:446. 10.3899/jrheum.171430
7.
LundbergIETjarnlundABottaiMWerthVPPilkingtonCdeVMet al. 2017 European League Against Rheumatism/American College of Rheumatology classification criteria for adult and juvenile idiopathic inflammatory myopathies and their major subgroups. Arthritis Rheumatol. (2017) 69:2271–82. 10.1002/art.40320
8.
LundbergIETjarnlundABottaiMWerthVPPilkingtonCVisserMet al. 2017 European League Against Rheumatism/American College of Rheumatology classification criteria for adult and juvenile idiopathic inflammatory myopathies and their major subgroups. Ann Rheum Dis. (2017) 76:1955–64. 10.1136/annrheumdis-2017-211468
9.
MalaviyaAN. 2017 EULAR/ACR classification criteria for adult and juvenile idiopathic inflammatory myopathies and their major subgroups: little emphasis on autoantibodies, why?Ann Rheum Dis. (2017) 77:e77. 10.1136/annrheumdis-2017-212701
10.
LundbergIEBottaiMTjarnlundA. Response to: ‘Performance of the 2017 European League Against Rheumatism/American College of Rheumatology classification criteria for adult and juvenile idiopathic inflammatory myopathies in clinical practice’ by Hocevar et al. Ann Rheum Dis. (2018) 77:e91. 10.1136/annrheumdis-2017-212786
11.
MariampillaiKGrangerBAmelinDGuiguetMHachullaEMaurierFet al. Development of a new classification system for idiopathic inflammatory myopathies based on clinical manifestations and myositis-specific autoantibodies. JAMA Neurol. (2018) 75:1528–37. 10.1001/jamaneurol.2018.2598
12.
LillekerJBVencovskyJWangGWedderburnLRDiederichsenLPSchmidtJet al. The EuroMyositis registry: an international collaborative tool to facilitate myositis research. Ann Rheum Dis. (2018) 77:30–9. 10.1136/annrheumdis-2017-211868
13.
BetteridgeZGunawardenaHNorthJSlinnJMcHughN. Anti-synthetase syndrome: a new autoantibody to phenylalanyl transfer RNA synthetase (anti-Zo) associated with polymyositis and interstitial pneumonia. Rheumatology(Oxford). (2007) 46:1005–8. 10.1093/rheumatology/kem045
14.
MahlerMFritzlerMJ. Detection of myositis-specific antibodies: additional notes. Ann Rheum Dis. (2018). 10.1136/annrheumdis-2018-213153
15.
LundbergIEdeVMWerthVP. Classification of myositis. Nat Rev Rheumatol. (2018) 14:269–78. 10.1038/nrrheum.2018.41
16.
MahlerMMeroniPLBossuytXFritzlerMJ. Current concepts and future directions for the assessment of autoantibodies to cellular antigens referred to as anti-nuclear antibodies. J Immunol Res. (2014) 2014:315179. 10.1155/2014/315179
17.
GhirardelloARampuddaMEkholmLBassiNTarriconeEZampieriSet al. Diagnostic performance and validation of autoantibody testing in myositis by a commercial line blot assay. Rheumatology (Oxford). (2010) 49:2370–4. 10.1093/rheumatology/keq281
18.
VulstekeJBDeLEClaeysKGDillaertsDPoesenKLenaertsJet al. Detection of myositis-specific antibodies. Ann Rheum Dis. (2018). 78:e7. 10.1136/annrheumdis-2017-212915
19.
CavazzanaIFrediMCeribelliAMordentiCFerrariFCarabelleseNet al. Testing for myositis specific autoantibodies: comparison between line blot and immunoprecipitation assays in 57 myositis sera. J Immunol Methods. (2016) 433:1–5. 10.1016/j.jim.2016.02.017
20.
PetersonLKJaskowskiTDLa'uluSLTeboAE. Antibodies to small ubiquitin-like modifier activating enzyme are associated with a diagnosis of dermatomyositis: results from an unselected cohort. Immunol Res. (2018) 66:431–6. 10.1007/s12026-018-9006-7
21.
RonnelidJBarbassoHSStorforsHGripKRonnblomLFranck-LarssonKet al. Use of a commercial line blot assay as a screening test for autoantibodies in inflammatory myopathies. Autoimmun Rev. (2009) 9:58–61. 10.1016/j.autrev.2009.03.005
22.
Espinosa-OrtegaFHolmqvistMAlexandersonHStorforsHMimoriTLundbergIEet al. Comparison of autoantibody specificities tested by a line blot assay and immunoprecipitation-based algorithm in patients with idiopathic inflammatory myopathies. Ann Rheum Dis. (2019). 10.1136/annrheumdis-2018-214690 [Epub ahead of print].
23.
PaltererBVitielloGCarraresiAGiudiziMGCammelliDParronchiP. Bench to bedside review of myositis autoantibodies. Clin Mol Allergy. (2018) 16:5. 10.1186/s12948-018-0084-9
24.
MahlerMMillerFWFritzlerMJ. Idiopathic inflammatory myopathies and the anti-synthetase syndrome: a comprehensive review. Autoimmun Rev. (2014) 13:367–71. 10.1016/j.autrev.2014.01.022
25.
MummertEFritzlerMJSjowallCBentowCMahlerM. The clinical utility of anti-double-stranded DNA antibodies and the challenges of their determination. J Immunol Methods. (2018) 459:11–9. 10.1016/j.jim.2018.05.014
26.
SheldonJDellavanceA. Strategies for building reference standards for autoantibodies. Front Immunol. (2015) 6:194. 10.3389/fimmu.2015.00194
27.
JacobsJFMBossuytX. Standardization and harmonization of autoimmune diagnostics. Clin Chem Lab Med. (2018) 56:1563–7. 10.1515/cclm-2018-0807
Summary
Keywords
myositis, autoantibodies, diagnosis, polymyosits, dermatomyositis, immunoassay
Citation
Mahler M, Betteridge Z, Bentow C, Richards M, Seaman A, Chinoy H and McHugh N (2019) Comparison of Three Immunoassays for the Detection of Myositis Specific Antibodies. Front. Immunol. 10:848. doi: 10.3389/fimmu.2019.00848
Received
19 November 2018
Accepted
01 April 2019
Published
30 April 2019
Volume
10 - 2019
Edited by
Ann Marie Reed, Duke University School of Medicine, United States
Reviewed by
Clio Mavragani, National and Kapodistrian University of Athens, Greece; Raju P. Khubchandani, Jaslok Hospital, India
Updates
Copyright
© 2019 Mahler, Betteridge, Bentow, Richards, Seaman, Chinoy and McHugh.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Michael Mahler mmahler@inovadx.com; m.mahler.job@web.de
This article was submitted to Autoimmune and Autoinflammatory Disorders, a section of the journal Frontiers in Immunology
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.