Skip to main content

ORIGINAL RESEARCH article

Front. Immunol., 10 November 2023
Sec. Autoimmune and Autoinflammatory Disorders: Autoinflammatory Disorders
This article is part of the Research Topic Advances in Musculoskeletal Imaging View all 3 articles

Artificial intelligence for the detection of sacroiliitis on magnetic resonance imaging in patients with axial spondyloarthritis

Seulkee Lee&#x;Seulkee Lee1†Uju Jeon&#x;Uju Jeon2†Ji Hyun LeeJi Hyun Lee3Seonyoung KangSeonyoung Kang1Hyungjin KimHyungjin Kim1Jaejoon LeeJaejoon Lee1Myung Jin Chung,Myung Jin Chung2,4Hoon-Suk Cha*Hoon-Suk Cha1*
  • 1Department of Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea
  • 2Medical AI Research Center, Samsung Medical Center, Seoul, Republic of Korea
  • 3Department of Radiology, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea
  • 4Department of Data Convergence and Future Medicine, Sungkyunkwan University School of Medicine, Suwon, Republic of Korea

Background: Magnetic resonance imaging (MRI) is important for the early detection of axial spondyloarthritis (axSpA). We developed an artificial intelligence (AI) model for detecting sacroiliitis in patients with axSpA using MRI.

Methods: This study included MRI examinations of patients who underwent semi-coronal MRI scans of the sacroiliac joints owing to chronic back pain with short tau inversion recovery (STIR) sequences between January 2010 and December 2021. Sacroiliitis was defined as a positive MRI finding according to the ASAS classification criteria for axSpA. We developed a two-stage framework. First, the Faster R-CNN network extracted regions of interest (ROIs) to localize the sacroiliac joints. Maximum intensity projection (MIP) of three consecutive slices was used to mimic the reading of two adjacent slices. Second, the VGG-19 network determined the presence of sacroiliitis in localized ROIs. We augmented the positive dataset six-fold. The sacroiliitis classification performance was measured using the sensitivity, specificity, and area under the receiver operating characteristic curve (AUROC). The prediction models were evaluated using three-round three-fold cross-validation.

Results: A total of 296 participants with 4,746 MRI slices were included in the study. Sacroiliitis was identified in 864 MRI slices of 119 participants. The mean sensitivity, specificity, and AUROC for the detection of sacroiliitis were 0.725 (95% CI, 0.705–0.745), 0.936 (95% CI, 0.924–0.947), and 0.830 (95%CI, 0.792–0.868), respectively, at the image level and 0.947 (95% CI, 0.912–0.982), 0.691 (95% CI, 0.603–0.779), and 0.816 (95% CI, 0.776–0.856), respectively, at the patient level. In the original model, without using MIP and dataset augmentation, the mean sensitivity, specificity, and AUROC were 0.517 (95% CI, 0.493–0.780), 0.944 (95% CI, 0.933–0.955), and 0.731 (95% CI, 0.681–0.780), respectively, at the image level and 0.806 (95% CI, 0.729–0.883), 0.617 (95% CI, 0.523–0.711), and 0.711 (95% CI, 0.660–0.763), respectively, at the patient level. The performance was improved by MIP techniques and data augmentation.

Conclusion: An AI model was developed for the detection of sacroiliitis using MRI, compatible with the ASAS criteria for axSpA, with the potential to aid MRI application in a wider clinical setting.

1 Introduction

Axial spondyloarthritis (axSpA) is a chronic inflammatory disease that predominantly affects the axial skeleton, including the sacroiliac (SI) joints (1, 2). Historically, axSpA was the result of the recognition of the early phases of the disease, termed ankylosing spondylitis (AS). In the era of the modified New York criteria, SI joint damage had to be evident on plain radiographs to fulfil the criteria for AS (3). However, magnetic resonance imaging (MRI) can recognize inflammation of the SI joints before the development of erosions that show radiographic changes on plain radiographs. Therefore, MRI of the SI joints is becoming increasingly important for early diagnosis and treatment of axSpA (4). Among the several MRI findings observed in axSpA, subchondral bone marrow edema (BME), which indicates active inflammation, was identified as a finding suggestive of sacroiliitis. The Assessment of SpondyloArthritis international Society (ASAS) criterion defined the presence of definite subchondral BME that is highly suggestive of sacroiliitis in semi-coronal short tau inversion recovery (STIR) sequences as “positive MRI” (5). Despite these advances, MRI interpretation of SI joints is labor-intensive, requires the acquisition of special skills, and shows variable results, even among experienced specialists (6).

The range of AI applications has recently expanded. Image data are advantageous for learning using AI because the input is presented as objective numbers, and the amount of data is large. Therefore, AI exhibits excellent performance in the field of picture recognition (7). Based on these results, efforts have been made to apply AI to various medical imaging (8, 9). In patients with axSpA, studies have used plain radiographs as inputs for machine learning to detect radiographic sacroiliitis (10) or the extent of radiographic progression (11).

Deep learning is a subtype of AI that uses many hidden layers for nonlinear process and extraction of important features. Deep learning has previously been applied to various MRI data (1214) including that of musculoskeletal system (15, 16). Therefore, the use of deep learning to detect sacroiliitis on the MRI of patients with axSpA appears promising. The Faster Region-based Convolutional Neural Network (R-CNN) (17) and Visual Geometry Group (VGG) network (18) are types of deep learning that have shown high performance in image classification tasks, owing to their computational efficacy (19) and higher performance than traditional methods (1922).

In this study, we used Faster R-CNN and VGG-19 to detect sacroiliitis according to the ASAS definition of positive MRI in patients with axSpA.

2 Materials and methods

2.1 Study sample

This retrospectisve study was conducted at the Samsung Medical Center, a tertiary referral hospital in Seoul, South Korea. We included patients who (1) visited the rheumatology clinic because of chronic back pain (> 3 months), (2) underwent semi-coronal MRI scans of the SI joints with STIR sequences between January 2010 and December 2021, and (3) were older than 18 years. We excluded cases in which the inflammation of the SI joint could not be evaluated because of artifacts, such as in patients who underwent total hip replacement, and patients with inconclusive clinical diagnoses. The STIR sequences of the SI joints were obtained using four 3.0-T MRI scanners from two companies: Ingenia, Ingenia CX, and Achieva from Phillips Healthcare and Skyra from Siemens Healthineers for 47, 26, 80, and 143 patients, respectively.

2.2 Data labeling

Sacroiliitis was identified independently by a rheumatologist (SL) and radiologist (JHL) using the definition of MRI sacroiliitis according to the ASAS classification criteria for axSpA. Active inflammatory lesions of the SI joint associated with spondyloarthritis on MRI were defined as the presence of BME visualized as hyperintensity in at least two consecutive slices or in at least two locations within a single slice, according to the ASAS criteria (5). The raters were blinded to the clinical data. Discrepancies in interpretation were resolved by a consensus. In addition, we extracted the bilateral SI joints by drawing bounding boxes to reduce the noise of unnecessary information when evaluating sacroiliitis. These ROIs were independently outlined by a rheumatologist (SL) and a radiologist (MCJ).

2.3 Model training

The pipeline for the proposed automatic sacroiliitis classification method is shown in Figure 1. First, all MR images were normalized, and the ROIs of the SI joints were extracted from the entire MRI. The presence of sacroiliitis was determined on individual MRI slices of localized SI joint ROIs.

FIGURE 1
www.frontiersin.org

Figure 1 Artificial intelligence framework to detect sacroiliitis in accordance with the assessment of spondyloArthritis international society criteria for axial spondyloarthritis.

2.4 Image pre-processing and sacroiliac joints localization

MRI shows a large intensity variation between different patients, as well as different slices within one patient (Supplementary Figure 1). Thus, we applied adaptive histogram equalization (23) to three-dimensional volume MRI of each patient to normalize the MRI for each patient. The regions other than SI joints can affect the diagnosis of sacroiliitis and interfere in the extraction of important features for the diagnosis of sacroiliitis (24). Thus, a deep convolutional neural network was used to efficiently localize the SI joints and automatically extract the ROIs. First, Faster R-CNN with ResNet-50 (25) was used to extract the ROIs of the SI joints using the entire MRI (Supplementary Figure 2A). Second, the ROIs extracted by the network were cropped and resized to a resolution of 128 × 256 for use as inputs to the classification network (Supplementary Figure 2B). One ROI each was extracted from the left and right sides of the SI joint.

2.5 Image post-processing and sacroiliitis classification

The classification network determined the presence of sacroiliitis based on the brightness distribution of pixels in the localized ROIs and contextual information based on the positional relationships between consecutive slices. MIP (26) was applied to three consecutive slices to mimic the process of comparing two adjacent slices before identifying the inflammatory lesion. In addition, the class imbalance between the positive and negative labels causes the network to become overfit for the majority class (negative labels). To overcome this problem, we utilized data augmentation techniques, including blurring, adjusting contrast, adding noise, rotating, and sharpening of positive labels. Because acquiring a large number of MRI scans for the diagnosis of sacroiliitis is difficult, we used transfer learning (27) to effectively train the network. As shown in Figure 1, the pre-trained VGG-19 was applied as a classification network using post-processed localized ROIs as inputs. The architecture of VGG-19 used in this study is illustrated in Supplementary Figure 3. More details are provided in the supplemental methods.

2.6 Comparing prediction results with ground truth of sacroiliitis and clinical diagnosis

Through each one-round cross-validation, each individual obtained a prediction result once. Because we performed a three-round cross-validation, each individual in this study had three prediction results. We repeated the prediction thrice to robustly compare the prediction performance by randomly dividing the training and validation groups thrice during cross-validation, which was not intended to confirm individual prediction results. However, to compare the ground truth and prediction results, we defined a prediction as positive when a patient was unanimously predicted to have sacroiliitis by all three predictions. We then compared the prediction results with the ground truth used for the labeling and diagnosis of axSpA by a rheumatologist based on a combination of clinical factors. We defined the patients who were clinically diagnosed with axSpA as ‘axSpA’ group, and the patients who were not diagnosed with axSpA as ‘nonspecific back pain’ group.

2.7 Statistical analyses

To evaluate the sacroiliitis classification performance, we compared the proposed method (Method C) with sacroiliitis classification results without augmentation and MIP (Method A) and sacroiliitis classification results using augmentation but without MIP (Method B). Sensitivity, specificity, and AUROC were used to determine the performances of classification algorithms. The intersection over union (IoU) was used to measure the gap between the ground truth and the predicted results of ROIs. The performances were obtained by averaging nine performances from three-round three-fold cross-validation. When assessing the performance of the AI model using the test dataset, we refrained from employing data augmentation and instead made predictions using the trained model with real MRI images. This approach was chosen to evaluate performance under actual conditions, without the use of simulated input images. More details are provided in the eMethods.

Statistical analyses of the clinical variables were performed using R version 4.1.3 (28). The interobserver reliability of positive sacroiliitis on MRI was determined using Cohen’s kappa coefficient (29). The chi-square test was performed to compare the prediction results of the individual patients with the ground truth and the clinical diagnosis of axSpA. All p-values were two-sided, and a p-value less than 0.05 was considered statistically significant.

3 Results

3.1 Characteristics of participants

A total of 296 participants with 4,746 MRI slices were included in this study (Supplementary Figure 4). A total of 167 participants had axSpA and 129 had nonspecific back pain. Sacroiliitis consistent with axSpA, as defined by the ASAS classification criteria, was identified in 119 participants (Supplementary Table 1). The clinical characteristics of the participants who underwent MRI are presented in Table 1. The participants were 36.8 years old on average and predominantly male (174/296, 58.8%). Among the participants with axSpA, 96 (57.5%) fulfilled the modified New York radiographic criteria for AS, and 153 (91.6%) were human leukocyte antigen B27 positive (153/167, 91.6%). The mean C-reactive protein level in patients with axSpA was 1.37 mg/dl.

TABLE 1
www.frontiersin.org

Table 1 Baseline characteristics of patients.

3.2 Interobserver reliability of sacroiliitis in MRI

The raters reached substantial agreement. The Cohen’s Kappa coefficient was 0.876 (95% CI: 0.771–0.981) for the identification of sacroiliitis compatible with the ASAS definition between the two readers (SL and JHL).

3.3 Localization of SI joints

First, the SI joints were localized using AI (Supplementary Figure 5). The average IoUs of the predicted results were 74.23% and 74.37% for the right and left SI joints, respectively (Supplementary Table 2). The predicted ROIs covered most SI joints, even in relatively poorly predicted cases (Supplementary Figure 5B). Therefore, we concluded that the AI that predicted the SI joint had sufficient performance for further analysis.

3.4 Detection of sacroiliitis compatible with the ASAS definition using artificial intelligence

On average, the final AI model (Method C) for the detection of sacroiliitis compatible with the ASAS definition of axSpA showed a sensitivity of 0.725 (95% CI, 0.705–0.745), specificity of 0.936 (95% CI, 0.924–0.947), and AUROC of 0.830 (95% CI, 0.792–0.868) in individual MRI slices, and a sensitivity of 0.947 (95% CI, 0.912–0.982), specificity of 0.691 (95% CI, 0.603–0.779), and AUROC of 0.816 (95% CI, 0.776–0.856) in individual participants after three-round three-fold cross-validation compared with the reference standard by two raters (Table 2). The performance of sacroiliitis detection improved gradually from deep learning directly on the raw image (Method A) by implementing augmentation (Method B) and further by performing both augmentation and MIP (Method C). The confusion matrices for the detection of sacroiliitis per image and subject are shown in Figure 2 and Supplementary Figure 6.

TABLE 2
www.frontiersin.org

Table 2 Performances of artificial intelligence models for the detection of sacroiliitis compatible with the assessment of spondyloArthritis international society definition.

FIGURE 2
www.frontiersin.org

Figure 2 Confusion matrices of the first-round cross-validation using the proposed method (Method C) for detecting sacroiliitis (A) for individual MRI slices; (B) for each subject.

3.5 Comparing prediction results with the ground truth of sacroiliitis and clinical diagnosis

We compared the prediction results with the ground truth of sacroiliitis and the clinical diagnosis of axSpA (Supplementary Table 3). A total of 21 false-positive cases occurred in the prediction by the unanimous decision of the predictive value of the three rounds. Of the 21 false-positive cases, 10 occurred in patients who were not clinically diagnosed with axSpA and 11 in patients who were clinically diagnosed with axSpA. A total of 53 patients existed who did not meet the ASAS criteria for “positive MRI” but were clinically diagnosed with axSpA, and the model generated in this study showed that significantly more false positives occurred in patients with clinically diagnosed axSpA than in those without (p=0.033, Supplementary Table 4). On the other hand, because patients with negative clinical diagnoses of axSpA had only positive sacroiliitis in five patients, we could not find additive information comparing false-negative cases with clinical diagnoses.

Figure 3 shows examples of gradient-weighted class activation mapping (Grad-CAM) used to visualize the models’ decisions and highlight the regions relevant to model predictions. In these examples, the place of BME matched with higher activations of Grad-CAM in method C, better than method A or B.

FIGURE 3
www.frontiersin.org

Figure 3 Examples of gradient-weighted class activation mapping (Grad-CAM) for the classification model from two different patients. The place of bone marrow edema matched with higher activations of Grad-CAM in method C, better than method A or B.

4 Discussion

We generated AI models to detect sacroiliitis according to the ASAS definition of positive MRI in patients with axSpA. We used the Faster R-CNN and VGG-19 algorithms, and the performance was improved by MIP techniques and data augmentation. The AUROCs were above 0.8 on an individual slice basis and on a per-patient basis.

MRI has recently gained importance in the diagnosis of axSpA and the assessment of disease activity because it can detect inflammation in patients with axSpA before structural changes are observed on plain radiographs. However, MRI findings of sacroiliitis in the ASAS criteria may have false positives (30) or false negatives (31). Therefore, MRI readings for sacroiliitis require a specialist with experience in MRI readings of musculoskeletal diseases.

This study included all MRI scans to evaluate the SI joint that were performed over a 12-year period in the rheumatology department for chronic back pain. This allowed the inclusion of a diverse patient population, including patients with nonspecific back pain and axSpA. An AI model was created and evaluated using MRI scans from four different machines of two different companies. Therefore, this study had the advantage of including all MRI scans performed to evaluate sacroiliitis in real-world clinical practice, allowing us to evaluate the model in the same context as patients encountered in a real-world clinical practice.

Notably, increasing the positive dataset through augmentation and training with MIP to include data from the anterior and posterior image slices improved the performance of the AI model. When collecting data to determine the presence of sacroiliitis, a small number of image slices contained actual inflammatory lesions, even in patients with positive axSpA MRI findings. Because patients without sacroiliitis must also be included in the training, the negative dataset will always outnumber the positive dataset for learning about active inflammatory sacroiliitis. In this case, augmentation increased the number of positive datasets. In addition, because the definition of positive MRI in the ASAS criteria for axSpA includes cases in which a single BME is observed in two or more consecutive image slices, to implement this, we used MIP to consider the anterior and posterior slices together in training. Because we confirmed that the augmentation and MIP techniques applied with a theoretical background improved the performance of the AI model, we expect that the same process will improve the performance of AI models with different structures in the future.

Several studies have examined active inflammation in SI joints using machine learning (10, 24, 32). Previous studies had comparable performance in predicting active inflammatory lesions in SI joints, and the definition of active inflammation was based on positive MRI findings compatible with the ASAS criteria for axSpA, as in the present study. However, no study has compared predicted results with the clinical diagnosis of axSpA.

The inclusion of MRI in radiographic diagnosis in the ASAS criteria has greatly improved the early diagnosis of axSpA. However, with only active inflammation included in the criteria, concerns exist about false positives and false negatives. As already known, BME can be observed on MRI as a false positive in osteitis condensans ilii or athletes with high physical activity (30, 33, 34), and in chronic disease, active inflammation may not be observed and may be reported as a false negative (31). In this study, patients without active inflammation based on the ASAS criteria for axSpA, but with a positive AI prediction, were significantly more likely to be clinically diagnosed with axSpA. Although the exact factors that contributed to this could not be analyzed in this study, probably, factors other than active inflammation were trained together and contributed to the prediction of clinical axSpA. Therefore, in addition to active inflammation, other factors around the SI joint might contribute to the diagnosis of axSpA in our AI model.

A few types of chronic inflammatory lesions have also been described as specific MRI findings of axSpA. Sclerosis, erosion, fat deposition, and ankylosis are typical of axSpA (5), and these findings are significantly less common in athletes or postpartum conditions which may show BME similar to axSpA (34, 35). However, quantitative criteria for the classification of axSpA for chronic inflammatory lesions have not yet been established and are not included in the ASAS criteria for the definition of positive MRI. Furthermore, T1-weighted images are required for evaluation in addition to the STIR sequences used in this study. For this reason, this analysis was not performed in this study, but it is expected that chronic inflammatory lesions will play a role in improving prediction performance.

In contrast, previous research suggested an association between the presence of non-inflammatory spine abnormalities and BME, fulfilling the ASAS definition of MRI sacroiliitis in patients with definite mechanical chronic back pain (36). Based on this, it is expected that by considering non-inflammatory bony abnormalities together, we may achieve a better differentiation of sacroiliitis caused by mechanical issues. Additionally, we believe that including images of the spine, another major site commonly affected by axSpA, would be advantageous for the predictive model. However, because accurate labeling is required for the creation of a prediction model, we still need to evaluate the clinical utility of non-inflammatory lesions and spine images for the diagnosis of axSpA applying them to a prediction model for sacroiliitis. Our study had several limitations. First, because no true ground truth existed for the presence of axSpA sacroiliitis, the consensus of multiple experts was used as the ground truth. The diagnosis uncertainty introduces noise into the dataset and affects the performance of the model. However, we assumed that the ground truth was of good quality because the two experts agreed substantially, with high interobserver reliability. Second, this study was designed to detect active inflammation; therefore, it could not distinguish between BME caused by other factors, such as physical activity or childbirth. These changes might be difficult to distinguish from axSpA based on imaging findings alone. Third, the AI model could not be evaluated using MRI scans from different institutes. Therefore, generalizing these results to MRI images is difficult using new scanners and protocols. However, because the study was trained and tested using images acquired from four different MRI machines over a 12-year period, we believe that it can be applied to MRI images captured in new environments. Fourth, one of the conditions for positive MRI to qualify for the ASAS criteria, finding at least two independent BME in a single slice, was not included in the model generation. The ASAS criteria mention two conditions regarding the amount of signal required to determine a positive MRI: if there is only one signal, it should be present in at least two slices (5). If there is more than one signal in a single slice, one slice may be sufficient. The MIP method was introduced for training when a single signal was identified in at least two consecutive slices; however, the method for identifying the existence of more than two independent signals in one slice was not implemented separately when creating the model. Although we did not provide information regarding the presence of two independent signals, we believe that additional post-processing may not be required because all the information is already in a single given, and previous studies have also achieved successful results without the information needed to detect distinct BMEs in a single slice (10, 32). Fifth, we did not test the AI model in practical applications. Although we believe that the AI model significantly reduces inter-observer variability and is useful for identifying sacroiliitis in a practice setting without a musculoskeletal imaging specialist, our study was not tested in a real-world setting. Further research is required to demonstrate the usefulness of the AI model in real-world practice.

In conclusion, an AI model was developed for the detection of sacroiliitis on MRI, compatible with the ASAS criteria for axSpA, with the potential to aid MRI applications in a wider clinical setting.

Data availability statement

The original contributions presented in the study are included in the article/Supplementary Material. Further inquiries can be directed to the corresponding author.

Ethics statement

This study complied with the principles of the Declaration of Helsinki. The Institutional Review Board of the Samsung Medical Center approved this study (SMC 2021-10-121). This study was performed using the data extracted from the Clinical Data Warehouse (CDW) Darwin-C at the Samsung Medical Center. The requirement for informed consent was waived because we used only de-identified data collected from the CDW.

Author contributions

SL: Conceptualization, Data curation, Formal Analysis, Funding acquisition, Investigation, Methodology, Resources, Validation, Writing – original draft, Writing – review and editing. UJ: Conceptualization, Data curation, Formal Analysis, Investigation, Methodology, Software, Validation, Visualization, Writing – original draft, Writing – review and editing. JHL: Conceptualization, Formal Analysis, Investigation, Writing – review and editing. SK: Conceptualization, Writing – review and editing. HK: Conceptualization, Writing – review and editing. JL: Conceptualization, Writing – review and editing. MC: Conceptualization, Formal Analysis, Funding acquisition, Investigation, Methodology, Resources, Software, Supervision, Writing – review and editing. H-SC: Conceptualization, Resources, Supervision, Writing – review and editing.

Acknowledgments

The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This research was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea Government (MSIT) (No.2021M3H9A2097957, 2021R1F1A1062148, and 2022R1F1A1071471) and funded by the Future Medicine 20*30 Project of the Samsung Medical Center [SMO1230061].

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fimmu.2023.1278247/full#supplementary-material

References

1. Danve A, Deodhar A. Treatment of axial spondyloarthritis: an update. Nat Rev Rheumatol (2022) 18(4):205–16. doi: 10.1038/s41584-022-00761-z

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Nikiphorou E, Hannonen P, Asikainen J, Borodina J, Kokko A, Paalanen K, et al. Survival and safety of infliximab bio-original and infliximab biosimilar (CT-P13) in usual rheumatology care. Clin Exp Rheumatol (2019) 37(1):55–9. doi: 10.4078/jrd.2021.28.2.55

PubMed Abstract | CrossRef Full Text | Google Scholar

3. van der Linden S, Valkenburg HA, Cats A. Evaluation of diagnostic criteria for ankylosing spondylitis. A proposal for modification of the New York criteria. Arthritis Rheum (1984) 27(4):361–8. doi: 10.1002/art.1780270401

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Sieper J, Poddubnyy D. Axial spondyloarthritis. Lancet (2017) 390(10089):73–84. doi: 10.1016/s0140-6736(16)31591-4

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Sieper J, Rudwaleit M, Baraliakos X, Brandt J, Braun J, Burgos-Vargas R, et al. The Assessment of SpondyloArthritis international Society (ASAS) handbook: a guide to assess spondyloarthritis. Ann Rheum Dis (2009) 68(Suppl 2):ii1–44. doi: 10.1136/ard.2008.104018

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Schwartzman M, Maksymowych WP. Is there a role for MRI to establish treatment indications and effectively monitor response in patients with axial spondyloarthritis? Rheum Dis Clin North Am (2019) 45(3):341–58. doi: 10.1016/j.rdc.2019.04.009

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Yamashita R, Nishio M, Do RKG, Togashi K. Convolutional neural networks: an overview and application in radiology. Insights Imaging (2018) 9(4):611–29. doi: 10.1007/s13244-018-0639-9

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Pesapane F, Codari M, Sardanelli F. Artificial intelligence in medical imaging: threat or opportunity? Radiologists again at the forefront of innovation in medicine. Eur Radiol Exp (2018) 2(1):35. doi: 10.1186/s41747-018-0061-6

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Oren O, Gersh BJ, Bhatt DL. Artificial intelligence in medical imaging: switching from radiographic pathological data to clinically meaningful endpoints. Lancet Digit Health (2020) 2(9):e486–e8. doi: 10.1016/S2589-7500(20)30160-6

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Bressem KK, Vahldiek JL, Adams L, Niehues SM, Haibel H, Rodriguez VR, et al. Deep learning for detection of radiographic sacroiliitis: achieving expert-level performance. Arthritis Res Ther (2021) 23(1):106. doi: 10.1186/s13075-021-02484-0

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Koo BS, Lee JJ, Jung JW, Kang CH, Joo KB, Kim TH, et al. A pilot study on deep learning-based grading of corners of vertebral bodies for assessment of radiographic progression in patients with ankylosing spondylitis. Ther Adv Musculoskelet Dis (2022) 14:1759720x221114097. doi: 10.1177/1759720x221114097

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Gao P, Shan W, Guo Y, Wang Y, Sun R, Cai J, et al. Development and validation of a deep learning model for brain tumor diagnosis and classification using magnetic resonance imaging. JAMA Netw Open (2022) 5(8):e2225608. doi: 10.1001/jamanetworkopen.2022.25608

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Wu Q, Wang S, Zhang S, Wang M, Ding Y, Fang J, et al. Development of a deep learning model to identify lymph node metastasis on magnetic resonance imaging in patients with cervical cancer. JAMA Netw Open (2020) 3(7):e2011625. doi: 10.1001/jamanetworkopen.2020.11625

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Yu Y, Xie Y, Thamm T, Gong E, Ouyang J, Huang C, et al. Use of deep learning to predict final ischemic stroke lesions from initial magnetic resonance imaging. JAMA Netw Open (2020) 3(3):e200772. doi: 10.1001/jamanetworkopen.2020.0772

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Bien N, Rajpurkar P, Ball RL, Irvin J, Park A, Jones E, et al. Deep-learning-assisted diagnosis for knee magnetic resonance imaging: Development and retrospective validation of MRNet. PloS Med (2018) 15(11):e1002699. doi: 10.1371/journal.pmed.1002699

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Yeh LR, Zhang Y, Chen JH, Liu YL, Wang AC, Yang JY, et al. A deep learning-based method for the diagnosis of vertebral fractures on spine MRI: retrospective training and validation of ResNet. Eur Spine J (2022) 31(8):2022–30. doi: 10.1007/s00586-022-07121-1

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Ren S, He K, Girshick R, Sun J. Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell (2017) 39(6):1137–49. doi: 10.1109/tpami.2016.2577031

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition (2014). Available at: https://arxiv.org/abs/1409.1556 (Accessed February 20, 2023).

Google Scholar

19. Lei X, Sui Z. Intelligent fault detection of high voltage line based on the Faster R-CNN. Measurement (2019) 138:379–85. doi: 10.1016/j.measurement.2019.01.072

CrossRef Full Text | Google Scholar

20. Li Z, Wu F, Hong F, Gai X, Cao W, Zhang Z, et al. Computer-aided diagnosis of spinal tuberculosis from CT images based on deep learning with multimodal feature fusion. Front Microbiol (2022) 13:823324. doi: 10.3389/fmicb.2022.823324

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Maraş Y, Tokdemir G, Üreten K, Atalar E, Duran S, Maraş H. Diagnosis of osteoarthritic changes, loss of cervical lordosis, and disc space narrowing on cervical radiographs with deep learning methods. Jt Dis Relat Surg (2022) 33(1):93–101. doi: 10.52312/jdrs.2022.445

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Olczak J, Fahlberg N, Maki A, Razavian AS, Jilert A, Stark A, et al. Artificial intelligence for analyzing orthopedic trauma radiographs. Acta Orthop (2017) 88(6):581–6. doi: 10.1080/17453674.2017.1344459

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Hummel R. Image enhancement by histogram transformation. Comput Graph Image Process (1977) 6(2):184–95. doi: 10.1016/S0146-664X(77)80011-7

CrossRef Full Text | Google Scholar

24. Lee KH, Choi ST, Lee GY, Ha YJ, Choi SI. Method for diagnosing the bone marrow edema of sacroiliac joint in patients with axial spondyloarthritis using magnetic resonance image analysis based on deep learning. Diagn (Basel) (2021) 11(7):1156. doi: 10.3390/diagnostics11071156

CrossRef Full Text | Google Scholar

25. He K, Zhang X, Ren S, Sun J. (2016). Deep residual learning for image recognition, in: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA. pp. 770–8.

Google Scholar

26. Wallis JW, Miller TR, Lerner CA, Kleerup EC. Three-dimensional display in nuclear medicine. IEEE Trans Med Imaging (1989) 8(4):297–30. doi: 10.1109/42.41482

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Pan SJ, Yang Q. A survey on transfer learning. IEEE Trans Knowl Data Eng (2010) 22(10):1345–59. doi: 10.1109/TKDE.2009.191

CrossRef Full Text | Google Scholar

28. R Developement Core Team. A language and environment for statistical computing. Available at: http://www.R-project.org (Accessed 20 February 2023).

Google Scholar

29. McHugh ML. Interrater reliability: the kappa statistic. Biochem Med (Zagreb) (2012) 22(3):276–82. doi: 10.11613/BM.2012.031

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Hoballah A, Lukas C, Leplat C, Taourel P, Pialat JB, Sans N, et al. MRI of sacroiliac joints for the diagnosis of axial SpA: prevalence of inflammatory and structural lesions in nulliparous, early postpartum and late postpartum women. Ann Rheum Dis (2020) 79(8):1063–9. doi: 10.1136/annrheumdis-2020-217208

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Diekhoff T, Lambert R, Hermann KG. MRI in axial spondyloarthritis: understanding an 'ASAS-positive MRI' and the ASAS classification criteria. Skeletal Radiol (2022) 51(9):1721–30. doi: 10.1007/s00256-022-04018-4

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Lin KYY, Peng C, Lee KH, Chan SCW, Chung Ho Y. Deep learning algorithms for magnetic resonance imaging of inflammatory sacroiliitis in axial spondyloarthritis. Rheumatology (2022) 61(10):4198–206. doi: 10.1093/rheumatology/keac059

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Wang R, Gabriel SE, Ward MM. Progression of nonradiographic axial spondyloarthritis to ankylosing spondylitis: A population-based cohort study. Arthritis Rheumatol (2016) 68(6):1415–21. doi: 10.1002/art.39542

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Weber U, Jurik AG, Zejden A, Larsen E, Jørgensen SH, Rufibach K, et al. Frequency and anatomic distribution of magnetic resonance imaging features in the sacroiliac joints of young athletes. Arthritis Rheumatol (2018) 70(5):736–45. doi: 10.1002/art.40429

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Agten CA, Zubler V, Zanetti M, Binkert CA, Kolokythas O, Prentl E, et al. Postpartum bone marrow edema at the sacroiliac joints may mimic sacroiliitis of axial spondyloarthritis on MRI. Am J Roentgenol (2018) 211(6):1306–12. doi: 10.2214/ajr.17.19404

CrossRef Full Text | Google Scholar

36. Marnas G, Bernardy C, Cole A, Bellier A, Chapuis P, Romand X, et al. Spine abnormalities associated with bone edema on sacroiliac joints MRI in patients with non-inflammatory chronic back pain. Joint Bone Spine (2022) 89(6):105436. doi: 10.1016/j.jbspin.2022.105436

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: axial spondyloarthritis, MRI, artificial intelligence, machine learning, sacroiliitis

Citation: Lee S, Jeon U, Lee JH, Kang S, Kim H, Lee J, Chung MJ and Cha H-S (2023) Artificial intelligence for the detection of sacroiliitis on magnetic resonance imaging in patients with axial spondyloarthritis. Front. Immunol. 14:1278247. doi: 10.3389/fimmu.2023.1278247

Received: 16 August 2023; Accepted: 25 October 2023;
Published: 10 November 2023.

Edited by:

Jukka Hirvasniemi, Erasmus Medical Center, Netherlands

Reviewed by:

António Proença Caetano, NOVA University of Lisbon, Portugal
Silvia Scriffignano, University of Molise, Italy

Copyright © 2023 Lee, Jeon, Lee, Kang, Kim, Lee, Chung and Cha. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Hoon-Suk Cha, hoonsuk.cha@samsung.com

These authors have contributed equally to this work and share first authorship

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.