Skip to main content

ORIGINAL RESEARCH article

Front. Med. Technol., 25 March 2024
Sec. Diagnostic and Therapeutic Devices

Uncovering the burden of hidradenitis suppurativa misdiagnosis and underdiagnosis: a machine learning approach

\r\nJoslyn KirbyJoslyn Kirby1Katherine KimKatherine Kim2Marko ZivkovicMarko Zivkovic3Siwei WangSiwei Wang3Vishvas GargVishvas Garg2Akash Danavar
Akash Danavar2*Chao LiChao Li2Naijun ChenNaijun Chen2Amit Garg,&#x;\r\nAmit Garg4,†
  • 1Department of Dermatology, Penn State Health, Hershey, PA, United States
  • 2Value and Evidence, AbbVie, Inc., North Chicago, IL, United States
  • 3Technology and Innovation, Genesis Research, Hoboken, NJ, United States
  • 4Department of Dermatology, Northwell Health, New Hyde Park, NY, United States

Hidradenitis suppurativa (HS) is a chronic inflammatory follicular skin condition that is associated with significant psychosocial and economic burden and a diminished quality of life and work productivity. Accurate diagnosis of HS is challenging due to its unknown etiology, which can lead to underdiagnosis or misdiagnosis that results in increased patient and healthcare system burden. We applied machine learning (ML) to a medical and pharmacy claims database using data from 2000 through 2018 to develop a novel model to better understand HS underdiagnosis on a healthcare system level. The primary results demonstrated that high-performing models for predicting HS diagnosis can be constructed using claims data, with an area under the curve (AUC) of 81%–82% observed among the top-performing models. The results of the models developed in this study could be input into the development of an impact of inaction model that determines the cost implications of HS diagnosis and treatment delay to the healthcare system.

Introduction

Hidradenitis suppurativa (HS) is a chronic inflammatory follicular skin condition presenting with painful lesions in the intertriginous skin areas, odor, drainage, and disfigurement that contribute to significant psychosocial and pain-related burdens (1, 2). It is also associated with a high comorbidity burden, for which early recognition and management may reduce mortality (35).

The prevalence of HS also remains largely unknown and varies across studies due to data collection methods (3). In the United States, studies show its prevalence ranging from 0.05% to 0.90% of the population (3). Globally, prevalence studies report higher results of up to 4.1% (3). Its prevalence may be higher among certain groups; studies suggest female patients, cigarette smokers, and patients with metabolic syndrome (including obesity, elevated triglycerides, low HDL, elevated blood glucose, and hypertension) may have a higher chance of developing HS (68).

The pathophysiology of HS is still not fully agreed upon, with current opinion leaning toward follicular hyperkeratosis and dilation followed by follicular rupture and inflammatory response as the primary events leading to the disease (9). With no specific diagnostic tests and unclear histology, the diagnosis of HS is based on three compulsory clinical criteria: skin changes, locations of lesions, and duration. The Hurley clinical staging system, which is used in the diagnostic process, divides HS into three stages. Stage 1 usually presents with painful nodules or boils that progress to recurrent abscesses, sinus tracts, and scarring (Stage 2) (10). Stage 3 is characterized by diffuse or broad involvement, with multiple interconnected sinus tracts and abscesses. The treatment choice depends on the stage of HS at diagnosis, and effective treatment options are often limited. A majority of patients benefit from a combination of medical and surgical management.

A general lack of awareness about HS in the medical community and a notable heterogeneity in the clinical presentation, which is most often confused with cutaneous abscess, may form the basis of poor disease recognition and misdiagnosis (6, 11). Early incorrect hypotheses of an infectious process as the origin of HS influence providers to recommend improved hygiene practices as a mitigation option causing diagnostic delays. A scarcity of dermatology providers, coupled with long wait times and insurance limitations, further amplifies long waiting periods for an accurate diagnosis (12, 13). HS patients suffer from symptoms for 10 years on average prior to accurate diagnosis, during which time they may experience fragmented care and inappropriate management, such as hospital admissions and readmissions for prolonged antibiotic courses directed at acute infections (11, 12, 14). HS underdiagnosis and misdiagnosis also result in increased healthcare system burden, wherein significantly higher costs of managing and treating HS have been observed compared to other inflammatory skin conditions (8, 15). Therefore, there is a need to reduce diagnostic delays by supporting accurate and early recognition of HS to limit disease progression and manage the comorbidity burden (14, 16). Some studies have reported the use of ultrasound (US) imaging as a characterizing diagnostic tool in conjunction with clinical examination to reduce the uncertainty of HS diagnosis and inform on optimal therapeutic strategies, primarily by detecting inflammatory activity and the early subclinical and dermal features of HS and accurately characterizing lesion morphology (1719). The use of US for diagnosis is a promising approach to both diagnosis and staging; however, its application in the practice setting is limited at present because it has not yet been standardized or validated. Recent reports on other techniques, such as laser speckle contrast analysis (LASCA) or optical coherence tomography (OCT), for HS diagnosis and treatment monitoring indicate the importance of the development of new tools for better HS detection and management (20, 21).

The application of machine learning (ML) to assist in disease recognition has been implemented in different therapeutic areas and may potentially identify undiagnosed or misdiagnosed HS patients. A study by Garg et al. (22) demonstrated a growing need for the development of clinical decision support tools for HS diagnosis. The application of ML to electronic health record (EHR) and claims databases has recently gained traction, with several studies utilizing ML in claims to identify depression, ankylosing spondylitis, cardiomyopathy, dementia, and hepatitis C (2327).

The study aimed to develop an ML algorithm to identify undiagnosed HS patients among patients with abscess or cellulitis, the diagnoses most commonly rendered incorrectly by clinicians who are less familiar with HS.

Materials and methods

Data source

Datasets derived from the IBM MarketScan Research Databases from 2000 to 2018 were used to train and test, and 2018–2019 data were used to validate ML models developed in this study. An exploratory application assessment of ML models was done on 2018 patient data. The database is comprised of fully adjudicated medical and pharmaceutical reimbursement claims from commercial, Medicare, and Medicaid health plans across the United States, covering over 225 million unique patients. It provides a comprehensive longitudinal view of the insured population, including demographics, plan and provider information, inpatient and outpatient diagnoses, procedures, retail and mail-order prescription records, and plan enrollment and participation eligibility dates.

Patient populations

ML classification models were developed to discern between cases (HS patients) and controls (non-HS patients). Two separate control cohorts included (1) patients with abscesses and (2) cellulitides. These controls were selected because HS patients are most often treated for either of these two conditions before being diagnosed with HS (11, 14). Table 1 presents the patient attrition for case and control cohorts.

Table 1
www.frontiersin.org

Table 1. Patient attrition.

This case–cohort study included patients with ≥1 HS diagnosis claim [International Classification of Diseases (ICD), Ninth Revision code 705.83 or ICD-10 code L73.2] between January 2000 and March 2018, aged ≥12 years on their first date of HS diagnosis, and with medical and pharmacy enrollment of ≥36 months prior to and ≥6 months after their first date of HS diagnosis (28, 29). The first HS diagnosis claim within the period of interest defined the index date for the cases.

The control cohorts included patients with ≥1 ICD-9/10 diagnosis claim indicating abscess (Supplementary Table S1) or cellulitis (Supplementary Table S2) between January 2000 and March 2018, aged ≥12 years on the abscess or cellulitis diagnosis date, and with pharmacy and medical enrollment of ≥36 months prior to and ≥6 months after the index date. The date of the first abscess or cellulitis diagnosis claim within the period of interest was used as the index date for controls. The patients with HS diagnoses in the database were excluded from the control cohorts. Diagnostic claims for abscess or cellulitis on the extremities, face/neck, and digits were not considered in the control cohorts due to the lower likelihood of these anatomical regions being impacted by HS.

For all cohorts, patients with ≥1 pre-index cancer- or immunocompromised-related diagnosis/medication (determined by the ICD-9/10 codes; Supplementary Tables S3, S4, respectively) were excluded because they were not considered high-risk and to minimize the bias that they would introduce in the HS patient classifier training.

Modeling approach

The modeling approach (Figure 1A) included feature engineering and model implementation. During the feature engineering phase, data preparation and feature selection were performed, including cohort generation, data cleaning and standardization, and feature reduction. In the implementation phase, the models were developed, performance was assessed, and the optimal model was selected. Data preparation utilized SAS software (Version 9.4, SAS Institute, Inc., Cary, NC, USA), whereas feature selection and model implementation were conducted using Python (Version 2.7).

Figure 1
www.frontiersin.org

Figure 1. Modeling approach: (A) main modeling steps, (B) model development overview, (C) selection of hidradenitis suppurativa (HS) and control patients for model development.

The model development overview is presented in Figure 1B. During the training step, a dataset containing values for the selected features for each patient in case and control training sets was processed to generate weighted mathematical functions (models) that determine the probabilities of a patient being an HS patient. The weighted mathematical function outputs were then assessed (according to the performance measures of interest) for alignment against the known categorization of patients in the test dataset. The function weights were further optimized by adjusting the hyperparameters until a satisfactory performance was attained.

This study considered six single ML algorithm methods—namely, penalized logistic regression (LR) using LASSO, random forest (RF), multilayer perceptron (MLP) neural network, AdaBoost, XGBoost, and LightGBM, and two ensemble methods that combine multiple individual contributing algorithms, i.e., MaxVoting and weighted average. In MaxVoting, each of the four algorithms considered (LR, RF, AdaBoost, and XGBoost) makes a prediction, and the prediction with the highest number of votes is included in the final output. In the weighted average, an ensemble prediction was calculated as the average of the proportionally weighted predictions from single algorithms (LR, XGBoost, and LightGBM). The eight ML algorithm methods were chosen based on their widespread use in ML-based predictive studies, the different biases that they introduce, and their complexity, to select one with the best balance between low complexity, high performance, and fast computational execution (the “optimal model”) (3036). Satisfactory performance was determined in consultation with dermatologists with a precision/accuracy threshold of 0.7.

The models were developed using selected subsets of case and control cohorts (Figure 1C). For each of the control cohorts, HS cases were matched 1:1 to a random sample of controls, and then 90% of the data were used for the training and 10% for the testing. A separate model that differentiates cases from controls was developed for each case–control training set.

The features used in model development were informed by literature review, the opinion of the clinician, and availability in the underlying data and included demographic and clinical characteristics identified by diagnostic, procedural, and medication codes (at drug class level) in the claims records for case–control cohorts. No derived variables were considered. Each diagnostic, procedural, or medication code identified in the dataset was considered as a separate feature, and no encoding was used. The ICD-9/10 diagnostic codes grouped to the first three digits were considered as binary variables (1/0 = patient had/did not have a claim with a specific diagnosis). To reduce the code burden and noise and provide clinically meaningful categories, we converted the Healthcare Common Procedure Coding System (HCPCS), Current Procedural Terminology (CPT), and ICD Procedure Coding System (ICD PCS) codes to Clinical Classification Software (CCS) procedural categories, which were represented as a frequency of the total number of claims with a specific procedure per patient. Drug classes were derived from Red Book and were included as frequency variables that represent the total number of prescriptions for a specific class per patient. Furthermore, the feature set was limited by filtering out those that occur in <1% of patients in the cohort, removing those with high degrees of mutual association or correlation (based on T-test, chi-squared, and phi-coefficient selection), and eliminating them with respect to importance using recursive feature elimination (RFE). Reduction of the initial feature set using the described methods resulted in an approximately three times smaller feature set.

Performance metrics

Four performance metrics were used to assess and select the optimal model: namely, the area under the curve (AUC), sensitivity, precision, and accuracy. The AUC, ranging from 0 to 1, describes the model accuracy under different thresholds of true and false positives. Sensitivity (recall), a ratio of true positives (HS patients correctly predicted as with HS) and the sum of true positives and false negatives (HS patients incorrectly predicted as without HS), specified the probability of detecting HS among those with the disease. Precision (positive predictive value), a ratio of true positives and the sum of true positives and false positives (patients in control cohorts incorrectly predicted as with HS), indicated the chance that patients with a positive HS prediction truly have HS. Accuracy, a ratio of the sum of true positives and true negatives (patients in control cohorts correctly predicted as without HS) over the total sample size, reflected the overall HS case classification correctness.

Sensitivity and validation analyses

Two sensitivity analyses, based on two different study periods, were performed for the three top-performing ML models. A “short- vs. long-term” analysis, designed to evaluate the difference in the impact of short-term and long-term features, assigned different weights to the short-term data (data from the records within 1 year of the index date) and the long-term data (from records within 1–3 years of the index date). The second sensitivity analysis, a “short-term” analysis, was conducted by considering only patient data within 1 year of the index date. This second sensitivity analysis was used to verify the predictive power and utility of short-term data, as larger numbers of patients will have 1 year worth of data available in most circumstances.

Validation of models was performed using data from 2018 to 2019; data for patients with known HS diagnoses were fed into the trained models, and an assessment to identify patients with HS was conducted.

Exploratory application

An exploratory real-world application of three top-performing models was performed to estimate the level of HS underdiagnosis in different US Metropolitan Statistical Areas (MSA). Within a specific MSA, patients in IBM MarketScan Research Databases with an abscess diagnosis in 2018 (index) and 12 months of continuous pre-index enrollment were run through an appropriately trained model. The numbers of ML-predicted HS patients and abscess patients within an MSA were compared to assess the proportion of patients with potential HS misdiagnosis. A high percentage of potentially misdiagnosed HS patients may indicate an extra burden on healthcare systems within an MSA that could be alleviated with a reassessment of patient populations by providers. The same evaluation was repeated for patients with cellulitis diagnosis.

Results

Attrition

Among 411,061 patients with HS diagnosis from January 2000 through March 2018, after all selection criteria were applied, 55,989 remained in the HS case cohort. For the control cohorts, following all patient selection criteria, there were 278,483 patients with documented abscesses and 1,431,524 patients with documented cellulitides.

Base analysis results

The primary results demonstrated that high-performing models for predicting HS diagnosis can be constructed using claims data. The performance comparison for the initial eight ML algorithms is presented in Table 2. Diagnostic accuracy of up to 65% and 73% was achieved among those trained on abscess and cellulitis controls, respectively. Precision was at 60% or above, reaching 80% among cellulitis-trained models. Sensitivity ranged from 55% to 76%, with an AUC of 81%–82% observed among the top-performing models indicating a discriminating ability on par with EHR-trained disease prediction ML models in the literature (32, 34, 3739). For all algorithms considered, the ML models differentiating HS and cellulitis patients performed better on all metrics as compared to the models trained to differentiate HS and abscess patients. Clinically, HS lesions may be more difficult to differentiate with respect to abscesses given that they are a type of HS lesion, which may explain the underperformance of the abscess-trained models. The three ML models with top-performing algorithms across all cohort analyses and all performance metrics were identified, namely, Model 1 (AdaBoost), Model 2 (LightGBM), and Model 3 (MaxVoting), and these were used in further analyses.

Table 2
www.frontiersin.org

Table 2. Performance metrics for all machine learning (ML) methods.

Age, gender, and risk factors (e.g., overweight and obesity, skin infections/disorders, and skin infection treatment feature types) were the strongest HS-predictive features among the top three models (Table 3). These findings align with the previous knowledge about the disease, from both consultation with HS-treating dermatologists and the existing literature (5, 6). Model 2 also considered the diagnostic feature types (presence of diagnostic claims) as important HS predictors among cellulitis patients. Among all individual algorithms contributing to Model 3, LR was more likely to use features of skin infections/disorders type and characteristics, such as tissue conditions, partial denture, and autogenous arteriovenous fistula, as the most important predictive features. XGBoost algorithm within Model 3 also considered specific comorbidity diagnoses such as osteomyelitis, periostitis, bone infections, nutritional and metabolic disorders, and open wound diagnosis as strong HS predictors. The models trained in Cohort 1 (the subset of the HS and “abscess” cohorts) were more likely to select top features from vaccination, diagnostics, and other comorbidities compared to the models trained to differentiate HS and cellulitis.

Table 3
www.frontiersin.org

Table 3. Top 10 predictive features for top-performing models.

Sensitivity analysis and validation results

Table 4 displays the “short vs. long-term” and “short-term” sensitivity analysis results. The performance metrics are comparable for both sensitivity analyses and similar to the results in Table 2, indicating that data within shorter timeframes of the index date, which may contain more patient samples, can be reliably used for developing models for these types of claims analyses.

Table 4
www.frontiersin.org

Table 4. Sensitivity analysis results for the top 3 models.

Table 5 presents the validation results. Out of 5,629 patients with their first HS diagnosis in 2018–2019 who satisfied the selection criteria, 5,418 were eligible for input into the models trained on “abscess” controls and 5,477 for input into the models trained on “cellulitis” controls. All top three models performed consistently, predicting 64%–69% of true HS patients. Overall, Models 1 and 2 showed a more robust performance.

Table 5
www.frontiersin.org

Table 5. Validation results for the top 3 models—predicting HS diagnosis among patients with known HS diagnosis in 2018–2019.

Exploratory application results

The exploratory application indicated a noticeable HS underdiagnosis among abscess or cellulitis patients. The percentage for underdiagnosis varied by MSA and model used. It was smaller among the abscess population than the cellulitis population, reaching 13% of abscess patients in MSAs with the highest level of underdiagnosis. Among cellulitis patients, underdiagnosis was as high as 50% in some MSAs. Metro areas with larger populations had the highest number of predicted HS patients, but there was no obvious relationship observed between the size of the abscess or cellulitis patient populations and the proportion of underdiagnosed HS. Heatmaps of HS prediction among identified abscess and cellulitis patients are presented in Figure 2. This application indicates that the utilization of developed ML models by health systems may be able to identify large pools of underdiagnosed HS patients for further evaluation and diagnosis and clinical and translational research.

Figure 2
www.frontiersin.org

Figure 2. Heat map of estimated hidradenitis suppurativa (HS) underdiagnosis among abscess and cellulitis patients by Metropolitan Statistical Areas (MSA) regions based on the prediction of the three top-performing machine learning (ML) models: (A) potential HS cases among abscess patients (AdaBoost), (B) potential HS cases among abscess patients (LightGBM), (C) potential HS cases among abscess patients (MaxVoting), (D) potential HS cases among cellulitis patients (AdaBoost), (E) potential HS cases among cellulitis patients (LightGBM), and (F) potential HS cases among cellulitis patients (MaxVoting).

Discussion

HS has poor recognition as a disease entity among both clinicians and patients. A clinical decision support that prompts consideration of HS and distinguishes it from cutaneous abscess and cellulitis may improve gaps in quality, timeliness, and specificity of care. In this study, we used 18 years of claims data to develop an ML model to predict HS among patients with abscesses and cellulitides. The performance of the models demonstrated the utility of the application of ML to claims data, opening another avenue for improving HS patient care.

All three models with the highest performance contain state-of-the-art boosting algorithms that often outperform the traditional algorithms (e.g., LR and RF) frequently used in healthcare analyses. Although these three models gave relatively consistent results among cohorts, the models exhibited differences in prediction performance based on their prediction functions. No single model performed the best across all measures and in all populations; however, the models based on the cellulitis control cohort outperformed those based on the abscess cohort, regardless of model type, reflecting the increased difficulty of discerning HS from abscess compared with cellulitis. Model 2 gave a more conservative result than the other two models, while Model 1 showed the most consistent performance across different testing populations. Given the sparseness of data and the large number of variables often encountered for patients with rare conditions in claims data, the ability of Model 1 to better operate in such conditions gives it an advantage over the other two models. Additionally, Model 1 has higher robustness, as it tends to weigh difficult-to-discern cases more heavily during the training, promoting their impact on model behavior. Of note, Models 1 and 2 had similar, if not better, performance compared with that of Model 3, suggesting the importance of not overlooking simpler models in favor of complicated, ensemble models in these kinds of applications. Furthermore, the two single models had faster execution times, with Model 1 requiring the least optimization and parameter tuning during the training, giving Model 1 an overall recommendation over the other two models.

As demonstrated, ML model performance varies based on the specific cohort used for training, including case and control definitions. Using clinical expert engagement in the early model development stages to appropriately identify populations of interest (e.g., HS vs. abscess patients as compared to HS vs. general dermatology patients) and setting desired optimization targets for model performance helps the resulting models to perform better and be more translatable for clinical use. Performance optimization (trade-off between accuracy, sensitivity, and precision) is dependent on the goal of the model use (screening or confirmation). The trade-off should be investigated when setting model probability threshold levels for classifying a patient as an HS patient.

This study focused on HS detection, but the utilized claims-based ML approach could be extended to the additional indications with appropriate retraining, particularly those hampered by small sample sizes in regular studies. The exploratory application using 2018 IBM MarketScan data showed high potential for identification of HS underdiagnosis or misdiagnosis, with uneven underdiagnosis across regions. The heatmap approach used in the exploratory analysis could spur further identification of regions/centers where the potential for underdiagnoses of HS patients may be high, and further HS medical education or intervention may be warranted. In such cases, it should be kept in mind that the regional distribution assessment results of HS prediction are somewhat reflective of the underlying regional data distribution, which for IBM MarketScan skews toward the southern/southeastern regions and major urban centers.

ML prediction studies for other diseases generally utilize EHR data or specialized datasets as opposed to claims data. Most of the ML-based prediction in dermatology has focused on image-trained models. Claims databases may be more useful than EHRs since they capture a larger population, allowing for larger training, testing, and validation datasets. Although EHRs often contain clinically meaningful data that allow easier model development, they are often limited in population size and characteristics and tend to capture the perspective of a single institution or network, which may produce results with limited relevance to other health provider systems or regions. Additionally, claims sources generally have the benefit of more complete data compared to many EHRs and ensure confidence in the relevance and generalizability of outcomes to a broader population. EHR-linked claims combination might further improve prediction performance due to the availability of clinical variables such as disease severity, procedure or test results, and laboratory values.

This study has several strengths and limitations. A large claims database over 18 years was used, resulting in large samples of HS cases and controls. Several ML models were initially considered, with careful training, testing, and validation and thoughtfully considered model inputs. Sensitivity analyses further gauged prediction, and an exploratory analysis showed the potential for real-world application. The challenges unique to ML may limit generalizability and real-world applicability. A potential limitation to expanded use may be that the application of trained models requires data with the same structure as used in model development, adding a data management burden. Furthermore, the algorithms selected as “best-performing” for the population from claims data considered in this study may not extend to other settings. Other algorithms may work more effectively in different populations if differences from the study population are large. As with any claims data, potential medical coding errors may affect the model performance. Contextual embedding and considerations of temporal relations between patient claims (e.g., time since the first presentation with dermatological symptoms), not considered in this study, could further improve the performance.

In summary, we have described the development of a clinical decision support model that predicts the probability of HS diagnosis and distinguishes it from cutaneous abscess and cellulitis, the most common mimics of HS; it has the potential to improve recognition of HS and reduce diagnostic delay. The results of the models developed can also be applied to the impact of the inaction model that determines cost implications for diagnosis and treatment delay, e.g., cost burden to healthcare systems. Testing on additional external datasets, followed by testing in a clinical setting and against a dermatologist diagnosis of HS, is recommended to confirm and optimize the model performance and its use in this fashion.

Data availability statement

The original contributions presented in the study are included in the article/Supplementary Material, and further inquiries can be directed to the corresponding author.

Author contributions

Conceptualization: JK, KK, MZ, SW, VG, NC, AG. Data curation: KK, MZ, SW, NC. Formal analysis: JK, KK, MZ, SW, VG, AD, CL, NC, AG. Investigation: KK, MZ, SW, VG, AD, CL. Methodology: JK, KK, MZ, SW, VG, AD, CL, NC, AG. Project administration: KK, VG, AD. Resources: KK, VG, AD. Supervision: KK, VG, AD. Validation: VG, AD, CL, NC. Visualization: KK, MZ, SW, AD, CL, NC. Writing – original draft preparation: KK, MZ, SW, AG. Writing – review and editing: JK, KK, MZ, SW, VG, AD, CL, NC, AG. All authors contributed to the article and approved the submitted version.

Acknowledgments

The authors would like to thank Carla Zema and Hemant Kanakamedala for contributing to the study concept, early phases of study design, and data review that was added to this manuscript. AbbVie provided funding for this study; contributed to the design; and participated in the collection, analysis, and interpretation of data and writing, reviewing, and approval of the final version of the manuscript.

Conflict of interest

http://cdn.elsevier.com/promis_misc/JID_COI_2013.pdf JK is a consultant for AbbVie, ChemoCentryx, Incyte, InflaRx, Janssen, MoonLake, Novartis, UCB, and Viela Bio and receives honorarium. JK is a speaker for AbbVie, Janssen, and UCB. KK was previously an employee of AbbVie for a portion of this study and may own AbbVie stock or stock options. MZ is an employee of Genesis Research that provided consulting services to AbbVie. SW was previously an employee of Genesis Research for a portion of this study. VG, AD, CL, and NC are employees of AbbVie and may own AbbVie stock or stock options. AG is an advisor for AbbVie, Aclaris Therapeutics, AnaptysBio, Aristea Therapeutics, Boehringer Ingelheim, Bristol Myers Squibb, Cosmo Pharmaceuticals, Incyte, Insmed, Janssen, Novartis, Pfizer, Sonoma Biotherapeutics, UCB, UNION Therapeutics, Ventyx Biosciences, and Viela Bio and receives honoraria. AG receives research grants from AbbVie, UCB, the National Psoriasis Foundation, and the CHORD COUSIN Collaboration (C3).

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fmedt.2024.1200400/full#supplementary-material

References

1. Dufour DN, Emtestam L, Jemec GB. Hidradenitis suppurativa: a common and burdensome, yet under-recognised, inflammatory skin disease. Postgrad Med J. (2014) 90(1062):216–21; quiz 20. doi: 10.1136/postgradmedj-2013-131994

PubMed Abstract | Crossref Full Text | Google Scholar

2. Kouris A, Platsidaki E, Christodoulou C, Efstathiou V, Dessinioti C, Tzanetakou V, et al. Quality of life and psychosocial implications in patients with hidradenitis suppurativa. Dermatology. (2016) 232(6):687–91. doi: 10.1159/000453355

PubMed Abstract | Crossref Full Text | Google Scholar

3. Jemec GB, Kimball AB. Hidradenitis suppurativa: epidemiology and scope of the problem. J Am Acad Dermatol. (2015) 73(5 Suppl 1):S4–7. doi: 10.1016/j.jaad.2015.07.052

PubMed Abstract | Crossref Full Text | Google Scholar

4. Reddy S, Strunk A, Garg A. All-cause mortality among patients with hidradenitis suppurativa: a population-based cohort study in the United States. J Am Acad Dermatol. (2019) 81(4):937–42. doi: 10.1016/j.jaad.2019.06.016

PubMed Abstract | Crossref Full Text | Google Scholar

5. Reddy S, Strunk A, Garg A. Comparative overall comorbidity burden among patients with hidradenitis suppurativa. JAMA Dermatol. (2019) 155(7):797–802. doi: 10.1001/jamadermatol.2019.0164

PubMed Abstract | Crossref Full Text | Google Scholar

6. Canoui-Poitrine F, Le Thuaut A, Revuz JE, Viallette C, Gabison G, Poli F, et al. Identification of three hidradenitis suppurativa phenotypes: latent class analysis of a cross-sectional study. J Invest Dermatol. (2013) 133(6):1506–11. doi: 10.1038/jid.2012.472

PubMed Abstract | Crossref Full Text | Google Scholar

7. Vazquez BG, Alikhan A, Weaver AL, Wetter DA, Davis MD. Incidence of hidradenitis suppurativa and associated factors: a population-based study of Olmsted County, Minnesota. J Invest Dermatol. (2013) 133(1):97–103. doi: 10.1038/jid.2012.255

PubMed Abstract | Crossref Full Text | Google Scholar

8. Andrade T, Vieira BC, Oliveira AMN, Martins TY, Santiago TM, Martelli ACC. Hidradenitis suppurativa: epidemiological study of cases diagnosed at a dermatological reference center in the city of Bauru, in the Brazilian southeast State of Sao Paulo, between 2005 and 2015. An Bras Dermatol. (2017) 92(2):196–9. doi: 10.1590/abd1806-4841.20175588

PubMed Abstract | Crossref Full Text | Google Scholar

9. Snyder CL, Chen SX, Porter ML. Obstacles to early diagnosis and treatment of hidradenitis suppurativa: current perspectives on improving clinical management. Clin Cosmet Investig Dermatol. (2023) 16:1833–41. doi: 10.2147/CCID.S301794

PubMed Abstract | Crossref Full Text | Google Scholar

10. Gill L, Williams M, Hamzavi I. Update on hidradenitis suppurativa: connecting the tracts. F1000Prime Rep. (2014) 6:112. doi: 10.12703/P6-112

PubMed Abstract | Crossref Full Text | Google Scholar

11. Saunte DM, Boer J, Stratigos A, Szepietowski JC, Hamzavi I, Kim KH, et al. Diagnostic delay in hidradenitis suppurativa is a global problem. Br J Dermatol. (2015) 173(6):1546–9. doi: 10.1111/bjd.14038

PubMed Abstract | Crossref Full Text | Google Scholar

12. Garg A, Neuren E, Cha D, Kirby JS, Ingram JR, Jemec GBE, et al. Evaluating patients’ unmet needs in hidradenitis suppurativa: results from the global survey of impact and healthcare needs (VOICE) project. J Am Acad Dermatol. (2020) 82(2):366–76. doi: 10.1016/j.jaad.2019.06.1301

PubMed Abstract | Crossref Full Text | Google Scholar

13. Creadore A, Desai S, Li SJ, Lee KJ, Bui AN, Villa-Ruiz C, et al. Insurance acceptance, appointment wait time, and dermatologist access across practice types in the US. JAMA Dermatol. (2021) 157(2):181–8. doi: 10.1001/jamadermatol.2020.5173

PubMed Abstract | Crossref Full Text | Google Scholar

14. Kokolakis G, Wolk K, Schneider-Burrus S, Kalus S, Barbus S, Gomis-Kleindienst S, et al. Delayed diagnosis of hidradenitis suppurativa and its effect on patients and healthcare system. Dermatology. (2020) 236(5):421–30. doi: 10.1159/000508787

PubMed Abstract | Crossref Full Text | Google Scholar

15. Kirby JS, Miller JJ, Adams DR, Leslie D. Health care utilization patterns and costs for patients with hidradenitis suppurativa. JAMA Dermatol. (2014) 150(9):937–44. doi: 10.1001/jamadermatol.2014.691

PubMed Abstract | Crossref Full Text | Google Scholar

16. Shelby D. Hidradenitis Suppurativa: A Disease Under-Diagnosed and Under-Treated. Myrtle Beach: Skin, Bones, Hearts and Private Parts (2018). Available online at: https://www.skinbonescme.com/2018/02/01/hidradenitis-suppurativa-disease-underdiagnosed-undertreated/

Google Scholar

17. Martorell A, Alfageme Roldán F, Vilarrasa Rull E, Ruiz-Villaverde R, Romaní De Gabriel J, García Martínez F, et al. Ultrasound as a diagnostic and management tool in hidradenitis suppurativa patients: a multicentre study. J Eur Acad Dermatol Venereol. (2019) 33(11):2137–42. doi: 10.1111/jdv.15710

PubMed Abstract | Crossref Full Text | Google Scholar

18. Di Cesare A, Rosi E, Amerio P, Prignano F. Clinical and ultrasonographic characterization of hidradenitis suppurativa in female patients: impact of early recognition of the disease. Life. (2023) 13(8):1630. doi: 10.3390/life13081630

PubMed Abstract | Crossref Full Text | Google Scholar

19. Mendes-Bastos P, Martorell A, Bettoli V, Matos AP, Muscianisi E, Wortsman X. The use of ultrasound and magnetic resonance imaging in the management of hidradenitis suppurativa: a narrative review. Br J Dermatol. (2023) 188(5):591–600. doi: 10.1093/bjd/ljad028

PubMed Abstract | Crossref Full Text | Google Scholar

20. Manfredini M, Chello C, Ciardo S, Guida S, Chester J, Lasagni C, et al. Hidradenitis suppurativa: morphologic and vascular study of nodular inflammatory lesions by means of optical coherence tomography. Exp Dermatol. (2022) 31(7):1076–82. doi: 10.1111/exd.14560

PubMed Abstract | Crossref Full Text | Google Scholar

21. Gierek M, Bergler-Czop B, Słaboń A, Łabuś W, Ochała-Gierek G. Laser speckle contrast analysis (LASCA): a new device in the diagnosis and monitoring of surgical treatment of hidradenitis suppurativa. Postepy Dermatol Alergol. (2023) 40(2):253–8. doi: 10.5114/ada.2023.126323

PubMed Abstract | Crossref Full Text | Google Scholar

22. Garg A, Reddy S, Kirby J, Strunk A. Development and validation of HSCAPS-1: a clinical decision support tool for diagnosis of hidradenitis suppurativa over cutaneous abscess. Dermatology. (2021) 237(5):719–26. doi: 10.1159/000511077

PubMed Abstract | Crossref Full Text | Google Scholar

23. Deodhar A, Rozycki M, Garges C, Shukla O, Arndt T, Grabowsky T, et al. Use of machine learning techniques in the development and refinement of a predictive model for early diagnosis of ankylosing spondylitis. Clin Rheumatol. (2020) 39(4):975–82. doi: 10.1007/s10067-019-04553-x

PubMed Abstract | Crossref Full Text | Google Scholar

24. Doyle OM, Leavitt N, Rigg JA. Finding undiagnosed patients with hepatitis C infection: an application of artificial intelligence to patient claims data. Sci Rep. (2020) 10(1):10521. doi: 10.1038/s41598-020-67013-6

PubMed Abstract | Crossref Full Text | Google Scholar

25. Kitanishi Y, Fujiwara M, Binkowitz B. Patient journey through cases of depression from claims database using machine learning algorithms. PLoS One. (2021) 16(2):e0247059. doi: 10.1371/journal.pone.0247059

PubMed Abstract | Crossref Full Text | Google Scholar

26. Nori VS, Hane CA, Martin DC, Kravetz AD, Sanghavi DM. Identifying incident dementia by applying machine learning to a very large administrative claims dataset. PLoS One. (2019) 14(7):e0203246. doi: 10.1371/journal.pone.0203246

PubMed Abstract | Crossref Full Text | Google Scholar

27. Huda A, Castano A, Niyogi A, Schumacher J, Stewart M, Bruno M, et al. A machine learning model for identifying patients at risk for wild-type transthyretin amyloid cardiomyopathy. Nat Commun. (2021) 12(1):2725. doi: 10.1038/s41467-021-22876-9

PubMed Abstract | Crossref Full Text | Google Scholar

28. Kim GE, Shlyankevich J, Kimball AB. The validity of the diagnostic code for hidradenitis suppurativa in an electronic database. Br J Dermatol. (2014) 171(2):338–42. doi: 10.1111/bjd.13041

PubMed Abstract | Crossref Full Text | Google Scholar

29. Marvel J, Vlahiotis A, Sainski-Nguyen A, Willson T, Kimball A. Disease burden and cost of hidradenitis suppurativa: a retrospective examination of US administrative claims data. BMJ Open. (2019) 9(9):e030579. doi: 10.1136/bmjopen-2019-030579

PubMed Abstract | Crossref Full Text | Google Scholar

30. Choi E, Schuetz A, Stewart WF, Sun J. Using recurrent neural network models for early detection of heart failure onset. J Am Med Inform Assoc. (2017) 24(2):361–70. doi: 10.1093/jamia/ocw112

PubMed Abstract | Crossref Full Text | Google Scholar

31. Cosmatos I, Matcho A, Weinstein R, Montgomery MO, Stang P. Analysis of patient claims data to determine the prevalence of hidradenitis suppurativa in the United States. J Am Acad Dermatol. (2013) 68(3):412–9. doi: 10.1016/j.jaad.2012.07.027

PubMed Abstract | Crossref Full Text | Google Scholar

32. Emir B, Masters ET, Mardekian J, Clair A, Kuhn M, Silverman SL. Identification of a potential fibromyalgia diagnosis using random forest modeling applied to electronic medical records. J Pain Res. (2015) 8:277–88. doi: 10.2147/jpr.s8256

PubMed Abstract | Crossref Full Text | Google Scholar

33. Fatima M, Pasha M. Survey of machine learning algorithms for disease diagnostic. J Intell Learn Syst Appl. (2017) 9:1–16. doi: 10.4236/jilsa.2017.91001

Crossref Full Text | Google Scholar

34. Gunčar G, Kukar M, Notar M, Brvar M, Černelč P, Notar M, et al. An application of machine learning to haematological diagnosis. Sci Rep. (2018) 8(1):411. doi: 10.1038/s41598-017-18564-8

Crossref Full Text | Google Scholar

35. Kim SJ, Cho KJ, Oh S. Development of machine learning models for diagnosis of glaucoma. PLoS One. (2017) 12(5):e0177726. doi: 10.1371/journal.pone.0177726

PubMed Abstract | Crossref Full Text | Google Scholar

36. Seneviratne MG, Banda JM, Brooks JD, Shah NH, Hernandez-Boussard TM. Identifying cases of metastatic prostate cancer using machine learning on electronic health records. AMIA Annu Symp Proc. (2018) 2018:1498–504. PMID: 30815195.30815195

PubMed Abstract | Google Scholar

37. Jammeh EA, Carroll CB, Pearson SW, Escudero J, Anastasiou A, Zhao P, et al. Machine-learning based identification of undiagnosed dementia in primary care: a feasibility study. BJGP Open. (2018) 2(2):bjgpopen18X101589. doi: 10.3399/bjgpopen18X101589

PubMed Abstract | Crossref Full Text | Google Scholar

38. Min X, Yu B, Wang F. Predictive modeling of the hospital readmission risk from patients’ claims data using machine learning: a case study on COPD. Sci Rep. (2019) 9(1):2362. doi: 10.1038/s41598-019-39071-y

PubMed Abstract | Crossref Full Text | Google Scholar

39. Perveen S, Shahbaz M, Keshavjee K, Guergachi A. A systematic machine learning based approach for the diagnosis of non-alcoholic fatty liver disease risk and progression. Sci Rep. (2018) 8(1):2112. doi: 10.1038/s41598-018-20166-x

PubMed Abstract | Crossref Full Text | Google Scholar

Keywords: machine learning, hidradenitis suppurativa, prediction, diagnosis, dermatology, model

Citation: Kirby J, Kim K, Zivkovic M, Wang S, Garg V, Danavar A, Li C, Chen N and Garg A (2024) Uncovering the burden of hidradenitis suppurativa misdiagnosis and underdiagnosis: a machine learning approach. Front. Med. Technol. 6:1200400. doi: 10.3389/fmedt.2024.1200400

Received: 4 April 2023; Accepted: 5 March 2024;
Published: 25 March 2024.

Edited by:

Kalpana Raja, Yale University, United States

Reviewed by:

Nan Huo, Mayo Clinic, United States
Farida Benhadou, Université libre de Bruxelles, Belgium
Gianluca Nazzaro, IRCCS Ca 'Granda Foundation Maggiore Policlinico Hospital, Italy

© 2024 Kirby, Kim, Zivkovic, Wang, Garg, Danavar, Li, Chen and Garg. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Akash Danavar akash.danavar@abbvie.com

ORCID Amit Garg orcid.org/0000-0003-0886-6856

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.