Skip to main content

ORIGINAL RESEARCH article

Front. Med., 04 October 2024
Sec. Precision Medicine
This article is part of the Research Topic Progressive Role of Artificial Intelligence in Treatment Decision - Making in the Field of Medical Oncology View all 4 articles

A hybrid machine learning model combining association rule mining and classification algorithms to predict differentiated thyroid cancer recurrence

  • 1Department of Internal Medicine and Medical Oncology, Faculty of Medicine, Inonu University, Malatya, Turkey
  • 2Department of Biostatistics and Medical Informatics, Faculty of Medicine, Inonu University, Malatya, Turkey
  • 3Clinical Laboratory Sciences, College of Applied Medical Sciences, King Khalid University, Abha, Saudi Arabia
  • 4Department of Respiratory Care, College of Applied Sciences, Almaarefa University, Diriya, Riyadh, Saudi Arabia
  • 5Department of Teacher Education, NLA University College, Oslo, Norway

Background: Differentiated thyroid cancer (DTC) is the most prevalent endocrine malignancy with a recurrence rate of about 20%, necessitating better predictive methods for patient management. This study aims to create a relational classification model to predict DTC recurrence by integrating clinical, pathological, and follow-up data.

Methods: The balanced dataset comprises 550 DTC samples collected over 15 years, featuring 13 clinicopathological variables. To address the class imbalance in recurrence status, the Synthetic Minority Over-sampling Technique for Nominal and Continuous (SMOTE-NC) was utilized. A hybrid model combining classification algorithms with association rule mining was developed. Two relational classification approaches, regularized class association rules (RCAR) and classification based on association rules (CBAR), were implemented. Binomial logistic regression analyzed independent predictors of recurrence. Model performance was assessed through accuracy, sensitivity, specificity, positive predictive value, negative predictive value, and F1 score.

Results: The RCAR model demonstrated superior performance over the CBAR model, achieving accuracy, sensitivity, and F1 score of 96.7%, 93.1%, and 96.7%, respectively. Association rules highlighted that papillary pathology with an incomplete response strongly predicted recurrence. The combination of incomplete response and lymphadenopathy was also a significant predictor. Conversely, the absence of adenopathy and complete response to treatment were linked to freedom from recurrence. Incomplete structural response was identified as a critical predictor of recurrence risk, even with other low-recurrence conditions.

Conclusion: This study introduces a robust and interpretable predictive model that enhances personalized medicine in thyroid cancer care. The model effectively identifies high-risk individuals, allowing for tailored follow-up strategies that could improve patient outcomes and optimize resource allocation in DTC management.

1 Introduction

Among the diverse array of endocrine malignancies, differentiated thyroid carcinoma (DTC) stands out as the most prevalent, presenting a unique challenge within the realm of oncology due to its variable rates of recurrence. These fluctuating recurrence patterns can profoundly influence patient management strategies and long-term outcomes, underscoring the complexity of this disease (1). Thyroid cancer is becoming more common, especially DTC. The degree of differentiation of thyroid carcinomas at the DTC and undifferentiated (anaplastic) ends of the illness spectrum has been used to classify these tumors. There is a clear difference in the morphology and behavior of these two species. Papillary and follicular carcinomas are the two types of DTCs. The undifferentiated group includes anaplastic, insular, and other forms of carcinoma at the other end of the range. In terms of behavior, anaplastic carcinomas are extremely aggressive, whereas papillary and follicular carcinomas are generally mild and treatable (2).

According to SEER (Surveillance, Epidemiology, and End Results Program) data, the estimated number of cases in 2024 is 44,020. This rate constitutes 2.2% of all cancer cases in 2024. The estimated number of deaths in 2024 is 2,170. However, the overall 5-year survival rate for thyroid cancer is quite good. While the 5-year expected survival for localized disease is 99%, it drops to 51% for distant metastasis. It typically peaks between the ages of 55 and 64. The papillary type, especially after increasing in 2014–2015, has shown a decreasing trend in the thyroid, whereas the follicular type has tended to remain stable for over twenty years. We detect the vast majority of patients while they are still localized (3).

Although the etiology of thyroid cancers is not clearly known, many factors have been blamed, especially DTCs found in endemic goiter regions and people exposed to radiation in childhood (4). Despite the generally favorable prognosis associated with DTC, the disease exhibits a notable propensity for recurrence in approximately 20% of patients, highlighting the critical need for the development of superior predictive methodologies. Such methodologies would enable the identification of high-risk individuals and facilitate the tailoring of treatment regimens, ultimately optimizing patient outcomes (5).

Recent years have witnessed remarkable advancements in the fields of data mining and machine learning, ushering in novel avenues for enhancing the accuracy of recurrence predictions across various medical domains. Amidst these innovative approaches, associative classification has emerged as a particularly promising technique, demonstrating its potential in diverse medical applications (6). This methodology synergistically amalgamates the strengths of association rule mining with the predictive prowess of classification algorithms. This method uses the pattern recognition features of association rule mining to find complex patterns and relationships in very large datasets, patterns that might be missed by other methods. Consequently, associative classification promises to deliver more accurate and robust predictions, a critical asset in the medical realm.

Regarding thyroid cancer, the application of associative classification could potentially reveal unique combinations of clinical and pathological features that exhibit heightened predictive power for recurrence events. Artificial intelligence/machine learning (AI/ML) models have demonstrated considerable potential in forecasting outcomes for different forms of cancer. These models can combine and merge many types of data, such as genetic, histological, and clinical data, to deliver precise prognostic information (7). However, the specific application of associative classification in predicting DTC recurrence remains an underexplored domain, representing fertile ground for further investigation.

Regularized Class Association Rules (RCAR) is an advanced data mining technique designed for class-imbalanced datasets that enhance predictive accuracy and model simplicity by generating concise, regularized rules that directly link feature sets to class labels, preventing overfitting and improving interpretability (810). The Classification Based on Association Rules (CBAR) method combines association rule mining with classification to create an understandable model. It does this by creating and prioritizing relevant rules based on confidence, support, and lift. This makes predictions clear and accurate, especially in fields where it’s important to know why decisions are made (8, 11, 12). Both RCAR and CBAR use association rules to classify, but RCAR uses regularization to deal with class imbalance and overfitting, while CBAR focuses on accuracy and readability without specifically dealing with class imbalance or model complexity. Which one to use depends on the dataset requirements and the desired balance between accuracy and simplicity (8).

The aim of this study is to develop and evaluate an associative classification model that integrates clinical, pathological, and follow-up data to accurately predict the recurrence of DTC. This model aims to personalize follow-up strategies based on individual risk profiles by enhancing predictive accuracy, improving patient outcomes, optimizing resource allocation, and advancing personalized medicine in thyroid cancer care. This approach seeks to identify high-risk individuals for intensive monitoring or adjuvant therapies while reducing unnecessary follow-up for low-risk patients, thereby contributing to the overall improvement of DTC management and prognosis in the broader context of cancer care (13).

2 Materials and methods

2.1 Dataset explanation

The open-access dataset employed in this study represents a rich and meticulously curated repository of clinicopathologic data, encompassing a comprehensive array of 13 features spanning a substantial period of 15 years. The main objective of the relevant dataset is to facilitate the prediction of recurrence in patients diagnosed with DTC, a malignancy characterized by its variable prognoses and treatment outcomes. Notably, each patient included in the dataset was followed for a minimum of 10 years, ensuring a longitudinal perspective and enabling rigorous analyses of long-term outcomes. This dataset was meticulously compiled with the express purpose of advancing research at the intersection of artificial intelligence and medical sciences, with a particular emphasis on elucidating the factors contributing to the recurrence of thyroid cancer. The dataset encompasses a diverse array of features, encompassing both categorical and numerical variables, thereby enabling a multidimensional approach to understanding the predictors of cancer recurrence. These features include demographic characteristics such as age and gender, clinicopathologic parameters like histologic code, capsule invasion, and lymph node involvement, as well as treatment-related variables such as surgical procedure, tumor size, and radiation therapy. This multifaceted representation of patient data provides a holistic method for exploring the intricate interplay between various factors and their potential impact on cancer recurrence. The balanced dataset using the relevant technique in the current study comprises 550 instances, each representing a unique patient diagnosed with well-DTC. The target variable is a binary indicator that delineates whether the cancer recurred [coded as 1] or did not recur [coded as 0] during the follow-up period. The remaining features encompass a comprehensive array of clinically relevant parameters, including age, gender, histologic code, capsule invasion, extension beyond the thyroid capsule, lymph node involvement, multifocal tumor, extracapsular extension, surgical procedure, tumor size, radiation treatment, and metastasis (14). The Inonu University Health Sciences Non-Interventional Clinical Research Ethics Committee approved this study (approval number: 2024/6061).

2.2 Patient stratification, diagnosis and treatment

Patient data were stratified as follows: patient’s age at diagnosis, sex (male or female), current smoking status, past smoking history, presence of goiter (diffuse, single nodular goiter in the left or right lobe, multinodular or normal), presence of adenopathy on physical examination (absent, anterior right, anterior left, bilateral, bilateral, posterior or diffuse including all previously mentioned sites), thyroid function (classified as euthyroid, clinical or subclinical hypo/hyperthyroidism), focality (unifocal, multifocal) and risk assessment according to ATA guidelines (low, intermediate and high), Initial treatment response (good, biochemically incomplete, structurally incomplete, indeterminate), TNM staging (individual T, N, and M scores and final stage) history of radiation therapy to the head and neck region, and recurrence status (including both locoregional and distant metastases) are considered. Per the 2015 revisions of “Treatment Guidelines for Patients with Thyroid Nodules and Differentiated Thyroid Cancer” by the American Thyroid Association, the classification of thyroid tumors is based on the degree of risk as high, intermediate, and low (15). Patients who were over 18 years of age, diagnosed with differentiated thyroid cancer, who continued their follow-up and underwent surgery were included in the study. Exclusion criteria were defined as patients who were not surgical candidates, dedifferentiated, and who did not follow-up after surgery. Scintigraphy is one of the most commonly used preoperative diagnostic methods for the diagnosis of thyroid cancer. It should be kept in mind that patients diagnosed with multinodular goiter or diffuse goiter on thyroid scintigraphy have a possibility of thyroid cancer. Currently, preoperative characterization of lesions can be best performed by fine needle aspiration biopsy. With this method, the need for surgery and the type of surgery to be performed are decided. Computed tomography is recognized as the most effective method for demonstrating metastasis and invasion of surrounding tissue. Invasion of regional vessels and nerves must be detected preoperatively (16). Treatment options for thyroid cancer are divided into three main groups: surgery, chemotherapy, and radiotherapy. Effective and accurate use of preoperative diagnostic methods is recommended for treatment planning. Surgery is considered the most appropriate option in patients who are suitable for surgery and who have not metastasized (17).

2.3 Data collection and quality

The dataset was meticulously curated, ensuring no missing values and capturing a comprehensive array of demographic, historical, and clinical data. This level of detail makes predictive models for thyroid cancer recurrence much more reliable and robust. It also lets us look into the complex relationships between clinicopathologic factors and outcomes in more depth. The high data quality reflects the study’s commitment to scientific rigor and lays a strong foundation for advancing medical research in this field (1, 5).

2.4 Data preprocessing and development of predictive models

In this study, the Synthetic Minority Oversampling Technique for Nominal and Continuous Data (SMOTE-NC) was employed to address class imbalance by generating synthetic examples for underrepresented classes, accommodating both categorical and continuous features. This data preprocessing step was followed by the development of an associative classification model, a hybrid machine learning approach that combines classification algorithms with association rule mining (6, 18, 19). This method allows for the detection of complex, non-linear relationships between variables, making it particularly effective for predictive modeling in medical contexts. The associative classification model is designed to produce interpretable predictions by using high-quality association rules, which enhances its ability to capture intricate patterns linked to thyroid cancer recurrence. The model’s performance is evaluated using metrics such as accuracy, sensitivity, specificity, positive predictive value, negative predictive value, and F1 score (20, 21). Additionally, the current study explored the use of RCAR, a technique that incorporates regularization to manage class imbalance and prevent overfitting, ensuring a balance between model simplicity and predictive accuracy. The CBAR method was also considered, focusing on leveraging association rules for high interpretability and accuracy, making it particularly valuable in domains where understanding the rationale behind predictions is crucial. The choice between RCAR and CBAR depends on the specific needs of the dataset and the desired trade-off between accuracy and model simplicity (13).

2.5 Statistical analysis

Both analytical (Shapiro-Wilk Test) and visual (histogram and probability plots) techniques were used to assess the variables’ conformance to the normal distribution. The Levene test was used to investigate the homogeneity of variances assumption. When it comes to quantitative data with a normal distribution, descriptive statistics are expressed as mean (standard deviation). To compare two unrelated groups based on variables that matched the parametric test assumptions, the independent samples t-test was employed. Categorical data were summarized with frequency and percentage, and the chi-square test was used for group comparison. Binomial logistic regression analysis was used in the multivariate analysis to examine independent predictors for thyroid cancer recurrence. The advanced feature selection strategy was followed when doing the logistic regression analysis. The logistic regression model and its coefficients were assessed using the Hosmer-Lemeshow and Omnibus tests. A p-value of less than 0.05 was deemed statistically significant for all results. Analyses were performed using Python 3.9 software and IBM SPSS Statistics 28.0 (IBM Corp., Armonk, NY, United States) package program.

3 Results

The demographic data shown in Table 1 elucidates notable differences across patient groups based on cancer recurrence. The group that did not experience a recurrence had an average age of 38.41 years (SD = 12.94), while the group that experienced one had a substantially higher mean age of 46.698 years (SD = 17.95), with a p-value of less than 0.001. In terms of gender distribution, there were more females in the group without recurrence (57.5%) than in the group with recurrence (42.5%). On the other hand, males consisted of 76.2% of the recurrent group and 23.8% of the non-recurrent group. With a p-value of less than 0.001, the gender distribution difference was statistically significant (Table 1).

TABLE 1
www.frontiersin.org

Table 1. Descriptive statistics in the demographic information across the groups.

Table 2 presents the statistical analysis results of the variables between the groups. The groups with and without recurrence differed significantly across several factors, according to the statistical analysis. The recurrent group had a higher frequency of smoking (81.8%) than the non-recurrent group (18.2%), with a p-value of less than 0.001. There was a significant difference in thyroid function; most recurred patients (53.1%) were euthyroid, whereas non-recurred cases were less frequently euthyroid (46.9%). Physical examination revealed that only the non-recurrent group (100%) had diffuse goiter, while the recurrent group had a greater incidence of multinodular goiter (61.4% vs. 38.6%), p-value < 0.001. The recurrent group had a higher frequency of adenopathy (94.3% vs. 5.7%), especially bilaterally (p-value < 0.001). The pathology results showed that the recurrent group had a greater prevalence of papillary carcinoma (55.4% vs. 44.6%), with a p-value of less than 0.001. The recurrent group exhibited considerably larger multifocality (74.4% vs. 25.6%), with a p-value of less than 0.001. P-value < 0.001 indicates that there was no high-risk classification in the non-recurrent group and 100% in the recurrent group. Higher proportions of advanced stages (T3a, T4a) were found in the tumor staging in the recurrent group (p-value < 0.001). The recurrent group had a considerably larger nodal involvement (N1b) (90.3% vs. 9.7%), with a p-value of less than 0.001. 100% of the recurrent group and 0% of the non-recurrent group experienced distant metastases (M1); the p-value was less than 0.001. The recurrent group had a considerably higher prevalence of advanced stage (II-IVB), with a p-value of less than 0.001. The response to treatment showed a stark contrast, with 99.2% of the recurrent group having a structurally incomplete response compared to 0.8% in the non-recurrent group (p-value < 0.001) (Table 2).

TABLE 2
www.frontiersin.org

Table 2. Statistical analysis results regarding variables between the groups.

Table 3 tabulates the results of the logistic regression analysis to determine independent biomarkers of thyroid cancer recurrence. The study employed logistic regression analysis to investigate the relevant factors that either increase or decrease the chance of DTC recurrence. The findings of this analysis are displayed in Table 3. The recurrence of thyroid cancer was significantly predicted by logistic regression analysis. Individuals with structural partial response had a significantly higher risk of recurrence (OR = 230.041, 95% CI [29.879–5299.832], p < 0.001), but patients with Hurthel cell pathology exhibited a significantly lower risk (OR = 0.02, 95% CI [0.001–0.25], p = 0.006). While indeterminate response (OR = 0.084, 95% CI [0.012–0.428], p = 0.005) and excellent response (OR = 0.004, 95% CI [0–0.042], p < 0.001) were linked to lower risk, clinical hypothyroidism was associated with reduced recurrence risk (OR = 130.849, 95% CI [2.606–8344.448], p = 0.014). On the other hand, a higher chance of recurrence was linked to Stage II cancer (OR = 18.593, 95% CI [3.141–146.542], p = 0.002) and euthyroid condition (OR = 17.419, 95% CI [1.542–394.084], p = 0.036). The Hosmer-Lemeshow test indicated that the model fit was adequate (χ2 = 0.862, df = 8, p = 0.999), and the model significantly predicted outcomes (χ2 = 695.186, df = 9, p < 0.001). These findings highlight the significance of thyroid function, cancer stage, pathology type, and treatment response in predicting the recurrence of thyroid cancer (Table 3).

TABLE 3
www.frontiersin.org

Table 3. Results of logistic regression analysis to determine independent biomarkers of thyroid cancer recurrence.

Table 4 demonstrates the performance results of classifiers based on association rules regarding thyroid cancer recurrence prediction. The study used accuracy, sensitivity, specificity, PPV, NPV, and F1 score to compare how well two rule-based classification methods—RCAR and CBAR—knew how to predict thyroid cancer recurrence. RCAR demonstrated slightly higher accuracy (96.7%) compared to CBAR (96.0%) and also outperformed CBAR in sensitivity (94.9% vs. 93.1%), indicating its superior ability to correctly identify true positives. The F1 score, balancing both precision and recall, was 96.7% for RCAR and 95.9% for CBAR, further confirming RCAR’s better overall classification performance (Table 4).

TABLE 4
www.frontiersin.org

Table 4. Performance results of classifiers based on association rules regarding thyroid cancer recurrence prediction.

Table 5 contains organized class association rules to reveal important patterns of thyroid cancer recurrence. Papillary thyroid cancer was the most common histologic subtype, accounting for 75% of cases, followed by Hurthle cell carcinoma (12%), follicular carcinoma (7%), and micropapillary thyroid cancer (6%). Over half of the patients (54%) responded well to treatment, while 27% had structurally incomplete responses, 17% had undetermined responses, and 6% had chemically incomplete responses. Recurrence occurred in 28% of patients, with a strong association between papillary pathology with structural incomplete response and recurrence (support: 41.1%, confidence: 100%). Nodal involvement classified as N1b was another key predictor of recurrence (support: 36.0%, confidence: 100%). Conversely, the absence of adenopathy and an excellent treatment response indicated a high probability of being recurrence-free (support: 35.1%, confidence: 100%).

TABLE 5
www.frontiersin.org

Table 5. The generated association rules based on the RCAR method.

Patients classified as low risk with excellent response also demonstrated a high likelihood of being recurrence-free (support: 34.5%). However, individuals with structurally incomplete responses, even with normal thyroid function (euthyroid), were likely to experience recurrence. This was particularly evident in intermediate-risk patients with structurally incomplete responses (Rule 6) and those with multinodular goiter despite euthyroid status (Rule 7). The most frequent rule identified involved euthyroid patients with structurally incomplete responses, indicating that treatment response is a critical factor in recurrence risk, regardless of thyroid function status (Table 5).

4 Discussion

The present study evaluated the performance of two rule-based classification algorithms, RCAR and CBAR, in predicting thyroid cancer recurrence. The achieved results demonstrated that RCAR outperformed CBAR in terms of accuracy (96.7% vs. 96.0%), sensitivity (94.9% vs. 93.1%), and F1 score (96.7% vs. 95.9%). These findings are consistent with previous research by Azmi et al. (9) and Zhang and Zhou (22), who have reported the superiority of RCAR over other rule-based algorithms in various classification tasks. The remarkable accuracy and sensitivity shown by RCAR in this research are especially notable since they signify the algorithm’s capacity to precisely categorize instances and detect genuine positives (cases that have recurred). In the context of thyroid cancer, rapid diagnosis of recurrence is of utmost importance for prompt management and improved patient outcomes (23).

The multiple logistic regression analysis reveals noteworthy autonomous indicators for the recurrence of thyroid cancer, which is consistent with the findings of earlier investigations. The presence of Hurthle cell pathology is related to a significantly reduced risk of recurrence (odds ratio = 0.02, 95% confidence interval: 0.001–0.25, p = 0.006), as reported by clinical research. A relevant medical study also found a decreased risk of recurrence associated with Hurthle cells (24). Hurthle cell thyroid carcinoma accounts for < 5% of all differentiated thyroid malignancies and is of follicular cell origin, and its biological behavior differs from other thyroid cancer histologies. Although it is considered a variant of follicular carcinoma, its different oncogenic expression may explain its different clinical behavior (25). The chance of recurrence is much higher for people who have a structural partial response (OR = 230.041, 95% CI: 29.879–5299.83, p < 0.001), which supports the idea that the first therapeutic response is important for predicting the outcome (26). The presence of clinical hypothyroidism greatly increases the likelihood of recurrence (odds ratio = 130.849, 95% confidence interval: 2.606–8344.44, p = 0.014). A high-quality response significantly decreases the likelihood of recurrence (odds ratio = 0.004, 95% confidence interval: 0–0.042, p < 0.001), supporting the findings of a relevant paper (5). Stage II thyroid cancer and euthyroid state are substantial risk factors for thyroid carcinoma, which are consistent with the study (27). The model’s resilience is validated using the Hosmer-Lemeshow and Omnibus tests, demonstrating a reliable match.

The association rules generated by RCAR provided valuable insights into the factors associated with thyroid cancer recurrence. For instance, the presence of papillary pathology with structural incomplete response (Rule 1) and nodal involvement with structural incomplete response (Rule 2) were strongly associated with recurrence, with 100% confidence and high support values (41.1% and 36.0%, respectively). These findings corroborate previous studies (5, 28) that have identified structural incomplete response and nodal status as significant predictors of thyroid cancer recurrence. Clinically, these rules could aid in identifying high-risk patients who may benefit from more aggressive treatment and closer monitoring (5). The aggressive PTC subtypes include the tall cell, columnar cell, diffuse sclerosing variant, and hobnail variant. Higher rates of nodal and distant metastases, multifocality, extra-thyroidal extension, recurrence, and resistance to radioactive iodine therapy have all been linked to these variations (2). It is not known exactly how many of the patients with papillary carcinoma in this study were classified as unconventional variants.

The lack of adenopathy and a good response to treatment (Rule 3) were strongly linked to freedom from recurrence. This suggests that the current methods for risk stratification are working well at finding low-risk patients. Clinical decision-making could use this information, potentially reducing the intensity of follow-up and treatment for low-risk patients (24). Unilateral or bilateral modified lymph node dissection is recommended to reduce the possibility of recurrence, especially in patients with tumor sizes greater than T2. The importance of lymphadenopathy in the disease should also be evaluated in this respect (29).

Additionally, the association between euthyroid status, constitutively incomplete response, and recurrence (Rules 5, 6, and 8) highlights the importance of considering both structural response and thyroid function in predicting recurrence, as reported by previous studies (5, 30). The importance of TSH suppression after surgery in patients with thyroid carcinoma is also known. thyroid hormone levels have long been known to be associated with recurrence. For low-risk thyroid cancer, the 2015 ATA guidelines advise keeping the TSH level between 0.5 and 2 mIU/L following thyroid lobectomy. The need for TSH suppression treatment following a lobectomy can be predicted by the preoperative TSH level. This could be useful in identifying patients who may benefit from thyroid hormone supplements. In a study, recurrence was found in 4 patients (1.1%) who did not receive any T4 supplementation and had TSH levels > 2 mIU/L after lobectomy. This situation shows us that preoperative and postoperative thyroid hormone levels are effective in recurrence. In our study, it is also shown to be important and a component that increases the risk (31). These findings suggest that even patients with normal thyroid function may require closer monitoring and potentially more aggressive treatment if they exhibit a structurally incomplete response.

It is noteworthy that the findings of this study are consistent with those reported in similar research articles cited in the text. Research papers (9, 32) also found that rule-based algorithms, particularly RCAR, outperformed other classification methods in various domains. Additionally, RCAR’s association rules align with the findings of research studies (33, 34) that examined the significance of factors such as pathology, nodal status, structural response, and thyroid function in predicting the recurrence of thyroid cancer.

The findings of this study have several clinical implications for the management of thyroid cancer patients. The high accuracy and sensitivity of the RCAR algorithm in predicting recurrence suggest that it could be integrated into clinical decision support systems to aid in risk stratification and treatment planning (35). The association rules generated by RCAR could be used to identify high-risk patients who may benefit from more aggressive treatment and closer monitoring, as well as low-risk patients who may be candidates for less intensive follow-up and treatment (5, 24).

Furthermore, the identification of specific factors associated with recurrence, such as pathology, nodal status, structural response, and thyroid function, reinforces the importance of considering these variables in risk assessment and clinical decision-making. This information could be used to develop more personalized treatment plans and follow-up strategies based on individual patient characteristics (30). The association rules obtained in the study can also guide us in the clinical decision-making process. In particular, factors such as papillary pathology, nodal involvement, and inadequate structural response appear to have a strong association with recurrence (Rules 1–2). Such high-risk patients may require more aggressive treatment regimens and closer follow-up (5).

On the other hand, the association of excellent structural response and absence of adenopathy with a low risk of recurrence (Rule 3) suggests that a less intensive follow-up and treatment plan may be appropriate for this patient group (36). Proper application of risk stratification systems can help us avoid unnecessary intensive treatment and follow-up. The association of structural incomplete response with recurrence even in euthyroid patients (Rules 5–8) highlights the need to consider structural response in addition to thyroid function tests (30). This finding suggests that some patients may require close monitoring or more aggressive treatment despite having normal thyroid function.

However, it is important to note that the clinical implementation of these findings should be evaluated carefully. While the RCAR algorithm and the association rules demonstrate promising performance, further validation on larger and more diverse datasets may be necessary before widespread adoption in clinical practice. Additionally, the interpretability and transparency of the rule-based models should be carefully evaluated to ensure that the decisions made based on these models are explainable and accountable (37).

A structurally incomplete response is a major risk factor that greatly increases the risk under all conditions. It is known that as the size of the thyroid tumor increases and the stage shifts towards the advanced stage, the risk of recurrence and the prognosis of the disease will be worse. However, due to the relatively small distribution of patients in this stratification, our methods were unable to detect a significant association. A general rule of thumb is that tumor size and stage are associated with a worse prognosis (38, 39).

In general, differentiated thyroid carcinomas have a good prognosis, but it is critical to identify those patients at risk of progressive disease with a poor clinical course and those at high risk of death at the time of diagnosis. Recognizing prognostic factors and being able to figure out the risk of recurrence are important for the best management of DTC. So are the extent of thyroid surgery and the reasons for radioiodine therapy after surgery. Methods to facilitate the determination of the risk of recurrence are critical in groups where a poor clinical outcome is expected (39). This study has a few limitations. Firstly, the analysis may not use a representative dataset of all thyroid cancer cases, and the results may differ when applied to different populations or clinical settings. Secondly, the study focused solely on rule-based classification algorithms, and it would be valuable to compare their performance with other machine learning techniques, such as neural networks or ensemble methods.

In conclusion, the current study demonstrated the efficacy of the RCAR algorithm in predicting thyroid cancer recurrence and provided valuable insights into the factors associated with recurrence through the generated association rules. The findings have potential clinical implications for risk stratification, treatment planning, and follow-up strategies in thyroid cancer management. However, further evaluation and validation are necessary before widespread clinical implementation.

Data availability statement

The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding authors.

Ethics statement

The studies involving humans were approved by the Inonu University Health Sciences Non-Interventional Clinical Research Ethics Committee. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study. Written informed consent was obtained from the individual(s) for the publication of any potentially identifiable images or data included in this article.

Author contributions

FFA: Writing – review and editing, Writing – original draft, Validation, Software, Resources, Investigation, Conceptualization. FHY: Writing – review and editing, Writing – original draft, Visualization, Validation, Software, Resources, Methodology, Investigation, Formal analysis, Data curation, Conceptualization. CC: Writing – review and editing, Writing – original draft, Visualization, Validation, Supervision, Software, Resources, Project administration, Methodology, Investigation, Formal analysis, Conceptualization. EE: Writing – review and editing, Writing – original draft, Visualization, Validation, Supervision, Resources, Investigation. NM: Writing – review and editing, Writing – original draft, Validation, Software, Resources, Investigation. FA: Writing – review and editing, Writing – original draft, Validation, Resources, Investigation. LPA: Writing – review and editing, Writing – original draft, Visualization, Validation, Resources, Investigation.

Funding

The author(s) declare financial support was received for the research, authorship, and/or publication of the article. The authors extend their appreciation to the Deanship of Research and Graduate Studies at King Khalid University for funding this work through a Large Research Project under grant number RGP-2/205/45. Dr. Fuzail Ahmad would like to thanks Almaarefa University for the support of this study.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

1. Davies L, Welch H. Current thyroid cancer trends in the United States. JAMA Otolaryngol Head Neck Surg. (2014) 140:317–22.

Google Scholar

2. Riaz S, Bashir H, Hassan A, Mushtaq S, Jamshed A, Murtaza A. Aggressive disease course of papillary thyroid carcinoma with focal undifferentiated component: A case report. Mol Imaging Radionuclide Ther. (2016) 25:134.

Google Scholar

3. National Cancer Institute. SEER cancer statistics: Thyroid cancer. Bethesda, MD: National Cancer Institute (2024).

Google Scholar

4. Klubo-Gwiezdzinska J. Childhood exposure to excess ionizing radiation is associated with dose-dependent fusions as molecular drivers of papillary thyroid cancer. Clin Thyroidol. (2022) 34:161–4. doi: 10.1089/ct.2022;34.161-164

PubMed Abstract | Crossref Full Text | Google Scholar

5. Tuttle R, Tala H, Shah J, Leboeuf R, Ghossein R, Gonen M, et al. Estimating risk of recurrence in differentiated thyroid cancer after total thyroidectomy and radioactive iodine remnant ablation: Using response to therapy variables to modify the initial risk estimates predicted by the new American Thyroid Association staging system. Thyroid. (2010) 20:1341–9. doi: 10.1089/thy.2010.0178

PubMed Abstract | Crossref Full Text | Google Scholar

6. Liu B, Hsu W, Ma Y editors. Integrating classification and association rule mining. Proceedings of the fourth international conference on knowledge discovery and data mining. Berlin: (1998).

Google Scholar

7. Adeoye J, Tan J, Choi S, Thomson P. Prediction models applying machine learning to oral cavity cancer outcomes: A systematic review. Int J Med Inform. (2021) 154:104557.

Google Scholar

8. Yağın F, Yağın B, Arslan A, Çolak C. Comparison of performances of associative classificationmethods for cervical cancer prediction: Observational study. Turk Klin J Biostat. (2021) 13:266.

Google Scholar

9. Azmi M, Runger G, Berrado A. Interpretable regularized class association rules algorithm for classification in a categorical data space. Inform Sci. (2019) 483:313–31.

Google Scholar

10. Hahsler M, Johnson I, Kliegr T, Kucha J. Associative classification in R: Arc, arulesCBA, and rCBA. R J. (2019) 9:254–67.

Google Scholar

11. Tsay Y, Chiang J-Y. CBAR: An efficient method for mining association rules. Knowl Based Syst. (2005) 18:99–105.

Google Scholar

12. Duwairi R, Ammari H. An enhanced CBAR algorithm for improving recommendation systems accuracy. Simul Model Pract Theory. (2016) 60:54–68.

Google Scholar

13. Dua S, Singh H, Thompson H. Associative classification of mammograms using weighted rules. Expert Syst Appl. (2009) 36:9250–9. doi: 10.1016/j.eswa.2008.12.050

PubMed Abstract | Crossref Full Text | Google Scholar

14. Borzooei S, Tarokhian A. Thyroid cancer recurrence prediction. (2023). Available online at: https://archive.ics.uci.edu/dataset/915/differentiated+thyroid+cancer+recurrence (accessed March 1, 2024).

Google Scholar

15. Luster M, Aktolun C, Amendoeira I, Barczyñski M, Bible K, Duntas L, et al. European perspective on 2015 American thyroid association management guidelines for adult patients with thyroid nodules and differentiated thyroid cancer: Proceedings of an interactive international symposium. Thyroid. (2019) 29:7–26.

Google Scholar

16. Karayağız A, Ferlengez E. Thyroid cancers: Diagnosis and surgical management. Zeynep Kamil Med J. (2019) 50:205–9.

Google Scholar

17. Lorusso L, Cappagli V, Valerio L, Giani C, Viola D, Puleo L, et al. Thyroid cancers: From surgery to current and future systemic therapies through their molecular identities. Int J Mol Sci. (2021) 22:3117. doi: 10.3390/ijms22063117

PubMed Abstract | Crossref Full Text | Google Scholar

18. Mukherjee M, Khushi M. SMOTE-ENC: A novel SMOTE-based method to generate synthetic data for nominal and continuous features. Appl Syst Innov. (2021) 4:18.

Google Scholar

19. Hassanzadeh R, Farhadian M, Rafieemehr H. Hospital mortality prediction in traumatic injuries patients: Comparing different SMOTE-based machine learning algorithms. BMC Med Res Methodol. (2023) 23:101. doi: 10.1186/s12874-023-01920-w

PubMed Abstract | Crossref Full Text | Google Scholar

20. Wong H, Lim G. Measures of diagnostic accuracy: Sensitivity, specificity, PPV and NPV. Proc Singapore Healthc. (2011) 20:316–8.

Google Scholar

21. Guldogan E, Yagin F, Pinar A, Colak C, Kadry S, Kim J. A proposed tree-based explainable artificial intelligence approach for the prediction of angina pectoris. Sci Rep. (2023) 13:22189. doi: 10.1038/s41598-023-49673-2

PubMed Abstract | Crossref Full Text | Google Scholar

22. Zhang S, Zhou QA. Novel efficient classification algorithm based on class association rules. Appl Mechanics Mater. (2012) 135:106–10. doi: 10.1007/s00500-021-06528-0

PubMed Abstract | Crossref Full Text | Google Scholar

23. Nieto H, Thornton C, Brookes K, Nobre de Menezes A, Fletcher A, Alshahrani M, et al. Recurrence of papillary thyroid cancer: A systematic appraisal of risk factors. J Clin Endocrinol Metab. (2022) 107:1392–406.

Google Scholar

24. Haugen B, Alexander E, Bible K, Doherty G, Mandel S, Nikiforov Y, et al. 2015 American thyroid association management guidelines for adult patients with thyroid nodules and differentiated thyroid cancer: The American thyroid association guidelines task force on thyroid nodules and differentiated thyroid cancer. Thyroid. (2016) 26:1–133.

Google Scholar

25. Kumari S, Adewale R, Klubo-Gwiezdzinska J. The molecular landscape of Hürthle cell thyroid cancer is associated with altered mitochondrial function-a comprehensive review. Cells. (2020) 9:1570. doi: 10.3390/cells9071570

PubMed Abstract | Crossref Full Text | Google Scholar

26. Lee Y, Hsieh C, Chuang J. Prognostic significance of partial tumor regression after preoperative chemoradiotherapy for rectal cancer: A meta-analysis. Dis Colon Rectum. (2013) 56:1093–101. doi: 10.1097/DCR.0b013e318298e36b

PubMed Abstract | Crossref Full Text | Google Scholar

27. Sherman SI, Brierley JD, Sperling M, Ain KB, Bigos ST, Cooper DS, et al. Prospective multicenter study of thyroiscarcinoma treatment: Initial analysis of staging and outcome. National thyroid cancer treatment cooperative study registry group. Cancer. (1998) 83:1012–21. doi: 10.1002/(sici)1097-0142(19980901)83:5<1012::aid-cncr28>3.0.co;2-9

PubMed Abstract | Crossref Full Text | Google Scholar

28. Majeed A, Satapathy S, Ballal S, Bal C. Dynamic risk stratification for predicting long-term outcomes in pediatric differentiated thyroid cancers. J Clin Endocrinol Metab. (2023) 108:e208–15.

Google Scholar

29. Witte J, Goretzki P, Dieken J, Simon D, Röher H. Importance of lymph node metastases in follicular thyroid cancer. World J Surg. (2002) 26:1017–22.

Google Scholar

30. Biondi B, Filetti S, Schlumberger M. Thyroid-hormone therapy and thyroid cancer: A reassessment. Nat Clin Pract Endocrinol Metab. (2005) 1:32–40.

Google Scholar

31. Bae M, Nam S, Roh J, Choi S, Nam S, Kim S. Thyroid stimulating hormone suppression and recurrence after thyroid lobectomy for papillary thyroid carcinoma. Endocrine. (2022) 75:487–94.

Google Scholar

32. Karabatak M, Ince M. An expert system for detection of breast cancer based on association rules and neural network. Expert Syst Appl. (2009) 36:3465–9.

Google Scholar

33. Mukhtar N, Aljamei H, Aljomaiah A, Moria Y, Alzahrani A. Natural course of the American Thyroid Association response to therapy statuses (dynamic risk stratification) in differentiated thyroid cancer. Eur Thyroid J. (2021) 10:198–207. doi: 10.1159/000511708

PubMed Abstract | Crossref Full Text | Google Scholar

34. Conzo G, Docimo G, Pasquali D, Mauriello C, Gambardella C, Esposito D, et al. Predictive value of nodal metastases on local recurrence in the management of differentiated thyroid cancer. Retrospective clinical study. BMC Surg. (2013) 13:S3. doi: 10.1186/1471-2482-13-S2-S3

PubMed Abstract | Crossref Full Text | Google Scholar

35. Harry M, Saman D, Truitt A, Allen C, Walton K, O’Connor P, et al. Pre-implementation adaptation of primary care cancer prevention clinical decision support in a predominantly rural healthcare system. BMC Med Inform Decision Mak. (2020) 20:117. doi: 10.1186/s12911-020-01136-

Crossref Full Text | Google Scholar

36. Morton R, Thompson J. Evidence-based follow-up schedules after primary cancer treatment. Ann Surg Oncol. (2020) 27:4067–9.

Google Scholar

37. Doshi-Velez F, Kim B. Towards a rigorous science of interpretable machine learning. arXiv [Preprint] (2017). arXiv:170208608.

Google Scholar

38. Londero S, Krogdahl A, Bastholt L, Overgaard J, Pedersen H, Hahn C, et al. Papillary thyroid carcinoma in Denmark, 1996–2008: Outcome and evaluation of established prognostic scoring systems in a prospective national cohort. Thyroid. (2015) 25:78–84. doi: 10.1089/thy.2014.0294

PubMed Abstract | Crossref Full Text | Google Scholar

39. Jukkola A, Bloigu R, Ebeling T, Salmela P, Blanco G. Prognostic factors in differentiated thyroid carcinomas and their implications for current staging classifications. Endocrine Relat Cancer. (2004) 11:571–9.

Google Scholar

Keywords: differentiated thyroid cancer, recurrence prediction, associative classification, machine learning, personalized medicine

Citation: Firat Atay F, Yagin FH, Colak C, Elkiran ET, Mansuri N, Ahmad F and Ardigò LP (2024) A hybrid machine learning model combining association rule mining and classification algorithms to predict differentiated thyroid cancer recurrence. Front. Med. 11:1461372. doi: 10.3389/fmed.2024.1461372

Received: 08 July 2024; Accepted: 23 September 2024;
Published: 04 October 2024.

Edited by:

Nishanth Thalambedu, University of Arkansas for Medical Sciences, United States

Reviewed by:

Fernando Marqués-García, Hospital Germans Trias i Pujol, Spain
Kritika Srinivasan Rajsri, New York University, United States

Copyright © 2024 Firat Atay, Yagin, Colak, Elkiran, Mansuri, Ahmad and Ardigò. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Fatma Hilal Yagin, hilal.yagin@inonu.edu.tr; Luca Paolo Ardigò, luca.ardigo@nla.no

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.