Haoran Ding
Chenzhou Wu
Yingzhao Huang- State Key Laboratory of Oral Diseases & National Clinical Research Center for Oral Diseases & Department of Head and Neck Oncology Surgery, West China Hospital of Stomatology, Sichuan University, Chengdu, China
Objectives: To date, radiomics has been applied in oncology for over a decade and has shown great progress. We used a bibliometric analysis to analyze the publications of radiomics in oncology to clearly illustrate the current situation and future trends and encourage more researchers to participate in radiomics research in oncology.
Methods: Publications for radiomics in oncology were downloaded from the Web of Science Core Collection (WoSCC). WoSCC data were collected, and CiteSpace was used for a bibliometric analysis of countries, institutions, journals, authors, keywords, and references pertaining to this field. The state of research and areas of focus were analyzed through burst detection.
Results: A total of 7,199 pieces of literature concerning radiomics in oncology were analyzed on CiteSpace. The number of publications has undergone rapid growth and continues to increase. The USA and Chinese Academy of Sciences are found to be the most prolific country and institution, respectively. In terms of journals and co-cited journals, Scientific Reports is ranked highest with respect to the number of publications, and Radiology is ranked highest among co-cited journals. Moreover, Jie Tian has published the most publications, and Phillipe Lambin is the most cited author. A paper published by Gillies et al. presents the highest citation counts. Artificial intelligence (AI), segmentation methods, and the use of radiomics for classification and diagnosis in oncology are major areas of focus in this field. Test-retest statistics, including reproducibility and statistical methods of radiomics research, the relation between genomics and radiomics, and applications of radiomics to sarcoma and intensity-modulated radiotherapy, are frontier areas of this field.
Conclusion: To our knowledge, this is the first study to provide an overview of the literature related to radiomics in oncology and may inspire researchers from multiple disciplines to engage in radiomics-related research.
Introduction
Unlike the natural intelligence displayed by humans and animals, artificial intelligence (AI) is intelligence demonstrated by machines. AI can be applied to develop systems possessing characteristics of human beings: the ability to learn, reasoning, sensing, and actioning. Initially, the development of automated interpretation of medical images was based on human decision models to perform high-level interpretations of images. At the time, logical rules were applied to AI machines. AI machines sought specific structures such as lines or circles for identification. Such systems have succeeded in other fields, such as in business and manufacturing. Next came the second generation of AI algorithms. Instead of focusing on certain symbols of images, such algorithms were designed to be more statistical. This kind of model of medical images may develop from healthy individuals, and its parameters are inferred from data. Such an algorithm can assist in helping radiologists identify lesions. The segmentation method serves as a classic example of this algorithm. Currently, the explosion of big data has ushered AI into a new era, and algorithms are called data-driven/model-free approaches, which involve automating knowledge discovery. This approach is now widely applied in medical research, and a popular application of this method is called radiomics (1).
Radiomics, first pioneered by Philippe Lambin (2), uses high-throughput data to extract certain features from medical images for personalized precision medicine development. With the development of AI, the field of radiomics has grown rapidly and been widely used in every phase of tumor treatment. Relying on quantitative data generated by medical imaging and the support of technology, radiomics offers a risk-free and efficient method for diagnosis (3, 4), classification (5), and prognosis prediction (6, 7) in oncology.
Data selection, medical imaging, feature extraction, exploratory analysis, and modelling are the five steps of radiomics (2, 8, 9). Applying standard imaging protocols to generate high-quality images from computed tomography (CT), positron-emission CT (PET-CT), magnetic resonance imaging (MRI), radiography or using high-quality photographs of lesions can enable radiomics reproducibility. Then, the volume of interest (VOI), which identifies lesions from images, is delineated by experienced radiologists or semiautomated or automated segmentation methods. The features extracted from VOIs are inputted to generate quantitative descriptions, which contain semantic and agnostic features. The value of extracted features is then analyzed, and only the features most contributing to the classifiers are retained for future modelling. In practice, this step can be supported by statistical approaches and AI, including a univariate analysis of variance, the least absolute shrinkage and selection operator, decision trees, neural networks, and support vector machines (9). The relationship among the algorithms is presented in Supplementary Figure S1.
Although radiomics can be applied in a large number of conditions, it is most well developed and widely used in oncology due to initial support received from the National Cancer Institute (9, 10) and Quantitative Imaging Biomarker Alliance (11). In 1973, some researchers intended to use texture features to classify images (12). In 1995, researchers started to use a convolutional neural network (CNN) to identify lung nodes, suggesting that it is possible to train computer algorithms to identify medical images (13). In late 2000, researchers attempted to identify the relationship between the imaging of tumors and their genomic types (14, 15). At the time, most studies were performed on relatively small datasets and lacked external examination, meaning that the established radiomic models were only based on small datasets from individual organizations and could not be validated by data from external organizations. With innovations made in the field of medical imaging, radiomics in oncology has rapidly progressed (16–19). In around 2012, radiomics was first proposed by Philippe Lambin; ever since, thousands of researchers have been encouraged to conduct radiomics-based research. In 2014, radiomics in oncology was used to examine CT imaging features for diagnosis and prediction (20). In 2016, researchers found for the first time that the radiomics signature could predict lymph node metastasis in patients with colorectal cancer (21). In 2018, researchers found that radiomics features could predict the treatment responses and prognosis of patients receiving immunotherapy (18). Some researchers have developed models for the automated identification of lesions from videos and images (3, 4). In addition, some researchers have found a correlation between radiomic features and tumor histology (22). At present, by extracting various features from medical images and translating these image features into high-throughput and quantitative data for analysis, radiomics can be used for the classification and differentiation of different lesions and subtypes of tumors (3–5) and for survival prediction (23) and prognosis prediction for patients undergoing radiation therapy (6, 24, 25). Even with common limitations, such as a lack of outside validations, the use of small datasets or the variabilities caused by medical imaging protocols, radiomics research has offered a significant opportunity for researchers to make clinical decisions from an entirely new perspective.
Since radiomics studies mostly rely on medical data, which are subject to approaches to data acquisition and analysis used, creating a gold standard for medical models remains a great challenge. When establishing a clinical model, the input and processing of radiomic features can drastically influence the model, as these features depend on the radiologists who record the clinical characteristics, on AI and on statistical methods. For example, inexperienced radiologists may fail to delineate a lesion entirely or miss significant clinical features, and different AI and statistical methods may create clinical diagnosis or prediction models with inconsistent accuracy. For these reasons, standardizing the procedures of radiomics studies and finding robust features with which to establish models are essential in achieving clinical goals of radiomics research.
Bibliometric analysis evaluates scientific activities in a certain field (26). A simple quantitative technique provided by citation analysis provides a means to estimate the impact of an article (27), such as the influence of bridging articles between themes or the influence of articles laying the foundation in certain fields. CiteSpace, developed by Chaomei Chen, is a Java-based application for detecting and visualizing possible trends and radical changes in scientific disciplines over time (28) and is a valuable tool for bibliometric analysis. The program can assist researchers in identifying influential and effective areas of research, trends, and prospects in certain fields. CiteSpace has been widely applied in many subjects for bibliometric analysis, such as neuroscience, oncology, and cardiovascular science (29–31).
In this article, we use data collected from the Web of Science Core Collection (WoSCC) and CiteSpace to analyze 7,199 publications related to radiomics in oncology and generated knowledge maps for the first time, to our knowledge. Since radiomics provides a new means for clinicians to examine entire tumors with rather minimally invasive methods, we sought to provide a more comprehensive understanding of the ever-changing field of radiomics. Furthermore, to encourage researchers from various disciplines to actively and creatively participate in practicing radiomics, we conducted our bibliometric analysis based on relevant literature in this field to outline the countries, authors, institutions, and journals that have made significant contributions to this field. In applying this method, we also identify areas of focus and future trends.
Methods
Data Acquisition and Search Strategy
Relevant literature was collected from the WoSCC. The following search terms were employed, the searching formula is also presented in Supplementary Figure S2.
The time interval was set to 2011 to 2020. Only articles and reviews were included, and no language restrictions were applied. The search and download process was carried out on March 14, 2021 to eliminate substantial errors caused by daily database updates. Given that data were directly downloaded from the database, ethical approval was not required.
Data Analysis
CiteSpace V was used to remove duplicates and analyze the 7,199 unique records exported. Then, to visualize emerging trends and areas of focus in tumor radiomics research, CiteSpace was applied to generate knowledge mappings of countries, institutions, co-occurrences of keywords, references, authors and co-cited authors, and co-cited journals (28). With each year covered by a dataset assigned a different color, CiteSpace uses colorful node edges or crosses to discriminate between different research objects, including countries, institutions, words, references, etc. The size of rings on nodes indicates the number of publications for each node. Purple rings surrounding circles indicate the centrality of nodes. Moreover, “Burst detection” is a function provided by the software to detect current and prospective areas of focus. The detection objects of this function can include noun phrases, keywords included in abstracts, papers, and so on, revealing words, or papers undergoing citation bursts in a given period. When the time period is set to the present, this means that some keywords or papers are undergoing a citation burst, which may indicate further prospects for a given field. The impact factors (IFs) for all publications were documented based on the Journal Citation Report (2019).
Generally, the productivity of individuals, journals, and countries can be measured by the total number of papers, whereas the total counts of citations of authors, journals, or references measure the total impact. Defined as the maximum value of h such that the given author/journal has published at least h papers that have each been cited at least h times, the H index is used to characterize a researcher’s output in scientific research. The impact factor (IF), defined as a scientometric index, is also a measurement of journals and articles (32). The value is calculated as the average number of citations a publication receives in 2 or 5 years as indexed by the Web of Science. Furthermore, co-citation is defined as the number of times two documents are cited together (33); that is, when two publications or authors are cited at the same time, they may focus on the same theme of research, which may indicate their cooperation. A burst of an event refers to a surge in the frequency of a certain event, such as the emergence of a keyword or the citation of a specific article (34). These parameters allow us to identify productive institutions and their countries and outstanding individuals in the studied field. Figure 1 illustrates the research steps of this study.
Figure 1 Workflows of this study.
Results
State of Publication Output
A total of 7,199 publications were examined in the present study and include 6,417 (89.1%) original articles and 782 (10.9%) reviews. Figure 2 shows the chronological distribution of the publications for 2011 to 2020. With technological breakthroughs in AI, an increasing number of researchers have been attracted to radiomics in oncology. As depicted in the diagram, the number of articles and reviews grew steadily in the first 4 years. From 2015 to 2020, the annual number of publications grew exponentially and peaked in 2020.
Figure 2 Chronological distribution of publications in radiomics for oncology from 2011 to 2020.
Active Countries and Institutions
The included publications were published in 82 countries and regions over the last decade. The top 10 contributors are presented in Supplementary Table S1, and the cooperative relationships among them are shown in Supplementary Figure S3. When counting the number of publications, the USA (2,280) ranks first, followed by China (2136), India (456), Germany (454), and England (401).
Overall, 715 institutions contributed to this field. Supplementary Table S1 shows the 10 most productive institutions, and Supplementary Figure S4 shows the cluster of institutions engaged in radiomics research in oncology by keyword. The most productive institution is the Chinese Academy of Sciences with 224 publications, followed by Sun Yat-Sen University (168), Fudan University (155), Harvard Medical School (145), and Stanford University (136). The three most prolific institutions are Chinese universities.
Productive Journals
A total of 1,247 journals published articles or reviews in this field. We list the 10 most productive journals with their IFs in this field in Supplementary Table S2 and provide an overdual map of citing and cited journals in Figure 3. According to statistics from the WoSCC, Scientific Reports published 253 publications over the last decade and thus ranks first. Medical Physics ranks second (244 publications), followed by IEEE Access (241 publications), European Radiology (213 publications), and Frontiers in Oncology (180 publications).
Figure 3 The dual map overlay of journals. This figure can be divided into two sections. Each dot represents one journal, and this knowledge map uses different colors to symbolize journals from different subjects. On the left, there are the citing journals of this field, and on the right, lays the cited journals in this field. The waves link to two sides means the publications on the journals of the left side may cite publications from the journals on the other side. For example, publications on journals in the field of medicine medical and clinical (labeled 2 on the left), may refer to the publications on the journal of systems, computing, and computer.
The 10 most co-cited journals are given in Supplementary Table S2. Among co-cited journals, Radiology was cited the most (3258 times), followed by IEEE Transactions on Medical Imaging (2800 times), Scientific Reports (2410 times), PLoS One (2407 times), and Medical Physics (2320 times).
Productive Authors
More than 2,000 authors have contributed to this field of research. Supplementary Table S3 shows the 10 most prolific authors, and Figure 4 presents a timeline of authors’ contributions to this field. Jie Tian is identified as the most productive author with 121 publications, and Anant Madabushi (56 publications) ranks second, followed by Dong Di (52 publications), Philippe Lambin (49 publications), and Zhenyu Liu (45 publications).
Figure 4 The timeline view listed authors by clustering through keywords. Each node represents one author. The position of the node here represents the time of an author’s first publication. There were 15 clusters of keywords. In each cluster, the size of each node shows the contribution of the author. It seems that the keywords “prostate” and “breast cancer MRI” occur most recently, which suggest the active participations of researchers in practicing radiomics for oncology related to them, and it also shows that researchers have been practicing radiomics research related to dental artifacts since it lasts the longest duration.
Supplementary Table S3 shows the leading 10 authors in terms of numbers of citations. The author with the most citations is Philippe Lambin (1,171 times), followed by Alex Krizhevsky (1,090 times), Robert J. Gillies (1,066 times), Hugo J. W. L Aerts (1,052 times), and Yann Lecun (1,020 times). Supplementary Figure S5 presents the authors’ potential cooperative relationships, as links between nodes indicate instances where authors are cited together. Since the authors on the left mainly focus on applications of radiomics while authors on the right have most laid the foundations of this field, Robert M. Haralick, shown in the middle of the network, has contributed in connecting applications and algorithms of radiomics in oncology (12).
With more than 2,000 author contributions, the knowledge map of cited authors provides information regarding the most influential authors and the collaborative relationships among them.
Popular References
CiteSpace provides a mixed map of terms and co-cited references, as shown in Figure 5. We present the 10 most cited references in Table 1. Of the 6,218 publications shown, an article published by Robert J. Gillies et al. in 2016 ranks first with 1,036 citations (9). This report describes the processes, challenges, and opportunities of radiomics in detail, particularly in reference to the field of oncology.
Figure 5 The mixed science map consists of the most cited noun phrases in publications and co-cited references in this field. By doing so, we illustrate the most co-cited references and the noun phrases in this field and uncover the relationship between them. There are two types of shapes in this picture. Each cross symbolizes a noun phrase, and each node represents a piece of co-cited references. There are links between the crosses and the circles. The links between two circles or noun phrases indicate there are some relationships between two pieces of articles or two phrases since they can be cited together. Also, the links between circles and crosses indicate that a piece of paper can be cited with certain noun phrases. Generally, there are three domains of this map. On the right and the left sides lay the most co-cited articles in the field. The ones on the left are mainly related to the definition and application of radiomics while the references on the right are mostly related to the AI algorithms involved in this field. In the middle are the most-cited noun phrases in the articles in this field. As indicated in the picture, the publications that contain these phrases are the bridges to relate publications from both sides. It illustrated that the most-cited articles from both sides may focus on conducting researches related to the noun phrases in the middle.
Table 1 The top 10 co-cited references.
The burst detection results show articles that have attracted the attention of peer scientists. Citation bursts note the duration and strength of each burst, or the duration and intensity of burst status, respectively (34). Figure 6 shows the 100 references with the strongest citation bursts. The citation burst analysis shows that a publication by Hugo J. W. L Aerts et al. earned the highest burst value (95.69) from 2015 to 2020 (35). This result indicates that this publication underwent a citation burst of the highest intensity from 2015 to 2020. The article reports that the radiomics data of cancer patients contain prognostic information and are associated with underlying gene expression patterns.
Figure 6 Detection of top 100 references with the strongest citation bursts.
Keyword Research
Over 800 keywords were extracted from publications. Figure 7 shows the keywords mentioned most frequently in publications. In terms of frequency, the term “artificial intelligence” ranks first (2,931 times), followed by “oncology” (1,972 times), “radiomics” (1,437 times), “classification” (1,436 times), “diagnosis” (1,020 times), and “segmentation” (995 times).
Figure 7 This is the knowledge map of the most cited keywords in this field. Each node represents a keyword, and the sizes of rings on the node denote the number of publications related to the keyword in a certain year. This map suggests the hotspots in this research field.
We identify the top 60 keywords with citation bursts, as shown in Figure 8, and we provide five keywords with the strongest recent citation bursts in Table 2. Of the 60 keywords with the strongest citation bursts, “radiation therapy” shows the highest burst strength level of 16.81. “Test retest”, “sarcoma”, “statistics”, “intensity-modulated radiotherapy,” and “genomics” are keywords with recent citation bursts, and the term “test retest” achieves the highest burst strength and the longest duration for 2016 to 2020. These keywords indicate that the reproducibility and statistical methods of radiomics, the relationship between radiomics and genomic types, and applications of radiomics to sarcomas and intensity-modulated radiotherapy are major focuses of research in this field.
Figure 8 Detection of top 60 keywords with the strongest citation bursts.
Table 2 Top 5 keywords in the network burst recently.
Discussion
To our knowledge, this is the first bibliometric analysis of radiomics in oncology. This article provides an in-depth and visualized analysis of publications of this field, which may help researchers gain a basic understanding, develop areas of focus and trends and pursue further practice in this field.
The 10 leading countries include four Asian countries, two American countries, and four European countries. The USA has contributed a great volume of publications (2,280) and has collaborated frequently with other countries. Publications from the USA and China comprise >40% of all publications. Among the 10 leading institutional contributors, the Chinese Academy of Sciences ranks highest in terms of volume. Furthermore, six of the 10 leading institutional contributors are Chinese universities. However, even with the country’s large volume of publications and despite including three of the five most prolific institutions, collaboration in China has been rare and limited, suggesting that although China has been carrying out radiomics research in oncology for the last decade, extensive collaborative work is needed.
Scientific Reports has been the leading contributions in this field with an IF of 3.998. Radiology has published fewer publications but is the most cited and hence may be viewed as an influential journal in this field with a high IF of 7.931; several ground-breaking articles have been published in Radiology (8, 9, 35).
We list the 10 leading contributing authors and the 10 most frequently cited authors. These authors have devoted themselves to conducting research in oncology radiomics and laid the foundation of basic knowledge in this field. Supplementary Figure S5 shows the corelationships of authors, which may indicate collaboration. With more than 100 publications, Jie Tian is the most prolific author with an H-index of 65. In 2016, to assist researchers in evaluating malignancy uncertainty, Jie Tian and his team developed a multicrop convolutional neural network to effectively characterize nodules instead of carefully segmenting using imaging and time-consuming feature extraction procedures (36). With the most citations of the 10 leading co-cited authors, Philippe Lambin is considered a pioneering and influential researcher in this field. He was the first to define radiomics and has made substantial efforts to standardize radiomics research (2, 8).
Among the 10 most cited references, an article by Robert J. Gilles et al. has been cited most, as this work provides basic information for researchers seeking to participate in radiomics research on work procedures, applications, challenges, and potential uses (9). In addition, three of the five most influential references focus on algorithms or basic knowledge of this field (37–39).
Keywords can represent areas of focus in a given field as shown in Figure 7, and we identified “artificial intelligence,” “tumors,” “classification,” “segmentation,” and “diagnosis” as areas of focus in this field. We summarize these areas as follows:
1. AI: Much of the development of radiomics relies on AI algorithms, as they can mimic human performance. To date, AI algorithms have been most widely used in radiomics in oncology. In fact, the development of AI can directly influence this field. In the past, radiomics studies most rely on traditional machine learning methods: the random forest, decision tree, and regression algorithms. These algorithms mostly rely on manual segmentation, require a huge amount of matrix manipulations, and can only perform well in small given datasets. These time-consuming processes hindered the applications of radiomics studies. Unlike the traditional machine learning methods, deep learning is a subset of AI that can acquire discriminative features from data. Instead of requiring experienced radiologists to evaluate medical images, deep learning algorithms excel at delineating and monitoring cancerous lesions and can translate medical images into quantitative data to be automatically analyzed. This approach has been most frequently applied in radiomics in oncology (40, 41). Moreover, radiomic models integrated by AI algorithms and clinical features can increase the capacity to judge individual treatment. With efforts made to develop AI technology, ground-breaking AI algorithms may enable computers to act more similar to human beings in the future.
2. Oncology, radiomics, diagnosis, and classification: When analyzing a medical image, clinicians usually depend on their personal experience, which is subjective, and results therefore vary among different radiologists (41). By applying quantitative data extracted from medical images for analysis, radiomics provides a new objective means using AI algorithms to detect lesions. Radiomics research today mainly focuses on diagnosis and classification (42, 43). For example, a computer-assisted diagnosis system can automatedly identify cancerous lesions with images and videos (44), and researchers have made considerable efforts to build radiomics models to classify identical cancerous lesions and lymph node status (5, 45).
3. Segmentation: To achieve reliable radiomic models in oncology, robustly and precisely delineating lesions is essential. However, traditional manual segmentation usually takes a very long time to perform, generates interobserver variability, and requires the involvement of experienced radiologists for analysis. To address these problems, automated segmentation methods have been established in radiomic research in oncology (46, 47).
Our burst detection results of references reveal articles that have attracted the attention of peer scientists (34). It seems that the ground-breaking articles and reviews with the highest citation burst strength and longest durations were published in 2015 (35). Since citation bursts may help researchers obtain a quick review of research focuses and perspectives, below we list some recent radiomic studies identified by citation burst detection that may be defined as ground-breaking works in this field in leading prospective research:
1. Some radiomic signatures have prognostic power, and there is a prognostic radiomic signature associated with underlying gene expression patterns (35);
2. Researchers have built a prostate cancer MRI computer-aided detection system evaluated on a per-patient basis and compared with the prospective performance of radiologists (48);
3. Multiparametric MRI has been used to accurately locate and segment rectal cancer (49);
4. Researchers have found that the preprocessing of CT images may influence feature volume dependence and its significance in univariate analysis models (50);
5. Using simple linear regression, a subset of radiomic features extracted from CT and cone-beam CT images can be interchangeable, and cone-beam CT radiomics can be used as a prognostic imaging biomarker (51).
We also found that radiomics research in oncology may focus on the following five keywords: test-retest, sarcoma, statistics, intensity-modulated radiotherapy, and genomics. These terms may reflect prospective areas of focus in radiomics for oncology and are summarized as follows:
1. Test-retest and statistics: Test-retest methods involve repeating the process of acquiring medical images to test the stability of radiomic features that they may generate. As there are many radiomics models based on various imaging parameter settings and algorithms, test-retest studies of these radiomics features have become essential for future applications. Researchers in this field have engaged in examining the reproducibility of radiomic features (52–54). However, according to a systematic review by Alberto Traverso et al., under different settings, there is no consensus on the most reproducible features (55). Moreover, the statistical method used in radiomics is of great significance. To conduct radiomic research of high quality, standardized statistical methods are essential (56, 57). Likewise, different facilities or radiologists involved during the acquisition of medical images and various analysis algorithms used may lead to bias in radiomics models. Sometimes, owing to the nonstandardized procedure of medical imaging, pictures are too distorted or of low resolution to be read by an AI algorithm. Inexperienced doctors may also fail to identify lesions. Such bias may lead to the conversion of the output result when establishing a radiomic model. Thus, future research may focus on the reproducibility of radiomics models.
2. Sarcoma: To date, radiomics has been used in the classification (58) and prediction of metastasis for sarcomas (59); additionally, nomograms have been used in survival prediction (60) for sarcomas. There have been relatively few radiomic analyses of sarcomas, since the prevalence of this disease is relatively low. However, this result implies that more radiomic studies should focus on sarcomas.
3. Intensity-modulated radiotherapy: Researchers have used radiomic models to predict patients’ responses to intensity-modulated radiotherapy (25, 61). As datasets expand, further applications of radiomics in predicting prognosis for patients undergoing radiotherapy may be identified.
4. Genomics: Radiogenomics involves the use of data generated by radiomic analysis to correlate with genomic patterns. Evidence has shown that radiomics features are correlated with gene patterns (35, 62, 63). Radiomic features that do not relate to gene types may supply independent information, which may enable precision medicine (9).
Our study has some limitations. First, we only focus on literature included in the WoSCC; thus, not all publications are considered and citation counts may be underestimated. Second, CiteSpace only analyses the main conclusions of publications instead of reviewing full texts; thus, some information may have been overlooked. Finally, our results only reflect the current state of radiomics research in oncology, as data are typically prone to frequent changes.
To our knowledge, this is the first analysis of radiomics in oncology conducted from the perspective of bibliometrics. The presented results may help researchers gain a basic understanding and detect areas of focus and trends and may encourage further practice in this field.
Conclusion
Due to advances in technology, radiomics in oncology has significantly evolved over the past decade. According to results found through CiteSpace, we can conclude that current studies in this field focus on AI algorithms and on using radiomics to realize automated segmentation and classify and diagnose lesions.
Such a trend may be attributed to the rapid growth of AI algorithms, which can identify medical images. Researchers have used this new tool to train machines to identify lesions. Many articles on such issues have emerged in the last decade. This may explain why in recent decades the number of papers in this field has sharply increased. However, even with AI algorithms surpassing the performance of physicians, we must carefully validate them.
Since CNN is the most widely used AI algorithm in this field, the terms “test-retest” and “statistics” were identified during our burst detection of keywords. This finding is attributed to the characteristics of CNN itself. Unlike other algorithms, CNN requires magnitude data to train models. When such data are available, CNN can establish a robust model with high precision for clinical decision-making. However, the accessibility of medical data is always limited, and many studies mainly establish their models based on relatively small datasets. Such models may perform well only for the studied datasets. Meanwhile, a given CNN network can only perform a single defined task based on the given labels and dataset. In regard to combining several radiomic models in identifying the same oncolesions, relabeling images and retraining models may be needed due to the limitations of CNN. Therefore, model test-retest and statistical methods are likely to be widely used in future work in this field. The identification of robust features and use of standardized statistical methods may offer opportunities for the combination of various CNN models. If this can be eventually achieved, robust CNN models may be developed and may surpass the capacities of human beings. Thus, with the application of CNN models, researchers can realize their limitations. The field will thus develop with the use of a new kind of algorithm that may overcome the limitations of the CNN network (1, 64).
From our findings, we must note that not all kinds of lesions have received equal attention. According to the provided evidence, lung, breast, and prostate cancer have been the most frequently studied malignancies. According to 2020 cancer statistics (65), some of the most prevalent cancers have not been widely studied, including colon and rectum tumors, bladder cancer, kidney cancer, etc. Additionally, some region-related cancers, including liver, gastric, and oral cancer (66), which are major forms of malignancy in Asia, have been less widely reported on. This may relate to barriers of radiomics technology and poor cross-country collaboration. “Sarcoma” was highlighted in the burst detection analysis, indicating that research has focused on this field; however, only a few studies have specifically investigated this type of malignancy. This trend may be due to the relatively low disease incidence and fast progression of the disease, rendering the availability of imaging datasets more constrained. An increased use of radiomics to diagnose the above less-reported malignancies may accompany the development of AI algorithms and the sharing of databases across regions and countries.
Intensity-modulated radiotherapy and genomics may be more heavily integrated with radiomics in the future, potentially because it usually takes a long time to establish a radiomic model that can predict the survival rate of intensity-modulated radiotherapy. With the establishment of a large dataset, the use of radiomics to predict the prognoses of patients undergoing such therapy may increase in the future. Additionally, studies have found relationships between cancerous lesions and their gene patterns. Since radiomics is a risk-free means to examine the gene patterns of oncology, it may become the next area of focus of this field.
In conclusion, with active participation and regulated practices, radiomics may be applied in every phase of oncology treatment, which could further advance the development of oncology and will likely change the state of oncology imaging.
Data Availability Statement
The original contributions presented in the study are included in the article/Supplementary Material. Further inquiries can be directed to the corresponding author.
Author Contributions
YL conceived and designed the structure of this manuscript. HD, CW, NL, WS, QZ, YH, and ZJ wrote the paper. YL revised the paper. All authors contributed to the article and approved the submitted version.
Funding
This work was supported by the National Natural Science Foundation of China [Grant No. 81972546 to YL].
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fonc.2021.689802/full#supplementary-material
References
1. Savadjiev P, Chong J, Dohan A, Vakalopoulou M, Reinhold C, Paragios N, et al. Demystification of AI-Driven Medical Image Interpretation: Past, Present and Future. Eur Radiol (2019) 29(3):1616–24. doi: 10.1007/s00330-018-5674-x
2. Lambin P, Rios-Velazquez E, Leijenaar R, Carvalho S, van Stiphout RG, Granton P, et al. Radiomics: Extracting More Information From Medical Images Using Advanced Feature Analysis. Eur J Cancer (2012) 48(4):441–6. doi: 10.1016/j.ejca.2011.11.036
3. Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, et al. Dermatologist-Level Classification of Skin Cancer With Deep Neural Networks. Nature (2017) 542(7639):115–8. doi: 10.1038/nature21056
4. Guo L, Xiao X, Wu C, Zeng X, Zhang Y, Du J, et al. Real-Time Automated Diagnosis of Precancerous Lesions and Early Esophageal Squamous Cell Carcinoma Using a Deep Learning Model (With Videos). Gastrointest Endosc (2020) 91(1):41–51. doi: 10.1016/j.gie.2019.08.018
5. Yin P, Mao N, Zhao C, Wu J, Chen L, Hong N. A Triple-Classification Radiomics Model for the Differentiation of Primary Chordoma, Giant Cell Tumor, and Metastatic Tumor of Sacrum Based on T2-Weighted and Contrast-Enhanced T1-Weighted MRI. J Magn Reson Imaging (2019) 49(3):752–9. doi: 10.1002/jmri.26238
6. Nie K, Shi L, Chen Q, Hu X, Jabbour SK, Yue N, et al. Rectal Cancer: Assessment of Neoadjuvant Chemoradiation Outcome Based on Radiomics of Multiparametric MRI. Clin Cancer Res (2016) 22(21):5256–64. doi: 10.1158/1078-0432.CCR-15-2997
7. Bologna M, Calareso G, Resteghini C, Sdao S, Montin E, Corino V, et al. Relevance of Apparent Diffusion Coefficient Features for a Radiomics-Based Prediction of Response to Induction Chemotherapy in Sinonasal Cancer. NMR Biomed (2020), e4265. doi: 10.1002/nbm.4265
8. Lambin P, Leijenaar RTH, Deist TM, Peerlings J, de Jong EEC, van Timmeren J, et al. Radiomics: The Bridge Between Medical Imaging and Personalized Medicine. Nat Rev Clin Oncol (2017) 14(12):749–62. doi: 10.1038/nrclinonc.2017.141
9. Gillies RJ, Kinahan PE, Hricak H. Radiomics: Images Are More Than Pictures, They Are Data. Radiology (2016) 278(2):563–77. doi: 10.1148/radiol.2015151169
10. Clarke LP, Nordstrom RJ, Zhang H, Tandon P, Zhang Y, Redmond G, et al. The Quantitative Imaging Network: NCI’s Historical Perspective and Planned Goals. Transl Oncol (2014) 7(1):1–4. doi: 10.1593/tlo.13832
11. Buckler AJ, Bresolin L, Dunnick NR, Sullivan DC. A Collaborative Enterprise for Multi-Stakeholder Participation in the Advancement of Quantitative Imaging. Radiology (2011) 258(3):906–14. doi: 10.1148/radiol.10100799
12. Haralick RM, Shanmugam K, Dinstein I. TEXTURAL FEATURES FOR IMAGE CLASSIFICATION. IEEE Trans Syst Man Cybernetics (1973) SMC3(6):610–21. doi: 10.1109/TSMC.1973.4309314
13. Lo SCB, Lou SLA, Lin JS, Freedman MT, Chien MV, Mun SK. Artificial Convolution Neural Network Techniques and Applications for Lung Nodule Detection. IEEE Trans Med Imaging (1995) 14(4):711–8. doi: 10.1109/42.476112
14. Segal E, Sirlin CB, Ooi C, Adler AS, Gollub J, Chen X, et al. Decoding Global Gene Expression Programs in Liver Cancer by Noninvasive Imaging. Nat Biotechnol (2007) 25(6):675–80. doi: 10.1038/nbt1306
15. Diehn M, Nardini C, Wang DS, McGovern S, Jayaraman M, Liang Y, et al. Identification of Noninvasive Imaging Surrogates for Brain Tumor Gene-Expression Modules. Proc Natl Acad Sci U.S.A. (2008) 105(13):5213–8. doi: 10.1073/pnas.0801279105
16. Parmar C, Grossmann P, Bussink J, Lambin P, Aerts H. Machine Learning Methods for Quantitative Radiomic Biomarkers. Sci Rep (2015) 5:13087. doi: 10.1038/srep13087
17. Parmar C, Leijenaar RT, Grossmann P, Rios Velazquez E, Bussink J, Rietveld D, et al. Radiomic Feature Clusters and Prognostic Signatures Specific for Lung and Head & Neck Cancer. Sci Rep (2015) 5:11044. doi: 10.1038/srep11044
18. Sun R, Limkin EJ, Vakalopoulou M, Dercle L, Champiat S, Han SR, et al. A Radiomics Approach to Assess Tumour-Infiltrating CD8 Cells and Response to Anti-PD-1 or Anti-PD-L1 Immunotherapy: An Imaging Biomarker, Retrospective Multicohort Study. Lancet Oncol (2018) 19(9):1180–91. doi: 10.1016/S1470-2045(18)30413-3
19. Huang C, Cintra M, Brennan K, Zhou M, Colevas AD, Fischbein N, et al. Development and Validation of Radiomic Signatures of Head and Neck Squamous Cell Carcinoma Molecular Features and Subtypes. EBioMedicine (2019) 45:70–80. doi: 10.1016/j.ebiom.2019.06.034
20. Hawkins SH, Korecki JN, Balagurunathan Y, Yuhua G, Kumar V, Basu S, et al. Predicting Outcomes of Nonsmall Cell Lung Cancer Using CT Image Features. IEEE Access (2014) 2:1418–26. doi: 10.1109/ACCESS.2014.2373335
21. Huang YQ, Liang CH, He L, Tian J, Liang CS, Chen X, et al. Development and Validation of a Radiomics Nomogram for Preoperative Prediction of Lymph Node Metastasis in Colorectal Cancer. J Clin Oncol (2016) 34(18):2157–64. doi: 10.1200/JCO.2015.65.9128
22. Wu W, Parmar C, Grossmann P, Quackenbush J, Lambin P, Bussink J, et al. Exploratory Study to Identify Radiomics Classifiers for Lung Cancer Histology. Front Oncol (2016) 6:71. doi: 10.3389/fonc.2016.00071
23. van Timmeren JE, Leijenaar RTH, van Elmpt W, Reymen B, Oberije C, Monshouwer R, et al. Survival Prediction of non-Small Cell Lung Cancer Patients Using Radiomics Analyses of Cone-Beam CT Images. Radiother Oncol (2017) 123(3):363–9. doi: 10.1016/j.radonc.2017.04.016
24. Liu Z, Zhang XY, Shi YJ, Wang L, Zhu HT, Tang Z, et al. Radiomics Analysis for Evaluation of Pathological Complete Response to Neoadjuvant Chemoradiotherapy in Locally Advanced Rectal Cancer. Clin Cancer Res (2017) 23(23):7253–62. doi: 10.1158/1078-0432.CCR-17-1038
25. Abdollahi H, Mofid B, Shiri I, Razzaghdoust A, Saadipoor A, Mahdavi A, et al. Machine Learning-Based Radiomic Models to Predict Intensity-Modulated Radiation Therapy Response, Gleason Score and Stage in Prostate Cancer. Radiol Med (2019) 124(6):555–67. doi: 10.1007/s11547-018-0966-4
26. Oelrich B, Peters R, Jung K. A Bibliometric Evaluation of Publications in Urological Journals Among European Union Countries Between 2000-2005. Eur Urol (2007) 52(4):1238–48. doi: 10.1016/j.eururo.2007.06.050
27. Khan MS, Ullah W, Riaz IB, Bhulani N, Manning WJ, Tridandapani S, et al. Top 100 Cited Articles in Cardiovascular Magnetic Resonance: A Bibliometric Analysis. J Cardiovasc Magn Reson (2016) 18(1):87. doi: 10.1186/s12968-016-0303-9
28. Chen C. CiteSpace II: Detecting and Visualizing Emerging Trends and Transient Patterns in Scientific Literature. J Am Soc Inf Sci Technol (2006) 57(3):359–77. doi: 10.1002/asi.20317
29. Da W, Tao Z, Meng Y, Wen K, Zhou S, Yang K, et al. A 10-Year Bibliometric Analysis of Osteosarcoma and Cure From 2010 to 2019. BMC Cancer (2021) 21(1):115. doi: 10.1186/s12885-021-07818-4
30. Yan W, Zheng K, Weng L, Chen C, Kiartivich S, Jiang X, et al. Bibliometric Evaluation of 2000-2019 Publications on Functional Near-Infrared Spectroscopy. Neuroimage (2020) 220:117121. doi: 10.1016/j.neuroimage.2020.117121
31. Chen S, Zhang Y, Dai W, Qi S, Tian W, Gu X, et al. Publication Trends and Hot Spots in Postoperative Cognitive Dysfunction Research: A 20-Year Bibliometric Analysis. J Clin Anesth (2020) 67:110012. doi: 10.1016/j.jclinane.2020.110012
32. Garfield E. The History and Meaning of the Journal Impact Factor. Jama-Journal Am Med Assoc (2006) 295(1):90–3. doi: 10.1001/jama.295.1.90
33. Small H. COCITATION IN SCIENTIFIC LITERATURE - NEW MEASURE OF RELATIONSHIP BETWEEN 2 DOCUMENTS. J Am Soc Inf Sci (1973) 24(4):265–9. doi: 10.1002/asi.4630240406
34. Chen C, Dubin R, Kim MC. Emerging Trends and New Developments in Regenerative Medicine: A Scientometric Update (2000 - 2014). Expert Opin Biol Ther (2014) 14(9):1295–317. doi: 10.1517/14712598.2014.920813
35. Aerts HJ, Velazquez ER, Leijenaar RT, Parmar C, Grossmann P, Carvalho S, et al. Decoding Tumour Phenotype by Noninvasive Imaging Using a Quantitative Radiomics Approach. Nat Commun (2014) 5:4006. doi: 10.1038/ncomms5006
36. Shen W, Zhou M, Yang F, Yu D, Dong D, Yang C, et al. Multi-Crop Convolutional Neural Networks for Lung Nodule Malignancy Suspiciousness Classification. Pattern Recognition (2017) 61:663–73. doi: 10.1016/j.patcog.2016.05.029
37. LeCun Y, Bengio Y, Hinton G. Deep Learning. Nature (2015) 521(7553):436–44. doi: 10.1038/nature14539
38. Ronneberger O, Fischer P, Brox T. U-Net: Convolutional Networks for Biomedical Image Segmentation. Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015. Lecture Notes Comput Sci (2015) 9351:234–41. doi: 10.1007/978-3-319-24574-4_28
39. He K, Zhang X, Ren S, Sun J. Deep Residual Learning for Image Recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE. (2016). p. 770–8.
40. Hosny A, Parmar C, Quackenbush J, Schwartz LH, Aerts H. Artificial Intelligence in Radiology. Nat Rev Cancer (2018) 18(8):500–10. doi: 10.1038/s41568-018-0016-5
41. Bi WL, Hosny A, Schabath MB, Giger ML, Birkbak NJ, Mehrtash A, et al. Artificial Intelligence in Cancer Imaging: Clinical Challenges and Applications. CA Cancer J Clin (2019) 69(2):127–57. doi: 10.3322/caac.21552
42. El-Dahshan E-SA, Mohsen HM, Revett K, Salem A-BM. Computer-Aided Diagnosis of Human Brain Tumor Through MRI: A Survey and a New Algorithm. Expert Syst Appl (2014) 41(11):5526–45. doi: 10.1016/j.eswa.2014.01.021
43. Liu C, Ding J, Spuhler K, Gao Y, Serrano Sosa M, Moriarty M, et al. Preoperative Prediction of Sentinel Lymph Node Metastasis in Breast Cancer by Radiomic Signatures From Dynamic Contrast-Enhanced MRI. J Magn Reson Imaging (2019) 49(1):131–40. doi: 10.1002/jmri.26224
44. Guo R, Guo J, Zhang L, Qu X, Dai S, Peng R, et al. CT-Based Radiomics Features in the Prediction of Thyroid Cartilage Invasion From Laryngeal and Hypopharyngeal Squamous Cell Carcinoma. Cancer Imaging (2020) 20(1):81. doi: 10.1186/s40644-020-00359-2
45. Ho TY, Chao CH, Chin SC, Ng SH, Kang CJ, Tsang NM. Classifying Neck Lymph Nodes of Head and Neck Squamous Cell Carcinoma in MRI Images With Radiomic Features. J Digit Imaging (2020) 33(3):613–8. doi: 10.1007/s10278-019-00309-w
46. Parmar C, Rios Velazquez E, Leijenaar R, Jermoumi M, Carvalho S, Mak RH, et al. Robust Radiomics Feature Quantification Using Semiautomatic Volumetric Segmentation. PloS One (2014) 9(7):e102107. doi: 10.1371/journal.pone.0102107
47. Polan DF, Brady SL, Kaufman RA. Tissue Segmentation of Computed Tomography Images Using a Random Forest Algorithm: A Feasibility Study. Phys Med Biol (2016) 61(17):6553–69. doi: 10.1088/0031-9155/61/17/6553
48. Litjens G, Debats O, Barentsz J, Karssemeijer N, Huisman H. Computer-Aided Detection of Prostate Cancer in MRI. IEEE Trans Med Imaging (2014) 33(5):1083–92. doi: 10.1109/TMI.2014.2303821
49. Trebeschi S, van Griethuysen JJM, Lambregts DMJ, Lahaye MJ, Parmar C, Bakers FCH, et al. Deep Learning for Fully-Automated Localization and Segmentation of Rectal Cancer on Multiparametric Mr. Sci Rep (2017) 7(1):5301. doi: 10.1038/s41598-017-05728-9
50. Fave X, Zhang L, Yang J, Mackin D, Balter P, Gomez D, et al. Impact of Image Preprocessing on the Volume Dependence and Prognostic Potential of Radiomics Features in non-Small Cell Lung Cancer. Trans Cancer Res (2016) 5(4):349–63. doi: 10.21037/tcr.2016.07.11
51. Shiri I, Rahmim A, Ghaffarian P, Geramifar P, Abdollahi H, Bitarafan-Rajabi A. The Impact of Image Reconstruction Settings on 18F-FDG PET Radiomic Features: Multi-Scanner Phantom and Patient Studies. Eur Radiol (2017) 27(11):4498–509. doi: 10.1007/s00330-017-4859-z
52. Leijenaar RTH, Carvalho S, Velazquez ER, Van Elmpt WJC, Parmar C, Hoekstra OS, et al. Stability of FDG-PET Radiomics Features: An Integrated Analysis of Test-Retest and Inter-Observer Variability. Acta Oncol (2013) 52(7):1391–7. doi: 10.3109/0284186X.2013.812798
53. van Velden FH, Kramer GM, Frings V, Nissen IA, Mulder ER, de Langen AJ, et al. Repeatability of Radiomic Features in Non-Small-Cell Lung Cancer [(18)F]FDG-PET/CT Studies: Impact of Reconstruction and Delineation. Mol Imaging Biol (2016) 18(5):788–95. doi: 10.1007/s11307-016-0940-2
54. Zhao B, Tan Y, Tsai WY, Qi J, Xie C, Lu L, et al. Reproducibility of Radiomics for Deciphering Tumor Phenotype With Imaging. Sci Rep (2016) 6:23428. doi: 10.1038/srep23428
55. Traverso A, Wee L, Dekker A, Gillies R. Repeatability and Reproducibility of Radiomic Features: A Systematic Review. Int J Radiat Oncol Biol Phys (2018) 102(4):1143–58. doi: 10.1016/j.ijrobp.2018.05.053
56. Leijenaar RT, Nalbantov G, Carvalho S, van Elmpt WJ, Troost EG, Boellaard R, et al. The Effect of SUV Discretization in Quantitative FDG-PET Radiomics: The Need for Standardized Methodology in Tumor Texture Analysis. Sci Rep (2015) 5:11075. doi: 10.1038/srep11075
57. Ha S, Choi H, Paeng JC, Cheon GJ. Radiomics in Oncological PET/CT: A Methodological Overview. Nucl Med Mol Imaging (2019) 53(1):14–29. doi: 10.1007/s13139-019-00571-4
58. Hermessi H, Mourali O, Zagrouba E. Deep Feature Learning for Soft Tissue Sarcoma Classification in MR Images via Transfer Learning. Expert Syst Appl (2019) 120:116–27. doi: 10.1016/j.eswa.2018.11.025
59. Vallieres M, Freeman CR, Skamene SR, El Naqa I. A Radiomics Model From Joint FDG-PET and MRI Texture Features for the Prediction of Lung Metastases in Soft-Tissue Sarcomas of the Extremities. Phys Med Biol (2015) 60(14):5471–96. doi: 10.1088/0031-9155/60/14/5471
60. Wu Y, Xu L, Yang P, Lin N, Huang X, Pan W, et al. Survival Prediction in High-Grade Osteosarcoma Using Radiomics of Diagnostic Computed Tomography. EBioMedicine (2018) 34:27–34. doi: 10.1016/j.ebiom.2018.07.006
61. Li S, Wang K, Hou Z, Yang J, Ren W, Gao S, et al. Use of Radiomics Combined With Machine Learning Method in the Recurrence Patterns After Intensity-Modulated Radiotherapy for Nasopharyngeal Carcinoma: A Preliminary Study. Front Oncol (2018) 8:648. doi: 10.3389/fonc.2018.00648
62. Zhu Y, Mohamed ASR, Lai SY, Yang S, Kanwar A, Wei L, et al. Imaging-Genomic Study of Head and Neck Squamous Cell Carcinoma: Associations Between Radiomic Phenotypes and Genomic Mechanisms via Integration of The Cancer Genome Atlas and The Cancer Imaging Archive. JCO Clin Cancer Inform (2019) 3:1–9. doi: 10.1200/CCI.18.00073
63. Zwirner K, Hilke FJ, Demidov G, Socarras Fernandez J, Ossowski S, Gani C, et al. Radiogenomics in Head and Neck Cancer: Correlation of Radiomic Heterogeneity and Somatic Mutations in TP53, FAT1 and KMT2D. Strahlenther Onkol (2019) 195(9):771–9. doi: 10.1007/s00066-019-01478-x
64. Fujita H. AI-Based Computer-Aided Diagnosis (AI-CAD): The Latest Review to Read First. Igaku Butsuri : Nihon Igaku Butsuri Gakkai Kikanshi. Japanese J Med Phys an Off J Japan Soc Med Phys (2020) 40(4):140. doi: 10.1007/s12194-019-00552-4
65. Siegel RL, Miller KD, Jemal A. Cancer Statistics, 2020. CA: A Cancer J Clin (2020) 70(1):7–30. doi: 10.3322/caac.21590
Keywords: radiomics, oncology, bibliometric analysis, hotspots, trends
Citation: Ding H, Wu C, Liao N, Zhan Q, Sun W, Huang Y, Jiang Z and Li Y (2021) Radiomics in Oncology: A 10-Year Bibliometric Analysis. Front. Oncol. 11:689802. doi: 10.3389/fonc.2021.689802
Received: 01 April 2021; Accepted: 27 August 2021;
Published: 20 September 2021.
Edited by:
Daniela Elena Oprea-Lager, Academic Medical Center, NetherlandsReviewed by:
Chen Liu, Army Medical University, ChinaWilliam Ian Duncombe Rae, The University of Sydney, Australia
Copyright © 2021 Ding, Wu, Liao, Zhan, Sun, Huang, Jiang and Li. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Yi Li, Liyi1012@163.com