- 1Oncoclínicas&Co/MedSir, Rio de Janeiro, Brazil
- 2Medical School of the Federal University of Rio de Janeiro, Rio de Janeiro, Brazil
- 3Santa Casa de Misericórdia de Belo Horizonte, Belo Horizonte, Brazil
- 4Faculdade de Medicina do ABC, Santo André, Brazil
- 5Centro de Estudos e Pesquisas de Hematologia e Oncologia (CEPHO), Sao Paulo, Brazil
Fundamentally precision oncology illustrates the path in which molecular profiling of tumors can illuminate their biological behavior, diversity, and likely outcomes by identifying distinct genetic mutations, protein levels, and other biomarkers that underpin cancer progression. Next-generation sequencing became an indispensable diagnostic tool for diagnosis and treatment guidance in current clinical practice. Nowadays, tissue analysis benefits from further support through methods like comprehensive genomic profiling and liquid biopsies. However, precision medicine in the field of oncology presents specific hurdles, such as the cost-benefit balance and widespread accessibility, particularly in countries with low- and middle-income. A key issue is how to effectively extend next-generation sequencing to all cancer patients, thus empowering treatment decision-making. Concerns also extend to the quality and preservation of tissue samples, as well as the evaluation of health technologies. Moreover, as technology advances, novel next-generation sequencing assessments are being developed, including the study of Fragmentomics. Therefore, our objective was to delineate the primary uses of next-generation sequencing, discussing its’ applications, limitations, and prospective paths forward in Oncology.
Introduction
The main fundament of precision oncology is the detailed molecular profiling of tumors to identify specific genetic alterations, protein expressions, and other biomarkers that drive cancer growth (Satam et al., 2023), besides predicting tumors’ biological behavior, heterogeneity, and prognosis (Nakagawa and Fujita, 2018).
DNA and RNA sequencing has rapidly evolved over the past four decades and had two breakthrough moments, first with Sanger sequencing and second with next-generation sequencing (NGS) (Satam et al., 2023). The latter allows broader analyses from fragments of the human DNA, with an extended spectrum of gene sequencing, and captures multiple mutations in a short period (Qin, 2019).
Studies on genome-wide analyses, like The Cancer Genome Atlas (TCGA) and International Cancer Genome Consortium (ICGC) performed with NGS technology, provided comprehensive mutational data (Nakagawa and Fujita, 2018). Such advanced technology does not limit itself to a single tumor site and may be applied to Non-Small Lung Cell Cancer (NSLCC) (de Oliveira Cavagna et al., 2023; Kang et al., 2024), Colon Cancer (Zhu L. et al., 2023; Bachet et al., 2023; Quintanilha et al., 2023), and Melanoma (King et al., 2023; Perez-Perez et al., 2023; Dedeilia et al., 2024) care.
NGS became an indispensable diagnostic tool, and with the increase of genomic profiling in current clinical practice for both diagnosis and treatment guidance, cancer management was reshaped by precision oncology (Mateo et al., 2022). Nonetheless, precision medicine in oncology poses unique challenges (Chan et al., 2021), such as cost-effectiveness and accessibility (Chan et al., 2021; Mateo et al., 2022), with major concerns on how NGS can be properly implemented for all cancer patients, empowering treatments’ decision-making (Mateo et al., 2022). Therefore, we aimed to scope the main applications of NGS, covering its’ applications, pitfalls, and future directions in Oncology.
Next-generation sequencing: a new standard in cancer management
NGS provides simultaneous sequencing and comprises a platform that uses sequencing-by-synthesis methods such as Illumina (reversible dye terminators) and Ion Torrent (hydrogen ion released) (Satam et al., 2023). The vast amount of NGS data requires advanced bioinformatics tools to properly analyze and interpret each variant and its clinical significance (Qin, 2019).
NGS enables detailed analysis of genetic material from various sources. Among the most used nucleic acids in NGS are genomic DNA (gDNA), RNA, cell-free DNA (cfDNA), and circulating tumor DNA (ctDNA). Each of these nucleic acids offers unique advantages and poses specific challenges for sequencing applications.
NGS marked a substantial advancement in personalized medicine by facilitating the identification of somatic driver mutations, resistance mechanisms, quantification of mutational burden, and germline mutations, laying the groundwork for a novel approach to cancer treatment (Salvo et al., 2021). Multiple studies have shown that mutation analysis can aid clinicians in more accurately classifying tumors and recommending appropriate treatment regimens for patients (Del Re et al., 2024). Such stratification led to the development of a personalized treatment approach, i.e., with the viability of choosing the proper treatment, whether the choice is chemotherapy, targeted therapy, and/or immunotherapy.
Current perspectives and clinical application
Comprehensive genomic profiling on cancer
Comprehensive Genomic Profiling (CGP) enhanced the field of molecular diagnostics, leveraging NGS technologies to analyze a broad array of genetic alterations across a multitude of genes in a single, efficient test (Pankiw et al., 2023; Diks et al., 2024).
CGP offers advantages over traditional methods by requiring smaller tissue samples and reducing the time needed to test for various biomarkers (Table 1). Improvements to CGP, such as RNA fusion assays and liquid biopsies, extend its capabilities beyond gDNA analyses. These additions are valuable for identifying gene fusions and splicing variants, as well as for augmenting the findings from tissue-based CGP, offering a more complete picture of a tumor’s genetic landscape (Tjota et al., 2024).
Cancer treatment is often complicated by the development of resistance to therapies. CGP can identify genetic changes that confer resistance to specific drugs, allowing oncologists to adjust treatment plans proactively. For example, the detection of a secondary mutation in the epidermal growth factor receptor (EGFR) gene in lung cancer patients who initially responded to EGFR inhibitors but then relapsed can guide the switch to alternative therapies designed to overcome resistance (Kulda et al., 2023; Rotow et al., 2024).
Nonetheless, the adoption of CGP across all clinical scenarios remains uneven (Kou et al., 2017). Despite these advantages, data indicate that while 44% of such patients in Japan are recommended new forms of therapy following CGP testing, fewer than 10% receive these recommended treatments, leading many to discover that the test does not change their treatment course (Kage et al., 2024).
The future of CGP lies in its integration with other ‘omics’ data (such as proteomics and metabolomics) and clinical information to develop even more sophisticated models of cancer. This integration promises to enhance our understanding of cancer biology, improve the prediction of treatment responses, and identify novel therapeutic targets.
Next-generation sequencing and liquid biopsy
The utilization of NGS technologies through liquid biopsy has emerged as a groundbreaking approach in the diagnosis, monitoring, and treatment planning for patients with cancer. These multifaceted aspects are pivotal for advancing personalized cancer therapy (Lin et al., 2021; Ferreira et al., 2023) (Table 2). These broad-spectrum analyses are crucial for identifying actionable mutations that can guide the selection of targeted therapies, making NGS an indispensable tool in the precision oncology toolbox (Del Re et al., 2024; Yi et al., 2024).
Liquid biopsy refers to the non-invasive analysis of tumor-derived material, such ctDNA, circulating tumor cells (CTCs), RNA, and exosomes, present in bodily fluids like blood, urine, or cerebrospinal fluid. This approach offers a dynamic snapshot of cancer’s genetic landscape, enabling real-time tumor evolution assessment, resistance mechanisms, and treatment efficacy) (Lin et al., 2021; Pesta et al., 2022; Herreros-Villanueva et al., 2022; Xia et al., 2023). Table 3 summarizes how liquid biopsies and NGS are transforming Oncology care.
The variability in ctDNA levels is critical for understanding the utility of ctDNA as a biomarker in cancer management. The differential detection rates of ctDNA may vary across various cancers. ctDNA may be found in more than 75% of patients with advanced stages of pancreatic, colorectal, gastroesophageal, hepatocellular, bladder, ovarian, breast, head & neck cancers, or melanoma (Bettegowda et al., 2014). Conversely, ctDNA might be less frequent (in fewer than 50% of cases) in patients with primary brain, prostate, thyroid, and renal cancers (Bettegowda et al., 2014). In cancers where ctDNA is more readily detected, NGS can be used to identify actionable genetic mutations that can guide targeted therapy decisions (Del Re et al., 2024; Horgan et al., 2024), whereas in cases where ctDNA is less prevalent, advancements in NGS sensitivity are critical for improving detection rates, thereby broadening the utility of ctDNA analyses across a wider range of cancers and stages (Tjota et al., 2024).
The integration of NGS into the domain of liquid biopsy is particularly crucial in evaluating variant allele frequency (VAF) in ctDNA, which has emerged as a promising biomarker with potential clinical applications (Chen and Zhao, 2019).
VAF are important measures of genetic variation that are used in a broad range of tumor assessments, including its’ purity and ploidy, and it can be measured from both genomic (DNA) and transcriptomic (RNA) sequencing data as the encoded and expressed allele frequencies, respectively (Slowinski et al., 2020). VAF can be assessed using either tissue samples or ctDNA isolated from liquid biopsy, and it may distinguish driver from passenger mutations and the potential germline status of genomic alterations (Galant et al., 2024). Thus, by calculating this genomic biomarker, VAF may represent a surrogate for mutation clonality and can act as a tool to evaluate the genomic heterogeneity of tumors (Boscolo Bielo et al., 2023), which is why lately, an extensive amount of research has focused on using VAF in ctDNA analyses in several types of tumors. This metric is valuable because it can provide insights into the tumor burden within the patient, the efficacy of treatment, and the dynamics of tumor evolution and resistance mechanisms (Hallermayr et al., 2023; Harter et al., 2024), as well as early detection of relapse or disease progression (Pairawan et al., 2020). However, the broad clinical application of VAF measurement in liquid biopsy is contingent upon further validation and research since the accuracy of VAF quantification is highly dependent on the NGS technologies employed (Janku et al., 2017; Manca et al., 2022; Menon and Brash, 2023), and lack of biological threshold definition (Boscolo Bielo et al., 2023), which may vary according to each type of tumor.
As research progresses and more clinical trials incorporate VAF and other NGS-derived metrics, the role of liquid biopsy in cancer care is expected to expand further, offering more personalized, dynamic, and effective treatment strategies for patients.
Pitfalls
Tissue sample quality and integrity
The pathway to obtain high-quality, reliable NGS data is full of challenges, notably from the pre-analytical phase until the NGS sequencing itself. The pre-analytical phase is critical as it encompasses all steps from the initial sample collection to the preparation of nucleic acids for sequencing extracted from formalin-fixed paraffin-embedded (FFPE) (Gu et al., 2023; Astier et al., 2024; Hatanaka et al., 2024).
The chosen tissue blocks must represent a substantial portion of the tumor, ensuring that at least 20% of the material is viable for biomolecular analyses (Gaspersic and Videtic Paska, 2020). The integrity of the sample before sequencing is critical. From the moment of collection, factors such as time to fixation, the duration of fixation, and the conditions under which the sample is stored can significantly affect the nucleic acids of the tumor tissue (Gu et al., 2023). For FFPE samples, the formalin fixation process can induce cross-linking between nucleic acids and proteins, leading to fragmentation and other modifications that challenge the extraction and subsequent analysis processes (Bhagwate et al., 2019), potentially compromising the quality of PCR amplification reactions (Gaspersic and Videtic Paska, 2020).
For instance, the nucleic acid fragmentation and hydrolytic deamination of cytosine can lead to deoxyuridine (dU) and T mismatches, and, eventually, artificial C>T substitutions (Haile et al., 2019; Parker et al., 2019). These artifacts, exacerbated by suboptimal fixation and extraction processes, pose challenges for accurately identifying subclonal driver mutations and other clinically relevant variants. Experimental strategies, such as using uracil-DNA glycosylase and high-fidelity polymerase, and bioinformatic approaches like the Genome Analysis ToolKit (GATK) FFPE filter, offer partial solutions (Bewicke-Copley et al., 2019). Recently Heo et al. (Heo et al., 2024) developed DEEPOMICS FFPE, a deep neural network-based tool trained on paired FF and FFPE sequencing data to distinguish true variants from FFPE-induced artifacts, demonstrating superior performance in preserving true variants while eliminating artifacts.
The DNA Integrity Number (DIN) (Hiramatsu et al., 2023) is an essential metric for assessing the quality of DNA, particularly for NGS applications. It quantitatively evaluates the degree of degradation in a DNA sample. The Agilent TapeStation system (Hiramatsu et al., 2023) provides a standardized method to measure DIN, offering a straightforward way to gauge whether a sample’s DNA integrity meets the requirements for successful NGS. A high DIN value indicates minimal degradation, suggesting that the DNA is likely to perform well in sequencing applications, whereas a lower DIN signals significant degradation, which could compromise the sequencing results.
RNA sequencing (RNA-seq) provides critical insights into gene expression and regulation, though its’ instability presents significant handling challenges (Wang et al., 2019). RNA-seq can identify differentially expressed genes, novel transcripts, and gene fusions. However, RNA is less stable than DNA and more prone to degradation by RNases, making its extraction and storage more challenging. RNA from FFPE samples is particularly difficult to work with due to cross-linking and fragmentation (Byron et al., 2016), especially in older blocks (which may be too poor for clinical testing) (Next-Generation Sequencing, 2024). Other disadvantages of this method include the turnaround time of approximately 1–3 weeks (complexity and labor intensity of testing has limited the widespread inclusion in (Next-Generation Sequencing, 2024)laboratories), the occurrence of bias and imperfections with short-read length RNA-seq technologies generated in sequencing library preparation and short read assembly, and the containing missing values by the read counts of gene expressions, thus resulting in information loss of specific gene and negative impact on downstream analysis (Hong et al., 2020).
Following DNA/RNA extraction and quality assessment, the next critical step in the NGS workflow is library preparation (Fujii et al., 2020; Szadkowska et al., 2022; Michalska-Falkowska et al., 2023). This process involves fragmenting the nucleic acids, repairing the ends, adding adapters, and sometimes incorporating specific indexes for multiplexing samples (Fujii et al., 2020). The quality and integrity of the input material directly influence the efficiency of these steps and the overall complexity and quality of the final library. Libraries from high-integrity samples will more accurately reflect the genome or transcriptome of interest and are more likely to yield robust, comprehensive sequencing data (Szadkowska et al., 2022).
As for liquid biopsies, including those involving ctDNA from blood and non-blood sources, they are vulnerable to the effects of varying anatomical disease distribution on ctDNA concentrations (Tivey et al., 2022). Some disadvantages of the method include low ctDNA to cfDNA ratio owing to the predominance of clonal hematopoiesis, the fact that only certain cell subtypes might release ctDNA into the circulation/low tumor burden, the poor representation of CNS disease, and the poor representation of some tumors (such as early stage non-small-cell lung cancers and sarcomas) (Nikanjam et al., 2022; Tivey et al., 2022). Also, not all detectable cfDNA alterations are cancer-related (Nikanjam et al., 2022). For instance, clonal hematopoiesis is common in patients with cancer and especially in those of advancing age or who previously received radiotherapy (Nikanjam et al., 2022; Tivey et al., 2022), and this feature can confound genomic analysis, especially the specificity of plasma ctDNA (Tivey et al., 2022). Moreover, the half-life of ctDNA is relatively short (approximately 2 h), indicating a need for rapid processing, and without proper preservation and stabilization tubes, the sensitivity of the method may be compromised (Tivey et al., 2022).
Cost and accessibility, especially in low and middle-income countries
NGS has seen a remarkable reduction in costs over the years, making it more accessible to researchers and clinicians worldwide (Table 4). In the early 2000 s, the cost of sequencing a human genome was approximately $100 million. However, due to technological advancements and economies of scale, the cost has plummeted to less than $1,000 as of 2022 (The cost of sequencing a human genome, 2021). This dramatic reduction in cost has democratized genomic sequencing, enabling its widespread use in research and clinical settings.
Despite these advancements, the cost of NGS testing in low and middle-income countries (LMICs) can still be prohibitive, especially for patients whose costs are out-of-pocket. A study by Schluckebier et al. (Schluckebier et al., 2020) found that the cost of NGS testing in Brazil was significantly higher than other diagnostic modalities in a cohort of advanced lung cancer. The study reported that the average incremental cost of NGS testing was approximately $3,500, which was unaffordable for many patients considering that the average income is about $1,738/monthly (Schluckebier et al., 2020).
Moreover, the continuous advancements in NGS technology and gene coverage add layers of complexity to assessing its’ true cost-effectiveness. These evolutions not only enhance the diagnostic capabilities but also increases the added value, thereby making it difficult to establish a reliable reference cost to be assessed over time. Furthermore, NGS decreasing costs may not be enough to improve access to Precision Oncology, it is important to consider the financial unaffordability of targeted agents (Rivera-Concepcion et al., 2022). A 2012 study assessing NSCLC patients, found an incremental cost of targeted therapy compared to chemotherapy of about $30,000 per QALY (Handorf et al., 2012).
Taken in conjunction, these challenges hamper incorporation of Precision Oncology into healthcare systems (O'Rourke et al., 2020). To address these challenges, efforts are underway to improve access to NGS testing in LMICs. For example, the Global Alliance for Genomics and Health (GA4GH) is working to develop guidelines and standards for genomic data sharing and analysis, with a focus on LMICs (Rehm et al., 2021). Additionally, initiatives such as the Human Heredity and Health in Africa (H3Africa) aim to build genomic research capacity in Africa and improve access to genomic testing (Mulder et al., 2018).
Next-generation sequencing and health technology assessment
Health technology assessment (HTA) involves the systematic evaluation of the properties and impacts of health technologies and interventions, including their direct and indirect effects on health outcomes, their costs, and resource utilization (O'Rourke et al., 2020). Moreover, HTA plays a crucial role in incorporation decision-making on a national level (O'Rourke et al., 2020).
While there is no standardized pharmacoeconomic tool for personalized medicine in oncology, the number of studies assessing the cost-effectiveness of NGS analyses has notably increased. Between 2005 and 2007, only three studies were conducted, but from 2014 to 2016, this number rose to 26 (Weymann et al., 2018). Curiously, most studies (76%) utilized the traditional Markov model methodology to evaluate the cost-effectiveness of NGS (Weymann et al., 2018). Furthermore, a significant portion (67%) explored the use of NGS as a risk stratification or prognostic predictor, particularly in breast cancer (44%), employing a health technology assessment modeling typically applied in therapeutic intervention evaluations (Weymann et al., 2018). In terms of NGS-driven targeted therapy, only two studies tackled this subject, both of which surpassed the cost-effectiveness threshold (Djalalov et al., 2014; Doble et al., 2017).
A Brazilian study compared the cost-effectiveness of NGS to sequential single gene testing and discovered that while the molecular diagnosis of patients with advanced NSCLC led to a higher number of true positive genomic alterations, the technology’s cost-effectiveness ratio exceeded the threshold for the Brazilian supplementary healthcare system perspective (Schluckebier et al., 2020). It is important to note that this study not only factored in genomic testing costs but also drug acquisition expenses over a lifetime horizon. Additionally, the authors relied on clinical trial data to estimate treatment duration and the outcomes of each therapeutic agent.
Another limitation of Precision Oncology HTA is the fact that the evidence supporting direct targetable therapies, particularly for rare mutations, is derived from studies with unconventional non-randomized designs, making it challenging to conduct cost-effectiveness analyses on these technologies (Faulkner et al., 2012).
The lack of frameworks for funding and reimbursement related to NGS also led to wide variation in the way it has been incorporated into national healthcare systems. National investment plans or dictation by law guide NGS integration in some countries, while others have a complete lack of plans, policies and governance dedicated to the promotion of NGS (Horgan et al., 2023). This underscores the presence of global disparities surrounding this topic. Efforts are underway to create an HTA framework that aims to facilitate NGS decision-making (Horgan et al., 2023). It is crucial to appreciate regional challenges to have a better understanding of possibilities surrounding NGS expansion and to create opportunities for that end, involving the various stakeholders in the process. In that context, new frameworks will be of great importance.
Future directions
Next-generation sequencing and fragmentomics
Fragmentomics is an emerging field of study focused on analyzing fragments of DNA, RNA, and other molecules shed by cells into bodily fluids like blood (Medina et al., 2023). This approach is gaining traction in oncology due to its’ potential to provide insights into the molecular characteristics of diseases, including cancer, without the need for invasive biopsies (Mathios et al., 2021; Leal et al., 2023).
The development of technologies and computational tools like Fragle, which quantifies ctDNA levels based on cfDNA fragment length distribution, exemplifies the advancements in fragmentomics. These technologies enable the detection and quantification of ctDNA with high sensitivity and specificity, facilitating early cancer detection, the monitoring of disease progression, and the assessment of treatment response. As fragmentomics continues to evolve, it promises to revolutionize personalized medicine by offering more detailed, dynamic, and non-invasive insights into several diseases, thereby improving patients’ outcomes through tailored therapeutic approaches (Zhu G. et al., 2023).
Next-generation sequencing and new platforms
The landscape of NGS for cancer research and care is rapidly evolving, with new platforms and approaches emerging to address the complexities of tumor genetics and improve patient outcomes. These innovations are not only enhancing the accuracy and efficiency of genomic sequencing but are also paving the way for more personalized and dynamic cancer treatments. Table 5 exemplifies some of the cutting-edge platforms and approaches in NGS for cancer.
Improving access to precision medicine in oncology
NGS became increasingly integrated into clinical practice, and it is crucial to assess its cost-effectiveness accurately. Traditional cost-effectiveness analyses often rely on clinical trial data, which may not fully capture the real-world effectiveness and cost implications of NGS testing (Klonoff, 2020). Based on that, future studies should incorporate real-world evidence (RWE) to provide a more comprehensive understanding of the value of NGS and Precision Oncology. By leveraging RWE, researchers can evaluate the long-term effectiveness, safety, and cost-effectiveness of NGS testing in real-world settings. This approach allows for a more accurate assessment of the value of NGS and can inform decision-making regarding its adoption and reimbursement.
Final comments
NGS testing has improved precision medicine and Oncology care. Although major improvements in technology, applicability and costs have been already addressed, NGS still may relays as an idealistic medical tool instead of a broader realistic instrument for cancer management.
Author contributions
MZ: Writing–original draft, Writing–review and editing. GV: Writing–original draft, Writing–review and editing. PA: Writing–original draft, Writing–review and editing. NG: Writing–original draft, Writing–review and editing. MR: Writing–original draft, Writing–review and editing. SM: Writing–original draft, Writing–review and editing. CF: Conceptualization, Supervision, Validation, Writing–original draft, Writing–review and editing.
Funding
The author(s) declare that no financial support was received for the research, authorship, and/or publication of this article.
Conflict of interest
Authors MZ, GV, PA, NG, MR, and CF were employed by Oncoclínicas&Co/MedSir.
The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
GV and CF declared that they were an editorial board member of Frontiers, at the time of submission. This had no impact on the peer review process and the final decision.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
Aldea, M., Friboulet, L., Apcher, S., Jaulin, F., Mosele, F., Sourisseau, T., et al. (2023). Precision medicine in the era of multi-omics: can the data tsunami guide rational treatment decision? ESMO Open 8 (5), 101642. doi:10.1016/j.esmoop.2023.101642
Astier, C., Ngo, C., Colmet-Daage, L., Marty, V., Bawa, O., Nicotra, C., et al. (2024). Molecular profiling of biliary tract cancers reveals distinct genomic landscapes between circulating and tissue tumor DNA. Exp. Hematol. Oncol. 13 (1), 2. doi:10.1186/s40164-023-00470-7
Bachet, J. B., Laurent-Puig, P., Meurisse, A., Bouché, O., Mas, L., Taly, V., et al. (2023). Circulating tumour DNA at baseline for individualised prognostication in patients with chemotherapy-naive metastatic colorectal cancer. An AGEO prospective study. Eur. J. Cancer 189, 112934. doi:10.1016/j.ejca.2023.05.022
Bettegowda, C., Sausen, M., Leary, R. J., Kinde, I., Wang, Y., Agrawal, N., et al. (2014). Detection of circulating tumor DNA in early- and late-stage human malignancies. Sci. Transl. Med. 6 (224), 224ra24. doi:10.1126/scitranslmed.3007094
Bewicke-Copley, F., Arjun Kumar, E., Palladino, G., Korfi, K., and Wang, J. (2019). Applications and analysis of targeted genomic sequencing in cancer studies. Comput. Struct. Biotechnol. J. 17, 1348–1359. doi:10.1016/j.csbj.2019.10.004
Bhagwate, A. V., Liu, Y., Winham, S. J., McDonough, S. J., Stallings-Mann, M. L., Heinzen, E. P., et al. (2019). Bioinformatics and DNA-extraction strategies to reliably detect genetic variants from FFPE breast tissue samples. BMC Genomics 20 (1), 689. doi:10.1186/s12864-019-6056-8
Boscolo Bielo, L., Trapani, D., Repetto, M., Crimini, E., Valenza, C., Belli, C., et al. (2023). Variant allele frequency: a decision-making tool in precision oncology? Trends Cancer 9 (12), 1058–1068. doi:10.1016/j.trecan.2023.08.011
Byron, S. A., Van Keuren-Jensen, K. R., Engelthaler, D. M., Carpten, J. D., and Craig, D. W. (2016). Translating RNA sequencing into clinical diagnostics: opportunities and challenges. Nat. Rev. Genet. 17 (5), 257–271. doi:10.1038/nrg.2016.10
Chan, K. K. W., Cheung, M. C., Regier, D. A., Hay, A., Louie, A. V., Cheung, W. Y., et al. (2021). The past, present, and future of economic evaluations of precision medicine at the committee for economic analyses of the Canadian cancer trials group. Curr. Oncol. 28 (5), 3649–3658. doi:10.3390/curroncol28050311
Chen, M., and Zhao, H. (2019). Next-generation sequencing in liquid biopsy: cancer screening and early detection. Hum. Genomics 13 (1), 34. doi:10.1186/s40246-019-0220-8
Dedeilia, A., Lwin, T., Li, S., Tarantino, G., Tunsiricharoengul, S., Lawless, A., et al. (2024). Factors affecting recurrence and survival for patients with high-risk stage II melanoma. Ann. Surg. Oncol. 31 (4), 2713–2726. doi:10.1245/s10434-023-14724-5
Del Re, M., Luculli, G. I., Petrini, I., Sbrana, A., Scotti, V., Perez, D. d. M., et al. (2024). Clinical utility of Next Generation Sequencing of plasma cell-free DNA for the molecular profiling of patients with NSCLC at diagnosis and disease progression. Transl. Oncol. 41, 101869. doi:10.1016/j.tranon.2023.101869
de Oliveira Cavagna, R., de Andrade, E. S., Tadin Reis, M., de Paula, F. E., Noriz Berardinelli, G., Bonatelli, M., et al. (2023). Detection of NTRK fusions by RNA-based nCounter is a feasible diagnostic methodology in a real-world scenario for non-small cell lung cancer assessment. Sci. Rep. 13 (1), 21168. doi:10.1038/s41598-023-48613-4
Diks, J., Tang, Z., Altan, M., Anderson, S., Chen, H., Rashid, A., et al. (2024). Detection of clinically actionable gene fusions by next-generation sequencing-based RNA sequencing of non-small cell lung cancer cytology specimens: a single-center experience with comparison to fluorescence in situ hybridization. Cancer Cytopathol. 132 (1), 41–49. doi:10.1002/cncy.22766
Djalalov, S., Beca, J., Hoch, J. S., Krahn, M., Tsao, M. S., Cutz, J. C., et al. (2014). Cost effectiveness of EML4-ALK fusion testing and first-line crizotinib treatment for patients with advanced ALK-positive non-small-cell lung cancer. J. Clin. Oncol. 32 (10), 1012–1019. doi:10.1200/JCO.2013.53.1186
Doble, B., John, T., Thomas, D., Fellowes, A., Fox, S., and Lorgelly, P. (2017). Cost-effectiveness of precision medicine in the fourth-line treatment of metastatic lung adenocarcinoma: an early decision analytic model of multiplex targeted sequencing. Lung Cancer 107, 22–35. doi:10.1016/j.lungcan.2016.05.024
Faulkner, E., Annemans, L., Garrison, L., Helfand, M., Holtorf, A. P., Hornberger, J., et al. (2012). Challenges in the development and reimbursement of personalized medicine-payer and manufacturer perspectives and implications for health economics and outcomes research: a report of the ISPOR personalized medicine special interest group. Value Health 15 (8), 1162–1171. doi:10.1016/j.jval.2012.05.006
Ferreira, C. G., Reis, M. X., and Veloso, G. G. V. (2023). Editorial: molecular genetic testing and emerging targeted therapies for non-small cell lung cancer. Front. Oncol. 13, 1308525. doi:10.3389/fonc.2023.1308525
Fujii, T., Uchiyama, T., Matsuoka, M., Myojin, T., Sugimoto, S., Nitta, Y., et al. (2020). Evaluation of DNA and RNA quality from archival formalin-fixed paraffin-embedded tissue for next-generation sequencing - retrospective study in Japanese single institution. Pathol. Int. 70 (9), 602–611. doi:10.1111/pin.12969
Galant, N., Nicoś, M., Kuźnar-Kamińska, B., and Krawczyk, P. (2024). Variant allele frequency analysis of circulating tumor DNA as a promising tool in assessing the effectiveness of treatment in non-small cell lung carcinoma patients. Cancers (Basel) 16 (4), 782. doi:10.3390/cancers16040782
Gaspersic, J., and Videtic Paska, A. (2020). Potential of modern circulating cell-free DNA diagnostic tools for detection of specific tumour cells in clinical practice. Biochem. Med. Zagreb. 30 (3), 030504. doi:10.11613/BM.2020.030504
Glowienka-Stodolak, M., Bagińska-Drabiuk, K., Szubert, S., Hennig, E. E., Horala, A., Dąbrowska, M., et al. (2024). Human papillomavirus infections and the role played by cervical and cervico-vaginal microbiota-evidence from next-generation sequencing studies. Cancers (Basel) 16 (2), 399. doi:10.3390/cancers16020399
Glyn, T., Williams, S., Whitehead, M., Eglinton, T., West, N., and Purcell, R. V. (2024). Digital spatial profiling identifies molecular changes involved in development of colitis-associated colorectal cancer. Front. Oncol. 14, 1247106. doi:10.3389/fonc.2024.1247106
Gu, W., Zhuang, W., Zhuang, M., and Li, Z. (2023). DNA damage response and repair gene mutations are associated with tumor mutational burden and outcomes to platinum-based chemotherapy/immunotherapy in advanced NSCLC patients. Diagn Pathol. 18 (1), 119. doi:10.1186/s13000-023-01401-0
Haile, S., Corbett, R. D., Bilobram, S., Bye, M. H., Kirk, H., Pandoh, P., et al. (2019). Sources of erroneous sequences and artifact chimeric reads in next generation sequencing of genomic DNA from formalin-fixed paraffin-embedded samples. Nucleic Acids Res. 47 (2), e12. doi:10.1093/nar/gky1142
Hallermayr, A., Keßler, T., Fujera, M., Liesfeld, B., Bernstein, S., von Ameln, S., et al. (2023). Impact of cfDNA reference materials on clinical performance of liquid biopsy NGS assays. Cancers (Basel) 15 (20), 5024. doi:10.3390/cancers15205024
Handorf, E. A., McElligott, S., Vachani, A., Langer, C. J., Bristol Demeter, M., Armstrong, K., et al. (2012). Cost effectiveness of personalized therapy for first-line treatment of stage IV and recurrent incurable adenocarcinoma of the lung. J. Oncol. Pract. 8 (5), 267–274. doi:10.1200/JOP.2011.000502
Harter, J., Buth, E., Johaenning, J., Battke, F., Kopp, M., Zelba, H., et al. (2024). Analytical performance evaluation of a 523-gene circulating tumor DNA assay for next-generation sequencing-based comprehensive tumor profiling in liquid biopsy samples. J. Mol. Diagn 26 (1), 61–72. doi:10.1016/j.jmoldx.2023.10.001
Hatanaka, K. C., Nakamura, K., Katoh, R., Ito, K., Hirokawa, M., Miyauchi, A., et al. (2024). Impact of the quality of resected thyroid cancer tissue sample on next-generation sequencing testing. Pathol. Int. 74 (2), 77–86. doi:10.1111/pin.13399
Heo, D. H., Kim, I., Seo, H., Kim, S. G., Kim, M., Park, J., et al. (2024). DEEPOMICS FFPE, a deep neural network model, identifies DNA sequencing artifacts from formalin fixed paraffin embedded tissue with high accuracy. Sci. Rep. 14 (1), 2559. doi:10.1038/s41598-024-53167-0
Herreros-Villanueva, M., Bujanda, L., Ruiz-Rebollo, L., Torremocha, R., Ramos, R., Martín, R., et al. (2022). Circulating tumor DNA tracking in patients with pancreatic cancer using next-generation sequencing. Gastroenterol. Hepatol. 45 (8), 637–644.
Hiramatsu, K., Matsuda, C., Masago, K., Toriyama, K., Sasaki, E., Fujita, Y., et al. (2023). Diagnostic utility of DNA integrity number as an indicator of sufficient DNA quality in next-generation sequencing-based genomic profiling. Am. J. Clin. Pathol. 160 (3), 261–267. doi:10.1093/ajcp/aqad046
Hong, M., Tao, S., Zhang, L., Diao, L. T., Huang, X., Huang, S., et al. (2020). RNA sequencing: new technologies and applications in cancer research. J. Hematol. Oncol. 13 (1), 166. doi:10.1186/s13045-020-01005-x
Horgan, D., Hamdi, Y., Lal, J. A., Nyawira, T., Meyer, S., Kondji, D., et al. (2023). Framework for adoption of next-generation sequencing (NGS) globally in the oncology area. Healthc. (Basel) 11 (3), 431. doi:10.3390/healthcare11030431
Horgan, D., Van den Bulcke, M., Malapelle, U., Troncone, G., Normanno, N., Capoluongo, E. D., et al. (2024). Tackling the implementation gap for the uptake of NGS and advanced molecular diagnostics into healthcare systems. Heliyon 10 (1), e23914. doi:10.1016/j.heliyon.2023.e23914
Ishida, C., Zubair, M., and Gupta, V. (2024). Molecular genetics testing, in StatPearls. Treasure Isl. (FL).
Janku, F., Zhang, S., Waters, J., Liu, L., Huang, H. J., Subbiah, V., et al. (2017). Development and validation of an ultradeep next-generation sequencing assay for testing of plasma cell-free DNA from patients with advanced cancer. Clin. Cancer Res. 23 (18), 5648–5656. doi:10.1158/1078-0432.CCR-17-0291
Kage, H., Akiyama, N., Chang, H., Shinozaki-Ushiku, A., Ka, M., Kawata, J., et al. (2024). Patient survey on cancer genomic medicine in Japan under the national health insurance system. Cancer Sci. 115 (3), 954–962. doi:10.1111/cas.16065
Kang, D. W., Park, S. K., Yu, Y. L., Lee, Y., Lee, D. H., and Kang, S. (2024). Effectiveness of next-generation sequencing for patients with advanced non-small-cell lung cancer: a population-based registry study. ESMO Open 9 (1), 102200. doi:10.1016/j.esmoop.2023.102200
King, A. D., Deirawan, H., Klein, P. A., Dasgeb, B., Dumur, C. I., and Mehregan, D. R. (2023). Next-generation sequencing in dermatology. Front. Med. (Lausanne) 10, 1218404. doi:10.3389/fmed.2023.1218404
Klonoff, D. C. (2020). The new FDA real-world evidence program to support development of drugs and biologics. J. Diabetes Sci. Technol. 14 (2), 345–349. doi:10.1177/1932296819832661
Kou, T., Kanai, M., Yamamoto, Y., Kamada, M., Nakatsui, M., Sakuma, T., et al. (2017). Clinical sequencing using a next-generation sequencing-based multiplex gene assay in patients with advanced solid tumors. Cancer Sci. 108 (7), 1440–1446. doi:10.1111/cas.13265
Kulda, V., Polivka, J., Svaton, M., Vanecek, T., Buresova, M., Houfkova, K., et al. (2023). Next generation sequencing analysis and its benefit for targeted therapy of lung adenocarcinoma. Cancer Genomics Proteomics 20 (4), 404–411. doi:10.21873/cgp.20392
Leal, A. I. C., Mathios, D., Jakubowski, D., Johansen, J. S., Lau, A., Wu, T., et al. (2023). Cell-free DNA fragmentomes in the diagnostic evaluation of patients with symptoms suggestive of lung cancer. Chest 164 (4), 1019–1027. doi:10.1016/j.chest.2023.04.033
Lin, C., Lee, H. J., Lin, Y. P., Tsai, L. P., Hsu, C. S., Biopsy, L., et al. (2021). Liquid Biopsy, ctDNA Diagnosis through NGS. Life (Basel) 11 (9).
Malekshoar, M., Azimi, S. A., Kaki, A., Mousazadeh, L., Motaei, J., and Vatankhah, M. (2023). CRISPR-Cas9 targeted enrichment and next-generation sequencing for mutation detection. J. Mol. Diagn 25 (5), 249–262. doi:10.1016/j.jmoldx.2023.01.010
Manca, P., Corallo, S., Lonardi, S., Fucà, G., Busico, A., Leone, A. G., et al. (2022). Variant allele frequency in baseline circulating tumour DNA to measure tumour burden and to stratify outcomes in patients with RAS wild-type metastatic colorectal cancer: a translational objective of the Valentino study. Br. J. Cancer 126 (3), 449–455. doi:10.1038/s41416-021-01591-8
Mateo, J., Steuten, L., Aftimos, P., André, F., Davies, M., Garralda, E., et al. (2022). Delivering precision oncology to patients with cancer. Nat. Med. 28 (4), 658–665. doi:10.1038/s41591-022-01717-2
Mathios, D., Johansen, J. S., Cristiano, S., Medina, J. E., Phallen, J., Larsen, K. R., et al. (2021). Detection and characterization of lung cancer using cell-free DNA fragmentomes. Nat. Commun. 12 (1), 5060. doi:10.1038/s41467-021-24994-w
Medina, J. E., Dracopoli, N. C., Bach, P. B., Lau, A., Scharpf, R. B., Meijer, G. A., et al. (2023). Cell-free DNA approaches for cancer early detection and interception. J. Immunother. Cancer 11 (9), e006013. doi:10.1136/jitc-2022-006013
Menon, V., and Brash, D. E. (2023). Next-generation sequencing methodologies to detect low-frequency mutations: "Catch me if you can. Mutat. Res. Rev. Mutat. Res. 792, 108471. doi:10.1016/j.mrrev.2023.108471
Michalska-Falkowska, A., Niklinski, J., Juhl, H., Sulewska, A., Kisluk, J., Charkiewicz, R., et al. (2023). Applied molecular-based quality control of biobanked samples for multi-omics approach. Cancers (Basel) 15 (14), 3742. doi:10.3390/cancers15143742
Mulder, N., Abimiku, A., Adebamowo, S. N., de Vries, J., Matimba, A., Olowoyo, P., et al. (2018). H3Africa: current perspectives. Pharmgenomics Pers. Med. 11, 59–66. doi:10.2147/PGPM.S141546
Nakagawa, H., and Fujita, M. (2018). Whole genome sequencing analysis for cancer genomics and precision medicine. Cancer Sci. 109 (3), 513–522. doi:10.1111/cas.13505
Next-generation sequencing (NGS) (2024). Next-generation sequencing (NGS). Available at: https://oncologypro.esmo.org/oncology-in-practice/anti-cancer-agents-and-biological-therapy/targeting-ntrk-gene-fusions/importance-of-testing-cancers-for-ntrk-gene-fusions/general-challenges-of-testing-for-cancers-with-ntrk-gene-fusion/next-generation-sequencing-ngs/rna-based-ngs/disadvantages.
Nikanjam, M., Kato, S., and Kurzrock, R. (2022). Liquid biopsy: current technology and clinical applications. J. Hematol. Oncol. 15 (1), 131. doi:10.1186/s13045-022-01351-y
O’Rourke, B., Oortwijn, W., and Schuller, T.International Joint Task Group (2020). The new definition of health technology assessment: a milestone in international collaboration. Int. J. Technol. Assess. Health Care 36 (3), 187–190. doi:10.1017/S0266462320000215
Pairawan, S., Hess, K. R., Janku, F., Sanchez, N. S., Mills Shaw, K. R., Eng, C., et al. (2020). Cell-free circulating tumor DNA variant allele frequency associates with survival in metastatic cancer. Clin. Cancer Res. 26 (8), 1924–1931. doi:10.1158/1078-0432.CCR-19-0306
Pankiw, M., Brezden-Masley, C., and Charames, G. S. (2023). Comprehensive genomic profiling for oncological advancements by precision medicine. Med. Oncol. 41 (1), 1. doi:10.1007/s12032-023-02228-x
Parker, J. D. K., Yap, S. Q., Starks, E., Slind, J., Swanson, L., Docking, T. R., et al. (2019). Fixation effects on variant calling in a clinical resequencing panel. J. Mol. Diagn 21 (4), 705–717. doi:10.1016/j.jmoldx.2019.03.005
Perez-Perez, M., Agostino, A., de Sola-Llamas, C. G., Ruvolo, M., Vilches-Arenas, A., Relimpio-López, M. I., et al. (2023). Next-generation sequencing of uveal melanoma with clinical and histological correlations: prognostic value of new mutations in the PI3K/AKT/mTOR pathway. Clin. Exp. Ophthalmol. 51 (8), 822–834. doi:10.1111/ceo.14302
Pesta, M., Shetti, D., Kulda, V., Knizkova, T., Houfkova, K., Bagheri, M. S., et al. (2022). Applications of liquid biopsies in non-small-cell lung cancer. Diagn. (Basel) 12 (8).
Qin, D. (2019). Next-generation sequencing and its clinical application. Cancer Biol. Med. 16 (1), 4–10. doi:10.20892/j.issn.2095-3941.2018.0055
Quintanilha, J. C. F., Graf, R. P., Fisher, V. A., Oxnard, G. R., Ellis, H., Panarelli, N., et al. (2023). Comparative effectiveness of immune checkpoint inhibitors vs chemotherapy in patients with metastatic colorectal cancer with measures of microsatellite instability, mismatch repair, or tumor mutational burden. JAMA Netw. Open 6 (1), e2252244. doi:10.1001/jamanetworkopen.2022.52244
Rehm, H. L., Page, A. J. H., Smith, L., Adams, J. B., Alterovitz, G., Babb, L. J., et al. (2021). GA4GH: international policies and standards for data sharing across genomic research and healthcare. Cell Genom 1 (2), 100029. doi:10.1016/j.xgen.2021.100029
Rivera-Concepcion, J., Uprety, D., and Adjei, A. A. (2022). Challenges in the use of targeted therapies in non-small cell lung cancer. Cancer Res. Treat. 54 (2), 315–329. doi:10.4143/crt.2022.078
Rotow, J. K., Lee, J. K., Madison, R. W., Oxnard, G. R., Jänne, P. A., and Schrock, A. B. (2024). Real-world genomic profile of EGFR second-site mutations and other osimertinib resistance mechanisms and clinical landscape of NSCLC post-osimertinib. J. Thorac. Oncol. 19 (2), 227–239. doi:10.1016/j.jtho.2023.09.1453
Salvo, M., González-Feliú, E., Toro, J., Gallegos, I., Maureira, I., Miranda-González, N., et al. (2021). Validation of an NGS panel designed for detection of actionable mutations in tumors common in Latin America. J. Pers. Med. 11 (9), 899. doi:10.3390/jpm11090899
Satam, H., Joshi, K., Mangrolia, U., Waghoo, S., Zaidi, G., Rawool, S., et al. (2023). Next-generation sequencing technology: current trends and advancements. Biol. (Basel) 12 (7), 997. doi:10.3390/biology12070997
Schluckebier, L., Caetano, R., Garay, O. U., Montenegro, G. T., Custodio, M., Aran, V., et al. (2020). Cost-effectiveness analysis comparing companion diagnostic tests for EGFR, ALK, and ROS1 versus next-generation sequencing (NGS) in advanced adenocarcinoma lung cancer patients. BMC Cancer 20 (1), 875. doi:10.1186/s12885-020-07240-2
Slowinski, P., Li, M., Restrepo, P., Alomran, N., Spurr, L. F., Miller, C., et al. (2020). GeTallele: a method for analysis of DNA and RNA allele frequency distributions. Front. Bioeng. Biotechnol. 8, 1021. doi:10.3389/fbioe.2020.01021
Su, D. G., Schoenfeld, D. A., Ibrahim, W., Cabrejo, R., Djureinovic, D., Baumann, R., et al. (2024). Digital spatial proteomic profiling reveals immune checkpoints as biomarkers in lymphoid aggregates and tumor microenvironment of desmoplastic melanoma. J. Immunother. Cancer 12 (3), e008646. doi:10.1136/jitc-2023-008646
Szadkowska, P., Roura, A. J., Wojtas, B., Wojnicki, K., Licholai, S., Waller, T., et al. (2022). Improvements in quality control and library preparation for targeted sequencing allowed detection of potentially pathogenic alterations in circulating cell-free DNA derived from plasma of brain tumor patients. Cancers (Basel) 14 (16), 3902. doi:10.3390/cancers14163902
Thirunavukkarasu, M. K., Veerappapillai, S., and Karuppasamy, R. (2024). Sequential virtual screening collaborated with machine-learning strategies for the discovery of precise medicine against non-small cell lung cancer. J. Biomol. Struct. Dyn. 42 (2), 615–628. doi:10.1080/07391102.2023.2194994
The cost of sequencing a human genome (2021). The cost of sequencing a human genome. Available at: https://www.genome.gov/about-genomics/fact-sheets/Sequencing-Human-Genome-cost.
Tivey, A., Church, M., Rothwell, D., Dive, C., and Cook, N. (2022). Circulating tumour DNA - looking beyond the blood. Nat. Rev. Clin. Oncol. 19 (9), 600–612. doi:10.1038/s41571-022-00660-y
Tjota, M. Y., Segal, J. P., and Wang, P. (2024). Clinical utility and benefits of comprehensive genomic profiling in cancer. J. Appl. Lab. Med. 9 (1), 76–91. doi:10.1093/jalm/jfad091
Volpe, S., Zaffaroni, M., Piperno, G., Vincini, M. G., Zerella, M. A., Mastroleo, F., et al. (2023). Multi-omics integrative modelling for stereotactic body radiotherapy in early-stage non-small cell lung cancer: clinical trial protocol of the MONDRIAN study. BMC Cancer 23 (1), 1236. doi:10.1186/s12885-023-11701-9
Wang, H., Sun, L., Sang, Y., Yang, X., Tian, G., Wang, Z., et al. (2019). A study of ALK-positive pulmonary squamous-cell carcinoma: from diagnostic methodologies to clinical efficacy. Lung Cancer 130, 135–142. doi:10.1016/j.lungcan.2019.02.015
Weymann, D., Pataky, R., and Regier, D. A. (2018). Economic evaluations of next-generation precision oncology: a critical review. JCO Precis. Oncol. 2, 1–23. doi:10.1200/PO.17.00311
Xia, T., Fang, C., and Chen, Y. (2023). Advances in application of circulating tumor DNA in ovarian cancer. Funct. Integr. Genomics 23 (3), 250.
Yahya, S., Watson, C. M., Carr, I., McKibbin, M., Crinnion, L. A., Taylor, M., et al. (2023). Long-read nanopore sequencing of RPGR ORF15 is enhanced following DNase I treatment of MinION flow cells. Mol. Diagn Ther. 27 (4), 525–535. doi:10.1007/s40291-023-00656-z
Yi, H., Youk, J., Lim, Y., Roh, H., Roh, D., Kyung, D., et al. (2024). Analytical and clinical validation of a highly sensitive NGS-based ctDNA assay with real-world concordance in NSCLC. Cancer Res. Treat. doi:10.4143/crt.2023.1294
Zhu, G., Rahman, C.R., Getty, V., Baruah, P., Carrié, H., Lim, A.J, et al. (2023b). Fragle: universal ctDNA quantification using deep learning of fragmentomic profiles. bioRxiv. 2023.07.28.550922. doi:10.1101/2023.07.28.550922
Keywords: precision medicine, next-generation sequencing, cancer, medical technology, health technology assessment (HTA)
Citation: Zalis M, Viana Veloso GG, Aguiar Jr. PN, Gimenes N, Reis MX, Matsas S and Ferreira CG (2024) Next-generation sequencing impact on cancer care: applications, challenges, and future directions. Front. Genet. 15:1420190. doi: 10.3389/fgene.2024.1420190
Received: 19 April 2024; Accepted: 13 June 2024;
Published: 09 July 2024.
Edited by:
Clévia Rosset, Federal University of Rio Grande do Sul, BrazilReviewed by:
Dahmane Oukrif, University College London, United KingdomBing Melody Zhang, Stanford University, United States
Copyright © 2024 Zalis, Viana Veloso, Aguiar Jr., Gimenes, Reis, Matsas and Ferreira. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Carlos Gil Ferreira, cgmferreira@gmail.com
†These authors have contributed equally to this work