Ke Chen1,2
Aijaz Ahmad Malik3
Yun-Jian Sheng1,2Sarfraz Ahmed4Changfeng Sun1,2
Cun-Liang Deng1
Suvash Chandra Ojha1,2*- 1Department of Infectious Diseases, The Affiliated Hospital of Southwest Medical University, Luzhou, China
- 2Southwest Medical University, Luzhou, China
- 3Faculty of Medical Technology, Center of Data Mining and Biomedical Informatics, Mahidol University, Bangkok, Thailand
- 4Department of Basic Sciences, University of Veterinary and Animal Sciences Lahore, Narowal, Pakistan
Background: Treatment of bloodstream staphylococcal infections (BSI) necessitates the prompt initiation of appropriate antimicrobial agents and the rapid de-escalation of excessive broad-spectrum coverage to reduce the risk of mortality. We, therefore, aimed to demonstrate the diagnostic accuracy of nucleic acid amplification tests (NAAT) for the identification of methicillin-resistant S. aureus (MRSA) and methicillin-sensitive S. aureus (MSSA) in clinically suspected patients.
Methods: Until November 23, 2020, databases including PubMed, Scopus, Embase, and Web of Science were scanned for eligible studies. A bivariate random-effects model was used for meta-analysis of the 33 included studies obtained from 1606 citations, and pooled summary estimates with 95% confidence intervals (CI) were generated.
Results: Twenty-three studies (n = 8,547) assessed NAAT accuracy for MSSA detection, while three studies (n = 479) evaluated MRSA detection in adults. The pooled NAAT sensitivity and specificity for MRSA in adults was higher [sensitivity: 0.83 (95% CI 0.59–0.96), specificity: 0.99 (95% CI 0.98–1.0)] as compared to MSSA [sensitivity: 0.76 (95% CI 0.69–0.82), specificity: 0.98 (95% CI 0.98–0.99)]. Similarly, eight studies (n = 4,089) investigating MSSA in pediatric population reported higher NAAT accuracy [sensitivity: 0.89 (95% CI 0.76–0.96), specificity: 0.98 (95% CI 0.97–0.98)] compared to adults. Among NAA tests, SeptiFast (real-time PCR, commercial) was frequently applied, and its diagnostic accuracy corresponded well to the overall summary estimates. A meta-regression and subgroup analysis of study design, sample condition, and patient selection method could not explain the heterogeneity (P > 0.05) in the diagnostic efficiency.
Conclusions: NAAT could be applied as the preferred initial tests for timely diagnosis and BSI management.
Introduction
Bloodstream staphylococcal infection (BSI) is an urgent medical issue due to its rising incidence, associated poor outcome and the emergence of high rates of secondary infections such as osteomyelitis, septic arthritis, infective endocarditis and septic metastases (1, 2). Many surveillances worldwide recorded a rise in the incidence of BSI to varying degrees, including Thailand (27.4%) (3), France (24%) (4) and Brazil (40–70%) (5), but the majority of documented cases are in adults. Pediatric incidence statistics are minimal, but infants younger than 1 year have been reported as having a higher incidence compared to adolescents (6). Especially in developed countries, methicillin-resistant S. aureus (MRSA) has been observed in over 60% of all isolated S. aureus, and associated MRSA mortality rates have reportedly been higher than methicillin-susceptible S. aureus (MSSA) (7). The burden of BSI is utterly immense in both clinical (8) and economic terms (9), with mortality rates ranging between 20 and 70% (10, 11). Thus, rapid identification of the causative agents and detection of resistance markers in patients with BSI, such as the mecA gene, may provide clinically vital information to guide effective care on time, leading to improved patient outcomes.
Vancomycin, a glycopeptide antimicrobial agent, has frequently been included as empirical therapy for suspected BSI (12), along with the awareness that delays in initiating effective antimicrobial therapy may affect patient outcomes. Once identification and susceptibility of microorganisms are established, treatment can be optimized to target isolated bacteria, including discontinuation of vancomycin when MSSA is present. Though safe, this approach exposes the patient to wide-spectrum antibiotic overuse. Even short anti-MRSA treatment courses may alter host flora, expose to drug-induced toxicity, escalate multidrug-resistant pathogens, treatment-related side effects, and increase hospitalization costs (13). Vancomycin, the preferred antibiotic solution for MRSA infections, is also less effective than oxacillin in the treatment of MSSA infections (14). If the initial antibiotics are inadequate and changed after the diagnostic tests are available, the mortality rate does not improve significantly. Therefore, it is increasingly important to balance these two competing interests, namely the need for complete coverage while avoiding unnecessary medications.
Blood cultures currently represent the primary method for determining the etiology of the BSI (15). This traditional culture-based approach can be time-consuming, including growth-based assays, colony morphology and microdilution resistance tests. It takes about 48–72 h to classify the causative organism, even with a positive blood culture. A positive microbiological diagnosis in BSI can only be made in ~20–30% of cases with a substantially higher false-negative rate (16, 17), and requires a certain amount of sample to begin the cultivation process. Nevertheless, obtaining adequate amounts of blood from neonates for culture is often difficult (18). Furthermore, samples collected after antibiotic exposure may reduce culture-based bacterial detection. As a result, the patients will likely miss the optimal chance of treatment. Therefore, if no pathogenic bacterial agent is detected, sepsis diagnosis is based solely on clinical symptoms, often coupled with an increase in essential biomarkers such as C-reactive protein or procalcitonin (19). For these reasons, there is an obvious need for a more rapid, yet precise tool that uses a limited blood volume to detect organism and guide antibiotic choices in patients with suspected BSI.
While the pathogen culture remains the gold standard, molecular amplification tests, which typically have a shorter turnaround time, can drastically reduce the critical time to initiate preventive and therapeutic strategies, including appropriate antibacterial therapy. Unlike traditional blood culture, NAAT relies on detecting bacterial DNA rather than the recovery of viable bacteria and is less affected by antibiotic pre-administration. A previous study demonstrated a decrease in the length of anti-MRSA antibiotics in patients with BSI following a rapid diagnostic test (20). Several studies have assessed the importance of molecular techniques including PCR, real-time PCR, GeneXpert, LAMP, and FilmArray (21–25), but literature on the relevance of these tests to timely BSI management is widely scattered for any meaningful interpretation. Given the need to make clinical decisions among the pediatric and adult population, we have systematically reviewed and analyzed the available data to demonstrate NAAT diagnostic accuracy compared with microbiological culture.
Methods
Search Strategy
This systemic review was carried out in compliance with the guidelines for Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) (26). A computerized search of the relevant studies without any restrictions was performed through PubMed (available since April 01, 1991), Scopus (available since April 01, 1992), Embase (available since July 01, 1992), Web of Science (available since December 01, 1999), and a reference study of the retrieved papers published until November 23, 2020. The search included a variation of the Boolean “OR” and “AND” operators with the following medical subject headings (MeSH): “Staphylococcus aureus,” “S. aureus,” “methicillin-resistant S. aureus,” “MRSA,” “Bloodstream infection,” “Blood infection,” “Blood culture,” “Bacteremia,” “Septicemia,” “Sepsis,” “Blood poisoning,” “Nucleic acid amplification,” “NAAT,” “Molecular assay,” “Loop-mediated isothermal amplification,” “LAMP,” “Polymerase chain reaction,” “PCR,” “Ligase chain reaction,” “LCR,” “Real-time PCR,” “qPCR,” “RT-PCR,” “Amplicor,” “SeptiFast,” “ProbeTec,” “Roche,” “Gen-Probe,” “FilmArray,” “Cepheid,” Abbott,” “Sensitivity,” “Specificity,” and “Accuracy.” No effort was made to obtain data from unpublished studies.
Study Selection
The MeSH terms were used to search through electronic databases for all relevant citations, and duplicates were carefully removed using the EndNote X9 software (Thomson Reuters, New York, NY, USA). The records obtained were initially scrutinized by reviewing titles and abstracts, and subsequent analysis excluded irrelevant studies. The full-text of potentially eligible studies for accuracy data was retrieved and carefully analyzed. The data collected by two independent researchers (K. Chen and A. A. Malik) were compared, and any comparative discrepancies were resolved by mutual consensus.
Inclusion Criteria
We included full-text, peer-reviewed, cross-sectional, randomized controlled, and case-control studies using NAAT to diagnose and compare BSI with a culture reference standard. For the index test, the studies explicitly provided True positive (TP), True negative (TN), False positive (FP) and False negative (FN) values or included sufficient information to derive 2 × 2 contingency tables. All studies that met the standard BSI definition were eligible for inclusion, including fever, chills, palpitations, rapid breathing, gastrointestinal symptoms, confusion and shock.
Exclusion Criteria
Studies were considered for exclusion if they were conference proceedings, commentaries, reviews, meta-analysis, editorials, case reports, mechanism, and animal experimentation. Studies providing insufficient data for constructing a 2 × 2 contingency table and comprising <10 specimens were excluded. Non-interpretable test results by both index test and microbiological reference standard were also not included.
Data Extraction
Two independent analysts (K. Chen and A. A. Malik) scanned all the related papers with pre-specified eligibility requirements in order to ensure the reproducibility of study selection. Disagreed studies were resolved by consultation with a third investigator (S. C. Ojha). The data were collected from eligible studies including authorship, publishing year, country, settings, study type, patient selection, patient characteristics, sample type, sample size, NAAT specifics, potential risks, and information for construction of 2 × 2 contingency table. For missing details, ambiguous reference standards, and specimen preparation techniques, the authors were consulted individually. Contingency tables for NAAT performance compared to microbiological reference standards were constructed on the basis of available data from the qualifying studies. Studies involving different index tests as compared to the specific reference standard were considered separate studies.
Quality Assessment
The methodological quality of the studies was assessed using the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2), a validated diagnostic study tool (27). The four QUADAS-2 domains were: patient selection, index test, reference standard, and flow and timing. All four domains for the possible risk of bias and the first three domains for applicability concerns were evaluated by reviewing authors (K. Chen and A. A. Malik). Each domain was assessed in terms of risk of bias using signaling questions that are answered with “yes,” “no,” or “unclear” and are judged as “low,” “high,” or “unclear,” respectively. The first three domains are simultaneously evaluated in terms of applicability concerns, which are also graded as “low,” “high,” or “unclear” with identical characteristics. The differences between the reviewing authors were settled by consensus.
Statistical Analysis
The following software was used for data analysis: RevMan 5.4 (Nordic Cochrane Centre, Copenhagen, Denmark) for the methodological quality assessment of included studies and summary plots generation (28). Meta-DiSc 1.4 (Cochrane Colloquium, Barcelona, Spain) for computation of pooled summary estimates including specificity, sensitivity, likelihood ratios, diagnostic odds ratio (DOR), and heterogeneity amongst data (29). Diagnostic accuracy of NAAT in association with 95% CI was computed against microbiological culture using a random-effects model. Furthermore, the I-square (I2) statistics were used to evaluate the heterogeneity of the included studies, where I2 values ranging from 0 to 40% indicate low heterogeneity, 30–60% moderate heterogeneity, 50–90% substantial heterogeneity, and values >90% signify considerable heterogeneity (30). Using subgroup analysis, different specimen conditions, patient selection, study design, and patient type were analyzed as possible heterogeneity sources. Publication bias was inspected using Deeks' funnel plot asymmetry test (31). A P-value of <0.05 was generally considered to be statistically significant.
Results
Literature Selection
In total, our search identified 1,606 unique records (PubMed, 402; Scopus, 818; Embase, 180; Web of Science, 206) (Figure 1). Of which, due to duplication in databases, 496 citations were eliminated. Following the scanning of the titles and abstracts of 1,110 publications, 156 studies considered potentially significant were subjected to a full-text revision. Supplementary Table 1 summarizes the studies reviewed, includin why these studies were excluded (see Supplementary Table 1). Essentially, 33 studies were included in subsequent analyses that met all the inclusion criteria (21, 32–63).
Figure 1. Flow chart of study selection.
Characteristics of the Included Studies
Table 1 shows the baseline features of the studies included (21, 32–63). Twenty-six studies were performed in countries with high incomes and seven in countries with lower-middle incomes. Studies reporting the usefulness of multiple index tests against a single reference standard were treated as separate studies. Centered upon this theory, this meta-analysis included 33 publications comprising 35 datasets. Out of 23 studies, 24 datasets (n = 8,547) evaluated the accuracy of NAAT for MSSA detection, while three studies (n = 479) examined the NAAT accuracy for MRSA detection in adults. Similarly, eight studies (n = 4,089) evaluated NAAT's accuracy for the identification of BSI in children. The total number of samples submitted for diagnostic assessment ranged from 15 to 2,844, with a median value of 100. All experimental tests were carried out in tertiary care hospitals or university research facilities. Only studies published in English before November 23, 2020, were included.
Table 1. Baseline features of included studies.
Quality Appraisal
We applied the QUADAS-2 tool to evaluate the methodological quality of included studies against microbiological culture reference standard (see Figure 2). For a few studies in the patient selection domain (34, 38, 40, 48, 53, 55, 63), the risk of bias was high because the studies could not prevent improper sample exclusion. Regarding the applicability concern, all studies included blood samples from patients suspected of BSI, indicating a low risk of bias. Other domains, including the index test and the reference standard, were presumably at low risk of bias, as NAAT used pre-established binary response investigation criteria. Concerns about the index test conduct's applicability are unclear, as no proven protocol is available for global use. Reference standards of all studies have been carried out in hospitals or university-affiliated reference labs; as such, we expect operator error bias to be of low concern. Subsequently, there was no uncertainty regarding the possible risk of bias in the flow and timing domain as both the index test and the reference standards were applied to the same samples. In general, the quality of the studies included in our meta-analysis met the methodological standards.
Figure 2. Methodological quality and risk of bias assessment of the eligible studies.
Summary Estimates
The studies were rather heterogeneous, so obtaining NAAT pooled summary estimates from integrated pediatric and adult populations was not considered meaningful for antimicrobial therapy. Initially, we concentrated on diagnosing BSI in children as it is often difficult to procure sufficiently large amounts of blood from children for microbiological culture. Subsequently, the pooled summary estimates of NAAT in the adult population to diagnose BSI were assessed. The accuracy of index tests, commercial tests, and a potential source of heterogeneity among studies in predefined subgroups have also been demonstrated.
Detection of BSI Among the Pediatric Population
Eight studies (21, 32, 38, 48, 51, 55, 57, 59) met the inclusion criteria for comparing NAAT with a microbiological culture among children consisting of a total of 4,089 samples for MSSA detection in suspected BSI patients. The sensitivity and specificity of NAAT for MSSA detection ranged from 0.25 (95% CI 0.0–0.94) to 1.0 (95% CI, 0.85–1.0), whilst our search did not result in any MRSA studies (Figure 3). The pooled summary estimates of NAAT for detection of MSSA in blood were [sensitivity: 0.89 (95% CI 0.76–0.96), specificity: 0.98 (95% CI 0.97–0.98), positive likelihood ratio (PLR): 26.9 (95% CI 6.35–114.2), negative likelihood ratio (NLR): 0.25 (95% CI 0.08–0.8), DOR: 142.34 (95% CI 16.85–1,202.7)]. The I2 sensitivity and specificity statistical values were 57.0 and 95.7%, respectively, indicating substantial to considerable heterogeneity. The area under the curve (AUC) of summary receiver operating characteristics (SROC) was 0.90 (95% CI 0.74–1.0), indicating overall justifiable diagnostic validity (Figure 5A).
Figure 3. Forest plot for detection of MSSA in the pediatric population. The square stands for the sensitivity and specificity of a particular study, the black line represents its confidence interval. TP, true positive, FP, false positive, FN, false negative, TN, true negative, CI, confidence interval.
Detection of BSI Among the Adult Population
Of 23 studies (33–37, 39–47, 49, 50, 52–54, 56, 58, 60–63), 24 datasets consisting of 8,547 blood samples evaluated the accuracy of NAAT for MSSA identification, whereas three datasets (n = 479) assessed the NAAT accuracy for MRSA identification. The sensitivity and specificity of NAAT for identification of MSSA ranged from 0.17 (95% CI 0.0–0.82) to 1.0 (95% CI 0.85–1.00) and from 0.90 (95% CI 0.73–0.98) to 1.00 (95% CI 0.99–1.00), respectively (Figure 4A). While the sensitivity and specificity of NAAT for identification of MRSA ranged from 0.25 (95% CI 0.0–0.94) to 1.0 (95% CI 0.74–1.00) and from 0.93 (95% CI 0.77–0.99) to 1.00 (95% CI 0.99–1.0), respectively (Figure 4B). Pooled summary estimates of NAAT for MSSA identification was lower [sensitivity: 0.76 (95% CI 0.69–0.82), specificity: 0.98 (95% CI 0.98–0.99), PLR: 28.63 (95% CI 18.59–44.1), NLR: 0.34 (95% CI 0.23–0.50), DOR: 116.38 (95% CI 57.68–234.8)] compared to MRSA [sensitivity: 0.83 (95% CI 0.59–0.96), specificity: 0.99 (95% CI 0.98–1.0), PLR: 40.73 (95% CI 3.89–426.1), NLR: 0.32 (95% CI 0.08–1.32), DOR: 268.6 (95% CI 32.1–2250.0)]. The I2 statistical scores for sensitivity and specificity of MSSA identification were 57.4 and 88.9%, respectively, indicating substantial to considerable heterogeneity. While I2 statistical scores for sensitivity and specificity of MRSA were 76.9 and 82.1%, indicating considerable heterogeneity. The AUC of SROC for assorted MSSA and MRSA among adult population was 0.97 (95% CI 0.94–1.0), suggesting overall valid diagnostic accuracy (Figure 5B).
Figure 4. Forest plot for detection of (A) MSSA and (B) MRSA in the adult population. The square stands for the sensitivity and specificity of a particular study, the black line represents its confidence interval. TP, true positive, FP, false positive, FN, false negative, TN, true negative, CI, confidence interval.
Figure 5. SROC plot of NAAT for (A) pediatric and (B) adult population. Red circles indicate the data point from each of the investigations, and the solid blue line represents the SROC curve.
Diagnostic Accuracy of In-house vs. Commercial Tests
The diagnostic accuracy of studies based on various NAA tests is summarized in Table 2. For pediatric and adult populations, the pooled summary estimates of the in-house NAA tests for detecting MSSA were consistently higher (sensitivity ≥78%; specificity ≥93%). The pooled summary estimates of the commercial tests were higher for MSSA identification [sensitivity: 0.75 (95% CI 0.66–0.82), specificity: 0.98 (95% CI 0.97–0.98), PLR: 31.9 (95% CI 20.4–50.0), NLR: 0.3 (95% CI 0.2–0.5), DOR: 126.1 (95% CI 62.1–256.2) and AUC 0.98 (95% CI 0.96–0.99)] as compared to MRSA [sensitivity: 0.56 (95% CI 0.21–0.88), specificity: 1.0 (95% CI 0.99–1.0), PLR: 113.2 (95% CI 4.7–2,699.8), NLR: 0.53 (95% CI 0.26–1.0), and DOR: 234.2 (95% CI 4.65–11,801.6)]. Among NAAT studies, SeptiFast were consistently performed to detect BSI in blood samples compared to other tests.
Table 2. Subgroup analysis of studies based on different NAA tests.
Meta-Regression and Subgroup Analysis
We assessed the possible source of heterogeneity through a meta-regression analysis on predefined subgroups. Meta-regression suggested that study design (prospective/others), country (developed/developing), and patient selection (consecutive/convenience) were not the significant source of heterogeneity (meta-regression P = 0.42, P = 0.34, and P = 0.62, respectively) with the exception of the sample condition (fresh/frozen) (P = 0.04).
Publication Bias
Using Deek's funnel plot asymmetry test, publication bias was measured. In our analysis, we did not find striking publication bias (P = 0.25).
Discussion
Despite advances in supportive care, BSI is a leading cause of death worldwide (10). In recent years, most studies have centered on screening positive blood culture to identify causative staphylococcal pathogen (64–66); however, it remains a matter of concern as every hour of delay in initiating effective antimicrobial therapy increases mortality by 7.6% in sepsis patients (67). Therefore, it is essential to recognize staphylococcal species and their resistance markers rapidly in patients with suspected BSI, as the prompt intervention will lead to improved clinical outcomes with effective antimicrobial therapy. Currently, several multiplex molecular assays have been cleared by the Food and Drug Administration (FDA) that can identify a wide range of microorganisms concurrently with specific resistance genes in blood samples, and several of these assays have been rendered commercially accessible (68). Nevertheless, the numerous case descriptions and the diverse samples used in the various studies make it difficult to compare research results and restrict diseases' management. We, therefore, conducted a systematic review and meta-analysis to evaluate NAAT's diagnostic performance for diagnosing BSI in clinically suspected patients.
Our results revealed that NAAT overall summary estimates for MRSA detection [sensitivity: 0.83 (95% CI 0.59–0.96), specificity: 0.99 (95% CI 0.98–1.0), AUC: 0.98 (95% CI 0.96–0.99)] were higher as compared to MSSA [sensitivity: 0.76 (95% CI 0.69–0.82), specificity: 0.98 (95% CI 0.98–0.99), AUC: 0.98 (95% CI 0.97–0.99)] among adults. Relatively smaller sample size, different DNA extraction technique, target genes adopted, and reaction material quality are among factors that could have contributed to greater NAAT accuracy for MRSA detection. Figure 6 shows the pooled sensitivity and specificity of NAAT for BSI detection in children and adults.
Figure 6. Summary for NAAT's pooled sensitivity and specificity.
In the pediatric population, NAAT displayed consistently higher diagnostic accuracy for MSSA detection [sensitivity: 0.89 (95% CI 0.76–0.96), specificity: 0.98 (95% CI 0.97–0.98), AUC: 0.90 (95% CI 0.74–1.0)]. Albeit not perfect, the higher sensitivity of NAAT among a pediatric population, where the acquisition of large volumes of blood is a major concern, and relatively small non-interpretable results, encourages the use of the test for the diagnosis of BSI in principle. Furthermore, NAAT identified more pathogens than blood cultures alone in all studies, and specificity (~98%) of the test was consistent among pediatric and adult populations, highlighting higher NAAT diagnostic accuracy. Compared to previously published systematic reviews conducted by Pammi et al. (69) in the neonatal population, we found that the pooled sensitivity of 0.90 (95% CI 0.82–0.95) and specificity of 0.93 (95% CI 0.89–0.96) were similar to our study. Similarly, a meta-analysis by Su et al. (70) mainly summarized the diagnostic value of the 16S rRNA gene PCR test for neonates, which reported a nearly similar sensitivity of 0.85 (95% CI, 0.81–0.88) and a specificity of 0.96 (95% CI, 0.95–0.96) for BSI diagnosis. All these reviews were not unique to MSSA or MRSA for the definitive diagnosis of BSI.
Additionally, NAAT subgroup analysis found that in-house tests [sensitivity: 0.78 (95% CI 0.66–0.88), specificity: 0.99 (95% CI 0.99–1.0)] and commercial tests [sensitivity: 0.75 (95% CI 0.66–0.82), specificity: 0.98 (95% CI 0.97–0.98)] were comparable for MSSA detection (Table 2). The PLR for commercial research was 31.9, implying that patients with BSI are ~32 times more likely than patients without BSI to be NAA test positive. In the case of MRSA, there was insufficient data in the in-house and commercial test subgroups to allow meaningful comparisons. Searching for more accurate commercial test details, we observed that SeptiFast was often used in BSI diagnosis, and the pooled summary estimates of tests [sensitivity: 0.76 (95% CI 0.66–0.84), specificity: 0.98 (95% CI 0.98–0.99)] corresponded well-with the study by Chang and colleagues [sensitivity: 0.75 (95% CI 0.65–0.83), specificity: 0.92 (95% CI 0.90–0.95)] (71). However, Chang and colleagues evaluated the accuracy of SeptiFast against a composite reference standard, including bacteremia and fungemia, which was not unique to BSI.
The vital strengths of this study include a rigorous search strategy, utility of systemic guidelines, impartial selection criteria, a precise reference standard, a bivariate random-effects model for data-manipulation, meta-regression analysis on predefined subgroups, and independent analysts' interpretation. Studies that did not adhere to specific guidelines for diagnosing BSI, as well as those with a high risk of bias and high applicability concerns, as judged by the QUADAS-2 tool, were removed from subsequent analysis. We also excluded studies with fewer than ten samples to reduce the effects of publication bias while also discouraging future researchers from conducting small-scale studies, which is consistent with other meta-analyses (72, 73). Furthermore, and involved pre-enrichment steps before molecular testing, which may tend to overstate the index test's diagnostic performance, were excluded.
There are a few limitations to our analysis. It is likely that we may have overlooked a few crucial studies through systematic literature searches across databases. Due to the high degree of reporting variability of the included studies, the effect of factors such as sample volume, non-standardized sample preparation, NAA testing expertise, amplification procedures, and laboratory facilities on the accuracy of NAA tests could not be addressed. It should be noted that the gene targets were also different, which could be possible reasons for the heterogeneity. Although the study design, sample condition, and patient selection were not significant sources of heterogeneity in the meta-regression analysis, these variables could enhance heterogeneity and limit the generalizability of the NAAT's overall diagnostic accuracy. In addition, this meta-analysis was constrained due to insufficient MRSA studies among both children and adult populations, and should be interpreted with caution.
Conclusions
Our findings suggest that currently available molecular assays may not have adequate diagnostic accuracy to replace microbial cultures. However, molecular assays have a shorter turnaround time, a higher proportion of false-positives, a higher specificity, and may detect minute amounts of DNA from a dead organism. Furthermore, because the specimen type and gene target for MRSA detection are the same in adults and children, NAAT's accuracy in adult blood samples could provide a glimpse of its applicability for subsequent detection in the pediatric population. Therefore, NAAT should be considered as the preferred initial tests for diagnosing BSI in order to avoid unnecessary anti-MRSA therapy. The utility of NAAT, in combination with microbiological culture, should be considered whenever feasible. Given the limited data on MRSA, it would be of interest to conduct a detailed investigation using a higher number of prospective studies to fully validate the clinical outcomes associated with NAAT's utility. Additionally, future research should analyze additional measures, including NAAT's impact on decreased hospitalizations, cost-effectiveness, antibiotic-related adverse effects, and electronic clinical decision supporting tools to accelerate therapy adjustment.
Data Availability Statement
The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author/s.
Author Contributions
SCO conceptualized the study. KC, AAM, and SCO performed the literature search, analyzed data, and drafted the manuscript. Y-JS, SA, CS, C-LD, and SCO reviewed and edited the manuscript. All authors contributed to the article and approved the submitted version.
Funding
This study was funded by the Doctoral Research Fund of Affiliated Hospital of Southwest Medical University to SCO and KC.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fped.2021.713447/full#supplementary-material
References
1. Del Rio A, Cervera C, Moreno A, Moreillon P, Miró JM. Patients at risk of complications of staphylococcus aureus bloodstream infection. Clin Infect Dis. (2009) 48:S246–53. doi: 10.1086/598187
2. Fowler VG, Olsen MK, Corey GR, Woods CW, Cabell CH, Reller LB, et al. Clinical identifiers of complicated staphylococcus aureus bacteremia. Arch Intern Med. (2003) 163:2066–72. doi: 10.1001/archinte.163.17.2066
3. Wongboot W, Chomvarin C, Engchanil C, Namwat W, Chaimanee P. Application of SYBR green real-time quantitative PCR and conventional PCR for the detection of methicillin-resistant staphylococcus aureus in blood samples. Chiang Mai J Sci. (2016) 43:737–46. Available online at: http://epg.science.cmu.ac.th/ejournal/
4. Cattoir V, Merabet L, Djibo N, Rioux C, Legrand P, Girou E, et al. Clinical impact of a real-time PCR assay for rapid identification of staphylococcus aureus and determination of methicillin resistance from positive blood cultures. Clin Microbiol Infect. (2011) 17:425–31. doi: 10.1111/j.1469-0691.2010.03233.x
5. Trindade PA, Pacheco RL, Costa SF, Rossi F, Barone AA, Mamizuka EM, et al. Prevalence of SCCmec type IV in nosocomial bloodstream isolates of methicillin-resistant staphylococcus aureus. J Clin Microbiol. (2005) 43:3435–7. doi: 10.1128/JCM.43.7.3435-3437.2005
6. Laupland KB, Lyytikäinen O, Sgaard M, Kennedy K, Knudsen JD, Ostergaard C, et al. The changing epidemiology of staphylococcus aureus bloodstream infection: a multinational population-based surveillance study. Clin Microbiol Infect. (2013) 19:465–71. doi: 10.1111/j.1469-0691.2012.03903.x
7. Brown J, Paladino JA. Impact of rapid methicillin-resistant Staphylococcus aureus polymerase chain reaction testing on mortality and cost effectiveness in hospitalized patients with bacteraemia. Pharmacoeconomics. (2010) 28:567–75. doi: 10.2165/11533020-000000000-00000
8. Song K-H, Kim ES, Sin H-Y, Park K-H, Jung S-I, Yoon N, et al. Characteristics of invasive staphylococcus aureus infections in three regions of Korea, 2009-2011: a multi-center cohort study. BMC Infect Dis. (2013) 13:581. doi: 10.1186/1471-2334-13-581
9. Kim C-J, Kim H-B, Oh M-d, Kim Y, Kim A, Oh S-H, et al. The burden of nosocomial staphylococcus aureus bloodstream infection in South Korea: a prospective hospital-based nationwide study. BMC Infect Dis. (2014) 14:590. doi: 10.1186/s12879-014-0590-4
10. Van Hal SJ, Jensen SO, Vaska VL, Espedido BA, Paterson DL, Gosbell IB. Predictors of mortality in staphylococcus aureus bacteremia. Clin Microbiol Rev. (2012) 25:6362–86. doi: 10.1128/CMR.05022-11
11. Cusumano JA, Dupper AC, Malik Y, Gavioli EM, Banga J, Berbel Caban A. Staphylococcus aureus bacteremia in patients infected with COVID-19: a case series. Open Forum Infect Dis. (2020) 7:518. doi: 10.1093/ofid/ofaa518
12. Liu C, Bayer A, Cosgrove SE, Daum RS, Fridkin SK, Gorwitz RJ, et al. Clinical practice guidelines by the infectious diseases Society of America for the treatment of methicillin-resistant staphylococcus aureus infections in adults and children. Clin Infect Dis. (2011) 52:e18–55. doi: 10.1093/cid/ciq146
13. Zhang S, Sun X, Chang W, Dai Y, Ma X. Systematic review and meta-analysis of the epidemiology of vancomycin-intermediate and heterogeneous vancomycin-intermediate staphylococcus aureus isolates. PLoS ONE. (2015) 10:e0136082. doi: 10.1371/journal.pone.0136082
14. Stryjewski ME, Szczech LA, Benjamin DK Jr, Inrig JK, Kanafani ZA, Engemann JJ, et al. Use of vancomycin or first-generation cephalosporins for the treatment of hemodialysis-dependent patients with methicillin-susceptible staphylococcus aureus bacteremia. Clin Infect Dis. (2007) 44:190–6. doi: 10.1086/510386
15. Martinez RM, Bauerle ER, Fang FC, Butler-Wu SM. Evaluation of three rapid diagnostic methods for direct identification of microorganisms in positive blood cultures. J Clin Microbiol. (2014) 52:2521–9. doi: 10.1128/JCM.00529-14
16. Reier-Nilsen T, Farstad T, Nakstad B, Lauvrak V, Steinbakk M. Comparison of broad range 16S rDNA PCR and conventional blood culture for diagnosis of sepsis in the newborn: a case control study. BMC Pediatr. (2009) 9:5. doi: 10.1186/1471-2431-9-5
17. Opota O, Croxatto A, Prod'hom G, Greub G. Blood culture-based diagnosis of bacteraemia: state of the art. Clin Microbiol Infect. (2015) 21:313–22. doi: 10.1016/j.cmi.2015.01.003
18. Connell TG, Rele M, Cowley D, Buttery JP, Curtis N. How reliable is a negative blood culture result? Volume of blood submitted for culture in routine practice in a children's hospital. Pediatrics. (2007) 119:891–6. doi: 10.1542/peds.2006-0440
19. Chiesa C, Panero A, Osborn JF, Simonetti AF, Pacifico L. Diagnosis of neonatal sepsis: a clinical and laboratory challenge. Clin Chem. (2004) 50:279–87. doi: 10.1373/clinchem.2003.025171
20. McHugh MP, Parcell BJ, MacKenzie FM, Templeton KE. Rapid molecular testing for staphylococcus aureus bacteraemia improves clinical management. J Med Microbiol. (2020) 69:552–7. doi: 10.1099/jmm.0.001171
21. Makhoul IR, Smolkin T, Sujov P, Kassis I, Tamir A, Shalginov R, et al. PCR-based diagnosis of neonatal staphylococcal bacteremias. J Clin Microbiol. (2005) 43:4823–5. doi: 10.1128/JCM.43.9.4823-4825.2005
22. Ohlin A, Bäckman A, Björkqvist M, Mölling P, Jurstrand M, Schollin J. Real-time PCR of the 16S-rRNA gene in the diagnosis of neonatal bacteraemia. Acta Paediatr. (2008) 97:1376–80. doi: 10.1111/j.1651-2227.2008.00924.x
23. Wolk D, Struelens M, Pancholi P, Davis T, Della-Latta P, Fuller D, et al. Rapid detection of staphylococcus aureus and methicillin-resistant S. Aureus (MRSA) in wound specimens and blood cultures: multicenter preclinical evaluation of the Cepheid Xpert MRSA/SA skin and soft tissue and blood culture assays. J Clin Microbiol. (2009) 47:823–6. doi: 10.1128/JCM.01884-08
24. Baek Y-H, Jo M-Y, Song M-S, Hong S-B, Shin K-S. Application of loop-mediated isothermal amplification (LAMP) assay to rapid detection of methicillin-resistant staphylococcus aureus from blood cultures. Biomed Sci Lett. (2019) 25:75–82. doi: 10.15616/BSL.2019.25.1.75
25. Salimnia H, Fairfax MR, Lephart PR, Schreckenberger P, DesJarlais SM, Johnson JK, et al. Evaluation of the FilmArray blood culture identification panel: results of a multicenter controlled trial. J Clin Microbiol. (2016) 54:687–98. doi: 10.1128/JCM.01679-15
26. McInnes MD, Moher D, Thombs BD, McGrath TA, Bossuyt PM, Clifford T, et al. Preferred reporting items for a systematic review and meta-analysis of diagnostic test accuracy studies: the PRISMA-DTA statement. JAMA. (2018) 319:388–96. doi: 10.1001/jama.2017.19163
27. Whiting PF, Rutjes AW, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. (2011) 155:529–36. doi: 10.7326/0003-4819-155-8-201110180-00009
28. Cochrane T. Review Manager (RevMan) 5.4. Copenhagen: The Nordic Cochrane Centre. (2008). p. 373.
29. Zamora J, Abraira V, Muriel A, Khan K, Coomarasamy A. Meta-DiSc: a software for meta-analysis of test accuracy data. BMC Med Res Methodol. (2006) 6:31. doi: 10.1186/1471-2288-6-31
30. Higgins JP, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, et al. Cochrane Handbook For Systematic Reviews of Interventions. Chichester: John Wiley & Sons (2019).
31. Deeks JJ, Macaskill P, Irwig L. The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed. J Clin Epidemiol. (2005) 58:882–93. doi: 10.1016/j.jclinepi.2005.01.016
32. Abd El-Aziz NK, Gharib AA, Mohamed EAA, Hussein AH. Real-time PCR versus MALDI-TOF MS and culture-based techniques for diagnosis of bloodstream and pyogenic infections in humans and animals. J Appl Microbiol. (2020) 130:1630–44. doi: 10.1111/jam.14862
33. Arabestani MR, Fazzeli H, Esfahani BN. Identification of the most common pathogenic bacteria in patients with suspected sepsis by multiplex PCR. J Infect Dev Ctries. (2014) 8:461–8. doi: 10.3855/jidc.3856
34. Bloos F, Hinder F, Becker K, Sachse S, Dessap AM, Straube E, et al. A multicenter trial to compare blood culture with polymerase chain reaction in severe human sepsis. Intens Care Med. (2010) 36:241–7. doi: 10.1007/s00134-009-1705-z
35. Etchebarne BE, Li Z, Stedtfeld RD, Nicholas MC, Williams MR, Johnson TA, et al. Evaluation of nucleic acid isothermal amplification methods for human clinical microbial infection detection. Front Microbiol. (2017) 8:2211. doi: 10.3389/fmicb.2017.02211
36. Faraji R, Behjati-Ardakani M, Faraji N, Moshtaghioun SM, Kalantar SM, Pedarzadeh A, et al. Molecular diagnosis of bacterial definite infective endocarditis by real-time polymerase chain reaction. Cardiol Res. (2018) 9:99–106. doi: 10.14740/cr687w
37. Fernández-Romero N, Quiles I, Jiménez C, Oliva MOL, Rivas B, Mingorance J, et al. Use of multiplex PCR in diagnosis of bloodstream infections in kidney patients. Diagn Microbiol Infect Dis. (2014) 80:93–6. doi: 10.1016/j.diagmicrobio.2014.07.001
38. García-Gudiño I, Yllescas-Medrano E, Maida-Claros R, Soriano-Becerril D, Díaz NF, García-López G, et al. Microbiological comparison of blood culture and amplification of 16S rDNA methods in combination with DGGE for detection of neonatal sepsis in blood samples. Eur J Pediatr. (2018) 177:85–93. doi: 10.1007/s00431-017-3036-3
39. Ginn AN, Hazelton B, Shoma S, Cullen M, Solano T, Iredell JR. Quantitative multiplexed-tandem PCR for direct detection of bacteraemia in critically ill patients. Pathology. (2017) 49:304–8. doi: 10.1016/j.pathol.2016.10.014
40. Grosse-Onnebrink J, Stehling F, Tschiedel E, Olivier M, Mellies U, Schmidt R, et al. Bacteraemia and fungaemia in cystic fibrosis patients with febrile pulmonary exacerbation: a prospective observational study. BMC Pulm Med. (2017) 17:96. doi: 10.1186/s12890-017-0440-4
41. Josefson P, Strålin K, Ohlin A, Ennefors T, Dragsten B, Andersson L, et al. Evaluation of a commercial multiplex PCR test (SeptiFast) in the etiological diagnosis of community-onset bloodstream infections. Eur J Clin Microbiol Infect Dis. (2011) 30:1127–34. doi: 10.1007/s10096-011-1201-6
42. Kitagawa Y, Ueda M, Ando N, Endo M, Ishibiki K, Kobayashi Y, et al. Rapid diagnosis of methicillin-resistant staphylococcus aureus bacteremia by nested polymerase chain reaction. Ann Surg. (1996) 224:665–71. doi: 10.1097/00000658-199611000-00010
43. Knabl L, Mutschlechner W, Orth-Höller D. Evaluation of a multiplex OnSpot primer-extension PCR assay in the diagnosis of sepsis. J Microbiol Methods. (2016) 120:91–3. doi: 10.1016/j.mimet.2015.12.001
44. Korber F, Zeller I, Grünstäudl M, Willinger B, Apfalter P, Hirschl AM, et al. SeptiFast versus blood culture in clinical routine – a report on 3 years experience. Wien Klin Wochenschr. (2017) 129:427–34. doi: 10.1007/s00508-017-1181-3
45. Lehmann LE, Alvarez J, Hunfeld KP, Goglio A, Kost GJ, Louie RF, et al. Potential clinical utility of polymerase chain reaction in microbiological testing for sepsis. Crit Care Med. (2009) 37:3085–90. doi: 10.1097/CCM.0b013e3181b033d7
46. Liberto MC, Puccio R, Matera G, Lamberti AG, Quirino A, Barreca GS, et al. Applications of lightcycler staphylococcus M-GRADE assay to detect staphylococcus aureus and coagulase-negative staphylococci in clinical blood samples and in blood culture bottles. Infez Med. (2006) 14:71–6.
47. Liu CF, Shi XP, Chen Y, Jin Y, Zhang B. Rapid diagnosis of sepsis with TaqMan-Based multiplex real-time PCR. J Clin Lab Anal. (2018) 32:e22256. doi: 10.1002/jcla.22256
48. Lucignano B, Ranno S, Liesenfeld O, Pizzorno B, Putignani L, Bernaschi P, et al. Multiplex PCR allows rapid and accurate diagnosis of bloodstream infections in newborns and children with suspected sepsis. J Clin Microbiol. (2011) 49:2252–58. doi: 10.1128/JCM.02460-10
49. Moore CC, Jacob ST, Banura P, Zhang J, Stroup S, Boulware DR, et al. Etiology of sepsis in Uganda using a quantitative polymerase chain reaction-based TaqMan Array Card. Clin Infect Dis. (2019) 68:266–72. doi: 10.1093/cid/ciy472
50. Obara H, Aikawa N, Hasegawa N, Hori S, Ikeda Y, Kobayashi Y, et al. The role of a real-time PCR technology for rapid detection and identification of bacterial and fungal pathogens in whole-blood samples. J Infect Chemother. (2011) 17:327–33. doi: 10.1007/s10156-010-0168-z
51. Oeser C, Pond M, Butcher P, Bedford Russell A, Henneke P, Laing K, et al. PCR for the detection of pathogens in neonatal early onset sepsis. PLoS ONE. (2020) 15:e0226817. doi: 10.1371/journal.pone.0226817
52. Pasqualini L, Mencacci A, Leli C, Montagna P, Cardaccia A, Cenci E, et al. Diagnostic performance of a multiple real-time PCR assay in patients with suspected sepsis hospitalized in an internal medicine ward. J Clin Microbiol. (2012) 50:1285–1288. doi: 10.1128/JCM.06793-11
53. Peters RP, van Agtmael MA, Gierveld S, Danner SA, Groeneveld AB, Vandenbroucke-Grauls CM, et al. Quantitative detection of staphylococcus aureus and enterococcus faecalis DNA in blood to diagnose bacteremia in patients in the intensive care unit. J Clin Microbiol. (2007) 45:3641–6. doi: 10.1128/JCM.01056-07
54. Rogina P, Skvarc M, Stubljar D, Kofol R, Kaasch A. Diagnostic utility of broad range bacterial 16S rRNA gene PCR with degradation of human and free bacterial DNA in bloodstream infection is more sensitive than an in-house developed PCR without degradation of human and free bacterial DNA. Mediators Inflamm. (2014) 2014:108592. doi: 10.1155/2014/108592
55. Santolaya ME, Farfán MJ, De La Maza V, Cociña M, Santelices F, Alvarez AM, et al. Diagnosis of bacteremia in febrile neutropenic episodes in children with cancer: microbiologic and molecular approach. Pediatr Infect Dis. (2011) 30:957–61. doi: 10.1097/INF.0b013e31822a37d7
56. Schaub N, Boldanova T, Noveanu M, Arenja N, Hermann H, Twerenbold R, et al. Incremental value of multiplex real-time PCR for the early diagnosis of sepsis in the emergency department. Swiss Med Wkly. (2014) 144:w13911. doi: 10.4414/smw.2014.13911
57. van den Brand M, van den Dungen FAM, Bos MP, van Weissenbruch MM, van Furth AM, de Lange A, et al. Evaluation of a real-time PCR assay for detection and quantification of bacterial DNA directly in blood of preterm neonates with suspected late-onset sepsis. Crit Care. (2018) 22:105. doi: 10.1186/s13054-018-2010-4
58. Wallet F, Nseir S, Baumann L, Herwegh S, Sendid B, Boulo M, et al. Preliminary clinical study using a multiplex real-time PCR test for the detection of bacterial and fungal DNA directly in blood. Clin Microbiol Infect. (2010) 16:774–9. doi: 10.1111/j.1469-0691.2009.02940.x
59. Wu YD, Chen LH, Wu XJ, Shang SQ, Lou JT, Du LZ, et al. Gram stain-specific-probe-based real-time PCR for diagnosis and discrimination of bacterial neonatal sepsis. J Clin Microbiol. (2008) 46:2613–9. doi: 10.1128/JCM.02237-07
60. Xiao Y, Shen X, Zhao QF, Yao YH, Yang TC, Niu JJ. Evaluation of real-time PCR coupled with multiplex probe melting curve analysis for pathogen detection in patients with suspected bloodstream infections. Front Cell Infect Microbiol. (2019) 9:1–11. doi: 10.3389/fcimb.2019.00361
61. Yanagihara K, Kitagawa Y, Tomonaga M, Tsukasaki K, Kohno S, Seki M, et al. Evaluation of pathogen detection from clinical samples by real-time polymerase chain reaction using a sepsis pathogen DNA detection kit. Crit Care. (2010) 14:R159. doi: 10.1186/cc9234
62. Zboromyrska Y, De la Calle C, Soto M, Sampietro-Colom L, Soriano A, Alvarez-Martínez MJ, et al. Rapid diagnosis of staphylococcal catheter-related bacteraemia in direct blood samples by real-time PCR. PLoS ONE. (2016) 11:e0161684. doi: 10.1371/journal.pone.0161684
63. Ziegler I, Fagerstrom A, Strålin K, Molling P. Evaluation of a commercial multiplex PCR assay for detection of pathogen DNA in blood from patients with suspected sepsis. PLoS ONE. (2016) 11:e0167883. doi: 10.1371/journal.pone.0167883
64. Wang HY, Kim S, Kim J, Park SD, Uh Y, Lee H. Multiplex real-time PCR assay for rapid detection of methicillin-resistant staphylococci directly from positive blood cultures. J Clin Microbiol. (2014) 52:1911–920. doi: 10.1128/JCM.00389-14
65. Qian QF, Eichelberger K, Kirby JE. Rapid identification of staphylococcus aureus directly from Bactec blood culture broth by the BinaxNOW S. aureus test. J Clin Microbiol. (2014) 52:319–20. doi: 10.1128/JCM.02291-13
66. Misawa Y, Yoshida A, Saito R, Yoshida H, Okuzumi K, Ito N, et al. Application of loop-mediated isothermal amplification technique to rapid and direct detection of methicillin-resistant staphylococcus aureus (MRSA) in blood cultures. J Infect Chemother. (2007) 13:134–40. doi: 10.1007/s10156-007-0508-9
67. Kumar A, Ellis P, Arabi Y, Roberts D, Light B, Parrillo JE, et al. Initiation of inappropriate antimicrobial therapy results in a fivefold reduction of survival in human septic shock. Chest. (2009) 136:1237–48. doi: 10.1378/chest.09-0087
68. Rello J, Van Engelen T, Alp E, Calandra T, Cattoir V, Kern W, et al. Towards precision medicine in sepsis: a position paper from the European society of clinical microbiology and infectious diseases. Clin Microbiol Infect. (2018) 24:1264–72. doi: 10.1016/j.cmi.2018.03.011
69. Pammi M, Flores A, Versalovic J, Leeflang MM. Molecular assays for the diagnosis of sepsis in neonates. Cochrane Database Syst Rev. (2017) 2:CD011926. doi: 10.1002/14651858.CD011926.pub2
70. Su G, Fu Z, Hu L, Wang Y, Zhao Z, Yang W. 16S ribosomal ribonucleic acid gene polymerase chain reaction in the diagnosis of bloodstream infections: a systematic review and meta-analysis. PLoS ONE. (2015) 10:e0127195. doi: 10.1371/journal.pone.0127195
71. Chang S-S, Hsieh W-H, Liu T-S, Lee S-H, Wang C-H, Chou H-C, et al. Multiplex PCR system for rapid detection of pathogens in patients with presumed sepsis–a systemic review and meta-analysis. PLoS ONE. (2013) 8:e62323. doi: 10.1371/journal.pone.0062323
72. Altez-Fernandez C, Ortiz V, Mirzazadeh M, Zegarra L, Seas C, Ugarte-Gil C. Diagnostic accuracy of nucleic acid amplification tests (NAATs) in urine for genitourinary tuberculosis: a systematic review and meta-analysis. BMC Infect Dis. (2017) 17:390. doi: 10.1186/s12879-017-2476-8
Keywords: bloodstream infection, NAAT accuracy, staphylococcal infections, pediatric population, meta-analysis
Citation: Chen K, Malik AA, Sheng Y-J, Ahmed S, Sun C, Deng C-L and Ojha SC (2021) Clinical Utility of Molecular Tests for Guiding Therapeutic Decisions in Bloodstream Staphylococcal Infections: A Meta-Analysis. Front. Pediatr. 9:713447. doi: 10.3389/fped.2021.713447
Received: 23 May 2021; Accepted: 12 July 2021;
Published: 05 August 2021.
Edited by:
Phuc Huu Phan, Vietnam National Hospital of Pediatrics, VietnamReviewed by:
Ellen Stobberingh, National Institute Public Health, Netherlands Gazi Arslan, Dokuz Eylül University, TurkeyCopyright © 2021 Chen, Malik, Sheng, Ahmed, Sun, Deng and Ojha. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Suvash Chandra Ojha, c3V2YXNoX29qaGEmI3gwMDA0MDtzd211LmVkdS5jbg==