Skip to main content

ORIGINAL RESEARCH article

Front. Microbiol., 22 December 2022
Sec. Infectious Agents and Disease
This article is part of the Research Topic Infectious Diseases (ID) - Post-pandemic Advances View all 8 articles

A diagnostic accuracy study comparing RNA LAMP, direct LAMP, and rapid antigen testing from nasopharyngeal swabs

Guojun Cao&#x;Guojun Cao1Ke Lin&#x;Ke Lin2Jingwen Ai&#x;Jingwen Ai2Jianpeng Cai&#x;Jianpeng Cai2Haocheng Zhang&#x;Haocheng Zhang2Yiqi YuYiqi Yu2Qihui LiuQihui Liu2Xinyun ZhangXinyun Zhang2Yi ZhangYi Zhang2Zhangfan FuZhangfan Fu2Jieyu SongJieyu Song2Hongyu WangHongyu Wang2Guanmin YuanGuanmin Yuan2Sen Wang,
Sen Wang2,3*Ming Guan,
Ming Guan1,3*Wenhong Zhang,,
Wenhong Zhang2,3,4*
  • 1Department of Laboratory Medicine, Huashan Hospital, Shanghai Medical College, Fudan University, Shanghai, China
  • 2Department of Infectious Diseases, National Medical Center for Infectious Diseases, Shanghai Key Laboratory of Infectious Diseases and Biosafety Emergency Response, Huashan Hospital, Fudan University, Shanghai, China
  • 3Shanghai Huashan Institute of Microbes and Infections, Shanghai, China
  • 4National Clinical Research Center for Aging and Medicine, Huashan Hospital, Fudan University, Shanghai, China

Introduction: During the coronavirus disease 2019 (COVID-19) pandemic, the early detection and isolation of individuals infected with severe acute respiratory syndrome coronavirus disease 2 (SARS-CoV-2) through mass testing can effectively prevent disease transmission. SARS-CoV-2 nucleic acid rapid detection based on loop-mediated isothermal amplification (LAMP) may be appropriate to include in testing procedures.

Methods: We used 860 nasopharyngeal specimens from healthcare workers of Huashan Hospital and COVID-19 patients collected from April 7th to 21st, 2022, to assess the clinical diagnostic performance of the LAMP assay marketed by Shanghai GeneSc Biotech and compared it to the result of a rapid antigen test (RAT) head-to-head.

Results: Overall, the diagnostic performance of LAMP assay and RAT were as follows. The LAMP assay represented higher sensitivity and specificity than RAT, especially in the extracted RNA samples. The sensitivity was 70.92% and 92.91% for direct LAMP and RNA-LAMP assay, respectively, while the specificity was 99.86% and 98.33%. The LAMP assay had overall better diagnostic performance on the specimens with relatively lower Ct values or collected in the early phase (≤7 days) of COVID-19. The combination of LAMP assay and RAT improved diagnostic efficiency, providing new strategies for rapidly detecting SARS-CoV-2.

Conclusion: The LAMP assay are suitable for mass screenings of SARS-CoV-2 infections in the general population.

Introduction

The pandemic caused by coronavirus disease 2019 (COVID-19), which began in December 2019 in Wuhan, China, results in a global public health crisis (Andersen et al., 2020). This disease is caused by infection with severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), a highly-transmissible virus belonging to the Coronaviridae family, of which, the control remains a global crisis (Andersen et al., 2020). The World Health Organization (WHO) declared a global emergency over the novel coronavirus on January 30, 2020 and declared COVID-19 a pandemic disease on March 12, 2020 (Cucinotta and Vanelli, 2020). According to WHO records, as of May 10, 2022, over 0.5 billion cases and over 6 million deaths had been reported (WHO, 2022). Rapid diagnosis is essential for screening SARS-CoV-2 infections and is important for controlling its spread.

Current methods for COVID-19 testing mainly fall into three categories: nucleic acid tests, serological tests for antibody detection, and antigen tests. Reverse-transcription polymerase chain reaction (RT-PCR), the gold standard for COVID-19 diagnosis, has the advantages of high sensitivity and specificity, and has become the most widely used technology for amplifying nucleic acids. However, RT-PCR testing has many limitations, including its long detection time, costly instruments, and need for skilled operators. As a result of these concerns, rapid antigen tests (RATs) for COVID-19, which can be easily performed and interpreted without complex equipment, have been approved for clinical use worldwide. However, studies have shown that RATs can only confirm samples containing large amounts of the virus as positive cases, while those containing small amounts of the virus may be misinterpreted, thus some infected patients may be missed (Yamayoshi et al., 2020). These limitations have prompted researchers to search for a method providing rapid and accurate detection of SARS-CoV-2.

The loop-mediated isothermal amplification (LAMP) technique was developed by Notomi et al. (2000). It is a rapid and straightforward technique for nucleic acid detection with high specificity and sensitivity. The specific amplification of the LAMP method relies on 4 or 6 designed primers that bind to six regions specific to the target gene (Notomi et al., 2000; Enosawa et al., 2003). Compared to RT-PCR, LAMP assays are significantly more rapid, with the advantages of no temperature changes, simpler operation, less cost, and more straightforward result interpretation (Enosawa et al., 2003; Chen et al., 2015). With the development and improvement of LAMP technology, it is now widely applied in many fields, such as food or environmental microbiology detection, and clinical pathology diagnosis. In healthcare, LAMP is used for detecting the Zika virus, Ebola virus, yellow fever virus, SARS-CoV-2, and various infectious diseases (Kwallah et al., 2013; Li et al., 2015; Chotiwan et al., 2017; Kashir and Yaqinuddin, 2020). Meanwhile, LAMP technology could be compatible with pH-based colorimetric readings (Tanner et al., 2015), allowing straightforward interpretation of test results by visual inspection. Considering its various advantages, LAMP is appealing in point-of-care or low-resource settings and can meet the need for at-home self-testing. Some LAMP-based kits for SARS-CoV-2 detection have received emergency use authorization (EUA) from the US Food and Drug Administration (FDA; FDA, 2022).

Novel and precise diagnostic tools that can be applied to multiple scenarios could help contain the present epidemic caused by SARS-CoV-2. Varieties of LAMP-based kits with high sensitivity and specificity of SARS-CoV-2 examination are available today, including the Loopamp 2019-SARS-CoV-2 detection reagent kit, the Warmstart RT-LAMP Assay Kit, the Variplex RT-LAMP Assay Kit, the RT-LAMP Mastermix kit, the specific colorimetric and fluorescence RT-LAMP Kit (Baek et al., 2020; Kitagawa et al., 2020; Klein et al., 2020; Lee et al., 2020; Nagura-Ikeda et al., 2020; Rödel et al., 2020; Yan et al., 2020; Kitajima et al., 2021). In this study, we wish to explore more suitable application scenarios of the LAMP assay and estimated the sensitivities and specificity of both the LAMP assay and RAT with large sample size during the SARS-CoV-2 outbreak in March 2022. We further analyzed the efficacy of the combined use of the LAMP assay and RAT, using RT-PCR as a reference.

Materials and methods

Study design and study population

This single-center prospective study at Huashan Hospital was carried out during April 7–21, 2022. All participants were ≥ 18 years of age. The detailed enrollment criteria are listed in Supplementary Table S1. After enrollment and consent, participants completed an initial survey to collect information on demographics, including age, gender, and identification number. The information of individual’s health history was gathered, including the date of the first positive report of a SARS-CoV-2 RT-PCR test and diagnosed with COVID-19, and the clinical classification. Participants received ≥1 reverse-transcription LAMP (RT-LAMP) test (Shanghai GeneSc Biotech Co., Ltd., Shanghai, China) with nasopharyngeal swabs (NPSs), and participants also underwent a RAT (Guangzhou Wondfo Biotech Co., Ltd., Guangzhou, China) for SARS-CoV-2 (with NPSs; Supplementary Figure S1). This study was performed in compliance with an institutional review board protocol at Huashan Hospital (2022–539).

RT-PCR assay

RT-PCR detection of the ORF1ab and N genes of SARS-CoV-2 was performed. The test procedure was as follows: first, purified viral nucleic acid (RNA) was extracted using the QIAamp viral RNA mini kit (50) extraction kit (article no. 52904; Qiagen, Hilden, Germany) or nucleic acid extraction rapid kit (magnetic bead methods; no. SDKF60101; Jiangsu Bioperfectus Technologies Co., Ltd., Jiangsu, China). Subsequently, an RT-PCR assay was performed after sampling, following the manufacturer’s instructions, including preparing the reaction system, adding the treated sample, and then amplification was performed on a TK-6000 real-time quantitative thermal cycler (Anhui Toneker Biotechnology Co., Ltd., Jinzhai, China) for approximately 1.5 h. Finally, we analyzed the result.

RT-LAMP assay/novel coronavirus 2019-nCoV nucleic acid rapid detection Kit (LAMP)

NPSs were collected by experienced clinicians and placed in 2 ml of sample preservation solution provided by the manufacturer (DNase and RNase-free water); then, the samples were processed in different ways. For samples processed with RNA-LAMP assay, the purified viral nucleic acid (RNA) was extracted using a nucleic acid extraction rapid kit (magnetic bead method; no. SDKF60101; Jiangsu Bioperfectus Technologies Co., Ltd., Jiangsu, China) from the original specimen for further detection. As for the samples processed with direct LAMP assay, the original sample would be heated at 95°C for 5 min directly for further test. The RT-LAMP assay was performed immediately after sampling, following the manufacturer’s instructions. For the test procedure, we preheated the heat block to 65°C, and took out the RCOV 8-tube strip. Then, we took out 25 μl of the pre-purified nucleic acid sample or heat-treated original sample and added it into a PCR reaction tube filled with a lyophilized reagent. We capped the loaded 8-tube strip for sealing and mixing well and then centrifuged it for a short period (observing the solution periodically; the color should be red). We immediately placed the PCR reaction tube in the preheated 65°C heat block; after 30 min of reaction, we took out the PCR reaction tube, cooled the tube to room temperature, and checked for a color change. If the reagent appeared yellow, the test result was positive; if the reagent was red, the test result was negative (Figure 1).

FIGURE 1
www.frontiersin.org

Figure 1. Operation flow of the LAMP assay.

Rapid antigen test

NPSs were collected by experienced physicians and placed in 0.4 ml of sample extraction solution (provided by the manufacturer). An antigen assay was performed following the manufacturer’s instructions. For nasopharyngeal secretion sample extraction, the NPS was collected, inserted into the sample extraction tube solution, and rotated approximately 10 times against the inner wall of the tube. The swab head should be left in the extraction tube for 1 min, and then added 3–4 drops (around 80 μl) of the treated sample to the spiking hole of the test card. The results should be observed within 15–20 min.

Sample collection

One NPS from a single nostril was subsequently placed in a collection tube containing RNase-free water. The order of nostrils (left or right) was randomized. For NPS, clinicians were required to insert the soft tip of the swab into the patients’ nostril until they encountered mild resistance or discomfort, then gently twist the swab against the inner wall of the nasal vestibule, and place the swab into the tube with RNase-free water. Tests were performed within 2 h of sample collection. In order to reduce interference of other factors, the same nasopharyngeal swabs were collected and tested for RAT, LAMP, and RT-qPCR assays simultaneously.

Statistical analysis

Statistical analysis was performed using IBM SPSS Statistics (IBM Corp., Armonk, NY, USA), Microsoft Excel Version 2021 (Microsoft Corporation, Redmond, WA, USA), and VassarStats: Web Site for Statistical Computation (Richard Lowry, NY, USA). Figures were conducted by GraphPad Prism 8.0 (GraphPad Software Inc., La Jolla, CA, USA) and the ggplot2 package of R (version 3.3.5; R Foundation for Statistical Computing, Vienna, Austria).

The sensitivity and specificity of the LAMP tests and RAT were determined based on the comparison with RT-PCR results. The viral load was determined in a semiquantitative manner expressed by the number of RT-PCR cycles, and the positive test cut-off of cycle threshold (CT) was 35, as a CT < 35 indicates a positive result. Sensitivity represents the test’s ability to identify individuals whose RT-PCR result confirms a SARS-CoV-2 infection, and specificity describes the test’s capability to identify participants with negative RT-PCR test results. The positive predictive value (PPV) and negative predictive value (NPV) describe the probability of SARS-CoV-2–infected individuals with a positive test result and no SARS-CoV-2 infection in participants with a negative test result, respectively. Accuracy indicates the test’s ability to identify healthy and infected individuals correctly, referring to the standard (RT-PCR test). The diagnostic performance of the test was calculated according to the following formulae:

Sensitivity = TP / (TP + FN).

Specificity = TN / (TN + FP).

PPV = TP / (TP + FP).

NPV = TN / (TN + FN).

Accuracy = (TP + TN) / (TP + TN + FP + FN).

The true-positive (TP) value refers to the number of positive test results that are also positive, referring to the standard, and the true-negative (TN) value represents the number of true-negative individuals identified by the method being evaluated, according to the standard. The false-positive (FP) value is the number of results that the testing method indicates are positive, but the standard indicates to be negative. The false-negative (FN) value is the number of positive results according to the standard that the testing methods reported to be negative. We also calculated 95% confidence intervals (CIs) for test performance.

For baseline characteristics, continuous variants were described by median [with interquartile range (IQR)] values, and categorical variables were expressed as numbers and percentages. The chi-squared test, Fisher’s test, and McNemar test were applied when comparing the sensitivity, specificity, PPV, NPV, and accuracy between different methods. A two-sided p value <0.05 was considered to be statistically significant.

Results

General characteristics of participants

Table 1 shows the demographic information for study participants reported here. A total of 571 individuals were enrolled, 383 (67.08%) of whom were healthcare workers of Huashan Hospital, and 188 (32.92%) patients were confirmed to have COVID-19. The median age of all participants was 44 years, and 44.48% of patients were male. Of the patients enrolled, 45.74% (86/188) had asymptomatic COVID-19, while 54.26% (102/188) were symptomatic. A total of 860 NPSs were obtained from 571 participants, and all specimens were tested by direct LAMP assay, RNA-LAMP assay, and RAT.

TABLE 1
www.frontiersin.org

Table 1. Demographic information of participants.

Clinical diagnostic performance of the LAMP assay and RAT

According to the clinical criteria, the specimens with the lowest CT value ≤35 in two genes were defined as positive for SARS-CoV-2 nucleic acid. Among all the NPS samples tested, 141 specimens were positive for SARS-CoV-2 nucleic acid, while 719 were negative. Compared to the RT-PCR results, the direct LAMP assay revealed a sensitivity of 70.92% (100/141; 95% CI, 62.58%–78.10%), a specificity of 99.86% (718/719; 95% CI, 99.10%–99.99%), and an accuracy of 95.12% (818/860; 95% CI, 93.40%–96.42%). The consistency of the direct LAMP assay and RT-PCR was analyzed and the kappa value was 0.799 (p < 0.001), reflecting relatively good agreement. We further calculated the PPV and NPV of the direct LAMP assay, which were 99.01% (95% CI, 93.82%–99.95%) and 94.60% (95% CI, 92.68%–96.05%), respectively (Table 2; Figure 2).

TABLE 2
www.frontiersin.org

Table 2. Clinical performance of RNA-LAMP test, LAMP test, and RAT.

FIGURE 2
www.frontiersin.org

Figure 2. Diagnostic performance of the RNA-LAMP assay, direct LAMP assay, and RAT.

In addition, the performance of the LAMP assay on extracted RNA (RNA-LAMP assay) was evaluated. Compared to the results of RT-PCR, the RNA-LAMP assay showed a sensitivity of 92.91% (131/141; 95% CI, 87.00%–96.36%), a specificity of 98.33% (707/719; 95% CI, 97.02%–99.09%), and an accuracy of 97.44% (838/860; 95% CI, 96.09%–98.35%). The consistency of RNA-LAMP assay and RT-PCR was analyzed and the kappa value was 0.907 (p < 0.001), reflecting great agreement. Furthermore, the PPV was 91.61% (95% CI, 85.49%–95.39%) and the NPV was 98.61% (95% CI, 97.36%–99.29%; Table 2; Figure 2).

The RAT had a sensitivity of 54.61% (77/141; 95% CI, 46.03%–62.94%), a specificity of 97.91% (704/719; 95% CI, 96.50%–98.78%), and an accuracy of 90.81% (781/860; 95% CI, 88.63%–92.62%). The consistency of RNA-LAMP assay and RT-PCR was analyzed and the kappa value was 0.611 (p < 0.001). Furthermore, the PPV and NPV of the RAT were 83.70% (95% CI, 74.21%–90.29%) and 91.67% (95% CI, 89.43%–93.48%), respectively (Table 2).

By employing different RT-PCR cut-off values, we analyzed the variations in sensitivity and specificity of both the LAMP assay and RAT. As shown in Figures 3A,B, the LAMP assay showed better performance in identifying both positive and negative ones, while the RAT showed relatively lower sensitivity and specificity values in the CT value range of 25–40. Additionally, direct LAMP assay achieved a similar sensitivity, regardless of whether the patient was symptomatic or not (71.64% vs. 70.27%, p = 0.941). Moreover, it was observed that, among both asymptomatic and symptomatic patients, direct LAMP assay represented a greater sensitivity than the RAT (asymptomatic patients: 71.64% vs. 56.72%, p = 0.013; symptomatic patients: 70.27% vs. 52.70%, p = 0.002). Direct LAMP assay also showed a higher specificity than the RAT (asymptomatic patients: 99.08% vs. 92.66%, p = 0.039; symptomatic patients: 100.00% vs. 94.74%, p = 0.016; Supplementary Table S2).

FIGURE 3
www.frontiersin.org

Figure 3. (A) The sensitivity of the RNA-LAMP assay, direct LAMP assay, and RAT with different RT-PCR cut-off values. (B) The specificity of the RNA-LAMP assay, direct LAMP assay, and RAT with different RT-PCR cut-off values.

Performance of the LAMP assay and RAT among specimens with different CT values

Moreover, we classified patients with positive RT-PCR results into four groups according to the CT value (Table 3). The probability of detection reflected the probability of the methods to identify the positive specimen, and it declined with an increase in CT value in both the LAMP assay and RAT. Among patients with CT values of 25–35, according to the RT-PCR test, the direct LAMP assay demonstrated a relatively better diagnostic performance than the RAT (25 ≤ CT < 30: 87.50% vs. 60.00%, p = 0.003; 30 ≤ CT < 35: 30.77% vs. 11.54%, p = 0.021). Moreover, the detection efficacy of RNA-LAMP was significantly higher than those of direct LAMP and RAT among patients with CT values of 30–35 (82.69% vs. 30.77%, p < 0.001; 82.69% vs. 11.54%, p < 0.001).

TABLE 3
www.frontiersin.org

Table 3. Positive detection rate of LAMP and RAT in patients with different CT value.

Effect of sampling time-point after disease onset on test sensitivity

In addition, we compared the detection effectiveness of the LAMP assay and RAT when identifying specimens collected within or over 7 days after the first positive RT-PCR results obtained from the patient. As shown in Figure 4, the direct LAMP assay provided a higher sensitivity when detecting the samples collected within 1 week from the first positive RT-PCR results, compared to those with positive results exceeding this period (86.84% vs. 50.82%, p = 0.053). Although the RAT also showed a higher sensitivity among patients in the early phase (≤7 days) than the late phase (>7 days; 72.37% vs. 32.79%, p = 0.011), it was relatively lower than that of direct LAMP (86.84% vs. 72.37%, p = 0.003; Table 4).

FIGURE 4
www.frontiersin.org

Figure 4. (A) The sensitivity of the RNA-LAMP assay among samples collected in different phases of COVID-19. (B) The sensitivity of the direct LAMP assay among samples collected in different phases of COVID-19. (C) The sensitivity of the RAT among samples collected in different phases of COVID-19.

TABLE 4
www.frontiersin.org

Table 4. Performance of LAMP and RAT at the indicated time of collection since first positive RT-qPCR results.

Combined use of the direct LAMP assay and RAT

In addition, we further combined the application of the direct LAMP assay and the RAT (defined as the joint method) to improve the detection sensitivity. According to the practical application, if one of these tests yielded a positive result, the individual should be considered as a suspected case of COVID-19. Therefore, we analyzed the sensitivity and the specificity of the joint method and found that the sensitivity was 73.76% (95% CI, 65.56%–80.64%), significantly higher than that of the RAT alone (73.76% vs. 54.61%, p < 0.001) and slightly higher than that of the direct LAMP assay alone (73.76% vs. 70.92%, p = 0.125). The specificity of the joint method was also high (97.77%; Figure 5).

FIGURE 5
www.frontiersin.org

Figure 5. Diagnostic performance of the RNA-LAMP assay, direct LAMP assay, RAT, and joint method.

Discussion

Several nucleic acid amplification approaches for diagnosis and monitoring of SARS-CoV-2 infections were developed in response to the COVID-19 pandemic. Molecular techniques, such as real-time PCR, are extremely sensitive and specific for detecting viral RNA and are currently recommended by the WHO for confirming diagnosis in symptomatic patients as well as for guiding public health decisions. However, local hospitals and clinics are bearing a heavy burden of detecting potential COVID-19 cases and treating patients. Therefore, integrated random-access, point-of-care molecular instruments for fast and accurate diagnosis of SARS-CoV-2 infections are urgently needed (Hou et al., 2020; Loeffelholz and Tang, 2021).

The data reported here describe the performance characteristics of the LAMP assay in detecting the nucleic acid of SARS-CoV-2, in both direct and RNA-extracted ways. We further performed a head-to-head comparison of the LAMP assay and RAT, considering practical use, and the results of this analysis included a relatively high sensitivity (direct LAMP, 70.92%; RNA-LAMP, 92.91%) and specificity (direct LAMP, 99.86%; RNA-LAMP, 98.33%) of the LAMP assay, especially using the extracted RNA, which was significantly better than the RAT in terms of sensitivity (54.61%), while the specificity remained similar (97.91%). According to a previous study, the direct LAMP assay was found to have a sensitivity of 67%, and the RNA-LAMP assay was reported to have a sensitivity of 97% in the detection of SARS-CoV-2, which are comparable to our results (Fowler et al., 2021). Furthermore, the direct LAMP assay was demonstrated to have a higher sensitivity than the RAT among both asymptomatic and symptomatic patients. The result approves the potential use of direct LAMP in rapid screening of both symptomatic and asymptomatic individuals, as previous studies have represented similar viral loads in asymptomatic and symptomatic patient groups (Arons et al., 2020; Kimball et al., 2020; Lavezzo et al., 2020; Cereda et al., 2021).

Although the RNA-LAMP assay showed a relatively higher sensitivity than the direct LAMP assay (92.91% vs. 70.92%, p < 0.001), RNA extraction is a significant rate-limiting step influencing COVID-19 diagnostic capacity. Consequently, despite a loss of sensitivity, the option to skip this step and test directly from a swab has significant benefits, including time and reagent savings and a more simplified methodology, reflecting the value of the application of the direct LAMP assay in the home environment or large-scale detection circumstances.

The performance of RATs for COVID-19 diagnosis has been intensively researched during the continuing COVID-19 pandemic (Khalid et al., 2022). In this head-to-head comparison between the direct LAMP assay and RAT, the LAMP assay demonstrated a higher sensitivity (70.92% vs. 54.61%, p < 0.001) and specificity (99.86% vs. 97.91%, p = 0.001) than the RAT. Earlier results are similar to the current findings: an in vitro experiment conducted by the Japanese government revealed that, compared to RT-PCR, RAT showed a sensitivity that varied from 50% to 66.7% (Nagura-Ikeda et al., 2020). A recent assessment of the literature, which included 16 trials, found that fast antigen testing for screening of asymptomatic persons can help reduce the spread of the disease (Loeffelholz and Tang, 2020; Walsh et al., 2022), suggesting the clinical application value of RATs. Considering that the direct LAMP assay has a higher sensitivity than RAT, we suppose that the LAMP assay could also play an important role in population screening. Furthermore, we combined the direct LAMP assay and RAT and found a sensitivity of 73.76%, higher than separate detecting by the LAMP assay or RAT. The result indicated the benefit of combining the two methods and providing a new application mode.

Besides, in this study, we demonstrated that the direct LAMP assay achieved a high positive rate (100%) in detection among patients with CT values <28. However, among COVID-19 patients with CT values of 30–35, the detection rate was relatively low (RNA-LAMP, 82.69%; direct LAMP, 30.77%). As RNA is a surrogate of live viral shedding, the results we found were in line with those of several previous studies, which reported that the virus cultivation was more viable when CT values were < 25, while the positive rate declined obviously when the CT values were > 30 (Bullard et al., 2020; Singanayagam et al., 2020; Sohn et al., 2020; Gniazdowski et al., 2021; Jaafar et al., 2021; Wölfl-Duchek et al., 2022). Previous publications have reported that it is unlikely that patients providing samples with high CT values pose a high risk of transmission (La Scola et al., 2020). Combining the results, we found that in the early phase (≤7 days) since the first positive RT-PCR test, the direct LAMP assay performed well in both sensitivity and accuracy. We could arbitrarily infer that the LAMP assay could exhibit high efficacy in detecting initially infected individuals who are highly contagious.

This study has several limitations. First, this study was conducted in a single center, which resulted in a limited sample size. Thus, the results cannot truly reflect the sensitivity and specificity of the LAMP assay among the population. Second, the samples were not collected by the patients themselves, thus importing bias, considering that, when patients collect samples themselves, the specimen may not contain sufficient viral RNA since the sampling site may not be deep enough. The LAMP assay performance on samples might vary according to the level of detectable RNA (as a surrogate of live viral shedding). Therefore, the sensitivity and specificity could be lower when the LAMP assay is put into practical use. To further quantify the effects of other factors influencing test sensitivity, standardization of clinical accuracy studies and access to patient-level CT values and duration of symptoms are needed.

Collectively, the LAMP assay showed relatively high sensitivity and specificity values and has a simple methodology with no requirement for additional equipment, requiring less time or expense than RT-PCR. Thus, we propose that the LAMP assay could complement the RT-PCR test when a higher sample throughput is required, especially in clinical settings with limited medical and human resources, because of its simplicity. Furthermore, the direct LAMP assay could be utilized as a point-of-care screening tool to quickly identify highly contagious individuals within a hospital or care unit or as a means for self-examination of home personnel during times of increased disease prevalence, and combining it with the RAT result could further increase the sensitivity. While ensuring that negative results should still be obtained through laboratory confirmation, LAMP could facilitate an immediate public health response, such as self-isolation or quarantine instructions, as well as rapid track-and-trace tools, benefiting surveillance programs aimed at limiting SARS-CoV-2 transmission in a community.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The studies involving human participants were reviewed and approved by Huashan Hospital Ethical Committee (2022-539). The patients/participants provided their written informed consent to participate in this study.

Author contributions

GC, JC, HZ, JA, and SW participated in the experiments, and GC provided with technical supports. KL analyzed the data and wrote the draft of the paper. GC and JA polish the draft. WZ, MG, SW, and JA conceived the experiments. YY, QL, XZ, JC, YZ, ZF, JS, HW, and GY participated in enrolling the volunteers and collected the basic and clinical information of the subjects. All authors contributed to the article and approved the submitted version.

Funding

This study was funded by research grants from the Shanghai Science and Technology Committee (20dz2210403, 20dz2260100, 20Z11901100, 21NL2600100, 20S31902700 and 21Y11900600), Shanghai Municipal Science and Technology Major Project (HS2021SHZX001), and National Natural Science Foundation of China (82041010).

Acknowledgments

We thank all participants in the study.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fmicb.2022.1063414/full#supplementary-material

References

Andersen, K. G., Rambaut, A., Lipkin, W. I., Holmes, E. C., and Garry, R. F. (2020). The proximal origin of SARS-CoV-2. Nat. Med. 26, 450–452. doi: 10.1038/s41591-020-0820-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Arons, M. M., Hatfield, K. M., Reddy, S. C., Kimball, A., James, A., Jacobs, J. R., et al. (2020). Presymptomatic SARS-CoV-2 infections and transmission in a skilled nursing facility. N. Engl. J. Med. 382, 2081–2090. doi: 10.1056/NEJMoa2008457

PubMed Abstract | CrossRef Full Text | Google Scholar

Baek, Y. H., Um, J., Antigua, K. J. C., Park, J.-H., Kim, Y., Oh, S., et al. (2020). Development of a reverse transcription-loop-mediated isothermal amplification as a rapid early-detection method for novel SARS-CoV-2. Emerg. Microbes Infect. 9, 998–1007. doi: 10.1080/22221751.2020.1756698

PubMed Abstract | CrossRef Full Text | Google Scholar

Bullard, J., Dust, K., Funk, D., Strong, J. E., Alexander, D., Garnett, L., et al. (2020). Predicting infectious severe acute respiratory syndrome coronavirus 2 from diagnostic samples. Clin. Infect. Dis. 71, 2663–2666. doi: 10.1093/cid/ciaa638

PubMed Abstract | CrossRef Full Text | Google Scholar

Cereda, D., Manica, M., Tirani, M., Rovida, F., Demicheli, V., Ajelli, M., et al. (2021). The early phase of the COVID-19 epidemic in Lombardy, Italy. Epidemics 37:100528. doi: 10.1016/j.epidem.2021.100528

PubMed Abstract | CrossRef Full Text | Google Scholar

Chen, H. W., Weissenberger, G., Atkins, E., Chao, C. C., Suputtamongkol, Y., and Ching, W. M. (2015). Highly sensitive loop-mediated isothermal amplification for the detection of Leptospira. Int. J. Bacteriol. 2015:147173. doi: 10.1155/2015/147173

PubMed Abstract | CrossRef Full Text | Google Scholar

Chotiwan, N., Brewster, C. D., Magalhaes, T., Weger-Lucarelli, J., Duggal, N. K., Ruckert, C., et al. (2017). Rapid and specific detection of Asian- and African-lineage Zika viruses. Sci. Transl. Med. 9:eaag0538. doi: 10.1126/scitranslmed.aag0538

PubMed Abstract | CrossRef Full Text | Google Scholar

Cucinotta, D., and Vanelli, M. (2020). WHO declares COVID-19 a pandemic. Acta Biomed 91, 157–160. doi: 10.23750/abm.v91i1.9397

PubMed Abstract | CrossRef Full Text | Google Scholar

Enosawa, M., Kageyama, S., Sawai, K., Watanabe, K., Notomi, T., Onoe, S., et al. (2003). Use of loop-mediated isothermal amplification of the IS900 sequence for rapid detection of cultured Mycobacterium avium subsp. paratuberculosis. J. Clin. Microbiol. 41, 4359–4365. doi: 10.1128/JCM.41.9.4359-4365.2003

PubMed Abstract | CrossRef Full Text | Google Scholar

FDA (2022). EUAs for coronavirus disease 2019 (COVID-19). Available via https://www.fda.gov/medical-devices/emergency-situations-medical-devices/emergency-use-authorizations-medical-devices (Accessed November 24, 2022).

Google Scholar

Fowler, V. L., Armson, B., Gonzales, J. L., Wise, E. L., Howson, E. L. A., Vincent-Mistiaen, Z., et al. (2021). A highly effective reverse-transcription loop-mediated isothermal amplification (RT-LAMP) assay for the rapid detection of SARS-CoV-2 infection. J. Infect. 82, 117–125. doi: 10.1016/j.jinf.2020.10.039

PubMed Abstract | CrossRef Full Text | Google Scholar

Gniazdowski, V., Paul Morris, C., Wohl, S., Mehoke, T., Ramakrishnan, S., Thielen, P., et al. (2021). Repeated coronavirus disease 2019 molecular testing: correlation of severe acute respiratory syndrome coronavirus 2 culture with molecular assays and cycle thresholds. Clin. Infect. Dis. 73, e860–e869. doi: 10.1093/cid/ciaa1616

PubMed Abstract | CrossRef Full Text | Google Scholar

Hou, H., Chen, J., Wang, Y., Lu, Y., Zhu, Y., Zhang, B., et al. (2020). Multicenter evaluation of the Cepheid Xpert Xpress SARS-CoV-2 assay for the detection of SARS-CoV-2 in oropharyngeal swab specimens. J. Clin. Microbiol. 58, e01288–e01220. doi: 10.1128/JCM.01288-20

CrossRef Full Text | Google Scholar

Jaafar, R., Aherfi, S., Wurtz, N., Grimaldier, C., Van Hoang, T., Colson, P., et al. (2021). Correlation between 3790 quantitative polymerase chain reaction-positives samples and positive cell cultures, including 1941 severe acute respiratory syndrome coronavirus 2 isolates. Clin. Infect. Dis. 72:e921. doi: 10.1093/cid/ciaa1491

PubMed Abstract | CrossRef Full Text | Google Scholar

Kashir, J., and Yaqinuddin, A. (2020). Loop mediated isothermal amplification (LAMP) assays as a rapid diagnostic for COVID-19. Med. Hypotheses 141:109786. doi: 10.1016/j.mehy.2020.109786

PubMed Abstract | CrossRef Full Text | Google Scholar

Khalid, M. F., Selvam, K., Jeffry, A. J. N., Salmi, M. F., Najib, M. A., Norhayati, M. N., et al. (2022). Performance of rapid antigen tests for COVID-19 diagnosis: a systematic review and meta-analysis. Diagnostics (Basel). 12:110. doi: 10.3390/diagnostics12010110

PubMed Abstract | CrossRef Full Text | Google Scholar

Kimball, A., Hatfield, K. M., Arons, M., James, A., Taylor, J., Spicer, K., et al. (2020). Asymptomatic and Presymptomatic SARS-CoV-2 infections in residents of a long-term care skilled nursing facility - King County, Washington, march 2020. MMWR Morb. Mortal. Wkly Rep. 69, 377–381. doi: 10.15585/mmwr.mm6913e1

PubMed Abstract | CrossRef Full Text | Google Scholar

Kitagawa, Y., Orihara, Y., Kawamura, R., Imai, K., Sakai, J., Tarumoto, N., et al. (2020). Evaluation of rapid diagnosis of novel coronavirus disease (COVID-19) using loop-mediated isothermal amplification. J. Clin. Virol. 129:104446. doi: 10.1016/j.jcv.2020.104446

PubMed Abstract | CrossRef Full Text | Google Scholar

Kitajima, H., Tamura, Y., Yoshida, H., Kinoshita, H., Katsuta, H., Matsui, C., et al. (2021). Clinical COVID-19 diagnostic methods: comparison of reverse transcription loop-mediated isothermal amplification (RT-LAMP) and quantitative RT-PCR (qRT-PCR). J. Clin. Virol. 139:104813. doi: 10.1016/j.jcv.2021.104813

PubMed Abstract | CrossRef Full Text | Google Scholar

Klein, S., Müller, T. G., Khalid, D., Sonntag-Buck, V., Heuser, A.-M., Glass, B., et al. (2020). SARS-CoV-2 RNA extraction using magnetic beads for rapid large-scale testing by RT-qPCR and RT-LAMP. Viruses 12:863. doi: 10.3390/v12080863

PubMed Abstract | CrossRef Full Text | Google Scholar

Kwallah, A., Inoue, S., Muigai, A. W., Kubo, T., Sang, R., Morita, K., et al. (2013). A real-time reverse transcription loop-mediated isothermal amplification assay for the rapid detection of yellow fever virus. J. Virol. Methods 193, 23–27. doi: 10.1016/j.jviromet.2013.05.004

PubMed Abstract | CrossRef Full Text | Google Scholar

La Scola, B., Le Bideau, M., Andreani, J., Hoang, V. T., Grimaldier, C., Colson, P., et al. (2020). Viral RNA load as determined by cell culture as a management tool for discharge of SARS-CoV-2 patients from infectious disease wards. Eur. J. Clin. Microbiol. Infect. Dis. 39, 1059–1061. doi: 10.1007/s10096-020-03913-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Lavezzo, E., Franchin, E., Ciavarella, C., Cuomo-Dannenburg, G., Barzon, L., Del Vecchio, C., et al. (2020). Suppression of a SARS-CoV-2 outbreak in the Italian municipality of Vo. Nature 584, 425–429. doi: 10.1038/s41586-020-2488-1

PubMed Abstract | CrossRef Full Text | Google Scholar

Lee, J. Y. H., Best, N., McAuley, J., Porter, J. L., Seemann, T., Schultz, M. B., et al. (2020). Validation of a single-step, single-tube reverse transcription loop-mediated isothermal amplification assay for rapid detection of SARS-CoV-2 RNA. J. Med. Microbiol. 69, 1169–1178. doi: 10.1099/jmm.0.001238

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, H., Wang, X., Liu, W., Wei, X., Lin, W., Li, E., et al. (2015). Survey and visual detection of Zaire ebolavirus in clinical samples targeting the nucleoprotein gene in Sierra Leone. Front. Microbiol. 6:1332. doi: 10.3389/fmicb.2015.01332

PubMed Abstract | CrossRef Full Text | Google Scholar

Loeffelholz, M. J., and Tang, Y. W. (2020). Laboratory diagnosis of emerging human coronavirus infections - the state of the art. Emerg. Microbes Infect. 9, 747–756. doi: 10.1080/22221751.2020.1745095

PubMed Abstract | CrossRef Full Text | Google Scholar

Loeffelholz, M. J., and Tang, Y. W. (2021). Detection of SARS-CoV-2&nbsp;at the point of care. Bioanalysis 13, 1213–1223. doi: 10.4155/bio-2021-0078

PubMed Abstract | CrossRef Full Text | Google Scholar

Nagura-Ikeda, M., Imai, K., Tabata, S., Miyoshi, K., Murahara, N., Mizuno, T., et al. (2020). Clinical evaluation of self-collected saliva by quantitative reverse transcription-PCR (RT-qPCR), direct RT-qPCR, reverse transcription-loop-mediated isothermal amplification, and a rapid antigen test to diagnose COVID-19. J. Clin. Microbiol. 58:e01438-20. doi: 10.1128/jcm.01438-20

PubMed Abstract | CrossRef Full Text | Google Scholar

Notomi, T., Okayama, H., Masubuchi, H., Yonekawa, T., Watanabe, K., Amino, N., et al. (2000). Loop-mediated isothermal amplification of DNA. Nucleic Acids Res. 28, 63e–663e. doi: 10.1093/nar/28.12.e63

PubMed Abstract | CrossRef Full Text | Google Scholar

Rödel, J., Egerer, R., Suleyman, A., Sommer-Schmid, B., Baier, M., Henke, A., et al. (2020). Use of the variplex™ SARS-CoV-2 RT-LAMP as a rapid molecular assay to complement RT-PCR for COVID-19 diagnosis. J. Clin. Virol. 132:104616. doi: 10.1016/j.jcv.2020.104616

PubMed Abstract | CrossRef Full Text | Google Scholar

Singanayagam, A., Patel, M., Charlett, A., Lopez Bernal, J., Saliba, V., Ellis, J., et al. (2020). Duration of infectiousness and correlation with RT-PCR cycle threshold values in cases of COVID-19, England, January to may 2020. Euro Surveill. 25:2001483. doi: 10.2807/1560-7917.Es.2020.25.32.2001483

PubMed Abstract | CrossRef Full Text | Google Scholar

Sohn, Y., Jeong, S. J., Chung, W. S., Hyun, J. H., Baek, Y. J., Cho, Y., et al. (2020). Assessing viral shedding and infectivity of asymptomatic or mildly symptomatic patients with COVID-19 in a later phase. J. Clin. Med. 9:2924. doi: 10.3390/jcm9092924

PubMed Abstract | CrossRef Full Text | Google Scholar

Tanner, N. A., Zhang, Y., and Evans, T. C. Jr. (2015). Visual detection of isothermal nucleic acid amplification using pH-sensitive dyes. BioTechniques 58, 59–68. doi: 10.2144/000114253

PubMed Abstract | CrossRef Full Text | Google Scholar

Walsh, K. A., Broderick, N., Ahern, S., Fawsitt, C. G., O'Brien, K. M., Carrigan, M., et al. (2022). Effectiveness of rapid antigen testing for screening of symptomatic individuals to limit the transmission of SARS-CoV-2: a rapid review. Rev. Med. Virol. 32:e2350. doi: 10.1002/rmv.2350

CrossRef Full Text | Google Scholar

WHO (2022). WHO coronavirus (COVID-19) dashboard [online]. Available at: https://covid19.who.int (Accessed June 17, 2022).

Google Scholar

Wölfl-Duchek, M., Bergmann, F., Jorda, A., Weber, M., Müller, M., Seitz, T., et al. (2022). Sensitivity and specificity of SARS-CoV-2 rapid antigen detection tests using Oral, anterior nasal, and nasopharyngeal swabs: a diagnostic accuracy study. Microbiol. Spectr. 10:e0202921. doi: 10.1128/spectrum.02029-21

PubMed Abstract | CrossRef Full Text | Google Scholar

Yamayoshi, S., Sakai-Tagawa, Y., Koga, M., Akasaka, O., Nakachi, I., Koh, H., et al. (2020). Comparison of rapid antigen tests for COVID-19. Viruses 12:1420. doi: 10.3390/v12121420

PubMed Abstract | CrossRef Full Text | Google Scholar

Yan, C., Cui, J., Huang, L., Du, B., Chen, L., Xue, G., et al. (2020). Rapid and visual detection of 2019 novel coronavirus (SARS-CoV-2) by a reverse transcription loop-mediated isothermal amplification assay. Clin. Microbiol. Infect. 26, 773–779. doi: 10.1016/j.cmi.2020.04.001

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: SARS-CoV-2, COVID-19, LAMP assay, rapid antigen test, diagnostic accuracy

Citation: Cao G, Lin K, Ai J, Cai J, Zhang H, Yu Y, Liu Q, Zhang X, Zhang Y, Fu Z, Song J, Wang H, Yuan G, Wang S, Guan M and Zhang W (2022) A diagnostic accuracy study comparing RNA LAMP, direct LAMP, and rapid antigen testing from nasopharyngeal swabs. Front. Microbiol. 13:1063414. doi: 10.3389/fmicb.2022.1063414

Received: 10 October 2022; Accepted: 28 November 2022;
Published: 22 December 2022.

Edited by:

Maria Alejandra Mussi, Consejo Nacional de Investigaciones Científicas y Técnicas, Argentina

Reviewed by:

Melis Anahtar, Harvard Medical School, United States
Oliver Schildgen, Kliniken der Stadt Köln, Germany

Copyright © 2022 Cao, Lin, Ai, Cai, Zhang, Yu, Liu, Zhang, Zhang, Fu, Song, Wang, Yuan, Wang, Guan and Zhang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Sen Wang, c2VuLndhbmdAbm1jaWQub3JnLmNu; Ming Guan, Z3Vhbm1pbmc4OEB5YWhvby5jb20=; Wenhong Zhang, d2VuaG9uZ3poYW5nX2hzQDEyNi5jb20=

These authors have contributed equally to this work and share first authorship

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.