- 1Department of Small Animal Medicine and Surgery, University of Veterinary Medicine Hannover, Hannover, Germany
- 2Research Center for Emerging Infections and Zoonoses, University of Veterinary Medicine Hannover, Hannover, Germany
- 3Department of Biochemistry, University of Veterinary Medicine Hannover, Hannover, Germany
- 4KynoScience Unternehmergesellschaft, Hörstel, Germany
- 5Department of Respiratory Medicine, Hannover Medical School, Hannover, Germany
- 6Hannover Medical School, Hannover, Germany
- 7Hannover Unified Biobank, Hannover Medical School, Hannover, Germany
- 8Department of Medicine, Division of Infectious Diseases, University Medical-Center Hamburg-Eppendorf, Hamburg, Germany
- 9Department for Clinical Immunology of Infectious Diseases, Bernhard Nocht Institute for Tropical Medicine, Hamburg, Germany
- 10German Center for Infection Research, Hamburg-Lübeck- Borstel-Riems, Hamburg, Germany
- 11Center for Biological Threats and Special Pathogens (ZBS) 1, Highly Pathogenic Viruses, World Health Organisation Reference Laboratory for SARS-CoV-2 and World Health Organisation Collaborating Centre for Emerging Infections and Biological Threats, Robert Koch Institute, Berlin, Germany
- 12Bundeswehr Institute of Microbiology, Munich, Germany
- 13Max von Pettenkofer-Institute, Virology, Ludwig Maximilian University of Munich, Munich, Germany
- 14German Center for Infection Research, Munich, Germany
- 15Bundeswehr Medical Service Headquarters, Koblenz, Germany
- 16Military Medical Center, Fürstenfeldbruck, Germany
- 17Bundeswehr School of Dog Handling, Gräfin-Maltzan-Kaserne, Ulmen, Germany
Background: Testing of possibly infected individuals remains cornerstone of containing the spread of SARS-CoV-2. Detection dogs could contribute to mass screening. Previous research demonstrated canines' ability to detect SARS-CoV-2-infections but has not investigated if dogs can differentiate between COVID-19 and other virus infections.
Methods: Twelve dogs were trained to detect SARS-CoV-2 positive samples. Three test scenarios were performed to evaluate their ability to discriminate SARS-CoV-2-infections from viral infections of a different aetiology. Naso- and oropharyngeal swab samples from individuals and samples from cell culture both infected with one of 15 viruses that may cause COVID-19-like symptoms were presented as distractors in a randomised, double-blind study. Dogs were either trained with SARS-CoV-2 positive saliva samples (test scenario I and II) or with supernatant from cell cultures (test scenario III).
Results: When using swab samples from individuals infected with viruses other than SARS-CoV-2 as distractors (test scenario I), dogs detected swab samples from SARS-CoV-2-infected individuals with a mean diagnostic sensitivity of 73.8% (95% CI: 66.0–81.7%) and a specificity of 95.1% (95% CI: 92.6–97.7%). In test scenario II and III cell culture supernatant from cells infected with SARS-CoV-2, cells infected with other coronaviruses and non-infected cells were presented. Dogs achieved mean diagnostic sensitivities of 61.2% (95% CI: 50.7–71.6%, test scenario II) and 75.8% (95% CI: 53.0–98.5%, test scenario III), respectively. The diagnostic specificities were 90.9% (95% CI: 87.3–94.6%, test scenario II) and 90.2% (95% CI: 81.1–99.4%, test scenario III), respectively.
Conclusion: In all three test scenarios the mean specificities were above 90% which indicates that dogs can distinguish SARS-CoV-2-infections from other viral infections. However, compared to earlier studies our scent dogs achieved lower diagnostic sensitivities. To deploy COVID-19 detection dogs as a reliable screening method it is therefore mandatory to include a variety of samples from different viral respiratory tract infections in dog training to ensure a successful discrimination process.
Introduction
The ongoing coronavirus disease 2019 (COVID-19) pandemic caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) still affects the life of people all over the world and highlights the need of rapid point-of-care screening tests as a key tool to contain viral spread. The real-time quantitative reverse transcription polymerase chain reaction (rtRT-PCR) is considered the gold standard for diagnosing SARS-CoV-2 infections with high diagnostic accuracy (1), but requires laboratory infrastructure, is time-consuming and can be cost-prohibitive and therefore of limited use for rapid field diagnosis during mass screening in public places, during large events or at ports-of-entry. In these situations, rapid point-of-care antigen tests are used for screening of individuals. However, a recently performed meta-analysis of rapid antigen test application indicates high variability of diagnostic accuracy under real-life conditions, with up to half of asymptomatic patients being tested false negative (2). Medical scent detection dogs could provide an additional screening tool. Several studies have proven canines' extraordinary olfactory acuity to detect individuals with infectious and non-infectious diseases (3). For example, they are capable of detecting a variety of cancer types like lung and breast cancer (4) malaria (5) and bacterial infections caused by Clostridium difficile (6), Staphylococcus aureus (7), and other bacteria (8). Consequently, several research groups currently train and deploy SARS-CoV-2 detection dogs, recently summarised in a WHO blueprint (9).
In the first published pilot study, dogs were able to detect saliva samples from COVID-19 patients with a diagnostic sensitivity of 83% and specificity of 96% (10), which has now been confirmed by multiple studies with larger sample sets and using the same or different body fluids (sweat or urine) (11–16). Interestingly, dogs are able to transfer their learned scent detection from beta-propiolactone (BPL) inactivated to non-inactivated samples as well as to different body fluids, with comparable diagnostic accuracies indicating a global, specific SARS-CoV-2-associated volatile compound release across different body secretions, independently from the patient being symptomatic or not (17). A recent interesting medical canine scent detection study has used mathematical modelling based on a large cohort of samples from symptomatic and asymptomatic SARS-CoV-2-infections with a wide range of virus loads, represented by varying cycle threshold (Ct) values, to show that these values had a negligible impact on sensitivity compared to lateral flow tests (18). In another recent publication, Hag-Ali and colleagues stated that scent dogs achieved even better sensitivities than the gold standard rtRT-PCR (19). Canine detection is also extremely rapid. Guest et al. report that just two dogs could screen 300 people in 30 min (18). All these studies demonstrate that scent detection dogs can discriminate between samples of SARS-CoV-2-infected, and non-infected healthy individuals with a high level of accuracy and speed. Detection dogs therefore may provide a reliable, fast (2–4 s per sample) screening method for SARS-CoV-2 infections, especially in countries with a lack of access to high-tech screening methods or as a preliminary mass screening for infectious diseases. However, until now, none of the studies evaluated if canines could also distinguish between SARS-CoV-2-infections and infections caused by different human coronaviruses nor other viruses that cause similar symptoms like influenza virus, parainfluenza virus or human rhinovirus. This has been criticised by reviewers (10). Thus, there is an urgent need to test COVID-19 medical scent detection dogs against other respiratory infectious diseases.
A pathogen-specific odour is thought to be detected by dogs being composed of unique volatile organic compounds (VOCs). Laboratory identification of the specific VOC pattern is, however, still in its infancy and there is little published data on the creation of different odours by viral infections. Angle et al. trained dogs to detect cell cultures infected with bovine viral diarrhoea virus (BVDV) (20). After training, these dogs were not just able to discriminate the BVDV-infected cell culture against an uninfected cell culture but also to cell cultures infected by bovine herpes virus 1 (BHV-1) and bovine parainfluenza virus 3 (BPIV-3) achieving high sensitivities and specificities (20). Aksenov and colleagues analysed VOCs emitted from cell cultures infected by different influenza virus subtypes and found unique VOC patterns for each subtype (21). A recent study has analysed breath samples from individuals infected with SARS-CoV-2 or influenza A virus and found also in this experiment virus-specific VOC patterns (22). These studies highlight that not only different virus families but also subtypes within one family have a different odour and could probably be distinguished by scent dogs. The aim of the current study was therefore to demonstrate that medical scent detection dogs can discriminate SARS-CoV-2 infections from other common viral respiratory tract infections, including other coronaviruses.
Materials and Methods
Inactivated saliva samples from SARS-CoV-2-infected and healthy individuals as negative controls were used for training. The saliva samples were acquired and prepared as described in previous studies (10). In addition to the set-up of samples in our first study (10), which only included saliva and tracheobronchial secretion samples, the current study included diluted naso- and oropharyngeal swabs and supernatant from cell cultures infected with different respiratory viruses.
Clinical swab samples used in this study were obtained from routine diagnostics at the Robert Koch Institute (Berlin, Germany). For pooled SARS-CoV-2 samples, a mix of 20 naso- and oropharyngeal swabs from PCR confirmed SARS-CoV-2 patients were used, similar Ct values (<1.0 difference) were matched. A 1:3 dilution was performed using swab samples from healthy individuals in phosphate buffered saline (PBS) as a negative matrix. As sample medium, PBS was used for all samples. Furthermore, pooled samples from individuals infected with four different coronaviruses and nine other viruses causing respiratory infections in humans like influenza viruses and parainfluenza viruses were included (Table 1). All samples were tested negative via rtRT-PCR for all other viruses included. The status of each included sample was determined by rtRT-PCR (23, 24) at the Centre for Biological Threats and Special Pathogens, Highly Pathogenic Viruses (ZBS1), and Unit 17: Influenza and Other Respiratory Viruses, German National Influenza Centre RKI (Berlin, Germany).
Samples originating from cell culture were derived from the Bundeswehr Institute of Microbiology (Munich, Germany). Six different human coronaviruses were cultured in a human hepatocyte derived carcinoma cell line (HuH7.5 cells, see Table 1). Subconfluent to confluent monolayers of HuH7.5 cells were rinsed with serum-free medium and inoculated with SARS-CoV-1 strain “Frankfurt-1” (kindly provided by C. Drosten, Charité Berlin), SARS-CoV-2 strain “BavPat1/2020,” (Global Initiative on Sharing All Influenza Data acc. no. EPI_ISL_406862), Middle East respiratory syndrome-related coronavirus (MERS-CoV) strain “EMC” (kindly provided by Bart Haagmans, Erasmus Medical Center Rotterdam), human coronavirus 229E (HCoV-229E) (American Type Culture Collection (ATCC) acc. no. VR-740), HCoV-OC43 (ATCC acc. no. VR-1558) and HCoVNL63. A mock control was included and handled identically with serum-free medium as the inoculum. After incubation for 60 min, the inoculum was discarded, the monolayers were rinsed three times with serum-free medium before supplementing the cells with minimum essential medium (MEM) containing 2% foetal calf serum. Incubation was performed at 33°C, 5% CO2 and 90% humidity for HCoV-OC43 and -NL63 and at 37°C for the other coronaviruses. Supernatant of the cell cultures was harvested when infection of the monolayers reached 90–100% [assessed either by cytopathic effect or immunofluorescence signal against viral protein (data not shown)]. Supernatants were cleared from cellular debris by centrifugation at 5,000 xg for 10 min in an Eppendorf 5804 centrifuge. Cleared supernatants were inactivated as described in our first study (10). Inactivation success was assessed by lack of growth on Vero E6 cells for SARS-CoV-1, SARS-CoV-2, and MERS-CoV and inoculation of HuH7.5 cells for HCoV-229E, -NL63, and -OC43. Virus identity and culture success were further confirmed by quantitative RT-PCR (25). Inactivated supernatants were aliquoted and stored at −20°C for storage and at 4°C for subsequent use (Supplementary Table 1).
Based on former results showing that BPL inactivation does not change scent dog detection (17) and for easier and safer handling of samples, all samples for either training and testing were BPL inactivated as formerly described (10). Until usage, the samples were deep-frozen at −80°C. For training and testing, a volume of 100 μl per sample was pipetted onto a cotton swab which was placed into a 4 ml glass tube. All samples were handled by the same two persons wearing disposable gloves to prevent odour contamination.
In total, twelve dogs (four males and eight females) were included in our studies. All dogs completed obedience training before the study, and some had a history of scent detection or protection work. Ages ranged between 1 and 5 years. Included dog breeds were Labrador Retriever (n = 5), Malinois (n = 4), German Shepherd (n = 2) and Cocker Spaniel (n = 1) (Supplementary Table 2).
As described in our previous studies (10, 17) a device called “Detection Dog Training System” (DDTS, Kynoscience UG, Hörstel, Germany) was used for sample presentation and positive reinforcement during training and testing. The DDTS allows for rapid, automatic, randomised, trainer-bias devoid and double-blind sample presentation (10). To verify the recorded results of the DDTS the dogs were filmed during testing and the videos were analysed manually. The training method is based on classical and operant conditioning by using only positive reinforcement as previously described in Jendrny et al. (10, 17). In the present study, the training period lasted 3 days with a high number of sample presentations using inactivated positive saliva samples, or the supernatants of cell cultures infected by SARS-CoV-2 as positive samples. As control samples, negative saliva from healthy individuals (SARS-CoV-2 rtRT-PCR negative) or the supernatant of a non-infected cell culture were utilised. Apart of the “green” dogs used in scenario III, all dogs completed previous training in 2020 for detection of saliva samples of SARS-CoV-2 infected individuals. They were still able to distinguish positive and negative samples even though they had not been trained with SARS-Cov-2 samples for 5 months. After training, the double-blind study was conducted on 2 days using cell cultures and pooled swab samples. In the test scenario I, SARS-CoV-2 positive naso- and oropharyngeal pooled swab samples were utilised as target odours. Distractors were swab samples from patients infected by other viruses causing respiratory tract infections including different coronaviruses (Table 1). In the following experiments (test scenario II and III) supernatant from cell cultures infected by several coronaviruses including SARS-CoV-2 and non-infected cell cultures was presented to evaluate if medical scent detection dogs could discriminate between SARS-CoV-2 infection and infection with other coronaviruses or negative controls.
Every nose dip into the DDTS' slots was evaluated with four possible options:
1. True positive (TP): the dog correctly indicates a SARS-CoV-2 positive sample
2. False negative (FN): the dog sniffs shortly at a SARS-CoV-2 positive sample but does not indicate it
3. True negative (TN): the dog sniffs shortly at a negative/distractor sample and correctly does not indicate it
4. False positive (FP): the dog incorrectly indicates a negative/distractor sample
For indicating a sample, the dogs rested with their snout in the respective device test slot (“freezing”). The indication time was recorded by the DDTS and after indicating the target sample the device automatically responded with a reward, i.e., food. Afterwards, the DDTS changed the positions of the presented samples without letting the dog or dog handler know the new positions of negative, distractor or positive samples. This allowed a double-blind sample presentation. In addition, all staff involved was positioned to prevent any interaction or influencing of the animals during the study.
The diagnostic sensitivity as well as diagnostic specificity, positive predictive values (PPV), and negative predictive values (NPV) were calculated according to Trevethan (26). PPV is defined as the probability that people with a positive screening test result indeed do have the condition of interest and was calculated as [true positive/(true positive + false positive)] ×100. NPV is defined as the probability that people with a negative screening test result do not have the condition of interest and was calculated [true negative/(false negative + true negative)] ×100. 95% confidence intervals (CIs) for sensitivity, specificity, PPV, and NPV were calculated with the hybrid Wilson/Brown method (27). Means of sensitivity, specificity, PPV, NPV, and accuracy with corresponding 95% CIs were also calculated per scenario. Two-tailed Fisher's exact test was used for analysis of the contingency tables; a P ≤ 0.05 was considered significant. All calculations were done with the Prism 9 software from GraphPad (La Jolla, CA, USA).
This study was carried out in accordance with the ethical requirements established by the Declaration of Helsinki. The study obtained ethical approval by the Berlin Chamber of Physicians (Eth 20/40) and was approved by the local Ethics Committee of Hannover Medical School (MHH) and Hamburg Medical Association for the University Medical-Center Hamburg-Eppendorf (UKE) (ethic consent number 9042_BO_K_2020 and PV7298, respectively). Written informed consent from all participants was obtained before sample collection. Animal work according to the study protocol and design was approved by the German Armed Forces.
Results
Three test scenarios were performed to address the aim of the study. In the first test scenario (scenario I), dogs who were trained with saliva samples discriminated between SARS-CoV-2 swab samples and swab samples from patients infected by other respiratory tract infection viruses (Table 1). The dogs achieved a mean sensitivity of 73.8% (95% CI: 66.0–81.7%) and a specificity of 95.1% (95% CI: 92.6–97.7%). In the following test scenario (scenario II) cell culture supernatants from cells infected by different coronaviruses or non-infected cells were comparatively presented to the dogs. Dogs were able to discriminate the SARS-CoV-2 supernatant from supernatants from other coronaviruses and non-infected controls with a mean sensitivity of 61.2% (95% CI: 50.7–71.6%) and a specificity of 90.9% (95% CI: 87.3–94.6%). In the last test scenario (scenario III), not formerly trained (“green”) dogs were directly trained using the supernatant from cell cultures infected by SARS-CoV-2. The dogs achieved a mean sensitivity of 75.8% (95% CI: 53.0–98.5%) and a specificity of 90.2% (95% CI: 81.1–99.4%) (Table 2; Figure 1).
Figure 1. Mean diagnostic specificity and sensitivity for all dogs for swab samples with preceding saliva training (test scenario I: blue circle), cell culture samples with preceding saliva training (test scenario II: red triangle), and cell culture samples with preceding cell culture training (test scenario III: green square), respectively. The 95% confidence intervals for specificity and sensitivity are shown with horizontal and vertical lines, respectively.
Overall, a total of 2,054 sample presentations were performed in three different test scenarios. During the presentation of swab samples (test scenario I), 139 correct indications and 50 false rejections of SARS-CoV-2 positive swab samples were recorded, while 919 correct rejections and only 46 false indications of swab samples from the other 13 viruses were made. When the supernatants of the different cell cultures were presented to the dogs trained with saliva (test scenario II), they indicated 67 SARS-CoV-2 sample presentations correctly and rejected 43 positive samples incorrectly. They made 45 false positive responses to any one of three other coronaviruses or one non-infected control and 443 correct rejections. In comparison, dogs trained with cell cultures for 3 days (test scenario III) correctly identified 45 SARS-CoV-2 supernatants correctly but incorrectly rejected 16 positive samples, whereas 220 correctly negative and 26 false positive responses to the other seven cell culture samples (six different coronaviruses and one non-infected control) were made (Figure 2).
Figure 2. Overall number of indications per pathogen for each test scenario of scent dogs is shown as vertical bars: (A) test scenario I (swab samples with preceding saliva training), (B) test scenario II (cell culture samples with preceding saliva training), and (C) test scenario III (cell culture samples with preceding cell culture training). Pathogens are grouped on the x-axis according to their virus families and separated by vertical dotted lines. Coronaviridae: severe acute respiratory syndrome coronavirus 1 and 2 (SARS-CoV-1 and SARS-CoV-2), Middle East respiratory syndrome-related coronavirus (MERS-CoV), human coronavirus 229E (HCoV-229E), human coronavirus HKU1 (HCoV-HKU1), human coronavirus NL63 (HCoV-NL63), human coronavirus OC43 (HCoV-OC43). Orthomyxoviridae: influenza A virus subtype H1N1 (A/H1N1), influenza A virus subtype H3N2 (A/H3N2), influenza B virus subtype Yamagata (B/YAM). Paramyxoviridae: human parainfluenza virus type 1 (HPIV-1), human parainfluenza virus type 3 (HPIV-3). Pneumoviridae: human metapneumovirus (HMPV), respiratory syncytial virus (RSV).
Discussion
Rapid detection of SARS-CoV-2 infections remains one of the main strategies to control the current global pandemic. Several studies have shown that trained scent detection dogs can discriminate SARS-CoV-2-infected individuals from healthy individuals with high diagnostic accuracies. However, to use medical detection dogs, as a reliable diagnostic test, it is important to ensure their capability to distinguish between samples from SARS-CoV-2-infected people and other viral infections causing similar symptoms. In the current study, dogs were able to discriminate samples from SARS-CoV-2 infected individuals and cell cultures from those infected with one of 15 other common acute respiratory viruses as distractors.
During 964 presentations of swab samples from patients with different viral infections other than SARS-CoV-2 (test scenario I), the scent dogs alerted falsely to 46 samples, which led to a mean specificity of 95.1%. This specificity is comparable to our first pilot study by Jendrny et al. in which we only used samples from healthy, SARS-CoV-2 negative individuals without any respiratory symptoms as control samples and obtained a specificity of 96.35% (10). When using cell culture samples (test scenario II and III), the canines achieved mean specificities of 90.2% and 90.6%, respectively. Although the diagnostic specificities were found lower compared to our previous studies (10, 17), our results indicate that dogs can distinguish SARS-CoV-2 from other viral respiratory infections.
When presenting cell culture samples to dogs trained by saliva, the mean sensitivity was 61.2%, which is lower compared to sensitivities ranging from 82% to 95% in our previous studies (10, 17). The reduced performance in some dogs could be explained by not entirely identical VOC pattern that is released from cell culture supernatant compared to VOCs originating from saliva samples of the organism, the human body. In contrast to this observation, some of the dogs were able to directly transfer from saliva samples to supernatant samples. Possible explanations for this inconsistency might be that not every dog is conditioned to exactly the same VOC pattern or that individual dogs may not recognise identical VOC patterns. It is unknown which disease-specific VOCs are detected by the dogs and it is reasonable that the dogs learned slightly different VOC patterns as positive. Despite this, results from previous studies demonstrate that all dogs could be successfully trained to a disease-specific odour (10, 17). It would have been best if we had used saliva samples from individuals with different viral infections for testing. Unfortunately, this was not possible, as there were currently few infections with other respiratory viruses due to the high hygiene standards established during SARS-CoV-2 pandemic to prevent virus transmission and spread. Cell cultures provide the opportunity to generate odour samples independent of the availability of acute patients and it is possible to include samples of a wide range of different viruses, including other coronaviruses. Therefore, we decided to directly train five dogs with cell culture supernatant from human cells infected by SARS-CoV-2 instead of saliva and assess their diagnostic performance in a subsequent session. After just 3 days of training the mean sensitivity increased from 61.2% for the dogs trained with saliva samples to 75.8% for the five dogs trained with SARS-CoV-2 cell culture supernatant. A longer training period likely would have increased diagnostic accuracies (20).
The prevalence in our study was 17.5%. The high prevalence is a result of the fact that we presented one SARS-CoV-2 positive sample next to several samples from different viruses. In a pandemic, prevalences will vary and are usually significantly lower. When the prevalence falls below a certain threshold the dogs might get frustrated and stop searching for a positive sample. To ensure that scent dogs keep their diagnostic accuracies in case of a low prevalence and to have an internal control it is important to reward dogs during a test run not only for finding positive samples but also for not indicating wrongly negative samples. Furthermore, one has to ensure that the training entails an increasing number of empty runs (presentation of only negative samples). Dogs' frustrations levels should then be recorded and considered when working in the field, ensuring dogs will receive a sufficient number of rewards to keep them positively engaged in the field. A further limitation can be the dog handler. Not only the dog but also the dog's handler has an individual character, an individual training level and therefore require different training requirements. The DDTS can overcome some of these limitations, as dogs can be trained to work independently [Supplementary Video 1 and see Jendrny et al. (10)].
The prevalence of an infectious diseases is dynamic in a pandemic. As aforementioned the prevalence in our test paradigm was higher than in the current pandemic situation, which is further subject to change with an ever-increasing number of people getting vaccinated. The real positive predictive values would be with the current prevalence lower when sensitivity and specificity of dogs remain unchanged and the dogs would be deployed without a rewarding system. However, as in our test setting, a lower prevalence does not impact the performance of the dogs necessarily, as the frequency of getting rewarded is above the prevalence of the disease.
The disease-specific odour that can be detected by dogs is thought to be determined by a specific pattern of VOCs. VOCs are produced by cell metabolism and released with breath, urine, saliva, blood, faeces, sweat and other body fluids (28). In comparison to bacteria, viruses have no own metabolism, but the common hypothesis is that viruses can change the metabolism of the infected host cell and therefore determine a special VOC pattern (29). The composition of emitted VOCs in human body fluids are not only a result of non-infectious and infectious diseases but depend on a variety of factors such as age, sex, and diet (30). Every human, regardless of an infection, emits a variety of VOCs in a special pattern, which is called the human volatilome, and this pattern determines the unique body odour (28, 31). The usage of cell cultures provides the opportunity to exclude a lot of these influencing factors. Human samples contain a wide array of virus-independent VOCs and dogs need to seek out the disease-specific odour. When training with samples from individuals it is necessary to include a large number of human subjects to ensure that dogs are conditioned on the disease-specific odour. Training with SARS-CoV-2-infected cell cultures as the target odour and an equally treated, non-infected cell culture as negative control sample possibly simplifies the discrimination process for the dog between infected and non-infected samples. For our studies HuH7.5, a well differentiated cell line, was utilised to produce samples from different coronavirus infections and a non-infected cell culture as control. HuH7.5 cells were originally derived from a liver tumour in a 57-year-old Japanese male in 1982. HuH7.5 are particularly used for propagating the hepatitis C virus in vitro (32) and provided the opportunity to cultivate six different coronaviruses in the same human cellular background. For all cell culture samples the same serum-free medium and MEM containing 2% foetal calf serum were used to prevent odour interferences. Therefore, the odours of the cell culture samples were not affected by individual factors of the host like age, sex, diet or underlying medical conditions which are usually influencing odour samples. Consequently, the differences in the emitted VOCs between the infected cell culture samples are based on the specific coronavirus. However, cell culture samples do not take into account that during the infection a lot of changes occur in the infected organs and organism, like the complex mix of inflammatory reaction and cellular influx with specific se- and excretion and debris of dying cells. Obviously, this is not mimicked in a cell culture and may at least in part explain some of the discrepancies between swab sample and cell culture results. Consequently, when training for real-life deployment samples from infected individuals should be preferred. However, regardless the complex changes in VOC profile in infected individuals our cell culture results indicate that the VOCs created by infected cells are virus specific, which is why scent dogs can discriminate cells infected with different viruses. Furthermore, apart from scenting VOC patterns, dogs might also be capable of detecting directly viruses or viral proteins via their vomeronasal organ. The vomeronasal organ is capable of processing a wide variety of molecules, including proteins, thus representing a different and additional mechanism of odour perception (33, 34), which could explain dogs being able to discriminate specific viruses.
Several studies have evaluated the VOCs of viral infections (21, 35–37). It has been shown, that human tracheobronchial epithelial (TBE) cells infected with human rhinovirus (HRV) emit distinct VOCs compared to non-infected cells and cells inoculated with inactivated HRV (38). In a follow-up study, TBE cells were infected with HRV or influenza A virus subtype H1N1 (A/H1N1) with corresponding non-infected controls. Emitted VOCs were analysed via gas chromatography-mass spectrometry. Fifty-four unique VOCs were found distinguishing virus-infected from -uninfected cells. Forty of these VOCs were specific for A/H1N1-infected cells, but five occurred in A/H1N1- and HRV-VOC patterns (35). In addition, infections by different influenza A virus subtypes result in disparate VOC patterns (21). Current data from several studies suggest that SARS-CoV-2 infections create a specific VOC pattern which could be used in diagnostics (22, 37, 39, 40). Steppert et al. analysed exhaled breath from persons infected by SARS-CoV-2 or influenza A virus and healthy people via multi-capillary column-ion mobility spectrometry. They were able to discriminate between SARS-CoV-2, influenza A virus and controls in a few minutes which indicates that SARS-CoV-2 and influenza A virus infections can be distinguished by their differing VOC patterns (22). In summary, these data indicate that every viral infection creates its own specific VOC pattern and can therefore be discriminated.
Preliminary work on discriminating different viral infections by scent dogs was performed by Angle et al. (20). They used cell cultures infected with BVDV as the target sample and cell cultures infected with BHV-1 or BPIV-3 as distractors presented in a scent wheel with eight arms. After a training period of 2 months, the two dogs achieved sensitivities of 85% and 96.7% and specificities of 98.1% and 99.3% (20). These results indicate that trained dogs can discriminate different viral infections by their odour which is in accordance with our findings. A successful discrimination is fundamental in scent detection training, meaning to be able to differentiate the target odour from similar odours (41). The main aim of our study was to prove that dogs can discriminate different viral respiratory tract infections by their odour. In all three test scenarios our dogs achieved mean specificities above 90% which indicates their capability to distinguish SARS-CoV-2 infections from infections with other viruses. However, in contrast to earlier findings our scent dogs achieved lower diagnostic accuracies (10, 17). This discrepancy could be attributed to a more similar odour of SARS-CoV-2 infections to other viral infections than to non-infected individuals or cells. The similar odour of different viral infections probably resulted in a lack of discrimination and should be considered in subsequent training and testing. Our study clearly shows that it is mandatory to include other viruses in dog training to keep the diagnostic accuracy high. Our results indicate that presenting samples from different viral infections in the early training phase would improve the dogs' diagnostic skills and will support a successful discrimination process. This would ensure that scent dogs are conditioned to the unique smell of a SARS-CoV-2 infection and not to additional VOCs which are produced by several viral infections.
Conclusion
In the current situation rapid antigen tests are used for screening people for SARS-CoV-2 infections, which generate test results within 15 min. Manufacturers state sensitivities above 90% (42), but several studies determined significantly lower sensitivities with certain tests (2, 43). The WHO and the Paul Ehrlich Institute (PEI, Langen, Germany) recommend a sensitivity of ≥80% and a specificity of ≥97% for rapid antigen tests (44, 45). In real life settings while screening asymptomatic people, Dinnes et al. found a mean sensitivity of 58% (2). For their deployment as a reliable diagnostic test COVID-19 detection dogs should meet the criteria recommended by the WHO and national institution like PEI. Previous studies indicate that the scent dog method could meet these criteria (14, 17, 19). In several studies dogs showed their capability to distinguish SARS-CoV-2 positive samples from negative samples with high diagnostic accuracy regardless of training method or sample type (11, 12, 14–19). Our results demonstrate their ability to differentiate viral respiratory tract infections by their odour but suggest including a variety of viruses during dog training to guarantee a high diagnostic accuracy. Further research should be performed to validate dogs' scent recognition capabilities as diagnostic tool, especially in asymptomatic or pre-symptomatic patients, vaccinated or not, as infected individuals spread virus and could even be super-spreaders, as has been documented (46). Follow-up study in this category is needed by testing larger cohort of swabs from asymptomatic rtRT-PCR positive individuals.
Data Availability Statement
The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author.
Ethics Statement
The studies involving human participants were reviewed and approved by Berlin Chamber of Physicians (Eth 20/40) Hannover Medical School 9042_BO_K_2020 University Medical-Center Hamburg-Eppendorf PV7298. The patients/participants provided their written informed consent to participate in this study. The animal study was reviewed and approved by German Armed Forces.
Author Contributions
NH participated in the planning of the study, carried out the main practical work, data analyses, and helped draught the manuscript. FT, SM, PJ, and HV designed and coordinated the study, drafted the manuscript (FT), conducted and coordinated (FT) the sample acquisition, and were responsible for data analyses (SM). MK-B, CS, and AO participated in the planning of the laboratory part of the study and were in charge for the legal permission for sample processing. CS, RE, KZ, and RW carried out the laboratory work at the Research Center for Emerging Infections and Zoonoses (CS) and Bundeswehr Institute of Microbiology (RE, KZ, and RW) including sample preparation, virus inactivation, and RtRT-PCR. HE programmed the DDTS software and supported the dog training. IP, TW, MM, AF, and MA were in charge for the ethical approval, patient recruitment and sample collection (IP and AF) at Hannover Medical School (IP, TW, and MM), and University Medical-Center Hamburg-Eppendorf (AF and MA). ANi and AP coordinated the sample acquisition at the Robert Koch Institute. AP, JM, and EK performed the sample preparation including rtRT-PCR at the Robert Koch Institute. ANa and EP were responsible for coordinating the acquisition and data of samples as part of the support provided by the German armed forces. CE was responsible for the special research proposal of the German Armed Forces as project manager on the part of the German Armed Forces. ME coordinated the cooperation with the University of Veterinary Medicine Hannover. AB participated in the planning of the cultivation of the different coronaviruses and provided the HuH7.5 cells. ES was responsible for the dog training and helped with data analyses. ME and ES were also involved in designing and coordinating the study. All authors have read and approved the final manuscript.
Funding
The project was funded as a special research project of the German Armed Forces Medical Service (02Z9-S-852121) and supported by the COVID-19 Research Network of the State of Lower Saxony (COFONI) through funding from the Ministry of Science and Culture of Lower Saxony in Germany (14-76403-184).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
The handling editor is currently organizing a Research Topic with one of the authors HV.
Publisher's Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Acknowledgments
We would like to thank the members of the ID-UKE-COVID-19 Study Group (Amelie Alberti, MA, Etienne Bartels, Thomas T. Brehm, Christine Dahlke, Monika Friedrich, Svenja Hardtke, Till Koch, Ansgar W. Lohse, My L. Ly, Stefan Schmiedel, L. Marie Weskamm, Julian Schulze zur Wiesch) at the University Medical-Center Hamburg-Eppendorf by helping us with recruitment of patients and sample collection. We further would like to thank Robert Zacharz, Pascal Baum, Christian Mertel, Jannik Hofmann, and Dominik Horne for support at the University of Veterinary Medicine Hannover, Germany during dog training. Special thanks go to our doggy noses Lotta, Füge, Vine, Filou, Bellatrix, Margo, Erec Junior, Joe, Baila, Harry, Billy, and Peggy. We would also like to thank Rouwen Stucke, Christin Moelders, Veronika Pilchová, and Katharina Meyer for their support in the laboratory and Karin Lübbert for her technical assistance. Michael Mühlebach (Paul Ehrlich Institute, Langen, Germany) receives our gratitude for the swift support in acquiring SARS-CoV and MERS-CoV for the strain collection of the Bundeswehr Institute of Microbiology. Another thanks to Barbara Biere (RKI, Berlin, Germany) for providing swab samples from other respiratory virus than SARS-CoV-2 and PCR confirmation of samples. Heartfelt thanks go to all the people providing us with samples, especially to the SARS-CoV-2-infected persons and their relatives with the sincere intention to contribute to the containment of COVID-19 and to scientific progress. We wish you lots of strength and full recovery during the current pandemic.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fmed.2021.749588/full#supplementary-material
Supplementary Table 1. Characteristics of the samples used for the study.
Supplementary Video 1. Scent detection dog working with Detection Dog Training System (DDTS). The video shows the Malinois “Filou” during a detection session. At each detection run only one hole is presenting the target scent, in this case SARS-CoV-2 samples, with the other six holes presenting the distractors. The dog indicates a positive detection by remaining with the nose longer than 2 s in the hole. This will release a food reward, a beeping sound and will be recorded automatically. The device then rearranges the sample presentation automatically and randomly.
References
1. Goudouris ES. Laboratory diagnosis of COVID-19. J Pediatr. (2021) 97:7–12. doi: 10.1016/j.jped.2020.08.001
2. Dinnes J, Deeks JJ, Adriano A, Berhane S, Davenport C, Dittrich S, et al. Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection. Cochrane Database Syst Rev. (2021) 3:CD013705. doi: 10.1002/14651858.CD013705.pub2
3. Reeve C, Koivusalo M. Biomedical scent detection dogs: would they pass as a health technology? Pet Behav Sci. (2018) 6:1–6. doi: 10.21071/pbs.v0i6.10785
4. McCulloch M, Jezierski T, Broffman M, Hubbard A, Turner K, Janecki T. Diagnostic accuracy of canine scent detection in early- and late-stage lung and breast cancers. Integr Cancer Ther. (2006) 5:30–9. doi: 10.1177/1534735405285096
5. Guest C, Pinder M, Doggett M, Squires C, Affara M, Kandeh B, et al. Trained dogs identify people with malaria parasites by their odour. Lancet Infect Dis. (2019) 19:578–80. doi: 10.1016/S1473-3099(19)30220-8
6. Bomers MK, Van Agtmael MA, Luik H, Van Veen MC, Vandenbroucke-Grauls CMJE, Smulders YM. Using a dog's superior olfactory sensitivity to identify Clostridium difficile in stools and patients: proof of principle study. BMJ. (2012) 345:e7396. doi: 10.1136/bmj.e7396
7. Fischer-Tenhagen C, Theby V, Krömker V, Heuwieser W. Detecting Staphylococcus aureus in milk from dairy cows using sniffer dogs. J Dairy Sci. (2018) 101:4317–24. doi: 10.3168/jds.2017-14100
8. Maurer M, McCulloch M, Willey AM, Hirsch W, Dewey D. Detection of bacteriuria by canine olfaction. Open Forum Infect Dis. (2016) 3:ofw051. doi: 10.1093/ofid/ofw051
9. World Health Organization. WHO R&D Blueprint on COVID-19: Consultation on the Use of Trained Dogs for Screening COVID-19 Cases. (2021). Available online at: https://cdn.who.int/media/docs/default-source/blue-print/who-consultation-screening-dogs--8th-march-2021.pdf?sfvrsn=a0d8cbda_1&download=true (accessed July 12, 2021).
10. Jendrny P, Schulz C, Twele F, Meller S, Von Köckritz-Blickwede M, Osterhaus ADME, et al. Scent dog identification of samples from COVID-19 patients–a pilot study. BMC Infect Dis. (2020) 20:536. doi: 10.1186/s12879-020-05281-3
11. Grandjean D, Sarkis R, Lecoq-Julien C, Benard A, Roger V, Levesque E, et al. Can the detection dog alert on COVID-19 positive persons by sniffing axillary sweat samples? a proof-of-concept study. PLoS ONE. (2020) 15:e0243122. doi: 10.1371/journal.pone.0243122
12. Eskandari E, Ahmadi Marzaleh M, Roudgari H, Hamidi Farahani R, Nezami-Asl A, Laripour R, et al. Sniffer dogs as a screening/diagnostic tool for COVID-19: a proof of concept study. BMC Infect Dis. (2021) 21:243. doi: 10.1186/s12879-021-05939-6
13. Essler JL, Kane SA, Nolan P, Akaho EH, Berna AZ, DeAngelo A, et al. Discrimination of SARS-CoV-2 infected patient samples by detection dogs: a proof of concept study. PLoS ONE. (2021) 16:e0250158. doi: 10.1371/journal.pone.0250158
14. Sarkis R, Lichaa A, Mjaess G, Saliba M, Selman C, Lecoq-Julien C, et al. New method of screening for COVID-19 disease using sniffer dogs and scents from axillary sweat samples. J Public Health. (2021) fdab215:1–6. doi: 10.1093/pubmed/fdab215
15. Mendel J, Frank K, Edlin L, Hall K, Webb D, Mills J, et al. Preliminary accuracy of COVID-19 odor detection by canines and HS-SPME-GC-MS using exhaled breath samples. Forensic Sci Int Synerg. (2021) 3:100155. doi: 10.1016/j.fsisyn.2021.100155
16. Vesga O, Agudelo M, Valencia-Jaramillo AF, Mira-Montoya A, Ossa-Ospina F, Ocampo E, et al. Highly sensitive scent-detection of COVID-19 patients in vivo by trained dogs. PLoS One. (2021) 16:e0257474. doi: 10.1371/journal.pone.0257474
17. Jendrny P, Twele F, Meller S, Schulz C, Von Köckritz-Blickwede M, Osterhaus A. et al.Scent dog identification of SARS-CoV-2 infections in different body fluids. BMC Infect Dis. (2021) 21:707. doi: 10.1186/s12879-021-06411-1
18. Guest C, Dewhirst SY, Allen DJ, Aziz S, Baerenbold O, Bradley J, et al. Using Trained Dogs and Organic Semi-Conducting Sensors to Identify Asymptomatic and Mild SARS-CoV-2 Infections. (2021). Available online at: https://www.lshtm.ac.uk/media/49791 (accessed July 15, 2021).
19. Hag-Ali M, AlShamsi AS, Boeijen L, Mahmmod Y, Manzoor R, Rutten H, et al. The detection dogs test is more sensitive than real-time PCR in screening for SARS-CoV-2. Commun Biol. (2021) 4:686. doi: 10.1038/s42003-021-02232-9
20. Angle TC, Passler T, Waggoner PL, Fischer TD, Rogers B, Galik PK, et al. Real-time detection of a virus using detection dogs. Front Vet Sci. (2016) 2:79. doi: 10.3389/fvets.2015.00079
21. Aksenov AA, Sandrock CE, Zhao W, Sankaran S, Schivo M, Harper R, et al. Cellular scent of influenza virus infection. ChemBioChem. (2014) 15:1040–8. doi: 10.1002/cbic.201300695
22. Steppert C, Steppert I, Sterlacci W, Bollinger T. Rapid detection of SARS-CoV-2 infection by multicapillary column coupled ion mobility spectrometry (MCC-IMS) of breath. A proof of concept study. J Breath Res. (2021) 15:027105. doi: 10.1088/1752-7163/abe5ca
23. Michel J, Neumann M, Krause E, Rinner T, Muzeniek T, Grossegesse M, et al. Resource-efficient internally controlled in-house real-time PCR detection of SARS-CoV-2. Virol J. (2021) 18:110. doi: 10.1186/s12985-021-01559-3
24. Oh D-Y, Buda S, Biere B, Reiche J, Schlosser F, Duwe S, et al. Trends in respiratory virus circulation following COVID-19-targeted nonpharmaceutical interventions in Germany, January–September 2020: analysis of national surveillance data. Lancet Reg Health Eur. (2021) 6:100112. doi: 10.1016/j.lanepe.2021.100112
25. Garbino J, Gerbase MW, Wunderli W, Deffernez C, Thomas Y, Rochat T, et al. Lower respiratory viral illnesses: improved diagnosis by molecular methods and clinical impact. Am J Respir Crit Care Med. (2004) 170:1197–203. doi: 10.1164/rccm.200406-781OC
26. Trevethan R. Sensitivity, specificity, and predictive values: foundations, pliabilities, and pitfalls in research and practice. Front Public Heal. (2015) 5:307. doi: 10.3389/fpubh.2017.00307
27. Brown LD, Cai TT, Das Gupta A. Interval estimation for a binomial proportion. Statist Sci. (2001) 16:101–33. doi: 10.1214/ss/1009213286
28. Shirasu M, Touhara K. The scent of disease: volatile organic compounds of the human body related to disease and disorder. J Biochem. (2011) 150:257–66. doi: 10.1093/jb/mvr090
29. Gould O, Ratcliffe N, Król E, De Lacy Costello B. Breath analysis for detection of viral infection, the current position of the field. J Breath Res. (2020) 14:041001. doi: 10.1088/1752-7163/ab9c32
30. Buljubasic F, Buchbauer G. The scent of human diseases: a review on specific volatile organic compounds as diagnostic biomarkers. Flavour Fragr J. (2015) 30:5–25. doi: 10.1002/ffj.3219
31. Amann A, Costello BDL, Miekisch W, Schubert J, Buszewski B, Pleil J, et al. The human volatilome: volatile organic compounds (VOCs) in exhaled breath, skin emanations, urine, feces and saliva. J Breath Res. (2014) 8:034001. doi: 10.1088/1752-7155/8/3/034001
32. Blight KJ, McKeating JA, Rice CM. Highly permissive cell lines for subgenomic and genomic hepatitis C virus RNA replication. J Virol. (2002) 76:13001–14. doi: 10.1128/JVI.76.24.13001-13014.2002
33. Dennis JC, Allgier JG, Desouza LS, Eward WC, Morrison EE. Immunohistochemistry of the canine vomeronasal organ. J Anat. (2003) 203:329–38. doi: 10.1046/j.1469-7580.2003.00200.x-i1
34. Sam M, Vora S, Malnic B, Ma W, Novotny M V, Buck LB. Odorants may arouse, instinctive behaviours. Nature. (2001) 412:142. doi: 10.1038/35084137
35. McCartney MM, Linderholm AL, Yamaguchi MS, Falcon AK, Harper RW, Thompson GR, et al. Predicting influenza and rhinovirus infections in airway cells utilizing volatile emissions. J Infect Dis. (2021) jiab205. doi: 10.1093/infdis/jiab205
36. Traxler S, Barkowsky G, Saß R, Klemenz AC, Patenge N, Kreikemeyer B, et al. Volatile scents of influenza A and S. pyogenes (co-)infected cells. Sci Rep. (2019) 9:18894. doi: 10.1038/s41598-019-55334-0
37. Ruszkiewicz DM, Sanders D, O'Brien R, Hempel F, Reed MJ, Riepe AC, et al. Diagnosis of COVID-19 by analysis of breath with gas chromatography-ion mobility spectrometry–a feasibility study. EclinicalMedicine. (2020) 29–30:100609. doi: 10.1016/j.eclinm.2020.100609
38. Schivo M, Aksenov AA, Linderholm AL, McCartney MM, Simmons J, Harper RW, et al. Volatile emanations from in vitro airway cells infected with human rhinovirus. J Breath Res. (2015) 8:037110. doi: 10.1088/1752-7155/8/3/037110
39. Grassin-Delyle S, Roquencourt C, Moine P, Saffroy G, Carn S, Heming N, et al. Metabolomics of exhaled breath in critically ill COVID-19 patients: a pilot study. EBioMedicine. (2021) 63:103154. doi: 10.1016/j.ebiom.2020.103154
40. Wintjens AGWE, Hintzen KFH, Engelen SME, Lubbers T, Savelkoul PHM, Wesseling G, et al. Applying the electronic nose for pre-operative SARS-CoV-2 screening. Surg Endosc. (2020) 2:1–8. doi: 10.21203/rs.3.rs-91868/v1
41. Moser AY, Bizo L, Brown WY. Olfactory generalization in detector dogs. Animals. (2019) 9:702. doi: 10.3390/ani9090702
42. Federal Institute for Drugs and Medical Devices. List of Rapid Point-of-Care SARS-CoV-2 Tests. (2021). Available onine at: https://antigentest.bfarm.de/ords/f?p=110:100:370446203875:::::&tz=2:00 (accessed July 6, 2021).
43. Osterman A, Baldauf HM, Eletreby M, Wettengel JM, Afridi SQ, Fuchs T, et al. Evaluation of two rapid antigen tests to detect SARS-CoV-2 in a hospital setting. Med Microbiol Immunol. (2021) 210:65–72. doi: 10.1007/s00430-020-00698-8
44. World Health Organization. SARS-CoV-2 Antigen-Detecting Rapid Diagnostic Tests–An Implementation Guide. (2020). Available online at: https://www.who.int/publications/i/item/9789240017740 (accessed July 2, 2021).
45. Paul-Ehrlich-Institut. Minimum Criteria for Rapid SARS-CoV-2 Antigen Tests Pursuant to Section 1 para 1 Sentence 1 TestVO (Statutory Test Regulation): Rapid Antigen Tests. (2021). Available online at: https://www.pei.de/SharedDocs/Downloads/EN/newsroom-en/dossiers/minimum-criteria-for-rapid-sars-cov2-antigen-tests-01-12-2020.pdf?__blob=publicationFile&v=5 (accessed July 12, 2021).
Keywords: canine, volatile organic compound (VOC), COVID-19, screening test, coronavirus, SARS-CoV-2, scent detection dog
Citation: ten Hagen NA, Twele F, Meller S, Jendrny P, Schulz C, von Köckritz-Blickwede M, Osterhaus A, Ebbers H, Pink I, Welte T, Manns MP, Illig T, Fathi A, Addo MM, Nitsche A, Puyskens A, Michel J, Krause E, Ehmann R, von Brunn A, Ernst C, Zwirglmaier K, Wölfel R, Nau A, Philipp E, Engels M, Schalke E and Volk HA (2021) Discrimination of SARS-CoV-2 Infections From Other Viral Respiratory Infections by Scent Detection Dogs. Front. Med. 8:749588. doi: 10.3389/fmed.2021.749588
Received: 29 July 2021; Accepted: 25 October 2021;
Published: 18 November 2021.
Edited by:
Daniel Simeon–Dubach, Independent Researcher, Walchwil, SwitzerlandReviewed by:
Thiago DeSouza-Vieira, National Institute of Allergy and Infectious Diseases, National Institutes of Health (NIH), United StatesTimothy Kudinha, Charles Sturt University, Australia
Copyright © 2021 ten Hagen, Twele, Meller, Jendrny, Schulz, von Köckritz-Blickwede, Osterhaus, Ebbers, Pink, Welte, Manns, Illig, Fathi, Addo, Nitsche, Puyskens, Michel, Krause, Ehmann, von Brunn, Ernst, Zwirglmaier, Wölfel, Nau, Philipp, Engels, Schalke and Volk. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Holger Andreas Volk, aG9sZ2VyLnZvbGsmI3gwMDA0MDt0aWhvLWhhbm5vdmVyLmRl
†These authors have contributed equally to this work