Skip to main content

ORIGINAL RESEARCH article

Front. Vet. Sci., 31 August 2023
Sec. Veterinary Epidemiology and Economics

Beyond accuracy: leveraging ASSURED criteria for field evaluation of point-of-care tests for food animal diseases

Sylvester Ochwo
Sylvester Ochwo*Andres M. PerezAndres M. PerezMaría Sol Prez AguirreburualdeMaría Sol Pérez Aguirreburualde
  • Center for Animal Health and Food Safety, College of Veterinary Medicine, University of Minnesota, Saint Paul, MN, United States

The growing availability of point-of-care tests (POCTs) for food-animal diseases offers opportunities for timely diagnosis, facilitating the efficient implementation of control measures. However, field assessment of new POCTs are yet to be standardized. This paper discusses the opportunity of expanding the current approach for the evaluation and validation of POCTs in food animal disease diagnosis, highlighting the limitations of traditional practice that primarily relies on estimating diagnostic accuracy (sensitivity and specificity). Here, the use of a protocol referred to as FIT-REASSURED, a modified framework combining the ASSURED and REASSURED criteria, is proposed to comprehensively assess POCTs. FIT-REASSURED encompasses key criteria such as fitness for purpose, real-time connectivity, ease of specimen collection, affordability, sensitivity, specificity, user-friendliness, rapidity and robustness, equipment-free operation, and deliverability. By incorporating these attributes, FIT-REASSURED provides a customizable approach to assess the accuracy, affordability, and utility of POCTs. Through collaborative efforts among stakeholders, the implementation of a standardized scorecard based on these FIT-REASSURED criteria can improve the reliability and practicality of POCTs in food-animal health.

Introduction

Diagnostic tests are essential in both clinical and field settings. In clinical settings, these tests are used to determine the need for treatment or to make decisions regarding the appropriate level of treatment. In field settings, they are employed to assess the frequency of diseases, identify their causes, and often select animals for necessary actions like culling (1). These tests play a crucial role in enabling informed decisions on disease management (prevention and control), and the safe trade of animals and their products (2). Furthermore, in the context of notifiable diseases, these tests support the efforts of veterinary services in implementing national control plans by facilitating timely and confident decision-making when there is a suspicion of disease, and minimizing the transmission of diseases and their impact on animal populations and public health (3).

Traditionally, diagnostic testing is laboratory-based, often involves expensive equipment, and requires skilled personnel to operate. While laboratory-based testing is known for its reliability and accuracy, it faces cost, sample transportation, and result turnaround time challenges (46). In settings with limited access to veterinary services or in remote areas, conducting laboratory-based disease diagnosis becomes particularly difficult due to factors such as the unavailability of laboratory facilities, equipment and technical personnel; economic and logistical constraints associated with testing costs and sample transportation, as well as the need for timely decision-making. Consequently, point-of-care tests (POCTs) have emerged as a practical alternative in this kind of scenario, as they bring the appealing advantage of enabling on-site testing that can be performed by individuals with limited technical expertise, providing rapid results at a lower cost compared to laboratory tests (5).

Technology advancements, portable equipment versions and the availability of thermal stable reagents, primarily used in human POCTs, have further facilitated their adoption in veterinary diagnostics. Such progress, along with the growing global demand for animal products and the need to manage emerging and re-emerging animal diseases, has intensified the demand for POCTs in the veterinary sector. The market for POCTs in veterinary diagnostics is expected to be worth 5.6 billion US dollars by 2030, with a current growth rate of 12.3% (7). Demand for POCTs in food animals will account for about 40% of this expected market value (7).

However, as the demand for point-of-care testing in food animals continues to grow, it becomes crucial to establish harmonized guidelines and criteria to evaluate the suitability of commercially available POCTs for field use. This need becomes even more significant due to the fact that these tests are often administered by individuals with varying levels of expertise in diagnostic testing. Standardized guidelines are crucial in ensuring the effectiveness and reliability of these tests across different settings and user proficiency levels. Additionally, priorities for POCT operational needs, such as portability of equipment, power source, ease of use, availability of controls, and cost of the tests differ across settings. Therefore, the development of harmonized criteria would ensure the appropriate selection of POCTs for their specific purposes, improving their overall efficiency. Furthermore, these guidelines would serve as a valuable resource for diagnostic test manufacturers when designing and validating test device performance prior market release, and for official veterinary services when making informed decisions about suitable tests.

As a precedent, significant progress has been made in the development of guidelines for reporting the accuracy of diagnostic tests, such as the “Standards for Reporting of Diagnostic Accuracy Studies (STARD)” statement (8, 9). STARD aims to enhance the completeness and transparency in reporting diagnostic accuracy studies by, providing a standardized list of essential items. Discussions have also taken place regarding the adaptation of STARD for animal disease studies and use of a different instrument (QUADAS) for assessing methodological quality (10). Additionally, the “Standards for Reporting of Diagnostic Accuracy Studies that use Bayesian Latent Class Models (STARD-BLCM)” have been developed for situations where a reference standard is absent (11). These standardized checklists are valuable tools that focus on diagnostic accuracy and can be applied to report various infectious disease diagnostic test results, including laboratory tests and POCTs.

In this article, we propose using the ASSURED criteria (12, 13), which stands for Affordable, Sensitive, Specific, User-friendly, Rapid and Robust, Equipment-free, and Deliverable, as well as its modified version, REASSURED (14, 15), as comprehensive guidelines for assessing POCTs for infectious diseases of food animals. Originally recommended by the World Health Organization (WHO) (12), these criteria encompass attributes beyond diagnostic accuracy, offering a valuable opportunity for comprehensive evaluation of POCT attributes, through the integration with other valuable pre-existing tools such as STARD. This approach enhances the assessment, validation, and selection of suitable POCTs for specific epidemiological settings, thereby improving disease control and management strategies while enabling better resource utilization by procuring the most appropriate POCTs for their specific needs.

Why is it relevant to standardize and harmonize criteria for the assessment of POCTs operational performance for food animal diseases?

The increasing use of POCTs in food animals without proper assessment of their operational field performance raises concerns about their true ability to effectively deliver reliable diagnoses. The operational performance of a diagnostic test encompasses factors beyond accuracy alone, including precision, speed, ease of use, cost-effectiveness, robustness, and suitability for the intended purpose or specific context/population. Studies by Hobbs et al. (5) and Velayudhan and Naikare (16) have discussed these challenges extensively and highlighted issues such as inconsistent and unclear validation data from test manufacturers, limitations in field validation and evaluation studies, difficulties in validating tests for specific pathogens, and the lack of guidelines for ensuring quality control in veterinary POCTs.

As further evidence supporting the points mentioned above, when evaluating commercially available tests for African swine fever (ASF) and foot-and-mouth disease (FMD), two of the most significant transboundary animal diseases, it becomes apparent that the majority of these commercial tests have been primarily assessed under laboratory conditions (17) (Table 1).

TABLE 1
www.frontiersin.org

Table 1. List of commercially available POCTs for two of the world’s most important transboundary animal diseases, ASF and FMD.

The data presented in Table 1 reveals that although the current WOAH’s terrestrial manual incorporates criteria such as fitness for purpose, analytical and diagnostic accuracy, repeatability, and reproducibility in its guidelines for validating diagnostic tests (3, 12), there is a gap between these guidelines and their implementation in practice. Furthermore, reports in the WOAH journal emphasize the importance of attributes like ruggedness and robustness in validating POCTs (15, 16). This highlights the need for the development of an explicit framework for assessing the operational performance of POCTs in real-world settings. Such a framework would bridge the gap and ensure that the guidelines and considerations outlined by WOAH are effectively applied in practice to enhance the reliability and effectiveness of POCTs. Although the establishment of legislation for the use of POCTs falls within the purview of the veterinary authority in each member country rather than WOAH, employing standardized criteria to evaluate and validate the performance of POCTs under field conditions will greatly contribute to providing valuable data and evidence to guide decision-making and legislation development in countries where such regulatory frameworks are lacking.

The World Health Organization’s ASSURED criteria and its modifications

In 2002, the World Health Organization (WHO) and the Special Programme for Research and Training in Tropical Diseases (TDR) recognized the crucial importance of innovative, effective, and affordable diagnostic methods for sexually transmitted diseases in humans, especially in developing countries. A set of criteria known as ASSURED was established to outline the desired qualities for new POCTs. These criteria include affordability, sensitivity, specificity, user-friendliness, rapid and reliable performance, equipment-free operation, and deliverability to those in need (12). The ASSURED criteria have played a pivotal role in guiding the development, validation, and regulation of POCTs for human healthcare over the last two decades. However, with the advent of wireless technology and the realization that individuals without specialized training may be conducting these tests, a revised version of the criteria, known as REASSURED, has been proposed. This updated standard places a greater emphasis on facilitating uncomplicated sample collection and connectivity in real-time (14, 15).

While originally designed for POCTs in human health, the fundamental characteristics that led to the development of the ASSURED criteria - accessibility, affordability, and accuracy - are equally critical for point-of-care testing in animal health. Except for the unique idea of fitness for purpose, which addresses the special diagnostic requirements for animal health, particularly in farm or field settings, the core ideas are transferable across both domains.

Suggesting the use of fitness for purpose (FIT-REASSURED) criteria for POCTs for food animal diseases

We propose the use of FIT-REASSURED, an adapted framework that combines the concept of fitness for purpose with the REASSURED criteria, to assess performance suitability of POCTs for infectious food animal diseases. It offers a comprehensive and flexible framework for assessing the performance and usability of POCTs. In the following sections, we outline the attributes of FIT-REASSURED criteria as they pertain to animal health. To illustrate its application, we conducted a preliminary assessment of five commercially available POCTs for ASF using FIT-REASSURED criteria, highlighting their strengths and weaknesses in Table 2.

TABLE 2
www.frontiersin.org

Table 2. Assessment of commercial POCTs for ASF using the FIT-REASSURED framework, highlighting how each test meets the fitness for purpose criteria and the other attributes of the framework.

Fitness for purpose

The concept of fitness for purpose pertains to the validation of a test, ensuring its performance characteristics for a specific intended use and under well-defined conditions (29). WOAH has identified major purposes that encompass demonstrating disease freedom in animal populations, confirming the absence of infection or agents in individual animals or products for trade purposes, assessing the effectiveness of eradication policies, confirming the clinical diagnosis of suspected cases, estimating infection prevalence for risk analysis, and determining immune status after vaccination, among others (29, 30). However, it is crucial that test validation be conducted with a clear definition of the intended purpose. For instance, a specific purpose could be to detect antigens against the African Swine Fever (ASF) virus in domestic pig herds presenting with hemorrhagic fever following an outbreak in an ASF-free geographical area. The purpose in this example would be to ensure that a POCT is validated for the detection of active cases of ASF at the herd level. Such a test could have low diagnostic sensitivity but high specificity at the individual sample level, and still be used to achieve this purpose by selecting pigs with clinical signs of hemorrhagic fever and increasing the number of samples what would increase sensitivity of the test at herd level. However, it is crucial to recognize that this approach may not be appropriate in other scenarios, for example, for certifying the health status of individual animals in a quarantine station.

In accordance with the concept of fitness for purpose, establishing the cutoff for diagnostic sensitivity of a POCT used at the herd level involves considering the cost associated with failing to detect a positive case (false negative). Given the potential risk of further disease spread resulting from a false-negative result, the diagnostic sensitivity cutoff is determined to minimize the possibility of missing infected animals. This decision-making process takes into account the purpose of the test, as well as the trade-offs between accuracy, operational attributes, and costs. By carefully considering these factors, a selected POCT can effectively support disease prevention efforts.

Real-time connectivity

Is the capability of systems, networks, or devices to create and maintain continuous, immediate, and synchronized communication or data exchange. It would be desirable for a POCT device to connect with external devices or systems like mobile phones or data networks. This allows for the real-time transmission and exchange of test results, enabling long-distance remote monitoring and collaboration among veterinarians, researchers, regulatory bodies, and other relevant stakeholders.

Ease of specimen collection

The simplicity and convenience with which samples from animals may be obtained for diagnostic testing. Tests that require less invasive or non-invasive sampling techniques and are easy to conduct are highly desirable, particularly in farm or field environments where access to specialized equipment or trained personnel may be limited. For example, a test that utilizes saliva or oral fluids obtained from a rope hung in a pen is preferred over one that necessitates blood collection.

Affordability

Inexpensive and cost-effective POCTs must be easily available and feasible to use without causing financial strain. Affordable POCTs promote widespread use and improved disease detection and management, especially in resource-limited settings. This leads to better animal health outcomes and more effective disease control.

Sensitivity

The ability of a diagnostic test to correctly identify animals that are truly infected with a specific pathogen or disease. This relates to the accurate classification of animals as being diseased, lowering the possibility of sick animals going undetected and spreading disease.

Specificity

The ability of a diagnostic test to correctly identify animals that are truly free from a specific pathogen or disease. Specificity is a critical characteristic since it ensures that healthy animals are not mistakenly classified as infected, eliminating wasteful treatments and consequent interruptions of trade or animal movement.

User-friendliness

The test’s ease of use and intuitive design render it accessible to a wide range of users, including producers, para-veterinarians, and individuals without professional experience. Clear instructions, straightforward processes, and minimal steps ensure that users can confidently execute and interpret the test. The test process must be simple, necessitating minimal handling of samples or reagents and requiring no additional laboratory materials.

Rapidity and robustness

A rapid POCT offers quick turnaround, producing data in a short period, typically minutes to hours, enabling prompt decision-making and the implementation of suitable actions. A robust POCT is made to withstand difficult field conditions, changes in sample quality, and environmental variables without losing effectiveness (30).

Simplicity and environmental friendliness

Tests that do not rely little on complex laboratory equipment and take into account the effects of their use and the waste they generate on the environment. A POCT should not produce toxic waste in large quantities that can contaminate grazing grounds and water for humans and animals.

Deliverability to end-users

Making tests and reagents accessible to farmers, technicians, and veterinarians requires practical considerations like supply chain management, packaging, storage, and distribution networks. By addressing these factors, we can ensure that essential POCTs are readily available to those who need them.

Discussion and conclusion

The use of POCTs to support laboratory diagnosis of food animal diseases presents a great opportunity to strengthen disease prevention and control by increasing the accessibility to fast, cost-effective and reliable results. To fully leverage this opportunity, steps need to be taken to ensure that POCTs that reach the market are of the desired quality, enabling veterinary services to select the most appropriate tests for their needs. However, the challenge lies in the observation that approaches for validating diagnostic tests, including POCTs, primarily focus on laboratory-based assessment (29). This approach overlooks the impact of environmental factors in the field and other attributes (affordability, operational attributes) which affect test performance and usability. These factors significantly influence the diagnostic accuracy and usability of POCTs, making it unreliable to extrapolate test results validated in one setting to another. Furthermore, the trade-offs between diagnostic accuracy, operational attributes, and the associated costs vary in different scenarios or settings.

To address these challenges, initial suggestions have been made to assess attributes such as test robustness and ruggedness during field validation of POCTs. Furthermore, there has been a proposal to incorporate a specific stage in WOAH guidelines, which would focus on the field validation of POCTs (30, 31). In addition, the design of checklists and scorecards for evaluating POCTs and other diagnostic tests has already been suggested (32, 33). However, what is still missing is a comprehensive framework that can be integrated with existing initiatives such as STARD and STARD-BLCM. To bridge this gap, we propose the FIT-REASSURED framework. This framework aims to integrate ongoing efforts and establish a systematic approach for assessing the suitability of POCTs for food animal diseases. While STARD emphasizes methodological rigor and the reporting of diagnostic accuracy studies, FIT-REASSURED takes into account practical applicability factors alongside diagnostic accuracy.

For example, it is widely recognized that different animal populations infected with the same pathogen exhibit diverse epidemiological characteristics. This variation underscores the need for tailored approaches in disease management. While most POCTs for food animal diseases provide simple dichotomous results, there are also tests that offer more detailed quantitative or semi-quantitative assessments, providing a deeper understanding of disease status (16, 34, 35). The availability of continuous results presents a valuable opportunity for veterinary services to validate different cut-off values based on animal species and sample type, thereby improving specificity and accuracy in disease diagnosis and management. This further emphasizes the importance of integrating and promoting the application of harmonized guidelines, such as STARD, for reporting animal disease studies.

Using the FIT-REASSURED framework as a guideline, stakeholders involved in the development and implementation of POCTs could systematically assess and prioritize different attributes within each criterion of the framework, considering their impact on the performance of a POCT for a given purpose. As demonstrated in Table 2, documenting this information allows for a reduction of the number of POCTs to be validated, streamlining the overall evaluation process. However, it is important to note that the necessary information to make informed decisions is currently partially available in the inserts and protocols. The systematic implementation of the FIT-REASSURED framework aims to address this gap and make it a goal for POCT kit manufacturers to comprehensively provide this information in the future.

The application of the FIT-REASSURED framework to assess ASF POCTs shown in Table 2 proved helpful in identifying the strengths and weaknesses of each test. Common positive aspects across all the POCTs evaluated were their ability to offer rapid results and the requirement for minimal training of users. The major challenges identified were the need for field evaluation of the tests for a predetermined purpose; all the POCTs required blood as a sample, which requires a trained person for proper sample collection; and the need for cold storage of reagents, which may affect the test’s robustness and deliverability.

Moving forward, once the fitness for purpose has been established and a shortlist of POCTs has been created, it is crucial to prioritize and weigh the remaining REASSURED attributes based on user needs. Engaging experts in diagnostics and epidemiology is essential to effectively assessing the relative importance of these attributes in the context of POCTs. Expert elicitation tools can be utilized to gather insights and opinions, allowing decision-makers to derive weights for each attribute based on their perceived significance. This process enables informed prioritization of attributes that align with the specific needs and requirements of the diagnostic tool.

We anticipate collaboration among various stakeholders, including researchers, regulatory organizations, veterinary services, and test manufacturers, to drive the advancement of FIT-REASSURED. Researchers will contribute to developing and testing tools for ranking and scoring the attributes of FIT-REASSURED, while incorporating Bayesian Latent Class models to measure diagnostic accuracy (36) and test repeatability. Economic studies will assess cost–benefit analysis and compare POCTs with laboratory tests to evaluate cost-effectiveness. Regulatory bodies will review the data generated by researchers and test manufacturers to develop appropriate guidelines for the use of POCTs. Manufacturers should consider FIT-REASSURED attributes when developing new POCTs to ensure desired quality standards are met. Veterinary services can utilize the framework to select and assess the suitability of commercially available POCTs, fostering collaboration and driving improvement. Collectively, these efforts will enhance the reliability and practicality of POCTs in managing food animal diseases.1

Data availability statement

The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author/s.

Author contributions

SO conceptualized the idea for this perspective article, reviewed the available literature, and drafted the manuscript. AP and MA refined the idea, reviewed, and edited the manuscript. All authors contributed to the article and approved the final version for submission.

Funding

This study was funded by the United States Department of Agriculture-Animal and Plant Health Inspection Service (USDA APHIS) through a grant (grant number AP22VSD&B000C028) for “Improving national capacity for early detection of foreign animal disease incursions: critical evaluation of field accuracy, standard of procedures, risks, challenges, and opportunities for the implementation of point of care platforms for National Animal Health Laboratory Network (NAHLN).”

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Footnotes

1. ^K. Inui, C. Gallardo, R. Portugal, L. Dixon, C. Baton, D. Williams, et al., The OIE ASF Reference Laboratory Network’s overview of African swine fever diagnostic tests for field application.

References

1. Smith, RD. Veterinary clinical epidemiology. 3rd ed. Boca Raton: CRC Press (2005). 280 p.

Google Scholar

2. Railey, AF, and Marsh, TL. Economic benefits of diagnostic testing in livestock: Anaplasmosis in cattle. Front Vet Sci. (2021) 8:626420. doi: 10.3389/fvets.2021.626420

CrossRef Full Text | Google Scholar

3. Schmitt, BJ. Veterinary diagnostic laboratories and their support role for veterinary services. Rev Sci Tech. (2003) 22:533–6. doi: 10.20506/rst.22.2.1418

CrossRef Full Text | Google Scholar

4. Inui, K, Nguyen, T, Tseng, HJ, Tsai, CM, Tsai, YL, Chung, S, et al. A field-deployable insulated isothermal RT-PCR assay for identification of influenza a (H7N9) shows good performance in the laboratory. Influenza Other Respir Viruses. (2019) 13:610–7. doi: 10.1111/irv.12646

CrossRef Full Text | Google Scholar

5. Hobbs, EC, Colling, A, Gurung, RB, and Allen, J. The potential of diagnostic point-of-care tests (POCTs) for infectious and zoonotic animal diseases in developing countries: technical, regulatory and sociocultural considerations. Transbound Emerg Dis. (2021) 68:1835–49. doi: 10.1111/tbed.13880

CrossRef Full Text | Google Scholar

6. Manessis, G, Gelasakis, AI, and Bossis, I. Point-of-care diagnostics for farm animal diseases: from biosensors to integrated lab-on-Chip devices. Biosensors. (2022) 12:455. doi: 10.3390/bios12070455

CrossRef Full Text | Google Scholar

7. BioSpace. Veterinary point of care diagnostics market to witness growth 12.3% by 2030. (2022). Available at: https://www.biospace.com/article/veterinary-point-of-care-diagnostics-market-to-witness-growth-12-3-percent-by-2030/ (Accessed May 18, 2023).

Google Scholar

8. Bossuyt, PM, Reitsma, JB, Bruns, DE, Gatsonis, CA, Glasziou, PP, Irwig, LM, et al. The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. Ann Intern Med. (2003) 138:W1–W12. doi: 10.7326/0003-4819-138-1-200301070-00012-w1

CrossRef Full Text | Google Scholar

9. Bossuyt, PM, Reitsma, JB, Bruns, DE, Gatsonis, CA, Glasziou, PP, Irwig, L, et al. STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies. Radiology. (2015) 277:826–32. doi: 10.1148/radiol.2015151516

CrossRef Full Text | Google Scholar

10. Gardner, IA. Quality standards are needed for reporting of test accuracy studies for animal diseases. Prev Vet Med. (2010) 97:136–43. doi: 10.1016/j.prevetmed.2010.09.009

CrossRef Full Text | Google Scholar

11. Kostoulas, P, Nielsen, SS, Branscum, AJ, Johnson, WO, Dendukuri, N, Dhand, NK, et al. STARD-BLCM: standards for the reporting of diagnostic accuracy studies that use Bayesian latent class models. Prev Vet Med. (2017) 138:37–47. doi: 10.1016/j.prevetmed.2017.01.006

CrossRef Full Text | Google Scholar

12. Kettler, H, White, K, and Hawkes, SJ, Diseases UBSP for R and T in Mapping the landscape of diagnostics for sexually transmitted infections: key findings and recommendations World Health Organization; (2004). Report No.: TDR/STI/IDE/04.1. Available at: https://apps.who.int/iris/handle/10665/68990 (Accessed May 18, 2023).

Google Scholar

13. Naseri, M, Ziora, ZM, Simon, GP, and Batchelor, W. ASSURED-compliant point-of-care diagnostics for the detection of human viral infections. Rev Med Virol. (2022) 32:e2263. doi: 10.1002/rmv.2263

CrossRef Full Text | Google Scholar

14. Land, KJ, Boeras, DI, Chen, XS, Ramsay, AR, and Peeling, RW. REASSURED diagnostics to inform disease control strategies, strengthen health systems and improve patient outcomes. Nat Microbiol. (2018) 4:46–54. doi: 10.1038/s41564-018-0295-3

CrossRef Full Text | Google Scholar

15. Otoo, JA, and Schlappi, TS. REASSURED multiplex diagnostics: a critical review and forecast. Biosensors. (2022) 12:124. doi: 10.3390/bios12020124

CrossRef Full Text | Google Scholar

16. Velayudhan, BT, and Naikare, HK. Point-of-care testing in companion and food animal disease diagnostics. Front Vet Sci. (2022) 9:1056440. doi: 10.3389/fvets.2022.1056440

CrossRef Full Text | Google Scholar

17. FAO-OIE. “Global framework for the progressive control of transboundary animal diseases,” in Priority Diseases at Global and Regional Levels. (2023) [cited 2023 Aug 22]. Available from: https://www.gf-tads.org/about/priority-diseases/en/

Google Scholar

18. Cavalera, S, Colitti, B, de Mia, GM, Feliziani, F, Giudici, SD, Angioi, PP, et al. Development of molecular and antigenic-based rapid tests for the identification of African swine fever virus in different tissues. Talanta. (2023) 258:124443. doi: 10.1016/j.talanta.2023.124443

CrossRef Full Text | Google Scholar

19. Sastre, P, Gallardo, C, Monedero, A, Ruiz, T, Arias, M, Sanz, A, et al. Development of a novel lateral flow assay for detection of African swine fever in blood. BMC Vet Res. (2016) 12:271–286. doi: 10.1186/s12917-016-0831-4

CrossRef Full Text | Google Scholar

20. Matsumoto, N, Siengsanan-Lamont, J, Gleeson, LJ, Douangngeun, B, Theppangna, W, Khounsy, S, et al. Evaluation of the diagnostic accuracy of an affordable rapid diagnostic test for African swine fever antigen detection in Lao People’s Democratic Republic. J Virol Methods. (2020) 286:113975. doi: 10.1016/j.jviromet.2020.113975

CrossRef Full Text | Google Scholar

21. Sastre, P, Pérez, T, Costa, S, Yang, X, Räber, A, Blome, S, et al. Development of a duplex lateral flow assay for simultaneous detection of antibodies against African and classical swine fever viruses. J Vet Diagn Investig. (2016) 28:543–9. doi: 10.1177/1040638716654942

CrossRef Full Text | Google Scholar

22. Cappai, S, Loi, F, Coccollone, A, Cocco, M, Falconi, C, Dettori, G, et al. Evaluation of a commercial field test to detect African swine fever. J Wildl Dis. (2017) 53:602–6. doi: 10.7589/2016-05-112

CrossRef Full Text | Google Scholar

23. Daigle, J, Onyilagha, C, Truong, T, Le, VP, Nga, BTT, Nguyen, TL, et al. Rapid and highly sensitive portable detection of African swine fever virus. Transbounding Emerging Dis. (2021) 68:952–9. doi: 10.1111/tbed.13770

CrossRef Full Text | Google Scholar

24. Liu, L, Atim, S, LeBlanc, N, Rauh, R, Esau, M, Chenais, E, et al. Overcoming the challenges of pen-side molecular diagnosis of African swine fever to support outbreak investigations under field conditions. Transbound Emerg Dis. (2019) 66:908–14. doi: 10.1111/tbed.13103

CrossRef Full Text | Google Scholar

25. Mee, PT, Wong, S, O’Riley, KJ, da Conceição, F, Bendita da Costa Jong, J, Phillips, DE, et al. Field verification of an African swine fever virus loop-mediated isothermal amplification (LAMP) assay during an outbreak in Timor-Leste. Viruses. (2020) 12:1444. doi: 10.3390/v12121444

CrossRef Full Text | Google Scholar

26. Tran, HNT, Le, NCT, Pham, BP, Luu, VQ, and Nguyen, VL. Evaluation of an automated insulated isothermal polymerase chain reaction system for rapid and reliable, on-site detection of African swine fever virus. Javma. (2021) 259:662–8. doi: 10.2460/javma.259.6.662

CrossRef Full Text | Google Scholar

27. Howson, ELA, Armson, B, Lyons, NA, Chepkwony, E, Kasanga, CJ, Kandusi, S, et al. Direct detection and characterization of foot-and-mouth disease virus in East Africa using a field-ready real-time PCR platform. Transbound Emerg Dis. (2018) 65:221–31. doi: 10.1111/tbed.12684

CrossRef Full Text | Google Scholar

28. Ferris, NP, Nordengrahn, A, Hutchings, GH, Paton, DJ, Kristersson, T, Brocchi, E, et al. Development and laboratory validation of a lateral flow device for the detection of serotype SAT 2 foot-and-mouth disease viruses in clinical samples. J Virol Methods. (2010) 163:474–6. doi: 10.1016/j.jviromet.2009.09.022

CrossRef Full Text | Google Scholar

29. World Organisation for Animal Health (OIE). Principles and methods of validation of diagnostic assays for infectious diseases. Chapter 1.1.6. In manual of diagnostic tests and vaccines for terrestrial animals. 8th ed. Paris, France: OIE (2018).

Google Scholar

30. Gardner, IA, Colling, A, Caraguel, C, Crowther, JR, Jones, G, Firestone, SM, et al. Introduction – validation of tests for OIE-listed diseases as fit-for-purpose in a world of evolving diagnostic technologies. Rev Sci Tech OIE. (2021) 40, 173–188. doi: 10.20506/rst.40.1.3207

CrossRef Full Text | Google Scholar

31. Halpin, K, Tribolet, L, Hobbs, E, and Singanallur, NB. Perspectives and challenges in validating new diagnostic technologies. Rev Sci Tech OIE. (2021) 40. doi: 10.20506/rst.40.1.3214

CrossRef Full Text | Google Scholar

32. Huddy, JR, Ni, M, Misra, S, Mavroveli, S, Barlow, J, and Hanna, GB. Development of the point-of-care key evidence tool (POCKET): a checklist for multi-dimensional evidence generation in point-of-care tests. Clinical Chemistry and Laboratory Medicine. (2019) 57:845–55. doi: 10.1515/cclm-2018-1089

CrossRef Full Text | Google Scholar

33. Lehe, JD, Sitoe, NE, Tobaiwa, O, Loquiha, O, Quevedo, JI, Peter, TF, et al. Evaluating operational specifications of point-of-care diagnostic tests: a standardized scorecard. Gray CM, editor. PLoS One. (2012) 7:e47459. doi: 10.1371/journal.pone.0047459

CrossRef Full Text | Google Scholar

34. Delhez, P, Meurette, E, Knapp, E, Theron, L, Daube, G, and Rao, AS. Assessment of a rapid semi-quantitative Immunochromatographic test for the evaluation of transfer of passive immunity in calves. Animals. (2021) 11:1641. doi: 10.3390/ani11061641

CrossRef Full Text | Google Scholar

35. Liebes, Y, Amir, L, Marks, RS, and Banai, M. Immobilization strategies of Brucella particles on optical fibers for use in chemiluminescence immunosensors. Talanta. (2009) 80:338–45. doi: 10.1016/j.talanta.2009.06.070

CrossRef Full Text | Google Scholar

36. Cheung, A, Dufour, S, Jones, G, Kostoulas, P, Stevenson, MA, Singanallur, NB, et al. Bayesian latent class analysis when the reference test is imperfect: -EN- -FR- Analyse bayésienne à classes latentes dans les situations où le test de référence est imparfait -ES- Análisis bayesiano de clases latentes cuando la prueba de referencia es imperfecta. Rev Sci Tech OIE. (2021) 40:271–286. doi: 10.20506/rst.40.1.3224

CrossRef Full Text | Google Scholar

Keywords: point-of-care tests, field evaluation, modified framework, FIT-REASSURED, animal health

Citation: Ochwo S, Perez AM and Pérez Aguirreburualde MS (2023) Beyond accuracy: leveraging ASSURED criteria for field evaluation of point-of-care tests for food animal diseases. Front. Vet. Sci. 10:1239111. doi: 10.3389/fvets.2023.1239111

Received: 14 March 2023; Accepted: 18 August 2023;
Published: 31 August 2023.

Edited by:

Muthu Thiruvengadam, Konkuk University, Republic of Korea

Reviewed by:

Polychronis Kostoulas, University of Thessaly, Greece

Copyright © 2023 Ochwo, Perez and Pérez Aguirreburualde. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Sylvester Ochwo, sochwo@umn.edu

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.