Performance Evaluation of In Vitro Screening and Diagnostic Kits for Hepatitis C Virus Infection

Aim: A reliable kit with high sensitivity and specificity is indispensable for diagnosing hepatitis C virus (HCV) infection. Detection kits for anti-HCV antibodies (anti-HCV) are used for screening, and quantification kits for HCV RNA and HCV antigen (Ag) are used for the definite diagnosis of HCV infection or the evaluation of the pathological condition of and therapeutic effects in patients with chronic hepatitis C. Several kits are currently available for these purposes and are provided for clinical use in Japan. In this study, we aimed to evaluate the performance of these kits.

Methods: We used International Standards for HCV RNA and HCV Ag and a regional reference panel to evaluate the performance of thirteen anti-HCV, five HCV RNA, and two HCV Ag kits.

Results: All specimens in the regional reference panel were diagnosed correctly by all anti-HCV kits, although the distributions of the quantified values varied, and the ratios of titer classification were not identical across kits. All HCV RNA kits quantified the International Standard with minimum deviation and diagnosed the specimens of the reference panel correctly. The quantified values of the International Standard by two HCV Ag kits were inconsistent. HCV Ag titers of some specimens were underestimated owing to the amino acid polymorphisms in comparison with HCV RNA titers.

Conclusions: The evaluation with International Standards and the regional reference panel was useful for assessing the quality of screening and diagnostic kits for HCV infection, and such quality control is essential for the clinical usage of these kits.

Introduction

Hepatitis C virus (HCV) is a human pathogen and major cause of chronic hepatitis. Approximately 71 million people globally have chronic hepatitis C infection (WHO, 2017). In most cases of infection, HCV causes chronic hepatitis and cirrhosis and leads to the development of hepatocellular carcinoma. Historically, interferon-based therapies have been used to eradicate HCV infection. However, these therapies often have unsatisfactory levels of efficacy, and chronic hepatitis C has been recognized to be a refractory disease (Feld and Hoofnagle, 2005; Pawlotsky, 2006; Feld and Ward, 2021). Recently, novel anti-HCV therapies with direct-acting antivirals have been established, and the number of patients who respond to treatment has increased (Pawlotsky, 2013; Feld, 2014; Welzel and Zeuzem, 2014; Tojima et al., 2020; Bhattacharjee et al., 2021; Stanciu et al., 2021). Therefore, chronic hepatitis C is now considered to be a curable disease, and it has been recommended to proceed with the detection of untreated or undiagnosed individuals with chronic HCV infection.

Currently, there are many in vitro screening and diagnostic kits for HCV infection available in Japan and other countries. These kits are inspected by the national regulatory authority in each country to verify their qualities before being released to the market. In Japan, when releasing new kits, the regulatory authority requires the same or better performance than preexisting kits on the market; the regression coefficient (slope of the correlation equation) of quantified values between new and preexisting kits should be between 0.9 and 1.1, and the coefficient of determination (R²) of these kits should be over 0.9. On the other hand, postmarketing surveillance is also considered to be important in maintaining the performance of these kits. Several kits are known to be affected by HCV genotypes and polymorphisms of nucleotides or amino acids, and predominant genotypes or strains may have regional specificity and change over time (Saeed et al., 2009; Murayama et al., 2012; Momose et al., 2018). To assess the performance of in vitro screening and diagnostic kits for HCV infection, International Standards for these kits and a regional reference panel are suitable. International Standards are approved by the World Health Organization (WHO) as a master calibrator of the international unit (IU), and a regional reference panel is built up by gathering the samples that are endemic in each region.

In this study, using International Standards for HCV RNA and HCV Ag, as well as a recently established regional reference panel, we evaluated a number of in vitro screening and diagnostic kits, including 13 anti-HCV detection, 5 HCV RNA quantification, and 2 HCV Ag quantification kits.

Methods

International Standards of HCV RNA and HCV Ag

International Standards are approved by the WHO for calibration of IUs. The sixth International Standard for HCV RNA genotype (GT) 1a (IS-RNA; NIBSC code: 18/184) and the first International Standard for HCV core antigen GT-1a (IS-Ag; PEI code: 129096/12) were obtained from the National Institute of Biological Standards and Control (NIBSC, UK) and Paul-Ehrlich-Institut (PEI, Germany), respectively. These International Standards were stored at -80°C until use.

Establishment of Regional Reference Panel

The regional HCV reference panel was established with 70 HCV-negative (CN1–CN70) and 80 HCV-positive (C1–C80) plasma specimens that were provided by the Japanese Red Cross Blood Centers. These specimens were collected in 2014 and 2015 in Japan and were determined to be ineligible for transfusion. The HCV genomes in samples of the positive reference panel were amplified by nested PCR, and genotypes were determined as reported previously (Furui et al., 2011). The positive reference panel included HCV strains of GT-1b (28; 35.0%), GT-2a (26; 32.5%), and GT-2b (26; 32.5%), which are in agreement with the predominant genotypes in Japan. These specimens were aliquoted in 1.0-mL volumes into 1.5-mL screw-cap tubes after centrifugation to exclude agglutinates or clots and then stored at −80°C until use.

Evaluation of HCV Detection Kits

In this study, 13 anti-HCV detection kits were enrolled: ARCHITECT Anti-HCV (ARCHITECT-Ab; Abbott Japan, Tokyo, Japan) (Yoo et al., 2015; Shepherd et al., 2020; Nam et al., 2021), Alinity i Anti-HCV (Alinity-Ab; Abbott Japan) (Shepherd et al., 2020; Nam et al., 2021), Lumipulse HCV (Lumipulse-Ab; Fujirebio, Tokyo, Japan), Lumipulse Presto HCV (Lumipulse Presto-Ab; Fujirebio), Lumipulse II Ortho HCV (Ortho-Ab; Fujirebio), Lumipulse Presto Ortho HCV (Ortho Presto-Ab; Fujirebio), Elecsys Anti-HCV II (Elecsys-Ab; Roche Diagnostics, Tokyo, Japan) (Yoo et al., 2015; Feng et al., 2016; Xu et al., 2019), Accuraseed HCV [II], (Accuraseed-Ab; Sanyo Chemical Industries, Kyoto, Japan), ADVIA Centaur anti-HCV assay (Centaur-Ab; Siemens Healthcare Diagnostics, Tokyo, Japan) (Dwyer, 2004; Yoo et al., 2015), HISCL Anti-HCV Assay Kit (HISCL-Ab; Sysmex, Kobe, Japan) (Feng et al., 2016), HISCL Anti-HCV II Assay Kit (HISCL II-Ab; Sysmex) (Xu et al., 2019), CL AIA-PACK HCVAb (CL AIA-Ab; TOSOH, Tokyo, Japan), and E Test ‘TOSOH’ II HCVAb (AIA-Ab; TOSOH). Of these anti-HCV detection kits, Lumipulse-Ab, Lumipulse Presto-Ab, Ortho-Ab, Ortho Presto-Ab, Accuraseed-Ab, HISCL-Ab, and CL AIA-Ab provide classification titers.

Five HCV RNA quantification kits were enrolled: COBAS AmpliPrep/COBAS TaqMan HCV test version 2.0 (CAP/CTM-RNA2; Roche Diagnostics) (Zitzer et al., 2013; Momose et al., 2018; Yao et al., 2018), cobas HCV (cobas-RNA; Roche Diagnostics) (Yao et al., 2018), Abbott RealTime HCV assay (ART-RNA; Abbott Japan), Alinity m HCV assay (Alinity-RNA; Abbott Japan) (Chevaliez et al., 2020) and Aptima HCV (Aptima-RNA; Hologic Japan, Tokyo, Japan) (Schalasta et al., 2016; Chevaliez et al., 2017; Schonning et al., 2017; Worlock et al., 2017).

Two HCV Ag quantification kits were enrolled: ARCHITECT HCV Ag (ARCHITECT-Ag; Abbott Japan) (Leary et al., 2006; Morota et al., 2009) and Lumipulse Ortho HCV Ag (Lumipulse-Ag; Fujirebio). All assays were performed by the respective manufacturers at their research laboratories.

Sequencing of HCV in the Regional Reference Panel

Viral RNA was extracted from 140 μL of each plasma sample using the QIAamp viral RNA kit (Qiagen, Valencia, CA, USA), and cDNA synthesis was conducted using SuperScript IV Reverse Transcriptase (Thermo Fisher Scientific, Waltham, MS). PCR was performed with a set of primers covering from the 5′ untranslated region (UTR) to the Envelope 1 region (1st round PCR: 44S-IH: 5′-CTGTGAGGAACTACTGTCTT-3′ and 1323R-IH: 5′-GGCGACCAGTTCATCATCAT-3′; 2nd round PCR: CS-17ssp: 5’-CCGGGAGAGCCATAGTGGTCTGCG-3’ and 1323R-IH). The amplified products were directly sequenced. The determined sequences of the core region were submitted to DDBJ/EMBL/GenBank and will appear with the following accession numbers: LC658661- LC658679.

Statistical Analysis

Correlations of the quantitative data were assessed by linear regression analyses, and R² values were calculated. P values of <0.05 were considered to indicate statistical significance. Analysis was performed using Prism 7 software (GraphPad Software, Inc., La Jolla, CA).

Results

Evaluation of Anti-HCV Detection Kits

The thirteen anti-HCV detection kits evaluated in this study are listed in Tables 1 and 2. Of these anti-HCV detection kits, seven kits were capable of the classifying the titers as high, middle, and low (Table 1), and six kits did not provide this titer classification but diagnosed specimens as positive, pending, or negative (Table 2). All the kits diagnosed all the HCV-positive specimens as positive and all the HCV-negative specimens as negative in the regional reference panel. The distributions of quantified titers of HCV-positive specimens by these kits varied (Figure 1). Among the kits providing titer classification, the titers measured by several kits were biased toward the upper detection limits, and those by others were widely distributed within the detection range. All specimens, except for one measured by HISCL-Ab, were classified as high or middle of the titer classification, and over half of the specimens were classified as high in measurement with most kits. There were more specimens classified as middle than high by HISCL-Ab (Figure 1A). The distributions of anti-HCV values also varied among the kits that did not provide titer classification (Figure 1B).

TABLE 1

Table 1 Anti-HCV detection kits providing antibody titer classification.

TABLE 2

Table 2 Anti-HCV detection kits not providing antibody titer classification.

FIGURE 1

Figure 1 Evaluation of HCV-positive specimens in the regional reference panel by anti-HCV detection kits. (A) Scatter dot plot of quantified values by 7 anti-HCV detection kits with titer classification. The numbers of specimens classified as high (H), middle (M), and low (L) titers are shown on the right of each plot. Dotted lines indicate the upper detection limit and boundaries between H and M and between M and L. (B) Scatter dot plot of quantified values by 6 anti-HCV detection kits without titer classification.

Evaluation of HCV RNA Quantification Kits

In this study, five HCV RNA quantification kits were evaluated (Table 3). Among these kits, two pairs of conventional and recently released kits provided by the same manufacturers were enrolled: ART-RNA and Alinity-RNA (Abbott Japan) and CAP/CTM-RNA2 and cobas-RNA (Roche Diagnostics). The new kit, Aptima-RNA (Hologic Japan), was also included. The dynamic ranges of these kits were comparable, and the lower limits of quantification were declared as follows: 10 IU/mL with Aptima-RNA, 12 IU/mL with ART-RNA, and Alinity-RNA, and 15 IU/mL with CAP/CTM-RNA2 and cobas-RNA. To quantify HCV RNA, Aptima-RNA uses transcription-mediated amplification (TMA), while other kits use reverse transcription-quantitative PCR (RT–qPCR).

TABLE 3

Table 3 HCV RNA quantification kits evaluated in this study.

To evaluate the performance of these kits, IS-RNA was serially diluted, quantified, and assessed for deviation from the theoretical titers. The quantified HCV RNA titers by these kits were close to the theoretical titer of each IS-RNA in the range of 4.0–1.5 log IU/mL, and the deviations from the assigned HCV RNA titers were < 10.0% except for one condition: 1.5 log IU/mL with cobas-RNA (Table 4). These kits could detect HCV RNA at a concentration of 1.0 log IU/mL, which was equal to or below the stated lower limit of quantification of these kits. In the evaluation of the regional reference panels, all these kits correctly diagnosed all specimens. The HCV RNA titers of HCV-positive specimens were distributed between 3 and 8 log IU/mL and were within the dynamic range of these kits. The quantified values by Alinity-RNA and ART-RNA, which are from one manufacturer (Abbott Japan), indicated an excellent correlation; the regression coefficient was 0.9990, and the R² value was 0.9681 (Figure 2A). The quantified values by Alinity-RNA also showed a good correlation to the quantified values by CAP/CTM-RNA2 and cobas-RNA, which are from another manufacturer (Roche Diagnostics); the regression coefficients were 1.008 and 1.010, and the R² values were 0.9765 and 0.9693, respectively. The regression coefficient between Alinity-RNA and Aptima-RNA (Hologic Japan) was lower than 0.9, although the R² value was over 0.9 (Figure 2A). Similar correlations were observed when using cobas-RNA as a reference, and a low regression coefficient with Aptima-RNA (0.8261) was also detected (Figure 2B). To assess the involvement of HCV genotypes in the low regression coefficient between Aptima-RNA and other kits, we calculated the regression coefficients with each genotype. In both correlations between Aptima-RNA and either Alinity-RNA or cobas-RNA, the regression coefficients for each genotype were similarly low; 0.8257, 0.8715, and 0.8500 with Alinity-RNA and 0.8478, 0.8337, and 0.8185 with cobas-RNA for GT-1b, GT-2a, and GT-2b, respectively. The R² values of these correlations did not differ among these genotypes (Supplementary Figure S1).

TABLE 4

Table 4 Detection of HCV RNA in International Standard by HCV RNA quantification kits.

FIGURE 2

Figure 2 Evaluation of HCV-positive specimens in the regional reference panel by HCV RNA quantification kits. (A) Correlation of quantified HCV RNA titers between Alinity-RNA and ART-RNA, CAP/CTM-RNA2, cobas-RNA, and Aptima-RNA. The correlation equation and the R² value are indicated at the top of the panel. (B) Correlation of quantified HCV RNA titers between cobas-RNA and CAP/CTM-RNA2, ART-RNA, Alinity-RNA, and Aptima-RNA. The correlation equation and the R² value are indicated at the top of the panel.

Evaluation of HCV Ag Quantification Kits

In this study, two HCV Ag quantification kits, ARCHITECT-Ag and Lumipulse-Ag, were evaluated (Table 5). The lower limits of quantification of ARCHITECT-Ag and Lumipulse-Ag were 3.0 and 50.0 fmol/L, respectively. IS-Ag was diluted to 300, 100, 30, 10, 3, and 1 IU/mL and subjected to measurement by these kits, although these kits do not use IS-Ag as a calibrator, and the quantified data were expressed in fmol/L. ARCHITECT-Ag could measure the diluted IS-Ag to 3 IU/mL and Lumipulse-Ag could detect to 30 IU/mL, and the linearity of quantified values of the diluted IS-Ag was confirmed in both kits. However, the quantified values by these kits were 1.33–1.57-fold different from each other, indicating that these kits are not standardized (Figure 3A).

TABLE 5

Table 5 Detection of HCV Ag in regional reference panels by HCV Ag quantification kits.

FIGURE 3

Figure 3 Evaluation of HCV Ag quantification kits using International Standards and a regional reference panel. (A) Quantified HCV Ag titers of serially diluted WHO International Standards. The WHO International Standard for HCV Ag (IS-Ag) was serially diluted to 300, 100, 30, 10, 3, and 1 IU/mL and quantified by ARCHITECT-Ag (circles) and Lumipulse-Ag (squares). (B) Correlations of HCV core Ag titers of the specimens in the HCV reference panel quantified by ARCHITECT-Ag and Lumipulse-Ag. Dashed lines indicate the 95% confidence intervals for the regression line. The correlation equation and the R² value are indicated at the top of the panel.

In the evaluation of the regional reference panel, all HCV-negative specimens were diagnosed as negative by both kits (Table 5). For the HCV-positive specimens, ARCHITECT-Ag quantified all 80 specimens in the HCV-positive panel, whereas Lumipulse-Ag could quantify 78 specimens (97.5%), with the HCV Ag titers of the remaining 2 specimens below the lower limit of quantification for Lumipulse-Ag. The regression coefficient of the quantified HCV Ag values by ARCHITECT-Ag and Lumipulse-Ag was 1.384, which is over 1.1, suggesting incompatibility of quantified HCV Ag data by these kits (Figure 3B). To assess the genotype dependency of this incompatibility, we calculated the correlations for each genotype. The regression coefficients were 1.403, 1.026, and 1.610 for GT- 1b, GT-2a, and GT-2b, respectively (Supplementary Figure S2). These data seemed to suggest a genotype dependence of the correlation because the regression coefficients were different in each genotype. However, when the 4 deviating specimens lying outside of the 95% confidence interval lines (C32, GT-2a; C35, GT-2b; C52, GT-2a; and C75, GT-1b) were excluded, the regression coefficients of each genotype became similar. Therefore, the correlation of the quantified values by these HCV Ag quantification kits did not seem to be affected by genotypes but was influenced by several specimens that had inconsistent values based on these two kits.

Correlation Between Quantification of HCV RNA and HCV Ag

The correlation between HCV Ag and HCV RNA titers of specimens in the regional reference panel was also assessed. Relatively good correlations were observed between HCV RNA and log-converted HCV Ag titers. For the quantified values by ARCHITECT-Ag and HCV RNA quantification kits, the regression coefficients ranged from 0.7363–0.8912, and the R² values ranged from 0.8664–0.8987 (Figure 4A). For the quantified values by Lumipulse-Ag and HCV RNA, the regression coefficients ranged from 0.7847–0.9463, and the R² values ranged from 0.8191–0.8469 (Figure 4B). Reflecting the low regression coefficients between Aptima-RNA and the other HCV RNA quantification kits, quantified values by ARCHITECT-Ag and Lumipulse-Ag exhibited low regression coefficients to Aptima-RNA. In these correlations, the quantified HCV Ag values of several specimens were plotted below the lower 95% confidence interval lines. In the correlation between quantified values by ARCHITECT-Ag and HCV RNA quantification kits, 4 specimens (C8, C18, C57, and C78) were identified to be plotted below the lower 95% confidence interval lines. In the correlation between quantified values by Lumipulse-Ag and HCV RNA kits, 7 specimens (C18, C21, C32, C50, C52, C56, and C57) were identified to be plotted below the lower 95% confidence interval lines. Specimen C8 was excluded because it was under the lower limit of quantification by Lumipulse-Ag. Taken together, all these 9 specimens (C8, C18, C21, C32, C50, C52, C56, C57, and C78) were selected, and the nucleotide sequences of the HCV core region were determined. The predicted amino acid (aa) sequences were aligned with the consensus sequence of each genotype: 1b-con, 2a-con, and 2b-con (Figure 4C). These 9 specimens, 3 with the GT-1b strain (C8, C18, and C57), 5 with the GT-2a strain (C21, C32, C52, C56, and C78), and 1 with the GT-2b strain (C50), were shown to have polymorphisms at aa48 or aa49.

FIGURE 4

Figure 4 Correlations between HCV RNA and HCV Ag quantified by ARCHITECT-Ag (A) and Lumipulse-Ag (B). Data for HCV Ag levels were converted to log fmol/L prior to analysis. In each plot, the lower limit of quantification of the respective HCV Ag assay is indicated by a dotted line. Dashed lines indicate the 95% confidence intervals for the regression line. The correlation equation and the R² value are indicated at the top of the panel. (C) An alignment of the first 60 amino acids of the HCV core region. Estimated amino acid sequences of nine strains with polymorphisms at amino acids 48 and 49 were aligned with the consensus sequence of each genotype: 1b-con, 2a-con, and 2b-con. Genotypes of aligned strains are indicated in parentheses. The position numbers are indicated at the top of the alignment, and amino acids at positions 48 and 49 are indicated by inverted triangles. Dots indicate identical amino acids.

Discussion

Postmarketing surveillance is a survey conducted after a medical device has been released to ensure its quality, efficacy, and accuracy and is used to gather detailed information that was not available before the sale. For the postmarketing surveillance of in vitro diagnostic kits for HCV infection, we exploited the regional reference panel for HCV consisting of epidemic strains in Japan. This reference panel was originally established to generate data regarding correlations to the preexisting kits at the approval step of a new in vitro screening and diagnostic kit. We also used International Standards for HCV RNA and HCV Ag for the evaluation of the performance of these kits.

Although numerous anti-HCV detection kits are currently available in Japan, we evaluated 13 representative kits in this study. All these kits correctly diagnosed all the HCV-positive and HCV-negative specimens in the reference panel. The distribution of measured titers was different among these kits, and the ratios of the titer classification were also inconsistent among the 7 kits that were available for the titer classification. The antigens used for the detection of anti-HCV in these kits differed across kits (Tables 1 and 2), and this difference in antigen may be responsible for the difference in anti-HCV titer. The detection of anti-HCV is used to screen for past exposure to and current infection of HCV. To distinguish between HCV carriers and persons previously infected with HCV, the anti-HCV titer was measured, and then HCV Ag or HCV RNA was detected, if necessary. In Japan, following the instructions of the Ministry of Health, Labour and Welfare of Japan, HCV screening is performed as follows: HCV antibody tests with titer classification are used to screen for current infection of HCV at the health check, and values of anti-HCV are classified into groups with high, medium, or low titers or as negative. Those with high titers or those with medium or low titers and HCV RNA positivity have a ‘high possibility of currently infected with HCV’ and are recommended to see a doctor for a definitive diagnosis and treatment. Those with medium or low titers who were HCV RNA-negative are determined to be ‘likely not currently infected with HCV’. Therefore, the titer classification of anti-HCV plays an important role in the flow of HCV screening in Japan, and the kits for this purpose are manufactured and sold only in Japan. Postmarketing surveillance of anti-HCV detection kits not only with high- or middle-titer specimens as used in this study but also with low-titer specimens will be essential to evaluate and maintain the performance of currently available or upcoming anti-HCV detection kits.

We evaluated the 5 HCV RNA quantification kits using IS-RNA and the reference panel. In the evaluation with IS-RNA, all these kits quantified the serially diluted IS-RNA down to the concentration of the quantification limits of these kits. The deviations in the quantified data by these kits from assigned concentrations were acceptable. The correlations between the quantified data by these kits was also evaluated by using the reference panel. Most of the kits exhibited excellent correlations, and the regression coefficients and the R² values were within the requirements of the regulatory authority. Only the regression coefficients between the quantified values by Aptima-RNA and the other kits were lower than 0.9, although the R² values were over 0.9 and genotype dependency was not detected. These data indicated that the data quantified by Aptima-RNA were not always identical to the data quantified by the other kits. The differences in the quantified data by Aptima-RNA and other kits were a maximum of 0.76 log IU/mL. Similar to our observation, the difference in the quantified data by Aptima-RNA and other kits has been previously reported, whereas an excellent correlation between Aptima-RNA and other kits indicated with a regression coefficient close to 1.0 has also been reported (Schalasta et al., 2016; Chevaliez et al., 2017; Schonning et al., 2017; Worlock et al., 2017; Chevaliez et al., 2020). Because the data quantifying the International Standards by each kit were nearly identical in each dilution, this discrepancy may depend on the region-specific genotypes or specific mutations of evaluated specimens; the evaluation of specimens obtained in a specific area, such as those included in the regional reference panel, will be essential to obtain valid data on the correlation between two kits. At least in Japan, careful attention will be needed when the HCV RNA quantification kit is changed from Aptima-RNA to another kit or another kit to Aptima-RNA during the follow-up of patients with chronic hepatitis C.

The performance of 2 HCV Ag quantification kits, ARCHITECT-Ag and Lumipulse-Ag, was also investigated. To standardize HCV Ag kits, the first WHO International Standard for HCV Ag was issued in 2014. However, it has not yet been commonly used and has not been applied to these kits. We used IS-Ag and the reference panel to evaluate the performance of these kits. As expected, the quantified data from the serially diluted IS-Ag were different from each other, and the regression coefficient in the correlation of the quantified HCV Ag values of the reference panel was over 1.1. These data suggested the incompatibility of quantified data by these kits. This incompatibility may cause problems in the clinical use of these kits because HCV Ag quantification is used as an alternative to HCV RNA to diagnose HCV infection and the evaluation of the pathological condition or therapeutic effects of chronic hepatitis C (Tanaka et al., 2003; Wang et al., 2021). In addition, the underestimation of HCV Ag values based on the correlation with HCV RNA has also been reported in some specimens. The amino acid polymorphisms at aa47–aa49 in the HCV core region were responsible for this deviation (Saeed et al., 2009; Murayama et al., 2012; Momose et al., 2018). In this study, 9 specimens in the reference panel exhibited underestimated values of HCV Ag and were revealed to have amino acid polymorphisms at aa48 and aa49. The affected specimens varied by kits; 4 specimens were underestimated when measuring with ARCHITECT-Ag, and 7 specimens were underestimated with Lumipulse-Ag (1 specimen was out of the quantification range). Specimen C78 was underestimated only by ARCHITECT-Ag, and specimens C32, C50, C52, and C56 were underestimated only by Lumipulse-Ag. The difference in these affected specimens also influenced the correlation between the quantified values by these kits. The quantified values for C32 and C52 deviated from the correlation of quantified values of these kits and fell outside of the 95% confidence interval lines. Therefore, to reconcile the differences in the quantification by these kits, standardization with IS-Ag and an investigation evaluating the influencing factors for the HCV Ag values is needed.

In this study, important information was obtained by postmarketing surveillance. The detection kits for anti-HCV and the quantification kits for HCV RNA and HCV Ag were confirmed to have enough sensitivity to diagnose HCV infection. However, the quantified values of these parameters by some kits were revealed to be incompatible with each other. In such cases, the correlation equation obtained by quantification of the reference panel will be useful for conversion. In the quantification of HCV Ag, careful attention is needed when following up the patients infected with HCV with the amino acid polymorphisms affecting the quantified values. As indicated in this study, the evaluation with International Standards and the regional reference panel was useful to confirm the quality of currently available diagnostic kits for HCV infection, and such quality control is essential for the clinical usage of these kits.

Data Availability Statement

The datasets presented in this article are not readily available because the raw data measured by the manufacturers cannot be provided. Requests to access the datasets should be directed to TK, takato@nih.go.jp.

Author Contributions

AM, HM, IH, and TK conceived this study. AM, HM, NY, and KM carried out the experiments. KM gathered and prepared the materials. MM and TK supervised the experiment and project. All authors contributed to the article and approved the submitted version.

Funding

This work was performed as part of a project for the preparation of reference panels of infectious disease specimens at the National Institute of Infectious Diseases in Japan. This work was also supported by the Research on Regulatory Science of Pharmaceuticals and Medical Devices from the Japan Agency for Medical Research and Development (AMED) (JP21mk0102146). The funders played no role in the study design, data collection and interpretation, or the decision to submit the work for publication.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Acknowledgments

The blood specimens used in the regional HCV reference panel were provided upon application for the use of blood donated in Japan based on the “Guidelines on the use of donated blood in research and development, etc.”. We are grateful to the Japan Association of Clinical Reagents Industries (Tokyo, Japan) and the in vitro diagnostics manufacturers for measuring the specimens: Abbott Japan (Tokyo, Japan), Fujirebio (Tokyo, Japan), Hologic Japan (Tokyo, Japan), Roche Diagnostics (Tokyo, Japan), Sanyo Chemical Industries (Kyoto, Japan), Siemens Healthcare Diagnostics (Tokyo, Japan), Sysmex (Kobe, Japan), and TOSOH (Tokyo, Japan). The manufacturers participating in measuring the specimens had no role in the study design and interpretation.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fcimb.2021.793472/full#supplementary-material

References

Bhattacharjee, C., Singh, M., Das, D., Chaudhuri, S., Mukhopadhyay, A. (2021). Current Therapeutics Against HCV. Virusdisease 32 (2), 1–16. doi: 10.1007/s13337-021-00697-0

CrossRef Full Text | Google Scholar

Chevaliez, S., Dubernet, F., Dauvillier, C., Hezode, C., Pawlotsky, J. M. (2017). The New Aptima HCV Quant Dx Real-Time TMA Assay Accurately Quantifies Hepatitis C Virus Genotype 1-6 RNA. J. Clin. Virol. 91, 5–11. doi: 10.1016/j.jcv.2017.03.020

PubMed Abstract | CrossRef Full Text | Google Scholar

Chevaliez, S., Onelia, F., Pacenti, M., Goldstein, E., Galan, J. C., Martinez-Garcia, L., et al. (2020). Multicenter Clinical Evaluation of Alinity M HCV Assay Performance. J. Clin. Virol. 129:104531. doi: 10.1016/j.jcv.2020.104531

PubMed Abstract | CrossRef Full Text | Google Scholar

Dwyer, R. (2004). The ADVIA Centaur Infectious Disease Assays: A Technical Review. J. Clin. Virol. 30 (Suppl 1), S1–S5. doi: 10.1016/j.jcv.2004.02.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Feld, J. J. (2014). Interferon-Free Strategies With a Nucleoside/Nucleotide Analogue. Semin. Liver Dis. 34 (1), 37–46. doi: 10.1055/s-0034-1371009

PubMed Abstract | CrossRef Full Text | Google Scholar

Feld, J. J., Hoofnagle, J. H. (2005). Mechanism of Action of Interferon and Ribavirin in Treatment of Hepatitis C. Nature 436 (7053), 967–972. doi: 10.1038/nature04082

PubMed Abstract | CrossRef Full Text | Google Scholar

Feld, J. J., Ward, J. W. (2021). Key Elements on the Pathway to HCV Elimination: Lessons Learned From the AASLD HCV Special Interest Group 2020. Hepatol. Commun. 5 (6), 911–922. doi: 10.1002/hep4.1731

PubMed Abstract | CrossRef Full Text | Google Scholar

Feng, S., Wei, B., Liu, Q., Wang, T., Li, D., Rao, C., et al. (2016). Evaluation of the Novel HISCL Chemiluminescence Enzyme Immunoassay for Laboratory Screening of Hepatitis C Virus. Clin. Vaccine Immunol. 23 (7), 652–654. doi: 10.1128/CVI.00078-16

PubMed Abstract | CrossRef Full Text | Google Scholar

Furui, Y., Hoshi, Y., Murata, K., Ito, K., Suzuki, K., Uchida, S., et al. (2011). Prevalence of Amino Acid Mutation in Hepatitis C Virus Core Region Among Japanese Volunteer Blood Donors. J. Med. Virol. 83 (11), 1924–1929. doi: 10.1002/jmv.22216

PubMed Abstract | CrossRef Full Text | Google Scholar

Leary, T. P., Gutierrez, R. A., Muerhoff, A. S., Birkenmeyer, L. G., Desai, S. M., Dawson, G. J. (2006). A Chemiluminescent, Magnetic Particle-Based Immunoassay for the Detection of Hepatitis C Virus Core Antigen in Human Serum or Plasma. J. Med. Virol. 78 (11), 1436–1440. doi: 10.1002/jmv.20716

PubMed Abstract | CrossRef Full Text | Google Scholar

Momose, H., Matsuoka, S., Murayama, A., Yamada, N., Okuma, K., Ikebe, E., et al. (2018). Evaluation of In Vitro Screening and Diagnostic Kits for Hepatitis C Virus Infection. J. Clin. Virol. 105, 97–102. doi: 10.1016/j.jcv.2018.06.008

PubMed Abstract | CrossRef Full Text | Google Scholar

Morota, K., Fujinami, R., Kinukawa, H., Machida, T., Ohno, K., Saegusa, H., et al. (2009). A New Sensitive and Automated Chemiluminescent Microparticle Immunoassay for Quantitative Determination of Hepatitis C Virus Core Antigen. J. Virol. Methods 157 (1), 8–14. doi: 10.1016/j.jviromet.2008.12.009

PubMed Abstract | CrossRef Full Text | Google Scholar

Murayama, A., Sugiyama, N., Watashi, K., Masaki, T., Suzuki, R., Aizaki, H., et al. (2012). Japanese Reference Panel of Blood Specimens for Evaluation of Hepatitis C Virus RNA and Core Antigen Quantitative Assays. J. Clin. Microbiol. 50 (6), 1943–1949. doi: 10.1128/JCM.00487-12

PubMed Abstract | CrossRef Full Text | Google Scholar

Nam, M., Song, D. Y., Song, S. H., Roh, E. Y., Shin, S., Park, K. U., et al. (2021). Performance Evaluation of Immunoassay for Infectious Diseases on the Alinity I System. J. Clin. Lab. Anal. 35 (3), e23671. doi: 10.1002/jcla.23671

PubMed Abstract | CrossRef Full Text | Google Scholar

Pawlotsky, J. M. (2006). Therapy of Hepatitis C: From Empiricism to Eradication. Hepatology 43 (2 Suppl 1), S207–S220. doi: 10.1002/hep.21064

PubMed Abstract | CrossRef Full Text | Google Scholar

Pawlotsky, J. M. (2013). Treatment of Chronic Hepatitis C: Current and Future. Curr. Top. Microbiol. Immunol. 369, 321–342. doi: 10.1007/978-3-642-27340-7_13

PubMed Abstract | CrossRef Full Text | Google Scholar

Saeed, M., Suzuki, R., Kondo, M., Aizaki, H., Kato, T., Mizuochi, T., et al. (2009). Evaluation of Hepatitis C Virus Core Antigen Assays in Detecting Recombinant Viral Antigens of Various Genotypes. J. Clin. Microbiol. 47 (12), 4141–4143. doi: 10.1128/JCM.01437-09

PubMed Abstract | CrossRef Full Text | Google Scholar

Schalasta, G., Speicher, A., Borner, A., Enders, M. (2016). Performance of the New Aptima HCV Quant Dx Assay in Comparison to the Cobas TaqMan HCV2 Test for Use With the High Pure System in Detection and Quantification of Hepatitis C Virus RNA in Plasma or Serum. J. Clin. Microbiol. 54 (4), 1101–1107. doi: 10.1128/JCM.03236-15

PubMed Abstract | CrossRef Full Text | Google Scholar

Schonning, K., Pedersen, M. S., Johansen, K., Landt, B., Nielsen, L. G., Weis, N., et al. (2017). Analytical and Clinical Performance of the Hologic Aptima HCV Quant Dx Assay for the Quantification of HCV RNA in Plasma Samples. J. Virol. Methods 248, 159–165. doi: 10.1016/j.jviromet.2017.07.006

PubMed Abstract | CrossRef Full Text | Google Scholar

Shepherd, S. J., McLellan, H., Bell, J., Gunson, R. N. (2020). Evaluation of Dried Blood Spot Testing Using the Abbott Alinity I. J. Clin. Virol. 132, 104638. doi: 10.1016/j.jcv.2020.104638

PubMed Abstract | CrossRef Full Text | Google Scholar

Stanciu, C., Muzica, C. M., Girleanu, I., Cojocariu, C., Sfarti, C., Singeap, A. M., et al. (2021). An Update on Direct Antiviral Agents for the Treatment of Hepatitis C. Expert Opin. Pharmacother. 22 (13), 1729–1741. doi: 10.1080/14656566.2021.1921737

PubMed Abstract | CrossRef Full Text | Google Scholar

Tanaka, Y., Takagi, K., Fujihara, T., Kitsugi, K., Fujiwara, K., Hiramatsu, K., et al. (2003). High Stability of Enzyme Immunoassay for Hepatitis C Virus Core Antigen-Evaluation Before and After Incubation at Room Temperature. Hepatol. Res. 26 (4), 261–267. doi: 10.1016/s1386-6346(03)00113-x

PubMed Abstract | CrossRef Full Text | Google Scholar

Tojima, H., Kakizaki, S., Takakusagi, S., Hoshino, T., Naganuma, A., Nagashima, T., et al. (2020). Favorable Outcome of Retreatment by Direct-Acting Antivirals for Hepatitis C Patients With Daclatasvir Plus Asunaprevir Combination Therapy Failure. Hepatol. Res. 50 (3), 303–312. doi: 10.1111/hepr.13462

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, Y., Jie, W., Ling, J., Yuanshuai, H. (2021). HCV Core Antigen Plays an Important Role in the Fight Against HCV as an Alternative to HCV-RNA Detection. J. Clin. Lab. Anal. 35 (6), e23755. doi: 10.1002/jcla.23755

PubMed Abstract | CrossRef Full Text | Google Scholar

Welzel, T. M., Zeuzem, S. (2014). Interferon-Free Strategies Without a Nucleoside/Nucleotide Analogue. Semin. Liver Dis. 34 (1), 47–57. doi: 10.1055/s-0034-1371010

PubMed Abstract | CrossRef Full Text | Google Scholar

WHO (2017) Global Hepatitis Report 2017. Available at: http://www.who.int/hepatitis/publications/global-hepatitis-report2017/en/ (Accessed 2 May 2018).

Google Scholar

Worlock, A., Blair, D., Hunsicker, M., Le-Nguyen, T., Motta, C., Nguyen, C., et al. (2017). Analytical Characteristics and Comparative Evaluation of Aptima HCV Quant Dx Assay With the Abbott RealTime HCV Assay and Roche COBAS AmpliPrep/COBAS TaqMan HCV Quantitative Test V2.0. Virol. J. 14 (1), 66. doi: 10.1186/s12985-017-0727-3

PubMed Abstract | CrossRef Full Text | Google Scholar

Xu, W., Tong, Y., Li, Y. (2019). Comparison of Roche Elecsys and Sysmex HISCL Immunoassays for the Screening of Common Blood-Borne Pathogens. Ann. Transl. Med. 7 (14), 300. doi: 10.21037/atm.2019.05.83

PubMed Abstract | CrossRef Full Text | Google Scholar

Yao, J. D., Young, S., Heilek, G. M., Marino, E., Paxinos, E. E., Marins, E. G., et al. (2018). Diagnosis and Monitoring of HCV Infection Using the Cobas HCV Test for Use on the Cobas 6800/8800 Systems. J. Clin. Virol. 102, 63–69. doi: 10.1016/j.jcv.2018.02.017

PubMed Abstract | CrossRef Full Text | Google Scholar

Yoo, S. J., Wang, L. L., Ning, H. C., Tao, C. M., Hirankarn, N., Kuakarn, S., et al. (2015). Evaluation of the Elecsys Anti-HCV II Assay for Routine Hepatitis C Virus Screening of Different Asian Pacific Populations and Detection of Early Infection. J. Clin. Virol. 64, 20–27. doi: 10.1016/j.jcv.2014.12.015

PubMed Abstract | CrossRef Full Text | Google Scholar

Zitzer, H., Heilek, G., Truchon, K., Susser, S., Vermehren, J., Sizmann, D., et al. (2013). Second-Generation Cobas AmpliPrep/Cobas TaqMan HCV Quantitative Test for Viral Load Monitoring: A Novel Dual-Probe Assay Design. J. Clin. Microbiol. 51 (2), 571–577. doi: 10.1128/JCM.01784-12

PubMed Abstract | CrossRef Full Text | Google Scholar