Value of the Overall Pneumococcal Polysaccharide Response in the Diagnosis of Primary Humoral Immunodeficiencies

Background: An overall response assay [OVA, based on a 23-valent pneumococcal polysaccharide vaccine (PPV23)] is widely used to screen for anti-pneumococcal antibodies. Given the heterogeneity of response from one polysaccharide (PS) to another, a World Health Organization-standardized serotype-specific enzyme-linked immunosorbent assay (SSA) is considered to be the only reliable method for testing anti-PS antibody responses in individuals with suspected primary immunodeficiencies (PIDs).

Objective: To evaluate the OVA relative to the reference SSA.

Methods: Serum samples of adult patients referred for a suspected PID were collected before and then 4–8 weeks after immunization with PPV23. The anti-pneumococcal response was systematically assessed with an SSA (7–16 serotypes) and interpreted according to the American Academy of Asthma, Allergy and Immunology’s current guidelines. We used receiver operating characteristic curves and agreement indices to assess the OVA’s diagnostic value in a first cohort. In order to validate these findings, a second (validation) cohort was then prospectively included.

Results: Sixty-two adult patients were included, and 42 (67.7%) were defined as poor responders according to the SSA. Only the post-immunization titer in the OVA was able to correctly identify poor responders; a titer below 110 mg/L gave a positive predictive value of 100% [identifying 24 (57.1%) of the 42 poor responders], and similar levels of diagnostic performance were observed in the validation cohort. The pre-vaccination antibody titer, the post/pre-vaccination antibody titer ratio and a post-vaccination titer above 110 mg/L in the OVA were not predictive of the response in the SSA.

Conclusion: A post-vaccination antibody titer below 110 mg/L in the OVA was constantly associated with a poor PPV23 response using the SSA. In all other cases, SSA is the only reliable method for assessing diagnostic vaccination with PPV23.

Introduction

An altered immunoglobulin G (IgG) antibody response to vaccines is an important criterion in the diagnosis of primary immunodeficiencies (PIDs), such as common variable immunodeficiency (CVID), transient hypogammaglobulinemia of infancy, selective IgA deficiency, IgG subclass deficiencies, or selective anti-polysaccharide antibody deficiency (SPAD) (1, 2). Although responses to protein or protein-conjugated antigens may be conserved, responses to polysaccharides (PSs) are usually impaired. This is particularly true for SPAD, which is characterized by an isolated defect in the specific anti-polysaccharide IgG response, normal total IgG, IgA/M, and IgG subclass titers, and the absence of a T-cell deficiency (1, 2). The response to PS antigens is usually tested by challenging the patient with the pneumococcal capsular polysaccharides (PnPSs) in the 23-valent pneumococcal vaccine (PPV23); in 2012, the American Academy of Asthma, Allergy and Immunology (AAAAI) proposed consensus criteria for an impaired response to PnPSs (1, 2). The currently accepted gold-standard test for specific anti-PnPS IgG responses is the serotype-specific enzyme-linked immunosorbent assay (ELISA) validated by the World Health Organization (WHO) (3). Given that each serotype requires a single ELISA, the serotype-specific assay (SSA) is too expensive and time-consuming to be used in routine practice; as a result, it has not been widely disseminated and is available in only a few highly qualified laboratories. Several alternative in-house multiplexed approaches have also been suggested but they are of limited access (4–7).

By contrast, the overall anti-PnPS response assay (OVA, which measures the antibody response to all 23 of the PPV23’s antigens) is widely available in hospital central laboratories and private diagnostic laboratories as in-house assays or easy-to-use commercial kits (8). In view of its design, the OVA only characterizes the overall response to all serotypes and does not take account of the well-known inter-serotype heterogeneity in antibody titers (9, 10). The published normative values were calculated for healthy, non-vaccinated control groups. Although several pathological values have also been reported, they were calculated from groups of patients with greatly differing diagnostic criteria (8, 11–13). The clinical relevance of OVA with regard to SSA has not previously been assessed, and OVA is not currently recommended for the assessment of anti-PnPS responses.

In this context, the present study was designed to assess the value of the OVA (the index test) in the diagnosis of a defective PS vaccine response in adults, relative to the gold-standard SSA.

Materials and Methods

Study Design

We first performed a retrospective study in patients being tested with the WHO-validated reference SSA for the diagnosis of suspected PIDs. In order to validate the threshold determined in the retrospective cohort, a second, separate cohort of patients with suspected PID was then prospectively evaluated.

Participants

In the retrospective study, the population was composed of adult patients having undergone a PS vaccine response assay for a suspected PID in the Department of Clinical Immunology at Lille University Medical Center (Lille, France), Saint Louis University Medical Center (Paris, France) and/or patients included in an ongoing trial which aims to evaluate a screening strategy of PIDs in adults (ClinicalTrials ref: NCT02972281).

In the prospective validation study, a second cohort of consecutive adult patients referred for possible PID from the above-mentioned ongoing NCT02972281 trial was included on a blind basis.

In both studies, stored serum samples were retrieved from the Immunomonitoring Facility at Cochin University Medical Center (Paris, France). The inclusion criteria were unexplained recurrent and/or severe bacterial infections with encapsulated bacteria (i.e., upper and/or lower respiratory tract infections, invasive infections). The main exclusion criteria were as follows: evidence of secondary immunodeficiency, immunoglobulin replacement therapy, non-compliance with the post-immunization period, and pneumococcal immunization in the previous 5 years. All identified PIDs were classified according to current guidelines (1, 14).

Ethics

Both studies were conducted in accordance with the recommendations of the Helsinki Declaration and complied with the requirements of the French Commission Nationale Informatique et Libertés.

Patients included through the ongoing adult PIDs screening study (ClinicalTrials ref: NCT02972281) gave written informed consent according to the current legislation and the study protocol.

Patients included through routine consultations of French university hospitals received information, and the ability to refuse, that their clinical data and/or remaining biological samples after routine testing completion could be used for research purposes. All samples were retrieved from a human biological collection declared to and authorized by the French Ministry in charge of Research (No. DC-2008-642). Hence, no written informed consent was collected from this population.

Test methods

The Clinical Reference Standard

The PnPS response was tested in the Immunomonitoring Facility at Cochin University Medical Center (Paris, France), using a WHO-validated SSA. Titers of antibody against seven capsular serotypes (4, 6B, 9V, 14, 18C, 19F, and 23F) were assessed before and then 4–8 weeks after the administration of PPV23 (3). The results were interpreted according to the 2012 AAAAI guidelines, which were recently reviewed by a panel of experts (2, 15). Briefly, an insufficient response for a given serotype was considered to correspond to post-immunization antibody titers below 1.3 mg/L or failing to show a fourfold increase. A twofold increase was deemed acceptable if the initial value was already greater than 1.3 mg/L. A poor response to PnPSs was defined by an insufficient response to at least 70% (i.e., 5 or more) of the 7 tested serotypes, and patients were, therefore, classified as “good responders” or “poor responders.” To validate the relevance of the 7-serotype PS response, serum samples with sufficient pre- or post-immunization (PPV23) volumes were tested for antibodies against nine additional serotypes (1, 3, 5, 6A, 7F, 19A, 10A, 12F, and 15B) (data not shown).

The Index Test

An OVA was used to measure the total titer of antibodies to all 23 serotypes in the serum samples studied with the reference standard at the time of the initial diagnosis and subsequently stored in a dedicated −80°C serum bank. The assay was performed in the Immunology Institute at Lille University Medical Center (Lille, France), using the VaccZyme™ anti-PCP IgG Enzyme Immunoassay Kit (The Binding Site^®, Birmingham, United Kingdom) on an ETI–Max 3000™ analyzer (DiaSorin^®, Vercelli, Italy). The serum samples were analyzed at a first-intention dilution of 1:100. A further 1:10 dilution was performed when antibody titers fell outside the assay’s linearity range. The OVA results were initially interpreted blindly, i.e., without regard to the SSA results. According to the study protocol, indeterminate results and missing data were to be excluded before the analysis.

Analyses

Analyses were performed using SAS^® software (version 9.4; SAS Institute Inc., Cary, NC, USA). Continuous variables are quoted as the median (range) and categorical variables are quoted as the number (percentage). The good responders and poor responders were compared with regard to their clinical and biological characteristics by using a Mann–Whitney test for continuous variables, and the chi-squared test or Fisher’s exact test for categorical variables, as appropriate.

In the retrospective study, linear regression and Pearson’s correlation coefficient were used to assess the putative relationship between OVA antibody titers and the sum of serotype-specific antibody titers before and after vaccination (13, 16). Receiver operating characteristic (ROC) curves were plotted and the area under the curve (AUC) was calculated for pre- and post-immunization antibody titers, the post-immunization increase and the post-/pre-immunization titer ratio. The best cut-off values were then chosen (i) according to the Youden index calculation [which defines the maximum potential effectiveness of a biomarker when equal weight is given to sensitivity (Se) and specificity (Sp)], and (ii) in order to maximize the assay’s Sp value. Positive and negative predictive values were calculated on the basis of the prevalence of the target condition in the included population. For each identified cut-off value, the OVA’s performance and agreement levels were measured using McNemar’s test and Cohen’s kappa.

In the prospective validation study, the best cut-off value determined in the retrospective study was used to classify patients against the gold-standard diagnosis and, thus, validate our methodology. All tests were two-tailed, and the threshold for statistical significance was set to p < 0.05.

Results

The Retrospective Study

Participants

Sixty-two patients were included, 33 (53.2%) were females, and the median (range) age at inclusion was 37.5 (18–75) years. No indeterminate results were observed with either assay. According to the SSA, 42 (67.7%) of the patients showed a poor response to PnPSs. The identified PIDs were CVID (n = 5, 8.1%), unclassified isolated IgG deficiency (n = 7, 11.3%), IgG subclass deficiency (n = 8, 12.9%, including IgG1/3 deficiency, n = 3; IgG2 deficiency, n = 2; IgG2/IgA deficiency, n = 3), isolated IgA deficiency (n = 2, 3.2%), isolated IgM deficiency (n = 1, 1.6%) and SPAD (n = 24, 38.7%). Some of the patients with SPAD have been described elsewhere (17). The patients’ clinical characteristics are presented as a function of the vaccine response in Table 1.

TABLE 1

Table 1. Clinical and biological characteristics of the retrospective study population as a whole and according to the vaccine response status.

Test Results

There was no significant difference between the good responders’ and poor responders’ median (range) sampling periods (respectively, 6.0 (4.0–7.8) and 6.4 (4.1–7.9) weeks after immunization, p = 0.465). The median (range) number of responsive serotypes was 3 (0–7) for the study population as a whole, 2 (0–4) for poor responders and 6 (5–7) for good responders (p < 0.001). In the SSAs, the response varied markedly from one serotype to another for both good responders and poor responders. An example of the complexity of comparing SSA and OVA responses due to SSA heterogeneity is illustrated for two patients with high OVA values in Figure S1 in Supplementary Material. Nevertheless, a linear regression of the sum of seven individual antibody responses and the overall antibody titers yielded acceptable Pearson correlation coefficients of r = 0.47 and r = 0.56 for pre-and post-immunization antibody titers, respectively (p < 0.001 for both).

A significant intergroup difference was observed for all the OVA criteria: the pre- and post-immunization titers (p = 0.004 and p < 0.001, respectively), the post-immunization increase and the post-/pre-immunization titer ratio (p < 0.001 for both) (Table 1; Figure 1). It is noteworthy that despite the presence of a significant difference in the median post-immunization titer between good responders and poor responders [480 (114–1360) and 100 (9–1010) mg/L, respectively; p < 0.001], several poor responders (n = 4, 9.5%) achieved high (>270 mg/L) post-immunization titers (Table 1; Figure 1).

FIGURE 1

Figure 1. Box-plot representations of overall assay (OVA) antibody titers for good responders vs. poor responders, using the four indicated parameters: (A) OVA pre-immunization levels, (B) OVA post-immunization levels, (C) OVA post-immunization increase, and (D) OVA post-/pre-ratio. p-Values were calculated in a Mann–Whitney test. Boxes represent the median (50th percentile) and the 25th and 75th percentiles. Whiskers represent the 5th and 95th percentiles, and points are used to indicate extreme values.

The results of ROC curve analyses of the OVA’s performance vs. the SSA are summarized in Figure 2. In multiple AUC comparisons (data not shown), the post-immunization titer and the post-immunization increase discriminated between poor and good responders [AUCs, 95% confidence interval (CI) of 0.910 (95% CI, 0.810–0.968) and 0.921 (95% CI, 0.824–0.974), respectively] better than the pre-immunization titer and the post-/pre-ratio did.

FIGURE 2

Figure 2. Receiver operating characteristic (ROC) curves for the four tested parameters. Estimated areas under the curve (AUCs) are presented with their (95% CI) and p values. The Youden index and best-choice criterion are indicated for each ROC curve.

Indicators of the OVA’s performance are presented in Table 2. In summary, an analysis of all four potential determinants showed that the Se increased and the Sp decreased as the magnitude of the response increased. Following calculation of the Youden index, the two best criteria were found to be a post-immunization antibody titer ≤230 mg/L and a post-immunization increase of ≤139 mg/L although neither of them achieved estimates of Se and Sp greater than 90%. As expected, the overall agreement was poor for most of the potentially determinant variables. McNemar’s test evidenced significant differences for a post-immunization titer of 230 mg/L (p = 0.008), and an increase of at least 139 mg/L (p = 0.049). Cohen’s kappa was never better than moderate (<0.60) for any of the criteria (Table 2).

TABLE 2

Table 2. Performance indicators and levels of agreement for the overall assay (OVA)’s results.^a

Given that our objective was to determine the value of first-intention use of the OVA, we searched for an easy-to-use criterion that maximized Sp (regardless of Se) than thus provided a reliable diagnosis. We found that a post-immunization threshold of 110 mg/L yielded the greatest Sp and correctly identified a high proportion of the poor responders [Se 57.8% (95% CI, 38.7–70.2); Sp 100.0% (95% CI, 83.2–100.0)].

When analyzing a broader set of 16 anti-serotype titers, only 1 of the 20 tested patients (5.0%) was reclassified (from a good responder to a poor responder). This 18-year-old woman presented with hypogammaglobulinemia and recurrent respiratory tract infections. She showed a good response for 5 of the first 7 serotypes tested in SSA but for only 11 of the 16 serotypes in total. In the OVA, the pre- and post-immunization titers were 17 and 182 mg/L, respectively. Consequently, only a slight decrease in Se was noted [Se 56.1% (95% CI, 42.1–70.1), Sp 100% (95% CI, 81.4–100)] when re-calculating the selected performance values for a threshold of 110 mg/L.

The Prospective Validation Study

Participants

Twenty patients were included in the validation study [17 females (85%); median (range) age at inclusion: 45.5 (28–63) years].

Diagnostic Performance of the OVA

Using the OVA assay, seven patients presented post-vaccination titers below the 110 mg/L threshold; of these, two patients with very low post-vaccination OVA titers (48 and 76 mg/L) were first categorized as good responders by the SSA performed on seven serotypes. Consequently, the OVA-estimated performances were as follows: Se: 62.5% [24.5–91.5]; Sp 83.3% [51.6–97.9]. It is noteworthy that the two patients with very low post-vaccination OVA titers presented a good response for five of the first seven serotypes tested. As for the case described above, analysis of the 16 serotypes with an SSA for these two patients resulted in reclassification, with good responses to, respectively, eight serotypes (50.0%) and 7 serotypes (43.8%). After the re-assignment of both patients to the PID group (both SPAD), the OVA assay gave satisfactory values for diagnostic performance (Se: 70.0% [34.8–93.3]; Sp: 100.0% [69.2–100.0]; positive predictive value: 100.0% [65.3–100.0]). The flow chart for the prospective validation study is available in Figure S2 in Supplementary Material, along with the OVA’s diagnostic performance.

Discussion

The present study is the first to have investigated the diagnostic value of a widely available OVA commercial kit in patients with a suspected PID by using the reference SSA to identify good responders and poor responders. Given that we wanted to establish whether use of the OVA alone could reliably identify a poor responder in routine clinical practice, we favored a high Sp. The most value parameter was a post-immunization titer below or equal to 110 mg/L [Sp 100% (95% CI, 83.2–100)]. However, the application of this cut-off value detected only around half of the poor responders [Se 57.8% (95% CI, 38.7–70.2)]—confirming that the SSA is required in a two-step procedure for patients with a post-immunization titer above 110 mg/L.

In a context of suspected PID, an anti-PnPS response assessment is of great clinical value. However, the gold-standard assay may prove both difficult to access and expensive to implement. The great inter-serotype heterogeneity of the anti-PnPS response in a given patient and the large inter-patient heterogeneity for a given serotype (as illustrated in Figure S1 in Supplementary Material) have long been recognized as important issues in assessment of anti-PnPS responses (9, 10). An isolated, elevated response to a single serotype may indeed be responsible for a high OVA value (18) (Figure S1 in Supplementary Material).

To overcome the heterogeneity problem, a number of multiplexed tests have been developed and evaluated for the diagnosis of impaired anti-PS responses. Many studies have evaluated the performance of Luminex^®-based assays based on either in-house protocols or the 14-valent kit sold by Luminex Corporation (Austin, TX, USA) (6, 19), and several researchers have proposed specific cut-off values and/or qualitative criteria for the interpretation of Luminex^® results—thus enabling the use of this time- and cost-saving method (6, 7, 20–24).

Other types of assays have been proposed for the assessment of anti-PS immunization in suspected cases of PID. The results for measurement of allohemagglutinins did not support the use of this approach for assessment of the response to PSs (25). More recently, Salmonella Typhi Vi vaccination was investigated as an alternative tool for PS response assessment (26). Primary results were promising but patients and physicians might be reluctant to use the Typhim Vi vaccine systemically and the assay appeared to be less performant in case of previous immunization/infection. Although cut-off values for an S. typhi Vi vaccine response were recently proposed (7), pneumococcal vaccination is still the reference for assessment of the response to PSs (15). In this context, we sought to determine the diagnostic value of one of the assays most frequently used in routine practice.

Linear regression of the sum of seven individual SSA values yielded a low correlation coefficient for the pre-immunization titer (r = 0.47), and a slightly higher coefficient for the post-immunization titer (r = 0.56). In the subset of patients in whom the antibody responses to 16 serotypes had been measured, the pre-immunization titer again had a low correlation coefficient (r = 0.47). By contrast, the coefficient for the post-immunization titer was much higher (r = 0.92). Our present results are consistent with the literature data (13, 16). The increase in the correlation coefficient was expected, since anti-pneumococcal antibodies are known to bind more specifically to their antigens after immunization (27).

To assess the relevance of the OVA’s values, we tested four different parameters: the pre-immunization titer, the post-immunization titer, the total post-immunization increase, and the post-/pre-immunization ratio. On the population level, comparisons of the raw OVA data identified significant differences between good responders and poor responders for all four parameters (Table 1; Figure 1). In another study of the OVA, Sánchez-Ramón et al. reported significant differences in the pre- and post-immunization titers between CVID patients and healthy controls [p = 0.02 and p = 0.006, respectively (26)]. We expected the pre-immunization titer to discriminate less well between good responders and poor responders, since basal pneumococcal antibody titers mainly depend on previous infections and immunizations (2). On the individual level, our ROC curve analyses revealed significantly greater AUCs for the post-immunization titer and the post-immunization increase. Although we investigated the best values according to the Youden index, a satisfactory threshold was not found. Given that several criteria yielded non-significant differences in McNemar’s test, Cohen’s agreement statistic was consistently low—ruling out the reliable use of the OVA alone.

Since our aim was to integrate the OVA into a combined diagnosis approach (rather than replace the SSA), we nevertheless investigated the relevance of a two-step process in which the OVA assay could be used as a screening test for impaired PS responses. Intuitively (and despite the problem of response heterogeneity), patients who fail to increase their antibody titers and/or have rather low overall titers could possibly be bad responders. Accordingly, we determined that a post-immunization titer ≤110 mg/L had diagnostic value as the highest OVA value that would always identify poor responders [accounting for around half of the positive cases: Se 57.8% (95% CI, 38.7–70.2), Sp 100% (95% CI, 83.2–100.0)].

To validate our results, we measured nine additional anti-serotype antibody titers in 20 patients for whom sufficient volumes of serum had been collected before and after administration of PPV23. Only one patient (5.0%) was reclassified as a poor responder rather than a good responder, despite a relatively similar proportion of good serotype responses [from n = 5 out of 7 (71.4%) to n = 11 out of 16 (68.8%)]. These data emphasize that a seven-SSA analysis is reliable. After recalculation, the Se and Sp for a ≤110 mg/L threshold were, respectively, 56.1% (95% CI, 42.1–70.1) and 100% (95% CI, 81.4–100).

Lastly, we evaluated the threshold of 110 mg/L on 20 additional patients. Given that reclassification (from good responders to bad responders) had been required for the 16-serotypes SSA, we checked the two patients with very low post-immunization OVA levels and who had initially been classified as good responders. Using the 16-serotypes SSA, both were reclassified as poor responders, and so the OVA’s diagnostic performance with the 110 mg/L threshold was similar to that observed in the retrospective study [Se: 70.0% (34.8–93.3); Sp: 100.0% (69.2–100.0); positive predictive value: 100.0% (65.3–100.0)] (Figure S2 in Supplementary Material).

Our study has several limitations. The study participants were all adults and had been referred for a suspected PID. Only 42 (67.7%) received a final diagnosis of PID—thanks to an analysis of their PPV23 response, in many cases. It has been reported that the likelihood of identifying a PID is surprisingly high when adult patients are referred to specialist centers (28). This high diagnosis rate may also be related to our selection procedure, which was based on referral for SSAs: in our establishments, only highly probable cases are tested with SSAs in order to obtain a diagnosis and confirm an indication for immunoglobulin replacement therapy. Nevertheless, we also included some good responders, and we used the most recent, widely accepted interpretation criteria to evaluate our results.

Concerns about the specificity of the gold-standard SSA method were recently raised, since one study found that about 11.2 to 20.4% of healthy adults (depending on the criteria applied) with no history of infection had PS antibody deficiencies (29). Given that the latter study was based on a bead-based serotype-specific assay, it may suffer from a lack of specificity. This was suggested in previous studies in which the absolute antibody concentrations obtained by both methods remained different, despite a good overall correlation (11, 21, 30, 31). In a recent study, the authors advanced that AAAAI criteria could not be applied to SSA and to an in-house Luminex^® bead-based assay (7). However, the use of a 3-serotypes SSA and a shorter (3–4 weeks) time interval between immunization and sample collection could also explain some weak responses and that 11 to 34% of the healthy subjects were classified as SPAD with the SSA or with the bead-based assay, respectively. To conclude, the authors suggested some interesting fifth percentile cut-off values for the interpretation of the PPV response measured by their in-house bead-based assay, as a way to overcome this possible lack of specificity (7).

Despite the clear need for further studies of the clinical relevance of an impaired antibody response to PS in subjects without any medical history suggestive of PID, and considering that all our patients had recurrent and/or severe unexplained bacterial infections consistent with a possible antibody deficiency, we believe that this potential source of bias was limited in the present study (7, 15, 29).

It should also be noted that our approach cannot distinguish between the four SPAD phenotypes (namely mild, moderate, severe, and memory) (2, 32). Nevertheless, the SPAD phenotype has never been linked to clinical presentations and/or complications—although very recent data suggest that it might be of value in guiding treatment decisions (15).

No patient with a post-immunization overall antibody titer ≤110 mg/L exhibited a good response using the 16-serotypes SSA. Indeed, a post-immunization overall antibody titer ≤110 mg/L yielded maximum specificity [100% (95% CI, 83.2–100.0)] and a high positive predictive value [100% (95% CI, 85.2–100.0)], although the high prevalence of poor responders in our population means that these predictive values should be confirmed in a larger cohort. Consequently, an impaired response can be diagnosed if the post-immunization overall antibody titer is ≤110 mg/L. However, the observation of higher antibody titers would require the application of SSAs for a definitive diagnosis. Accordingly, we propose a two-step diagnostic approach based on OVA screening and the use of SSAs when the post-immunization titer is >110 mg/L (Figure 3).

FIGURE 3

Figure 3. A decision tree using the overall assay (OVA) as a first-line test and SSAs for definitive assessment of the anti-PnPS response.

Finally, we evaluated only one commercial overall anti-pneumococcal response assay, and a similar comparison method should be applied to other commercial and in-house overall assays.

Conclusion

We evaluated the diagnostic performance of an OVA for the assessment of impaired anti-PS responses. If the gold standard, WHO-validated SSA is not available, a commercial OVA may be of value in screening for PIDs. Our results suggest that a post-vaccination antibody titer below 110 mg/L in the OVA is associated with a poor PPV23 response. In all other cases, SSA is the only reliable method for assessing the response to PPV23.

Ethics Statement

Concerning the patients (n = 33/82) included through the above-mentioned ongoing adult PIDs screening (ClinicalTrials ref: NCT02972281), this study was carried out in accordance with the recommendations of the Helsinki Declaration and complied with the requirements of the French Commission Nationale Informatique et Libertés, with written informed consent from all subjects. The reference code of the Agence Nationale de Sécurité du Médicament et des produits de santé (ANSM) is 140857B-61. Concerning the other patients (n = 49/82), the used samples came from a collection declared to the French Ministry in charge of Research (No. DC-2008-642). In accordance with French regulations, the process for declaring human biological collections for research purposes involves an independent ethics committee (i.e., the committee for the protection of individuals) and the opinion of this committee is decision-making. Consequently, it is recognized that the authorization issued by the Ministry in charge of Research takes the place of advice from the ethics committee.

Author Contributions

BL and GL designed the study, analyzed and interpreted the data, and drafted the manuscript. CF, LT, DL, and GL have contributed to patients’ recruitment and data acquisition, and provided critical revision of the manuscript. MB, SM, MJ, and SP were responsible for parts of the data acquisition and contributed to critically revise the manuscript. SR, SB, A-SD, SD, FB, and ML supplied help to data interpretation and revision of the manuscript. All authors gave final approval of the version to be published.

Conflict of Interest Statement

VaccZyme™ Anti-PCP human IgG ELISA kits were donated by the Binding Site Group Ltd., Birmingham, UK. Binding Site Group Ltd. had no role in experimental design or analysis. BL received travel and accomodation support from the Binding Site Group Ltd. for a congress. There are no other financial or commercial relationships to declare.

Funding

The Lille University Hospital, the Imagine Institute/CEREDIH (Centre de Référence des Déficits Immunitaires Héréditaires), Octapharma, CSL Behring, Laboratoire Français de Fractionnement et de Biotechnologies (LFB) S.A., and Air Liquide S.A provided supportive grants for patients’ inclusion in an ongoing PIDs screening study (ClinicalTrials ref: NCT02972281).

Supplementary Material

The Supplementary Material for this article can be found online at http://www.frontiersin.org/articles/10.3389/fimmu.2017.01862/full#supplementary-material.

Figure S1. Examples of discrepancies between SSA and overall assay (OVA) results for two representative patients. Antibody titers are displayed as histograms (blue: pre-immunization, red: post-immunization). The dotted line corresponds to the 1.3 mg/L cutoff for a good individual serotype response.

Figure S2. Flow chart for the prospective validation study. The numbers of patients are given with the overall assay (OVA) performances for the previously determined 110 mg/L threshold. Sp, specificity; PPV, positive predictive value.

Abbreviations

AAAAI, American academy of asthma, allergy and immunology; AUC, area under the curve; CVID, common variable immunodeficiency; ELISA, enzyme-linked immunosorbent assay; OVA, overall response assay; PID, primary immunodeficiency; PPV23, 23-valent pneumococcal polysaccharide vaccine; PnPS, pneumococcal capsular polysaccharide; ROC, receiver operating characteristic; Se, sensitivity; Sp, specificity; SPAD, selective anti-polysaccharide antibody deficiency; SSA, serotype-specific assay; WHO, World Health Organization.

References

1. Bonilla FA, Khan DA, Ballas ZK, Chinen J, Frank MM, Hsu JT, et al. Practice parameter for the diagnosis and management of primary immunodeficiency. J Allergy Clin Immunol (2015) 136:e1–78. doi:10.1016/j.jaci.2015.04.049

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Orange JS, Ballow M, Stiehm ER, Ballas ZK, Chinen J, De La Morena M, et al. Use and interpretation of diagnostic vaccination in primary immunodeficiency: a working group report of the basic and clinical immunology interest section of the American academy of allergy, asthma & immunology. J Allergy Clin Immunol (2012) 130:S1–24. doi:10.1016/j.jaci.2012.07.002

CrossRef Full Text | Google Scholar

3. Wernette CM, Frasch CE, Madore D, Carlone G, Goldblatt D, Plikaytis B, et al. Enzyme-linked immunosorbent assay for quantitation of human antibodies to pneumococcal polysaccharides. Clin Vaccine Immunol (2003) 10:514–9. doi:10.1128/CDLI.10.4.514-519.2003

CrossRef Full Text | Google Scholar

4. Pickering J, Hoopes J, Groll M, Romero H, Wall D, Sant H, et al. 22-plex chemiluminescent microarray for pneumococcal antibodies. Am J Clin Pathol (2007) 128:23–31. doi:10.1309/781K5W6QH7JH2TMA

CrossRef Full Text | Google Scholar

5. Goldblatt D, Ashton L, Zhang Y, Antonello J, Marchese RD. Comparison of a new multiplex binding assay versus the enzyme-linked immunosorbent assay for measurement of serotype-specific pneumococcal capsular polysaccharide IgG. Clin Vaccine Immunol (2011) 18:1744–51. doi:10.1128/CVI.05158-11

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Hill HR, Pickering JW. Reference laboratory agreement on multianalyte pneumococcal antibody results: an absolute must! Clin Vaccine Immunol (2013) 20:955–6. doi:10.1128/CVI.00325-13

CrossRef Full Text | Google Scholar

7. Schaballie H, Bosch B, Schrijvers R, Proesmans M, De Boeck K, Boon MN, et al. Fifth percentile cutoff values for antipneumococcal polysaccharide and anti-Salmonella typhi Vi IgG describe a normal polysaccharide response. Front Immunol (2017) 8:546. doi:10.3389/fimmu.2017.00546

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Schauer U, Stemberg F, Rieger CHL, Buttner W, Borte M, Schubert S, et al. Levels of antibodies specific to tetanus toxoid, Haemophilus influenzae type B, and pneumococcal capsular polysaccharide in healthy children and adults. Clin Vaccine Immunol (2003) 10:202–7. doi:10.1128/CDLI.10.2.202-207.2003

CrossRef Full Text | Google Scholar

9. Go ES, Ballas ZK. Anti-pneumococcal antibody response in normal subjects: a meta-analysis. J Allergy Clin Immunol (1996) 98:205–15. doi:10.1016/S0091-6749(96)70244-0

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Sorensen RU, Leiva LE, Javier FC III, Sacerdote DM, Bradford N, Butler B, et al. Influence of age on the response to Streptococcus pneumoniae vaccine in patients with recurrent infections and normal immunoglobulin concentrations. J Allergy Clin Immunol (1998) 102:215–21. doi:10.1016/S0091-6749(98)70089-2

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Borgers H, Moens L, Picard C, Jeurissen A, Raes M, Sauer K, et al. Laboratory diagnosis of specific antibody deficiency to pneumococcal capsular polysaccharide antigens by multiplexed bead assay. Clin Immunol (2010) 134:198–205. doi:10.1016/j.clim.2009.10.006

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Schütz K, Hughes RG, Parker A, Quinti I, Thon V, Cavaliere M, et al. Kinetics of IgM and IgA antibody response to 23-valent pneumococcal polysaccharide vaccination in healthy subjects. J Clin Immunol (2013) 33:288–96. doi:10.1007/s10875-012-9792-y

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Rose MA, Buess J, Ventur Y, Zielen S, Herrmann E, Schulze J, et al. Reference ranges and cutoff levels of pneumococcal antibody global serum assays (IgG and IgG2) and specific antibodies in healthy children and adults. Med Microbiol Immunol (2013) 202:285–94. doi:10.1007/s00430-013-0292-3

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Picard C, Al-Herz W, Bousfiha A, Casanova J-L, Chatila T, Conley ME, et al. Primary immunodeficiency diseases: an update on the classification from the International Union of Immunological Societies Expert Committee for primary immunodeficiency 2015. J Clin Immunol (2015) 35:696–726. doi:10.1007/s10875-015-0201-1

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Perez E, Bonilla FA, Orange JS, Ballow M. Specific antibody deficiency: controversies in diagnosis and management. Front Immunol (2017) 8:586. doi:10.3389/fimmu.2017.00586

CrossRef Full Text | Google Scholar

16. Rubins JB, Alter M, Loch J, Janoff EN. Determination of antibody responses of elderly adults to all 23 capsular polysaccharides after pneumococcal vaccination. Infect Immun (1999) 67:5979–84.

PubMed Abstract | Google Scholar

17. Lopez B, Boucher A, Bahuaud M, Mortuaire G, Melliez H, Launay D, et al. Specific polysaccharide antibody deficiency revealed by severe bacterial infections in adulthood: a report on 11 cases. Clin Infect Dis (2017) 65(2):328–31. doi:10.1093/cid/cix284

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Janssen WJM, Bloem AC, Vellekoop P, Driessen GJ, Boes M, van Montfrans JM. Measurement of pneumococcal polysaccharide vaccine responses for immunodeficiency diagnostics: combined IgG responses compared to serotype specific IgG responses. J Clin Immunol (2014) 34:3–6. doi:10.1007/s10875-013-9925-y

CrossRef Full Text | Google Scholar

19. Pickering JW, Martins TB, Greer RW, Schroder MC, Astill ME, Litwin CM, et al. A multiplexed fluorescent microsphere immunoassay for antibodies to pneumococcal capsular polysaccharides. Am J Clin Pathol (2002) 117:589–96. doi:10.1309/LMCH-C4Q2-VFL9-3T1A

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Borgers H, Jeurissen A, Flamaing J, Peetermans WE, Moens L, Verhaegen J, et al. Elderly subjects do not show impaired pneumococcal capsular polysaccharide serotype-specific antibody responses as assessed by a multiplexed bead assay. Clin Immunol (2010) 135:501–2. doi:10.1016/j.clim.2010.01.017

CrossRef Full Text | Google Scholar

21. Balloch A, Licciardi PV, Tang MLK. Serotype-specific anti-pneumococcal IgG and immune competence: critical differences in interpretation criteria when different methods are used. J Clin Immunol (2013) 33:335–41. doi:10.1007/s10875-012-9806-9

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Zhang X, Simmerman K, Yen-Lieberman B, Daly TM. Impact of analytical variability on clinical interpretation of multiplex pneumococcal serology assays. Clin Vaccine Immunol (2013) 20:957–61. doi:10.1128/CVI.00223-13

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Daly TM, Pickering JW, Zhang X, Prince HE, Hill HR. Multilaboratory assessment of threshold versus fold-change algorithms for minimizing analytical variability in multiplexed pneumococcal IgG measurements. Clin Vaccine Immunol (2014) 21:982–8. doi:10.1128/CVI.00235-14

CrossRef Full Text | Google Scholar

24. Daly TM, Hill HR. Use and clinical interpretation of pneumococcal antibody measurements in the evaluation of humoral immune function. Clin Vaccine Immunol (2015) 22:148–52. doi:10.1128/CVI.00735-14

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Schaballie H, Vermeulen F, Verbinnen B, Frans G, Vermeulen E, Proesmans M, et al. Value of allohemagglutinins in the diagnosis of a polysaccharide antibody deficiency: allohemagglutinins for polysaccharide antibody deficiency diagnosis. Clin Exp Immunol (2014) 180(2):271–9. doi:10.1111/cei.12571

CrossRef Full Text | Google Scholar

26. Sánchez-Ramón S, de Gracia J, García-Alonso A, Rodríguez Molina JJ, Melero J, de Andrés A, et al. Multicenter study for the evaluation of the antibody response against Salmonella typhi Vi vaccination (EMPATHY) for the diagnosis of anti-polysaccharide antibody production deficiency in patients with primary immunodeficiency. Clin Immunol (2016) 169:80–4. doi:10.1016/j.clim.2016.05.006

CrossRef Full Text | Google Scholar

27. Concepcion NF, Frasch CE. Pneumococcal type 22F polysaccharide absorption improves the specificity of a pneumococcal-polysaccharide enzyme-linked immunosorbent assay. Clin Vaccine Immunol (2001) 8:266–72. doi:10.1128/CDLI.8.2.266-272.2001

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Rosenberg E, Dent PB, Denburg JA. Primary immune deficiencies in the adult: a previously underrecognized common condition. J Allergy Clin Immunol Pract (2016) 4:1101–7. doi:10.1016/j.jaip.2016.09.004

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Keswani A, Dunn NM, Manzur A, Kashani S, Bossuyt X, Grammer LC, et al. The clinical significance of specific antibody deficiency (SAD) severity in chronic rhinosinusitis (CRS). J Allergy Clin Immunol Pract (2017) 5:1105–11. doi:10.1016/j.jaip.2016.11.033

CrossRef Full Text | Google Scholar

30. Whaley MJ, Rose C, Martinez J, Laher G, Sammons DL, Smith JP, et al. Interlaboratory comparison of three multiplexed bead-based immunoassays for measuring serum antibodies to pneumococcal polysaccharides. Clin Vaccine Immunol (2010) 17:862–9. doi:10.1128/CVI.00022-10

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Lal G, Balmer P, Stanford E, Martin S, Warrington R, Borrow R. Development and validation of a nonaplex assay for the simultaneous quantitation of antibodies to nine Streptococcus pneumoniae serotypes. J Immunol Methods (2005) 296:135–47. doi:10.1016/j.jim.2004.11.006

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Sorensen RU, Harvey T, Lily L. Selective antibody deficiency with normal immunoglobulins. In: Metodiev K, editor. Immunodeficiency. New York: InTech (2012).

Google Scholar