Skip to main content

ORIGINAL RESEARCH article

Front. Oncol., 11 January 2022
Sec. Genitourinary Oncology
This article is part of the Research Topic Women in Genitourinary Oncology: 2021 View all 11 articles

Cost and Toxicity Comparisons of Two IMRT Techniques for Prostate Cancer: A Micro-Costing Study and Weighted Propensity Score Analysis Based on a Prospective Study

Ingrid Masson&#x;Ingrid Masson1†Martine Bellanger,*&#x;Martine Bellanger2,3*†Genevive PerrocheauGeneviève Perrocheau2Marc-Andr Mah,Marc-André Mahé1,4David AzriaDavid Azria5Pascal PommierPascal Pommier6Nathalie Mesgouez-NeboutNathalie Mesgouez-Nebout7Philippe GiraudPhilippe Giraud8Didier PeiffertDidier Peiffert9Bruno ChauvetBruno Chauvet10Philippe DudouetPhilippe Dudouet11Naji SalemNaji Salem12Georges NoëlGeorges Noël13Jonathan KhalifaJonathan Khalifa14Igor LatorzeffIgor Latorzeff15Catherine Gurin-Charbonnel,Catherine Guérin-Charbonnel16,17Stphane SupiotStéphane Supiot1
  • 1Department of Radiation Oncology, Institut de Cancérologie de l’Ouest René Gauducheau, Saint-Herblain, France
  • 2Department of Human and Social Sciences, Institut de Cancérologie de l’Ouest René Gauducheau, Saint-Herblain, France
  • 3UMR CNRS6051, EHESP (Ecole des Hautes Etudes en Santé Publique - School of Public Health), University of Rennes, Rennes, France
  • 4Department of Radiation Oncology, François Baclesse Cancer Center, Caen, France
  • 5Fédération Universitaire d’Oncologie Radiothérapie (FOROM), Institut Régional du Cancer Montpellier (ICM), Université de Montpellier, Institut de Recherche en Cancérologie de Montpellier (IRCM), Montpellier, France
  • 6Department of Radiation Oncology, Léon Bérard Center, Lyon, France
  • 7Department of Radiation Oncology, Institut de Cancérologie de l’Ouest Paul Papin, Angers, France
  • 8Department of Radiation Oncology, Georges Pompidou European Hospital, Paris, France
  • 9Department of Radiation Oncology, Lorraine Cancer Institute, Vandœuvre-lès-Nancy, France
  • 10Department of Radiation Oncology, Sainte Catherine Institute, Avignon, France
  • 11Department of Radiation Oncology, Pont de Chaume Clinic, Montauban, France
  • 12Department of Radiation Oncology, Paoli-Calmettes Institute, Marseille, France
  • 13Department of Radiation Oncology, Cancerology Institute of Strasbourg-Europe, Strasbourg, France
  • 14Department of Radiation Oncology, Institut Universitaire du Cancer de Toulouse-Oncopole (IUCT-Oncopole), Toulouse, France
  • 15Department of Radiation Oncology, Pasteur Clinic, Toulouse, France
  • 16Clinical Trial Sponsor Unit/Biometry, Institut de Cancérologie de l’Ouest René Gauducheau, Saint-Herblain, France
  • 17Centre de Recherche en Cancérologie et Immunologie Nantes Angers - Center for Research in Cancerology and Immunology Nantes-Angers (CRCINA), Institut National de la Santé et de la Recherche Médicale - National Institute for Health and Medical Research (INSERM) UMR1232, Centre National de la Recherche Scientifique - National Center for Scientific Research (CNRS) ERL6001, University of Nantes, Nantes, France

Background: Intensity modulated radiation therapy (IMRT) combined with androgen deprivation therapy (ADT) has become the standard treatment for patients with high-risk prostate cancer. Two techniques of rotational IMRT are commonly used in this indication: Volumetric Modulated Arc Therapy (VMAT) and helical tomotherapy (HT). To the best of our knowledge, no study has compared their related costs and clinical effectiveness and/or toxicity in prostate cancer. We aimed to assess differences in costs and toxicity between VMAT and HT in patients with high-risk prostate cancer with pelvic irradiation.

Material and Methods: We used data from the “RCMI pelvis” prospective multicenter study (NCT01325961) including 155 patients. We used a micro-costing methodology to identify cost differences between VMAT and HT. To assess the effects of the two techniques on total actual costs per patient and on toxicity we used stabilized inverse probability of treatment weighting.

Results: The mean total cost for HT, €2019 3,069 (95% CI, 2,885–3,285) was significantly higher than the mean cost for VMAT €2019 2,544 (95% CI, 2,443–2,651) (p <.0001). The mean ± SD labor and accelerator cost for HT was €2880 (± 583) and €1978 (± 475) for VMAT, with 81 and 76% for accelerator, respectively. Acute GI and GU toxicity were more frequent in VMAT than in HT (p = .021 and p = .042, respectively). Late toxicity no longer differed between the two groups up to 24 months after completion of treatment.

Conclusion: Use of VMAT was associated with lower costs for IMRT planning and treatment than HT. Similar stabilized long-term toxicity was reported in both groups after higher acute GI and GU toxicity in VMAT. The estimates provided can benefit future modeling work like cost-effectiveness analysis.

Introduction

Intensity modulated radiation therapy (IMRT) combined with androgen deprivation therapy (ADT) for 2–3 years has become the standard treatment for patients with high-risk prostate cancer (16). The further technological improvement with rotational modulated radiotherapy makes it possible to achieve dose escalation in the primary tumor while sparing normal tissues or organs. Two techniques of rotational IMRT are commonly used: Volumetric Modulated Arc Therapy (VMAT RapidArc™ Varian Medical Systems and VMAT® Elekta) and helical tomotherapy (HT: Tomotherapy® Accuray).

Several studies have suggested more favorable dosimetric parameters with VMAT when compared with step-and-shoot or conventional IMRT in patients with prostate cancers, including high-risk prostate cancers (712). VMAT results in improved sparing of organs at risk (OARs) and delivery efficiency, combined with significantly lower treatment time and reduced monitor units (MUs) (712). There was no worsening clinical effectiveness or toxicity reported (7).

When comparing VMAT techniques and helical tomotherapy (HT) only small significant dosimetric differences in prostate cancer were observed (13) including high-risk prostate cancer with pelvic nodal irradiation (14). Both accelerators exhibited the same plan quality (13), but with more homogeneous dose distribution for HT (14) and in some studies, better OAR sparing for HT (15, 16), whereas VMAT was associated with shorter treatment time and lower MUs (13, 14, 16). There was no comparative analysis of clinical effectiveness or toxicity of VMAT versus HT in high-risk prostate cancer, whether the radiotherapy was to the prostate alone or to the prostate and pelvic lymph nodes.

Among attempts to estimate costs and effectiveness associated with these advanced technologies, we retrieved only one in prostate cancer that compared VMAT to IMRT and found it “cost-effective” (7). In a recent systematic review on cost-effectiveness of prostate cancer radiotherapy, stereotactic body radiotherapy (SBRT) appeared the least expensive from a societal perspective followed by IMRT. Proton beam therapy (PBT) was both the most expensive and the least effective (17). Nevertheless, lack of evidence in cost estimates and “uncertainty surrounding improvements in outcomes” of new technologies (e.g., disease progression, adverse events) make cost-effectiveness analysis of “new versus traditional technologies of radiotherapy” in prostate cancer challenging (18).

To the best of our knowledge, no study has compared costs and clinical effectiveness and/or toxicity of VMAT versus HT in prostate cancer. Only two studies (19, 20) from a French prospective multicenter study evaluated the clinical outcomes and costs associated with these techniques in patients with head and neck cancer.

The present study aimed to assess differences in costs and toxicity between VMAT and helical tomotherapy in patients with high-risk prostate cancer. For this study, we considered no differences between VMAT RapidArc™ and VMAT® Elekta, as done in the literature, since this is the same VMAT technology developed by two manufacturers. We referred to them both as VMAT, when appropriate.

Materials and Methods

Study Design

We used data from the “Intensity modulated Radiation Therapy in pelvic lymph node irradiation” prospective multicenter study (so called in French “RCMI pelvis”), which aimed to compare costs and clinical outcomes of IMRT with VMAT (Rapid’Arc™ and VMAT® Elekta) versus helical tomotherapy (HT) (Tomotherapy®) in prostate, cervical, and anal canal cancers, with pelvic lymph node irradiation (https://www.clinicaltrials.gov/, NCT01325961). The “RCMI pelvis” study had the same protocol as the ‘ART-ORL’ study on head and neck cancer, and both studies were carried out jointly by fourteen French academic cancer centers (Supplementary Table A1) (19, 20). Patients were assigned to one of the accelerators based on their availability in each center or at the discretion of the investigators. No randomization between treatments was thus possible. The expected number of patients to be included was 20 anal canal cancers, 50 cervical cancers, and 150 prostate cancers. However, to obtain a homogenous population, for the current study we only selected patients with prostate cancer. The inclusion criteria were patients aged ≥18 years with histologically proven high-risk prostate cancer according to d’Amico’s classification (21) and the Eastern Cooperative Oncology Group (ECOG) Performance Status ≤2, and who received pelvic lymph node irradiation and androgen deprivation therapy (ADT) for 3 years. Patients included in the GETUG 18 trial were also eligible for the RCMI pelvis study (22). The exclusion criteria were lombo-aortic irradiation, salvage radiotherapy after radical prostatectomy, and re-irradiation. Enrolled patients had an abdominal, pelvic, and thoracic CT Scan and/or Positron Emission Tomography–Computed Tomography (PET-CT) and Prostate specific antigen (PSA) test. Delineation followed guidelines for high-risk prostate cancer (22). Clinical Target Volume (CTV) 1 included pelvic lymph node areas, prostate, and seminal vesicles. CTV 2 was limited to the prostate. Planning Target Volume (PTV) 1 and 2 were respectively defined by: CTV1 + 1 cm, CTV2 + 1 cm (+0.5 cm posterior). A moderate hypofractionated Simultaneous Integrated Boost (SIB) plan was delivered to 34 fractions: 54.4 Gy to PTV1 and 74.8 Gy to PTV2. For GETUG 18 trial patients only, a normo-fractionated sequential plan was delivered in 40 fractions: 46 Gy to PTV 1 then 34 Gy to PTV2. Dose prescription followed the International Commission on Radiation Units 83 (23). All patients provided signed informed consent to participate in the study. The study was approved by the National Ethics Committee (Ref: 11/03, 4 January 2011) and the National Committee for protection of personal data (DR-2011-277 N°911317).

Micro-Costing Study

The micro-costing methodology is considered the most accurate approach for costing hospital services (24). It makes it possible to identify all the resources used within hospital production processes and per patient (24). In our micro-costing study, we defined the production process as being from treatment planning to the last radiation therapy (RT) session. Of note, ADT was not included in the costing analysis, since this is a standardized procedure. To measure and value the resources used, we followed, and adapted when necessary, the previously described method of Perrier et al. (19). For this reason, we only identified use of resources that was likely to vary between VMAT and HT to estimate actual cost differences between the two strategies. Our study assumed differences in the resources used in all planning stages (i.e., image registration and contouring, inverse planning, patient-specific quality control (QC), and pre-treatment patient setup verification), along with treatment delivery, accelerator QC for IMRT, and preventive internal and external maintenance. CT scan planning was supposed to be similar in both techniques. We did not include Record and Verify Systems (RVSs) as Tomotherapy treatments were already integrated into the RVSs from the other manufacturers. Patient-specific Quality Assurance (QA) software, independent of the machine, was excluded accordingly. Last, we considered standard radiation bunker that may accommodate any accelerator currently used (19) and also any change in radiotherapy advancements over its life span. We therefore assumed similar construction costs for the two techniques studied.

Detailed data on resource utilization of labor and equipment were collected using chronometers. They included all personnel time spent and equipment mobilization time for each patient over their course of treatment. For example, for a treatment session, this ranged from a patient’s admission to discharge from the irradiation room. We thus included not only the time of treatment delivery, but also image control time and any potential interruption time. Labor included radiation therapist, dosimetrist, medical physicist, radiation oncologist, resident and biomedical technician. We assigned values of time resources used to estimate costs, as follows. Unit costs of labor were based on the average annual full gross wages (i.e., annual payroll taxes included) divided by the number of workable yearly hours. We estimated the full gross wage on a 15-year experience basis and on a collective labor agreement of UNICANCER, a consortium of the 18 French cancer centers. For all cost estimates, we used the same method as described in Perrier et al. (19), except for the costs of QC and internal maintenance (IM), given in Equation (1) below and for which resources were collected from questionnaires.

QC and IM cost=Σlabor=12 hourly full wageQC and IM Nhs(1)

Where Nhs = annual number of dedicated hours, and labor = medical physicist or biomedical technician.

We obtained data on capital resources, such as equipment (i.e., accelerator and Treatment Planning Systems—TPS—for VMAT only, as for HT accelerator cost includes TPS) from standardized questionnaires, as previously described (19). Equipment was valued using replacement and maintenance costs with a life expectancy of 12 years for the accelerators and 5 years for the TPS, based on data available from the literature (25, 26). We estimated the costs of accelerators, annual external maintenance contracts and TPS directly from the catalog prices of the manufacturers.

We estimated total actual costs per patient that vary between VMAT and HT from the hospital perspective. All estimates were in Euro 2019, all taxes included, but without discounting as the analytic time horizon for costs was less than 3 months. It is worth noting that we could not estimate the resources used for treatments associated with acute toxicity, since all treatment types, but hospitalization, were not collected in the frame of the study.

Toxicity

We analyzed acute toxicity (≤3 months) and late toxicity [up to 24 months, based on previously published studies (27, 28)], that were scored using the National Cancer Institute Common Terminology Criteria for Adverse Events (CTCAE) version 3.0. Toxicity was reported as follows: no toxicity (grade 0), grade 1, grade 2, and grades 3–4. Acute adverse events (serious adverse events with hospitalizations included) that were clinical outcomes within the same time horizon as the estimated costs were reported on electronic Case report forms (CRF). Besides, all late adverse events were collected as well. For the analysis, we reported Gastrointestinal (GI) toxicity, Genito-urinary (GU) toxicity, and sexual toxicity. Lastly, patient reported outcomes such as Quality of Life (QoL) were not investigated in this study.

Statistical Analysis

We described patients’ characteristics using mean and standard deviation (SD) for continuous variables, or count and percentage for categorical variables. In addition, we assessed differences between treatment groups, from the original datasets, using logistic regression, and multinomial logistic regression for binary variables and tumor stage (cT) respectively, and linear regression for continuous variables. We compared differences in hours spent for treatment, QC, and internal maintenance between the two techniques using a non-parametric Wilcoxon test and we used a paired Wilcoxon test for comparing differences in duration of treatment session. We tested uncertainty on the total cost of each technique by running a one-way sensitivity analysis over the range of plausible parameters and illustrating with a Tornado plot showing the impact of increasing and decreasing each of the parameters by 20%, a range suggested in the methods of sensitivity analysis in economic evaluation (29). In addition, we used probabilistic sensitivity analyses with a non-parametric bootstrap method, with 1,000 iterations, to obtain the 95% confidence intervals (CI) of total actual costs (30).

Similarly to Bibault et al. (20), we used propensity scores to obtain balancing covariates at enrollment in the VMAT and HT groups to address potential selection bias due to non-randomization (31). We used the stabilized inverse probability of treatment weighting (IPTW) (32). We estimated standardized differences to compare the balance in measured baseline covariates between the two treatment groups. Due to the study design, we could not include cancer center as a covariate, though it was likely to be a confounding factor. As mentioned above, investigators assigned patients to one of the accelerators based on their availability in each cancer center or at their discretion. We estimated the propensity score (PS) using a logistic regression in which treatment assignment was regressed (32). With ITPW, each patient was weighted by the inverse probability of receiving the treatment they actually received (i.e., 1/PS in the HT group and 1/(1 − PS) in the VMAT group). Finally, we applied the stabilized IPTW, to preserve the size of the pseudo-population as well as to reduce the variance of the treatment effect estimates (32).

To assess the impact of the two techniques on total costs and toxicity we ran linear regressions (costs) and ordered logistic regressions (toxicity) adjusting for sequential versus SIB plans. All regressions were performed before and after having introduced IPTW.

We performed all analyses using R software version 3.6.1. We used the stdidff package (https://CRAN.R-project.org/package=stddiff) to compute the standardized differences for all categorical variables with more than two levels.

Results

Patient Characteristics

Two hundred and fifteen patients were recruited between April 2011 and January 2015: 155 with prostate cancer, 30 with cervix cancer and 30 with anal cancer (Supplementary Figure A1). Of the 155 patients with prostate cancer, 106 patients were treated with VMAT and 49 with HT. We had information on resource use for all patients (155); and for toxicity, information was available for 147 patients (i.e., 98/106 in the VMAT group; 49/49 in the HT group).

At baseline, age, performance status, cT and cN stages, and PSA varied between the two techniques, (with significant differences for N stage). After IPTW, we observed almost no differences between the VMAT and HT groups (Table 1). For the Gleason scores, when checking the balance between groups we found no significant difference before or after weighting (p >0.5).

TABLE 1
www.frontiersin.org

Table 1 Patient characteristics.

Resource Use

We observed similar median annual treatment times (Interquartile range—IQR) spent with VMAT and helical tomotherapy (HT), with 2,513 h (IQR, 92.5) and 2,520 h (IQR, 216), respectively (P = .7). In addition, we did not find any statistical differences in median annual time spent for quality control and internal preventive maintenance, 194.5 h (IQR, 81.75) were spent with VMAT and 144 h (IQR, 56) with HT (p = .28). We found that the median time for the first session was 18 min per patient for HT and 20 min for VMAT (p = .31) (Supplementary Figure A2). Treatment times then decreased across sessions for VMAT (15 min) while keeping the same for HT (18 min) (p = .002 and p <.001), up to the fourth and more sessions, for which 13 and 17 min (p <.001) were reported for VMAT and HT, respectively. This demonstrates a learning process effect on time spent per patient.

Total Actual Costs per Patient

Table 2 presents the total actual costs per patient as well as major cost components. After inverse probability of treatment weighting and control for covariates, the mean cost for helical tomotherapy (HT), estimated at € 3,069 (95% CI, 2,885–3,285) was significantly higher than the mean cost for VMAT €2,544 (95% CI, 2,443–2,651) (p <.0001). We found a substantial variation in session costs (i.e., accelerator + labor costs), accounting for 94% of HT costs and only 78% of VMAT costs (p <.001) (Table 2). As shown in Table 2, only the planning phase was more costly for VMAT than for HT, with €566 (292), and €189 (117) mean costs (SD), respectively (p <.0001) (Table 2). This yielded a mean cost difference of €525 in the HT group compared with the VMAT group.

TABLE 2
www.frontiersin.org

Table 2 Total actual cost per patient (€2019) after Inverse probability of treatment weighting (IPTW).

The Tornado diagram (Figure 1) shows the most influential parameters (i.e., prices, cost, time with ±20% variation) on estimated costs. The latter were highly sensitive to the annual operating time as well as to the accelerator immobilization time (Figure 1). The costs decreased by 12.1 and 15.5% following a 20% increase in the annual operating time and a 20% decrease in the accelerator immobilization time, for VMAT and for HT, respectively. To a lesser extent, costs were sensitive to time spent by the radiation therapist (Figure 1).

FIGURE 1
www.frontiersin.org

Figure 1 Tornado diagram for VMAT (A) and helical tomotherapy (B) total actual costs. Tornado diagram shows the graphical output of the one- way sensitivity analysis. On the x-axis, the value of total cost, and the vertical line represents the total cost with all parameter baseline values. Each parameter has its own bar and the length of each bar shows how much impact that parameter can have total cost when varied 20% more of less than its baseline value is. The bars are arranged in descending order of length, so that the diagram exhibits from the most to the least sensitive factors.

For each technique, the sequential plan exhibited significantly higher costs than the SIB plan (p <.001), with €2,659 (95% CI, 2,504–2,834) versus €2,498 (95% CI, 2376–2657) for VMAT, and €3,902 (95% CI, 3473–4357) versus €2,895 (95% CI, 2754–3076) for helical tomotherapy. The variation was mainly due to the irradiation phase, where accelerator immobilization time and labor time were more expensive in the sequential process than in the SIB process (Supplementary Figure A3).

Acute and Late Toxicity

As shown in Table 3A, the proportion of patients with acute grade 3–4 toxicities was very low in both groups. This went from 0 to 1% of patients having Gastrointestinal (GI) toxicity (p = .033) to 4% with genitourinary (GU) toxicity in both groups (p = .145). After IPTW and control for covariates, we observed significantly higher frequency in acute GI and GU toxicities for VMAT than for HT (p = .021 and p = .042, respectively) but similar sexual toxicities in the two groups (p = .236).

TABLE 3
www.frontiersin.org

Table 3 Acute and late toxicity.

TABLE 3B
www.frontiersin.org

Table 3b Late toxicity*.

In the long-term period, in both unweighted and weighted populations, the proportions of patients for whom physicians reported late grade 3–4 toxicities remained dramatically low (with no more than 4% of patients experiencing grade 3–4 GI, GU and sexual toxicity), whatever the machine (Table 3B). Overall, VMAT and HT did not differ significantly in late GI, GU and sexual toxicity either (p = .162; p = .669; and p = .062 respectively after IPTW) (Table 3B).

There was no difference in serious adverse event related hospitalization, nor any permanent discontinuation of treatment reported in the study. In acute toxicity, we observed only one hospitalization due to dysuria in the HT group. In late toxicity, three hospitalizations were noted for dysuria on stenosis, hematuria, and rectal bleeding on radiation proctitis in the VMAT group and one for rectal bleeding on radiation proctitis in the HT group.

Discussion

The analysis based on the “RCMI pelvis” prospective multicenter study found that each hospital spent on average an additional €525 per patient when they used helical tomotherapy (HT) rather than VMAT for IMRT preparation and delivery in high-risk prostate cancer patients with pelvic lymph node irradiation. Considering health outcomes, although acute GI and GU toxicity were significantly higher for VMAT than for HT, the late toxicity outcomes (up to 24 months after completion of treatment) no longer differed between the two groups.

The economic results are consistent with the data on head and neck cancers published by Perrier et al., which show an excess in mean costs for HT over VMAT (19). In the two studies, the findings were explained by differences in the price of accelerators and in costs of external maintenance, along with differences in treatment times. Helical tomotherapy has remained more expensive than VMAT accelerators, despite a reduction in price variation between 2013 and 2019, the two years of estimation. In addition, longer RT sessions result in increased times spent by personnel and accelerators. The results from our study are also consistent with existing evidence on treatment delivery as a major cost component of IMRT (3335). In line with our estimates, and for prostate cancer, HT was associated with a longer average treatment delivery time than VMAT (15, 36). Of note, this finding holds true, whether time was measured only for irradiation (15, 36) or for the whole treatment delivery as we and Perrier et al. (19) did. For VMAT mostly, we observed a learning effect, which was previously demonstrated during the implementation process of new techniques (37). The micro-costing methodology makes possible time assessment that is closest to clinical practice. However, our evaluation differs from Perrier et al., as we estimated all times spent (such as operating time, QC time of treatment machines and internal maintenance) from standardized questionnaires completed by the cancer centers included in the study. This resulted in findings in line with the Health Economics in Radiation (ESTRO/HERO) project for which annual QC time estimated was 150 to 200 h, based on a time-driven, activity-based, costing methodology (TD-ABC) (25). Finally, the study observed lower costs for SIB hypofractionated IMRT compared to sequential IMRT in prostate cancers, and this, regardless of the accelerators, as in Hulstaert et al. who found lower average costs in hypofractionated schemes in lung and breast cancers compared to standard fractionation schemes (35). In the latter, treatment delivery was the major cost driver, a factor of cost variation that we also observed in the sensitivity analysis we carried out.

In our micro-costing study, we were able to refer to the Diagnosis-Related Group (DRG) related tariff for a given procedure, and that the national health insurance system (NHIS) reimburses hospitals. As reported in a recent European study, a higher reimbursement is made in France for treatments with helical tomotherapy when comparing to other VMAT machines (38). The current tariff for a HT session is twice that of a VMAT session when our actual estimations showed a 20% incremental cost (i.e., a € 525 (95% CI, 442–634) difference between the two techniques).

In terms of toxicity, comparative evidence between VMAT and helical tomotherapy is limited. Our study found significant higher frequency in acute GI and GU in VMAT than in HT, but no worse significant outcomes in late toxicity. Our results are similar to those of Bibault et al. in head and neck cancers (20), who after IPTW adjustment found significantly more acute salivary disorders in the VMAT group, but no difference between HT and VMAT in all toxicities evaluated in the long term (more than 15), except for salivary function (20). Stabilized long term symptoms after significant differences in acute symptoms associated with IMRT have been reported elsewhere (39).

Strengths and Limitations

This study used rigorous methods to assess the costs and toxicity associated with helical tomotherapy (HT) and VMAT IMRT in prostate cancers. The large variation in baseline characteristics between the two techniques demonstrated the importance of using the propensity score as it makes appropriate adjustment possible for reducing confounding bias when estimating treatment effects. In the economic analysis of radiotherapy, micro-costing represents an accurate method for collecting details of the resources used for costing procedures. To our knowledge, this study is the first of its kind to estimate the costs and toxicity of VMAT and HT in high-risk prostate cancers with pelvic lymph node irradiation with long follow-up time. The identification of treatment delivery as a major cost driver and source of difference between the techniques used is a result of particular interest, given cancer centers’ efforts to introduce new radiotherapy techniques. Applying micro-costing methodology contributes to a broader European (EU) effort to improve knowledge of the resources allocated to radiotherapy within the overall resources for treating cancer patients (26, 38, 4043), and ultimately to improve the quality of care. However, one should keep in mind that our evaluation was based on French cancer center labor costs and payment schemes, which differ from other EU and international oncology centers (38). This should be considered carefully before generalizing our findings.

This study has certain limitations. The first relate to the data collection. Collecting data in real-world clinical practice has some advantages, but it can also be challenging on both the clinical and the funding sides. This has resulted in variability in patients recruited across cancer centers and in a small population sample. In addition, randomization between treatment groups was not possible. We note that the propensity scores we used do not account for the effect of unmeasured covariates (44, 45). Because patients were assigned to only one technique in each cancer center, based on their availability (only 4 centers out of 14 had both VMAT and HT accelerators), or on investigators’ discretion, as earlier mentioned, we could not take the cancer center effect into account, although we expect that it is a confounding factor. Another limitation of the study is the difference in time horizon between the cost analysis and the toxicity assessment, due to data collected. We were not able to estimate the costs of treatments used for acute adverse events. This has resulted in underestimating short term costs, and has made impossible to relate the differences in cost to the differences in outcomes, a requirement in cost-effectiveness analysis. Moreover, as in any economic evaluation, and especially when conducting a micro-costing study, we made assumptions and simplifications that Perrier et al. have already reported (19) and that may have an impact on our final estimates. We thus advise caution before generalizing our results. Finally, our model does not apply to low- or intermediate risk prostate cancer patients where pelvic irradiation is not routinely recommended (46), where ADT is usually limited to unfavorable intermediate-risk tumors (5), and SBRT or proton therapy to the prostate gland only is a therapeutic option (46).

Conclusion

Assessing the effectiveness and value associated with the IMRT treatment of prostate cancer with pelvic lymph node irradiation is of particular importance. The study found evidence to support the hypothesis of cost differences between VMAT and HT for IMRT preparation and delivery in favor of VMAT, and no toxicity differences in the long term after more acute GI and GU toxicity for VMAT than for HT. Our findings have already the potential to help clinicians’ decision-making. For the payer, the French NIHS, these findings support an increase in the DRG reimbursement of a VMAT session. Our approach paved the way to a cost-effectiveness model that will combine the long-term health impacts of the two techniques, already identified, to the quality of life reported by patients to be assessed along with long-term costs of VMAT and HT.

Data Availability Statement

The data that support the findings of this study are available on request from the last author (SS).

Ethics Statement

The study was approved by the National Ethics Committee (Ref: 11/03, 4 January 2011) and the National Committee for protection of personal data (DR-2011-277 N°911317). The patients/participants provided their written informed consent to participate in this study.

Author Contributions

Conceptualization, M-AM and GP. Methodology, IM, MB, GP, CG-C, and SS. Software, MB and CG-C. Validation, IM, MB, GP, CG-C, and SS. Formal analysis, IM, MB, GP, and SS. Investigation, DA, PP, NM-N, PG, DP, BC, PD, NS, GN, JK, IL, and SS. Resources, IM, MB, and GP. Data curation, IM, GP, and CG-C. Writing—Original draft preparation, IM, MB, and SS. Writing—Review and editing, IM, MB, and SS. Visualization, IM, MB, and SS. Supervision, MB and SS. Project administration, GP. Funding acquisition, M-AM. All authors contributed to the article and approved the submitted version.

Funding

The three manufacturers (Accuray, Inc., Varian Medical Systems, and Elekta AB) financially supported the RCMI pelvis study. However, the RCMI pelvis is an independent study and the ideas and opinions expressed in this work are those of the authors and do not necessarily represent those of the manufacturers. The funders (Accuray, Inc.; Varian Medical Systems; Elekta AB) had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

Conflict of Interest

DA declares conflict of interest with Novagray, which has nothing to do with this study.

The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Acknowledgments

The authors are grateful to Lionel Perrier and Jean-Emmanuel Bibault for their inputs in previous studies on IMRT. We thank Philippe Tessier and Yohann Foucher for their help in improving the study.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fonc.2021.781121/full#supplementary-material

References

1. Bolla M, Van Tienhoven G, Warde P, Dubois JB, Mirimanoff R-O, Storme G, et al. External Irradiation With or Without Long-Term Androgen Suppression for Prostate Cancer With High Metastatic Risk: 10-Year Results of an EORTC Randomised Study. Lancet Oncol (2010) 11(11):1066–73. doi: 10.1016/S1470-2045(10)70223-0

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Bolla M, de Reijke TM, Van Tienhoven G, Van den Bergh ACM, Oddens J, Poortmans PMP, et al. Duration of Androgen Suppression in the Treatment of Prostate Cancer. N Engl J Med (2009) 360(24):2516–27. doi: 10.1056/NEJMoa0810095

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Pilepich MV, Winter K, Lawton CA, Krisch RE, Wolkov HB, Movsas B, et al. Androgen Suppression Adjuvant to Definitive Radiotherapy in Prostate Carcinoma–Long-Term Results of Phase III RTOG 85-31. Int J Radiat Oncol Biol Phys (2005) 61(5):1285–90. doi: 10.1016/j.ijrobp.2004.08.047

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Mottet N, van den Bergh RCN, Briers E, Van den Broeck T, Cumberbatch MG, De Santis M, et al. EAU-EANM-ESTRO-ESUR-SIOG Guidelines on Prostate Cancer-2020 Update. Part 1: Screening, Diagnosis, and Local Treatment With Curative Intent. Eur Urol (2021) 79(2):243–62. doi: 10.1016/j.eururo.2020.09.042

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Martin JM, Supiot S, Berthold DR. Pharmacotherapeutic Management of Locally Advanced Prostate Cancer: Current Status. Drugs (2011) 71(8):1019–41. doi: 10.2165/11591500-000000000-00000

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Parker C, Castro E, Fizazi K, Heidenreich A, Ost P, Procopio G, et al. Prostate Cancer: ESMO Clinical Practice Guidelines for Diagnosis, Treatment and Follow-Up†. Ann Oncol (2020) 31(9):1119–34. doi: 10.1016/j.annonc.2020.06.011

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Fogarty GB, Ng D, Liu G, Haydu LE, Bhandari N. Volumetric Modulated Arc Therapy is Superior to Conventional Intensity Modulated Radiotherapy–a Comparison Among Prostate Cancer Patients Treated in an Australian Centre. Radiat Oncol (2011) 6:108. doi: 10.1186/1748-717X-6-108

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Ren W, Sun C, Lu N, Xu Y, Han F, Liu YP, et al. Dosimetric Comparison of Intensity-Modulated Radiotherapy and Volumetric-Modulated Arc Radiotherapy in Patients With Prostate Cancer: A Meta-Analysis. J Appl Clin Med Phys (2016) 17(6):254–62. doi: 10.1120/jacmp.v17i6.6464

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Aznar MC, Petersen PM, Logadottir A, Lindberg H, Korreman SS, Kjær-Kristoffersen F, et al. Rotational Radiotherapy for Prostate Cancer in Clinical Practice. Radiother Oncol (2010) 97(3):480–4. doi: 10.1016/j.radonc.2010.09.014

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Hardcastle N, Tomé WA, Foo K, Miller A, Carolan M, Metcalfe P. Comparison of Prostate IMRT and VMAT Biologically Optimised Treatment Plans. Med Dosim (2011) 36(3):292–8. doi: 10.1016/j.meddos.2010.06.001

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Palma D, Vollans E, James K, Nakano S, Moiseenko V, Shaffer R, et al. Volumetric Modulated Arc Therapy for Delivery of Prostate Radiotherapy: Comparison With Intensity-Modulated Radiotherapy and Three-Dimensional Conformal Radiotherapy. Int J Radiat OncologyBiologyPhysics (2008) 72(4):996–1001. doi: 10.1016/j.ijrobp.2008.02.047

CrossRef Full Text | Google Scholar

12. Palma D, Vollans E, James K, Nakano S, Moiseenko V, Shaffer R, et al. Volumetric Modulated Arc Therapy (VMAT) for Delivery of Prostate Radiotherapy: Reduction in Treatment Time and Monitor Unit Requirements Compared to Intensity Modulated Radiotherapy. Int J Radiat Oncol Biol Phys (2008) 72(1):S312. doi: 10.1016/j.ijrobp.2008.06.1083

CrossRef Full Text | Google Scholar

13. Rao M, Yang W, Chen F, Sheng K, Ye J, Mehta V, et al. Comparison of Elekta VMAT With Helical Tomotherapy and Fixed Field IMRT: Plan Quality, Delivery Efficiency and Accuracy. Med Phys (2010) 37(3):1350–9. doi: 10.1118/1.3326965

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Pasquier D, Cavillon F, Lacornerie T, Touzeau C, Tresch E, Lartigau E. A Dosimetric Comparison of Tomotherapy and Volumetric Modulated Arc Therapy in the Treatment of High-Risk Prostate Cancer With Pelvic Nodal Radiation Therapy. Int J Radiat Oncol Biol Phys (2013) 85(2):549–54. doi: 10.1016/j.ijrobp.2012.03.046

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Wolff D, Stieler F, Welzel G, Lorenz F, Abo-Madyan Y, Mai S, et al. Volumetric Modulated Arc Therapy (VMAT) vs. Serial Tomotherapy, Step-and-Shoot IMRT and 3D-Conformal RT for Treatment of Prostate Cancer. Radiother Oncol (2009) 93(2):226–33. doi: 10.1016/j.radonc.2009.08.011

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Tsai C-L, Wu J-K, Chao H-L, Tsai Y-C, Cheng JC-H. Treatment and Dosimetric Advantages Between VMAT, IMRT, and Helical Tomotherapy in Prostate Cancer. Med Dosim (2011) 36(3):264–71. doi: 10.1016/j.meddos.2010.05.001

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Konski A. Cost Effectiveness of Prostate Cancer Radiotherapy. Transl Androl Urol (2018) 7(3):371–7. doi: 10.21037/tau.2017.12.38

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Schroeck FR, Jacobs BL, Bhayani SB, Nguyen PL, Penson D, Hu J. Cost of New Technologies in Prostate Cancer Treatment: Systematic Review of Costs and Cost Effectiveness of Robotic-Assisted Laparoscopic Prostatectomy, Intensity-Modulated Radiotherapy, and Proton Beam Therapy. Eur Urol (2017) 72(5):712–35. doi: 10.1016/j.eururo.2017.03.028

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Perrier L, Morelle M, Pommier P, Boisselier P, Coche-Dequeant B, Gallocher O, et al. Cost Analysis of Complex Radiation Therapy for Patients With Head and Neck Cancer. Int J Radiat OncologyBiologyPhysics (2016) 95(2):654–62. doi: 10.1016/j.ijrobp.2016.02.013

CrossRef Full Text | Google Scholar

20. Bibault J-E, Dussart S, Pommier P, Morelle M, Huguet M, Boisselier P, et al. Clinical Outcomes of Several IMRT Techniques for Patients With Head and Neck Cancer: A Propensity Score-Weighted Analysis. Int J Radiat Oncol Biol Phys (2017) 99(4):929–37. doi: 10.1016/j.ijrobp.2017.06.2456

PubMed Abstract | CrossRef Full Text | Google Scholar

21. D’Amico AV, Whittington R, Malkowicz SB, Schultz D, Blank K, Broderick GA, et al. Biochemical Outcome After Radical Prostatectomy, External Beam Radiation Therapy, or Interstitial Radiation Therapy for Clinically Localized Prostate Cancer. JAMA (1998) 280(11):969–74. doi: 10.1001/jama.280.11.969

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Sargos P, Guerif S, Latorzeff I, Hennequin C, Pommier P, Lagrange J-L, et al. Definition of Lymph Node Areas for Radiotherapy of Prostate Cancer: A Critical Literature Review by the French Genito-Urinary Group and the French Association of Urology (GETUG-AFU). Cancer Treat Rev (2015) 41(10):814–20. doi: 10.1016/j.ctrv.2015.10.005

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Gregoire V, Mackie TR. Dose Prescription, Reporting and Recording in Intensity-Modulated Radiation Therapy: A Digest of the ICRU Report 83. Imaging Med (2011) 3(3):367–73. doi: 10.2217/iim.11.22

CrossRef Full Text | Google Scholar

24. Tan SS, van Putten E, Nijdam WM, Hanssens P, Beute GN, Nowak PJ, et al. A Microcosting Study of Microsurgery, LINAC Radiosurgery, and Gamma Knife Radiosurgery in Meningioma Patients. J Neurooncol (2011) 101(2):237–45. doi: 10.1007/s11060-010-0243-4

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Defourny N, Perrier L, Borras J-M, Coffey M, Corral J, Hoozée S, et al. National Costs and Resource Requirements of External Beam Radiotherapy: A Time-Driven Activity-Based Costing Model From the ESTRO-HERO Project. Radiother Oncol (2019) 138:187–94. doi: 10.1016/j.radonc.2019.06.015

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Dunscombe P, Grau C, Defourny N, Malicki J, Borras JM, Coffey M, et al. Guidelines for Equipment and Staffing of Radiotherapy Facilities in the European Countries: Final Results of the ESTRO-HERO Survey. Radiother Oncol (2014) 112(2):165–77. doi: 10.1016/j.radonc.2014.08.032

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Goineau A, Marchand V, Rigaud J, Bourdin S, Rio E, Campion L, et al. Prospective Evaluation of Quality of Life 54 Months After High-Dose Intensity-Modulated Radiotherapy for Localized Prostate Cancer. Radiat Oncol (2013) 8(1):53. doi: 10.1186/1748-717X-8-53

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Pederson AW, Fricano J, Correa D, Pelizzari CA, Liauw SL. Late Toxicity After Intensity-Modulated Radiation Therapy for Localized Prostate Cancer: An Exploration of Dose–Volume Histogram Parameters to Limit Genitourinary and Gastrointestinal Toxicity. Int J Radiat OncologyBiologyPhysics (2012) 82(1):235–41. doi: 10.1016/j.ijrobp.2010.09.058

CrossRef Full Text | Google Scholar

29. Briggs A, Sculpher M, Buxton M. Uncertainty in the Economic Evaluation of Health Care Technologies: The Role of Sensitivity Analysis. Health Econ (1994) 3(2):95–104. doi: 10.1002/hec.4730030206

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Briggs AH, Wonderling DE, Mooney CZ. Pulling Cost-Effectiveness Analysis Up by its Bootstraps: A non-Parametric Approach to Confidence Interval Estimation. Health Econ (1997) 6(4):327–40. doi: 10.1002/(SICI)1099-1050(199707)6:4<327::AID-HEC282>3.0.CO;2-W

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Rosenbaum PR, Rubin DB. Reducing Bias in Observational Studies Using Subclassification on the Propensity Score. J Am Stat Assoc (1984) 79(367):9. doi: 10.1080/01621459.1984.10478078

CrossRef Full Text | Google Scholar

32. Austin PC, Stuart EA. Moving Towards Best Practice When Using Inverse Probability of Treatment Weighting (IPTW) Using the Propensity Score to Estimate Causal Treatment Effects in Observational Studies. Stat Med (2015) 34(28):3661–79. doi: 10.1002/sim.6607

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Defourny N, Monten C, Grau C, Lievens Y, Perrier L. Critical Review and Quality-Assessment of Cost Analyses in Radiotherapy: How Reliable are the Data? Radiother Oncol (2019) 141:14–26. doi: 10.1016/j.radonc.2019.09.020

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Van de Werf E, Verstraete J, Lievens Y. The Cost of Radiotherapy in a Decade of Technology Evolution. Radiother Oncol (2012) 102(1):148–53. doi: 10.1016/j.radonc.2011.07.033

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Hulstaert F, Mertens A-S, Obyn C, Van Halewyck D, van der Straten B, Lievens Y. Innovative Radiotherapy Techniques: A Multicentre Time-Driven Activity-Based Costing Study. Health Technology Assessment (HTA) Brussels: Belgian Health Care Knowledge Centre (KCE (2013). KCE Reports 198C. D/2013/10.273/9.

Google Scholar

36. Oliver M, Ansbacher W, Beckham WA. Comparing Planning Time, Delivery Time and Plan Quality for IMRT, RapidArc and Tomotherapy. J Appl Clin Med Phys (2009) 10(4):117–31. doi: 10.1120/jacmp.v10i4.3068

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Bonastre J, Noël E, Chevalier J, Gerard JP, Lefkopoulos D, Bourhis J, et al. Implications of Learning Effects for Hospital Costs of New Health Technologies: The Case of Intensity Modulated Radiation Therapy. Int J Technol Assess Health Care (2007) 23(2):248–54. doi: 10.1017/S026646230707033X

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Lievens Y, Defourny N, Corral J, Gasparotto C, Grau C, Borras JM, et al. How Public Health Services Pay for Radiotherapy in Europe: An ESTRO–HERO Analysis of Reimbursement. Lancet Oncol (2020) 21(1):e42–54. doi: 10.1016/S1470-2045(19)30794-6

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Fransson P, Nilsson P, Gunnlaugsson A, Beckman L, Tavelin B, Norman D, et al. Ultra-Hypofractionated Versus Conventionally Fractionated Radiotherapy for Prostate Cancer (HYPO-RT-PC): Patient-Reported Quality-of-Life Outcomes of a Randomised, Controlled, non-Inferiority, Phase 3 Trial. Lancet Oncol (2021) 22(2):235–45. doi: 10.1016/S1470-2045(20)30581-7

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Lievens Y, Dunscombe P, Defourny N, Gasparotto C, Borras JM, Grau C. HERO (Health Economics in Radiation Oncology): A Pan-European Project on Radiotherapy Resources and Needs. Clin Oncol (2015) 27(2):115–24. doi: 10.1016/j.clon.2014.10.010

CrossRef Full Text | Google Scholar

41. Grau C, Defourny N, Malicki J, Dunscombe P, Borras JM, Coffey M, et al. Radiotherapy Equipment and Departments in the European Countries: Final Results From the ESTRO-HERO Survey. Radiother Oncol (2014) 112(2):155–64. doi: 10.1016/j.radonc.2014.08.029

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Lievens Y, Grau C. Health Economics in Radiation Oncology: Introducing the ESTRO HERO Project. Radiother Oncol (2012) 103(1):109–12. doi: 10.1016/j.radonc.2011.12.026

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Defourny N, Dunscombe P, Perrier L, Grau C, Lievens Y. Cost Evaluations of Radiotherapy: What do We Know? An ESTRO-HERO Analysis. Radiother Oncol (2016) 121(3):468–74. doi: 10.1016/j.radonc.2016.12.002

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Austin PC, Grootendorst P, Anderson GM. A Comparison of the Ability of Different Propensity Score Models to Balance Measured Variables Between Treated and Untreated Subjects: A Monte Carlo Study. Stat Med (2007) 26(4):734–53. doi: 10.1002/sim.2580

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Dehejia RH, Wahba S. Propensity Score-Matching Methods for Nonexperimental Causal Studies. Rev Econ Stat (2002) 84(1):151–61. doi: 10.1162/003465302317331982

CrossRef Full Text | Google Scholar

46. National Comprehensive Cancer Network. NCCN Guidelines Version 2.2021 Prostate Cancer (2021). Available at: https://www.nccn.org/professionals/physician_gls/pdf/prostate.pdf.

Google Scholar

Keywords: Volumetric Arc Therapy (VMAT), helical tomotherapy (HT), high risk prostate cancers, micro-costing, inverse probability of treatment weighting (IPTW), toxicity, France

Citation: Masson I, Bellanger M, Perrocheau G, Mahé M-A, Azria D, Pommier P, Mesgouez-Nebout N, Giraud P, Peiffert D, Chauvet B, Dudouet P, Salem N, Noël G, Khalifa J, Latorzeff I, Guérin-Charbonnel C and Supiot S (2022) Cost and Toxicity Comparisons of Two IMRT Techniques for Prostate Cancer: A Micro-Costing Study and Weighted Propensity Score Analysis Based on a Prospective Study. Front. Oncol. 11:781121. doi: 10.3389/fonc.2021.781121

Received: 22 September 2021; Accepted: 10 December 2021;
Published: 11 January 2022.

Edited by:

Gustavo Cardoso Guimaraes, Beneficência Portuguesa de São Paulo, Brazil

Reviewed by:

Yoichiro Okubo, Kanagawa Cancer Center, Japan
Giuliano Aita, A.C. Camargo Cancer Center, Brazil

Copyright © 2022 Masson, Bellanger, Perrocheau, Mahé, Azria, Pommier, Mesgouez-Nebout, Giraud, Peiffert, Chauvet, Dudouet, Salem, Noël, Khalifa, Latorzeff, Guérin-Charbonnel and Supiot. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Martine Bellanger, martine.bellanger@ico.unicancer.fr

These authors have contributed equally to this work and share first authorship

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.