- 1Menzies Institute for Medical Research, University of Tasmania, Hobart, TAS, Australia
- 2NHMRC Centre of Research Excellence for Pulmonary Fibrosis, Camperdown, NSW, Australia
- 3Department of Anaesthesiology (High–Tech Branch), First Affiliated Hospital of Anhui Medical University, Hefei, Anhui, China
- 4Australian Government Department of Health and Aged Care, Tasmania (TAS) Office, Hobart, TAS, Australia
- 5School of Medicine, University of Tasmania, Hobart, TAS, Australia
Background: Immortal time bias (ITB) has been overlooked in idiopathic pulmonary fibrosis (IPF). We aimed to identify the presence of ITB in observational studies examining associations between antifibrotic therapy and survival in patients with IPF and illustrate how ITB may affect effect size estimates of those associations.
Methods: Immortal time bias was identified in observational studies using the ITB Study Assessment Checklist. We used a simulation study to illustrate how ITB may affect effect size estimates of antifibrotic therapy on survival in patients with IPF based on four statistical techniques including time-fixed, exclusion, time-dependent and landmark methods.
Results: Of the 16 included IPF studies, ITB was detected in 14 studies, while there were insufficient data for assessment in two others. Our simulation study showed that use of time–fixed [hazard ratio (HR) 0.55, 95% confidence interval (CI) 0.47–0.64] and exclusion methods (HR 0.79, 95% CI 0.67–0.92) overestimated the effectiveness of antifibrotic therapy on survival in simulated subjects with IPF, in comparison of the time–dependent method (HR 0.93, 95% CI 0.79–1.09). The influence of ITB was mitigated using the 1 year landmark method (HR 0.69, 95% CI 0.58–0.81), compared to the time–fixed method.
Conclusion: The effectiveness of antifibrotic therapy on survival in IPF can be overestimated in observational studies, if ITB is mishandled. This study adds to the evidence for addressing the influence of ITB in IPF and provides several recommendations to minimize ITB. Identifying the presence of ITB should be routinely considered in future IPF studies, with the time–dependent method being an optimal approach to minimize ITB.
Highlights
- Question: How immortal time bias (ITB) can affect effect size estimates of antifibrotic therapy on survival in patients with idiopathic pulmonary fibrosis (IPF)?
- Findings: The effectiveness of antifibrotic therapy on survival in patients with IPF can be overestimated in observational studies, if ITB is mishandled. Identifying the presence of ITB should be routinely considered in future IPF studies, with the time–dependent method being an optimal approach to minimize ITB.
- Meaning: Clinical decisions based on biased estimations may have potentially detrimental impact on clinical practice. This study adds to the evidence for addressing the influence of ITB in IPF studies and provides methods to ensure the true effect of treatments are estimated to ensure appropriate treatment for patients with IPF in future observational studies.
Introduction
Definition of immortal time bias
In the early 1970s, two observational studies (1, 2) examined associations between heart transplant and survival of patients and reported superior survival in treated patients compared to untreated controls. However, Gail (3) noted that there was an artificial survival advantage in the transplanted group, related to all treated patients needing to survive until time of treatment.
Immortal time refers to the waiting period before participants begin to receive interventions (e.g., antifibrotic therapy) since they will never become a treated patient if they die first or are censored (4, 5). However, no such period is allowed for the controls. When it is not adequately dealt with in analysis, a systematic error of immortal time bias (ITB) can occur, which distorts the real associations between interventions and outcomes in observational studies (6, 7).
Susceptibility of idiopathic pulmonary fibrosis studies to ITB
Immortal time bias commonly occurs in cohort studies due to the nature of their observational settings. Idiopathic pulmonary fibrosis (IPF) studies examining associations between interventions and time–to–event outcomes are particularly susceptible to suffer from the influence of ITB due to two key reasons. First, identifying a specific commencement date for medication use may be difficult in available data sources, especially for individuals with a rapid disease trajectory, which may limit abilities to measure the immortal time. In practice, patients with IPF commonly experience a substantial duration of symptoms (such as cough and shortness of breath) before diagnosis. A previous study (8) found that the median time delay from symptom onset to diagnosis was 2.1 years, and 41% (n = 84) of incident patients with IPF reported initial misclassification of respiratory symptoms. Second, IPF is characterized by a high mortality risk, with a median survival time of about 3 years (9, 10). Observation periods in IPF studies are commonly short, and thereafter immortal person–time may account for a large proportion of the total observation period (person years) in the intervention group, which may induce substantial biases.
Persistence of unaddressed ITB in IPF studies
The influence of ITB has been addressed in many disease areas such as diabetes (11), cancers (12), rheumatic diseases (13), orthopedics (14), and chronic obstructive pulmonary disease (COPD) (15), however, there is a paucity of data on the influence of ITB in IPF studies (16–19).
Several cohort studies (20, 21) have reported the protective effect of anti–gastric fluid reflux therapy on survival in IPF, while this survival benefit may have been affected by the influence of ITB (22, 23). In 2021, a meta–analysis (24) including 18 cohort studies reported the protective effect of antifibrotic therapy on survival of IPF; however, none were assessed or corrected for the influence of ITB. A recent commentary (25) has highlighted that the effectiveness of antifibrotic therapy in reducing the risk of death in IPF may be overestimated by the influence of ITB in a German cohort study (17).
Current methods to mishandle immortal time in observational studies
Both time–fixed and exclusion methods are conventional but biased in IPF studies during analysis (26). The time–fixed method is defined as Cox proportional hazards regression models with a time–fixed definition for the study intervention, which can introduce misclassification bias by counting immortal person–time as part of the intervention group (11, 27). The exclusion method is defined as Cox models with a complete exclusion of immortal person–time from the analysis, which can introduce selection bias (11, 27).
Appropriate methods to handle immortal time in observational studies
Both time–dependent and landmark methods are unbiased approaches and can be used to account for ITB (11, 28). The time–dependent method is defined as Cox models with a time–dependent definition for the study intervention. Any immortal person–time is added to the untreated comparator group for analysis (11). The landmark method is defined as Cox models with a landmark time, which excludes participants who have died or are censored before the landmark time (28). Participants are classified as exposed (intervention) group or unexposed (comparator) group based on their exposure status from cohort entry until the landmark time, and any newly exposed subjects during subsequent follow up after the landmark time are categorized into the comparator group (28). Although those two appropriate methods are gradually used in recent observational studies in the field of interstitial lung diseases (29, 30), there have been no studies in the field of IPF that evaluated effects of antifibrotic therapy with the incorporation of ITB.
The objectives of our methodological study
With the above backdrop in mind, this methodological study aims to identify the presence of ITB in observational studies examining associations between antifibrotic therapy and survival in patients with IPF and illustrate how ITB may affect effect size estimates of those associations by assessment methods.
Materials and methods
Identification of ITB
A newly published ITB Study Assessment Checklist (4) was used to identify the presence of ITB in observational studies; this checklist includes five items: cohort entry, immortal time, intervention eligibility period, observation period, and statistical methods. From the IPF studies reviewed, cohort entry is defined as the time of IPF diagnosis if known or recruitment to a cohort if not. Immortal time is defined as the time between cohort entry and the initiation of antifibrotic therapy. Intervention eligibility period is defined as the duration of antifibrotic therapy for participants. Specific observation period for the intervention and comparator group is also needed to be provided. As mentioned previously, four statistical techniques include time-fixed, exclusion, time-dependent, and landmark methods.
We used the studies included in a recent meta–analysis (24) of survival benefit of antifibrotic therapy as examples to identify the presence of ITB. Two investigators (QZ and IC) independently assessed the presence of ITB and identified the statistical methods used in each observational study. If the intervention was a time–dependent exposure and there was an immortal time during the follow up, potential for ITB was deemed to exist. All discrepancies were discussed and resolved by consensus with a third investigator (AJP).
A simulation study
To illustrate how ITB may affect the effectiveness of antifibrotic therapy on survival in IPF, we used a simulated dataset of subjects with IPF since access to the real world data was not available (22).
A simulation study is commonly used to estimate performance of statistical methods and illustrate how those methods can be utilized into practice (31). Individual survival data were simulated from a Weibull distribution with a proportional hazard function and censored at 5 years by using the “survsim package” in STATA (32). A hypothetic treatment variable (antifibrotic therapy) was generated from a binomial distribution with parameters n = 1,000 and p = 0.5. We incorporated the effect of antifibrotic therapy by defining a median background survival time of 3 years and a hazard ratio (HR) of death of 0.55, as estimated from a meta–analysis (24). For ITB illustration, we simulated that each subject with antifibrotic therapy had 1 year of immortal time.
Kaplan–Meier survival curves and Log-rank tests were used to compare 3 years survival between simulated subjects with and without antifibrotic therapy using the four statistical methods. In addition, Cox proportional hazards regression models were used to calculate crude HR [95% confidence interval (CI)] for mortality when ITB was considered. The time-dependent method was considered as the current gold-standard in this analysis (11, 28). We further quantified the difference in the effect estimates between the time-dependent method and other methods including time-fixed, exclusion, and landmark, as follows (33):
Considering there are high heterogeneities on survival times or mortality outcomes in studies reporting IPF-related antifibrotic therapy (24), a sensitivity analysis was conducted to validate our estimates. We repeated the analyses defining a median background survival time of 2 years, and a HR of death of 0.38 in the unadjusted Cox model as estimated from a previous cohort study (19). For ITB illustration, we simulated that each subject with antifibrotic therapy had 1 year of immortal time.
All statistical analyses were conducted using STATA version 17.0 (34).
Results
Identification of ITB
There were 18 cohort studies (16–19, 35–48) in a recent meta–analysis (24), while one study (45) reporting white blood cell counts, and one study (46) reporting cross–sectional area of erector spinae muscle as the main intervention of interest were excluded from this study.
Of the 16 included studies (Table 1), 14 (16–19, 35, 37–39, 41–44, 47, 48) were the subject of ITB due to using time–dependent interventions (i.e., participants starting use of antifibrotic therapy at any time during the follow up period). Two studies (36, 40) were detected with uncertain status for ITB with obscure description of timelines for both intervention and comparator groups.
Table 1. Assessment of immortal time bias (ITB) in published studies reporting effects of antifibrotic therapy on survival of participants with idiopathic pulmonary fibrosis (IPF).
For statistical methods, the time–fixed method was used in ten studies (18, 19, 35, 37–39, 42–44, 47) and exclusion method was used in other four studies (16, 17, 41, 48). Specific statistical methods were not applicable in the remaining two studies (36, 40).
A simulation study
Simulated subjects
Of the 1,000 simulated subjects with IPF, 483 were assigned to “take” antifibrotic therapy (antifibrotics users), and 517 did not receive antifibrotic therapy (non–users). The median (25th–75th percentiles) observation period from cohort entry to death was 3.5 (2.0, 5.0) years for the total population, 4.5 (2.7, 5.0) years for antifibrotics users, and 2.9 (1.5, 4.9) years for non–users, respectively.
Time-fixed method
Immortal time was 483 person years, which accounted for 26% of 1,855 person years for antifibrotics users in the time–fixed method. Immortal person–time were ignored and incorporated in the treated group (Figure 1A). The 3 years survival rate of antifibrotics users was significantly higher than non–users (71 vs. 48%; P < 0.001) (Figure 2A). Antifibrotics users had a significantly decreased risk of all–cause mortality compared to non–users using the time–fixed method (HR 0.55, 95% CI 0.47–0.64; P < 0.001) (Table 2).
Figure 1. Illustration of allocating immortal time in four different methods. (A) Time–fixed method, (B) exclusion method, (C) time–dependent method, and (D–F) landmark method. For the time–fixed method, the immortal time was ignored and incorporated in the treated group. For the exclusion method, the immortal time was excluded from the study. For the time–dependent method, the immortal time was switched into the control group, with an additional 483 subjects being added into the control group. For the landmark method, 0.5, 1, and 2 years landmarks excluded 45, 90, and 245 simulated subjects who had died prior to this time point, respectively. Immortal time was defined as the time from cohort entry to the initiation of antifibrotic therapy. Landmark time was defined as a fixed time point, which was the same for all subjects.
Figure 2. Kaplan–Meier survival curves with methods of (A) time–fixed, (B) exclusion, (C) time–dependent, and (D–F) landmark. For the time–fixed method, the immortal time was ignored and incorporated in the treated group. For the exclusion method, the immortal time was excluded from the study. For the time–dependent method, the immortal time was switched into the control group, with an additional 483 subjects being added into the control group. For the landmark method, 0.5, 1, and 2 years landmarks excluded 45, 90, and 245 simulated subjects who had died prior to this time point, respectively. Immortal time was defined as the time from cohort entry to the initiation of antifibrotic therapy. Landmark time was defined as a fixed time point, which was the same for all subjects.
Table 2. An illustration of the influence of immortal time bias (ITB) on associations between antifibrotic therapy and survival in simulated subjects with idiopathic pulmonary fibrosis (IPF) using four statistical methods.
Exclusion method
All immortal person–time were excluded from the study in the exclusion method (Figure 1B). There was a significant difference in the 3 years survival rates between antifibrotics users and non–users using the exclusion method (56 vs. 48%; P = 0.003) (Figure 2B). Antifibrotics users had a significantly decreased risk of all–cause mortality compared to non–users using the exclusion method (HR 0.79, 95% CI 0.67–0.92; P = 0.003) (Table 2).
Time-dependent method
All immortal person–time were switched into the control group in the time–dependent method, with an additional 483 subjects being added into the control group (Figure 1C). The 3 years survival rates for antifibrotics users and non–users were similar (56 versus 53%; P = 0.391) (Figure 2C). There was no significant association between antifibrotic therapy and survival in subjects with IPF using the time-dependent method (HR 0.93, 95% CI 0.79–1.09; P = 0.391) (Table 2).
Landmark method
For the landmark method, 0.5, 1, and 2 years landmarks excluded 45, 90, and 245 simulated subjects who had died prior to this time point, respectively (Figures 1D–F). For the 0.5 year landmark method, the 3 years survival rate of antifibrotics users was significantly higher than non-users in subjects who survived more than 6 months (71 versus 53%; P < 0.001) (Figure 2D). For the 1 year landmark method, there was a significant difference in the 3 years survival rates between antifibrotics users and non–users in subjects who survived more than 1 year (71 versus 58%; P < 0.001) (Figure 2E). For the 2 years landmark method, the 3 years survival rate of antifibrotics users was significantly higher than non–users in subjects who survived more than 2 years (83 versus 73%; P < 0.001) (Figure 2F). Antifibrotics users were associated with a significantly decreased risk of all–cause mortality compared to non–users using 0.5 year landmark (HR 0.61, 95% CI 0.52–0.71; P < 0.001), 1 year landmark (HR 0.69, 95% CI 0.58–0.81; P < 0.001), and 2 years landmark (HR 0.69, 95% CI 0.57–0.84; P < 0.001), respectively (Table 2).
Difference in the effect estimates between four methods
Table 2 shows the difference in the effect estimates between the time-dependent method and other methods. Compared to the time-dependent method, use of time-fixed and exclusion methods overestimated the effectiveness of antifibrotic therapy in reducing the risk of all–cause mortality by 41 and 15%, respectively. For the 0.5, 1, and 2 years landmark methods, effectiveness of antifibrotic therapy was overestimated in reducing the risk of all–cause mortality by 34, 26 and 26%, respectively, compared to the time-dependent method.
Sensitivity analysis
After simulating data with a different background survival time and HR of death, our results remained consistent (Supplementary 1). Compared to the time-dependent method, use of time-fixed and exclusion methods overestimated the effectiveness of antifibrotic therapy in reducing the risk of all–cause mortality by 39 and 15%, respectively. For the 0.5, 1, and 2 years landmark methods, effectiveness of antifibrotic therapy was overestimated in reducing the risk of all–cause mortality by 32, 24 and 26%, respectively, compared to the time-dependent method.
Discussion
Main findings
To the best of our knowledge, this is one of few studies that highlights the importance of identifying and accounting for the influence of ITB in the field of IPF studies. We used the ITB Study Assessment Checklist to identify the presence of ITB in observational studies, and a simulation study (for the first time in the world) to illustrate how ITB can overestimate the survival impacts of IPF-related antifibrotic therapy in observational studies. Our findings have demonstrated the time–dependent method to be an optimal statistical approach to minimize ITB in IPF studies where immortal time is identified.
The importance of addressing ITB in IPF studies
Observational studies examining effectiveness of medications on survival are highly susceptible to ITB in IPF due to substantial diagnostic delay and poor survival time. Further, time-fixed and exclusion methods are commonly used in IPF studies, which leads to overestimate the effectiveness of medications on survival in observational studies (22).
No examples of the assessment of ITB influence on survival of IPF using time–dependent or landmark methods have been published to date. Seven studies (11, 12, 28, 33, 49–51) were selected from a search for ITB literature based on PubMed, which were regarded as examples to illustrate how ITB can affect effect size estimates in other population. Detailed search strategies were provided in Supplementary 2. It has been demonstrated in previous studies that there could be substantial adjustments to the effect size estimates for interventions after correction for ITB (Table 3). ITB may also on some occasions lead to a reversal of the true effect estimate of interventions. For example, a previous study (52) reported that participants with type 2 diabetes using statins had a delay in disease progression (HR 0.74, 95% CI 0.58–0.95) compared to those without using stains; however, this association was reversed after correcting for ITB in the same dataset (HR 1.97, 95% CI 1.53–2.52) (11).
Table 3. Description of seven observational studies of the effects of interventions on study outcomes using various statistical methods for handling immortal time bias (ITB).
Identification of ITB
Of the 16 studies reviewed, we found that 14 studies were detected with presence of ITB based on the ITB checklist, while there were insufficient data for assessment of two others. This is consistent with a recently published Letter to Editor (26) that summarized observational studies reporting the effectiveness of antifibrotic therapy on mortality of IPF and identified 14 studies (16–19, 35, 41, 42, 44, 45, 53–57) presenting ITB. Compared to a previous study (26), we have included more studies and have provided more detailed information by using the ITB checklist and conducting a simulation study to identify and account for ITB in IPF studies. Furthermore, Kaplan-Meier survival curves are plotted for illustrating correction of ITB, which could be used to identify the presence of ITB through observing the initial part of the survival curves when there is substantial variation in the slopes between antifibrotics users and non–users. The immediate marked separation of survival plots where present in previous IPF studies means that ITB was not taken into account (17, 19). In addition, all STATA code for data generation and modeling are given in Supplementary 3 which provide detailed information to repeat our analyses or validate our results in real datasets for future studies.
Correction of ITB
Our simulation study showed that use of time–fixed and exclusion methods overestimated the effectiveness of antifibrotic therapy in reducing the risk of all–cause mortality by 41 and 15%, respectively, compared to the time–dependent method. This is consistent with the findings of a methodological study which examined the effectiveness of inhaled corticosteroids on survival in a real dataset of patients with COPD (28). By using various methods to handle ITB, the investigators found that both the time–fixed method (HR 0.55, 95% CI 0.53–0.57) and exclusion method (HR 0.66, 95% CI 0.64–0.69) considerably overestimated the effectiveness of inhaled corticosteroids in comparison of the time–dependent method (HR 0.97, 95% CI 0.93–1.00) which the authors identified as a “gold standard.”
The time–dependent method is closest to the true effect of interventions on study outcomes that was first reported in 1974 by Mantel and Byar (58). In the early 2000s, Suissa (49, 59, 60) comprehensively addressed the potential influence of ITB on associations between medications (such as inhaled corticosteroids and beta–agonists) and survival in COPD. However, such an optimal approach requires adequate information to calculate the immortal time.
The landmark method is an alternative approach to the time–dependent method that was introduced in 1983 by Anderson et al. (61). We found that this method can mitigate the influence of ITB compared to the time–fixed method, but its performance highly dependent on the timepoint chosen. Thus, multiple landmark time points are commonly set to account for ITB. A previous study (28) set four landmark time points (3, 6, 9, and 12 months) to examine the effectiveness of inhaled corticosteroids on survival in COPD, but only found a significant effect at a 3 months landmark model. It should be noted that subjects who have died are excluded prior to the landmark time, thus the effect of antifibrotic therapy should be interpreted as being among subjects who survive at least to the defined landmark time. In addition, use of landmark method has a key limitation: subjects are excluded from the analysis which reduces statistical power; this is particularly important in critical care research where events are usually more common early in the disease process in subjects with severe diseases such as IPF.
Strengths and limitations
This study adds to the evidence for addressing the influence of ITB in IPF studies and provides several recommendations to minimize ITB in future observational studies. First, the ITB Study Assessment Checklist should be used to avoid ITB at the stage of study design and data analysis. f, the prevalent new-user design provides a comparison of exposed patients with time-matched unexposed controls during follow up, which might avoid ITB. (23) Third, a longer observation period can be used to mitigate the influence of ITB by reducing the proportion of immortal person–time in the total observation period (person years) in the intervention group. While this might be difficult in some patients with rapid disease progression. In addition, studies should collect and utilize adequate data to calculate immortal person–time. Lastly, the use of time–dependent and landmark methods can account for the influence of ITB in observational studies during data analysis.
Lack of validating our results in a real-world dataset is the main limitation for this study. Our simulation study can only confirm the direction of ITB and illustrate how it can overestimate the survival impacts of IPF-related antifibrotic therapy, while this study is limited to estimate the real magnitude of the effect size of this bias. In addition, the simulated data are generated based on a few reasonable assumptions in support of the modeling that illustrate the impact of ITB, while there are high heterogeneities on survival times and mortality outcomes for IPF-related antifibrotic therapy reported from a previous meta-analysis (24). However, results from our sensitivity analysis remained consistent after simulating datasets based on a different background of survival time and mortality outcome. Future studies should quantify the effect size estimates of the influence of ITB on associations between antifibrotic therapy and survival in patients with IPF based on data linkage with filling of prescriptions, although it could be challenging for getting the data required for such analyses.
Conclusion
The effectiveness of antifibrotic therapy on survival in IPF is likely to be overestimated in observational studies, if ITB is not handled appropriately. Identifying the presence of ITB should therefore be routinely considered and reported in future IPF studies, and we recommend the use of time–dependent method to optimally account for the influence of ITB in observational studies. Clinical decisions based on biased estimations may have potentially detrimental impact on clinical practice. This study provides methods to ensure the true effect of treatments are estimated to ensure appropriate treatment for patients with IPF in future observational studies.
Data availability statement
The original contributions presented in this study are included in the article/Supplementary material, further inquiries can be directed to the corresponding author.
Ethics statement
Ethical review and approval was not required for the study on human participants in accordance with the local legislation and institutional requirements. Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.
Author contributions
QZ designed the study and wrote the first draft of the manuscript. PO contributed to the statistical review and manuscript writing. EW, IC, BG, JC, and HA contributed to the study design and manuscript writing. AP contributed to the conceptualization, study design, and manuscript writing. All authors contributed to the revisions and agreed to the final manuscript.
Funding
This study was part of the QUality of LIfE and Costs AssociaTed with Idiopathic Pulmonary Fibrosis Study (QUIET–IPF), a project funded through the NHMRC Centre of Research Excellence in Pulmonary Fibrosis (GNT1116371) and by Foundation Partner Boehringer Ingelheim and Program Partners Roche and Galapagos. The funder was not involved in the study design, collection, analysis, interpretation of data, the writing of this article, or the decision to submit it for publication.
Acknowledgments
We thank all authors of reviewed studies for the effective and timely communication.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fmed.2023.1157706/full#supplementary-material
References
1. Messmer BJ, Nora JJ, Leachman RD, Cooley DA. Survival-times after cardiac allografts. Lancet. (1969) 1:954–6. doi: 10.1016/s0140-6736(69)91857-1
2. Clark DA, Stinson EB, Griepp RB, Schroeder JS, Shumway NE, Harrison DC. Cardiac transplantation in man. VI. Prognosis of patients selected for cardiac transplantation. Ann Intern Med. (1971) 75:15–21. doi: 10.7326/0003-4819-75-1-15
3. Gail MH. Does cardiac transplantation prolong life? A reassessment. Ann Intern Med. (1972) 76:815–7. doi: 10.7326/0003-4819-76-5-815
4. Vail EA, Gershengorn HB, Wunsch H, Walkey AJ. Attention to immortal time bias in critical care research. Am J Respir Crit Care Med. (2021) 203:1222–9. doi: 10.1164/rccm.202008-3238CP
5. Yadav K, Lewis RJ. Immortal time bias in observational studies. JAMA. (2021) 325:686. doi: 10.1001/jama.2020.9151
6. Suissa S. Immortal time bias in pharmacoepidemiology. Am J Epidemiol. (2008) 167:492–9. doi: 10.1093/aje/kwm324
7. Karim ME, Gustafson P, Petkau J, Tremlett H. Comparison of statistical approaches for dealing with immortal time bias in drug effectiveness studies. Am J Epidemiol. (2016) 184:325–35. doi: 10.1093/aje/kwv445
8. Hoyer N, Prior TS, Bendstrup E, Wilcke T, Shaker SB. Risk factors for diagnostic delay in idiopathic pulmonary fibrosis. Respir Res. (2019) 20:103. doi: 10.1186/s12931-019-1076-0
9. Richeldi L, Collard HR, Jones MG. Idiopathic pulmonary fibrosis. Lancet. (2017) 389:1941–52. doi: 10.1016/s0140-6736(17)30866-8
10. Akgün KM, Crothers K, Pisani M. Epidemiology and management of common pulmonary diseases in older persons. J Gerontol A Biol Sci Med Sci. (2012) 67:276–91. doi: 10.1093/gerona/glr251
11. Lévesque LE, Hanley JA, Kezouh A, Suissa S. Problem of immortal time bias in cohort studies: example using statins for preventing progression of diabetes. BMJ. (2010) 340:b5087. doi: 10.1136/bmj.b5087
12. Weberpals J, Jansen L, Van Herk-Sukel MPP, Kuiper JG, Aarts MJ, Vissers PAJ, et al. Immortal time bias in pharmacoepidemiological studies on cancer patient survival: empirical illustration for beta-blocker use in four cancers with different prognosis. Eur J Epidemiol. (2017) 32:1019–31. doi: 10.1007/s10654-017-0304-5
13. Abrahami D, Hudson M, Suissa S. Statins and lower mortality in rheumatic diseases: an effect of immortal time bias? Semin Arthritis Rheum. (2021) 51:211–8. doi: 10.1016/j.semarthrit.2020.11.010
14. Larson DR, Crowson CS, Devick KL, Lewallen DG, Berry DJ, Maradit Kremers H. Immortal time bias in the analysis of time-to-event data in orthopedics. J Arthroplasty. (2021) 36:3372–7. doi: 10.1016/j.arth.2021.06.012
15. Suissa S, Ernst P. Beta-blockers in Copd: a methodological review of the observational studies. COPD. (2018) 15:520–5. doi: 10.1080/15412555.2018.1554637
16. Dempsey TM, Sangaralingham LR, Yao X, Sanghavi D, Shah ND, Limper AH. Clinical effectiveness of antifibrotic medications for idiopathic pulmonary fibrosis. Am J Respir Crit Care Med. (2019) 200:168–74. doi: 10.1164/rccm.201902-0456oc
17. Behr J, Prasse A, Wirtz H, Koschel D, Pittrow D, Held M, et al. Survival and course of lung function in the presence or absence of antifibrotic treatment in patients with idiopathic pulmonary fibrosis: long-term results of the insights-Ipf registry. Eur Respir J. (2020) 56:1902279. doi: 10.1183/13993003.02279-2019
18. Adegunsoye A, Alqalyoobi S, Linderholm A, Bowman WS, Lee CT, Pugashetti JV, et al. Circulating plasma biomarkers of survival in antifibrotic-treated patients with idiopathic pulmonary fibrosis. Chest. (2020) 158:1526–34. doi: 10.1016/j.chest.2020.04.066
19. Jo HE, Glaspole I, Grainge C, Goh N, Hopkins PM, Moodley Y, et al. Baseline characteristics of idiopathic pulmonary fibrosis: analysis from the Australian idiopathic pulmonary fibrosis registry. Eur Respir J. (2017) 49:1601592. doi: 10.1183/13993003.01592-2016
20. Lee JS, Ryu JH, Elicker BM, Lydell CP, Jones KD, Wolters PJ, et al. Gastroesophageal reflux therapy is associated with longer survival in patients with idiopathic pulmonary fibrosis. Am J Respir Crit Care Med. (2011) 184:1390–4. doi: 10.1164/rccm.201101-0138oc
21. Lee CM, Lee DH, Ahn BK, Hwang JJ, Yoon H, Shin CM, et al. Protective effect of proton pump inhibitor for survival in patients with gastroesophageal reflux disease and idiopathic pulmonary fibrosis. J Neurogastroenterol Motil. (2016) 22:444–51. doi: 10.5056/jnm15192
22. Tran T, Suissa S. The effect of anti-acid therapy on survival in idiopathic pulmonary fibrosis: a methodological review of observational studies. Eur Respir J. (2018) 51:1800376. doi: 10.1183/13993003.00376-2018
23. Tran T, Assayag D, Ernst P, Suissa S. Effectiveness of proton pump inhibitors in idiopathic pulmonary fibrosis: a population-based cohort study. Chest. (2020) 159:673–82. doi: 10.1016/j.chest.2020.08.2080
24. Petnak T, Lertjitbanjong P, Thongprayoon C, Moua T. Impact of antifibrotic therapy on mortality and acute exacerbation in idiopathic pulmonary fibrosis: a systematic review and meta-analysis. Chest. (2021) 160:1751–63. doi: 10.1016/j.chest.2021.06.049
25. Suissa S, Assayag D. Mortality benefit with antifibrotics in idiopathic pulmonary fibrosis: real world evidence or bias? Eur Respir J. (2021) 57:2004562. doi: 10.1183/13993003.04562-2020
26. Suissa S, Suissa K. Antifibrotics and reduced mortality in idiopathic pulmonary fibrosis: immortal time bias. Am J Respir Crit Care Med. (2022) 207:105–9. doi: 10.1164/rccm.202207-1301LE
27. Mansournia MA, Nazemipour M, Etminan M. Causal diagrams for immortal time bias. Int J Epidemiol. (2021) 50:1405–9. doi: 10.1093/ije/dyab157
28. Mi X, Hammill BG, Curtis LH, Lai EC-C, Setoguchi S. Use of the landmark method to address immortal person-time bias in comparative effectiveness research: a simulation study. Stat Med. (2016) 35:4824–36. doi: 10.1002/sim.7019
29. Pugashetti JV, Adegunsoye A, Wu Z, Lee CT, Srikrishnan A, Ghodrati S, et al. Validation of proposed criteria for progressive pulmonary fibrosis. Am J Respir Crit Care Med. (2022) 207:69–76. doi: 10.1164/rccm.202201-0124OC
30. Khor YH, Gutman L, Abu Hussein N, Johannson KA, Glaspole IN, Guler SA, et al. Incidence and prognostic significance of hypoxemia in fibrotic interstitial lung disease: an international cohort study. Chest. (2021) 160:994–1005. doi: 10.1016/j.chest.2021.04.037
31. Morris TP, White IR, Crowther MJ. Using simulation studies to evaluate statistical methods. Stat Med. (2019) 38:2074–102. doi: 10.1002/sim.8086
32. Crowther MJ, Lambert PC. Simulating biologically plausible complex survival data. Stat Med. (2013) 32:4118–34. doi: 10.1002/sim.5823
33. Wallis CJD, Saskin R, Narod SA, Law C, Kulkarni GS, Seth A, et al. Estimating the effect of immortal-time bias in urological research: a case example of testosterone-replacement therapy. BJU Int. (2017) 120:584–90. doi: 10.1111/bju.13918
35. Alhamad EH, Cal JG, Alrajhi NN, Aharbi WM, AlRikabi AC, AlBoukai AA. Clinical characteristics, comorbidities, and outcomes in patients with idiopathic pulmonary fibrosis. Ann Thorac Med. (2020) 15:208–14. doi: 10.4103/atm.ATM_230_20
36. Cerri S, Monari M, Guerrieri A, Donatelli P, Bassi I, Garuti M, et al. Real-life comparison of pirfenidone and nintedanib in patients with idiopathic pulmonary fibrosis: a 24-month assessment. Respir Med. (2019) 159:105803. doi: 10.1016/j.rmed.2019.105803
37. Dhooria S, Agarwal R, Sehgal IS, Prasad KT, Muth V, Garg M, et al. A real-world study of the dosing and tolerability of pirfenidone and its effect on survival in idiopathic pulmonary fibrosis. Sarcoidosis Vasc Diffuse Lung Dis. (2020) 37:148–57. doi: 10.36141/svdld.v37i2.8718
38. Feng H, Zhao Y, Li Z, Kang J. Real-life experiences in a single center: efficacy of pirfenidone in idiopathic pulmonary fibrosis and fibrotic idiopathic non-specific interstitial pneumonia patients. Ther Adv Respir Dis. (2020) 14:1753466620963015. doi: 10.1177/1753466620963015
39. Fernández-Fabrellas E, Molina-Molina M, Soriano JB, Portal JAR, Ancochea J, Valenzuela C, et al. Demographic and clinical profile of idiopathic pulmonary fibrosis patients in Spain: the Separ national registry. Respir Res. (2019) 20:127. doi: 10.1186/s12931-019-1084-0
40. Hosein K, Le J, Mura M. Assessing the therapeutic response to pirfenidone in idiopathic pulmonary fibrosis: can we do better than with forced vital capacity alone? Lung. (2017) 195:101–5. doi: 10.1007/s00408-016-9963-3
41. Kang J, Han M, Song JW. Antifibrotic treatment improves clinical outcomes in patients with idiopathic pulmonary fibrosis: a propensity score matching analysis. Sci Rep. (2020) 10:15620. doi: 10.1038/s41598-020-72607-1
42. Kaunisto J, Salomaa ER, Hodgson U, Kaarteenaho R, Kankaanranta H, Koli K, et al. Demographics and survival of patients with idiopathic pulmonary fibrosis in the finnishipf registry. ERJ Open Res. (2019) 5:00170–2018. doi: 10.1183/23120541.00170-2018
43. Margaritopoulos GA, Trachalaki A, Wells AU, Vasarmidi E, Bibaki E, Papastratigakis G, et al. Pirfenidone improves survival in Ipf: results from a real-life study. BMC Pulm Med. (2018) 18:177. doi: 10.1186/s12890-018-0736-z
44. Moon SW, Kim SY, Chung MP, Yoo H, Jeong SH, Kim DS, et al. Longitudinal changes in clinical features, management, and outcomes of idiopathic pulmonary fibrosis. A nationwide cohort study. Ann Am Thorac Soc. (2021) 18:780–7. doi: 10.1513/AnnalsATS.202005-451OC
45. Nathan SD, Brown AW, Mogulkoc N, Soares F, Collins AC, Cheng J, et al. The association between white blood cell count and outcomes in patients with idiopathic pulmonary fibrosis. Respir Med. (2020) 170:106068. doi: 10.1016/j.rmed.2020.106068
46. Suzuki Y, Aono Y, Kono M, Hasegawa H, Yokomura K, Naoi H, et al. Cause of mortality and sarcopenia in patients with idiopathic pulmonary fibrosis receiving antifibrotic therapy. Respirology. (2021) 26:171–9. doi: 10.1111/resp.13943
47. Zubairi ABS, Ahmad H, Hassan M, Sarwar S, Abbas A, Shahzad T, et al. Clinical characteristics and factors associated with mortality in idiopathic pulmonary fibrosis: an experience from a tertiary care center in Pakistan. Clin Respir J. (2018) 12:1191–6. doi: 10.1111/crj.12650
48. Zurkova M, Kriegova E, Kolek V, Lostakova V, Sterclova M, Bartos V, et al. Effect of pirfenidone on lung function decline and survival: 5-yr experience from a real-life Ipf cohort from the Czech empire registry. Respir Res. (2019) 20:16. doi: 10.1186/s12931-019-0977-2
49. Suissa S. Inhaled steroids and mortality in Copd: bias from unaccounted immortal time. Eur Respir J. (2004) 23:391–5. doi: 10.1183/09031936.04.00062504
50. Shintani AK, Girard TD, Eden SK, Arbogast PG, Moons KGM, Ely EW. Immortal time bias in critical care research: application of time-varying cox regression for observational cohort studies. Crit Care Med. (2009) 37:2939–45. doi: 10.1097/ccm.0b013e3181b7fbbb
51. Choi YY, Lee JK, Kim H-S, Kim DW, Kim HM, Kang DR. Medications and the risk of colorectal cancer in patients with inflammatory bowel diseases: use of the landmark method. Yonsei Med J. (2021) 62:997. doi: 10.3349/ymj.2021.62.11.997
52. Yee A, Majumdar SR, Simpson SH, McAlister FA, Tsuyuki RT, Johnson JA. Statin use in type 2 diabetes mellitus is associated with a delay in starting insulin. Diabet Med. (2004) 21:962–7. doi: 10.1111/j.1464-5491.2004.01263.x
53. Gao J, Kalafatis D, Carlson L, Pesonen IHA, Li C-X, Wheelock Å, et al. Baseline characteristics and survival of patients of idiopathic pulmonary fibrosis: a longitudinal analysis of the Swedish Ipf registry. Respir Res. (2021) 22:40. doi: 10.1186/s12931-021-01634-x
54. Jegal Y, Park JS, Kim SY, Yoo H, Jeong SH, Song JW, et al. Clinical features, diagnosis, management, and outcomes of idiopathic pulmonary fibrosis in Korea: analysis of the Korea Ipf cohort (Kico) registry. Tuberc Respir Dis (Seoul). (2022) 85:185–94. doi: 10.4046/trd.2021.0123
55. Lee EG, Lee TH, Hong Y, Ryoo J, Heo JW, Gil BM, et al. Effects of low-dose pirfenidone on survival and lung function decline in patients with idiopathic pulmonary fibrosis (Ipf): results from a real-world study. PLoS One. (2021) 16:e0261684. doi: 10.1371/journal.pone.0261684
56. Leuschner G, Klotsche J, Kreuter M, Prasse A, Wirtz H, Pittrow D, et al. Idiopathic pulmonary fibrosis in elderly patients: analysis of the insights-Ipf observational study. Front Med (Lausanne). (2020) 7:601279.
57. Wright WA, Crowley LE, Parekh D, Crawshaw A, Dosanjh DP, Nightingale P, et al. Real-world retrospective observational study exploring the effectiveness and safety of antifibrotics in idiopathic pulmonary fibrosis. BMJ Open Respir Res. (2021) 8:e000782. doi: 10.1136/bmjresp-2020-000782
58. Mantel N, Byar DP. Evaluation of response-time data involving transient states: an illustration using heart-transplant data. J Am Stat Assoc. (1974) 69:81. doi: 10.2307/2285503
59. Suissa S. Immortal time bias in observational studies of drug effects. Pharmacoepidemiol Drug Saf. (2007) 16:241–9. doi: 10.1002/pds.1357
60. Suissa S. Effectiveness of inhaled corticosteroids in chronic obstructive pulmonary disease. American J Respir Crit Care Med. (2003) 168:49–53. doi: 10.1164/rccm.200210-1231oc
Keywords: immortal time bias, idiopathic pulmonary fibrosis, time–dependent, landmark, observational research
Citation: Zheng Q, Otahal P, Cox IA, de Graaff B, Campbell JA, Ahmad H, Walters EH and Palmer AJ (2023) The influence of immortal time bias in observational studies examining associations of antifibrotic therapy with survival in idiopathic pulmonary fibrosis: A simulation study. Front. Med. 10:1157706. doi: 10.3389/fmed.2023.1157706
Received: 02 February 2023; Accepted: 27 March 2023;
Published: 11 April 2023.
Edited by:
Paolo Spagnolo, University of Padua, ItalyReviewed by:
Yet Khor, Monash University, AustraliaIain Stewart, Imperial College London, United Kingdom
Copyright © 2023 Zheng, Otahal, Cox, de Graaff, Campbell, Ahmad, Walters and Palmer. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Andrew J. Palmer, YW5kcmV3LnBhbG1lckB1dGFzLmVkdS5hdQ==
†These authors share senior authorship