Nadine Reid1
Rosane Nisenbaum2,3Stephen W. Hwang2,4Anna Durbin2,5Nicole Kozloff1,5,6Ri Wang2
Vicky Stergiopoulos1,2,5,6*- 1Centre for Addiction and Mental Health, Toronto, ON, Canada
- 2MAP Centre for Urban Health Solutions Applied Health Research Centre, Li Ka Shing Knowledge Institute, St. Michael's Hospital, Unity Health Toronto, Toronto, ON, Canada
- 3Division of Biostatistics, Dalla Lana School of Public Health University of Toronto, Toronto, ON, Canada
- 4Department of Medicine, Faculty of Medicine, University of Toronto, Toronto, ON, Canada
- 5Department of Psychiatry, University of Toronto, Toronto, ON, Canada
- 6Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, ON, Canada
Background: People experiencing homelessness and mental illness have poorer service engagement and health-related outcomes compared to the general population. Financial incentives have been associated with increased service engagement, but evidence of effectiveness is limited. This protocol evaluates the acceptability and impact of financial incentives on service engagement among adults experiencing homelessness and mental illness in Toronto, Canada.
Methods: This study protocol uses a pragmatic field trial design and mixed methods (ClinicalTrials.gov Identifier: NCT03770221). Study participants were recruited from a brief multidisciplinary case management program for adults experiencing homelessness and mental illness following hospital discharge, and were randomly assigned to usual care or a financial incentives arm offering $20 for each week they attended meetings with a program provider. The primary outcome of effectiveness is service engagement, measured by the count of participant-provider health-care contacts over the 6-month period post-randomization. Secondary health, health service use, quality of life, and housing outcomes were measured at baseline and at 6-month follow-up. Quantitative data will be analyzed using descriptive statistics and inferential modeling including Poisson regression and generalized estimating equations. A subset of study participants and other key informants participated in interviews, and program staff in focus groups, to explore experiences with and perspectives regarding financial incentives. Qualitative data will be rigorously coded and thematically analyzed.
Conclusions: Findings from this study will contribute high quality evidence to an underdeveloped literature base on the effectiveness and acceptability of financial incentives to improve service engagement and health-related outcomes among adults experiencing homelessness and mental illness.
Introduction
People experiencing homelessness and mental illness have significantly poorer mental and physical health and quality of life relative to the general population (1–3). In addition, compared to the general population, they have higher rates of acute care utilization and associated costs (2, 4, 5). Efforts to improve the health and health service use outcomes of this population have historically been challenged by poor service engagement and high drop-out rates (6). Lack of service engagement has in turn been associated with poor health outcomes, including increased symptom severity, reduced quality of life, a greater likelihood of returning to hospital (6–8), and increased acute care costs (6, 7). Strategies to improve service engagement are essential to maximizing treatment effectiveness and to improving the health and social outcomes of this population.
For adults experiencing homelessness and mental illness, the transition from hospital to community settings has been associated with an increased risk of homelessness (9) and worsened mental illness (10). Programs and interventions aiming to support this population in establishing (re)connections to housing and community-based resources during care transition, such as Critical Time Intervention, have been used successfully to improve the health (11), health service use (12–14), quality of life (11, 14), and housing outcomes (9, 15) of this population. Further research, focused on practical strategies to improve service engagement, particularly in the critical period following hospital discharge, is essential to maximizing the impact of such interventions and to improving health and social outcomes in this population.
An individual's decision to engage in and adhere to treatment is influenced by a wide range of factors. Behavioral economics principles in health care suggest that individuals have a tendency to make health decisions that are biased toward the present and immediate rewards vs. future outcomes and delayed gratification (16, 17). These principles have been used in intervention design to motivate individuals to make health-promoting decisions, including engaging in treatment or services (18). Literature on interventions to promote service engagement among people experiencing mental illness has suggested that the provision of practical housing and financial supports are important in promoting service engagement (19, 20). It has also been proposed that financial incentives, providing a reliable, practical, and immediate reward for health-promoting behaviors, may be an effective engagement strategy and positively influence health decision-making, and consequently improve health and health service use outcomes in vulnerable populations (18, 21–24).
Financial incentives have indeed been shown to influence health behaviors for a range of health conditions, including increasing smoking cessation rates (25, 26), weight loss (27), engagement in HIV care and prevention (28–30), blood donation (31), and adherence to tuberculosis treatment (32). Reviews of the literature have found that financial incentives were effective in 73% of cases (33), and that effects were greater for singular behaviors compared to complex, sustained behavior change (33) and for shorter-term (<6 months) interventions (22). Specifically among people experiencing homelessness and/or mental illness, financial incentives have been shown to improve health outcomes such as therapy adherence (34, 35), medication adherence (32, 36), substance use abstinence (37, 38), and smoking cessation (39, 40).
Although existing literature has highlighted that financial incentives may be an effective service engagement strategy for underserved populations, particularly when implemented in the context of a short-term intervention (22, 33, 38), significant knowledge gaps remain. In particular, there is limited evidence on the effectiveness of financial incentives in different populations and settings, including their use in adults experiencing homelessness and mental illness following hospital discharge, a period of high risk for poor health outcomes. In addition, few studies have explored the acceptability of financial incentives, including the perspectives of key stakeholders, such as affected individuals and their service providers. As the use of financial incentives remains controversial, and ethical and pragmatic concerns continue, including concerns about coercion and unintended consequences, further exploration of these issues is warranted (41–44).
To address these knowledge gaps, this article describes an evaluation protocol for a study using mixed methods to investigate the effectiveness of and experiences with using financial incentives to increase engagement of homeless adults with mental illness with a brief case management intervention following hospital discharge in Toronto, Canada. In addition to service engagement, using a pragmatic field trial design, this study will investigate the impact of financial incentives on secondary health, health service use, quality of life, and housing outcomes. Qualitative data, exploring the acceptability, and perceived positive and negative impacts of financial incentives, will be integrated in study findings to support a comprehensive and nuanced understanding of the potential role of financial incentives in supporting service engagement in this underserved population.
Methods and Analysis
Program Description
The Coordinated Access to Care for the Homeless (CATCH) program is a multidisciplinary brief case management program for individuals experiencing homelessness and mental illness being discharged from hospital in Toronto, Canada. Informed by the Critical Time Intervention model, the program was launched in 2010 and has been described extensively elsewhere (11, 12, 45–48). Briefly, CATCH aims to support individuals in the critical period following hospital discharge by providing coordinated physical and mental medical care, peer support and intensive case management over a period of 3–6 months. Previous program evaluations have associated CATCH with improvements in mental health and substance use symptoms and health status (11), fewer and shorter hospitalizations, more frequent outpatient psychiatrist visits (46), and continuity of care (45).
Study Design
Using a community-based, participatory research framework, CATCH-Financial Incentives (CATCH-FI) is a pragmatic field trial using mixed methods to evaluate the impact and acceptability of financial incentives in promoting service engagement of homeless adults with mental illness following hospital discharge. This study was launched in December 2018. Study recruitment is completed, data collection however is ongoing and the trial is registered with ClinicalTrials.gov (Identifier: NCT03770221).
CATCH program participants enrolled in the CATCH-FI trial and randomly assigned to the intervention arm receive $20 for every week they remain meaningfully engaged with program service providers over 6 months of follow-up, or until they are successfully transitioned to longer-term supports. Study participants can earn up to $80CAN per month by attending meetings with their program service provider by phone, text, email, or in-person, as per their care plan. Participants randomly assigned to the control arm receive usual CATCH care, which does not include a financial incentive for attending meetings with their program service provider.
The impact of financial incentives on participants' level of service engagement, measured by program attendance, evaluated as the number of “health-care contacts” a participant makes with CATCH service providers over a 6-month follow-up period. Of note, participant contacts with service providers are counted as “health-care contacts” if they relate to participants' care plans. As a low barrier program, CATCH service providers meet program participants in person, via phone, email, or texts, as per program participants' needs and preferences. Social or trivial contacts of program participants with service providers are not considered “health-care contacts” and are not being measured or documented in program records or reports to program funders.
Secondary health, health service use, quality of life, and housing outcomes (secondary outcomes) are also being collected over the study period. The study hypothesis is that participants receiving financial incentives will have higher levels of service engagement and consequently better health, health service use, quality of life, and housing outcomes compared to participants receiving usual care.
This study additionally uses qualitative methods to investigate stakeholder perspectives and experiences using financial incentives. In-depth qualitative interviews and focus groups were conducted with study participants, program service providers, and other key informants to explore experiences of and perspectives on the acceptability of using financial incentives to support service engagement in this population.
The research questions guiding this study are:
1. What are the levels of service engagement and health, health service use, quality of life, and housing outcomes for homeless adults with mental health needs receiving financial incentives vs. usual care over a 6-month period following hospital discharge?
2. What are key stakeholder perspectives and experiences using financial incentives, including their acceptability, feasibility, as well as potential drawbacks?
Approach to Mixed Methods and Data Integration
Within a community-based, participatory research framework, a convergent mixed methods design is used to evaluate experiences with, perspectives on, and impact of financial incentives on service engagement of an underserved population. With the qualitative sample drawn from the larger study sample, and inclusive of additional key stakeholders, qualitative, and quantitative data collection take place in parallel (49, 50). In addition to integrating qualitative and quantitative data sources through sampling, integration of data sources will take place by comparing and contrasting qualitative and quantitative data once data analysis is completed, and through interpretation and reporting of findings (50–53). Our objective in employing this convergent synthesis approach is to leverage the respective advantages of both types of data to generate a comprehensive and nuanced understanding on how financial incentives may facilitate engagement, health, and well-being of an underserved population, including the range of unique, multi-level contextual factors that may impact implementation of this strategy (50, 54).
Study Participants: Recruitment, Eligibility, and Randomization
The CATCH program receives 450–600 referrals of homeless adults per year, from hospitals or community agencies, prior to or shortly after hospital discharge for a mental health condition. Study participants were recruited among successive new CATCH program participants. Referrals to the study were made by CATCH staff during program intake meetings. Program participants expressing an interest in receiving information about the study were contacted by research staff to confirm interest, eligibility, to obtain informed consent, and to conduct a baseline assessment.
Study participants meet both CATCH program and CATCH-FI study eligibility criteria. Program eligibility criteria include: (1) current homelessness (defined as having no fixed place to stay for at least the past seven nights with little likelihood of finding a place in the upcoming month) or precarious housing (defined as currently occupying a single room in a multi-tenant building or house with shared common areas including bathroom and kitchen or a hotel/motel as a primary residence, and having a history of one or more episodes of absolute homelessness in the past year); (2) service provider-determined unmet mental health needs; (3) service user-determined unmet support needs; and (4) age 18 years or older. Excluded from the program are individuals with recent aggressive behavior requiring a higher intensity of support, or individuals whose illness severity necessitates residential care. To be eligible for the current study, in addition to meeting program eligibility requirements, participants must have been new referrals to CATCH, recently admitted or readmitted to hospital services, and have had at least one contact with the CATCH team.
Participants were randomized following the baseline interview using block randomization (55), which randomizes the participant list into groups 1:1 using blocks of four and six. This approach has the advantage of maintaining balanced group sizes throughout the recruitment process. The nature of the intervention precluded blinding of participants and study staff.
A subset of participants completing qualitative interviews were purposefully recruited from the larger randomized sample to participate in in-depth semi-structured qualitative interviews. Qualitative study participants were purposefully selected to reflect a diversity of perspectives based on gender, ethnicity, study arm, and service engagement. Study staff invited individuals with the ability to reflect on their experiences, a strategy that has previously been used with success by our team in studies of adults experiencing homelessness and mental illness (11, 12, 45–48). Other key informant stakeholders and CATCH service providers were also purposefully recruited to complete interviews and focus groups based on their role or expertise (health care, health administration, health ethics). Key informants were health and administrative leaders at organizations affiliated with the CATCH program, and had experience serving the target population. CATCH service providers included both case managers and program administrators.
Sample Size
Previous research by our group (48) estimated that for those receiving usual care, the mean number of health-care contacts with program providers per month is 4.6. It was hypothesized that the intervention group will have at least 25% more health-care contacts with program providers per month (mean = 5.8) during the critical transition period. Because the primary outcome represents a count variable, sample sizes for Poisson regression were calculated using the formula provided in Signorini (56). Sample sizes of 67 per group achieve 80% power to detect a rate ratio of 1.25 with a significance level of 0.05 using a two-sided test. However, we expect an attrition rate of 22.0% (44), thus the final sample size per group is inflated by 22%, resulting in a total of 172 study participants. A subsample of study participants (n = 22), service providers (n = 12), and other key informants (n = 6) was estimated a priori as adequate to achieve saturation of qualitative findings and triangulation of data sources.
Data Collection
Baseline data collection occurred between November 2018 and September 2020; follow-up data collection will be completed in July 2021. All data collection is conducted by trained research assistants from the Survey Research Unit at the Centre for Urban Health Solutions at St. Michael's Hospital. Quantitative surveys lasting 1–2 hwere administered at baseline (up to within 6 weeks of enrollment) and are offered at 6 months post-enrollment (between 6 weeks prior to and up to 16 weeks after that) to all study participants. Survey data are collected using SNAP professional software, and data are held on an internally owned and operated secure sever. All program participants received honoraria paid in-person, by check or email money transfer for each completed interview ($30 for the baseline interview and $60 for the 6-month follow-up interview), in addition to public transportation fare.
Qualitative data collection occurred between April 2019 and December 2020. In-depth, 45–60-min semi-structured interviews were conducted during the study period with program participants and other key informants, and focus groups were conducted with CATCH service providers. Qualitative interview service user participants received an honorarium of $30 and public transportation fare.
This study uses several evidence-based follow-up and study retention strategies for this population (57, 58). To minimize attrition, participants were asked at baseline to provide detailed contact information for themselves and any family, friends, or service providers who could help locate them. To support study retention further, participants were also encouraged to call study staff monthly to update contact information (receiving a $10 honorarium per call). In addition, study staff regularly reach out to participants between interviews to maintain up to date contact records.
A schedule of enrolment, intervention, and assessment is detailed in Figure 1.
Figure 1. Schedule of enrolment, intervention, and assessments.
Measures
Quantitative Measures
The primary outcome is service engagement, or program attendance, measured as a count of health-care contacts with CATCH service providers per month over the 6-month period (or until discharge from the program). CATCH service providers record program participant attendance in health care appointments and care planning meetings lasting at least 5 min in participant health records. Eligible health-care contacts include in-person and virtual appointments, as well as care planning conversations through email or text. This definition is consistent with the current program practices and ensures only eligible health-care contacts are recorded and reported to the funding agency. Data on program attendance will be captured at study end through chart reviews by a blinded study staff.
Demographic data and other participant characteristics including residential status and income sources were collected by self-report at baseline. Secondary outcome measures of mental and physical health status, health service use, quality of life, and housing are being collected at baseline and 6 months and a measure of perceived therapeutic working alliance is collected at 6 months. Health service use will also be evaluated using data linkage of administrative health records, conducted at ICES, which holds population-based health and health service use information at the patient level for all Ontarians with health insurance.
See Table 1 for a detailed description of all quantitative measures.
Table 1. Description of measures.
Qualitative Measures
Interviews and focus groups explored the experiences of using financial incentives from both program participant and provider perspectives. Topic guides were developed and iteratively refined by the PI and study staff, with input from people with lived experience of homelessness and mental health challenges. Topics included perceptions of facilitators and barriers to service engagement during care transitions; factors affecting health decision-making in this population; and the perceived risks, barriers, and expected or experienced impact of financial incentives during care transitions. Given ethical concerns and underdeveloped literature on the use of financial incentives, topic guides specifically probed stakeholders to comment on the acceptability of using financial incentives, facilitators of ethical implementation, and potential negative or unintended consequences.
Interviewers' extensive experience with the study population, rigorous interviewer training for this study, and early and ongoing review of transcripts by the PI and study staff helped to ensure consistency across interviews. Investigator triangulation and member checking will help to validate the findings.
Analyses
Quantitative Analyses
Exploratory analyses will calculate descriptive statistics (mean, standard deviation, median, quartiles), construct graphs (histograms, box-plots, scatterplots, spaghetti plots), and estimate correlations between selected participants' characteristics and longitudinal outcomes.
Primary Outcome Analysis
Since program duration is customized for each participant, and may last between 1 and 6 months, we will calculate participants' person-months of program participation. This will allow us to estimate the rate ratio comparing the intervention and usual care groups with respect to the number of contacts with CATCH service providers per month. Therefore, for each participant, the total number of months in the program before discharge and the total number of contacts over the number of months in the program will be calculated. A Poisson regression model (PROC GENMOD) with total contacts as the dependent variable, group (CATCH-FI vs. CATCH-UC) as the covariate and an offset equal to the log (number of months spent on the program) will estimate the rate ratio and 95% confidence intervals, and the mean number of contacts per person-months and 95% confidence intervals in each group.
Secondary Outcome Analysis
For continuous outcomes (i.e., QoLi-20, CSI, SF-36, and EQ-5D VAS), we will define change from baseline to 6-month follow-up as scores at 6 months minus scores at baseline. We will conduct analyses of covariance (ANCOVA) to compare changes from baseline between CATCH-FI and CATCH-UC, adjusting for baseline scores as a covariate.
For count outcomes (i.e., GAIN-SS, number of hospitalizations, number of days hospitalized, and number of emergency department visits) we will model the baseline and 6-month outcomes using generalized estimating equations (GEE) assuming the Poisson distribution or the negative binomial distribution, if over-dispersion is suggested by the data. The models will include the main effects of group (CATCH-FI vs. CATCH-UC) and time (6 months vs. baseline), and the interaction of group by time. A significant interaction will indicate that change from baseline is different between the groups. Rate ratios and 95% confidence intervals will be estimated.
The analysis of administrative data is similar to that of count outcomes, except that the period of consideration will be 12 months instead of 6 months pre and post-randomization.
For analyzing the number of days stably housed in the past 6 months, we will consider GEE with a Poisson or negative binomial distribution. The model will include the main effects of group and time, an interaction between group and time, selected covariates, and an offset represented by the natural log of residence days accounted during the 6 months interval. Rate ratios and 95% confidence intervals will be estimated to compare the rate of days stably housed per person-months.
For the WAI-SR, evaluated at the 6-month follow-up only, total scale, and sub-scales scores will be calculated and compared between the groups using the two-sample t-test or the Wilcoxon rank-sum test if extreme outliers are present. The correlation between WAI-SR and other outcomes at 6 months will be explored by estimating the Pearson or Spearman correlation coefficients, overall and by group.
SAS 9.4 will be used for all analyses and all analyses will use the intention-to-treat principle. We will consider multiple imputation to handle missing data. All statistical tests will be two-sided and a p-value of 0.05 or less will indicate statistical significance. There are no plans for interim analyses.
Qualitative Analyses
All interviews and focus groups were audio-recorded and transcribed verbatim. Grounded theory (76, 77) and inductive thematic analysis (78) will be used to guide coding and interpretation of interview and focus group transcripts. This approach allows for theory-testing based on existing literature in addition to anticipating novel emerging themes.
Coding will be completed by a team of coders including the PI, study co-Investigators, and study staff, using a structured approach to maximize rigor (79–81). First, transcripts will be collectively reviewed to develop a set of key concepts or codes; potential codes are both identified beforehand based on literature reviews and initial data impressions and allowed to emerge during coding. Similar codes will be grouped into sets of higher-order themes, supported with direct examples, and the research team will reconvene to discuss categories and collectively, iteratively reduce, and refine the set of themes as needed. Investigator triangulation and member checking will be used to validate the data. Qualitative data analysis software (QSR International NVivo 12) will be used to support all qualitative data management and analysis.
Benefits, Risks, Safety, and Monitoring
All study participants have access to the CATCH program throughout the trial period. Participants in the intervention group experience the direct benefit of receiving a financial incentive. Participants in both groups may indirectly benefit from sharing their experiences with study staff and by contributing to knowledge creation that may inform strategies to more effectively support this population. Involvement in this intervention poses minimal risk to the safety of participants, and no anticipated harms.
A key criticism of the use of financial incentives is the risk of coercion. The study strives to minimize this risk directly, by recruiting participants from a program providing comprehensive support to homeless adults with mental health challenges, irrespective of study participation. In addition, the study uses a modest financial incentive and a rigorous informed consent process. Furthermore, the study strives to minimize the risk of coercion indirectly, by aiming to better understand this potential risk, how to minimize it in practice and how to identify strategies to better engage this underserved population.
It is possible that some participants may find certain survey or interview questions uncomfortable. Participation however is voluntary and individuals may choose not to answer or withdraw from the study at any point in time without penalty. All interventions involving financial incentives include the risk of creating a differential effect on those with varying levels of financial need, but this study's exclusive focus on people experiencing homelessness and mental health challenges minimizes this risk.
The study protocol was registered with ClinicalTrials.gov on December 10, 2018 (NCT number: NCT03770221). Research Ethics Board (REB)-approved protocol amendments will be posted on the site. The PI and study team will meet regularly to review data, data confidentiality, any adverse events, adherence to protocol design, recruitment and retention. In addition, the study team meet will meet regularly throughout the trial period, and collect and report to the REB any reported adverse events or other unintended effects of the intervention as per institutional policies. Important protocol modifications will also be reported to the REB and trial registry. This pragmatic field trial is subject to audits by the host institution.
The PI and study team bring extensive experience in the design, implementation, and evaluation of interventions for the target population (11, 12, 45–48), providing a reliable foundation for early identification and prompt response to potential emergent challenges.
Discussion
This article describes a pragmatic field trial protocol aiming to evaluate the acceptability and impact of financial incentives on service engagement of homeless adults with mental health challenges following hospital discharge. Service engagement of this population in traditional health services remains low, given their multiple competing priorities of securing shelter, basic income, access to health and social services, and other needed supports. A pragmatic randomized field trial and in-depth qualitative interviews and focus groups will contribute high quality evidence to an underdeveloped literature on the effectiveness and acceptability of financial incentives in supporting service engagement of this population, at high risk of poor outcomes.
Using a participatory framework, the study aims to include the voices of all relevant stakeholders in data collection, analysis and interpretation, including affected individuals, direct service providers, program administrators, and other key informants. The protocol is strengthened by the use of mixed methods, to provide a nuanced understanding of the acceptability, risks, and impact of financial incentives, including ethical and pragmatic considerations associated with their use. Ultimately, the study aims to inform local health solutions to supporting service engagement of this population.
Results and lessons learned will be useful to other populations or jurisdictions interested in implementing financial incentives or seeking to improve service engagement of underserved populations, a priority in many settings aspiring to promote health equity. Future research should investigate the role of additional strategies to promoting service engagement, including flexible drop-in appointments, using peers, and proactive outreach, in efforts to understand what service engagement strategies work best, for who, in diverse service contexts.
Conclusion
Promoting service engagement of homeless adults with mental illness following hospital discharge is urgently needed. Study findings will contribute to growing literature on strategies to support service engagement and improve health outcomes among disadvantaged and underserved populations.
Ethics and Dissemination
Ethics Statement
This study protocol was approved by the Unity Health Toronto Research Ethics Board (approval number REB#18-196; approved on November 1, 2018) and the Centre for Addiction and Mental Health Research Ethics Board (approval number REB#156/2018; approved December 19, 2018). All participants provided either written or verbal informed consent to participate. To facilitate and confirm participants' understanding, access to a professional interpreter and a capacity-to-consent questionnaire were used as needed.
Dissemination and Data Sharing
Trial findings will be communicated to study participants, funders and research audiences through briefing notes, presentations, and publications. There are no publication restrictions. Authorship membership is limited to study co-investigators and ICJME criteria for authorship will apply. Study datasets will be available through the corresponding author, as per Unity Health Institutional policies.
Author Contributions
NR led drafting of this manuscript. VS is the study's Principal Investigator and supervised the drafting of this manuscript. RN participated in the study design and implementation, led data analysis, and participated in the editing of this manuscript. SH, AD, and NK participated in study design and implementation and the editing of this manuscript. RW participated in data analysis and editing of this manuscript. All authors contributed to the article and approved the submitted version.
Funding
This study was sponsored by Unity Health Toronto (30 Bond St. Toronto, ON M5B 1W8, 416-460-4000). Funding for this study is provided by the Ontario Ministry of Health's Health System Research Fund (Grant Number: 259) and the Canadian Institutes of Health Research (CIHR Foundation Grant Funding Reference Number: 143259). The corresponding author, VS, is the Principal Investigator of this study; other co-Investigators include manuscript authors RN, SH, AD, and NK.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Acknowledgments
We would like to thank the CATCH program staff and service users for their time and participation in this study, in addition to the Survey Research Unit research staff at the MAP Centre for Urban Health Solutions, St. Michael's Hospital, Unity Health Toronto.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyt.2021.722485/full#supplementary-material
References
2. Fazel S, Geddes JR, Kushel M. The health of homeless people in high-income countries: descriptive epidemiology, health consequences, and clinical and policy recommendations. Lancet. (2014) 384:1529–40. doi: 10.1016/S0140-6736(14)61132-6
3. Stergiopoulos V, Cusi A, Bekele T, Skosireva A, Latimer E, Schutz C, et al. Neurocognitive impairment in a large sample of homeless adults with mental illness. Acta Psychiatr Scand. (2015) 131:256–68. doi: 10.1111/acps.12391
4. Buck DS, Brown CA, Mortensen K, Riggs JW, Franzini L. Comparing homeless and domiciled patients' utilization of the Harris County, Texas public hospital system. J Health Care Poor Underserved. (2012) 23:1660–70. doi: 10.1353/hpu.2012.0171
5. Hwang SW, Weaver J, Aubry T, Hoch JS. Hospital costs and length of stay among homeless patients admitted to medical, surgical, and psychiatric services. Med Care. (2011) 49:350–4. doi: 10.1097/MLR.0b013e318206c50d
6. Dixon LB, Holoshitz Y, Nossel I. Treatment engagement of individuals experiencing mental illness: review and update. World Psychiatry. (2016) 15:13–20. doi: 10.1002/wps.20306
7. Haddad PM, Brain C, Scott J. Nonadherence with antipsychotic medication in schizophrenia: challenges and management strategies. Patient Relat Outcome Meas. (2014) 5:43. doi: 10.2147/PROM.S42735
8. Kreyenbuhl J, Nossel IR, Dixon LB. Disengagement from mental health treatment among individuals with schizophrenia and strategies for facilitating connections to care: a review of the literature. Schizophr Bull. (2009) 35:696–703. doi: 10.1093/schbul/sbp046
9. Herman DB, Conover S, Gorroochurn P, Hinterland K, Hoepner L, Susser ES. Randomized trial of critical time intervention to prevent homelessness after hospital discharge. Psychiatr Serv. (2011) 62:713–9. doi: 10.1176/ps.62.7.pss6207_0713
10. Herman DB, Susser ES, Jandorf L, Lavelle J, Bromet EJ. Homelessness among individuals with psychotic disorders hospitalized for the first time: findings from the Suffolk county mental health project. Am J Psychiatry. (1998) 155:109–13. doi: 10.1176/ajp.155.1.109
11. Stergiopoulos V, Gozdzik A, Nisenbaum R, Drubin J, Hwang SW, O'Campo P, et al. Bridging hospital and community care for homeless adults with mental health needs: outcomes of a brief interdisciplinary intervention. Can J Psychiatry. (2018) 63:774–84. doi: 10.1177/0706743718772539
12. Stergiopoulos V, Gozdzik A, Cohen A, Guimond T, Hwang SW, Kurdyak P, et al. The effect of brief case management on emergency department use of frequent users in mental health: findings of a randomized controlled trial. PLoS ONE. (2018) 12:e0182157. doi: 10.1371/journal.pone.0182157
13. Shaffer SL, Hutchison SL, Ayers AM, Goldberg RW, Herman D, Duch DA, et al. Brief critical time intervention to reduce psychiatric rehospitalization. Psychiatr Serv. (2015) 66:1155–61. doi: 10.1176/appi.ps.201400362
14. Tomita A, Herman DB. The impact of critical time intervention in reducing psychiatric rehospitalization after hospital dis- charge. Psychiatr Serv. (2012) 63:935–7. doi: 10.1176/appi.ps.201100468
15. Kasprow WJ, Rosenheck RA. Outcomes of critical time intervention case management of homeless veterans after psychiatric hospitalization. Psychiatr Serv. (2007) 58:929–35. doi: 10.1176/ps.2007.58.7.929
16. Mogler BK, Shu SB, Fox CR, Goldstein NJ, Victor RG, Escarce JJ, et al. Using insights from behavioral economics and social psychology to help patients manage chronic diseases. J Gen Intern Med. (2013) 28:711–8. doi: 10.1007/s11606-012-2261-8
17. Rice T. The behavioural economics of health and health care. Ann Rev Public Health. (2013) 34:431–47. doi: 10.1146/annurev-publhealth-031912-114353
18. Carminati L. Behavioural economics and human decision making: instances from the health care system. Health Policy. (2020) 124:659–64. doi: 10.1016/j.healthpol.2020.03.012
19. George M, Manuel JI, Gandy-Guedes ME, McCray S, Negatu D. “Sometimes what they think is helpful is not really helpful”: understanding engagement in the Program of Assertive Community Treatment (PACT). Community Ment Health J. (2016) 52:882–90. doi: 10.1007/s10597-015-9934-9
20. Shaw J, Conover S, Herman DB, Jarrett M, Leese M, McCrone P, et al. Critical time intervention for severely mentally ill prisoners (CRISP): a randomized trial. Health Service Deliv Res. (2017) 5:1–38. doi: 10.3310/hsdr05080
21. Operario D, Kuo C, Sosa-Rubi SG, Galarraga O. Conditional economic incentives for reducing HIV risk behaviors: integration of psychology and behavioural economics. Health Psychol. (2013) 32:932–40. doi: 10.1037/a0032760
22. Giles EL, Robalino S, McColl E, Sniehotta FF, Adams J. The effectiveness of financial incentives for health behaviour change: systematic review and meta-analysis. PLoS ONE. (2014) 9:e90347. doi: 10.1371/journal.pone.0090347
23. Lagarde M, Haines A, Palmer N. Conditional cash transfers for improving uptake of health interventions in low- and middle-income countries: a systematic review. JAMA. (2007) 298:1900–10. doi: 10.1001/jama.298.16.1900
24. Wu W. The relationship between incentives to learn and Maslow's Hierarchy of Needs. Physics Procedia. (2012) 24:1335–42. doi: 10.1016/j.phpro.2012.02.199
25. Tappin D, Bauld L, Purves D, Boyd K, Sinclair L, MacAskill S, et al. Financial incentives for smoking cessation in pregnancy: randomized controlled trial. BMJ. (2015) 350:h134. doi: 10.1136/bmj.h134
26. Volpp KG, Troxel AB, Pauly MV, Glick HA, Puig A, Asch DA, et al. A randomized, controlled trial of financial incentives for smoking cessation. N Engl J Med. (2009) 360:699–709. doi: 10.1056/NEJMsa0806819
27. Volpp KG, John LK, Troxel AB, Norton L, Fassbender J, Lowenstein G. Financial incentive-based approaches for weight loss: a randomized trial. JAMA. (2008) 300:2631–7. doi: 10.1001/jama.2008.804
28. Barnett PG, Sorensen JL, Wong W, Haug NA, Hall SM. Effect of incentives for medication adherence on health care costs in methadone patients with HIV. Drug Alcohol Depend. (2009) 100:115–21. doi: 10.1016/j.drugalcdep.2008.09.017
29. Bassett IB, Wilson D, Taaffe J, Freedberg KA. Financial incentives to improve progression through the HIV treatment cascade. Curr Opin HIV AIDS. (2015) 10:451–63. doi: 10.1097/COH.0000000000000196
30. Dombrowski JC, Galagan SR, Ramchandani M, Dhanireddy S, Harrington RD, Moore A, et al. HIV care for patients with complex needs: a controlled evaluation of a walk-in, incentivized care model. Open Forum Infect Dis. (2019) 6:1–8. doi: 10.1093/ofid/ofz294
31. Goette L, Stutzer A. Blood Donations and Incentives: Evidence From A Field Experiment (April 2019). CEPR Discussion Paper No. DP13677. Available online at SSRN: https:/ssrn.com/abstract=3376608
32. Tulsky JP, Pilote L, Hahn JA, Zolopa AJ, Burke M, Chesney M, et al. Adherence to Isoniazid Prophylaxis in the homeless: a randomized controlled trial. Arch Intern Med. (2000) 160:697–702. doi: 10.1001/archinte.160.5.697
33. Merrick EL, Hodgkin D, Horgan CM. Incentives to shape health behaviors: how can we make them more person-centred? J Workplace Behav Health. (2014) 29:19–31. doi: 10.1080/15555240.2014.868721
34. Post E, Cruz M, Harman J. Incentive payments for attendance at appointments for depression among low-income African Americans. Psychiatr Serv. (2006) 57:414–6. doi: 10.1176/appi.ps.57.3.414
35. Stanley IH, Chu C, Brown TA, Sawyer KA, Joiner TE Jr. Improved clinical functioning for patients receiving fee discounts that reward treatment engagement. J Clin Psychol. (2016) 72:15–21. doi: 10.1002/jclp.22236
36. Priebe S, Yeeles K, Bremner S, Lauber C, Eldridge S, Ashby D, et al. Effectiveness of financial incentives to improve adherence to maintenance treatment with antipsychotics: cluster randomised controlled trial. BMJ. (2013) 347:f5847. doi: 10.1136/bmj.f5847
37. Messina N, Farabee D, Rawson R. Treatment responsivity of cocaine-dependent patients with antisocial personality disorder to cognitive-behavioral and contingency management interventions. J Consult Clin Psychol. (2003) 71:320. doi: 10.1037/0022-006X.71.2.320
38. Davis DR, Kurti AN, Skelly JM, Redner R, White TJ, Higgins ST. A review of the literature on contingency management in the treatment of substance use disorders, 2009-2014. Prev Med. (2016) 92:36–46. doi: 10.1016/j.ypmed.2016.08.008
39. Baggett TP, Chang Y, Yaqubi A, McGlave C, Higgins ST, Rigotti NA. Financial incentives for smoking abstinence in homeless smokers: a pilot randomized controlled trial. Nicotine Tob Res. (2018) 20:1442–50. doi: 10.1093/ntr/ntx178
40. Rash CJ, Petry NM, Alessi SM. A randomized trial of contingency management for smoking cessation in the homeless. Psychol Addict Behav. (2018) 32:141–8. doi: 10.1037/adb0000350
41. Giles EL, Sniehotta FF, McColl E, Adams J. Acceptability of financial incentives and penalties for encouraging uptake of health behaviours: focus groups. BMC Public Health. (2015) 5:58. doi: 10.1186/s12889-015-1409-y
42. Hoskins K, Ulrich CM, Chinnick J, Buttenheim AM. Acceptability of financial incentives for health-related behavior change: an updated systematic review. Prev Med. (2019) 126:105762. doi: 10.1016/j.ypmed.2019.105762
43. Noordraven EL, Schermer MHN, Blanken P, Mulder CL, Wierdsma AI. Ethical acceptability of offering financial incentives for taking antipsychotic depot medication: patients' and clinicians' perspectives after a 12-month randomized controlled trial. BMC Psychiatry. (2017) 17:313. doi: 10.1186/s12888-017-1485-x
44. Priebe S, Sinclair J, Burton A, Marougka S, Larsen J, Firn M, et al. Acceptability of offering financial incentives to achieve medication adherence in patients with severe mental illness: a focus group study. J Med Ethics. (2010) 36:463–8. doi: 10.1136/jme.2009.035071
45. Lamanna D, Stergiopoulos V, Durbin J, O'Campo P, Poremski D, Tepper J. Promoting continuity of care for homeless adults with unmet health needs: The role of brief interventions. Health Soc Care Community. (2018) 26:56–64. doi: 10.1111/hsc.12461
46. Reid N, Mason J, Kurdyak P, Nisenbaum R, de Oliveira C, Hwang S, et al. Evaluating the impact of a critical time intervention adaptation on health care utilization among homeless adults with mental health needs in a large urban centre. Can J Psychiatry. (2021). doi: 10.1177/0706743721996114. [Epub ahead of print].
47. Stergiopoulos V, Gozdzik A, Tan de Bibiana J, Guimond T, Hwang SW, Wasylenki DA, et al. Brief case management versus usual care for frequent users of emergency departments: the Coordinated Access to Care from Hospital Emergency Departments (CATCH-ED) randomized controlled trial. BMC Health Serv Res. (2016) 16:432. doi: 10.1186/s12913-016-1666-1
48. Stergiopoulos V, Gozdzik A, Nisenbaum R, Lamanna D, Hwang SW, Tepper J, et al. Integrating hospital and community care for homeless people with unmet mental health needs: program rationale, study protocol and sample description of a brief multidisciplinary case management intervention. Int J Ment Health Addiction. (2017) 15:362–78. doi: 10.1007/s11469-017-9731-5
49. Creswell JW, Plano Clark VL. Designing and Conducting Mixed Methods Research (2nd ed.). Thousand Oaks, CA: Sage (2010).
50. Fetters MD, Curry LA, Creswell JW. Achieving integration in mixed methods designs – principles and practices. Health Serv Res. (2013) 48:2134–56. doi: 10.1111/1475-6773.12117
51. Pluye P, Hong QN. Combining the power of stories and the power of numbers: mixed methods research and mixed studies reviews. Annu Rev Public Health. (2014) 35:29–45. doi: 10.1146/annurev-publhealth-032013-182440
52. Templeton AR, Young L, Bish A, Gnich W, Cassie H, Treweek S, et al. Patient-, organization-, and system-level barriers and facilitators to preventive oral health care: a convergent mixed-methods study in primary dental care. Implement Sci. (2016) 11:5. doi: 10.1186/s13012-015-0366-2
53. Vallesi S, Flatau P, Thielking M, Mackelprang JL, Taylor KM, La Sala L, et al. A mixed methods randomised control trial to evaluate the effectiveness of the journal to social inclusion – phase 2 intervention for chronically homeless adults: study protocol. BMC Public Health. (2019) 19:334. doi: 10.1186/s12889-019-6644-1
54. Migiro SO, Magangi BA. Mixed methods: a review of the literature and the future of the new research paradigm. Afr J Bus Manag. (2011) 5:3757–64. doi: 10.5897/AJBM09.082
55. McEntegart D. Block randomization. In: D'Agostino RB, Sullivan L, Massaro J, editors. Wiley Encyclopedia of Clinical Trials. Hoboken, NJ: John Wiley & Sons, Inc (2008). doi: 10.1002/9780471462422.eoct301
56. Signorini DF. Sample size for Poisson regression. Biometrika. (1991) 78:446–50. doi: 10.1093/biomet/78.2.446
57. Barber CC, Fonagy P, Fultz J, Simulinas M, Yates M. Homeless near a thousand homes: outcomes of homeless youth in a crisis shelter. Am J Orthopsychiatry. (2005) 75:347–55. doi: 10.1037/0002-9432.75.3.347
58. Seidman LJ, Schutt RK, Caplan B, Tolomiczenko G, Turner WM, Goldfinger SM. The effect of housing interventions on neuropsychological functioning among homeless persons with mental illness. Psychiatr Serv. (2003) 54:905–8. doi: 10.1176/appi.ps.54.6.905
59. Boothroyd R, Chen H. The psychometric properties of the Colorado Symptom Index. Adm Policy Ment Health. (2008) 35:370–8. doi: 10.1007/s10488-008-0179-6
60. Dennis ML, Chan YF, Funk RR. Development and validation of the GAIN Short Screener (GSS) for internalizing, externalizing and substance use disorders and criminal/violence problems among adolescents and adults. Am J Addictions. (2010) 15:s80–s91. doi: 10.1080/10550490601006055
61. Ware Jr. JE, Sherbourne C. The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care. (1992) 30:473–83. doi: 10.1097/00005650-199206000-00002
62. Ware JE Jr, Snow K, Kosinski M, Gandek B. SF-36 Health Survey Manual and Interpretation Guide. Boston, MA: New England Medical Centre, The Health Institute (1993).
63. Durbin A, Kapustianyk G, Nisenbaum R, Wang R, Aratangy T, Khan B, et al. Recovery education for people experiencing housing instability: an evaluation protocol. Int J Soc Psychiatry. (2019) 65:468–78. doi: 10.1177/0020764019858650
64. Burckhardt CS, Anderson KL. The Quality of Life Scale (QOLS): reliability, validity and utilization. Health Qual Life Outcomes. (2003) 1:60. doi: 10.1186/1477-7525-1-60
65. Lehman AF, Dixon LB, Kernan E, DeForge BR, Postrado LT. A randomized trial of assertive community treatment for homeless persons with severe mental illness. Arch Gen Psychiatry. (1997) 54:1038–43. doi: 10.1001/archpsyc.1997.01830230076011
66. Powell GA, Adair CE, Streiner DL, Mayo N, Latimer E. Changes in quality of life from a homelessness intervention: true change, response shift, or random variation. Qual Life Res. (2017) 26:1853–64. doi: 10.1007/s11136-017-1522-8
67. Patterson M, Moniruzzaman A, Palepu A, Zabkiewicx D, Frankish CH, Krausz M, et al. Housing first improves subjective quality of life among homeless adults with mental illness: 12-month findings from a randomized controlled trial in Vancouver, British Columbia. Soc Psychiatry Psychiatr Epidemiol. (2013) 48:1245–59. doi: 10.1007/s00127-013-0719-6
68. EuroQol Research Foundation. EQ-5D-5L User Guide. (2019). Available online at: https://euroqol.org/publications/user-guides
69. Lamers LM, Bouwmans CA, van Straten A, Donker MCH, Hakkaart L. Comparison of EQ-5D and SF-6D utilities in mental health patients. Health Econ. (2006) 15:1229–36. doi: 10.1002/hec.1125
70. Tsemberis S, McHugo G, Williams V, Hanrahan P, Stefancic A. Measuring homelessness and residential stability: the residential time-line follow-back inventory. J Comm Psychol. (2007) 35:29–42. doi: 10.1002/jcop.20132
71. New Hampshire Dartmouth Rehabilitation Centre. Residential Follow-Back Calendar [Version June 1995]. Lebanon, NH: Dartmouth Medical School (1995).
72. Goering P, Veldhuizen S, Watson A, Adair C, Kopp B, Latimer E, et al. National At Home/Chez Soi Final Report. Calgary, AB: Mental Health Commission of Canada (2014). Available online at: http://www.mentalhealthcommission.ca
73. Goering P, Streiner D, Adair CE, Aubry T, Barker J, Distasio J, et al. The At Home/Chez Soi trial protocol: a pragmatic, multi-site, randomized controlled trial of Housing First in five Canadian cities. BMJ Open. (2011) 1:e000323. doi: 10.1136/bmjopen-2011-000323
74. Busseri MA, Tyler JD. Interchangeability of a working alliance inventory and working alliance inventory, short form. Psychol Assess. (2003) 15:193–7. doi: 10.1037/1040-3590.15.2.193
75. Horvath AO, Greenberg LS. Development and validation of the Working Alliance Inventory. J Couns Psychol. (1989) 36:223–33. doi: 10.1037/0022-0167.36.2.223
76. Glaser BG, Strauss A. Discovery of Grounded Theory. Strategies for Qualitative Research. New Brunswick; London: Sociology Press (1967). doi: 10.1097/00006199-196807000-00014
78. Braun V, Clark V. Using thematic analysis in psychology. Qual Res Psychol. (2006) 3:77–101. doi: 10.1191/1478088706qp063oa
79. Devotta K, Pedersen C. Coding Qualitative Data: Working With a Team of Coders. CRICH Survey Research Unit Methodology Bits. (2015). Available online at: https://hdl.handle.net/1807/70247
Keywords: homelessness, mental illness, service engagement, financial incentives, randomized controlled trial
Citation: Reid N, Nisenbaum R, Hwang SW, Durbin A, Kozloff N, Wang R and Stergiopoulos V (2021) The Impact of Financial Incentives on Service Engagement Among Adults Experiencing Homelessness and Mental Illness: A Pragmatic Trial Protocol. Front. Psychiatry 12:722485. doi: 10.3389/fpsyt.2021.722485
Received: 08 June 2021; Accepted: 09 July 2021;
Published: 03 August 2021.
Edited by:
Daniel Bressington, Charles Darwin University, AustraliaReviewed by:
Daniel Poremski, Institute of Mental Health, SingaporeKristy Buccieri, Trent University, Canada
Copyright © 2021 Reid, Nisenbaum, Hwang, Durbin, Kozloff, Wang and Stergiopoulos. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Vicky Stergiopoulos, vicky.stergiopoulos@camh.ca