The Short-Term Value of the “Healthy Primary School of the Future” Initiative: A Social Return on Investment Analysis

Background: This study examines the social return on investment (SROI) of the “Healthy Primary School of the Future” initiative after 2 years.

Methods: Healthy Primary Schools of the Future (HPSF) provide a healthy lunch and daily structured physical activity sessions, whereas Physical Activity Schools (PAS) focus on physical activity only. We evaluated the 2-years investments and effects (N = 1,676 children) of both school environments (four schools) compared to control schools (four schools). Investments and outcomes were grouped within the healthcare, education, household & leisure, and labor & social security sector. Outcomes that could be expressed in monetary terms were used for the calculation of social return on investment.

Results: HPSF and PAS created outcomes for the healthcare sector by favorable changes in health behaviors, body mass index [both significant], and medical resource use [not significant]. Outcomes for the education sector included a favorable impact on perceived social behaviors and school satisfaction, and absenteeism from school [latter not significant], and more engagement with the community was experienced. The per child investments, €859 (HPSF) and €1017 (PAS), generated a benefit of €8 (HPSF) and €49 (PAS) due to reduced school absenteeism and medical resource use.

Conclusions: Within 2 years of intervention implementation, the HPSF initiative created outcomes in several sectors, but the benefits did not outweigh the investments. Follow-up assessments as well as modeling long-term outcomes are needed to assess the total value of the interventions. Until then, the SROI framework can inform strategies for obtaining stakeholder support and intervention implementation.

Trial registration: The study was registered in the ClinicalTrials.gov database on 14 June 2016 (NCT02800616).

Introduction

The environment in which today's children are growing up is characterized by many opportunities for unhealthy dietary intake and few facilities for physical activity (1, 2). Adverse consequences, such as overweight and obesity have been steadily increasing over the last decades. In 2009, 13–15% of Dutch boys and girls aged 2–21 years were overweight compared to 5–7% in 1980 (3). As a response to this growing public health concern, the Healthy Primary School of the Future initiative was developed (4). Key elements of this initiative are the provision of a daily healthy lunch and structured physical activity sessions, which are innovative elements within the Dutch primary school setting (corresponding to 4–12 years of age). The HPSF initiative consists of a full intervention, named the “Healthy Primary Schools of the Future” (HPSF), and a partial intervention, referred to as “Physical Activity Schools” (PAS). Within 2 years of intervention, Bartelink et al. (14) found that HPSF was effective in increasing healthy dietary behaviors and physical activity (5). Both HPSF and PAS were also effective in lowering children's body mass index (BMI) z-scores (BMI adjusted for age and sex) (6).

Cost-effectiveness studies aim to inform implementation and funding decisions. Ideally, the time over which costs and outcomes of childhood programs are evaluated should go beyond childhood, because the impact of weight reductions on chronic diseases, health-related quality of life (HRQOL), and costs do not fully occur within childhood. Evaluations of short-term cost and effects are, however, more in line with the time horizons that policy makers tend to work with (usually 3–5 years) (7, 8), and provide information for decision-making on the implementation, continuation, and scaling-up of interventions.

In the current study, we use the social return on investment (SROI) framework for examining the investments, outcomes, and societal value of HPSF and PAS. The SROI framework aims to examine all outcomes of a program (no matter who incurs them). To aggregate investments and outcomes and calculate return on investment or cost-effectiveness, outcomes are assigned to a monetary value (financial benefits) and are divided by the investments. This calculation (SROI calculation) results in an estimate on the amount of benefits returned for every euro spent (9, 10). The SROI framework also recognizes that not all outcomes can be assigned to a monetary value (and can be expressed quantitatively). Outcomes that cannot be expressed in monetary terms are included in a SROI story, which articulates the non-monetary value. The objective of this study is to examine the short-term SROI generated by HPSF and PAS in the first 2 years of intervention implementation.

Methods

A quasi-experimental study, which started in 2015 in the south of the Netherlands, evaluates the effects of two “Healthy Primary Schools of the Future” (HPSF) and two “Physical Activity Schools” (PAS) compared to four control schools who maintained the usual school curriculum. No randomization was applied because voluntary participation was key to the intervention implementation. A healthy morning snack and daily healthy lunches were provided (at HPSF only) in combination with structured physical activity sessions including structured sports activities, free play, and creative activities. At HPSF, the lunch break was prolonged to about 1 h, which led to an extension of the school day with ~30 min (some lunch breaks involved an educational component to meet the education hour requirements). Children and their parents were invited to participate in data collection at baseline (no blinding), and could join at all measurement waves as children continuously leave and enter primary school (dynamic cohort design). Further details on the interventions and data collection procedures have been published elsewhere (4, 11).

A SROI analysis was performed by taking five steps, according to the methods of Nicholls et al. (2012): (1) defining the scope and identifying key stakeholders; (2) identifying investments and outcomes; (3) evidencing outcomes; (4) establishing impact, and (5) assessing the SROI (12).

Step 1: Scope and Key Stakeholders

Whilst the quasi-experimental study examines the effects of HPSF and PAS for a period of 4 years (baseline: school year 2015/2016, year 4: 2019/2020), the current study focuses on the impact after 2 years (baseline: school year 2015/2016, year 1: 2016/2017, year 2: 2017/2018). Several stakeholders contributed to the delivery of HPSF and PAS, and may be directly or indirectly affected by the interventions. Stakeholders were grouped within the healthcare, education, household & leisure, and labor & social security sector (Figure 1: box H, box E, box HL, and box L, respectively).

FIGURE 1

Figure 1. Impact inventory including the potential outcomes of school-based lifestyle interventions. HRQOL, health-related quality of life; PA, physical activity. Underlined text: The outcomes that could be expressed in financial terms (H3, H4, H6, E3, HL4, L2) were included in the calculation of social return on investment. Due to the small numbers for unpaid work (HL4) and parental absenteeism from work or education (L2), the potential benefits could not be reliably estimated and we refrained from including them in the calculation of social return on investment. We refrained from defining financial proxies for outcomes that are not financial in nature (e.g., behaviors) as this will lead to double counting due to the interdependencies between outcomes within the same or between domains (e.g., health behaviors, physical health, and HRQOL; between physical health and absenteeism from school). Non-financial outcomes, however, may have some additional value. We therefore complemented the SROI calculation with a SROI story. A longer time horizon was needed to examine the outcomes on cognitive performances (E2). HL1, HL2, and L1 were not (yet) formally measured within the quasi-experimental study.

Step 2 and 3: Identifying Investments and Outcomes and Evidencing Outcomes

Investments

In a previous study, we made an overview of the activities provided at HPSF and PAS in comparison to the regular school curriculum, and the corresponding investment costs (13). The cost analysis also revealed cost offsets: children's lunches were provided at school and led to a cost offset within the household, and the extended school day at HPSF provided caregivers with additional time (productivity cost) that could be spent on paid or unpaid work. These cost offsets were deducted from the investments to calculate the net investments. For more details on the cost calculation see Appendix 2.

Qualitative Outcomes

Semi-structured interviews with stakeholders were held at the end of the second year about the implementation and perceived changes (11). School coordinators (N = 4), coordinators of the pedagogical employees (N = 4), school health promoters from the regional Public Health Services (N = 4), and the project coordinator (N = 1) were interviewed (Figure 1 and Appendix 3). More information can be found in the paper written by Bartelink et al. (14).

Quantitative Outcomes

The selection of quantitative outcomes was made by the interdisciplinary scientific project group, and presented in an impact inventory (Figure 1) (4). Quantitative outcomes were measured annually (T0: 2015, T1: 2016, T2: 2017) and covered height and weight measurements, child questionnaires, and parental questionnaires. School records contained information on absenteeism from school. Routine school satisfaction surveys were administered among caregivers and children between 2016 and 2018. In the current study, we included children that were enrolled at the participating schools and exposed to the interventions from baseline onwards. Children in grade 8 at baseline were excluded as no follow-up measurements could be obtained. We also excluded the children that switched between schools between 2015 and 2017. Benefits were calculated by multiplying the outcomes over 2 years (measured in volumes/quantity) by the unit cost for that outcome. Benefits were assessed at the group level in order to calculate an average per child benefit. Standardized prices from national costing guidelines were used for outcomes that were financial in nature (medical resource use, productivity) (15), and published proxy values were applied for other outcomes (QALY and school absenteeism) (Table A3.1) (16, 17). The outcome measurement and valuation, and the selection of the study sample (N = 1,676) are further described in Appendix 3.

Step 4: Establishing Impact

This step is used to estimate what proportion of the outcome can be isolated as being added by the intervention. In the current study, the quasi-experimental design with a control group and 2-years time frame was used to account for this element.

Step 5: SROI Assessment

The SROI calculation included the outcomes on children's HRQOL, medical resource use (Figure 1: H3 and H4), and school absenteeism (Figure 1: E3). The outcomes for medical resource use and absenteeism, which represented a cost, were rescaled so that all outcomes would indicate a benefit. Benefits were calculated as the sum of outcomes over year 1 and 2. Firstly, the per child benefits were aggregated within each sector, and were then summed up across the sectors (within-dimension approach) (18). An annual discount rate of 2.5% was used for investments and benefits to account for the differences in the time at which investments and outcomes occur (16). The reasons for in/excluding outcomes from the SROI calculation, and the calculation of benefits are further detailed in Appendix 4.

Statistical Analysis

Descriptive statistics were used to explore baseline sociodemographic and outcome variables. Multiple imputation was used to account for possible selective non-response (missing at random assumption) and to use all available data (see Appendix 4 for details on the handling of missing data). Imputations were generated with the MICE package in R using 50 imputed datasets with 20 iterations (for details see Appendix 4) using predictive mean matching. The mean differences in the per child benefits over year 1 and 2 were examined with a generalized linear model with a Gamma distribution and a log link function to account for the zero values and skewness of the data. The analyses were adjusted for sex, study year at baseline, socioeconomic status (SES), ethnicity, baseline BMI z-scores (BMI adjusted for age and sex), and baseline outcome scores to account for imbalances in covariates (Appendix 4). The social return on investment was calculated as the ratio of benefits to net investments. Additionally, the incremental net monetary benefit was calculated as the difference in benefits (for HPSF and PAS vs. control schools) minus the difference in net investments. All statistical analyses were performed in IBM SPSS Statistics for Windows version 23 (Armonk, NY: IBM Corp) and R version 3.5.1.

Scenario and Sensitivity Analysis

Scenario analyses were performed to analyse the SROI of HPSF and PAS for specific situations. For details and reasoning behind the scenario analyses we refer to Appendix 5. (1) Lower investments at HPSF for pedagogical staff (eight instead of 12 pedagogical workers) based on changes in the way activities are organized. (2) Lower investments for HPSF and PAS that are expected to occur on the long-term (so-called steady state) (13). (3) Excluding children in grade 7 at baseline who are leaving school after the eighth grade and missed the 2-years follow-up measurement. Sensitivity analyses were conducted to see how the results would change under different assumptions: (1) Including spillover effects on caregiver's HRQOL and productivity (paid work) (Figure 1: H6, HL4). (2) No offsets due to the extended school day at HPSF in the calculation of the net investment for HPSF. (3 and 4) Willingness to pay (WTP) thresholds of €20.000 and €50.000 per QALY gained instead of €36.000 per QALY gained. (5) No discounting of benefits and investments instead of an annual discount rate of 2.5%. (6) A complete case analysis (non-imputed outcomes). For details on the sensitivity analyses, see also Appendix 5.

Results

At baseline (T0), N = 1,403, 60.3% children and their parents joined the study. For the current study, N = 1,676 children and their parents were included based on the selection of school years and school switchers excluded (see Appendix 1 for the flow diagram) (6). Children from control schools had higher BMI z-scores (0.232 vs. 0.051 at HPSF and 0.092 at PAS) and chronic diseases were more prevalent (36 vs. 30% at HPSF and PAS) (Table 1).

TABLE 1

Table 1. Summary of covariates and baseline outcomes for each group separately (pre-imputation).

Investments

For the first year of implementation, the total investments amounted to €1,448 per child for HPSF and €665 per child for PAS. The offsets for HPSF included the forgone household expenses on children's lunches as they were provided by the schools, the value of the extended school day in terms of parental productivity, and the forgone household expenses on the fee for the lunch break (used for supervision during the lunch break) which was not applied (total €−1,019 per child). The net investment costs of HPSF were €429 per child for the first year of intervention implementation (€2.68 per child per day) (not discounted). The offsets for PAS only included the forgone household expenses on the fee for the lunch break (the offsets for the lunch and the prolonged school day were not applicable for PAS), and the net investment amounted to €505 per child for the first year (€3.16 per child per day) (not discounted) (19). In the second year, the costs for transport and accommodations were not incurred, which resulted in a net investment of €399 (HPSF) and €475 (PAS) per child (not discounted). The net investment for year 1 and 2 together were €828 per child for HPSF (€2.59 per child per day) and €980 for PAS (€3.06 per child per day) (discounted results: €859 per child year and €2.69 per child per day for HPSF, and €1,017 per child year and €3.18 per child per day for PAS).

SROI Story (Non-monetized Outcomes)

Child Outcomes

Healthcare

Bartelink et al. (2019) previously reported that water consumption, the intake of different food types during the lunch, and time spent in light physical activity had increased more at HPSF compared to control schools (5). Several participants on the interviews reported that dietary behaviors of children at HPSF became more diverse, and children were more willing to taste unfamiliar products (Figure 1: H1) (14). Standardized BMI scores had decreased more in children at HPSF compared to children at PAS and control schools, and for children at PAS in comparison to children at control schools (6) (Figure 1: H2).

Education

From the interviews with stakeholders it emerged that children were less bored during recess time and fewer conflicts happened at the schoolyard and in the classroom (Figure 1: E1) (14). The school satisfaction surveys showed that children were satisfied with the lunch (60–83% at the two HPSF schools), and with the PA sessions at HPSF and PAS (75–93%). Nearly half of the children at HPSF enjoyed the school day more (39–50%) compared to the pre-intervention period, compared to 46–57% of children at PAS (Figure 1: E4).

Intangibles

Regarding non-cognitive skills, the interview respondents noticed that children learnt from the offered games as children were better able to create and manage their own activities during recess time (Figure 1: I1). No significant differences were found between groups for children's self-efficacy scores (adjusted mean differences HPSF vs. control: −0.48 [95% CI: −1.38; 0.42] PAS vs. control: 0.30 [95% CI: −0.60; 1.19]). Self-reported psychosocial health (Figure 1: I2), measured with the Pediatric Quality of Life (PedsQL) instrument, decreased somewhat from baseline to year 2 (no statistically significant differences between groups). This was, however, not observed for parent-reports about children's psychosocial health (Appendix 6).

Outcomes in Other Persons Than the Child

Healthcare

Some teacher and parental practices (discussing and educating about nutrition and PA) changed in a favorable direction (Figure 1: H5) (14).

Education

Caregivers were generally satisfied with the organization (67–74%) and the content of the lunch (70–76%) at HPSF, and with the structured sports activities, free play, and creative activities at HPSF and PAS (50–79%). The majority would recommend HPSF to other caregivers (64–76%) (Figure 1: E5).

Intangibles

No significant changes over time were found between groups for parental well-being (adjusted mean differences HPSF vs. control: 0.28 [95% CI: −0.37; 0.93], PAS vs. control: 0.08 [95% CI: −0.61; 0.76]) (Figure 1: I3).

Household and leisure

Organizations for sport and leisure were invited to provide workshops. Activities did not only take place at school, but the school gym and the green area around the school were also used for free play and games (Figure 1: HL3). At year 2, 12–18% of the respondents on the parental questionnaire reported that their own working hours and/or the working hours of their partner changed as a result of HPSF and PAS, varying from minor to a lot of influence.

Labor and social security

No statistically significant differences were found for parental absenteeism from work or education (Appendix 6) (Figure 1: L2). As this result was based on only few cases (known for <10% of the analyzed study participants) the benefits could not be reliably estimated, and we refrained from including this benefit in the calculation of social return on investment.

SROI Calculation (Monetized Outcomes)

No statistically significant differences were found between groups for the number of QALYs accrued by children and for children's medical resource use within the 2-years of follow-up (Figure 1: H3 and H4). No statistically significant differences were found for health-related and non-health related absenteeism (Figure 1: E3). Because absenteeism represents a cost, absenteeism days were represented as a negative benefit. The monetary value (per child per 2 years) for health-related absenteeism amounted to €−309 (PAS) and €−352 (HPSF) vs. €−338 (control schools), and were €−29 (PAS) and €−25 (HPSF) vs. €−31 (control schools) for non-health related absenteeism (Table 2). No significant differences were found between groups for the number of QALYs accrued by caregivers (Figure 1: H6): rate ratio HPSF vs. control: 1.00 [95% CI: 0.97; 1.04], rate ratio PAS vs. control: 1.01 [95% CI: 0.97; 1.04]. No statistically significant differences were found for time spent on paid work (Figure 1: HL4): rate ratio HPSF vs. control: 1.02 [95% CI: 0.97; 1.08], PAS vs. control: 1.05 [95% CI: 0.99; 1.12]. The net investment for HPSF (€859/child/2 years), generated a benefit of €8/child/2 years [95% CI: €−1,085–1,057] when considering the financial outcomes in the child (Table 2). The incremental net benefit of HPSF was estimated at €−851/child/2 years (SROI ratio of 0.01). The net investment costs for PAS (€1017/child/2 years), generated a benefit of €49/child/2 years [95% CI: €−1,041–1,097]. The incremental net benefit of PAS was estimated at €−968/child/2 years (SROI ratio of 0.05). See Appendix 6 for the results when not adjusting for covariates. A breakdown of results by sector shows that most investment were incurred by the education sector, while offsets were received by the household and leisure sector, and most benefits belonged to the healthcare sector (HPSF: 100%, PAS: 40%) (Table 3).

TABLE 2

Table 2. Social return on investment (€) in year 1 and 2 (N = 1,676, adjusted for covariates).

TABLE 3

Table 3. Breakdown of social return on investment (€) in year 1 and 2 by sector.

The results of the scenario and sensitivity analyses were comparable to the base-case (SROI between zero and one), except for excluding children who were in grade 7 at baseline, and for the complete case analysis (Appendix 7). Repeating the analysis without children in grade 7 resulted in extra benefit for both HPSF and PAS (SROI HPSF: 1.70 vs. 0.01; PAS: 0.70 vs. 0.05). Additionally, including spillovers on caregiver's HRQOL and productivity increased the SROI (SROI HPSF: 0.05 vs. 0.01, PAS: 0.70 vs. 0.05). The complete case analysis showed comparable results with regard to the direction of the regression estimates (Appendix 5). However, due to the number of missing data and the missing data mechanism (not completely at random) the complete case analysis resulted in inefficient and (probably) biased point estimates of the benefits (SROI HPSF: −1.80 vs. 0.01, PAS: 0.60 vs. 0.05).

Discussion

The objective of the current study was to examine the short-term return on investment created by HPSF and PAS after 2 years of intervention. HPSF and PAS led to outcomes within the healthcare sector (favorable changes in health behaviors and body mass index [both significant], and medical resource use [not significant]), education sector (favorable changes on perceived social behaviors at school and school satisfaction, and absenteeism from school [later not significant]), and household & leisure sector (perceived engagement with the community). The benefits (HPSF: €0.05 per child/day, PAS: €0.31/child/day), did not outweigh the net investment costs of HPSF and PAS (HPSF: €2.69/child/day, PAS: €3.18/child/day). For every euro invested, HPSF and PAS generated a benefit of €0.01 [95% CI: €−1.3; €1.2] and €0.05 [95% CI: €−1.0; €1.1], respectively. In the paper of Bartelink et al. (2019) it was shown that HPSF resulted in more favorable effects on children's BMI scores compared to PAS (6). The authors suggested that HPSF may be more effective in targeting health behaviors, since HPSF simultaneously addressed nutrition and physical activity, and the activities at HPSF led to additional health-promoting changes in the school (5). In contrast, the SROI calculation revealed that PAS led to more financial benefits than HPSF, which was mainly due to the favorable effects of PAS on absenteeism from school (not statistically significant). The results, however, do not suggest that PAS had a more favorable SROI as compared to HPSF, because HPSF led to more favorable results on the non-monetized outcomes (see SROI story). The findings on financial benefits need to be interpreted with caution. Benefits were not statistically significant and therefore uncertain, but a trend toward favorable outcomes was observed. The SROI of HPSF and PAS increased substantially after including spillover effects, which was driven by the monetization of the relative small effects on caregivers' HRQOL (WTP for a QALY), as well as by the favorable effects on caregiver productivity. In the sensitivity analysis, it can also be seen that the SROI was sensitive to the QALY gains. Most short-term cost-effectiveness studies on childhood lifestyle interventions examined cost-effectiveness by the ratio of costs and health outcomes, such as body mass index improvements, cases of overweight prevented, or units of waist circumference prevented (20). WTP thresholds are not available for these outcomes, and interpreting their cost-effectiveness results therefore remains difficult. In contrast to these studies, we combined a qualitative and quantitative approach for examining the health- and non-health outcomes of HPSF and PAS. By using the SROI framework we were able to integrate the outcomes for multiple sectors (21, 22). If we would have examined the interventions from a healthcare perspective alone, a substantial part of the outcomes would have been ignored (HPSF: 49% of financial benefits, PAS: 59% of financial benefits). Jones et al. (2011) examined the SROI of the Food for Life programme, and also considered both health-related and non-health outcomes for local suppliers, school catering services, schools, parents, and local authorities (23). Financial proxies were defined by stakeholders, such as using the costs of a trip to the farm for valuing the knowledge of children about the origin of foods, which resulted in a SROI ratio of 4.4. Defining monetary values for non-financial outcomes is challenging as methods for obtaining proxies are not standardized. In the current study, we used standard cost prices only and refrained from defining financial proxies ourselves. This could have resulted in a conservative estimate of the SROI of HPSF and PAS. Due to the non-response on the parental questionnaire and the dynamic cohort design, our study suffered from missing data on covariates and longitudinal outcomes, which required multiple imputation.

Decisions on school-based lifestyle interventions should not be based on only the intervention's short-term return on investment. Follow-up assessments, as well as modeling to extrapolate short-term results beyond the trial period, are required to examine the full merits of school-based lifestyle interventions. Long-term information is, however, not always available for decision-making, because follow-up assessments are dependent on previous intervention implementation. To ensure successful intervention implementation and continuation it is crucial to have support from all stakeholders. The SROI framework allowed for comprehensively assessing the distribution of investments and outcomes over stakeholder groups. The results of the current study showed that the short-term benefits did not outweigh the investments of the HPSF initiative, but outcomes were generated for multiple sectors. The majority of investments were incurred by the education sector, while outcomes were received by the healthcare, household & leisure, and education sector. This information can be used as input for continuation decisions and investment strategies on the HPSF initiative by, for example, exploring alternative modes of intervention delivery (e.g., changing the organization of activities so that fewer pedagogical employees are needed), and examining whether a redistribution of investments over, amongst others, schools, parents, and the government is desired. The SROI framework can therefore serve as a tool in obtaining stakeholder support, foster intervention implementation and continuation, and facilitate follow-up research and decision-making on school-based lifestyle interventions. In accordance to others, we recommend that further research should focus on the valuation of outcomes in different sectors (18, 22, 24), and on the methods for valuing outcomes across different sectors (18) to further develop the methodology and enhance the implementation of the SROI methodology (17, 25). Future research is also needed to examine if SROI evaluations adequately meet the information needs of different stakeholders and optimally support the various decision-making processes on school-based lifestyle interventions.

Data Availability Statement

The data that support the findings of this study were collected as part of the ‘Healthy Primary School of the Future’ quasi-experimental study. Data collection took place until 2019 to study the effects after 4 years of exposure. Data will become available from the authors upon reasonable request, following article publication on the 4-year effects and potential other comparative studies in the Netherlands.

Ethics Statement

The need for ethical approval has been waived by the Medical Ethics Committee Zuyderland in Heerlen (MEC 14-N-142). All participants were required to complete an informed consent form in accordance with the Declaration of Helsinki, signed by both parents/caregivers, and by the children in case they are 12 years or older. The study protocol has been registered in the database ClinicalTrials.gov (NCT02800616).

Author Contributions

MO and MJ designed the current study. MO, NB, and MW contributed to the data acquisition. MO and BW performed the statistical analyses. MO wrote the manuscript with input from all authors. All authors read and approved the final manuscript.

Funding

This study was funded by the Limburg provincial authorities, Project Number 200130003, by Friesland Campina, Project Number LLMV00, and by Maastricht University. None of the funding bodies had a role in the design of the study or the writing of this manuscript. Nor will the funding bodies have a role in the future data collection, analysis, interpretation of data, and the writing of publications.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

We were grateful to all schools, the children, and other collaborating partners participating in the project.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpubh.2020.00401/full#supplementary-material

Abbreviations

BMI, body mass index; HPSF, Healthy Primary Schools of the Future; HRQOL, health-related quality of life; PAS, Physical Activity Schools; PedsQl, Pediatric Quality of Life Inventory; QALY, quality-adjusted life year; SES, socioeconomic status; SROI, social return on investment; WTP, willingness to pay.

References

1. Lake A, Townshend T. Obesogenic environments: exploring the built and food environments. J R Soc Promot Health. (2006) 126:262–7. doi: 10.1177/1466424006070487

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Guthold R, Stevens GA, Riley LM, Bull FC. Worldwide trends in insufficient physical activity from 2001 to 2016: a pooled analysis of 358 population-based surveys with 1.9 million participants. Lancet. (2018) 6:e1077–86. doi: 10.1016/S2214-109X(18)30357-7

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Schönbeck Y, Talma H, van Dommelen P, Bakker B, Buitendijk SE, Hirasing RA, et al. Increase in prevalence of overweight in Dutch children and adolescents: a comparison of nationwide growth studies in 1980, 1997 and 2009. PLoS ONE. (2011) 6:e27608. doi: 10.1371/journal.pone.0027608

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Willeboordse M, Jansen MW, van den Heijkant SN, Simons A, Winkens B, de Groot RH, et al. The Healthy Primary School of the Future: study protocol of a quasi-experimental study. BMC Public Health. (2016) 16:639. doi: 10.1186/s12889-016-3301-9

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Bartelink NHM, van Assema P, Kremers SPJ, Savelberg HH, Oosterhoff M, Willeboordse M, et al. One- and two-year effects of the Healthy Primary School of the Future on children's dietary and physical activity behaviours: a quasi-experimental study. Nutrients. (2019) 11:689. doi: 10.3390/nu11030689

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Bartelink N, Van Assema P, Kremers SPJ, Savelberg HH, Oosterhoff M, Willeboordse M, et al. Can the Healthy Primary School of the Future offer perspective in the on-going obesity epidemic in young children?—A quasi-experimental study. BMJ Open. (2019) 9:e030676. doi: 10.1136/bmjopen-2019-030676

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Masters R, Anwar E, Collins B, Cookson R, Capewell S. Return on investment of public health interventions: a systematic review. J Epidemiol Community Health. (2017) 71:827–34. doi: 10.1136/jech-2016-208141

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Finkelstein EA, Trogdon JG. Public health interventions for addressing childhood overweight: analysis of the business case. Am J Public Health. (2008) 98:411–5. doi: 10.2105/AJPH.2007.114991

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Laing CM, Moules NJ. Social return on investment: a new approach to understanding and advocating for value in healthcare. J Nurs Adm. (2017) 47:623–8. doi: 10.1097/NNA.0000000000000557

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Banke-Thomas AO, Madaj B, Charles A, van den Broek N. Social return on investment (SROI) methodology to account for value for money of public health interventions: a systematic review. BMC Public Health. (2015) 15:582. doi: 10.1186/s12889-015-1935-7

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Bartelink NHM, van Assema P, Jansen MWJ, Savelberg HH, Willeboordse M, Kremers SPJ. The Healthy Primary School of the Future: a contextual action-oriented research approach. Int J Environ Res Public Health. (2018) 15:2243. doi: 10.3390/ijerph15102243

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Nicholls J, Lawlor E, Neitzert E, Goodspeed T. A Guide to Social Return on Investment. (2012). Available online at: http://www.socialvalueuk.org (accessed March 1, 2019).

13. Oosterhoff M, Bosma H, van Schayck OCP, Joore MA. A cost analysis of school-based lifestyle interventions. Prev Sci. (2018) 19:716–27. doi: 10.1007/s11121-018-0918-1

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Bartelink NHM, van Assema P, Jansen MWJ, Savelberg HH, Moore GF, Hawkins J, et al. Process evaluation of the Healthy Primary School of the Future: the key learning points. BMC Public Health. (2019) 19:698. doi: 10.1186/s12889-019-6947-2

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Zorginstituut Nederland. Kostenhandleiding: Methodologie van Kostenonderzoek en Referentieprijzen voor Economische Evaluaties in de Gezondheidszorg [Methodology of Cost Research and Cost Prices for Heal Economic Evaluations]. (2015). Available online at: https://www.zorginstituutnederland.nl/over-ons/werkwijzen-en-procedures/adviseren-over-en-verduidelijken-van-het-basispakket-aan-zorg/beoordeling-van-geneesmiddelen/richtlijnen-voor-economische-evaluatie (accessed November 14, 2019).

Google Scholar

16. Pomp M, Schoemaker CG, Polder JJ. Op weg naar Maatschappelijke Kosten-Batenanalyses voor Preventie en zorg [Social Cost-Benefit Analysis for Prevention and Care]. Ministerie van Volksgezondheid (2014). Available online at: https://www.rivm.nl/publicaties/op-weg-naar-maatschappelijke-kosten-batenanalyses-voor-preventie-en-zorg-themarapport (accessed March 1, 2019).

Google Scholar

17. Drost R, Paulus A, Ruwaard D, Evers S. Handleiding Intersectorale Kosten en baten van (Preventieve) Interventies [Guideline for Intersectoral Costs and Benefits of Preventive Interventions]. (2014). Available online at: https://hsr.mumc.maastrichtuniversity.nl/sites/intranet.mumc.maastrichtuniversity.nl/files/hsr_mumc_maastrichtuniversity_nl/Symposia/30_Oct_2014_VGE_NVTAG/um-hsr_handleiding_intersectorale_kosten_en_baten.pdf (accessed November 25, 2019).

18. Walker S, Griffin S, Asaria M, Tsuchiya A, Sculpher M. Striving for a societal perspective: a framework for economic evaluations when costs and effects fall on multiple sectors and decision makers. Appl Health Econ Health Policy. (2019) 17:577–90. doi: 10.1007/s40258-019-00481-8

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Oosterhoff M, Bosma H, van Schayck OCP, Joore MA. Correction to: cost analysis of school-based lifestyle interventions. Prev Sci. (2019) 20:970–4. doi: 10.1007/s11121-019-01030-4

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Oosterhoff M, Bosma H, van Schayck OCP, Evers S, Dirksen CD, Joore MA. A systematic review on economic evaluations of school-based lifestyle interventions targeting weight-related behaviours among 4–12 year olds: issues and ways forward. Prev Med. (2018) 114:115–22. doi: 10.1016/j.ypmed.2018.06.015

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Goebbels AF, Lakerveld J, Ament AJ, Bot SD, Severens JL. Exploring non-health outcomes of health promotion: the perspective of participants in a lifestyle behaviour change intervention. Health Policy. (2012) 106:177–86. doi: 10.1016/j.healthpol.2012.04.005

PubMed Abstract | CrossRef Full Text | Google Scholar

22. van Mastrigt GA, Paulus AT, Aarts MJ, Evers SM, Alayli-Goebbels AF. A qualitative study on the views of experts regarding the incorporation of non-health outcomes into the economic evaluations of public health interventions. BMC Public Health. (2015) 15:954. doi: 10.1186/s12889-015-2247-7

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Jones RA, Sinn N, Campbell KJ, Hesketh K, Denney-Wilson E, Morgan PJ, et al. The importance of long-term follow-up in child and adolescent obesity prevention interventions. Int J Pediatr Obes. (2011) 6:178–81. doi: 10.3109/17477166.2011.575155

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Sanders GD, Neumann PJ, Basu A, Brock DW, Feeny D, Krahn M, et al. Recommendations for conduct, methodological practices, and reporting of cost-effectiveness analyses: second panel on cost-effectiveness in health and medicine. JAMA. (2016) 316:1093–103. doi: 10.1001/jama.2016.12195

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Hutchinson CL, Berndt A, Gilbert-Hunt S, George S, Ratcliffe J. Valuing the impact of health and social care programmes using social return on investment analysis: how have academics advanced the methodology? A protocol for a systematic review of peer-reviewed literate. BMJ Open. (2018) 8:e022534. doi: 10.1136/bmjopen-2018-022534

CrossRef Full Text | Google Scholar