Kristen H. Walter
Nicholas P. Otis1,2,3
Michal Kalli Hose
Kathleen M. Ober
Lisa H. Glassman- 1Health and Behavioral Sciences, Naval Health Research Center, San Diego, CA, United States
- 2VA San Diego Healthcare System, San Diego, CA, United States
- 3Leidos, Inc., San Diego, CA, United States
Introduction: Recreational and adaptive sports programs may be beneficial therapeutic interventions for improving psychological outcomes among veterans and service members with posttraumatic stress disorder (PTSD) because they provide opportunities for exercise, socialization, respite, and time outdoors. Although there are an increasing number of sports programs for veterans and service members with PTSD, data evaluating the outcomes of such programs are limited.
Materials and methods: The sample included 74 U.S. veterans who participated in the National Veterans Summer Sports Clinic (NVSSC), an annual, week-long adaptive sports program in San Diego, California. Participants were categorized into two subgroups: those who met criteria for probable PTSD using the PTSD Checklist for DSM-5 (n = 20) and those who did not (n = 54). Participants completed self-report assessments before and after each daily activity, before and after the program, and 3 months following program completion.
Results: Over the course of NVSSC program participation, the diagnostic subgroups (probable PTSD vs. no PTSD) did not significantly differ on changes in depression, positive affect, negative affect, or insomnia. Compared to those without PTSD, veterans with PTSD experienced greater reduction in generalized anxiety during the program (MD = −3.07, p = 0.034). Veterans with PTSD also experienced significant improvements in PTSD symptoms at postprogram (MD = −23.76, p < 0.001). For both groups, significant benefits were shown during the program but rebounded by the 3-month follow-up. Over the course of each daily activity, positive affect (MD = 2.71, p < 0.001) and depression/anxiety scores significantly decreased (MD = −0.75, p < 0.001), with no differences between PTSD diagnostic groups across time (ps = 0.714 and 0.961, respectively).
Conclusion: Veterans with and without PTSD benefited from participation in the NVSSC. Participants with probable PTSD experienced greater improvements in generalized anxiety at postprogram only; there were no other significant differences between the two groups at postprogram or at 3-month follow-up. In line with prior research, benefits for those with PTSD were lost by 3-month follow-up, suggesting that regular engagement in recreational and adaptive sports may be necessary to sustain psychological health improvements.
Introduction
The availability of recreational and adaptive sports programs for veterans and military service members has increased dramatically over the last decade. Mounting evidence supports the positive impact on psychological symptoms, well-being, and other health-related outcomes (Davis-Berman et al., 2018; Greer and Vin-Raviv, 2019; Walker et al., 2020) as well as the psychological benefits of exercise among both community e.g., (see Mikkelsen et al., 2017 for a review) and psychiatric samples (e.g., Rethorst et al., 2013; Schuch et al., 2016). Recreational and adaptive programs center on participant engagement in physical activities (e.g., sports, swimming, fishing, canoeing) and create adaptations for varying physical and psychological abilities. These adaptations may include modifying equipment such as bicycles or skis, using wheelchairs, or allowing caregiver participation/support. Recreational and adaptive programs are particularly valuable because they encourage physical exercise, often in a natural environment and with social interaction, factors that have been linked to improvements in mental health, quality of life, and functioning (e.g., Greer and Vin-Raviv, 2019; Walter et al., 2019; Wheeler et al., 2020; Walter et al., 2021; Sidiropoulos et al., 2022).
The National Veterans Summer Sports Clinic (NVSSC) and Winter Sports Clinic (NVWSC) are examples of recreational and adaptive sports programs offered to veterans with physical (e.g., limb amputation) or psychological [e.g., posttraumatic stress disorder (PTSD)] injuries, and preliminary data suggest that both programs have positive impacts on the mental health of veterans who attend. A recent study examined NVSSC outcomes (N = 74; Walter et al., 2021) and found that immediately following the week-long program, veteran participants reported improvements in depression, anxiety, social functioning, and negative and positive affect. However, those gains were not maintained at 3-month follow-up (Walter et al., 2021). A separate study examining outcomes following two recreational and adaptive sports clinics for veterans (NVWSC and the National Veterans Wheelchair Games; N = 132) reported improvements in quality of life and self-esteem for attendees (Sporner et al., 2009). Increasing access to nature-based physical activities for veterans and service members with psychological and physical injuries represents an avenue for improving mental health, and such activities may also be less likely to trigger fears of stigma and treatment avoidance, which can be concerns for these populations (e.g., Forsyth et al., 2020).
Veterans and service members with PTSD may particularly benefit from engagement in adaptive and recreational programs. PTSD is one of the most common mental health conditions among veterans and service members (Fulton et al., 2015; Thomas et al., 2017) and significantly impacts the individual, their family, and greater community (e.g., Taft et al., 2011; Creech and Misca, 2017). Although the U.S. Department of Veterans Affairs (VA) has provided infrastructure and extensive resources devoted to evidence-based PTSD treatments, there are veterans who do not respond to these treatments or who are reticent to seek traditional psychological interventions (e.g., Stecker et al., 2013; Hoge et al., 2014; Steenkamp et al., 2015), highlighting the need for additional treatment options. Although research is limited, two recent literature reviews (Davis-Berman et al., 2018; Greer and Vin-Raviv, 2019) found that outdoor interventions may have positive psychological and psychosocial benefits and improve quality of life among veterans with PTSD. However, both reviews stressed that these findings should be interpreted with caution, citing the weak methodological quality of existing studies.
Recent studies have continued to support the short-term positive effects of these programs on psychological and psychosocial functioning among veterans and service members with PTSD, but they suffer from similar methodological limitations (e.g., Townsend et al., 2018; Walter et al., 2019; Wheeler et al., 2020; Hooker et al., 2022). First, few studies used control groups, which limits understanding program impact compared with how participants might have fared without intervention. Additionally, most studies used small sample sizes, and across studies, significant variability exists in program length or type of recreational activities offered, thereby limiting generalizability. Lastly, few studies included a follow-up to determine whether benefits persisted over time. Although there is a larger body of research supporting the immediate benefits of outdoor physical activities among broader populations (e.g., Thompson Coon et al., 2011; Walter et al., 2019, 2021), the long-term impact of these programs remains unclear. Most studies have not examined outcomes beyond a few weeks after program conclusion, but more recent studies have extended follow-up assessments to 3–9 months (e.g., Townsend et al., 2018; Walter et al., 2019; Hooker et al., 2022). Though scant, longitudinal data suggest that many psychological health outcomes are not sustained over time (e.g., Townsend et al., 2018; Walter et al., 2019; Hooker et al., 2022). As such, it is critical that research improve upon the methodological limitations of the existing research to understand the outcomes of these programs and the duration of effects for veterans and service members with PTSD.
The current study sought to extend the findings of Walter et al. (2021) by examining PTSD outcomes following the annual NVSSC program, and by comparing other psychological outcomes between veteran participants with and without probable PTSD. The goal of this naturalistic study was to evaluate NVSSC program outcomes among veterans with probable PTSD, without changing the intended NVSSC population or program structure. The parent study (Walter et al., 2021) found that overall, participating veterans experienced significant pre- to postprogram changes in depression, generalized anxiety, social functioning, and positive and negative affect. This study also builds on the methodological limitations of the existing literature by incorporating a comparison group (i.e., probable PTSD vs. no PTSD), using well-validated measures commonly used with the military population, and examining immediate, short-term, and longer-term outcomes. Exploring outcomes among veterans and service members with PTSD is an important research endeavor, given that recreational and adaptive sports programs are often provided to these specific populations; however, data evaluating such program outcomes are limited. Furthermore, results can inform the delivery of recreational and adaptive sports programs by identifying who benefits most from these interventions, what outcomes can be expected, and how these interventions may work in tandem with traditional treatment approaches.
Materials and methods
Program
The NVSSC is an annual, week-long adaptive sports program for veterans with physical and psychological injuries that is provided by the VA. Veterans from across the United States travel to San Diego, California, to participate in a different recreational activity each day over 5 days, including cycling, surfing, sailing, kayaking, and archery/pickleball. Recreational activity instruction is provided by trained instructors and volunteers, and equipment and adaptations are made based on physical and/or psychological need. Veterans are assigned to teams of approximately 10 participants for the duration of the week. Data analyzed for this naturalistic study were collected from participants in the 2017 and 2018 NVSSC programs.
Participants
To be eligible for the NVSSC, U.S. veterans were required to have a psychological (e.g., PTSD, depression) or physical (e.g., amputation, traumatic brain injury) diagnosis as a reason for program referral. There were several conditions for which veterans were not granted medical clearance such as significant cardiovascular risk. Otherwise, there were no additional exclusion criteria for the parent study, and data from all 74 participants were analyzed in both studies (see Walter et al., 2021). In the current analysis, participants were categorized into two groups a posteriori based on DSM-5 diagnostic criteria and data from the preprogram Life Events Checklist (LEC; Weathers et al., 2013a) and PTSD Checklist for DSM-5 (PCL-5; Weathers et al., 2013b): probable PTSD (n = 20) and no PTSD (n = 54). Importantly, 100% of the probable PTSD and 57% of the non-PTSD subgroups reported concurrent mental health treatment (e.g., medication, psychotherapy).
Procedure
Participants were recruited at the host hotel during the NVSSC orientation meeting and clinic exposition. Veterans interested in study participation provided informed consent and completed a preprogram assessment; those who did not consent took part in the program as offered. Veterans then participated in a different recreational activity each day over 5 days as part of the larger team to which they were assigned. Brief self-report assessments were completed before and after each daily recreation activity. A postprogram assessment was completed on the final day of the program. Lastly, participants completed a follow-up assessment via phone 3 months after the NVSSC. The 3-month assessment was selected as a sufficient timeframe to determine whether gains were maintained after participants returned to their normal lives without risking significant participant attrition. All study procedures were approved by the VA San Diego Healthcare System Institutional Review Board.
Measures
Posttraumatic stress disorder symptom severity in the past month was evaluated with the LEC (Weathers et al., 2013a) and PCL-5 (Weathers et al., 2013b). The PCL-5 contains 20 questions rated on a 0–4 scale, with total scores ranging from 0 to 80 (higher scores indicate greater PTSD severity). In this study, internal consistency was α = 0.87–0.97 across time points. Probable PTSD diagnosis was determined by matching Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5; American Psychiatric Association, 2013) criteria with responses on the LEC (criterion A) and PCL-5. Specifically, probable PTSD criteria were met if participants reported a Criterion A traumatic event on the LEC-5 and indicated a rating of 2 or higher (i.e., “moderately” to “extremely” bothersome) on at least one cluster B symptom, one cluster C symptom, two cluster D symptoms, and two cluster E symptoms on the PCL-5.
Depression symptom severity during the past 2 weeks was measured with the 8-item Patient Health Questionnaire (PHQ-8; Kroenke et al., 2009b). The 8-item version of the PHQ (i.e., version without the suicide item) was selected due to our inability to adequately manage suicide risk in this naturalistic setting. PHQ-8 items are summed to a total severity score (range 0–24; higher scores reflect greater severity). Across assessment points, internal consistency for the PHQ-8 was α = 0.86–0.89. Depression/anxiety symptoms were also measured before and after each activity with the 4-item Patient Health Questionnaire (PHQ-4; Kroenke et al., 2009a). Like the PHQ-8, PHQ-4 items are summed to a total score (scale range 0–12; α = 0.72–0.84 across activity).
Generalized anxiety symptoms were evaluated with the Generalized Anxiety Disorder-7 (GAD-7; Spitzer et al., 2006). The frequency of each symptom in the past 2 weeks was rated on a 4-point scale, which is summed to create an overall score ranging from 0 to 21 (higher scores indicate greater generalized anxiety severity). Internal consistency was α = 0.91 at all-time points.
Insomnia was examined with the Insomnia Severity Index (ISI; Morin and Barlow, 1993). The ISI is a 7-item, self-report measure that can be summed to a total severity score (range 0–28; higher scores indicate greater insomnia severity). Across time points, internal consistency for the ISI was α = 0.90–0.93.
Affect was assessed with the Positive and Negative Affect Schedule (PANAS; Watson et al., 1988). The PANAS is a 20-item, self-report measure consisting of 10 positive and 10 negative emotions experienced over the past several hours. The Positive Affect Schedule (PAS) and Negative Affect Schedule (NAS) are each summed to create subscales, with higher scores (10–50) indicating greater intensity of affect. Cronbach’s alphas were α = 0.89–0.92 and α = 0.86–0.91 for the PAS and NAS subscales, respectively, across longitudinal time points. To reduce participant burden, only the PAS was completed before and after each activity (α = 0.94–0.97).
At preprogram, participants completed a demographic questionnaire containing age, gender identity, race/ethnicity, and military service information. Preprogram physical activity was measured with the 9-item International Physical Activity Questionnaire–Self-Report Short Form (IPAQ-SF; Craig et al., 2003). IPAQ-SF items assess the frequency and duration of moderate and vigorous physical activity, walking, and sitting that participants have engaged in over the last 7 days. A categorization of highly physically active equates to at least 60 min of moderate intensity activity per day; moderate equates to at least 30 min of moderate intensity activity on most days; and low equates to less than moderate (For a more detailed scoring, see IPAQ Research Committee, 2005). At preprogram and 3-month follow-up, veterans self-reported concurrent treatments and interventions using a treatment utilization questionnaire developed for the study.
Data analysis
All data were checked for plausibility and analyzed as intent-to-treat. Mann–Whitney U-tests, independent t-tests, and Chi-square tests were run to determine whether any preprogram differences existed between diagnostic groups (i.e., probable PTSD vs. no PTSD). Activity order and type were not examined in the current analyses because the parent study found no significant differences by these factors (Walter et al., 2021).
Multilevel models (MLMs) in SPSS 25 (IBM, Armonk, NY, United States) were used to examine changes in psychological outcomes based on PTSD diagnostic status. Longitudinal (i.e., preprogram, postprogram, 3-month follow-up) models were run for the PCL-5, PHQ-8, GAD-7, ISI, PAS, and NAS. Daily activity (i.e., pre- and postsession) models were run for the PHQ-4 and PAS. Models were built using a step-up, model-building process with respect to model fit and theory. Covariance matrices were chosen based on Akaike information criterion and the number of parameters specified. All final models relied on restricted maximum likelihood to account for missing data, which uses all available data to estimate missing values. Missing data were determined as missing at random in the parent study (Walter et al., 2021).
In longitudinal models, time was used categorically because there were qualitative differences between time points (i.e., an intervention was delivered between pre- and postprogram but not in the follow-up period; timeframe); thus, a random time slope could not be estimated as residuals cannot be calculated based on only one data point per time point. Although random time slopes could not be set, we used a random effect of intercept and a repeated effect of time [as a function of participant with an unstructured covariance matrix]. Fixed effects included time, concurrent psychiatric medication, and PTSD diagnostic status.
In daily activity models, time represented pre- to postsession for each activity. A random effect of time was calculated given that the qualitative difference across all time points was equivalent; time was crossed with day (continuous) and there were multiple observations per time point (i.e., pre and postsession). Based on this, random effects used a first-order autoregressive covariance structure and included intercept, pre- to postsession, day, and the crossed effect of pre- to postsession by day—all as a function of participant. Repeated effects used time as a function of participant by day with an unstructured covariance matrix. Fixed effects in activity session models included time, concurrent psychiatric medication, and PTSD diagnostic status. For fixed effects in both longitudinal and activity models, preprogram physical activity level was removed before final models due to lack of significance, and concurrent psychotherapy was not included due to high correlation with concurrent pharmacotherapy.
Results
A total of 74 NVSSC participants were included in the analysis; 20 were classified as having a probable PTSD diagnosis at preprogram and 54 were not. Those in the probable PTSD group reported more severe preprogram depression (p < 0.001), generalized anxiety (p < 0.001), and negative affect (p = 0.026) scores, and they were more likely to report use of concurrent treatment (p < 0.001); there were no other significant demographic differences. For additional descriptive information, see Table 1. MLM estimated marginal means for outcomes by PTSD status can be found in Table 2, and unadjusted model results can be found in Appendix Table S1.
Table 1. Preprogram sample characteristics.
Table 2. Estimated marginal means at all time points by probable PTSD status.
Psychological symptoms
For those with probable PTSD at preprogram, PCL-5 scores significantly decreased from pre- to postprogram (MD = −23.76, p < 0.001) but then rebounded to preprogram scores at 3-month follow-up (postprogram to 3-month, MD = 22.18, p = 0.005). Specifically, PTSD severity scores were 43.15 at preprogram, 19.39 at postprogram, and 41.57 at 3-month follow-up when controlling for concurrent psychiatric medication. Change in PTSD symptom severity was statistically significant and reliable; however, it did not exceed the suggested cutoff for clinical significance on the PCL-5 (28 points; Marx et al., 2022). PTSD scores were not compared between diagnostic groups because only one group met probable PTSD criteria based on a Criterion A traumatic event. For complete longitudinal program results, see Table 3.
Table 3. Mean differences from estimated marginal means of final multilevel models examining psychological outcomes.
Across participants, PHQ-8 scores significantly decreased from pre- to postprogram (MD = −4.23, p < 0.001) then returned to preprogram scores during the 3-month follow-up period (MD = 5.56, p < 0.001) after controlling for concurrent treatment and PTSD diagnostic status. Change in depression severity was statistically significant but did not reach the level of clinical significance on the PHQ-8 (e.g., 5 points; Schneider et al., 2020). Specifically, depression severity scores decreased from 7.94 to 3.70 points then returned to 9.26 points. The interaction addressing the main study aim was not significant (Time × PTSD Diagnosis, p = 0.792), suggesting that probable PTSD diagnosis did not effect change in depression severity over time.
GAD-7 scores significantly improved from pre- to postprogram (MD = −4.61, p < 0.001) and reverted to preprogram scores at 3-month follow-up (MD = 5.26, p < 0.001) when accounting for other factors. Generalized anxiety scores decreased from 7.29 to 2.69 points then increased to 7.95 points in the follow-up period. Although the overall Time × PTSD Diagnosis interaction was not significant (i.e., spanning preprogram to 3-month follow-up; p = 0.093), inspection of simple effects showed a statistically significant difference between groups from pre- to postprogram (MD = −3.07, p = 0.034). Specifically, those with probable PTSD decreased 3.07 points more than those without at postprogram. Generalized anxiety was the single outcome demonstrating a significant between-group difference over time. This difference was statistically significant but not at the level of clinical significance on the GAD-7 (4 points; Toussaint et al., 2020).
PHQ-4 scores were used to assess depression and anxiety before and after each daily activity. These scores significantly improved (MD = −0.75, p < 0.001) over the course of the day. However, there were no differences between PTSD diagnostic groups across time (p = 0.961; see Table 4).
Table 4. Mean differences from estimated marginal means of final multilevel models examining activity session outcomes.
Self-reported insomnia symptoms significantly improved during the program, as indicated by changes in ISI scores from pre- to postprogram (MD = −3.08, p < 0.001). During the follow-up period, scores returned to preprogram levels (MD = 2.05, p = 0.066; preprogram to 3-month p = 0.327). Changes in insomnia symptoms over time did not vary by probable PTSD diagnostic status (p = 0.721).
Affect
Overall, positive affect significantly improved from pre- to postprogram (MD = 7.88, p < 0.001), but not during the follow-up period (MD = −9.62, p < 0.001). PAS scores increased from 34.81 to 42.69 points during the program before returning to 33.07 at 3-month follow-up. There was no significant difference over time by probable PTSD diagnostic status (p = 0.281). Daily activity scores followed a similar pattern, where PAS scores improved from pre- to postsession (MD = 2.71, p < 0.001) but did not differ over time by PTSD status (p = 0.714).
Negative affect significantly decreased among participants from pre- to postprogram (MD = −2.62, p = 0.003), and like other outcomes, scores returned to preprogram scores by the 3-month follow-up (MD = 2.21, p = 0.014). On average, NAS scores decreased from 16.12 to 13.50 points before increasing to 15.72 points at 3-month follow-up. Change in NAS scores over time was not influenced by probable PTSD diagnostic status (p = 0.456).
Discussion
Given that PTSD is one of the most common psychological diagnoses among veterans and service members (e.g., Fulton et al., 2015; Thomas et al., 2017) and that recreational and adaptive sports programs are often available for these populations, it is critical to explore how these programs impact psychological health among veterans with PTSD. The current study compared psychological outcomes following NVSSC program participation among veterans with and without probable PTSD. Overall, veterans with probable PTSD reported similar psychological benefits to the NVSSC program compared to those without PTSD when added to their current treatment plan. Results from this study demonstrated that U.S. veterans with and without probable PTSD reported significant improvements in depression, generalized anxiety, insomnia, positive affect, and negative affect immediately following participation in the week-long NVSSC program, as well as improvements in depression/anxiety and positive affect immediately following a session activity. Veterans with probable PTSD also reported significant reductions in PTSD symptom severity over the course of the program, which were reliable and statistically significant. However, the change in PTSD symptom severity approached, but did not exceed, suggested thresholds for clinical significance (Marx et al., 2022). In general, the only significant difference in longitudinal outcomes between veterans with and without PTSD was for generalized anxiety (observed from pre- to postprogram), although this finding was not clinically meaningful (Toussaint et al., 2020). This finding may be explained by the fact that on average, veterans with PTSD had higher generalized anxiety severity scores compared to those without PTSD. Thus, veterans with probable PTSD had greater room for improvement.
Study findings reflect the current literature, which suggests that recreational and adaptive sports programs have positive short-term psychological outcomes among military populations with PTSD (e.g., Davis-Berman et al., 2018; Forsyth et al., 2020). Consistent with these findings, Walter et al. (2019) showed that outcomes for service members with and without probable PTSD were comparable directly following 6 weeks of surf therapy (i.e., at postprogram). These findings were later extended to demonstrate similar outcomes between surf therapy participants with both major depressive disorder and PTSD (Otis et al., 2020) and among hike therapy participants (Otis et al., in press). Overall, the benefits of recreational and adaptive sports programs seem to be broadly beneficial for military populations with and without PTSD.
Study results also replicate several studies demonstrating that positive outcomes for physically based interventions may not be sustained in the weeks and months following participation (e.g., Townsend et al., 2018; Walter et al., 2021; Hooker et al., 2022). Across all psychological outcomes and both diagnostic groups, scores rebounded to preprogram levels at 3-month follow-up, suggesting that gains were not maintained. Walter et al. (2023) used similar assessment methodology to this study to evaluate the duration of psychological effects following a randomized trial of surf and hike therapy. The Surf and Hike Therapy programs were conducted locally on a weekly basis for 6 consecutive weeks whereas the NVSSC was a week-long program in San Diego that typically required participants to travel. Unlike findings from the current study that showed a rebound in symptoms at the 3-month follow-up, results at 3 months following Surf and Hike Therapy demonstrated continued gains in depression outcomes for active duty service member participants (Walter et al., 2023). While these findings cannot be directly compared, together they may suggest that programs with longer duration, more regular sessions, occur locally, or provide opportunities for continued engagement following the program period may facilitate sustained psychological improvements (e.g., Babyak et al., 2000; Mota-Pereira et al., 2013). Additional research is needed to identify program factors (e.g., length of program, frequency of sessions, proximity of location) that are most beneficial and predictors of symptom regression so that researchers and clinicians can develop optimal recreational and adaptive sports programs that provide lasting psychological benefit.
Demonstrating positive mental health effects of NVSSC program participation for veterans with PTSD is important because military populations with this disorder can be both difficult to treat (e.g., Steenkamp et al., 2015; Resick et al., 2017) and reluctant to seek treatment due to factors such as stigma (e.g., Hoge et al., 2004; Pietrzak et al., 2009; Kulesza et al., 2015; Sharp et al., 2015), negative beliefs about care, and logistical issues (e.g., Stecker et al., 2013; Hoge et al., 2014). Adaptive and recreational treatments—in combination with traditional interventions or as a first step in engaging in therapeutic options—may serve an important role in the treatment “package” offered to those with PTSD. These programs may serve a unique function in this population because they are available to veterans and service members with a variety of physical and psychological diagnoses, may not trigger the same level of stigma as traditional therapies, and promote socialization and other positive mental health outcomes (e.g., Davis-Berman et al., 2018; Greer and Vin-Raviv, 2019; Forsyth et al., 2020). Further, our findings add to a growing body of literature indicating there appears to be both global and disorder-specific effects for recreational and adaptive sports interventions (Walter et al., 2019; Otis et al., 2020, in press). Allowing these programs to be inclusivity oriented may ensure that populations at greatest need for these interventions are able to receive them.
This work has several important limitations and findings should be interpreted accordingly. The study used naturalistic design with groups created a posteriori to address the study aim—determining whether NVSSC program outcomes differed between veterans with and without probable PTSD—and was not conducted as an experimental design or randomized controlled trial. As such, it is impossible to know whether our longitudinal findings are directly the result of NVSSC, other interventions or confounds, or a combination of factors. Similarly, concurrent outpatient mental health treatment was not included in analyses due to lack of variability (95% of the probable PTSD group); instead, we used concurrent psychiatric medication in the models, which showed greater variability (70% of the probable PTSD group). Given the overlap between preprogram concurrent psychiatric medication use and PTSD diagnostic status, we cannot separate the effects of each and acknowledge the question of whether such programs serve as a standalone or adjunctive intervention approach. This study did not measure participants’ levels of physical activity during the follow-up period, so we were unable to determine whether those who continued to engage in physical activity were more likely to retain the psychological benefits following the NVSSC. Physical activity data collected via the IPAQ-SF were only collected at preprogram as the measure was initially developed as a survey tool rather than as an instrument to evaluate change (e.g., Craig et al., 2003). Although outcome data exhibited a quadratic pattern, time was unable to be examined quadratically due to uneven spacing between assessment points. The subsample of veterans with probable PTSD was small (n = 20) and may impact generalizability and representativeness of the sample. Probable PTSD diagnosis was also determined by applying diagnostic scoring criteria to a self-report measure (i.e., PCL-5). Ideally, a clinician-administered interview would be used to establish a PTSD diagnosis. However, the PCL-5 is a well-validated assessment for this purpose and widely used in military populations (Bovin et al., 2016; Forkus et al., 2022). The remainder of outcomes were assessed with self-report measures, which may be subject to bias. Finally, postprogram assessments were captured on the last day of the program, immediately following the end of the last session, which may have conflated program and activity effects.
There are also several study strengths that add to the current body of literature examining recreational and adaptive sports programs among veterans and service members with PTSD. Although many of these programs exist, there are limited data evaluating their effectiveness for veterans and service members with PTSD. The current study examined NVSSC program outcomes for veterans with probable PTSD in comparison to those without to determine whether there are disorder-specific or more global psychological effects. The naturalistic design improves external validity by evaluating the program as it exists in the “real world.” Assessments were administered at various time points, including pre- and postsession, as well as preprogram, postprogram, and 3-month follow-up, allowing for an examination of immediate, short-term, and longer-term program outcomes. Lastly, well-validated self-report assessments and statistical analyses intended for longitudinal data were used to maximize confidence in the data and associated findings.
This study compared NVSSC outcomes between veteran participants with and without probable PTSD. Study results support the psychological benefits of the NVSSC for veterans with and without probable PTSD and contribute to the research evaluating recreational and adaptive sports programs. Along with the parent study, our data show benefits over the course of the NVSSC for veterans with and without probable PTSD that were not maintained in the follow-up period, suggesting that ongoing engagement and programs that occur more frequently or that are local to veterans may help sustain gains (e.g., Walter et al., 2021). However, our findings also highlight areas for continued research to ensure that the benefits of these programs, which can improve psychological health and may reduce stigma, are sustained over time. Additional research is needed to determine what factors hinder or protect against relapse during the follow-up period, and then adapt programs to include prevention methods. This is not uncommon. Many evidence-based psychological interventions include “relapse prevention” strategies (e.g., Resick et al., 2016; Foa et al., 2019), and recreational interventions may benefit from the same strategy. Available evidence to date suggests that recreational and adaptive sports interventions may offer benefits to veterans with PTSD, but lingering questions remain regarding whether these interventions fit into the broader PTSD treatment guidelines (e.g., standalone vs. adjunctive therapy) as well as how to ensure benefits are sustained over time.
Data availability statement
The dataset presented in this article is not readily available because of security protocols and privacy regulations, but they may be made available on reasonable request by the VA San Diego Healthcare System or by contacting the corresponding author to facilitate the request. Requests to access the datasets should be directed to KW, kristen.h.walter.civ@health.mil.
Ethics statement
The studies involving human participants were reviewed and approved by the VA San Diego Healthcare System Institutional Review Board, protocol number H170050. The patients/participants provided their written informed consent to participate in this study.
Author contributions
KW: secured funding, conceptualization, methodology, investigation, resources, writing—original draft, supervision, and project administration. NO: conceptualization, methodology, formal analysis, writing—original draft, data curation, resources, and project management. MH and KO: investigation, supervision, resources, recruitment, and project administration. LG: investigation, data curation, manuscript conceptualization, writing—original draft, supervision. All authors reviewed, edited, and approved the final manuscript.
Funding
This work was supported in part by the U.S. Navy Bureau of Medicine and Surgery (BUMED) under work unit no. N1600. BUMED had no role in the study design, collection, analysis, or interpretation of the data, writing the manuscript, or the decision to submit the paper for publication.
Acknowledgments
The authors would like to acknowledge Marissa Abegg, Isabel V. Altarejos, Danielle J. Beck, Bianca I. Colon, Jody DeLaPeña Murphy, Cora M. Dyslin, Casey B. Kohen, Brittney Mazzone, Jianna M. Sode, Karen Tannenbaum, and Ilanit T. Young for their significant efforts on this project. We are also appreciative of the editorial assistance of Michelle Stoia. The authors would also like to sincerely thank the staff, instructors, sponsors, venue coordinators, volunteers, and veterans who make the VA National Veterans Summer Sports Clinic possible.
Conflict of interest
NO and LG are employed by Leidos, Inc.
The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2023.1207633/full#supplementary-material
References
American Psychiatric Association . (2013). Diagnostic and statistical manual of mental disorders (5th). Washington, DC: APA.
Babyak, M., Blumenthal, J. A., Herman, S., Khatri, P., Doraiswamy, M., Moore, K., et al. (2000). Exercise treatment for major depression: maintenance of therapeutic benefit at 10 months. Psychosom. Med. 62, 633–638. doi: 10.1097/00006842-200009000-00006
Bovin, M. J., Marx, B. P., Weathers, F. W., Gallagher, M. W., Rodriguez, P., Schnurr, P. P., et al. (2016). Psychometric properties of the PTSD checklist for diagnostic and statistical manual of mental disorders–fifth edition (PCL-5) in veterans. Psychol. Assess. 28, 1379–1391. doi: 10.1037/pas0000254
Craig, C. L., Marshall, A. L., Sjöström, M., Bauman, A. E., Booth, M. L., Ainsworth, B. E., et al. (2003). International physical activity questionnaire: 12-country reliability and validity. Med. Sci. Sports Exerc. 35, 1381–1395. doi: 10.1249/01.MSS.0000078924.61453.FB
Creech, S. K., and Misca, G. (2017). Parenting with PTSD: a review of research on the influence of PTSD on parent-child functioning in military and veteran families. Front. Psychol. 8:1101. doi: 10.3389/fpsyg.2017.01101
Davis-Berman, J., Berman, D., and Berman, N. D. (2018). Outdoor programs as treatment for posttraumatic stress disorder in veterans: issues and evidence. Best Pract. Mental Health 14, 9–20.
Foa, E. B., Hembree, E. A., Rothbaum, B. O., and Rauch, S. A. M. (2019). Prolonged Exposure Therapy for Processing of Traumatic Experiences: Therapist Guide (2nd). Oxford: Oxford University Press.
Forkus, S. R., Raudales, A. M., Rafiuddin, H. S., Weiss, N. H., Messman, B. A., and Contractor, A. A. (2022). The posttraumatic stress disorder (PTSD) checklist for DSM–5: a systematic review of existing psychometric evidence. Clin. Psychol. Sci. Pract. 30, 110–121. doi: 10.1037/cps0000111
Forsyth, A., Lysaght, R., Aiken, A., and Cramm, H. (2020). Wilderness adventure program may help combat perceptions of stigma among veterans. Ecopsychology 12, 8–18. doi: 10.1089/eco.2019.0031
Fulton, J. J., Calhoun, P. S., Wagner, H. R., Schry, A. R., Hair, L. P., Feeling, N., et al. (2015). The prevalence of posttraumatic stress disorder in operation enduring freedom/operation Iraqi freedom (OEF/OIF) veterans: a meta-analysis. J. Anx. Disord. 31, 98–107. doi: 10.1016/j.janxdis.2015.02.003
Greer, M., and Vin-Raviv, N. (2019). Outdoor-based therapeutic recreation programs among military veterans with posttraumatic stress disorder: assessing the evidence. Mil. Behav. Health 7, 286–303. doi: 10.1080/21635781.2018.1543063
Hoge, C. W., Castro, C. A., Messer, S. C., McGurk, D., Cotting, D. I., and Koffman, R. L. (2004). Combat duty in Iraq and Afghanistan, mental health problems, and barriers to care. New Engl. J. Med. 351, 13–22. doi: 10.1056/NEJMoa040603
Hoge, C. W., Grossman, S. H., Auchterlonie, J. L., Riviere, L. A., Milliken, C. S., and Wilk, J. E. (2014). PTSD treatment for soldiers after combat deployment: low utilization of mental health care and reasons for dropout. Psychiatr. Serv. 65, 997–1004. doi: 10.1176/appi.ps.201300307
Hooker, T., McCool, S., Fischer, S., Tysor, D., and Lackey, N. Q. (2022). Exploring changes in depression and meaning in life through river rafting for veterans with PTSD. J. Outdoor Recreat. Educ. Leadership 14, 16–33. doi: 10.18666/JOREL-2022-V14-I2-11110
IPAQ Research Committee . (2005). Guidelines for data processing and analysis of the international physical activity questionnaire (IPAQ) - short and long forms. Available at: https://bit.ly/36Kib50
Kroenke, K., Spitzer, R. L., Williams, J. B., and Löwe, B. (2009a). An ultra-brief screening scale for anxiety and depression: the PHQ-4. Psychosomatics 50, 613–621. doi: 10.1016/S0033-3182(09)70864-3
Kroenke, K., Strine, T. W., Spitzer, R. L., Williams, J. B., Berry, J. T., and Mokdad, A. H. (2009b). The PHQ-8 as a measure of current depression in the general population. J. Affect. Disord. 114, 163–173. doi: 10.1016/j.jad.2008.06.026
Kulesza, M., Pedersen, E. R., Corrigan, P. W., and Marshall, G. N. (2015). Help-seeking stigma and mental health treatment seeking among young adult veterans. Mil. Behav. Health 3, 230–239. doi: 10.1080/21635781.2015.1055866
Marx, B. P., Lee, D. J., Norman, S. B., Bovin, M. J., Sloan, D. M., Weathers, F. W., et al. (2022). Reliable and clinically significant change in the clinician-administered PTSD scale for DSM-5 and PTSD checklist for DSM-5 among male veterans. Psychol. Assess. 34, 197–203. doi: 10.1037/pas0001098
Mikkelsen, K., Stojanovska, L., Polenakovic, M., Bosevski, M., and Apostolopoulos, V. (2017). Exercise and mental health. Maturitas 106, 48–56. doi: 10.1016/j.maturitas.2017.09.003
Morin, C. M., and Barlow, D. H. (1993). Insomnia: Psychological Assessment and Management. New York, NY: Guilford Press.
Mota-Pereira, J., Silvério, J. M. A., Fonte, D., Carvalho, S., Ramos, J., and Ribeiro, J. C. (2013). “Moderate exercise as an adjuvant therapy for treatment-resistant major depressive disorder: 6-month follow-up” in Aerobic Exercise. eds. J. A. Simmons and A. C. Brown (Hauppauge, NY: Nova Science Publishers, Inc.), 85–111.
Otis, N. P., Walter, K. H., Glassman, L. H., Ray, T. N., Kobayashi Elliott, K. T., and Michalewicz-Kragh, B. (in press). Comorbidity of Depression and PTSD: Outcomes From a Randomized Controlled Trial of Surf and Hike Therapies Among Service Members.
Otis, N. P., Walter, K. H., Glassman, L. H., Ray, T. N., Michalewicz-Kragh, B., and Thomsen, C. J. (2020). Effects of PTSD and MDD comorbidity on psychological changes during surf therapy sessions for active duty service members. Glob. J. Community Psychol. Pract. 11, 1–23.
Pietrzak, R. H., Johnson, D. C., Goldstein, M. B., Malley, J. C., and Southwick, S. M. (2009). Perceived stigma and barriers to mental health care utilization among OEF-OIF veterans. Psychiatr. Serv. 60, 1118–1122. doi: 10.1176/ps.2009.60.8.1118
Resick, P. A., Monson, C. M., and Chard, K. M. (2016). Cognitive Processing Therapy for PTSD: A Comprehensive Manual. New York, NY: Guilford Publications.
Resick, P. A., Wachen, J. S., Dondanville, K. A., Pruiksma, K. E., Yarvis, J. S., Peterson, A. L., et al. (2017). Effect of group vs individual cognitive processing therapy in active-duty military seeking treatment for posttraumatic stress disorder: a randomized clinical trial. JAMA Psychiat. 74, 28–36. doi: 10.1001/jamapsychiatry.2016.2729
Rethorst, C. D., Sunderajan, P., Greer, T. L., Grannemann, B. D., Nakonezny, P. A., Carmody, T. J., et al. (2013). Does exercise improve self-reported sleep quality in non-remitted major depressive disorder? Psychol. Med. 43, 699–709. doi: 10.1017/S0033291712001675
Schneider, R. A., Chen, S. Y., Lungu, A., and Grasso, J. R. (2020). Treating suicidal ideation in the context of depression. BMC Psychiatry 20, 497–495. doi: 10.1186/s12888-020-02894-5
Schuch, F. B., Vancampfort, D., Richards, J., Rosenbaum, S., Ward, P. B., and Stubbs, B. (2016). Exercise as a treatment for depression: a meta-analysis adjusting for publication bias. J. Psychiatr. Res. 77, 42–51. doi: 10.1016/j.jpsychires.2016.02.023
Sharp, M. L., Fear, N. T., Rona, R. J., Wessely, S., Greenberg, N., Jones, N., et al. (2015). Stigma as a barrier to seeking health care among military personnel with mental health problems. Epidemiol. Rev. 37, 144–162. doi: 10.1093/epirev/mxu012
Sidiropoulos, A. N., Glasberg, J. J., Moore, T. E., Nelson, L. M., and Maikos, J. T. (2022). Acute influence of an adaptive sporting event on quality of life in veterans with disabilities. PLoS One 17:e0277909. doi: 10.1371/journal.pone.0277909
Spitzer, R. L., Kroenke, K., Williams, J. B., and Löwe, B. (2006). A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch. Intern. Med. 166, 1092–1097. doi: 10.1001/archinte.166.10.1092
Sporner, M. L., Fitzgerald, S. G., Dicianno, B. E., Collins, D., Teodorski, E., Pasquina, P. F., et al. (2009). Psychosocial impact of participation in the National Veterans Wheelchair Games and winter sports clinic. Disabil. Rehabil. 31, 410–418. doi: 10.1080/09638280802030923
Stecker, T., Shiner, B., Watts, B. V., Jones, M., and Conner, K. R. (2013). Treatment-seeking barriers for veterans of the Iraq and Afghanistan conflicts who screen positive for PTSD. Psychiatr. Serv. 64, 280–283. doi: 10.1176/appi.ps.001372012
Steenkamp, M. M., Litz, B. T., Hoge, C. W., and Marmar, C. R. (2015). Psychotherapy for military-related PTSD: a review of randomized clinical trials. JAMA 314, 489–500. doi: 10.1001/jama.2015.8370
Taft, C. T., Watkins, L. E., Stafford, J., Street, A. E., and Monson, C. M. (2011). Posttraumatic stress disorder and intimate relationship problems: a meta-analysis. J. Consult. Clin. Psychol. 79, 22–33. doi: 10.1037/a0022196
Thomas, M. M., Harpaz-Rotem, I., Tsai, J., Southwick, S. M., and Pietrzak, R. H. (2017). Mental and physical health conditions in US combat veterans: results from the National Health and resilience in veterans study. Prim. Care Companion CNS Disord. 19:17m02118. doi: 10.4088/PCC.17m02118
Thompson Coon, J., Boddy, K., Stein, K., Whear, R., Barton, J., and Depledge, M. H. (2011). Does participating in physical activity in outdoor natural environments have a greater effect on physical and mental wellbeing than physical activity indoors? A systematic review. Environ. Sci. Technol. 45, 1761–1772. doi: 10.1021/es102947t
Toussaint, A., Hüsing, P., Gumz, A., Wingenfeld, K., Härter, M., Schramm, E., et al. (2020). Sensitivity to change and minimal clinically important difference of the 7-item generalized anxiety disorder questionnaire (GAD-7). J. Affect. Disord. 265, 395–401. doi: 10.1016/j.jad.2020.01.032
Townsend, J., Hawkins, B. L., Bennett, J. L., Hoffman, J., Martin, T., Sotherden, E., et al. (2018). Preliminary long-term health outcomes associated with recreation-based health and wellness programs for injured service members. Cogent Psychol. 5:1444330. doi: 10.1080/23311908.2018.1444330
Walker, R. A., Smith, P. M., Limbert, C., and Colclough, M. (2020). The psychosocial effects of physical activity on military veterans that are wounded, injured, and/or sick: a narrative synthesis systematic review of quantitative evidence. Mil. Behav. Health 8, 292–307. doi: 10.1080/21635781.2020.1746445
Walter, K. H., Otis, N. P., Del Re, A. C., Kohen, C. B., Glassman, L. H., Ober, K. M., et al. (2021). The National Veterans Summer Sports Clinic: change and duration of psychological outcomes. Psychol. Sport Exerc. 55:101939. doi: 10.1016/j.psychsport.2021.101939
Walter, K. H., Otis, N. P., Ray, T. N., Glassman, L. H., Beltran, J. L., Kobayashi Elliott, K. T., et al. (2023). A randomized controlled trial of surf and hike therapy for U.S. active duty service members with major depressive disorder. BMC Psych. 23:109. doi: 10.1186/s12888-022-04452-7
Walter, K. H., Otis, N. P., Ray, T. N., Powell, A. L., Glassman, L. H., Michalewicz-Kragh, B., et al. (2019). Breaking the surface: psychological outcomes among U.S. active duty service members following a surf therapy program. Psychol. Sport Exerc. 45:101551. doi: 10.1016/j.psychsport.2019.101551
Watson, D., Clark, L. A., and Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: the PANAS scales. J. Pers. Soc. Psychol. 54, 1063–1070. doi: 10.1037/0022-3514.54.6.1063
Weathers, F. W., Blake, D., Schnurr, P., Kaloupek, D., Marx, B., and Keane, T. (2013a). The life events checklist for DSM-5 (LEC-5). Available at: https://www.ptsd.va.gov/professional/assessment/te-measures/life_events_checklist.asp
Weathers, F. W., Litz, B. T., Keane, T. M., Palmieri, P., Marx, B., and Schnurr, P. (2013b). The PTSD checklist for DSM-5 (PCL-5). Available at: https://www.ptsd.va.gov/professional/assessment/adult-sr/ptsd-checklist
Wheeler, M., Cooper, N. R., Andrews, L., Hacker Hughes, J., Juanchich, M., Rakow, T., et al. (2020). Outdoor recreational activity experiences improve psychological wellbeing of military veterans with post-traumatic stress disorder: positive findings from a pilot study and a randomised controlled trial. PLoS One 15:e0241763. doi: 10.1371/journal.pone.0241763
Keywords: physical activity, outdoor recreation programs, adaptive sports, veterans, PTSD, nature exposure, outdoor activity
Citation: Walter KH, Otis NP, Hose MK, Ober KM and Glassman LH (2023) The effectiveness of the National Veterans Summer Sports Clinic for veterans with probable posttraumatic stress disorder. Front. Psychol. 14:1207633. doi: 10.3389/fpsyg.2023.1207633
Edited by:
James W. Whitworth, National Center for Posttraumatic Stress Disorder, United StatesReviewed by:
Madeleine K. Nowak, Boston University, United StatesDaniel Lee, National Center for Posttraumatic Stress Disorder, United States
Sanaz Nosrat, Glooko, Inc., United States
Copyright © 2023 Walter, Otis, Hose, Ober and Glassman. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Kristen H. Walter, kristen.h.walter.civ@health.mil