Comparison of Therapy Practice at Home and in the Clinic: A Retrospective Analysis of the Constant Therapy Platform Data Set

Background: Computer-based therapies can provide an affordable and practical alternative by providing frequent intervention for stroke survivors with chronic aphasia by allowing the opportunity for home exercise practice, however more evidence is needed. The goal of this retrospective analysis was to compare the time course of therapy engagement when therapy was targeted in the clinic or at home by post-stroke individuals. We examined if home users of the therapy were compliant in therapy and if this documented practice time was associated with improved outcomes similar to clinic patients who practiced under the guidance of a clinician.

Methods: A retrospective analysis of anonymously aggregated data collected for 3,686 patients with post-stroke aphasia over the course of four years (2013–2017) was conducted. Participants either received therapy delivered through Constant Therapy only at home (N = 2,100) or only in the clinic (N = 1,577). Constant Therapy includes over 70 evidence-based therapies for language and cognitive skills. This program was individualized for each patient with targeted tasks that dynamically adapted to each individual's progress.

Results: Patients with <60% accuracy were analyzed to determine how long it took them to reach >90% accuracy. Results showed that both home-therapy and clinic patients reached 90% accuracy on their tasks similarly (Median = 3 sessions), but the frequency of therapy was significantly different with 50% of home users receiving therapy at least every 2 days while 50% of clinic patients only had therapy once every 5 days (p < 0.001). Thus, home-therapy users were able to master tasks in a shorter time (median of 6 days) than clinic patients (median of 12 days) (p < 0.001).

Conclusion: Outcomes of treatment are similar for home users and clinic patients indicating the potential usability of a home-based treatment program for rehabilitation for post-stroke aphasia.

Introduction

It is estimated that ~100,000 persons acquire aphasia each year in industrial countries (eso-stroke.org). In addition, there are roughly 1.7 million new instances of brain injury each year. Even though aphasia is more debilitating than other disabilities (1, 2), rehabilitation for chronic aphasia is quite fragmented. After a limited number of speech therapy sessions immediately following stroke, persons with aphasia (PWA) receive little to no support to maintain progress or carry therapy strategies over into daily communicative activities. This negatively influences their quality of life as compared to individuals with other chronic disabilities (3, 4).

Research indicates that aphasia rehabilitation improves language and communication ability (5–9) but there are no clear standard of care guidelines for providing effective and efficient rehabilitation services for chronic aphasia. Approaches to improve specific aspects of language are effective but these treatments require one-on-one (clinician-patient) intervention with periodic visits to the hospital and clinic. Additionally, the frequency of clinic visits is determined by health insurance plans, the individual's mobility and access to transportation, as well as vicarious factors, including the geographic location of the hospital and adverse weather. These barriers complicate the already difficult path for consistent and systematic aphasia rehabilitation for chronic stroke survivors. A recent study in the United Kingdom documented that chronic stroke survivors received between 3 and 5 60 min therapy sessions over a period of 3 months (10), which is far lower than the recommended clinical practice recommendations (11).

One potential solution is to facilitate patient practice of rehabilitation at home. Several studies have examined computer based interventions at home and in the clinic, but most of these have included small sample sizes and the degree of outcomes have been variable (12–31). Some of these studies have incorporated different types of homework into their therapy program, and the amount of practice at home has varied greatly, partly contributing to different outcomes. Additionally, very few of these studies directly compared intervention at home vs. in the clinic, thus making it difficult to draw conclusions about whether therapy at home is equivalent to therapy provided in the clinic [see (32) for a full discussion on this topic].

One of the studies noted above provided preliminary efficacy for a remotely delivered cloud-based rehabilitation program called Constant Therapy (27) in 51 patients with aphasia. Experimental and control patients in this study practiced therapy tasks on an iPad, but experimental patients also practiced independently at home, while control patients only received therapy in the clinic. Results showed that experimental patients showed significantly more improvements on standardized tests than control patients, but they also received much more practice than control patients. Importantly, more severe patients showed more improvements than less severe patients. However, the experimental patients still received treatment in the clinic, so this study does not provide a direct comparison of clinic-only and home-only therapy.

To summarize, computer-based treatments are emerging as an alternative to delivering therapy for patients, however, for these types of treatment deliveries to become realistic alternatives to one-on-one in-clinic therapy visits, more evidence is required. The goal of this retrospective analysis was to compare the time course of therapy engagement and corresponding outcomes when therapy was targeted in the clinic or at home by post-stroke individuals. In both scenarios, patients practiced a computer-based therapy, however, therapy performed under the real-time guidance of a clinician was compared with therapy performed at home without real-time clinician guidance. We examined how often home users utilized the therapy and if this documented practice time was associated with improved outcomes similar to clinic patients who practiced under the guidance of a clinician. The hypothesis was that both home users and clinic users will improve in a similar timeframe on the tasks assigned in treatment and demonstrate the feasibility of a home-based treatment program for rehabilitation for post-stroke aphasia.

Methods

Participants

Over a span of 4 years (2013–2017), data was anonymously aggregated and analyzed from 20,000 independent PWA, all of whom presented with language and/or cognitive disorders. Constant Therapy was the software used for therapy delivery and is available for download on the iTunes and Google stores. Either clinicians could set up an account for the patient, or the patient could create an account after downloading the program from their application. Before the patients could sign into the account, they were presented with a written description of the user license agreement where they had to consent to the use of their exercise and therapy performance for scientific and research purposes. They were asked to provide information about their demographics, including age (in years) and years since injury (0–6 months, 6 months−1 year, 1–2 years, 2–5 years, 5–10 years, and more than 10 years). They were also asked to self-select which domains of the therapy they felt they needed improvement. Only two groups are analyzed for this paper, PWA who received therapy only when they were in the clinic (n = 1,577), and PWA who received therapy only while at home (n = 2,100). PWA who received therapy both at home and in the clinic were excluded from this study. Refer to Table 1 for a breakdown of age and years since injury for home and clinic PWA.

TABLE 1

Table 1. Count of PWA in age and years since injury bins, by home and clinic therapy use.

This project was considered an IRB exempted retrospective analysis by Pearl IRB (#17-LNCO-101) under 45 CFR 46.101(b) category 2.

Therapy Program

Data was collected using a mobile therapy platform, Constant Therapy, which includes 70 evidence-based tasks with varying levels of difficulty ranging from one level to 10 levels, for a total of 244 individual task levels. The tasks fall in the domains of language: (a) naming, (b) comprehension, (c) speaking, (d) reading, and (e) writing; and cognitive skills: (a) attention, (b) executive skills and problem solving, (c) mental flexibility, (d) memory, and (e) visuospatial skills. Patients practiced in the clinic with clinicians (i.e., clinic group) or independently if they were not currently receiving therapy (i.e., home group). This program was standardized, in that all tasks were designed and administered in a uniform way, but also individualized in that patients were assigned tasks that addressed their individual strengths and weaknesses and dynamically adapted to each individual's progress.

The data presented here are curated from a larger data set. To keep the analyses between the home and clinic users comparable, several filters were applied to the data. Thus, for the purposes of this study, only the tasks where PWA were initially struggling (<60% accuracy) and proceeded to then master the task (90% accuracy and greater) were included in the analyses. This method of selecting data also equated the clinic and home patient groups on factors such as overall severity. Second, only instances where PWA took more than 1 day but fewer than 60 days to master the task were included. In addition, only tasks that at least 15 clinic-only PWA and 15 home-only PWA completed were included for analysis, which left 46 task levels with enough data to be analyzed (see Table 2 for a count of subjects included in each task level) across 34 unique tasks. We should note that selection of these 46 tasks does not imply that for the tasks not selected for analysis, there are preexisting differences in the performance between the two groups. In fact, clinicians did not chose the task at that difficulty level in the clinic for 116 task levels and 80 tasks levels were not assigned to both groups (presumably because these tasks were at the highest or lowest difficulty levels). Only 2 of the task levels had enough in clinic use but not enough at home use, the Symbol Matching level 1 and Picture Matching level 1 tasks, both of which are only assigned at home to the most severe cases after home users have failed at the level 2 version of those tasks, respectively, which rarely happens. Thus, if the tasks were used in the clinic, they were included in the study.

TABLE 2

Table 2. Count of PWA included in each task by home and clinic therapy use.

Data Analysis

Five dependent variables were considered:

(i) The number of calendar days passed from when users first struggled with a task (with an accuracy of 60% or less) to when they first succeeded at the task (with an accuracy of 90% or more). This measures how many days passed as the users practiced a particular therapy task before improving,

(ii) The median number of days between each therapy session during that period to gauge how frequently therapy was performed while excluding events like vacations and missed therapy days,

(iii) The number of days of therapy the user required in order to succeed at a task,

(iv) The number of items per therapy day that users completed, and

(v) The total number of therapy items (individual questions or exercises) for users to reach 90% accuracy.

To provide a context for these variables, if a user failed at a math task on Monday, practiced again on Wednesday, and succeeded at the task on Friday, it took 3 days of therapy spread out over 5 calendar days with 2 days between each therapy session in order to succeed at the task. If the patient practiced 5 items per therapy day, then the total number of items required to succeed at the task would be 15.

With the exception of the median number of days between therapy sessions and the number of items per therapy day, all of the measures had exponential distributions (Figure 1). Therefore, log transformations were performed and used for analyses with number of calendar days, number of days of therapy sessions, and total number of items. Statistics were completed using Statistical Package for the Social Science (SPSS Inc., Chicago, IL).

FIGURE 1

Figure 1. Summary of median calendar days needed to master the task by user group.

Results

Data for 3677 PWA were analyzed for this study. The average age of home users was 59.77 and clinic users was 64.48 years. A t-test (since the age was entered as a continuous variable) (t = 9.03, p < 0.001) showed these differences were significant even though they were very similar. The average time since injury for home users was 2.01 years while clinic users was 1.59 years. A Mann–Whitney test was conducted because time since stroke was provided as a semi-categorical variable and this was also significantly different, Mann–Whitney (statistic = 1,455,696.0, p < 0.001). Given that there were pre-existing differences between the two groups in their age and time since stroke, these factors were entered as covariates into the data analyses.

A two-tailed Pearson correlation revealed that all five measures were significantly correlated with each other (Table 3). Therefore, separate univariate ANCOVAs (instead of one MANCOVA) were run with each of the measures as the dependent variable and with the user group (clinic or home users) and the task (different tasks and different levels of task) as independent variables, controlling for age and time since injury. The first ANCOVA examined the log of the number of calendar days for users to reach 90% accuracy and found no significant effect of age, but there was a significant effect of years since injury [F_(1,7056) = 3.85, p < 0.05] where home users had a higher number of years since injury than clinic users. As noted above, there is a slight difference in time since injury between the two groups. However, a regression showed that time since injury did not significantly affect the log number of calendar days (t = −0.77, beta = −0.01, p = 0.44). There was a main effect of user group [F_(1,7056) = 279.44, p < 0.001] where clinic users took a higher number of calendar days to reach 90% accuracy than home users (Figure 2). Specifically, the adjusted mean log number of calendar days for users to reach 90% accuracy was 1.00 (SE = 0.01) for clinic users and 0.75 (SE = 0.01) for home users; in other words, the median number of calendar days was 12 for clinic users and six for home users. There was also a main effect of task level [F_(45,7,056) = 2.52, p < 0.001] where the number of calendar days for users to reach 90% accuracy varied across task levels. The interaction was not significant.

TABLE 3

Table 3. Correlation results for log of number of calendar days, log of total number of items, log of number of therapy days, and median days between sessions.

FIGURE 2

Figure 2. Adjusted means for the number of calendar days passed by user group. Covariates appearing in the model are evaluated at the following values: years since injury = 2.10, age = 61.62.

The second ANCOVA looked at the median number of days between therapy sessions and showed no significant effect of age or years since injury. There was a significant main effect of user group [F_(1,7,056) = 205.84, p < 0.001] where clinic users had a greater median numbers of days between sessions than home users (Figure 3), such that the median number of days between therapy sessions was five for clinic users and two for home users. The main effect of task level was not significant, but the interaction was significant [F_(45,7,056) = 2.97, p < 0.001] where clinic users had a greater median number of days between sessions than home users for some task levels but the opposite was true for other task levels.

FIGURE 3

Figure 3. Adjusted means for the median number of days between each therapy session by user group. Covariates appearing in the model are evaluated at the following values: years since injury = 2.10, age = 61.62.

The third ANCOVA examined the log of the number of therapy days that users took to reach 90% accuracy and found a significant effect of age [F_(1,7,056) = 9.18, p < 0.01] where home users were younger than clinic users. However, a regression showed that age did not predict the log number of therapy days (t = 0.57, beta = 0.01, p = 0.57). There was no significant effect of time since injury. There was a significant main effect of user group [F_(1,7,056) = 75.64, p < 0.001] where overall, clinic users took fewer days of therapy to reach 90% accuracy than home users (Figure 4). Specifically, the adjusted mean log number of days of therapy for users to reach 90% accuracy was 0.42 (SE = 0.01) for clinic users and 0.49 (SE = 0.004) for home users; the median number of days of therapy was two for clinic users and three for home users. There was also a significant main effect of task level [F_(45,7,056) = 3.30, p < 0.001] where the number of days of therapy differed across task levels. The interaction was also significant [F_(45,7,056) = 1.99, p < 0.001] where clinic users required more days of therapy than home users for some task levels but the opposite was true for other task levels.

FIGURE 4

Figure 4. Adjusted means for the number of days of therapy the user completed by user group. Covariates appearing in the model are evaluated at the following values: years since injury = 2.10, age = 61.62.

The fourth ANCOVA examined the number of items per day that users completed and found no significant effect of age or time since injury. There was a significant main effect of user group [F_(1,7,056) = 13.44, p < 0.001] where clinic users completed more items per therapy day than home users. Specifically, the adjusted mean number of items per therapy day that users completed was 8.66 (SE = 0.11) for clinic users and 7.60 (SE = 0.08) for home users; the median number of items per therapy day was 8.17 for clinic users and 6.40 for home users. The main effect of task level was not significant, but the interaction was significant [F_(45,7,056) = 5.93, p < 0.001] where clinic users completed more items per therapy day than home users on some task levels while the opposite was true for other task levels (Figure 5).

FIGURE 5

Figure 5. Adjusted means for the number of items per day the users completed by user group. Covariates appearing in the model are evaluated at the following values: years since injury = 2.10, age = 61.62.

The fifth ANCOVA looked at the log of the total number of items that users took to reach 90% accuracy and found no significant main effects, nor any effects of age or time since injury. In this case, the adjusted mean log total number of items for users to reach 90% accuracy was 1.30 (SE = 0.01) for clinic users and 1.32 (SE = 0.01) for home users; the median total number of items was 20 for both clinic and home users. The interaction between user group and task levels was significant [F_(45,7,056) = 5.38, p < 0.001] where clinic users required more items than home users for some task levels and the opposite was true for other task levels (Figure 6).

FIGURE 6

Figure 6. Adjusted means for the total number of therapy items the users completed by user group. Covariates appearing in the model are evaluated at the following values: years since injury = 2.10, age = 61.62.

Discussion

The goal of this retrospective analysis was to compare the time course of therapy engagement when therapy was practiced in the clinic or at home by post-stroke individuals. The main observation of the study was that to improve on a specific task, it is the amount of practice that is required rather than the setting that is practiced. Also, patients take advantage of practicing multiple times a week if they have the option, and are able to engage with the software independently.

First, there was no significant difference between clinic and home users on the total number of items that were required to reach 90% accuracy (ANCOVA #5), although there was a significant interaction between user group and task level (with some tasks requiring greater items practiced compared to others). Also, clinic users needed significantly fewer days of therapy to reach 90% accuracy than home users (ANCOVA #3). Again, there was a significant effect of task level and the interaction was also significant, though the effect where clinic users required fewer days than home users was the most prevalent effect, with six of the 46 task levels showing the opposite effect. One element of this effect can be explained through the analysis which showed that clinic users practiced more items per therapy day than home users (ANCOVA #4) although again the interaction effect indicated some tasks required greater items practiced compared to others. These three results indicate that while the clinic users practice more items per therapy day, there are no differences in the overall number of items practiced across the two groups. These results appear to suggest that post-stroke patients (both home and clinic users) require the same number of items to achieve criterion on a given task. This observation is important because it demonstrates that patients who use the software, are getting benefit from the therapy independently, and this is not significantly different from the benefit gained from users who are working with the guidance of a clinician.

Importantly, there are differences between the clinic and home users (ANCOVA #1); clinic users take significantly more calendar days to reach 90% accuracy than home users. Though there was also a significant effect of task level, the interaction was not significant, so the two groups did not differ significantly based on the task level. Additionally, the results showed that the clinic users had a significantly greater number of days between therapy sessions than home users (ANCOVA #2). The interaction was significant this time, though the main effect of clinic users having more days between sessions was true for all but four of the 46 task levels. Both these findings suggest that clinic users take longer than home users to reach 90% accuracy due to accessibility to the program. Users who only used the therapy program in the clinic would need to wait at least until their next therapy session to do the task again. On the other hand, home users had access to the therapy program every day at home. Thus, they had the option to practice therapy multiple times a week.

The main effect of user group showed that while home users complete their therapy quicker than clinic users, the clinic users do not need as many days of therapy to reach 90%. Although this observation seems contradictory, it is possible that clinic users may benefit from one-on-one clinician interaction to master the therapy tasks relative to home users who may or may not have family support to complete the therapy tasks.

It is meaningful to put these results in context and comparing median values presented in the results illustrate the differences nicely. Say that a clinic-only user were to start therapy on the first of the month; the results show that it takes this user 12 calendar days to progress from 60 to 90% performance on a task. This person attends therapy sessions every 5–7 days but needs two sessions to reach 90% accuracy. Thus, by the 12th day of the month, this clinic user would have mastered the therapy tasks and is ready to move on to the next therapy task. In comparison, a home user also starts on the first of the month, takes 6 days to progress from 60 to 90%. This person, however, practices the therapy task every 2 days and needs three sessions to master the task. Thus, by the 6th day of the month, the user would have mastered the therapy task and is ready to move on to the next therapy task. Note that both users complete a median of 20 items to reach 90% accuracy. Thus, these results indicate that the home user practices fewer items per therapy day but practices therapy more often whereas the clinic user practices more items per therapy day but has access to the therapy less often. Overall, these results suggest that similar outcomes can be achieved in home therapy and under the guidance of a clinician, albeit following a different timeframe. There are some advantages to clinic-based treatment, interacting with a clinician hastens the improvement, but conversely patients can progress through their treatment faster when they practice therapy at home more frequently.

There are some important caveats to this retrospective analysis. First, users were not randomly assigned into their groups, they were self-selected in terms of whether they used the app either at the clinic or at home. Therefore, it is possible that severity of the patients may have influenced the results such that more severe users only worked with clinicians whereas less severe patients were able to work independently at home. Our own previous work has shown that severe patients interact with the Constant Therapy platform differently than less severe patients (33). To avoid this problem, we only examined progress from 60 to 90% performance for all patients and Table 4 shows mean starting accuracy levels for each of the tasks analyzed and differences between the two groups. While some differences are significant for some tasks, there are no systemic differences between the two groups and there are also between-task differences in starting accuracy. Another important caveat of this data set is that there are no standardized assessments to validate the improvements made in treatment. This is an important trade off in this type of big data analysis, while large amounts of data sets are collected across several English-speaking countries, it is impossible to collect detailed demographic and assessment information from these individuals. Future work in this area should combine remote assessments that are designed to capture changes made in the treatment program but this data is unavailable for this manuscript.

TABLE 4

Table 4. Group comparisons of starting accuracy for each task.

In consideration of these caveats, this retrospective analysis provides a narrow interpretation of a large data set that directly compares the rate of treatment gains for patients who practice one-on-one in the clinic vs. those who receive therapy only at home. These results contribute to an increasing body of research showing that self-administered computer based therapy and/or telerehabilitation may be a feasible alternate approach to continuing rehabilitation (5, 16, 17, 29–31). Further, the observation that increased therapy practice is associated with more improvement aligns with studies that emphasize the importance of dosage of therapy in chronic aphasia (34–37). For many individuals, visits to a clinician are infrequent and inconsistent which limits the amount of therapy, and thus the recovery they can achieve (10). Remote/computer-based therapy can be practiced daily at home thus allowing patients to practice more intense therapy than periodic visits to a clinic, while achieving similar therapy gains as one-on-one clinician visits. Ultimately, this may facilitate the way the clinicians deliver therapy, which may become more efficient and fulfilling for both the patient and the clinician (38, 39).

Ethics Statement

This study was carried out in accordance with the recommendations of Pearl IRB. This study was exempt from written informed consent as it was an anonymized retrospective analysis. Our protocol was exempt because (1) the research involves the study of existing data that is recorded by the investigator [per 45-CFR 46.101 (b) (4)], and (2) the research involves the use of education tests (cognitive, diagnostic, achievement), survey procedures that are analyzed in an aggregated form [per 45 CFR 46.101 (b)(2)].

Author Contributions

VA, MA, SK, and JG conceptualized the project. CD, JG, and SK were involved in analyzing the results and writing the manuscript.

Conflict of Interest Statement

SK and CD are currently consultants for The Learning Corporation. JG, MA, and VA are employees of The Learning Corporation.

References

1. Mozaffarian D, Benjamin EJ, Go AS, Arnett DK, Blaha MJ, Cushman M, et al. Executive summary: heart disease and stroke statistics-2016 update: a report from the American heart association. Circulation (2016) 133:447–54. doi: 10.1161/CIR.0000000000000366

CrossRef Full Text | Google Scholar

2. Engelter ST, Gostynski M, Papa S, Frei M, Born C, Ajdacic-Gross V, et al. Epidemiology of aphasia attributable to first ischemic stroke: incidence, severity, fluency, etiology, and thrombolysis. Stroke (2006) 37:1379–84. doi: 10.1161/01.STR.0000221815.64093.8c

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Lam JM, Wodchis WP. The relationship of 60 disease diagnoses and 15 conditions to preference-based health-related quality of life in Ontario hospital-based long-term care residents. Med Care (2010) 48:380–7. doi: 10.1097/MLR.0b013e3181ca2647

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Worrall L, Sherratt S, Rogers P, Howe T, Hersh D, Ferguson A, et al. What people with aphasia want: their goals according to the ICF. Aphasiology (2010) 25:309–22. doi: 10.1080/02687038.2010.508530

CrossRef Full Text | Google Scholar

5. Zheng C, Lynch L, Taylor N. Effect of computer therapy in aphasia: a systematic review. Aphasiology (2016) 30:211–44. doi: 10.1080/02687038.2014.996521

CrossRef Full Text | Google Scholar

6. Allen L, Mehta S, McClure JA, Teasell R. Therapeutic interventions for aphasia initiated more than six months post stroke: a review of the evidence. Top Stroke Rehabil. (2012) 19:523–35. doi: 10.1310/tsr1906-523

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Cherney LR, Patterson JP, Raymer A, Frymark T, Schooling T. Evidence-based systematic review: effects of intensity of treatment and constraint-induced language therapy for individuals with stroke-induced aphasia. J Speech Lang Hear Res. (2008) 51:1282–99. doi: 10.1044/1092-4388(2008/07-0206)

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Kelly H, Brady MC, Enderby P. Speech and language therapy for aphasia following stroke. Cochrane Database Syst Rev. (2010) CD000425. doi: 10.1002/14651858.CD000425.pub2

CrossRef Full Text | Google Scholar

9. Brady MC, Kelly H, Godwin J, Enderby P, Campbell P. Speech and language therapy for aphasia following stroke. Cochrane Database Syst Rev. (2016) 6:CD000425. doi: 10.1002/14651858.CD000425.pub4

CrossRef Full Text | Google Scholar

10. Palmer R, Witts H, Chater T. What speech and language therapy do community dwelling stroke survivors with aphasia receive in the UK? PLoS ONE (2018) 13:e0200096. doi: 10.1371/journal.pone.0200096

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Brainin M, Norrving B, Sunnerhagen KS, Goldstein LB, Cramer SC, Donnan GA, et al. Poststroke chronic disease management: towards improved identification and interventions for poststroke spasticity-related complications. Int J Stroke (2011) 6:42–6. doi: 10.1111/j.1747-4949.2010.00539.x

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Aftonomos LB, Steele RD, Wertz RT. Promoting recovery in chronic aphasia with an interactive technology. Arch Phys Med Rehabil. (1997) 78:841–6. doi: 10.1016/S0003-9993(97)90197-0

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Fink RB, Brecher A, Schwartz MF, Robey RR. A computer-implemented protocol for treatment of naming disorders: evaluation of clinician-guided and partially self-guided instruction. Aphasiology (2002) 16:161–86. doi: 10.1080/02687030244000400

CrossRef Full Text | Google Scholar

14. Ramsberger G, Marie B. Self-administered cued naming therapy: a single-participant investigation of a computer-based therapy program replicated in four cases. Am J Speech Lang Pathol. (2007) 16:343–58. doi: 10.1044/1058-0360(2007/038)

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Fridriksson J, Baker JM, Whiteside J, Eoute D Jr, Moser D, Vesselinov R, et al. Treating visual speech perception to improve speech production in nonfluent aphasia. Stroke (2009) 40:853–8. doi: 10.1161/STROKEAHA.108.532499

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Kurland J, Wilkins AR, Stokes P. iPractice: piloting the effectiveness of a tablet-based home practice program in aphasia treatment. Semin Speech Lang. (2014) 35:51–63. doi: 10.1055/s-0033-1362991

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Woolf C, Caute A, Haigh Z, Galliers J, Wilson S, Kessie A, et al. A comparison of remote therapy, face to face therapy and an attention control intervention for people with aphasia: a quasi-randomised controlled feasibility study. Clin Rehabil. (2015) 30:359–73. doi: 10.1177/0269215515582074

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Cherney LR, Halper AS. Novel technology for treating individuals with aphasia and concomitant cognitive deficits. Top Stroke Rehabil. (2008) 15:542–54. doi: 10.1310/tsr1506-542

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Manheim LM, Halper AS, Cherney L. Patient-reported changes in communication after computer-based script training for aphasia. Arch Phys Med Rehabil. (2009) 90:623–7. doi: 10.1016/j.apmr.2008.10.022

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Cherney LR, Kaye RC, van Vuuren S. Acquisition and maintenance of scripts in aphasia: a comparison of two cuing conditions. Am J Speech Lang Pathol. (2014) 23:S343–60. doi: 10.1044/2014_AJSLP-13-0097

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Linebarger M, McCall D, Virata T, Berndt RS. Widening the temporal window: processing support in the treatment of aphasic language production. Brain Lang. (2007) 100:53–68. doi: 10.1016/j.bandl.2006.09.001

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Choi YH, Park HK, Paik NJ. A telerehabilitation approach for chronic aphasia following stroke. Telemed J E Health (2015) 22:434–40. doi: 10.1089/tmj.2015.0138

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Stark BC, Warburton EA. Improved language in chronic aphasia after self-delivered iPad speech therapy. Neuropsychol Rehabil. (2018) 28:818–31. doi: 10.1080/09602011.2016.1146150

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Steele RD, Baird A, McCall D, Haynes L. Combining teletherapy and on-line language exercises in the treatment of chronic aphasia: an outcome study. Int J Telerehabil. (2014) 6:3–20. doi: 10.5195/IJT.2014.6157

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Mortley J, Wade J, Enderby P. Superhighway to promoting a client-therapist partnership? Using the Internet to deliver word-retrieval computer therapy, monitored remotely with minimal speech and language therapy input. Aphasiology (2004) 18:193–211. doi: 10.1080/02687030344000553

CrossRef Full Text | Google Scholar

26. Palmer R, Enderby P, Cooper C, Latimer N, Julious S, Paterson G, et al. Computer therapy compared with usual care for people with long-standing aphasia poststroke: a pilot randomized controlled trial. Stroke (2012) 43:1904–11. doi: 10.1161/STROKEAHA.112.650671

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Des Roches CA, Balachandran I, Ascenso EM, Tripodis Y, Kiran S. Effectiveness of an impairment-based individualized rehabilitation program using an iPad-based software platform. Front Human Neurosci. (2015) 8:1015. doi: 10.3389/fnhum.2014.01015

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Hoover EL, Carney A. Integrating the iPad into an intensive, comprehensive aphasia program. Semin Speech Lang. (2014) 35:25–37. doi: 10.1055/s-0033-1362990

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Varley R, Cowell PE, Dyson L, Inglis L, Roper A, Whiteside SP. Self-administered computer therapy for apraxia of speech: two-period randomized control trial with crossover. Stroke (2016) 47:822–8. doi: 10.1161/STROKEAHA.115.011939

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Meltzer JA, Baird AJ, Steele RD, Harvey SJ. Computer-based treatment of poststroke language disorders: a non-inferiority study of telerehabilitation compared to in-person service delivery. Aphasiology (2018) 32:290–311. doi: 10.1080/02687038.2017.1355440

CrossRef Full Text | Google Scholar

31. Pitt R, Theodoros D, Hill AJ, Rodriguez AD, Russell T. The feasibility of delivering constraint-induced language therapy via the Internet. Digit Health (2017) 3:2055207617718767. doi: 10.1177/2055207617718767

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Des Roches CA, Kiran S. Technology-based rehabilitation to improve communication after acquired brain injury. Front Neurosci. (2017) 11:382. doi: 10.3389/fnins.2017.00382

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Des Roches CA, Mitko A, Kiran S. Relationship between self-administered cues and rehabilitation outcomes in individuals with aphasia: understanding individual responsiveness to a technology-based rehabilitation program. Front Hum Neurosci. (2017) 11:07. doi: 10.3389/fnhum.2017.00007

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Shrubsole K, Worrall L, Power E, O'Connor DA. Recommendations for post-stroke aphasia rehabilitation: an updated systematic review and evaluation of clinical practice guidelines. Aphasiology (2017) 31:1–24. doi: 10.1080/02687038.2016.1143083

CrossRef Full Text | Google Scholar

35. Shrubsole K, Worrall L, Power E, O'Connor DA. Priorities for closing the evidence-practice gaps in poststroke aphasia rehabilitation: a scoping review. Arch Phys Med Rehabil. (2018) 99:1413–1423 e24. doi: 10.1016/j.apmr.2017.08.474

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Dignam JK, Rodriguez AD, Copland DA. Evidence for intensive aphasia therapy: consideration of theories from neuroscience and cognitive psychology. PM R (2016) 8:254–67. doi: 10.1016/j.pmrj.2015.06.010

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Kiran S. How does severity of aphasia influence individual responsiveness to rehabilitation? using big data to understand theories of aphasia rehabilitation. Semin Speech Lang. (2016) 37:48–59. doi: 10.1055/s-0036-1571358

PubMed Abstract | CrossRef Full Text | Google Scholar

38. van de Sandt-Koenderman WM. Aphasia rehabilitation and the role of computer technology: can we keep up with modern times? Int J Speech Lang Pathol. (2011) 13:21–7. doi: 10.3109/17549507.2010.502973

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Varley R. Rethinking aphasia therapy: a neuroscience perspective. Int J Speech Lang Pathol. (2011) 13:11–20. doi: 10.3109/17549507.2010.497561

PubMed Abstract | CrossRef Full Text | Google Scholar