Vera C. Kaelin1,2
Mina Valizadeh3,4
Zurisadai Salgado2
Julia G. Sim2
Dana Anaby5,6
Andrew D. Boyd1,7,8
Natalie Parde3,4*†
Mary A. Khetani1,2,6,9*†- 1Rehabilitation Sciences, University of Illinois at Chicago, Chicago, IL, United States
- 2Children's Participation in Environment Research Lab, University of Illinois at Chicago, Chicago, IL, United States
- 3Computer Science, University of Illinois at Chicago, Chicago, IL, United States
- 4Natural Language Processing Laboratory, University of Illinois at Chicago, Chicago, IL, United States
- 5School of Physical and Occupational Therapy, McGill University, Montreal, QC, Canada
- 6CanChild Centre for Childhood Disability Research, McMaster University, Hamilton, ON, Canada
- 7Biomedical and Health Information Sciences, University of Illinois at Chicago, Chicago, IL, United States
- 8Physical Therapy, University of Illinois at Chicago, Chicago, IL, United States
- 9Occupational Therapy, University of Illinois at Chicago, Chicago, IL, United States
Background: There is increased interest in using artificial intelligence (AI) to provide participation-focused pediatric re/habilitation. Existing reviews on the use of AI in participation-focused pediatric re/habilitation focus on interventions and do not screen articles based on their definition of participation. AI-based assessments may help reduce provider burden and can support operationalization of the construct under investigation. To extend knowledge of the landscape on AI use in participation-focused pediatric re/habilitation, a scoping review on AI-based participation-focused assessments is needed.
Objective: To understand how the construct of participation is captured and operationalized in pediatric re/habilitation using AI.
Methods: We conducted a scoping review of literature published in Pubmed, PsycInfo, ERIC, CINAHL, IEEE Xplore, ACM Digital Library, ProQuest Dissertation and Theses, ACL Anthology, AAAI Digital Library, and Google Scholar. Documents were screened by 2–3 independent researchers following a systematic procedure and using the following inclusion criteria: (1) focuses on capturing participation using AI; (2) includes data on children and/or youth with a congenital or acquired disability; and (3) published in English. Data from included studies were extracted [e.g., demographics, type(s) of AI used], summarized, and sorted into categories of participation-related constructs.
Results: Twenty one out of 3,406 documents were included. Included assessment approaches mainly captured participation through annotated observations (n = 20; 95%), were administered in person (n = 17; 81%), and applied machine learning (n = 20; 95%) and computer vision (n = 13; 62%). None integrated the child or youth perspective and only one included the caregiver perspective. All assessment approaches captured behavioral involvement, and none captured emotional or cognitive involvement or attendance. Additionally, 24% (n = 5) of the assessment approaches captured participation-related constructs like activity competencies and 57% (n = 12) captured aspects not included in contemporary frameworks of participation.
Conclusions: Main gaps for future research include lack of: (1) research reporting on common demographic factors and including samples representing the population of children and youth with a congenital or acquired disability; (2) AI-based participation assessment approaches integrating the child or youth perspective; (3) remotely administered AI-based assessment approaches capturing both child or youth attendance and involvement; and (4) AI-based assessment approaches aligning with contemporary definitions of participation.
Introduction
Participation is a key re/habilitation outcome that has been defined by the World Health Organization as the “involvement in life situation” (1, p. 9). In pediatric re/habilitation this definition has been further conceptualized by Imms et al. (2) in the family of Participation-Related Constructs (fPRC) framework. This contemporary framework defines participation as child or youth attendance and involvement in activities, which is related to but distinct from their activity competencies, environment/context, and preferences or sense of self (2, 3). Attendance is the objective dimension of participation and has been commonly used to quantify participation in pediatric re/habilitation (2–5). Involvement is considered as more complex (2, 3, 5) and has been further grouped by education and pediatric re/habilitation literature into behavioral, cognitive, and emotional involvement (6–8). Behavioral involvement is considered observable on-task behavior (8), whereas cognitive involvement (thoughtfulness and willingness to employ effort for tasks) and emotional involvement (positive and negative feelings when interacting with people or tasks) are non-observable (3, 8).
Recent literature reviews revealed inconsistent conceptualization of participation in pediatric re/habilitation, hindering interpretability and comparison across studies and practice approaches (4, 5). For example, participation has often been used interchangeably with activity competence, rendering confusion about these two distinct but related constructs (2–5). For efficient service provision (9) to reduce costs and provider and patient burden (10), there is need to simplify processes within participation-focused pediatric re/habilitation services without compromising the complexity and the customization of participation-focused services to individual needs.
The application of artificial intelligence (AI), which is considered a top re/habilitation research priority (9, 11), might be one way to address this need. AI can be defined as systems that think and act rationally by mimicking humans (12). Regardless of the type of AI method employed [e.g., machine learning (ML), natural language processing (NLP)] (12), AI is commonly used to simplify processes and to customize information to individuals' preferences and needs, which could benefit the healthcare industry (13). In pediatric re/habilitation, AI may help to consolidate and analyze information in ways that afford for providers to more efficiently enact the evaluation and goal-setting, intervention, and reevaluation phases of the therapeutic process (14) to deliver client-centered and participation-focused re/habilitation interventions (15, 16). In the last decade there has been a vast increase in research on the use of AI in participation-focused pediatric re/habilitation warranting need for summarizing the body of literature in this area of work (17).
Recently, our scoping review (17) on the use of AI in re/habilitation interventions targeting the participation of children and youth with acquired and congenital disabilities included appraisal of: (1) their type of AI and customization used; (2) their mode of delivery (i.e. in-person, remote); and (3) whether goal-setting was addressed. Results revealed 94 studies using AI in participation-focused pediatric re/habilitation interventions. Of these 94 studies, only 7 (8%) applied types of AI other than robotics or virtual reality (VR), only one study (1%) was tailored to patients' individual needs, only 10 (11%) were delivered remotely, and only one (1%) of the studies described individual goal-setting as part of their intervention (17).
A main limitation of this scoping review include its exclusive focus on interventions (17). Assessments that are conceptually sound play a substantial role in shaping the enactment of quality therapeutic processes (4, 5, 14, 18) and ensuring consistent interpretation of research findings across studies (5). Prior systematic reviews revealed few participation assessments that aligned with contemporary definitions of child and youth participation [i.e., children and youth's attendance and their involvement (2, 3)] (5, 19). Despite increased interest in using AI to capture participation (15), none of the included pediatric assessment approaches used AI (5, 19). The lack of AI to assess for child and youth participation might be due to selection of search terms and differing terminology in pediatric re/habilitation and computer science (e.g., while “measure” is used for clinical assessment approach in pediatric re/habilitation, it is often a data analytic term in computer science). Alternatively, the use of AI to assess children's participation is still in a nascent phase, which could have precluded their inclusion. Additionally, the authors did not examine participation assessments in regards to their focus on types of involvement (i.e., behavioral, cognitive, and emotional) and concluded the need for “further investigation and characterization, both in relation to what constitutes involvement and the best methods of measurement.” (5, p. 13). To extend knowledge of the landscape on AI use in participation-focused pediatric re/habilitation, a scoping review on AI-based participation-focused assessments is needed.
Therefore, the purpose of this scoping review was to understand how the construct of participation is captured and operationalized in pediatric re/habilitation using AI, and to what extent it aligns with the contemporary definitions of child and youth participation [i.e., attendance and involvement (2, 3), as indicated by child or youth behavioral, cognitive, and emotional involvement (6–8)].
Methods
Study Design
We conducted a scoping review to summarize the breadth of existing evidence on how participation is captured and operationalized in pediatric re/habilitation research using AI-based assessment approaches and to identify gaps for future research (20–22). In re/habilitation disciplines, assessment is a way to gather clinically relevant information about a patient (23). This can be done via different modalities (e.g., observation, interview) and through standardized or non-standardized tools. For this review, assessment is considered an approach and does not necessarily include a standardized tool. We use the PRISMA-ScR checklist (22) and the Joanna Briggs Institute guidelines by Peter et al. (21), encompassing an enhanced version of Arksey and O'Malley's five steps (21, 24, 25). A protocol for this scoping review is registered in Open Science Framework (26).
Step 1: Identifying the Research Question(s)
How is child or youth participation captured and operationalized in participation-focused pediatric re/habilitation research using AI?
a) What are the demographic characteristics of the targeted population examined in studies using AI to capture participation?
b) What types of AI have been used to assess for child and youth participation in pediatric re/habilitation research?
c) What methods (i.e., reported, observation, estimates), data sources (i.e., child/youth, caregiver, researcher, re/habilitation professional, other type of professional/not specified, facial/skeleton/eye recognition, sensors, Electroencephalogram (EEG), distance estimate, other), and mode of administration (i.e., remotely, in person) have been used to assess for child and youth participation in pediatric re/habilitation?
d) To what extent does participation-focused pediatric re/habilitation research using AI assess for participation in ways that align with the contemporary definition of child and youth participation (2, 3, 6–8)?
e) What are the research gaps in addressing child and youth participation, as aligned with the contemporary definition of child and youth participation, in pediatric re/habilitation research that uses AI?
Step 2: Identifying Relevant Studies
The first author of this review (VK) conducted a systematic literature search in well-established applied health sciences and computer science databases (i.e., Pubmed, PsycInfo, ERIC, CINAHL, IEEE Xplore, ACM Digital Library) with additional searches in ACL Anthology and AAAI Digital Library to retrieve documents published before February 2021. No search limitations were applied, including no publication data limit. We used a search strategy previously published by Kaelin et al. (17). For this scoping review, we additionally conducted a search for gray literature in Google Scholar (200 most relevant) (27) and ProQuest Dissertation and Theses, and we screened the reference lists of included studies (see Appendix 1 for exemplar search history for gray literature search).
Step 3: Study Selection
Documents were included if: (1) the document included a focus on capturing participation using AI; (2) the research paper included data on children and/or youth [aged 0–24 years, as aligned with the definition of children and youth put forth by the United Nations (28)] with a congenital or acquired disability (1); and (3) the document was published in English. No operational definition of participation was applied, so as to ensure inclusion of a broad scope of documents. The following terms have been used to describe participation in the fPRC (2, 3) and/or in prior literature reviews on pediatric participation (4, 19, 29) and were therefore considered as indicators of participation and included in this review: participation, inclusion, engagement, playfulness, access or attendance to life situation/settings/activities, social interaction, and social engagement. Documents were excluded if: (1) the document did not include a focus on capturing participation in daily activities (e.g., focus was on measuring skill development); (2) there was no use of AI to capture participation; (3) there were no data included of children or youth with a congenital or acquired disability (1); (4) the document focused on data of adults (mean age >24 years) (28); (5) the document was published in languages other than English; or (6) the document was a textbook review, textbook chapter, literature review, study protocol or demonstration paper, conference or workshop program, or included only an abstract without additional information. To prevent missing relevant documents, the reference lists of excluded literature reviews were screened.
After removal of duplicates from the scientific and gray literature search (n = 1,008), the titles and abstracts of 2,398 documents were screened for inclusion by two researchers independently (VK and MV) (see Figure 1). This resulted in 49 documents that underwent full-text screening by three researchers independently (ZS, JS, and VK) based on the same inclusion and exclusion criteria as for title and abstract screening. Disagreements during title/abstract and full-text screening were resolved through discussion and key informant feedback (MK and NP). In addition, a total of 86 documents were identified through title screening of reference lists in both included documents and excluded literature reviews. After abstract screening of these 86 additional documents, 10 were identified for full-text screening based on the same inclusion and exclusion criteria.
Figure 1. Study selection.
Step 4: Charting the Data
For all included documents, data were extracted by the same three researchers using Microsoft Excel, based on the following categories: Author(s), year, title, sample size, child/youth age, child/youth gender, child/youth acquired or congenital disability, child/youth race and ethnicity [Hispanic, non-Hispanic], family socio-economic status, family income, parental education level, how participation is operationalized, term(s) used to denote participation, whether a definition was provided for participation, participation activity addressed, approach to data collection (i.e., reported, observation, estimates), data source(s) (i.e., child/youth, caregiver, researcher, re/habilitation professional, other type of professional/not specified, facial/skeleton/eye recognition, sensors, EEG, distance estimate, other), type(s) of AI used [i.e., cognitive modeling, computer vision, constraint satisfaction and optimization, game theory, human-agent/computer/robot interaction, human computation and crowdsourcing, knowledge representation and reasoning, ML, NLP, planning/routing/scheduling, robotics, and visualization and VR (12)], and mode of administration (i.e., remotely, in person). The selection of demographic categories for extraction was guided by prior research on common predictors of child and youth participation (30–32). To ensure clarity and relevance of these categories, the data extraction tool was first trialed by three researchers (VK, ZS, and JS) with 5 included documents selected at random.
Step 5: Collating, Summarizing, and Reporting Results
Following data charting, we summarized the included studies according to their publication date, sample size, included child and youth age, gender, acquired or congenital disability, race and ethnicity, and their family's socio-economic status and/or income and their parents' education level. We calculated frequencies for the approach to data collection, data source(s), the type(s) of AI used, mode of administration, and whether a definition for participation was provided. Additionally, the first author (VK) sorted the data in the category of how participation is operationalized according to the fPRC (2, 3) paired with research on the conceptualization of involvement (6–8) and as visualized in Figure 2. More specifically, data was mapped to (1) child and youth attendance, (2) their involvement (2, 3), as indicated by child or youth behavioral, cognitive, and emotional involvement (6–8), (3) participation-related constructs (i.e., activity competence, sense of self, preferences, environment/context), and 4) a category “other” in situations where data could neither be mapped to participation (i.e., attendance, type of involvement) nor participation-related constructs. For participation assessment approaches that focused on involvement without specifying the type, we assumed a focus on all types of involvement. Uncertainties were discussed with a key informant (MK).
Figure 2. Conceptualization of participation based on contemporary frameworks of participation. Informed by the family of Participation-Related Constructs (fPRC) (2, 3) as paired with research on the conceptualization of involvement (6–8).
Results
Our scientific and gray literature search revealed 3,406 documents, with 1,008 duplicates, resulting in 2,398 documents that we screened based on their title and abstract (see Figure 1). A total of 2,349 documents were excluded, resulting in 49 documents that underwent full-text screening, and another 10 documents that were identified by screening the reference lists of excluded literature reviews and included studies. While most documents were excluded because they did not use AI to capture participation (n = 24), additional reasons for exclusion were the lack of data on children and/or youth with a congenital or acquired disability (n = 8), document format (i.e., protocol or demonstration papers, only an abstract was available) (n = 4), and duplicates (e.g., a study from a dissertation already included in form of a published article) (n = 2). This resulted in 21 included studies for this scoping review, each representing a different AI-based participation assessment approach.
Demographic Characteristics of the Included Samples
We describe the included studies based on their publication date, included sample size, sampled child and/or youth age, gender, congenital or acquired disability, and race and/or ethnicity [Hispanic, non-Hispanic], as well as the family's socio-economic status or income and the parental education level.
The 21 included studies were published between 2007 and 2020, with most of them (n = 13/21; 62%) published after 2016 (33–45). The sample size of the included studies ranged from 2 to 35 children and/or youth, with a mean age up to 20.8 years (see Table 1). Of the 12 studies that reported on child and/or youth gender, 11 studies (92%) included male majority samples (33, 34, 38–41, 45, 46, 49, 50, 53). The vast majority of the included studies focused on children and/or youth with autism spectrum disorder (ASD) (n = 19/21; 91%) (33, 34, 37–53), followed by single instances of studies including children with Down syndrome (5%) (50), children with a visual impairment (5%) (35), and children with cerebral palsy (5%) (36). None of the studies reported on family socio-economic status, family income, or child or youth ethnicity [Hispanic, non-Hispanic]. Only 1 study reported on child or youth race (33) and only 1 study reported on parental education level for one of the caregivers sampled (40).
Table 1. Included studies.
Capturing Participation
We synthesize findings about capturing participation, according to how existing AI-based assessment approaches gathered data, the data source(s) used, and the type(s) of AI used to capture participation.
Of the 21 assessment approaches, 20 (95%) (34–53) used annotated observations of child and youth participation as collected by the re/habilitation professional (n = 8/20; 40%) (34, 35, 39, 40, 43, 45, 52, 53), researcher (n = 5/20; 25%) (35, 36, 40, 46, 47), or other type of professional (e.g., psychologist, expert human rater) (n = 12/20; 60%) (34, 35, 37, 38, 40–42, 44, 48–51) to include in predictive models of participation (see Table 2). More specifically, re/habilitation professionals, researchers or other types of professionals rated the child or youth participation via observation in real-time or on video and then a classification model was trained to predict participation based on that labeled data. None of the included participation assessment approaches included the child or youth perspective (e.g., annotations conducted by the child or youth, self-reported data), and only one included the caregiver perspective (i.e., annotated observations by caregivers) in their predictive model of participation (40). Liu et al. (53) collected youth and caregiver report data (i.e., annotations done by youth and caregiver), in addition to therapist annotations; however, only therapist annotations together with collected physiological indices (e.g., heart sound) were included in the predictive model of participation.
Table 2. Data collection, data source, and type(s) of AI used.
These annotated observations were paired with data collected from facial, skeleton, or eye recognition tools (n = 9/20; 45%) (33, 37, 40–42, 44, 45, 50, 52), sensors (n = 6/20; 30%) (34, 40, 44, 45, 51, 53), EEG (n = 4/20; 20%) (34, 36, 39, 46), via distance estimates (n = 3/20; 15%) (47–49), and/or other tools (n = 6/20; 30%) such as microphones or electrodes (34, 38, 40, 43–45). To capture or predict participation, 18 of the 21 participation assessment approaches used multiple types of AI (86%) (34–50, 52). The vast majority of participation assessment approaches applied ML (n = 20/21; 95%) (34–53), followed by CV (n = 13/21; 62%) (33–35, 37, 41, 42, 44, 45, 47–50, 52), robotics and HCI (n = 9/21; 43%) (36, 37, 40, 43–45, 47–49), VR (n = 4/21; 19%) (34, 39, 46, 52) and NLP (n = 1/21; 5%) (38). ML and NLP were used to classify (i.e., automatically group based on prediction) data into categories of participation (e.g., engagement; non-engagement) (34–53). For example, Krupa et al. (51) paired physiological parameters (i.e., electro dermal activity and heart rate captured via sensors) with annotated observations of child participation to train a machine learning model to predict participation. CV was used to extract facial features (e.g., facial expressions, whether a face is directed toward the screen) to support capturing participation (33–35, 37, 41, 42, 44, 45, 47–50, 52). For instance, Kalantarian et al. (42) used a face tracker algorithm to locate the child's face within a video frame during a game session. These data [i.e., indicator for participation according to (42)] together with annotated observations on child participation were included in a ML model to predict child participation. VR, robotics and HCI were only used in combination with other types of AI (34, 36, 37, 39, 40, 43–49, 52). For example, Khamassi et al. (43) used ML to predict child participation by pairing data on a robot's expressivity with annotations on child participation. Similarly, Fan et al. (39, 46) used VR for driving simulations while participation was captured through paired annotated observations and collected EEG data entered in a predictive ML model.
In contrast to the pairing of annotated observation and recognition tools to collect data on child and youth participation, Ahmed et al. (33) captured participation using solely a threshold for facial action unit intensity, detected by a CV tool. This way of capturing participation was examined with children and youth with ASD completing self-contained academic lessons with tests (33).
Of the 21 included participation assessment approaches, 17 (81%) (34–37, 39, 40, 43–53) were delivered in person and outside the child or youth natural environment (e.g., laboratory) and 4 (19%) (33, 38, 41, 42) were either delivered remotely in the child's natural environment or the authors indicated their intention to deliver the developed assessment approach remotely. The purpose of assessing for child and/or youth participation in most studies was to contribute to building autonomous robots (n = 11/21; 52%) (36, 37, 40, 43–45, 47–50, 53) or systems that automatically adjust for task difficulty level based on the child and/or youth participation level (n = 4/21; 19%) (34, 39, 46, 52).
Operationalizing Participation
We synthesize findings pertaining to how participation was operationalized per the terms used, and what was intended and actually captured.
None of the included assessment approaches used the term participation. Rather, most of them used the term engagement (n = 17/21; 81%) (33–46, 50, 52, 53), followed by social interaction (n = 3/21; 14%) (47–49) and involvement (n = 1/21; 5%) (51). About half of the included studies (n = 10/21; 48%) provided a definition for the term(s) used (33, 35–38, 43, 49, 50, 52, 53). Most assessment approaches examined participation in play activities (n = 8/21; 38%) (36, 38, 42, 47–50, 53), followed by driving (n = 3/21; 14%) (34, 39, 46), social interaction activities (n = 3/21; 14%) (40, 43, 52), academic lessons or mathematical problem solving (n = 2/21; 10%) (33, 35), and watching a movie (n = 1/21; 5%) (41). One study (5%) investigated assessing participation in varied activities (from simple games on smart phone to cycling) (51) and 3 studies (14%) (37, 44, 45) did not specify the activity.
In terms of how participation was intended to be captured, none of the included assessment approaches intended to capture attendance. To assess for involvement, only 1 participation assessment approach (5%) intended to capture both behavioral and emotional involvement (33), and only 1 assessment approach (5%) intended to capture emotional involvement (51) (see Table 3). The remaining 19 participation assessment approaches (91%) did not specify which aspects of involvement they intended to capture (34–50, 52, 53), so we assumed they intended to capture involvement generally.
Table 3. Operationalization of participation.
In terms of actual capturing of child and youth participation, all participation assessment approaches captured behavioral involvement. A total of 13 assessment approaches captured aspects not pertaining to participation (34–36, 38, 39, 43–46, 50–53) according to the used contemporary definition of participation (2, 3, 6–8). More specifically, 3 assessment approaches (14%) captured aspects that pertain to activity competences (i.e., quality of the doing such as quality of facial expression and actions on partner or object while playing or performing a non-specified activity) (38, 44, 45), 2 (10%) captured aspects of the environment and context (e.g., robot expressions) (38, 43), and 12 assessment approaches (57%) captured aspects that are outside of the scope of the fPRC framework (2, 3) and/or behavioral, cognitive, or emotional involvement (6–8) (e.g., heart rate, skin temperature) (34–36, 38, 39, 44–46, 50–53). None of the participation assessment approaches captured attendance, nor emotional or cognitive involvement.
Discussion
Child and youth participation is a multidimensional and complex outcome in pediatric re/habilitation (2, 3, 9, 11, 18). Conceptually sound assessments are critical for shaping the enactment of the therapeutic processes (4, 5, 14, 18) and ensuring consistent interpretation of research findings across studies (5). While child and youth participation is characterized as both attendance and involvement (2, 3) (i.e., behavioral, cognitive, and emotional involvement) (6–8) few non-AI participation-focused assessments actually capture it as such (5). The increased use of AI in pediatric re/habilitation (17) provides an important opportunity for undertaking this scoping review, which examined how the concept of participation has been captured and operationalized in AI-based assessment approaches (4, 5, 14, 18) and identified gaps for future research at the intersection of pediatric re/habilitation and computer science, with potential for relevant extension into related fields [e.g., health informatics (15)].
Lack of Reported Demographics and Sample Representativeness
Samples of included research were mainly skewed toward greater representation of male participants and children and youth with ASD and lacked reporting on family socio-economic status, family income, parental education, and child or youth race and ethnicity [Hispanic, non-Hispanic]. The concern of skewed data (e.g., oversampling of male participants and select diagnoses) as well as the lack of reporting on demographics in the training sets for applications of AI has been raised in prior literature (17, 54). Skewed and missing data in predictive models raise questions about their generalizability to the population and the degree they may reinforce existing inequalities in healthcare settings (54). Therefore, future research on this topic should consistently report on family socio-economic status and child and/or youth race and ethnicity as well as improve sampling strategies to better represent child or youth gender (55) and the range of diagnoses in children who experience unmet participation need (56, 57).
Lack of AI-Based Participation Assessment Approaches Integrating the Child or Youth Perspective
All included AI-based assessment approaches integrated objective (i.e., observable) data to capture participation, with the vast majority using annotated observations. Only one of the 21 included participation assessment approaches integrated proxy-reported (e.g., caregiver-reported) data (40), and none of the included assessment approaches integrated child or youth self-reported data to capture participation. While the dominating focus on objective data is congruent with prior research not involving AI (4, 5, 58, 59), additional challenges for using AI to capture self-reported participation (15) may have amplified this result. Previously reported challenges include the lack of a machine-readable ontology describing components for activity and participation and the lack of annotation standards and data for this type of work (15). The dominating focus on objective data in this review might also be explained by the targeted population (i.e., mainly children and youth with ASD) that might be non-verbal communicators. Alternatively, it might be reflective of the common type(s) of AI employed (i.e., robotics, HCI, and VR) in participation-focused pediatric re/habilitation research (17). Many included participation assessment approaches employing robotics, HCI and VR aimed at integrating real-time participation data through using CV and/or ML (i.e. annotated observations) to simultaneously adapt the robotic behavior or VR task difficulty (34, 39, 43, 45, 47–49, 52).
The importance of the subjective dimension for participation assessment has been identified in prior research involving children and youth with acquired and congenital disabilities and their caregivers (5, 60–62). One way to include self-reported participation data in such applications might be through annotations conducted by children or youth themselves. However, due to interpersonal differences in experiencing and expressing participation (2, 3, 18, 44) generalization of such predictive models might be limited. Alternatively, non-AI participation assessments are often used within pediatric re/habilitation to gather self- or proxy-reported data for individual goal setting. For example, the Participation and Environment Measures (PEM) (63–65) assess for how often a child, youth or young adult participates in home, (pre-)school/daycare/work and community activities, their level of involvement in those activities, the desire for participation to change, applied participation-focused strategies, and the perceived impact of the environment on child, youth or young adult participation. Applications of AI such as recommender algorithms (e.g., constraint satisfaction and optimization) or NLP might provide simplified, more practical and low-cost ways for self- or proxy-reported data collection and interpretation for individual goal setting such as by systematically integrating responses into the individual child or youth participation profile, their participation goal, and intervention planning (12, 16, 66, 67).
Lack of Remotely Administered AI-Based Assessment Approaches Capturing Participation
Few participation assessment approaches were administered remotely and in the natural environment [e.g., a child's home (38, 41)]. This result is surprising, due to the potential for leveraging technology to administer participation assessment approaches remotely and the previously reported importance of the environment in shaping child or youth participation (68–71). However, it aligns with results from a previous scoping review revealing only a few remotely delivered AI-based interventions targeting child or youth participation (17).
This result might be explained by the need for special equipment (e.g., camera equipped rooms) to administer the included AI-based participation-focused assessment approaches and interventions, with children and youth in attendance (17). Measuring participation with children and youth in attendance might also be the reason for the lack of measuring “attendance” in the included participation-focused assessment approaches. Alternatively, AI may be better suited to managing the higher complexity associated with assessing for a child's involvement when compared to their attendance (2, 3, 5). In pediatric re/habilitation, there are few non-AI participation-focused assessments that capture data on involvement which has been discussed as a key limitation (5). This review highlights early attempts to capture involvement through the use of AI, may reveal a unique opportunity for combining existing non-AI participation-focused assessments with new approaches using AI, to more fully assess child and youth participation. Therefore, there is need for further validation of these approaches to capturing involvement through AI (72).
Lack of AI-Based Assessment Approaches Fully Aligned With Contemporary Definitions of Participation
While most included participation assessment approaches intended to capture all three aspects of involvement, none of them actually captured the two non-observable aspects of involvement (i.e., cognitive or emotional involvement). This mismatch between what was intended vs. actually captured might be connected to the lack of subjective data collection in the included participation assessment approaches as previously discussed. Subjective data could complement and/or extend recent efforts to quantify engagement, including behavioral engagement (58, 59).
Assessment approaches included in this scoping review captured aspects of activity competence and environment that were mistakenly labeled as participation or involvement. In addition, this review included a high number of participation assessment approaches that capture aspects that could not be mapped to the fPRC (2, 3). One such example are data on body functions such as kinematics data (50) that neither belong to the participation construct nor to participation-related constructs. One reason for researchers to collect body functions to capture participation might be related to the terms used to describe the types of involvement [i.e., behavioral, cognitive, emotional (6–8)]. In re/habilitation, the terms “behavioral, cognitive and emotional” have often been used in combination with “skills” such as concentration, attention, and asking questions (8), which arguably are body functions or activity competencies (15). Terms that have often been related to body functions or participation-related constructs (5) may misguide researchers and practitioners to focus on such constructs when designing assessments on involvement. Thus, findings of this review may indicate a need for different terms describing types of involvement. One way could be by differentiating between “observable” and “non-observable” aspects of involvement instead of using behavioral, cognitive, and emotional involvement as visualized in Figure 3. According to existing literature, observable involvement can be described as the observed partaking in an activity, for example, through focusing on a task. In contrast, non-observable involvement can be described as the feeling of inclusion, acceptance, and belonging as well as the felt engagement in an activity such as through flow or investment (5, 8, 73, 74).
Figure 3. Participation encompassing observable and non-observable parts of involvement. Informed by the family of Participation-Related Constructs (fPRC) (2, 3) and research on the conceptualization of involvement (2, 3, 6–8, 72, 73).
The distinction between observable and non-observable aspects of involvement may also help to emphasize the importance to include subjective data to fully capture participation, which has been identified as a limitation in existing participation assessments with and without the use of AI (5). Because knowledge on the construct involvement is still emerging (73), future research on child and youth involvement in attended activities is needed for its conceptualization in participation assessments in pediatric re/habilitation.
Limitations
The main limitation of this research is the risk of having missed relevant documents. For example, when AI was not mentioned in the title or abstract, that document was likely excluded from our search and/or when applying our selection criteria. Additionally, we did not evaluate the quality of included studies. However, this is not typically done in scoping reviews due to their purpose of providing a map of existing evidence vs. synthesizing the best available evidence (21).
Conclusions
There is an increasing number of research studies on the use of AI to capture participation involvement, which indicates the promise of AI to capture participation and an opportunity to further investigate the construct of participation, particularly child and youth involvement. Our results show that most of the included assessment approaches captured participation through observation and by applying ML, CV or robotics and HCI. There was a mismatch between what assessment approaches intended to capture and what they actually captured, with a high number of assessments collecting data unrelated to participation, according to contemporary frameworks of child and youth participation (2, 3, 6–8). Our results suggest 4 main gaps that need to be addressed in future research: (1) a lack of research reporting on common demographic factors and including samples representing the population of children and youth with a congenital or acquired disability; (2) lack of AI-based participation assessments integrating the child or youth perspective; (3) lack of remotely administered AI-based assessments capturing both the attendance and involvement dimensions of child and youth participation; and (4) lack of AI-based assessments that fully align with contemporary definitions of child and youth participation.
Data Availability Statement
The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author/s.
Author Contributions
VK mentored by her committee members (MK, NP, DA, and AB), took the lead in conceptualizing the study, and drafting all sections of the manuscript. MV and VK screened articles based on their title and abstract. ZS, JS, and VK screened articles based on full-text reads and extracted data from included articles and VK synthesized them to gain the results of this research. DA and AB provided feedback on the conceptualization of the study and prior versions of this manuscript. MK and NP co-mentored VK through each step of this work including study conceptualization, systematic literature search, study selection process, data analysis, and write-up of this manuscript. All authors provided editing of the manuscript and read and approved the final version.
Funding
This work was conducted in partial fulfillment of the requirements for a Ph.D. in Rehabilitation Sciences and was supported by the University of Illinois at Chicago, through their Dean's Scholar Fellowship (PI: VK) and Chancellor's Undergraduate Research Award (ZS). The contents of this manuscript were developed under a grant from the National Institute on Disability, Independent Living, and Rehabilitation Research (NIDILRR grant number 90SFGE0032-01-00). NIDILRR is a Center within the Administration for Community Living (ACL), Department of Health and Human Services (HHS). The contents of this manuscript do not necessarily represent the policy of NIDILRR, ACL, or HHS, and you should not assume endorsement by the Federal Government.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Acknowledgments
The authors thank Martha Werler at Boston University (BU) and Amelia Brunskill at the University of Illinois at Chicago (UIC) library for guidance on search strategies and Vivian Villegas from the Children's Participation in Environment Research Lab (CPERL) for critical feedback on prior drafts of this manuscript.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fresc.2022.855240/full#supplementary-material
Abbreviations
AI, artificial intelligence; ASD, autism spectrum disorder; EEG, electroencephalogram; fPRC, family of participation-related constructs; HCI, human-agent/computer/robot interaction; ML, machine learning; NLP, natural language processing; PEM, participation and environment measure; VR, virtual reality.
References
1. The World Health Organization. International Classification of Functioning, Disability, Health: Children & Youth Version: ICF-CY. Geneva: World Health Organization (2007).
2. Imms C, Granlund M, Wilson PH, Steenbergen B, Rosenbaum PL, Gordon AM. Participation, both a means and an end: a conceptual analysis of processes and outcomes in childhood disability. Dev Med Child Neurol. (2017) 59:16–25. doi: 10.1111/dmcn.13237
3. Imms C. The nature of participation. In: Imms C, Green D, editors. Participation - Optimising Outcomes in Childhood-Onset Neurodisability. London: MacKeith Press (2020). p. 5–11.
4. Imms C, Adair B, Keen D, Ullenhag A, Rosenbaum P, Granlund M. ‘Participation': a systematic review of language, definitions, and constructs used in intervention research with children with disabilities. Dev Med Child Neurol. (2015) 58:29–38. doi: 10.1111/dmcn.12932
5. Adair B, Ullenhag A, Rosenbaum P, Granlund M, Keen D, Imms C. Measures used to quantify participation in childhood disability and their alignment with the family of participation-related constructs: a systematic review. Dev Med Child Neurol. (2018) 60:1101–16. doi: 10.1111/dmcn.13959
6. King G, Chiarello LA, Thompson L, McLarnon MJW, Smart E, Ziviani J, et al. Development of an observational measure of therapy engagement for pediatric rehabilitation. Disabil Rehabil. (2019) 41:86–97. doi: 10.1080/09638288.2017.1375031
7. King G, Currie M, Petersen P. Child and parent engagement in the mental health intervention process: a motivational framework. Child Adolesc Ment Health. (2014) 19:2–8. doi: 10.1111/camh.12015
8. Fredricks JA, Blumenfeld PC, Paris AH. School engagement: potential of the concept, state of the evidence. Rev Educ Res. (2004) 74:59–109. doi: 10.3102/00346543074001059
9. Eunice Kennedy Shriver National Institute of Child Health Human Development the NIH Medical Rehabilitation Coordinating Committee. National Institutes of Health (NIH) Research Plan on Rehabilitation. (2021). Available online at: https://www.nichd.nih.gov/sites/default/files/2021-11/NIH_Research_Plan_on_Rehabilitation.pdf (accessed January 10, 2022).
10. Bodenheimer T, Sinsky C. From triple to quadruple aim: care of the patient requires care of the provider. Ann Fam Med. (2014) 12:573–6. doi: 10.1370/afm.1713
11. Eunice Kennedy Shriver National Institute of Child Health Human Development the NIH Medical Rehabilitation Coordinating Committee. National Institutes of Health (NIH) Research Plan on Rehabilitation: Moving the Field Forward. (2016). Available online at: https://www.nichd.nih.gov/sites/default/files/publications/pubs/Documents/NIH_ResearchPlan_Rehabilitation.pdf (accessed March 20, 2019).
13. Mccowan AL. Technology in healthcare : how artificial intelligence will revolutionize the profession. Kentucky J Undergrad Scholarsh. (2020) 4:6. Available online at: https://encompass.eku.edu/cgi/viewcontent.cgi?article=1083&context=kjus
14. Fisher AG, Marterella A. Powerful Practice: A Model for Authentic Occupational Therapy. Fort Collins, CO: Three Star Press (2019).
15. Newman-Griffis D, Porcino J, Zirikly A, Thieu T, Camacho Maldonado J, Ho P-S, et al. Broadening horizons: the case for capturing function and the role of health informatics in its use. BMC Public Health. (2019) 19:1–13. doi: 10.1186/s12889-019-7630-3
16. Newman-Griffis D, Camacho Maldonado J, Ho P-S, Sacco M, Jimenez Silva R, Porcino J, et al. Linking free text documentation of functioning and disability to the ICF with natural language processing. Front Rehabil Sci. (2021) 2:1–17. doi: 10.3389/fresc.2021.742702
17. Kaelin VC, Valizadeh M, Salgado Z, Parde N, Khetani MA. Artificial intelligence in rehabilitation targeting participation of children and youth with disabilities: a scoping review. J Med Internet Res. (2021) 23:e25745. doi: 10.2196/25745
18. Coster W, Khetani MA. Measuring participation of children with disabilities: issues and challenges. Disabil Rehabil. (2008) 30:639–48. doi: 10.1080/09638280701400375
19. Resch C, Van Kruijsbergen M, Ketelaar M, Hurks P, Adair B, Imms C, et al. Assessing participation of children with acquired brain injury and cerebral palsy: a systematic review of measurement properties. Dev Med Child Neurol. (2020) 62:434–44. doi: 10.1111/dmcn.14465
20. Munn Z, Peters MDJ, Stern C, Tufanaru C, McArthur A, Aromataris E. Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Med Res Methodol. (2018) 18:143. doi: 10.1186/s12874-018-0611-x
21. Peters MDJ, Godfrey C, McInerney P, Munn Z, Tricco AC, Khalil H. Chapter 11: Scoping reviews. In: Aromataris E, Munn Z, editors. JBI Manual for Evidence Synthesis, JBI. (2020). Available online at: https://reviewersmanual.joannabriggs.org (accessed January 5, 2022).
22. Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, et al. PRISMA Extension for Scoping Reviews (PRISMA-ScR): checklist and Explanation. Ann Intern Med. (2018) 169:467–73. doi: 10.7326/M18-0850
23. Law MC, MacDermid J. Evidence-Based Rehabilitation: A Guide to Practice. 3rd ed. New York, NY: Slack Incorporated (2014).
24. Arksey H, O'Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. (2005) 8:19–32. doi: 10.1080/1364557032000119616
25. Levac D, Colquhoun H, O'Brien KK. Scoping studies: advancing the methodology. Implement Sci. (2010) 5:69. doi: 10.1186/1748-5908-5-69
26. Kaelin VC, Valizadeh M, Salgado Z, Sim JG, Anaby D, Boyd AD, et al. Characterizing Participation in Pediatric Re/Habilitation Research Using Artificial Intelligence: A Scoping Review. (2021). Available online at: https://osf.io/x392z (accessed January 5, 2022).
27. Haddaway NR, Collins AM, Coughlin D, Kirk S. The role of google scholar in evidence reviews and its applicability to grey literature searching. PLoS ONE. (2015) 10:e0138237. doi: 10.1371/journal.pone.0138237
28. United, Nations. Youth. Available online at: https://www.un.org/en/global-issues/youth (accessed May 24, 2020).
29. Adair B, Ullenhag A, Keen D, Granlund M, Imms C. The effect of interventions aimed at improving participation outcomes for children with disabilities: a systematic review. Dev Med Child Neurol. (2015) 57:1093–104. doi: 10.1111/dmcn.12809
30. Arakelyan S, Maciver D, Rush R, O'hare A, Forsyth K. Family factors associated with participation of children with disabilities: a systematic review. Dev Med Child Neurol. (2019) 61:514–22. doi: 10.1111/dmcn.14133
31. Bult MK, Verschuren O, Jongmans MJ, Lindeman E, Ketelaar M. What influences participation in leisure activities of children and youth with physical disabilities? A systematic review. Res Dev Disabil. (2011) 32:1521–9. doi: 10.1016/j.ridd.2011.01.045
32. Law M, Finkelman S, Hurley P, Rosenbaum P, King S, King GA, et al. Participation of children with physical disabilities: relationships with diagnosis, physical function, and demographic variables. Scand J Occup Ther. (2004) 11:156–62. doi: 10.1080/11038120410020755
33. Ahmed AA, Goodwin MS. Automated detection of facial expressions during computer-assisted instruction in individuals on the autism spectrum. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. Denver, CO: Association for Computing Machinery (2017). p. 6050–5.
34. Bian D. Physiology-based Intelligent Systems for Individuals with Autism: Novel platforms for autism intervention and early detection [Dissertation]. Vanderbilt University, Nashville, TN (2019).
35. Volta E, Niewiadomski R, Olugbade T, Gilio C, Cocchi E, Berthouze N, et al. Analysis of cognitive states during bodily exploration of mathematical concepts in visually impaired children. In: Proceeding of the 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII). Cambridge: IEEE (2019). p. 420–6.
36. Fleury M. Engagement detection and emotion recognition algorithms as inputs to a reward function for children with and without clinical motor impairments: a pilot investigation. [Dissertation]. University Colorado, Denver, CO (2020).
37. Rudovic O, Utsumi Y, Lee J, Hernandez J, Ferrer EC, Schuller B, et al. CultureNet: a deep learning approach for engagement intensity estimation from face images of children with autism. In: Proceeding of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). Madrid: IEEE. (2018). p. 339–46.
38. Chorianopoulou A, Tzinis E, Iosif E, Papoulidi A, Papailiou C, Potamianos A. Engagement detection for children with autism spectrum disorder. In: Proceeding of the 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). New Orleans, LA: IEEE (2017). p. 5055–9.
39. Fan J, Wade JW, Key AP, Warren ZE, Sarkar N. EEG-based affect and workload recognition in a virtual driving environment for ASD intervention. IEEE Trans Biomed Eng. (2018) 65:43–51. doi: 10.1109/TBME.2017.2693157
40. Feng Y, Jia Q, Chu M, Wei W. Engagement evaluation for autism intervention by robots based on dynamic bayesian network and expert elicitation. IEEE Access. (2017) 5:19494–504. doi: 10.1109/ACCESS.2017.2754291
41. Hashemi J, Dawson G, Carpenter KLH, Campbell K, Qiu Q, Espinosa S, et al. Computer vision analysis for quantification of autism risk behaviors. IEEE Trans Affect Comput. (2018) 12:215–26. doi: 10.1109/TAFFC.2018.2868196
42. Kalantarian H, Washington P, Schwartz J, Daniels J, Haber N, Wall D. A gamified mobile system for crowdsourcing video for autism research. In: Proceedings - 2018 IEEE International Conference on Healthcare Informatics. New York City, NY: IEEE (2018). p. 350–2.
43. Khamassi M, Chalvatzaki G, Tsitsimis T, Velentzas G, Tzafestas C. A framework for robot learning during child-robot interaction with human engagement as reward signal. In: Proceeding of the 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN). Nanjing: IEEE (2018). p. 461–4.
44. Rudovic O, Zhang M, Schuller B, Picard RW. Multi-modal active learning from human data: a deep reinforcement learning approach. arXiv. (2019). doi: 10.1145/3340555.3353742
45. Rudovic O, Lee J, Dai M, Schuller B, Picard RW. Personalized machine learning for robot perception of affect and engagement in autism therapy. Sci Robot. (2018) 3:eaao6760. doi: 10.1126/scirobotics.aao6760
46. Fan J, Wade JW, Dayi Bian, Key AP, Warren ZE, Mion LC, et al. A Step towards EEG-based brain computer interface for autism intervention. In: Proceeding of the 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). Milan: IEEE (2015). p. 3767–70.
47. Feil-Seifer D, Mataric M. Automated detection and classification of positive vs. negative robot interactions with children with autism using distance-based features. In: Proceedings of the 6th International Conference on Human-Robot Interaction - HRI '11. New York, NY: ACM Press (2011). p. 323–30.
48. Feil-Seifer D, Matarić M. Using proxemics to evaluate human-robot interaction. In: Proceeding of the 5th ACM/IEEE International Conference on Human-Robot Interaction - HRI '10. New York, NY: ACM Press (2010). p. 143.
49. Feil-Seifer D, Mataric M. Distance-based computational models for facilitating robot interaction with children. J Human-Robot Interact. (2012) 1:55–77. doi: 10.5898/JHRI.1.1.Feil-Seifer
50. Ge B, Park HW, Howard AM. Identifying engagement from joint kinematics data for robot therapy prompt interventions for children with autism spectrum disorder. In: Proceeding of the International Conference on Social Robotics. Kansas City, MO: Springer (2016). p. 531–40.
51. Krupa N, Anantharam K, Sanker M, Datta S, Sagar JV. Recognition of emotions in autistic children using physiological signals. Health Technol. (2016) 6:137–47. doi: 10.1007/s12553-016-0129-3
52. Lahiri U, Bekele E, Dohrmann E, Warren Z, Sarkar N. Design of a virtual reality based adaptive response technology for children with autism. IEEE Trans Neural Syst Rehabil Eng. (2013) 21:55–64. doi: 10.1109/TNSRE.2012.2218618
53. Liu C, Conn K, Sarkar N, Stone W. Affect recognition in robot assisted rehabilitation of children with autism spectrum disorder. In: Proceeding of the 2007 IEEE International Conference on Robotics and Automation. Rome: IEEE (2007). p. 1755–60.
54. Ross C. As the FDA Clears a Flood of AI Tools, Missing Data Raise Troubling Questions on Safety Fairness. (2021). Available online at: https://www.statnews.com/2021/02/03/fda-clearances-artificial-intelligence-data/ (accessed November 10, 2021).
55. Charles Lynn Schusterman Family Foundation. More Than Numbers. A Guide Toward Diversity, Equity, and Inclusion (DEI) in Data Collection. (2020). Available online at: https://cloudspn.tfaforms.net/266232 (accessed January 5, 2022).
56. Kaelin VC, Wallace ER, Werler MM, Collett BR, Khetani MA. Community participation in youth with craniofacial microsomia. Disabil Rehabil. (2020) 44:253–60. doi: 10.1080/09638288.2020.1765031
57. Kaelin VC, Wallace ER, Werler MM, Collett BR, Rosenberg J, Khetani MA. Caregiver perspectives on school participation among students with craniofacial microsomia. Am J Occup Ther. (2021) 75:7502205100p1. doi: 10.5014/ajot.2021.041277
58. Delfing D, Hentrich L, Chin K, Friel K, Imms C, Santamaria V, et al. The role of engagement in upper extremity interventions for children with unilateral spastic cerebral palsy. 75h Annual Meeting of the American Academy for Cerebral Palsy and Developmental Medicine (AACPDM) [Conference Presentation], Virtual Conference. (2021). Available online at: https://www.aacpdm.org/events/2021
59. Delfing D, Hentrich L, Chin K, Friel K, Imms C, Santamaria V, et al. Quantifying engagement in a pediatric rehabilitation setting. 75h Annual Meeting of the American Academy for Cerebral Palsy and Developmental Medicine (AACPDM) [Conference Presentation], Virtual Conference. (2021). Available online at: https://www.aacpdm.org/events/2021
60. Bedell GM, Khetani MA, Cousins MA, Coster WJ, Law MC. Parent perspectives to inform development of measures of children's participation and environment. Arch Phys Med Rehabil. (2011) 92:765–73. doi: 10.1016/j.apmr.2010.12.029
61. Khetani MA, Cohn ES, Orsmond GI, Law MC, Coster WJ. Parent perspectives of participation in home and community activities when receiving Part C early intervention services. Topics Early Child Spec Educ. (2013) 32:234–45. doi: 10.1177/0271121411418004
62. Gantschnig BE, Hemmingsson H, La Cour K. Feeling and being involved? Participation experienced by children with disabilities at regular schools in Austria. J Occup Ther Sch Early Interv. (2011) 4:260–75. doi: 10.1080/19411243.2011.633424
63. Coster W, Law MC, Bedell GM. PEM-CY - Participation and Environment Measure - Children and Youth. Boston, MA: Boston University (2021).
64. Khetani MA, Coster W, Law MC, Bedell GM. Young Children's Participation and Environment Measure. Fort Collins, CO: Colorado State University (copyright to authors) (2013).
65. Shahin S, DiRezze B, Ahmed S, Anaby D. Development and content validity of the Youth and Young-adult Participation and Environment Measure (Y-PEM). Disabil Rehabil. (2022) 1:1–13. doi: 10.1080/09638288.2022.2030809
66. Newman-Griffis D, Fosler-Lussier E. Automated coding of under-studied medical concept domains: linking physical activity reports to the International Classification of Functioning, Disability, and Health. Front Digit Heal. (2021) 3:1–19. doi: 10.3389/fdgth.2021.620828
67. Thieu T, Maldonado JC, Ho P-S, Ding M, Marr A, Brandt D, et al. A comprehensive study of mobility functioning information in clinical notes: entity hierarchy, corpus annotation, and sequence labeling. Int J Med Inform. (2021) 147:104351. doi: 10.1016/j.ijmedinf.2020.104351
68. Di Marino E, Tremblay S, Khetani MA, Anaby D. The effect of child, family and environmental factors on the participation of young children with disabilities. Disabil Health J. (2018) 11:36–42. doi: 10.1016/j.dhjo.2017.05.005
69. Anaby D, Law M, Coster W, Bedell G, Khetani MA, Avery L, et al. The mediating role of the environment in explaining participation of children and youth with and without disabilities across home, school, and community. Arch Phys Med Rehabil. (2014) 95:908–17. doi: 10.1016/j.apmr.2014.01.005
70. Anaby D, Hand C, Bradley L, Direzze B, Forhan M, Digiacomo A, et al. The effect of the environment on participation of children and youth with disabilities: a scoping review. Disabil Rehabil. (2013) 35:1589–98. doi: 10.3109/09638288.2012.748840
71. Anaby DR, Law M, Feldman D, Majnemer A, Avery L. The effectiveness of the Pathways and Resources for Engagement and Participation (PREP) intervention: improving participation of adolescents with physical disabilities. Dev Med Child Neurol. (2018) 60:513–9. doi: 10.1111/dmcn.13682
72. Haberfehlner H, Goudriaan M, Bonouvrié LA, Jansma EP, Harlaar J, Vermeulen RJ, et al. Instrumented assessment of motor function in dyskinetic cerebral palsy: a literature review. Gait Posture. (2019) 73:439–40. doi: 10.1016/j.gaitpost.2019.07.169
73. Imms C, Green D. Participation. Optimising Outcomes in Childhood-Onset Neurodisability. London: MacKeith Press (2020).
Keywords: involvement, engagement, assessment, measurement, natural language processing, machine learning, computer vision, technology
Citation: Kaelin VC, Valizadeh M, Salgado Z, Sim JG, Anaby D, Boyd AD, Parde N and Khetani MA (2022) Capturing and Operationalizing Participation in Pediatric Re/Habilitation Research Using Artificial Intelligence: A Scoping Review. Front. Rehabilit. Sci. 3:855240. doi: 10.3389/fresc.2022.855240
Received: 14 January 2022; Accepted: 11 March 2022;
Published: 14 April 2022.
Edited by:
Denis Newman-Griffis, University of Pittsburgh, United StatesReviewed by:
Supawadee Putthinoi, Chiang Mai University, ThailandElizabeth Rasch, National Institutes of Health (NIH), United States
Copyright © 2022 Kaelin, Valizadeh, Salgado, Sim, Anaby, Boyd, Parde and Khetani. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Mary A. Khetani, bWtoZXRhbmkmI3gwMDA0MDt1aWMuZWR1; Natalie Parde, cGFyZGUmI3gwMDA0MDt1aWMuZWR1
†These authors have contributed equally to this work and share senior authorship