Principal Components Analysis Using Data Collected From Healthy Individuals on Two Robotic Assessment Platforms Yields Similar Behavioral Patterns

Background: Kinarm Standard Tests (KSTs) is a suite of upper limb tasks to assess sensory, motor, and cognitive functions, which produces granular performance data that reflect spatial and temporal aspects of behavior (>100 variables per individual). We have previously used principal component analysis (PCA) to reduce the dimensionality of multivariate data using the Kinarm End-Point Lab (EP). Here, we performed PCA using data from the Kinarm Exoskeleton Lab (EXO), and determined agreement of PCA results across EP and EXO platforms in healthy participants. We additionally examined whether further dimensionality reduction was possible by using PCA across behavioral tasks.

Methods: Healthy participants were assessed using the Kinarm EXO (N = 469) and EP (N = 170–200). Four behavioral tasks (six assessments in total) were performed that quantified arm sensory and motor function, including position sense [Arm Position Matching (APM)] and three motor tasks [Visually Guided Reaching (VGR), Object Hit (OH), and Object Hit and Avoid (OHA)]. The number of components to include per task was determined from scree plots and parallel analysis, and rotation type (orthogonal vs. oblique) was decided on a per-task basis. To assess agreement, we compared principal components (PCs) across platforms using distance correlation. We additionally considered inter-task interactions in EXO data by performing PCA across all six behavioral assessments.

Results: By applying PCA on a per task basis to data collected using the EXO, the number of behavioral parameters were substantially reduced by 58–75% while accounting for 76–87% of the variance. These results compared well to the EP analysis, and we found good-to-excellent agreement values (0.75–0.99) between PCs from the EXO and those from the EP. Finally, we were able to reduce the dimensionality of the EXO data across tasks down to 16 components out of a total of 76 behavioral parameters, which represents a reduction of 79% while accounting for 73% of the total variance.

Conclusion: PCA of Kinarm robotic assessment appears to capture similar relationships between kinematic features in healthy individuals and is agnostic to the robotic platform used for collection. Further work is needed to investigate the use of PCA-based data reduction for the characterization of neurological deficits in clinical populations.

Introduction

Robotic assessment tools can capture granular and high-dimensional kinematic information from the upper limbs that would be very difficult to measure with a human observer, thus potentially facilitating both assessment and rehabilitation (Wu et al., 2013; Colombo et al., 2014; Pila et al., 2017; Veerbeek et al., 2017). Kinarm is one such device, and provides objective parameters of motor, sensory, and cognitive function using the participants’ arms. It has been validated across multiple patient groups (Coderre et al., 2010; Dukelow et al., 2010, 2012; Debert et al., 2012; Simmatis et al., 2017; Gaprielian et al., 2019). Kinarm Standard Tests^TM (KSTs) consist of several behavioral tasks that include automated data analysis routines, and which generate up to 20 performance items per task that describe spatial and temporal aspects of performance. However, the breadth of behavioral tasks results in complex datasets being produced (>100 parameters per participant), which may impede meaningful interpretation of data – particularly for those unfamiliar with the meaning or neuroscientific importance of each metric. Therefore, this technology may benefit from the application of data reduction techniques.

Principal component analysis (PCA) is a statistical procedure that is commonly used for dimensionality reduction, which preserves the maximal amount of variance in a given dataset (Pearson, 1901; Hotelling, 1933; Ringnér, 2008). The first principal component (PC) is a linear combination of variables that accounts for the largest amount of variance, followed by the second and so forth (Jolliffe and Cadima, 2016). Our previous study examined PCA for healthy participant’s data. We found that data from the Kinarm End-Point Lab (EP) could be substantially reduced while accounting for a large amount of variance, and that many PCs were comprised of task parameters with high loadings and minimal cross loadings (i.e., items that loaded substantially across multiple components) (Wood et al., 2018).

Kinarm Standard Tests can also be completed on a second robotic platform called the Kinarm EXO¹. The EXO robots are attached to the arm using troughs and the entire arm is constrained to move in the horizontal plane. In contrast, the EP robots are grasped in each hand permitting horizontal movements of the manipulanda, but with the plane of the arm being largely vertical (i.e., elbows pointing down with the wrist halfway between pronation and supination). These differences in arm geometry could potentially influence motor strategies and the structure of motor performance, even for similar behavioral goals (Beer et al., 2004). As such, it is important to validate results from reduction techniques performed on data from these different Kinarm platforms to ensure that they can produce findings in a manner that is agnostic to the technology used to collect movement data.

Previous studies have explored the use of PCA or exploratory factor analysis with other robotic platforms (Gilliaux et al., 2014; Longhi et al., 2016; Panarese et al., 2016) and others have employed PCA as a dimensionality reduction tool for analyzing motor synergies (Ozturk et al., 2016; Wang et al., 2020). However, some studies reporting PCA of behavioral data have relied on small sample sizes (typically N < 50) that could limit generalizability to other samples of participants. Other previous work has explored the use of non-variance-based dimensionality reduction measures to create aggregate representations of Kinarm data (Kenzie et al., 2017); however, this has the limitation of being difficult to relate back to the underlying variables that contribute to the summary statistic that is produced. Our central objective was to replicate PCA across robotic platforms to understand how similar the groupings of kinematic features are across data collection systems with varying arm geometries. We did this by quantifying the agreement between PCA results derived from the EP [published previously (Wood et al., 2018)] and the current Kinarm EXO analysis. Further, the large size of the EXO dataset permitted an examination of whether further data reduction was feasible across behavioral tasks. As such, comparable data reduction results across platforms, and tasks, would suggest similar strategies or features of motor execution that are common across behaviors.

Materials and Methods

Participant Recruitment

Healthy participants were community-based and were recruited via advertisements on lab and departmental websites, in local classifieds (online and print), and by word-of-mouth. Trained research staff screened each adult participant (≥18 years old) to ensure that task instructions could be easily understood, and that participants had no prior neurological deficits or medical conditions that could affect upper limb function. Once enrolled, participants were then assessed by our research staff at one of four sites in Canada, which included three sites in Kingston, ON (Providence Care Hospital, St. Mary’s of The Lake Hospital, and Kingston General Hospital) and one in Calgary, AB (Foothills Medical Centre). Participants’ handedness was determined using the Modified Edinburgh Handedness Inventory (Oldfield, 1971). The Queen’s University and Affiliated Hospitals Health Sciences Research Ethics Board and The University of Calgary Conjoint Health Research Ethics Board approved participants’ recruitment and assessment. Informed consent was obtained from each participant prior to the Kinarm assessment. Participants were recruited separately for studies conducted using the EP and EXO platforms. Note that the EP platform is newer and therefore the number of participants who completed each of the tasks presented here is lower and more variable across tasks than with the EXO.

Robotic Assessment

Participants were either seated in a height-adjustable chair that was locked in place in front of the EP robotic system (Figure 1A) or were seated in the height-adjustable wheelchair seat when using the EXO robotic system (Figure 1B; Kinarm, Kingston, ON, Canada). For the former, participants were instructed to grasp the EP robotic handles with each hand, permitting free movement of the hands in the horizontal plane with the arm itself in the vertical plane (i.e., elbow largely pointing downward). For the latter, the EXO seat height was adjusted for each participant to achieve shoulder abduction (∼85°) to provide comfort and anti-gravity support of the upper arm and forearm/hand. Thus, movements in the workspace maintained the hand, elbow, and shoulder in the horizontal plane. Participants were seated in the EP or EXO in front of a virtual reality system that displayed each task in the horizontal workspace, and vision of the participant’s arms and hands were occluded with a physical barrier. The participant’s head was positioned in the front center of the display case and visual feedback of actual hand position (when provided) was typically represented on the screen by a white circle (radius = 0.5 cm) in the middle of the handle grasped by the participant (EP) or over their index fingertip (EXO). A trained operator provided instructions from a standardized script prior to starting each task.

FIGURE 1

Figure 1. (A) Kinarm End-Point Lab with graspable robots and virtual reality system aligned with the horizontal workspace. (B) Kinarm Exoskeleton Lab with adjustable robots attached to the arms maintaining arm motion in the horizontal plane and a similar virtual reality system.

The Arm Position Matching (APM) (Dukelow et al., 2010; Mochizuki et al., 2019) task assessed upper-limb position sense (an element of proprioception), whereas the other three tasks broadly assessed upper-limb motor behavior: Visually Guided Reaching (VGR) (Coderre et al., 2010), Object Hit (OH) (Tyryshkin et al., 2014), and Object Hit and Avoid (OHA) (Bourke et al., 2016). Detailed descriptions of all tasks have been reported previously (Coderre et al., 2010; Dukelow et al., 2010; Tyryshkin et al., 2013; Bourke et al., 2016; Wood et al., 2018), but are summarized in Table 1 for reference. Task parameter descriptions can be obtained from Kinarm (see text footnote 1). Within each task, 9–20 performance parameters were produced (parameters analyzed were the same across both robotic platforms), and completing all 4 tasks took < half an hour on a given robotic platform. Note that, in this study, VGR and APM data were analyzed from each of the dominant- and non-dominant arms separately, and so we report 6 total behavioral assessments (i.e., OH, OHA, two separate scores for VGR, and two separate scores for APM, totaling 6). To prevent potential handedness confounds, mixed handedness participants (n = 2) were removed from the analysis, and we used performance parameters from both the dominant and non-dominant limbs for two of the tasks (i.e., VGR and APM).

TABLE 1

Table 1. Kinarm behavioral battery task descriptions.

Automated data collection and analysis software was used to measure arm movements and quantify task performance. Task parameter values for the healthy cohort (also reported in this study) were standardized (mean subtracted and divided by the standard deviation), and then used to create a Box-Cox transform (Box and Cox, 1964), which converted the distribution of standardized scores into a standard Normal distribution (i.e., mean = 0, standard deviation = 1, distribution symmetric). Regression models were used to adjust scores for the influence of age, sex, handedness, and robotic platform. Robotic platform was included as a covariate because data from each platform are on the same scale within each task, but note that behavioral patterns across tasks may vary. These equations were implemented in the software used to run the Kinarm tasks (Dexterit-E version 3.7; see text footnote 1) and generated Z-scores for measures of performance for each healthy individual. This process has been described in greater detail previously (BKIN Technologies, 2019; Simmatis et al., 2020a).

Principal Component Analysis

Principal component analysis was conducted in R version 3.4.1 (R Core Team, 2017) using psych package version 1.8.12 (Revelle, 2019). Kinarm performance items were converted to Z-scores (Simmatis et al., 2020a) prior to PCA, with parallel analysis being used to determine the optimal number of components. Eigenvalues (i.e., proxies of relative variance explained by each component) were plotted in descending order to generate a scree plot (Cattell, 1966; Sakaluk and Short, 2017). Parallel analysis was used to generate a random data set that possessed the same dimensionality (i.e., number of columns and sample size) as the observed data. The 95th percentile (i.e., 1.645 standard deviations above the mean) of eigenvalues calculated from the randomized data was graphed over the scree plot of the observed data. The components retained from the observed data were those with larger eigenvalues than the corresponding random dataset (Horn, 1965; Cattell, 1966; O’connor, 2000; Sakaluk and Short, 2017). Parallel analysis was chosen as the method to retain components as the scree plot is only useful as an adjunct due to variability in accuracy, whereas parallel analysis has been shown to be highly robust to variation in data size/structure (Zwick and Velicer, 1986). See Supplementary Figure 1 for the scree plots and respective parallel analysis across tasks. Rotation was then implemented to help yield the most interpretable solution. An oblique rotation (oblimin) was first conducted (Jennrich and Sampson, 1966), which allows for correlated components. If all inter-component correlations were < | 0.30|, then an orthogonal rotation (varimax) (Kaiser, 1958) was implemented. Taking the current sample size into account, and using a two-tailed α of 0.01, we considered a component loading to be substantial if the loading was ≥ | 0.40| (Stevens, 2009). Note that for n = 300 a loading of 0.298 (2^∗0.149) is considered substantial, we used ≥ |0.40| to keep in line with our previous work (Wood et al., 2018) and to remain stringent in identifying substantial loadings. Additionally, an item was considered to cross-load if the loading was ≥ | 0.30| on two or more components (Costello and Osborne, 2005). To further characterize performance, components and their respective parameters that loaded highly were used to generate intuitive labels. For complete details of the EP PCA, see our previously published findings (Wood et al., 2018). Although we considered all {1…k; k ≥ n} – component models, we describe in detail only the optimal n-component solution for the sake of brevity.

We retained the restricted analysis of right-handed individuals only from our previous work (Wood et al., 2018). We allowed individuals with left-hand dominance to be analyzed in the present study to maintain maximum comparability to our previous work and also ensure that we further expanded upon this previous limitation to now include both left- and right-handed participants. Importantly, the participants analyzed in the previous study had completed tasks with their non-dominant arms, but we chose to exclude these data for simplicity of interpretation of our results; our primary objective was the implementation of the PCA technique on granular robotic data. Furthermore, in the present work, we sought to expand the application of our technique to include non-dominant arm information.

Determining PCA Agreement Across Platforms

We compared patterns of PC loadings after PC rotation by using the distance correlation metric (Székely et al., 2007). Briefly, the distance correlation is a tool for generalized correlation between series of data that are not necessarily linearly related. It calculates a Euclidean distance measure between two series of data (i.e., one set of PCs derived from each robot type) to determine how “close” they are in absolute terms without requiring specific data distributions (e.g., we would not expect PC values to be Normally distributed). Thus, we applied this technique to each pair of PC loadings to identify their similarity regardless of being in the same feature space due to rotation. Distance correlation is bounded between 0 and 1, with 0 indicating no agreement, and 1 indicating perfect agreement (Székely et al., 2007). We refer the interested reader to (Székely et al., 2007) for the in-depth calculation of the distance correlation and more detailed notes on its interpretation. Distance correlations and associated p-values (derived using a permutation method built into the software) were calculated using the Pingouin 0.3.8 package implemented in Python 3.7.1. Given the number of correlations performed (n = 61), we set the significant α value for correlations at 0.05/61 ≈ 8.19e-4 (i.e., we used the Bonferroni correction to control for the family-wise error rate).

Results

Data Reduction Related to the EXO

Table 2 provides a brief summary of demographics for each cohort. Of all participants assessed using the EXO (N = 469), 211 (45%) were male, mean age was 46.4 (range: 18–93 years), and 418 (89%) were right-handed. Figure 2 displays the PC loadings for parameters of each task completed using the Kinarm EXO and EP platforms. The number of performance parameters per task (range 9–20) was substantially reduced (range 58–75%) by discovering groups of related parameters that gathered into 3–5 components, which explained a large amount of overall variance (range 76–87%) in each task. Although the ordering/variance accounted for by the PC varied across robotic platforms, the EXO PCs were comprised of several of the task parameters that loaded highly onto PCs derived from the EP data (i.e., consistent across platforms). For example, in APM (dominant arm), similar parameters that described EP variability (contraction/expansion ratio) had high loadings on the first component (all loadings >0.8) but several parameters loaded highly onto PC2 on the EP. Another example can be observed in OH, in which parameters related to either left- or right-hand speed, had moderate-to-high loadings on the first component (all >0.6). For complete details regarding the proportion of variance accounted for, data reduction, and component loadings, see Supplementary Tables 1, 2. The interpretation of the PCs derived from the EXO dataset was often similar to that for PCs from the EP dataset, and we have provided a summary of the interpretations of the top two PCs from each task across both platforms in Table 3.

TABLE 2

Table 2. Participant demographics and task characteristics.

TABLE 3

Table 3. Top two PCs from each task and their interpretations.

FIGURE 2

Figure 2. Heatmaps depicting substantial (>| 0.40|) loadings in the EXO and EP tasks. Results are summarized only for VGR and APM in the dominant arm, for comparison across robotic platforms (EP data do not include non-dominant arm analyses). Left column: EXO loadings. Right column: EP loadings. Both columns: highly positive loadings are indicated by red hues and highly negative loadings are indicated by blue hues. Loadings less than | 0.40| are white. “-D” signifies dominant arm.

Agreement Between EXO and EP PCs

For the End-Point robot, N = 80/200 to 86/190 (40–46%) of participants were male, mean age was 42.5 (range 18–88) to 46.3 (range 18–87), and all participants for each task were right-handed. Note that this group included only right-handed individuals (Wood et al., 2018). We quantified agreement between EP and EXO robot PCs using the distance correlation, which were generally substantial (>0.50) (Figure 3). For tasks in which there were the same numbers of PCs across both analyses (i.e., VGR and OHA), each PC from the EXO robot had a clear correspondent in the EP data. For example, PC1 of VGR (EXO) had a distance correlation of 0.96 (p < 1e-4) with PC2 of VGR (EP), which is intuitive as PC2 of VGR (EP) was comprised of 6/8 of the task parameters that loaded highly onto PC1 of VGR (EXO). This PC agreement across platforms was most evident for the OHA task, where distance correlations across all five PCs were high (≥ 0.97; all p-values < 8.19e-4). However, other situations arose where there were differing numbers of components across platforms (i.e., APM and OH). Specifically, both OH and APM-D were represented by three PCs for the EP, but by more for the EXO (4 and 5, respectively). In these cases, high correlations (>0.80; all p < 8.19e-4) were still observed between the three PCs for the EP and one of the top three PCs for the EXO. Finally, we observed a case in VGR-D where a correlation was substantial (0.88) but not statistically significant (0.05 > p > 8.19e-4) between EP PC1 and EXO PC2.

FIGURE 3

Figure 3. Distance correlations for each of the tasks in which comparison was possible between EXO and EP robots. Correlation values are colored darkening shades of blue if they are statistically significant after correcting for multiple comparisons (p < 8.19e-4), (i.e., lighter hues indicate lower correlation values). PC = “principal component”, “-D” = “dominant arm.” *Indicates correlations that were > 0.80 but had p-values < 0.05 but > 8.19e-4 (i.e., not statistically significant after multiple comparisons).

Principal Component Analysis Across All Four Kinarm Tasks

Our final analysis examined if greater dimension reduction was possible if all the parameters across all behavioral tasks were considered simultaneously. According to the scree plot and parallel analysis, 16 models warranted further examination. For 2- through 16-component solutions, we kept the orthogonal rotation because the inter-component correlations ranged from −0.18 to 0.29. For the 16-component solution, all items had substantial loadings (>| 0.40|). See Figure 4 for a visual representation of the component loadings across tasks and respective items. When pooled together across all six tasks, PCA reduced this large data set from 76 parameters to 16 components, reducing the overall data by 79% while still retaining 73% of the variance. The across-task PCA identified fewer components than PCA on the individual tasks (16 PCs compared to a total of 24 PCs across individual tasks). Interestingly, each task generally remained separate on its own PC. Notably, both VGR and APM tasks commonly shared PCs across dominant and non-dominant arms. For example, PC2 was dominated by VGR across both arms. APM across both arms had several parameters that loaded onto PC4. As well, OH and OHA tasks also shared PCs (i.e., PC1 and PC3). In contrast, PCs never included OH or OHA parameters with VGR or APM parameters, and no PCs included VGR and APM parameters.

FIGURE 4

Figure 4. A visual representation of significant loadings (>| 0.40|) from the principal component analysis across four Kinarm tasks with all parameters included for healthy individuals. The color gradient represents the strength of the component loadings, with the darker shade representing higher loadings. Orange represents positive loadings with blue representing negative loadings. The gray lines visually separate tasks and the respective limb assessed. APM = Arm Position Matching; VGR = Visually Guided Reaching; RVGR = Reverse Visually Guided Reaching; OH = Object Hit; OHA = Object Hit and Avoid; D = dominant limb; ND = non-dominant limb.

Discussion

We performed PCA on Kinarm EXO data, similarly to our previous work with the Kinarm EP, to quantify the extent of agreement between the results of PCA on data collected from both platforms. We then performed PCA across multiple tasks on EXO data to investigate inter-task interactions between parameters. We identified that PCA of EXO data produced interpretable results that were subjectively comparable to our previous analysis. The strengths of the associations between results from both platforms suggest that participants performed behavioral tasks similarly with both the EP and the EXO systems with minimal, albeit informative, deviation of task parameter loadings across PCs and platforms. Finally, PCA across all tasks highlighted further dimensionality reduction beyond that observed in individual-task PCAs, reflecting interactions across tasks with similar characteristics. These results have interesting implications for the ability of different robotic platforms to quantify motor function, and for the use of robotic platforms to characterize motor impairments that may arise from neurological disease.

We identified that PCA of Kinarm EXO and EP data captured relationships between variables that were interpretable, and that differences across platforms could be emphasized using these findings. As an illustrative example of interpretability, consider the first component derived from VGR (dominant arm). Loadings on this component indicated that as total movement time decreased, maximum speed increased, as did the path length ratio (ratio of actual distance the hand traveled relative to the straight-line distance between start and end points). Intuitively, this group of variables would appear to be related as time and speed should be inversely related and longer trajectories generating a larger path length ratio should tend to require more time to complete the movement. Interpretability also extends to across-platform comparisons. Consider PC1 of OHA from the EXO, and PC2 of OHA from the EP (Figure 2), in which loaded parameters were largely the same except for “movement area” for both the right and left hand, which were uniquely observed with PC1 of the EXO. The covariation of these parameters with overall metrics of performance such as “total objects hit” suggests that, in the EXO platform, there was a stronger relationship between workspace utilization and overall task performance than there was with the EP. This difference likely reflects the fact that movement is less encumbered when using the EP as compared to the EXO robotic systems.

Our results illustrate that PCA on data gathered from the EP agreed very well with the PCA on data derived from the EXO versions of Kinarm robotic platforms; this demonstrates that some fundamental constructs of motor behavior were captured using both platforms. Similarity across platforms is most evident in VGR-D, where a three PC structure was chosen for both platforms; each component is largely comprised of the same task parameters and only their order differs, which is not surprising given that PC loadings are sample dependent and negligible differences will frequently be observed. Similarity in the parameters captured in a given PC also extends previous findings that arm movements can be performed similarly whether the elbow is free, or whether the entire arm is constrained to the horizontal plane while moving (Beer et al., 2004). The example of VGR-D has interesting implications from a motor control perspective. The three PCs that were found to describe VGR-D, for both platforms, had relevant groupings that correspond to features of motor behavior. PC1 from the EXO data describes initial movements, as does PC2 from EP data (see also Table 3). Interestingly, the parameters that loaded onto this component correspond to the early feedforward component of reaching (Coderre et al., 2010). This is in contrast to PC2 of EXO data and PC1 of EP data, which included parameters related to feedback control (Coderre et al., 2010). Although separating feedforward and feedback processes may not necessarily be correct (Todorov and Jordan, 2002; Crevecoeur and Kurtzer, 2018), there is a convenience in delineating early- and later epochs of movement. Further, the present results highlight that the strategies implemented by individuals tends to lead to distinct patterns in performance related to movement initiation and online corrections.

It is interesting to note the across-task PCA of EXO data demonstrated interactions within classes of tasks (i.e., reaching, hitting, and matching), but limited interactions between different classes of tasks. PCs spanned VGR across arms and APM across both arms, and OH and OHA, suggesting common strategies. In contrast, there was little shared information between the three classes of tasks. For example, speed in VGR and speed in OH/OHA did not group together. This separation in performance between motor tasks is consistent with previous work highlighting relatively low correlations in performance across different skills or tasks. For example, Drowatzky and Zuccato (1967) examined the performance of individuals for various static and dynamic postural tasks and found correlations were quite low (range from −0.19 to 0.31). As well, previous work demonstrated poor intra-individual correlations between movement speed and accuracy across unimanual- and bimanual upper-limb tasks when both hands have to reach to two targets simultaneously (Mickevičienė et al., 2015), although this may be different when there is a common goal for both hands (Tresilian and Stelmach, 1997). These findings suggest a goal-dependency of the separability of intra-individual unimanual and bimanual performance, which would additionally align with the differences in task objective between VGR and OH/OHA in the present study. As with the case for within-task PC loadings, across-task PC loading patterns have interesting implications from the perspective of the neural correlates of motor behavior. Uni- and bi-manual tasks are executed by the similar brain structures, but it is not the case that a bimanual movement is simply two yoked unimanual movements. For example, Grefkes (Grefkes et al., 2008) demonstrated that stroke can disrupt interhemispheric communication between supplementary motor area (SMA) and primary motor cortex (M1), which affected bimanual movements in a unique way compared to unimanual movements. Bimanual tasks recruit a distributed network of brain areas involved in movement control, including the bilateral dorsal premotor cortices and bilateral parietal association areas (Szameitat et al., 2012). Potentially, the PCs that we found for bimanual object-hitting tasks could provide insight into the functionality of these distributed networks. However, this is beyond the scope of our current analysis.

Our results suggest that it might be suitable to use Kinarm platforms interchangeably for clinical research, particularly that involving high-dimensional data analysis techniques. Using the example of VGR, it is clear that PC1 of the EXO and PC2 of the EP capture nearly an identical behavioral pattern. Platform interchangeability could potentially be important, for example, in individuals with multiple sclerosis (MS). People with MS can have wide-ranging levels of upper limb impairments (Simmatis et al., 2020b) and, as such, they may require the use of one machine or another, depending on their status. For less-affected individuals, it would be ideal to use an EP-style device to minimize setup time and mitigate fatigue-related effects induced by a long assessment. Conversely, in more-affected individuals who suffer from weakness or who readily experience motor fatigue, an EXO-style device could be used to provide upper-limb anti-gravity support. Importantly, the Z-scores derived from the Kinarm assessments are adjusted for age, sex, handedness, and robotic platform, and so it is valid to compare individual Z-scores regardless of platform. However, when considering analyses that might use high-dimensional behavioral data, such as multivariate statistics or machine learning to detect behavioral patterns, it will be important to consider the covariation of multiple parameters. In the example of VGR, because the individual parameters covary similarly across platforms (e.g., EXO PC1 and EP PC2), it would likely be suitable to put both EXO and EP data into one common analysis. Some tasks’ PCs displayed minor changes in loading magnitude (e.g., OHA EXO PC1 and OHA EP PC2 have similar but non-identical loading patterns), but likely not to the extent that it would confound multivariate analysis.

Our study has some limitations to address. First, our original assessment using EP data was restricted to right-handed individuals, and the non-dominant arm was not considered in analysis. Despite this, we identified very high levels of agreement between the tasks that we included previously and those analyzed here, and high agreement was consistent across tasks. Thus, it seems likely that assessments in the non-dominant limb, or in left-handed individuals, would yield comparable results to those observed here. Note also that our data analysis procedure adjusted for handedness in calculating normalized Z-scores. Given that we performed these assessments on healthy individuals, it remains to be seen how well these results generalize to individuals with neurological impairments and if PCA facilitates separation of healthy individuals and those with neurological deficits, such as stroke. It is possible that stroke perturbs normal motor synergies and therefore could disrupt the way that our kinematic parameters group together, which would be favorable if used as a preprocessing step for supervised classification. These problems need to be considered in future studies. Furthermore, there were differences in the number of participants in the study across both platforms, which may have contributed small differences in PC loadings or orderings.

Conclusion

We identified that PCA of data from the Kinarm EXO was able to intuitively describe sensorimotor task performance, in line with our previous work using the Kinarm EP. We additionally identified across-task or across-limb associations of parameters that potentially highlight higher-level patterns of sensorimotor behavior in healthy individuals. Finally, we can quantitatively state that behavioral constructs uncovered using PCA on EP- and EXO robots were conserved across platforms. Future work should investigate the use of our PCA-based approach to improve the classification of clinical populations and assist with the characterization of neurological deficits.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics Statement

The studies involving human participants were reviewed and approved by the Queen’s University and Affiliated Hospitals Health Sciences Research Ethics Board University of Calgary’s Conjoint Health Research Ethics Board. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

MW, LS, and JJ participated in the statistical plan, data analysis, and drafting of the manuscript. SD participated in the study design, collection of the data, and drafting of the manuscript. JB participated in the study design and drafting of the manuscript. SS is the primary investigator and participated in the study design and drafting of the manuscript. All authors contributed to the article and approved the submitted version.

Funding

This work was supported by an Ontario Research Foundation – Research Excellence grant and a GSK Chair in Neuroscience to SS, and a CIHR operating grant (MOP 106662) and Heart and Stroke Foundation of Canada Grant-in-Aid (G-13-0003029) to SD. The funding agencies had no role in the design of this study and they did not have any role in data collection or analysis.

Conflict of Interest

JB receives a stipend from the Trillium Gift of Life Network to support his role as the Hospital Donation Support Physician. SS is cofounder and CSO of Kinarm, the manufacturer of the robotic device used in the present study

The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

The authors would like to thank Kim Moore, Simone Appaqaq, Megan Metzler, Janice Yajure, and Mark Piitz for assessing the participants, as well as Helen Bretzke and Justin Peterson for their contribution to software implementation and database management.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fnhum.2021.652201/full#supplementary-material

Footnotes

1. ^ www.kinarm.com

References

Beer, R. F., Dewald, J. P. A., Dawson, M. L., and Rymer, W. Z. (2004). Target-dependent differences between free and constrained arm movements in chronic hemiparesis. Exp. Brain Res. 156, 458–470. doi: 10.1007/s00221-003-1807-8

PubMed Abstract | CrossRef Full Text | Google Scholar

BKIN Technologies (2019). KINARM Standard Tests Summary. Kingston, ON: BKIN Technologies.

Google Scholar

Bourke, T. C., Lowrey, C. R., Dukelow, S. P., Bagg, S. D., Norman, K. E., and Scott, S. H. (2016). A robot-based behavioural task to quantify impairments in rapid motor decisions and actions after stroke. J. NeuroEng. Rehabil. 13:91. doi: 10.1186/s12984-016-0201-2

PubMed Abstract | CrossRef Full Text | Google Scholar

Box, G. E., and Cox, D. (1964). An analysis of transformations. J. R. Stat. Soc. Ser. B 26, 211–252. doi: 10.1080/01621459.1981.10477649

CrossRef Full Text | Google Scholar

Cattell, R. B. (1966). The scree test for the number of factors. Multivariate Behav. Res. 1, 245–276. doi: 10.1207/s15327906mbr0102_10

CrossRef Full Text | Google Scholar

Coderre, A. M., Amr Abou Zeid, Dukelow, S. P., Demmer, M. J., Moore, K. D., Demers, M. J., et al. (2010). Assessment of upper-limb sensorimotor function of subacute stroke patients using visually guided reaching. Neurorehabil. Neural Repair 24, 528–541. doi: 10.1177/1545968309356091

PubMed Abstract | CrossRef Full Text | Google Scholar

Colombo, R., Cusmano, I., Sterpi, I., Mazzone, A., Delconte, C., and Pisano, F. (2014). Test-retest reliability of robotic assessment measures for the evaluation of upper limb recovery. Biosyst. Biorobot. 7, 313–319. doi: 10.1007/978-3-319-08072-7_51

CrossRef Full Text | Google Scholar

Costello, A. B., and Osborne, J. W. (2005). Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Pract. Assess. Res. Eval. 10:7.

Google Scholar

Crevecoeur, F., and Kurtzer, I. (2018). Long-latency reflexes for inter-effector coordination reflect a continuous state feedback controller. J. Neurophysiol. 120, 2466–2483. doi: 10.1152/jn.00205.2018

PubMed Abstract | CrossRef Full Text | Google Scholar

Debert, C. T., Herter, T. M., Scott, S. H., and Dukelow, S. (2012). Robotic assessment of sensorimotor deficits after traumatic brain injury. J. Neurol. Phys. Ther. 36, 58–67. doi: 10.1097/NPT.0b013e318254bd4f

PubMed Abstract | CrossRef Full Text | Google Scholar

Drowatzky, J. N., and Zuccato, F. C. (1967). Interrelationships between selected measures of static and dynamic balance. Res. Q. 38, 509–510.

Google Scholar

Dukelow, S. P., Herter, T. M., Bagg, S. D., and Scott, S. H. (2012). The independence of deficits in position sense and visually guided reaching following stroke. J. Neuroeng. Rehabil. 9:72. doi: 10.1186/1743-0003-9-72

PubMed Abstract | CrossRef Full Text | Google Scholar

Dukelow, S. P., Herter, T. M., Moore, K. D., Demers, M. J., Glasgow, J. I., Bagg, S. D., et al. (2010). Quantitative assessment of limb position sense following stroke. Neurorehabil. Neural Repair 24, 178–187. doi: 10.1177/1545968309345267

PubMed Abstract | CrossRef Full Text | Google Scholar

Gaprielian, P., Scott, S. H., Lowrey, C., Reid, S., Pari, G., and Levy, R. (2019). Integrated robotics platform with haptic control differentiates subjects with Parkinson’s disease from controls and quantifies the motor effects of levodopa. J. Neuroeng. Rehabil. 16:124. doi: 10.1186/s12984-019-0598-5

PubMed Abstract | CrossRef Full Text | Google Scholar

Gilliaux, M., Lejeune, T. M., Detrembleur, C., Sapin, J., Dehez, B., Selves, C., et al. (2014). Using the robotic device REAplan as a valid, reliable, and sensitive too l to quantify upper limb impairments in stroke patients. J. Rehabil. Med. 46, 117–125. doi: 10.2340/16501977-1245

PubMed Abstract | CrossRef Full Text | Google Scholar

Grefkes, C., Nowak, D. A., Eickhoff, S. B., Dafotakis, M., Küst, J., Karbe, H., et al. (2008). Cortical connectivity after subcortical stroke assessed with functional magnetic resonance imaging. Ann. Neurol. 63, 236–246. doi: 10.1002/ana.21228

PubMed Abstract | CrossRef Full Text | Google Scholar

Horn, J. L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika 30, 179–185. doi: 10.1007/BF02289447

PubMed Abstract | CrossRef Full Text | Google Scholar

Hotelling, H. (1933). Analysis of a complex of statistical variables into principal components. J. Educ. Psychol. 24, 498–520. doi: 10.1037/h0070888

CrossRef Full Text | Google Scholar

Jennrich, R. I., and Sampson, P. F. (1966). Rotation for simple loadings. Psychometrika 31, 313–323. doi: 10.1007/BF02289465

PubMed Abstract | CrossRef Full Text | Google Scholar

Jolliffe, I. T., and Cadima, J. (2016). Principal component analysis: a review and recent developments. Philos. Trans. A 374:20150202.

Google Scholar

Kaiser, H. F. (1958). The varimax criterion for analytic rotation in factor analysis. Psychometrika 23, 187–200. doi: 10.1007/BF02289233

CrossRef Full Text | Google Scholar

Kenzie, J. M., Semrau, J. A., Hill, M. D., Scott, S. H., and Dukelow, S. P. (2017). A composite robotic-based measure of upper limb proprioception. J. Neuroeng. Rehabil. 14:114. doi: 10.1186/s12984-017-0329-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Longhi, M., Merlo, A., Prati, P., Giacobbi, M., and Mazzoli, D. (2016). Instrumental indices for upper limb function assessment in stroke patients: a validation study. J. Neuroeng. Rehabil. 13:52. doi: 10.1186/s12984-016-0163-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Mickevičienė, D., Skurvydas, A., and Karanauskienė, D. (2015). Is intraindividual variability different between unimanual and bimanual speed-accuracy movements? Percept. Mot. Skills 120, 125–138. doi: 10.2466/25.PMS.120v14x3

CrossRef Full Text | Google Scholar

Mochizuki, G., Centen, A., Resnick, M., Lowrey, C., Dukelow, S. P., and Scott, S. H. (2019). Movement kinematics and proprioception in post-stroke spasticity: assessment using the Kinarm robotic exoskeleton. J. Neuroeng. Rehabil. 16:146. doi: 10.1186/s12984-019-0618-5

PubMed Abstract | CrossRef Full Text | Google Scholar

O’connor, B. P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer’s MAP test. Behav. Res. Methods Instr. Comput. 32, 396–402. doi: 10.3758/BF03200807

PubMed Abstract | CrossRef Full Text | Google Scholar

Oldfield, R. C. (1971). The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 9, 97–113. doi: 10.1016/0028-3932(71)90067-4

CrossRef Full Text | Google Scholar

Ozturk, A., Tartar, A., Ersoz Huseyinsinoglu, B., and Ertas, A. H. (2016). A clinically feasible kinematic assessment method of upper extremity motor function impairment after stroke. Measurement 80, 207–216. doi: 10.1016/j.measurement.2015.11.026

CrossRef Full Text | Google Scholar

Panarese, A., Pirondini, E., Tropea, P., Cesqui, B., Posteraro, F., and Micera, S. (2016). Model-based variables for the kinematic assessment of upper-extremity impairments in post-stroke patients. J. Neuroeng. Rehabil. 13:81. doi: 10.1186/s12984-016-0187-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Pearson, K. (1901). LIII. On lines and planes of closest fit to systems of points in space. Philos. Mag. Ser. 6 2, 559–572. doi: 10.1080/14786440109462720

CrossRef Full Text | Google Scholar

Pila, O., Duret, C., Laborne, F. X., Gracies, J. M., Bayle, N., and Hutin, E. (2017). Pattern of improvement in upper limb pointing task kinematics after a 3-month training program with robotic assistance in stroke. J. Neuroeng. Rehabil. 14:105. doi: 10.1186/s12984-017-0315-1

PubMed Abstract | CrossRef Full Text | Google Scholar

R Core Team (2017). R: A Language and Environment for Statistical Computing. Vienna: R Foundation for Statistical Computing.

Google Scholar

Revelle, W. (2019). Psych: Procedures for Personality and Psychological Research. Evanston, IL: Northwestern University.

Google Scholar

Ringnér, M. (2008). What is principal component analysis? Nat. Biotechnol. 26, 303–304. doi: 10.1038/nbt0308-303

PubMed Abstract | CrossRef Full Text | Google Scholar

Sakaluk, J. K., and Short, S. D. (2017). A methodological review of exploratory factor analysis in sexuality research: used practices, best practices, and data analysis resources. J. Sex Res. 54, 1–9. doi: 10.1080/00224499.2015.1137538

PubMed Abstract | CrossRef Full Text | Google Scholar

Simmatis, L., Krett, J., Scott, S. H., and Jin, A. Y. (2017). Robotic exoskeleton assessment of transient ischemic attack. PLoS One 12:e0188786. doi: 10.1371/journal.pone.0188786

PubMed Abstract | CrossRef Full Text | Google Scholar

Simmatis, L. E. R., Early, S., Moore, K. D., Appaqaq, S., and Scott, S. H. (2020a). Statistical measures of motor, sensory and cognitive performance across repeated robot-based testing. J. Neuroeng. Rehabil. 2, 1–12.

Google Scholar

Simmatis, L. E. R., Jin, A. Y., Taylor, S. W., Bisson, E. J., Scott, S. H., and Baharnoori, M. (2020b). The feasibility of assessing cognitive and motor function in multiple sclerosis patients using robotics. Mult. Scler. J. Exp. Transl. Clin. 6, 1–11. doi: 10.1177/2055217320964940

PubMed Abstract | CrossRef Full Text | Google Scholar

Stevens, J. P. (2009). Applied Multivariate Statistics for the Social Sciences, 5th Edn. London: Routledge.

Google Scholar

Szameitat, A. J., McNamara, A., Shen, S., and Sterr, A. (2012). Neural activation and functional connectivity during motor imagery of bimanual everyday actions. PLoS One 7:e38506. doi: 10.1371/journal.pone.0038506

PubMed Abstract | CrossRef Full Text | Google Scholar

Székely, G. J., Rizzo, M. L., and Bakirov, N. K. (2007). Measuring and testing dependence by correlation of distances. Ann. Stat. 35, 2769–2794. doi: 10.1214/009053607000000505

CrossRef Full Text | Google Scholar

Todorov, E., and Jordan, M. I. (2002). Optimal feedback control as a theory of motor coordination. Nat. Neurosci. 5, 1226–1235. doi: 10.1038/nn963

PubMed Abstract | CrossRef Full Text | Google Scholar

Tresilian, J. R., and Stelmach, G. E. (1997). Common organization for unimanual and bimanual reach-to-grasp tasks. Exp. Brain Res. 115, 283–299. doi: 10.1007/PL00005697

PubMed Abstract | CrossRef Full Text | Google Scholar

Tyryshkin, K., Coderre, A. M., Glasgow, J. I., Herter, T. M., Bagg, S. D., Dukelow, S. P., et al. (2014). A robotic object hitting task to quantify sensorimotor impairments in participants with stroke. J. Neuroeng. Rehabil. 11:47. doi: 10.1186/1743-0003-11-47

PubMed Abstract | CrossRef Full Text | Google Scholar

Tyryshkin, K., Dukelow, S. P., Glasgow, J. I., and Scott, S. H. (2013). Hand usage and inter-limb coordination parameters for the bimanual rapid visuomotor task to quantify sensorimotor dysfunction of participants with stroke. BMC Neurosci. 14(Suppl. 1):350. doi: 10.1186/1471-2202-14-S1-P350

CrossRef Full Text | Google Scholar

Veerbeek, J. M., Langbroek-Amersfoort, A. C., Van Wegen, E. E. H., Meskers, C. G. M., and Kwakkel, G. (2017). Effects of robot-assisted therapy for the upper limb after stroke. Neurorehabil. Neural Repair 31, 107–121. doi: 10.1177/1545968316666957

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, C., Peng, L., Hou, Z. G., Li, J., Zhang, T., and Zhao, J. (2020). Quantitative assessment of upper-limb motor function for post-stroke rehabilitation based on motor synergy analysis and multi-modality fusion. IEEE Trans. Neural Syst. Rehabil. Eng. 28, 943–952. doi: 10.1109/TNSRE.2020.2978273

PubMed Abstract | CrossRef Full Text | Google Scholar

Wood, M. D., Simmatis, L. E. R., Boyd, J. G., Scott, S. H., and Jacobson, J. A. (2018). Using principal component analysis to reduce complex datasets produced by robotic technology in healthy participants. J. Neuroeng. Rehabil. 15:71.

Google Scholar

Wu, C. Y., Yang, C. L., Chen, M., Lin, K. C., and Wu, L. L. (2013). Unilateral versus bilateral robot-assisted rehabilitation on arm-trunk control and functions post stroke: a randomized controlled trial. J. Neuroeng. Rehabil. 10:35. doi: 10.1186/1743-0003-10-35

PubMed Abstract | CrossRef Full Text | Google Scholar

Zwick, W. R., and Velicer, W. F. (1986). Comparison of five rules for determining the number of components to retain. Psychol. Bull. 99, 432–442. doi: 10.1037/0033-2909.99.3.432

CrossRef Full Text | Google Scholar