- 1Bio-Inspired RObots for MEDicine-Laboratory, Department of Biomedical Engineering, University of Basel, Allschwil, Switzerland
- 2Center for Medical Image Analysis and Navigation, Department of Biomedical Engineering, University of Basel, Allschwil, Switzerland
Introduction: Ergonomic issues are widespread among surgeons performing teleoperated robotic surgery. As the ergonomics of a teleoperation system depends on the controller handle, it needs to be designed wisely. While the importance of the controller handle in robot-assisted telemanipulation has been highlighted previously, most existing work on the usability of a human-robot system for surgery was of qualitative nature or did not focus on surgery-specific tasks.
Methods: We investigated the influence of nine different grasp-type telemanipulator handles on the usability of a lambda.6 haptic input device for a virtual six degrees of freedom peg-in-hole task. User performance with different handles was assessed through four usability metrics: i) task completion time, ii) dimensionless jerk, iii) collision forces, and iv) perceived workload. We compared these usability results with those of a prior study examining only the functional rotational workspace of the same human-robot system.
Results: The linear mixed-effect model (LMM) analysis showed that all four usability metrics were dependent on the telemanipulator handle. Moreover, the LMM analysis showed an additional contribution of the hole accessibility to the usability of the human-robot system.
Discussion: In case contact forces between the follower end-effector and its surroundings are not critical, the fixed-hook-grasp handle showed the best results out of the nine tested handles. In case low contact forces are crucial, the tripod-grasp handle was most suitable. It can thus be deduced that different grasp-type telemanipulator handles affect system usability for a surgery-related, teleoperated six degrees of freedom placement task. Also, maximizing the functional rotational workspace can positively affect system usability.
1 Introduction
Robotic technology is extensively used in surgical procedures (Tavakoli et al., 2008) in the form of teleoperated and image-guided systems (Hoeckelmann et al., 2015). For example, in 2023, over 2.2 million procedures were performed worldwide with da Vinci systems only (Intuitive Surgical, 2023), representing more than a 100% increase over the last 5 years (Intuitive Surgical, 2018). During teleoperated procedures, the surgeon operates a human-machine interface (the controller) that controls a remote surgical robot (the follower) (Tavakoli et al., 2008). The spatial separation of the surgeon from the operating instrument allows for processing the controller’s motions before transferring them to the follower. This results in several benefits of teleoperated surgery over traditional surgery, including tremor filtering, motion scaling, increased dexterity, and preventing the instrument from entering previously defined forbidden regions (Okamura, 2004; Park et al., 2001; Prasad et al., 2004; Tavakoli et al., 2008). However, these teleoperation systems also pose several challenges. Much effort has been put into solving technical challenges, such as overcoming the limited workspace of controllers (Conti and Khatib, 2005) or the lack of haptic feedback (Enayati et al., 2016; Okamura, 2004).
However, surgeon safety and comfort have received little attention in minimally invasive surgery (Catanzarite et al., 2018), such that it is not surprising that ergonomic issues are widespread among surgeons performing teleoperated robotic surgery (Armijo et al., 2019; Catanzarite et al., 2018; Craven et al., 2013; Morton and Stewart, 2022). The ideal arm position for working with surgical instruments has been described as follows (Matern and Waller, 1999; Matern, 2009): at the shoulder, the upper arm should be slightly abducted, retroverted, and rotated inward. The arm should be flexed 90°–120° at the elbow and the forearm in its natural position between pro- and supination. The hand should be in its natural position, with the wrist slightly extended and the fingers slightly bent. In accordance with this, the rapid upper limb assessment (RULA) survey for the ergonomic assessment of workplaces rates an upper arm position of 20° flexion to 20° extension with no elevation or abduction, a lower arm position of 60°–100° flexion and a neutral wrist position the most ergonomic (McAtamney and Corlett, 1993). The instrument handles influence the hand position of the user (Matern, 2009) and were found a possible target for ergonomic improvement of teleoperated robotic surgical systems (Morton and Stewart, 2022).
Important aspects of ergonomics are both human wellbeing and overall system performance (International Organization for Standardization, 2016). Overall system performance is a broad term and challenging to define and quantify. We considered system usability an essential aspect of overall system performance suitable for quantitative measurements. The ISO 9241–210 standard on “human-centred design for interactive systems” defines usability as the “extent to which a system […] can be used by specified users to achieve specified goals with effectiveness, efficiency and satisfaction in a specified context of use” (International Organization for Standardization, 2010). We are convinced that a telemanipulator handle influences the wellbeing of the human operating the robotic system and the usability of the human-robot system.
Already 30 years ago, Bejczy concluded, based on a subjective analysis, that for adequate control of six degrees of freedom (DoF), the telemanipulator handle “must be held firmly with at least two fingers and the heel of the hand at all times” (Bejczy, 1992). A newer survey on different surgical instrument handles (robotic and non-robotic) among surgeons showed that subjective handle preference was strongly influenced by the surgeons’ background and experience (Santos-Carreras et al., 2012). Yet, a study comparing different telemanipulators for teleoperation in earthwork highlighted the importance of considering factors for selecting the telemanipulator handle beyond user familiarity, such as telemanipulator ergonomics and task compatibility (Saunier et al., 2024). For robot-assisted surgery, two studies assessing both quantitative and qualitative performance metrics of different haptic telemanipulators highlighted the importance of the hand-controller (Baghdadi et al., 2020; Zareinia et al., 2015). However, in those studies both the mechanics and the handle of the compared telemanipulators differed. Hence, it remains unclear what performance differences emerge from the handle. It is thus not surprising that the authors themselves concluded that future work should focus on evaluating the performance of different handles with the same haptic telemanipulator. Our previous studies assessing the influence of the handle only on the usability of a human-robot system have focused on workspace exploring tasks (Zoller et al., 2019a; 2020). While the importance of the accessibility of a large workspace is undebatable during robot-assisted surgery, there are unarguably more representative tasks to assess the usability of a human-robot system for surgery. Thus, it can be concluded that previous work on telemanipulator handles was mostly of qualitative nature, did not focus on surgery-specific tasks, or stated the necessity of further studies comparing different handles with the same telemanipulator.
This study aimed to investigate the influence of different telemanipulator handles on the usability of a human-robot system. For this, we exemplarily chose a virtual six DoF peg-in-hole task, as many steps in a robotic surgery require the accurate placement of tools, which can be simulated by a six DoF peg-in-hole task. Also, peg-in-hole tasks have previously been used to assess user performance with robot-assisted surgical systems (Baghdadi et al., 2020; Okamura et al., 2011; Zareinia et al., 2015). In addition, we also investigated if system usability for a peg-in-hole task correlates with the human-robot system functional rotational workspace, i.e., the intersection of the mechanical rotational workspace of the telemanipulator device and the anatomical rotational workspace of the operator’s hand and wrist with a given grasp type and a weight-supported arm posture (Zoller et al., 2020). Such a correlation would underline the importance of maximizing the functional rotational workspace to improve telemanipulation with human-robot systems. Therefore, in this study the following hypotheses were tested:
Hypothesis 1. The telemanipulator handle influences system usability for a virtual peg-in-hole task.
Hypothesis 2. System usability for a virtual peg-in-hole task depends on the functional rotational workspace of the human-robot system.
2 Materials and methods
2.1 Input system
In this study, the usability of a haptic input device with different telemanipulator handles was assessed. The assessed haptic input device was a customized, handleless, six DoF lambda.6 (Force Dimension, Nyon, Switzerland), which was designed for right-handed use (see Figure 1). A detailed workspace description and illustrations for this device can be found in Zoller et al. (2020). An adapter at the end-effector of the lambda.6 device allowed for easy mounting of different handles. In this study, we used nine different handles (see Figure 2), each designed to be grasped with a different grasp type adopted from Feix et al. (2016). These were the same nine handles for which we have previously assessed the functional rotational workspace (Zoller et al., 2019a). We have developed these handles specifically for teleoperation tasks with the lambda.6 haptic input device (Zoller et al., 2019b). The computer-aided design (CAD) models of the handles used in this study are available online: https://doi.org/10.21227/8xhk-dv15.
Figure 1. Experimental setup: the user interacts through the test handle ① mounted on the haptic input device ②‚ with a virtual environment ③. The virtual environment is visually perceived through the head-mounted display ④, which is tracked by a lighthouse system⑤. An armrest ⑥ allows support of the user’s forearm.
Figure 2. All nine test handles and the additional training handle used in this study are depicted. The top row depicts the five power-grip handles that are held with the following grasp types (left to right): adducted thumb, fixed hook, power disk, power sphere, and parallel extension. The bottom row depicts the four precision-grip handles that are held with the following grasp types: precision disk, quadpod, tripod, and writing tripod. At the bottom right, the training handle to be held with a distal grasp type is shown.
2.2 Peg-in-hole scenario
To assess the usability of the input system, we designed a virtual reality (VR) scenario, which was displayed to the user on an HTC Vive Pro head-mounted display (HMD) tracked by a Lighthouse 1.0 system (both HTC, New Taipei City, Taiwan) (see Figure 1). The scenario consisted of a peg-in-hole task, in which a peg had to be inserted in different holes with different pitch/yaw/roll orientations displayed on the inside of a hemisphere. The scenario comprised two custom applications: a VR application used for visualization only and a C++ application for haptic rendering, control of the lambda.6 device, running the logic to complete the task, progressing through the study protocol, and data recording. The VR application was created in Unity (Unity Technologies, San Francisco, CA, United States), while the C++ application was created using CHAI3D (Conti et al., 2003) and the Force Dimension SDK (version 3.7.3.3210). The two applications communicated over network sockets to synchronize the relevant objects between the haptic and visual scenes and to exchange information about the VR scenario’s current state. Both applications were run as fast as possible, i.e., with target visual and haptic update rates of 60 Hz and 4,000 Hz, respectively. However, the actual update rates varied based on logged data. The measured visual and haptic update rates were 51 Hz
The peg was shaped like a T-beam with a height, width, and depth of 37.5 mm each. The hemisphere had an outer radius of 200.25 mm and a thickness of 40.5 mm. For each trial, a hole with a specific pitch/yaw/roll orientation was displayed on the hemisphere. The hemisphere holes were slightly bigger than the peg, allowing for a rotational tolerance of 6
A total of 27 different holes with different pitch/yaw/roll orientations were displayed on the hemisphere one at a time (see Figure 3). We used the same pitch/yaw/roll orientations that we have previously used in the functional roll workspace assessments (Zoller et al., 2019a) to allow better relating the results of this usability study with previous findings about the functional rotational workspace of those nine tested grasp-type handles.
Figure 3. (A) Hemisphere with holes at the nine tested pitch/yaw orientations. (B) 2D map visualizing the different pitch/yaw orientations for the holes. (C) The three different roll orientations tested at each pitch/yaw orientation.
During the peg-in-hole task, the haptic device with the attached telemanipulation handles was controlled with gravity compensation and used by the participant to interact with the virtual environment displayed through the HMD. The VR scenario required the user to move the virtual peg to the hemisphere center in a neutral pitch/yaw/roll orientation before every peg insertion attempt to ensure a consistent starting pose for all peg insertion attempts. A ghost peg indicating the correct starting pose was visualized to facilitate maneuvering the peg to the correct pose. Also, a small magnetic force and torque helped the user position and orient the peg correctly as soon as they were close to the starting pose. In addition, linear and angular tolerances of 0.5 mm and 0.1 rad (5.73◦), respectively, were introduced for the starting pose. The user was required to hold the peg in the correct starting pose for 1.5 s to initiate the peg-in-hole task. During this period, the pose of the subsequent hole was displayed to the participant. The start of the task was then indicated with a sound, and the magnetic force and torque application was inactivated. During each peg insertion attempt, the user perceived haptic feedback in form of collision forces and torques when the peg collided with the hemisphere. Also, to protect the haptic device from any damage by the user, virtual haptic walls were implemented close to the mechanical joint limits of the device and rendered to the participants when they came close to the workspace boundaries of the haptic device. Each peg insertion attempt ended either with the peg insertion into the corresponding hole or after a trial duration of 30 s. A peg was considered inside a hole if its center was located at the center of the hole with a distance tolerance of 0.3 mm. At the end of each peg insertion attempt, another sound was played and the ghost peg at the starting pose was displayed to the user again. The user then had to move the handle back to the starting pose to align the peg with the ghost peg for the next peg-in-hole attempt. One scenario consisted of 27 peg insertion attempts into 27 holes with different pitch/yaw/roll orientations. During each peg insertion attempt, the C++ application recorded the position and orientation of both the lambda.6 end-effector and the virtual peg, as well as the forces and torques sent to the haptic device. The total attempt duration and the final positional and rotational errors of the peg with respect to its target pose in the hole were also recorded.
2.3 Usability metrics
The ISO 9241–210 standard on “human-centred design for interactive systems” mentions three aspects of system usability: effectiveness, efficiency, and satisfaction (International Organization for Standardization, 2010). The same standard defines effectiveness as “accuracy and completeness with which users achieve specified goals,” efficiency as “resources expended in relation to the accuracy and completeness with which users achieve goals,” and satisfaction as “freedom from discomfort and positive attitudes towards the use of the product.” In the ISO 2941–940 standard on the “evaluation of tactile and haptic interactions,” the expended resources defining the efficiency are further specified to include time, human effort, costs, and materials (International Organization for Standardization, 2017). The same standard states that to measure the user’s satisfaction with the system, one should consider their physical, cognitive, and emotional response. In order to cover all aspects of system usability, we investigated four different usability metrics: i) task completion time, ii) dimensionless jerk, iii) collision forces, and iv) perceived workload. The collision forces and dimensionless jerk represent the accuracy with which the users fulfilled the peg-in-hole tasks. The task completion time was used as an indirect measure of task completeness, as any task completion time <30 s represents a completed task, while a task completion time
2.4 Design and procedure
This study had a cross-over (within-subjects) design. Prior to the system usability assessment, the participant’s capability for stereo vision was tested using the Lang Stereotest I, as described by Brown et al. (2001). Furthermore, the participant’s hand size was assessed using a glove size chart. Then, the experimenter showed the participant the process of a peg-in-hole scenario with the training handle. During this process, the experimenter emphasized that each peg insertion should be carried out as fast as possible, but to protect the haptic device, calm, controlled movements would be preferred over fast, jerky movements. Also, the participant was reminded to respect the workspace limits of the haptic device rendered to the participant by virtual walls. Finally, the experimenter explained that each peg insertion attempt would end after 30 s but that they should keep trying to insert the peg until an attempt is either successful or aborted. For the peg-in-hole scenarios, the participant was seated in front of the lambda.6 haptic device, with an armrest supporting an ergonomic arm posture at rest. An instructional video was displayed to the participant on a computer screen, depicting how the tested handle should be grasped in the following peg-in-hole scenario. The participant was asked to grasp the handle correctly with the right hand and was corrected if necessary. Only the participant’s right hand was examined because both the device and the handles were designed for use with the right hand only. After verifying knowledge of the correct grasp, the participant let go of the handle, put the HMD on, re-grasped the handle, and completed the peg-in-hole scenario described in Section 2.2 with the goal of inserting the peg in each of the 27 holes as fast as possible. During the scenario, the experimenter continuously observed the grasp type of the participant and instructed the participant to restore the instructed grasp type when necessary.
Before switching to the next handle, the participant was asked to complete the NASA Raw Task Load Index (NASA-RTLX) questionnaire (Byers et al., 1989), assessing the perceived workload during the peg-in-hole scenario. Thus, one experiment included the instructional video, the peg-in-hole scenario, and the NASA-RTLX questionnaire.
For familiarization purposes, each participant conducted the experiment first with a training handle (distal-type grasp). Subsequently, the experiment was conducted nine times, once with each of the nine test handles. The order of the test handles was randomized using a 9th-order row-complete Latin square to account for learning and fatigue effects. Also, the order of the holes was randomized to be different for all nine scenarios assessing the test handles. In total, the experiment was conducted ten times per participant (once with the training handle and nine times with the test handles), resulting in a total duration of the experimental session of approximately 2 h per participant.
2.5 Participants
Twenty-eight healthy, right-handed participants (13 females, 23–62 years, mean age 31.3 years) volunteered to participate in this study in February 2020. All participants had normal or corrected to normal stereo vision and did not report any recent injury or other disorders of the right upper extremity. Twelve of the participants already participated in a former study of this study series (i.e., Zoller et al., 2019a and/or Zoller et al., 2020). Other than this, the participants did not have prior experience with haptic telemanipulators. The participants were recruited from the Department of Biomedical Engineering of the University of Basel (students and researchers) and the general public. The study was conducted according to the declaration of Helsinki, the law of Switzerland, and has been approved by the responsible ethics commission (EKNZ 2018-01992). Written informed consent was obtained from all participants. One participant decided to drop out of the study after suffering from a cramp during the experiments. This participant had been replaced with the 28th participant to guarantee that the total number of participants was a multiple of nine required for a Latin square randomization with nine conditions.
2.6 Data analysis
As described in Section 2.3, we assessed the four usability metrics task completion time, dimensionless jerk, collision forces, and perceived workload. The data from the training handle was not analyzed. While task completion time, dimensionless jerk, and collision forces were analyzed for each peg insertion attempt, the perceived workload was assessed once for each grasp-type handle per participant.
The task completion time for each peg insertion attempt was directly recorded by the C++ application.
For the dimensionless jerk, we used the dimensionless jerk measure
where
with
and the movement velocity
where
For the collision forces, the force data was also downsampled to 100 Hz and only time points at which the recorded force data was
The perceived workload was computed once for each handle per participant from the NASA-RTLX questionnaire. This questionnaire consisted of six questions (see Supplementary Material) that the participants answered by crossing one of twenty-one lines dividing a 100-point scale into 5-point increments. The perceived workload score is the mean of the six individual scales (Byers et al., 1989).
The data of the 81 peg insertion attempts (
The statistical analysis of the data was performed in R (version 3.6.3) using an alpha level of .05. We performed a linear mixed-effect model (LMM) analysis for each of the four different usability metrics using the lme4 library (Bates et al., 2015). LMMs were chosen since the participants were measured repeatedly and thus, the different data from one participant are not independent. Also, compared to repeated measures ANOVA, LMMs can better deal with missing data and allow modeling dependent variables with numeric (integer and floating point) factors on top of categorical factors. For task completion time, dimensionless jerk, and collision forces, the LMM analysis was performed on the level of each individual peg insertion attempt. The LMM analysis for perceived workload was performed on the level of each handle. All LMMs were fit with maximum likelihood estimation. For each usability metric
To test our hypothesis that the telemanipulator handle influences system usability for a peg-in-hole task (Hypothesis 1), the models were extended by adding the hypothesized predicting variable handle (factor with nine levels) as a fixed effect (Equation 6):
Likelihood ratio tests
To test the hypothesis that system usability is influenced by the functional rotational workspace of the human-robot system (Hypothesis 2), the models were further extended by adding the numeric variable insideWristRoM as a predictor [insideWristRoM from 0 to 9, data from Zoller et al. (2019a)]. This variable designates how many participants reached a specific hole orientation when only movements of the hand and wrist were allowed and is thus a measure of the accessibility of each hole orientation. Thus, two additional LMMs were fit (Equations 7, 8):
where
3 Results
LMM analysis of all quantitative usability metrics (task completion time, dimensionless jerk, and collision forces) resulted in heavy-tailed normal Q-Q plots, which violated the assumption for normally distributed residuals. Therefore, the LMM analysis was completed using the natural log transform of task completion time, dimensionless jerk, and collision forces as the dependent variables. The histograms of both the original and, where applicable, log-transformed data as well as the normal Q-Q plots of the resulting LMMs can be found in the Supplementary Material.
For all four usability metrics (task completion time, dimensionless jerk, collision forces, and perceived workload), the likelihood ratio test showed a significantly better model fit for the model with
Figure 4. The task completion time, dimensionless jerk, collision forces (logarithmic scale), and the workload of the participants for the different grasp-type handles. All peg insertion attempts were considered for the task completion time, dimensionless jerk, and collision forces. The perceived workload was assessed once per participant and handle. Low values indicate fast task completion, high movement smoothness, gentle peg insertion, and low mental effort, respectively. The solid central line on each box indicates the median and the bottom and top edges of the boxes designate the 25th
Table 1. Tukey honestly significant difference post hoc test results for the pairwise handle comparisons and all four usability metrics.
For the three quantitative usability metrics (task completion time, dimensionless jerk, and collision forces), the likelihood ratio test showed a significantly better model fit for the model with both
4 Discussion
Former work on usability-related metrics of human-robot systems for surgery focused on comparing different haptic devices (Baghdadi et al., 2020; Zareinia et al., 2015). Regarding the handles of surgical devices, previous work mainly focused on its design for an ergonomic work position, the possibility to trigger additional device functionality, a large functional workspace, or the handle comfort and precision (Bejczy, 1992; Matern and Waller, 1999; Matern, 2009; Santos-Carreras et al., 2012; Zoller et al., 2019a; 2020). Complementary to this, we focused on the quantitative usability assessment of one specific haptic device with different handles for a specific task mimicking the common surgical requirement to place a tool accurately.
Our results showed that all four usability measures were significantly influenced by the telemanipulator handle, i.e., our model with
One might argue that a single usability score combining the four usability metrics might allow for a better comparison of the different handles. Such a combination would require weighting the different metrics. We decided against such a combination because different real-life tasks would require different weightings. Low task completion time is always aimed for in surgical settings to minimize the anesthesia time and cost of operating room use. However, especially when interacting with delicate tissue such as nerves, low dimensionless jerk and collision forces indicate smoother and more gentle tissue interaction, potentially preventing tissue damage and thus improving surgical outcomes. This would be more important than shorter operating times in surgeries with delicate tissues nearby. Therefore, such weighting would be task-dependent, e.g., different for orthopedic vs. brain surgery.
Regarding the task completion time, the dimensionless jerk, and the perceived workload score, the fixed-hook-, quadpod-, tripod-, and writing-tripod-grasp handles showed the lowest mean values across all peg insertions. For the fixed-hook-, quadpod-, and tripod-grasp handles, these low mean values also resulted in significantly lower task completion time, dimensionless jerk, and perceived workload score compared to other handles. These results indicate that these handles were more suitable for the investigated peg-in-hole task than others, as they required less time, presented a lower workload, and resulted in smoother movements.
A different pattern was observed for the collision forces: here, the precision-disk-, quadpod-, tripod-, and writing-tripod-grasp handles showed the lowest mean values across all peg insertions. These low mean values also resulted in significantly lower collision forces compared to other handles. Collision forces are a measure of placement accuracy because they are proportional to the unwanted penetration depth of the peg into the virtual hole walls. As all four of the above handles are grasped with a precision grip with an abducted thumb (Feix et al., 2016), it can be assumed that for low collision forces in an accurate placement task, it is best to choose a precision grip with an abducted thumb. This is supported by previous findings where surgeons perceived handles whose primary function (instrument aperture) was controlled with a power grip as less accurate (Santos-Carreras et al., 2012).
The fixed-hook-grasp handle scored significantly better than all other handles except for the tripod-grasp handle in three of our four usability metrics (task completion time, dimensionless jerk, and perceived workload). This result is surprising as Santos-Carreras et al. (2012) concluded based on a qualitative handle evaluation that handles “which need to be grasped with the whole hand”, i.e., power-grip handles (Napier, 1956) such as the fixed-hook-grasp handle (Feix et al., 2016), are less intuitive. The sub-scale “mental demand” of the RTLX can be seen as a measure of intuitiveness (Hurtienne, 2011). A closer evaluation of the mental demand sub-scale revealed the lowest mean scores (16.3 of 100) for the fixed-hook- and tripod-grasp handles. Our results, therefore, do not support the conclusion that power-grip handles are, per se, less intuitive to use than precision grip handles.
The fixed-hook-grasp handle scored best in three of our four usability metrics (task completion time, dimensionless jerk, and perceived workload; see
Including
The only difference between the conditions in both this and our previous studies (Zoller et al., 2019a; Zoller et al., 2020) was the used handle requiring different grasp types. Therefore, our observed correlation between the usability metrics and the fixed-forearm accessibility of the rotational workspace indicates that the user’s initial hand position, i.e., the grasp type, alone influences telemanipulator usability. This indicates that maximizing the fixed forearm rotational workspace, which we aimed for in previous work (Zoller et al., 2020), can already be used to improve the usability of a telemanipulator handle. We consider this an important finding because the functional rotational workspace can be evaluated with much simpler setups than the usability, i.e., with less elaborate virtual environments and without haptic feedback. Thus, simpler and task-independent experiments to improve the rotational workspace of a handle could already be used to improve system usability.
Robotic surgery is more fatiguing for the shoulder and neck than laparoscopic surgery (Armijo et al., 2019). Besides the positive correlation with usability, maximizing the fixed forearm rotational workspace reduces required shoulder and elbow movements. That could reduce the fatiguing shoulder movements during telemanipulation, resulting in further ergonomic benefits. However, reduced muscle fatigue cannot be deduced from our data and would require a different study protocol. In addition, muscle fatigue is likely task-dependent, e.g., specific to posture during and the duration of the teleoperation task.
In this study, we assessed a simulated peg-in-hole-task using a virtual end-effector instead of a physical follower device controlled by the telemanipulator. While surgical instrument handles can be studied in virtual reality settings (Matern et al., 2005), the performance will always depend on certain properties of the virtual environment (Gillespie, 2005). In our case, the resolution and contrast of the HMD or the haptic force and torque rendering might have influenced performance. However, the limitations of the virtual environment were identical for the trials with all handles. Therefore, we would not expect them to have affected the differences found between the handles. Nevertheless, in a real teleoperation setting, task performance and user experience would be influenced by additional challenges on the follower side, such as delays, limitations of control, stability issues, and precision limitations in position, velocities, and forces. Also, physical phenomena such as friction and slipping are difficult to simulate accurately and might have an additional effect on task performance and user experience. Because different handles might influence how users can cope with these challenges, further studies with a real follower device are needed to verify our findings on the influence of a telemanipulator handle on system usability.
Also, certain characteristics of the user influence performance (Gillespie, 2005). We had participants with very diverse levels of experience interacting with virtual environments. In our opinion, this is rather a strength than a limitation because we assume that surgeons’ experience interacting with virtual environments varies largely from none to extensive. Thus, the experience of our study population in interacting with virtual environments supposedly mirrors that of the surgeon population, i.e., the end users of surgical telemanipulators. The age distribution of the participants in this study did not represent the population likely to be involved in teleoperated surgery because no participant was in the age range between 35 and 50 years. However, we do not expect findings contrary to this study for participants in this age group.
Future studies could validate our findings by replacing our virtual environment with a real follower and a real six DoF peg-in-hole task. For this, any robot suitable for robotic surgery, such as the ones described by Alip et al. (2022), could be used if it is controlled by a haptic device that allows mounting different grasp-type handles. However, in our understanding, usability and performance are strongly dependent on the investigated task, therefore, generalization of findings is often questionable. As surgical procedures are more complex than a peg-in-hole task, we highly suggest investigations on the individual systems and tasks at hand. For this, a specific seven DoF task, such as a sewing task, could be investigated by comparing system usability with two different seven DoF handles, a fixed-hook-grasp handle with a seventh DoF that is controlled by the index finger and thumb and an openable tripod-grasp handle. Nevertheless, given that we found significant effects in a simplified sample task, it can be assumed that these effects become even more pronounced with more complex tasks. We are thus convinced that our results provide two helpful insights applicable to many cases: First, simply maximizing the fixed-forearm workspace may already improve usability independent of the specific task at hand. Secondly, different handles indeed make a difference for peg-in-hole-like tasks, and fixed-hook- and tripod-grasp handles are promising.
5 Conclusion
To our knowledge, this study is the first to assess the usability of different handles with the same haptic telemanipulator. In our investigated virtual peg-in-hole task, different telemanipulator handles significantly affected system usability in all four measured performance metrics task completion time, dimensionless jerk, collision forces, and perceived workload. Best performances were achieved with the fixed-hook- and tripod-grasp handles. Our results indicate that precision grip handles with an abducted thumb might be best for accurate placement tasks where low collision forces are crucial. In contrast, fixed-hook-grasp handles might be a good choice for the rough positioning of a tool or tasks of long duration, given that low contact forces are not crucial.
Additionally, we have shown a correlation between the fixed-forearm accessibility of the rotational workspace with the three measured quantitative performance metrics task completion time, dimensionless jerk, and collision forces. Fixed-forearm accessibility is task-independent and can be improved with simple means (Zoller et al., 2020). Our observed correlation indicates that maximizing fixed-forearm accessibility can positively affect system usability and that the user’s initial hand position alone is already influencing telemanipulator usability. Nevertheless, to be applicable to surgical robotics, our findings must be validated in a real teleoperation setting investigating specific surgical tasks.
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics statement
The studies involving humans were approved by the Ethikkommission Nordwest- und Zentralschweiz. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study. Written informed consent was obtained from the individual(s) for the publication of any potentially identifiable images or data included in this article.
Author contributions
EZ: Conceptualization, Formal Analysis, Investigation, Methodology, Project administration, Software, Visualization, Writing–original draft, Writing–review and editing. SvB: Conceptualization, Formal Analysis, Investigation, Methodology, Software, Visualization, Writing–review and editing. NG: Conceptualization, Writing–review and editing. PC: Funding acquisition, Writing–review and editing. GR: Conceptualization, Writing–review and editing.
Funding
The author(s) declare that financial support was received for the research, authorship, and/or publication of this article. This work was supported by the Werner Siemens Foundation through the MIRACLE project.
Acknowledgments
The authors would like to thank Frédéric Bourgeois and Jacob Bursavich for their help with developing of the virtual environment and the haptic rendering algorithm. For paraphrasing and formatting of this manuscript ChatGPT (OpenAI, 2022, models GPT-3.5 and GPT-4o) has been used.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/frobt.2024.1457926/full#supplementary-material
References
Alip, S. L., Kim, J., Rha, K. H., and Han, W. K. (2022). Future platforms of robotic surgery. Urologic Clin. N. Am. 49, 23–38. doi:10.1016/j.ucl.2021.07.008
Armijo, P. R., Huang, C.-K., High, R., Leon, M., Siu, K.-C., and Oleynikov, D. (2019). Ergonomics of minimally invasive surgery: an analysis of muscle effort and fatigue in the operating room between laparoscopic and robotic surgery. Surg. Endosc. 33, 2323–2331. doi:10.1007/s00464-018-6515-3
Baghdadi, A., Hoshyarmanesh, H., de Lotbiniere-Bassett, M. P., Choi, S. K., Lama, S., and Sutherland, G. R. (2020). Data analytics interrogates robotic surgical performance using a microsurgery-specific haptic device. Expert Rev. Med. Devices 17, 721–730. doi:10.1080/17434440.2020.1782736
Bates, D., Mächler, M., Bolker, B., and Walker, S. (2015). Fitting linear mixed-effects models using lme4. J. Stat. Softw. 67, 1–48. doi:10.18637/jss.v067.i01
Bejczy, A. (1992). “Teleoperation: the language of the human hand,” in Robot and human communication, 1992. Proceedings (IEEE International Workshop on IEEE), 32–43. doi:10.1109/ROMAN.1992.253909
Brown, S., Weih, L., Mukesh, N., McCarty, C., and Taylor, H. (2001). Assessment of adult stereopsis using the Lang 1 stereotest: apilot study. Binocul. Vis. and Strabismus Q. 16, 91–98.
Byers, J. C., Bittner, A., and Hill, S. G. (1989). Traditional and raw task load index (TLX) correlations: are paired comparisons necessary. Adv. Industrial Ergonomics Saf. 1, 481–485.
Catanzarite, T., Tan-Kim, J., and Menefee, S. A. (2018). Ergonomics in gynecologic surgery. Curr. Opin. Obstetrics Gynecol. 30, 432–440. doi:10.1097/GCO.0000000000000502
C onti, F., Barbagli, F., Balaniuk, R., Halg, M., Lu, C., Morris, D., et al. (2003). “The CHAI libraries,” in Proceedings of eurohaptics 2003, 496–500.
Conti, F., and Khatib, O. (2005). “Spanning large workspaces using small haptic devices,” in First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference (IEEE), 183–188. doi:10.1109/WHC.2005.118
Craven, R., Franasiak, J., Mosaly, P., and Gehrig, P. A. (2013). Ergonomic deficits in robotic gynecologic oncology surgery: a need for intervention. J. Minim. Invasive Gynecol. 20, 648–655. doi:10.1016/j.jmig.2013.04.008
Enayati, N., De Momi, E., and Ferrigno, G. (2016). Haptics in robot-assisted surgery: challenges and benefits. IEEE Rev. Biomed. Eng. 9, 49–65. doi:10.1109/RBME.2016.2538080
Feix, T., Romero, J., Schmiedmayer, H.-B., Dollar, A. M., and Kragic, D. (2016). The GRASP taxonomy of human grasp types. IEEE Trans. Human-Machine Syst. 46, 66–77. doi:10.1109/THMS.2015.2470657
Gillespie, R. B. (2005). “Haptic interface to virtual environments,” in Robotics and automation handbook (Boca Raton, Florida: CRC Press), 464–486.
Groen, J., and Werkhoven, P. J. (1998). Visuomotor adaptation to virtual hand position in interactive virtual environments. Presence 7, 429–446. doi:10.1162/105474698565839
Hoeckelmann, M., Rudas, I. J., Fiorini, P., Kirchner, F., and Haidegger, T. (2015). Current capabilities and development potential in surgical robotics. Int. J. Adv. Robotic Syst. 12. doi:10.5772/60133
Hogan, N., and Sternad, D. (2009). Sensitivity of smoothness measures to movement duration, amplitude, and arrests. J. Mot. Behav. 41, 529–534. doi:10.3200/35-09-004-RC
Hurtienne, J. (2011). “Image schemas and design for intuitive use,”. Berlin, Germany: Technische Universität Berlin. Ph.D. thesis. doi:10.14279/depositonce-2753
International Organization for Standardization (2010). ISO 9241-210:2010 Ergonomics of human-system interaction – human-centred design for interactive systems
International Organization for Standardization (2016). ISO 6385:2016 Ergonomics principles in the design of work systems.
International Organization for Standardization (2017). ISO 9241-940:2017 Ergonomics of human-system interaction – evaluation of tactile and haptic interactions
Matern, U. (2009). Ergonomic deficiencies in the operating room: examples from minimally invasive surgery. Work 33, 165–168. doi:10.3233/WOR-2009-0862
Matern, U., Koneczny, S., Tedeus, M., Dietz, K., and Buess, G. (2005). Ergonomic testing of two different types of handles via virtual reality simulation. Surg. Endosc. Other Interventional Tech. 19, 1147–1150. doi:10.1007/s00464-004-2171-x
Matern, U., and Waller, P. (1999). Instruments for minimally invasive surgery. Surg. Endosc. 13, 174–182. doi:10.1007/s004649900934
McAtamney, L., and Corlett, E. N. (1993). Rula: a survey method for the investigation of work-related upper limb disorders. Appl. Ergon. 24, 91–99. doi:10.1016/0003-6870(93)90080-S
Morton, J., and Stewart, G. D. (2022). The burden of performing minimal access surgery: ergonomics survey results from 462 surgeons across Germany, the UK and the USA. J. Robotic Surg. 16, 1347–1354. doi:10.1007/s11701-021-01358-6
Napier, J. R. (1956). The prehensile movements of the human hand. J. bone Jt. Surg. Br. 38, 902–913. doi:10.1302/0301-620X.38B4.902
Okamura, A. M. (2004). Methods for haptic feedback in teleoperated robot-assisted surgery. Industrial Robot An Int. J. 31, 499–508. doi:10.1108/01439910410566362
Okamura, A. M., Verner, L. N., Yamamoto, T., Gwilliam, J. C., and Griffiths, P. G. (2011). “Force feedback and sensory substitution for robot-assisted surgery,” in Surgical robotics: systems applications and visions. Editors J. Rosen, B. Hannaford, and R. M. Satava (Boston, MA: Springer US), 419–448. doi:10.1007/978-1-4419-1126-1_18
Park, S., Howe, R. D., and Torchiana, D. F. (2001). “Virtual fixtures for robotic cardiac surgery,” in International conference on medical image computing and computer-assisted intervention (Springer), 1419–1420. doi:10.1007/3-540-45468-3_252
Prasad, S. M., Prasad, S. M., Maniar, H. S., Chu, C., Schuessler, R. B., and Damiano Jr, R. J. (2004). Surgical robotics: impact of motion scaling on task performance. J. Am. Coll. Surg. 199, 863–868. doi:10.1016/j.jamcollsurg.2004.08.027
Santos-Carreras, L., Hagen, M., Gassert, R., and Bleuler, H. (2012). Survey on surgical instrument handle design: ergonomics and acceptance. Surg. Innov. 19, 50–59. doi:10.1177/1553350611413611
Saunier, L., Preda, M., and Fetita, C. (2024). “Controller evaluation for earthwork teleoperation and training in virtual reality,” in 2024 16th International Conference on Human System Interaction (HSI), 1–6. doi:10.1109/HSI61632.2024.10613582
Tavakoli, M., Patel, R. V., Moallen, M., and Aziminejad, A. (2008). Haptics for teleoperated surgical robotic systems. World Sci. doi:10.1142/6816
Zareinia, K., Maddahi, Y., Ng, C., Sepehri, N., and Sutherland, G. R. (2015). Performance evaluation of haptic hand-controllers in a robot-assisted surgical system. Int. J. Med. Robotics Comput. Assisted Surg. 11, 486–501. doi:10.1002/rcs.1637
Zoller, E. I., Cattin, P. C., Zam, A., and Rauter, G. (2019a). “Assessment of the functional rotational workspace of different grasp type handles for the lambda. 6 haptic device,” in 2019 IEEE World Haptics Conference (WHC) (IEEE), 127–132. doi:10.1109/WHC.2019.8816080
Zoller, E. I., Gerig, N., Cattin, P. C., and Rauter, G. (2020). The functional rotational workspace of a human-robot system can be influenced by adjusting the telemanipulator handle orientation. IEEE Trans. Haptics 14, 335–346. doi:10.1109/TOH.2020.3027261
Keywords: ergonomics, handle, human factors, telemanipulation, usability
Citation: Zoller EI, von Ballmoos S, Gerig N, Cattin PC and Rauter G (2024) Handle shape influences system usability in telemanipulation. Front. Robot. AI 11:1457926. doi: 10.3389/frobt.2024.1457926
Received: 01 July 2024; Accepted: 29 October 2024;
Published: 22 November 2024.
Edited by:
Ioannis Dimitrios Zoulias, United Kingdom Atomic Energy Authority, United KingdomReviewed by:
Harun Tugal, United Kingdom Atomic Energy Authority, United KingdomYingwei Guo, Northeast Petroleum University, China
Ruth Maltby, CMR Surgical Ltd., United Kingdom
Copyright © 2024 Zoller, von Ballmoos, Gerig, Cattin and Rauter. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Nicolas Gerig, bmljb2xhcy5nZXJpZ0B1bmliYXMuY2g=