- Suzumori Laboratory, Department of Mechanical Engineering, School of Engineering, Tokyo Institute of Technology, Tokyo, Japan
Introduction: Robotic exoskeletons are emerging technologies that have demonstrated their effectiveness in assisting with Activities of Daily Living. However, kinematic disparities between human and robotic joints can result in misalignment between humans and exoskeletons, leading to discomfort and potential user injuries.
Methods: In this paper, we present an ergonomic knee exoskeleton based on a dual four-bar linkage mechanism powered by hydraulic artificial muscles for stair ascent assistance. The device comprises two asymmetric four-bar linkage mechanisms on the medial and lateral sides to accommodate the internal rotation of the knee and address the kinematic discrepancies between these sides. A genetic algorithm was employed to optimize the parameters of the four-bar linkage mechanism to minimize misalignment between human and exoskeleton knee joints. The proposed device was evaluated through two experiments. The first experiment measured the reduction in undesired load due to misalignment, while the second experiment evaluated the device’s effectiveness in assisting stair ascent in a healthy subject.
Results: The experimental results indicate that the proposed device has a significantly reduced undesired load compared to the traditional revolute joint, decreasing from 14.15 N and 18.32 N to 1.88 N and 1.07 N on the medial and lateral sides, respectively. Moreover, a substantial reduction in muscle activities during stair ascent was observed, with a 55.94% reduction in surface electromyography signal.
Discussion: The reduced undesired load of the proposed dual four-bar linkage mechanism highlights the importance of the adopted asymmetrical design for reduced misalignment and increased comfort. Moreover, the proposed device was effective at reducing the effort required during stair ascent.
1 Introduction
Falling accidents are a major health risk in older people. Canadian Institute for Health Information (2011) reported that 74% of hospitalizations from major injuries for cases aged 65 and older were caused by falls. Moreover, unintentional falls are the leading external cause of death, causing 76% of deaths from injury in the 65 and older age group (Startzell et al., 2000). Most falls are unintentional (as opposed to intentional falls such as assault or suicide) and are preventable.
The specific actions involved in Activities of Daily Living (ADLs) play a crucial role in the risk of falling among older adults. Self-reported data from older adults indicate that stair ascent is one of the most challenging ADLs they encounter (Verghese et al., 2008). Statistical data also supports their concerns, with stair negotiation being some of the actions with the highest risk of accidents for the elderly (Startzell et al., 2000).
Older adults are more prone to falls due to several risk factors, including decreased muscle strength, balance impairment, and cognitive impairment (Al-Aama, 2011). The decreased muscular capability in particular is mechanically limiting older adults’ capability to perform ADLs. Hortobágyi et al. (2003) found that old adults perform stair ascents near their maximal capabilities. Another study by Böhme et al. (2022) reported a significant power deficit in the elderly during stair ascent.
The identification of stair ascent as one of the actions associated with an elevated risk of falls highlights the importance of targeting stair ascent for preventive interventions and assistive technologies. One such technology is robotic exoskeletons, which was found to be beneficial for stair ascent assistance; Woo et al. (2021) evaluated the effectiveness of a lower limb exoskeleton for stair ascent assist in healthy young persons. They found that metabolic costs, namely, net oxygen cost and total heartbeats were reduced with assistance without affecting climbing speeds. Chandrapal et al. (2013) found that a knee joint exoskeleton can significantly reduce muscle activity of an able-body user during stair ascent. These studies illustrate the promising potential of exoskeleton technology for stair ascent assistance.
However, a significant issue of current exoskeletons is physical Human-Robot Interaction (pHRI), which concerns the transmission of forces or torque between the human musculoskeletal system and the structure of the robot. The design of the wearable robot should consider ergonomics and comfort as one of its design goals (Pons, 2008). Nevertheless, the intrinsic kinematic incompatibility between human joints and robotics joints makes this a challenge.
Most lower-extremities wearable robots utilize simple revolute joints which only allow pure rotation along a fixed axis as the knee joint (Celebi et al., 2013). In contrast, while the human knee joint is functionally similar to revolute joints, its movements are much more complex; the tibiofemoral joint surface has a unique combination of rolling and sliding of the tibia on the femur (Pinskerova et al., 2000; Blaha et al., 2003; Biščević et al., 2005) due to the following reasons. First, the shape of the femoral condyle is not circular: several mathematical models have been proposed including segments of circles (Pinskerova et al., 2000), and oval (Biščević et al., 2005). Second, there are four main ligaments in the knee, namely, the Anterior Cruciate Ligament (ACL), the Posterior Cruciate Ligament (PCL), the Medial Collateral Ligament (MDL), and the Lateral Collateral Ligament (LDL). These ligaments affect the percentage of the rolling-sliding ratio of the knee. Additionally, the femoral condyle has a different shape on the medial and lateral side, resulting in an internal rotation during the flexion motion of the knee, where the femur is shown to undergo an internal rotation relative to the tibia (Kurosawa et al., 1985; Pinskerova et al., 2000; Koo and Andriacchi, 2008; Feng et al., 2016).
The mismatch between the kinematics of a wearable robot and its wearer results in an undesired misalignment. The resulting misalignment may cause discomfort from abrasion (Pons, 2008; Akiyama et al., 2012; Séguin and Doumit, 2020; Zhang et al., 2020; Asker et al., 2021; Gao et al., 2021), and unintended load which may cause injuries such as muscle damage or internal bleeding (Lee and Guo, 2010; Akiyama et al., 2012; Séguin and Doumit, 2020; Bessler-Etten et al., 2022). The discomfort caused by these devices may cause the user to abandon the equipment (Phillips and Zhao, 1993). An ergonomic knee joint mechanism based on knee biomechanics may be able to reduce these concerns.
One of the simpler mechanisms aimed to improve pHRI is a serial revolute joint (Sulzer et al., 2009). The mechanism is also present in many commercial off-the-shelf knee braces (Singer and Lamontagne, 2008). The mechanism consists of three links: thigh, knee, and shank. Two gears inside the knee part make the angle between the thigh and the knee, and the knee and the shank equal. In this mechanism, the Instant Center of Rotation (ICR) is at the center of the knee part. During knee flexion, the ICR moves backward and upwards, which differs from the J-shaped centrode of natural knees (Séguin and Doumit, 2023).
A more complex approach is the four-bar linkage, which is one of the earliest knee mechanisms utilized in prosthetic (Radcliffe, 1994). The goal of utilizing the four-bar linkage in lower limb prostheses was to increase stability and achieve knee lock in the stance phase of walking.
Four-bar linkage mechanisms have also been applied to simulate various aspects of the knee joint, including the ACL and PCL ligaments (Zavatsky and O’Connor, 1992), the shape of the condyle (Karami et al., 2004), and the centrode and axoid of the knee (Bertomeu et al., 2007; Kim et al., 2015; Gao et al., 2021). Zavatsky and O’Connor (1992) found that there is minimal change in the length of the ligaments during knee flexion. They proposed that a stiff bar model is a reasonable simplification of the human knee. Karami et al. (2004) optimized a four-bar linkage to the shape of the condyle. Lastly, various studies including Bertomeu et al. (2007), Kim et al. (2015), and Gao et al. (2021) replicated the centroid or axoid of the human knee using a four-bar linkage. They used optimization techniques such as genetic algorithm (GA) or particle swarm optimization to optimize the initial position of four-bar linkages. They found that four-bar linkage has a significant improvement over simple revolute joints and polycentric serial revolute joints (Bertomeu et al., 2007).
Although a planar four-bar linkage is an improvement over simpler mechanisms, it cannot account for the internal/external rotation of the tibia. In response, Zeng et al. (2022) proposed a 2-DoF humanoid dual cross four-bar mechanism, which not only utilizes the four-bar linkage to allow for ICR translation but also incorporates a set of adaptive roller mechanisms to allow for internal rotation. The researchers suggested that either a dual asymmetric four-bar linkage or a roller mechanism could be adopted to enable internal rotation, thus providing greater flexibility and precision in the design of exoskeletons.
The layout of the knee joint exoskeleton is also a crucial consideration in support design. A unilateral exoskeleton with soft support can exert an undesired twisting force (Wang et al., 2018; Sarkisian et al., 2020). This further contributes to misalignment and discomfort in the device. To address this issue, several solutions can be considered, such as adopting a two-side-support layout, using stiff support braces, or supporting on the anterior or posterior side of the leg. However, each solution comes with its own challenges: a two-side-support layout needs to account for the internal rotation of the knee, stiff braces may cause additional discomfort, and implementing anterior support is considerably more complex than other layouts (Wang et al., 2018).
In this study, we propose an exoskeleton based on dual four-bar linkage for stair ascent assistance. A two-side-support layout was adopted to minimize the undesired twisting force and reduce misalignment instead of lateral support. Two sets of asymmetric four-bar linkages are installed on the lateral and medial sides of the knee joint. To account for the kinematic differences and internal rotation of the knee joint, the four-bar linkages were specifically designed and optimized for the biomechanics of each side of the knee. This allows the device to overcome the limitations of previous four-bar linkage-based assistive exoskeletons. To actuate the exoskeleton, we selected the Hydraulic Artificial Muscle (HAM) as the actuator. The HAM has a very high force density and energy density compared to other types of actuators (Mori et al., 2010; Morita et al., 2018), making them suitable for wearable robotics. Furthermore, it is also very light, reducing the added burden to the user and improving the comfort of the device. Lastly, the HAM allows a remote actuation system to be adopted, improving weight distribution of the wearable device.
In wearable devices, the added weight and moment of inertia has a significant effect on the human user. In Royer and Martin (2005), the researchers attached several configurations of mass to the participant’s lower extremity to determine the effects of added weight and moment of inertia during walking. They found that increasing either the added weight or moment of inertia result in an increase in energy cost compared to a baseline setup. Another study (Liu et al., 2021) evaluated the effects of weight distribution of exoskeletons on muscle activities. They created four knee exoskeletons using identical components, with a different motor and gear box positioning. They found that muscle activities varied among weight distributions and movements. These studies highlights the significance of added weight and weight distribution of exoskeletons, and the importance of a lightweight actuator such as the HAM in wearable devices.
In our earlier work (Kittisares et al., 2020), we proposed a sit-to-stand exoskeleton based on a four-bar linkage and the HAM. The proposed device was able to generate the knee torque profile required for sit-to-stand and was effective at assisting the sit-to-stand in a human experiment. This study is an improvement of our earlier work, with a primary focus on reducing discomfort resulting from human-robot misalignment. In particular, the proposed design considers the kinematics of the knee in a three-dimensional space and facilitates internal knee rotation through a novel dual four-bar linkage design. This enhancement significantly improves the comfort of the device and enhances force transmission when compared to the single planar mechanism with stiff braces used in our earlier work. Moreover, the two-side-support layout enables a larger torque output, allowing the device to assist with stair ascent which demands significantly greater torque than sit-to-stand.
The remainder of this paper is organized as follows: Section 2 proposes and describes the requirements and design of the device. Section 3 evaluates the effectiveness of the device through experiments, and Section 4 discusses the implications of this study and concludes this paper.
2 Materials and methods
The proposed exoskeleton comprises two main components: the ergonomic four-bar linkage joint mechanisms and the HAM. The device incorporates dual four-bar linkages situated on the medial and lateral sides in a dual-side-support arrangement. These four-bar linkages serve multiple functions, including emulating the kinematics of the human knee joint, serving as attachment points for the HAM, and providing installation positions for connective equipment. The four-bar linkages are designed asymmetrically to accommodate the inherent asymmetry of the human knee joint.
The HAMs, in contrast, are the active component that provides assistive force to the exoskeleton. This force is transmitted to the user via the linkage mechanism and the connective equipment. The HAMs were selected as the actuator due to their high force density and back-drivability, both of which are crucial for wearable devices. Each linkage mechanism on both the medial and lateral sides is equipped with a HAM, enabling the delivery of assistive torque to both sides. This configuration helps reduce undesired twisting forces, thereby reducing human-robot misalignment and enhancing comfort.
2.1 Dual four-bar linkage design
Although four-bar linkage mechanisms have been shown to reduce kinematic incompatibility, one issue of using symmetrical four-bar linkages on both sides to replicate the kinematics of the knee joint is that it cannot account for internal/external rotation of the knee caused by kinematic differences between the medial and lateral sides. Therefore, the proposed four-bar linkage mechanism accounts for this asymmetry by reproducing the kinematics of the femur on the lateral and medial sides individually. As the medial-lateral translational motion of the tibia is relatively small, it is assumed to be negligible, and the three-dimensional motion of the tibia is approximated using two planar four-bar linkage mechanisms on the medial and lateral sides of the knee.
Consider the four-bar linkage consisting of four rigid links connected by four revolute joints with two coupler points as shown in Figure 1. The linkage mechanism was designed in moving tibia on the fixed femur coordinate, with the origin point corresponding to the geometric center axis of the condyle (Feng et al., 2016). The positive x and y values correspond to the posterior and proximal directions, respectively. Let the position of the joints be denoted by A, B, C, and D, the positions of coupler points denoted by E and P, and the angles of the links AB, BC, CD, and AD denoted by θ1, θ2, θ3, and θ4, respectively. Next, r1, r2, r3, r4, and r5 correspond to the lengths of link AB, BC, CD, AD, and BE respectively. The link AD represents the stationary femur link, while link BC represents the moving tibia. Point P denotes the coupler point which traces the path of the tibia plateau, while points E and F denote the fixing point of the HAM.
The flexion angle of the knee joint, denoted by θknee, is defined as θknee = 0° when the knee is fully extended. It is given by the sum of the angle of the tibia link and its initial angle given by θi:
The four-bar linkage mechanism can be solved using Freudenstein’s Equation (Freudenstein, 1955). Freudenstein’s Equation allows the positions of each link to be solved as a function of the angle of the coupler link. Using Freudenstein’s Equation, the relation between θ1 and θ2 is given by
where:
Since the angle θ4 is constant, solving the angle θ1 as a function of θ2 will allow the θknee to be solved. The solution of the four-bar linkage is given below.
where:
k4 = sin(θ2 − θ4),
k5 = cos(θ2 − θ4) − k2,
k6 = k3 cos(θ2 − θ4) − k1, and
k7 =
This will allow point B, and subsequently, points C and P, of the four-bar linkage mechanism to be found at any angle of the coupler link.
To accurately generate the trajectory of the anatomical axis using the four-bar linkage mechanism, an optimization method is necessary as it is not possible to solve for the optimal value directly. Previous research efforts focused on developing optimal ergonomic four-bar linkage mechanisms that could replicate the centrode or axoid of the anatomical knee joint. However, this approach can be prone to error, as both the tangent method and the Reuleaux method used to determine the centrode or axoid are sensitive to measurement errors (Zatsiorsky, 2002). Furthermore, small errors in the centrode or axoid can accumulate to a large final translation error due to the centrode and axoid being based on instantaneous values. Therefore, in this paper, we propose reproducing the translational motion of the tibia at any orientation instead. This will reduce the accumulative error compared to replicating the centrode or axoid.
The objective of this optimization is to minimize the error between the biomechanical trajectory of the tibia plateau and the trajectory generated by the coupler point P in the four-bar linkage mechanism. To achieve this objective, the Euclidean distance between the translational displacement of the two trajectories is minimized at any orientation. The biomechanical trajectory is based on the data published in Feng et al. (2016). The problem can be formulated as an optimization problem as:
where:
x denotes the optimization variable vector containing initial x-y coordinates of points A, B, C, and D, i.e., x = ⟨xA, xB, xC, xD, yA, yB, yC, yD⟩,
f denotes the function of position vector of point P of the four-bar linkage at angle i,
θmax denotes the maximum knee flexion angle, and
Pknee,i denotes position vector of the biological knee joint at angle i.
The maximum and minimum values of joint positions are in place to avoid a bulky and unfeasible solution. Since the objective function of the optimization is nonconvex, a global optimization technique is required. In this study, the parameters were first optimized using GA, then the optimization results were further fine-tuned using the quasi-Newton method.
The GA is a suitable optimization method for four-bar linkage design due to its ability to solve highly nonlinear optimization problems with complex constraints. Four-bar linkage design involves determining the lengths of the links and the initial joint angles to achieve specific motion requirements. The design space for these variables can be vast and contains multiple local minima. The GA’s ability to explore a nonlinear search space allows it to search for solutions in this complex optimization problem.
The GA in this study was implemented using the Global Optimization Toolbox in MATLAB 2021a (MathWorks, MA, United States). The population size was 2000, as a smaller population was not able to explore the search space sufficiently to reach a reasonable solution due to the complexity of the four-bar linkage problem. Other options were default options, namely, the selection method was Stochastic Universal Sampling, the crossover method was Crossover Scattered, and the mutation function was Gaussian mutation.
To further optimize the results obtained from GA, a quasi-Newton method was used to fine-tune the results obtained from GA. A similar approach has been adopted in Chandra and Omlin (2007), where they used gradient descent, another gradient-based method, to fine-tune the optimized results from GA. By using a gradient-based method for fine-tuning, the optimization process can converge faster within the basin of attraction, which allows the optimal solution to be found more efficiently. In this study, the implementation of the BFGS algorithm in MATLAB 2021a was utilized. The optimization process was carried out 50 times each for both the medial and lateral link mechanisms to increase the success probability of the GA.
The optimization results of the medial land lateral links with the trajectory traced by the human tibia plateau and the optimal mechanism are displayed in Figures 2, 3, respectively. The initial coordinates of each point in the optimal four-bar linkage mechanisms are given in Table 1.
FIGURE 2. The optimal four-bar linkage configuration of the medial side at 0° and 120° knee angles. The trajectories of the human tibia and the proposed mechanism is shown in blue and orange, respectively.
FIGURE 3. The optimal four-bar linkage configuration of the lateral side at 0° and 120° knee angles. The trajectories of the human tibia and the proposed mechanism is shown in blue and orange, respectively.
2.2 Hydraulic artificial muscle
The HAM, shown in Figure 4, is a contracting actuator based on the McKibben muscle. However, instead of operating with pneumatic power as originally designed (Tondu, 2012), the HAM is operated with hydraulic power. This allows it to operate at a much higher pressure, resulting in a significantly larger contraction force.
The HAM has three main components: the inner rubber tube, the outer braided sleeve, and the fittings on both ends. The outer sleeve is woven in a double-helix pattern at a specific angle. This allows the sleeve to transform the radial expansion of the inner tube into axial contraction force; when hydraulic pressure is applied to the rubber tube, it expands radially. The radial expansion of the tube, and, in turn, the sleeve, causes the braiding angle of the sleeve to widen similar to a pantograph. This phenomenon converts the radial expansion into contraction force.
The theoretical contraction force of an ideal HAM can be derived from the relationship between inflation pressure and the braiding angle of the outer sleeve. It was first given in Schulte (1961) as a function of braiding angle with correction terms for tubing elasticity and internal frictions. Ignoring the correction terms, Schulte’s equation can also be simplified as a function of contraction as
where:
F is contraction force,
P is applied pressure,
d0 is initial sleeve diameter,
ϕ0 is initial braiding angle, and
ɛ is contraction ratio.
The theoretical maximum contraction is found at
The theoretical maximum contraction force is found at rest length and can be found by equating ɛ = 0 which results in
However, as the simplified model completely disregards the inner rubber tube, it cannot predict the different stress-strain curves between loading and unloading of the HAM, which stems from various factors including sleeve frictions and rubber elastic hysteresis (Treloar, 2005; Tondu, 2012; Kurumaya et al., 2017). Moreover, the theoretical model greatly overpredicts the maximum contraction ratio. Therefore, the force-contraction relationship of the HAM in the design process was modeled using the least squares linear regression on the unloading curve instead.
In the human knee, the quadriceps, which is the extensor muscle of the knee, is situated on the front of the thigh. Similarly, in our exoskeleton, the HAM is connected to between link AD and BC to generate knee extension torque. The HAM is fixed to the tibia link BC at the coupler point E, and fixed to the femur link AD at point F.
The torque output of the device can be calculated from the cross product of the lever arm vector between the ICR of the four-bar linkage and the force vector. The ICR of link BC is located at the intersection between link AB and CD.
Finally, the torque output of the device, denoted by τ, is given by
The design process to determine to locations of points E and F are as follows. First, the length of the HAM is given. Next, link BC was extended from point B by length r5 and angle ψ, creating point E, which is where the HAM is connected to link BC. Then, to match the contraction ratio of the HAM to the motion range of the device, a circle with a radius equal to the length of the HAM at maximum contraction was drawn with the point E at θknee = 0° as its center. Next, another circle with a radius equal to the HAM at rest length was drawn with point E at maximum flexion angle as its center. The two circles have two intersections, and the intersection on the proximal side (i.e., on the thigh) is selected as the fixing point F on link AD. This process ensures that the HAM will be at rest length at the maximum flexion angle, and fully contracted when θknee = 0°, effectively preventing the device from bending the knee beyond its natural range of motion.
The optimal values of r5 and ψ were selected by using grid search to optimize for the values with the maximum sum of knee extension torque between 40° and 70°, which is the range where the peak torque during stair ascent was reported in the literature. The values were also selected such that the device will not generate negative torque, hindering the motion at any knee joint position. The lateral link was designed with a slightly wider range of motion to account for internal rotation.
The final design of the device is displayed in Figure 5.
2.3 Experimental validation
Two experiments were conducted to verify the effectiveness of the proposed exoskeleton. First, the improved comfort of the proposed dual four-bar linkage mechanism was evaluated using a pressure sensor to measure the unintended load acting on the leg due to human-robot misalignment. Second, a human trial has been conducted to verify the effectiveness of the device in humans. The participant in both experiments was one of the authors; therefore, ethical review and approval were not required.
2.3.1 Undesired load measurement
When a wearable device with incompatible kinematics to the natural biomechanics of the human body is worn, the misalignment can cause undesired load to the user at the support equipment that connects the device to the human body. This undesired load causes discomfort and pain, and can potentially injure the user. In this experiment, this undesired load is measured to evaluate the improved comfort of the proposed mechanism.
In this experiment, stiff braces were used to connect the wearable device to the user’s body. These braces were carefully designed and 3D-printed to fit the user’s body contours, ensuring a secure and customized attachment. The braces were fixed to the user’s body using hook-and-loop fastener straps. Two braces were used for each of the shank and thigh parts of the device, resulting in a total of four braces.
To measure the undesired load, a thin film force sensing resistor (MD30-60, Walfront) was inserted between the lower shank brace and the user’s leg. This position is where the undesired load was felt intensely in preliminary tests. Both sides of the sensor were attached with a thin plate to normalize the contact surface. The sensor was calibrated to ensure precise sensor readings. The experiment setup is illustrated in Figure 6.
FIGURE 6. Experiment setup of the undesired load experiment. The subject was seated with their leg hanging above the ground. The pressure sensor was inserted under the lower shank brace on the anterior side of the leg.
The proposed dual four-bar linkage mechanism was compared against an identical orthosis equipped with a revolute joint and a four-bar linkage proposed by Karami et al. (2004). In their paper, they concluded that the kinematic differences between the medial and lateral sides were negligible. The implementation of the Karami model four-bar linkage was discussed in detail in our previous paper (Kittisares et al., 2020). All mechanisms were outfitted with identical braces at approximately the same distance from the knee joint. The experiment was conducted on a 28-year-old healthy male with a height of 1.65 m and a body mass of 54 kg. The experimental methodology is as follows:
1. The participant wears the device while seated and the knee at approximately 90° angle.
2. The participant extends and flexes their leg a few times and readjusts the straps to align the device with the biological joint.
3. The participant is seated with their legs hanging.
4. The participant slowly extends their leg until fully extended, then slowly returns to the hanged position. This step is repeated for 10 times.
2.3.2 Support evaluation
In this section, a human trial was conducted to evaluate the effectiveness of the proposed device in assisting a natural stair ascent motion in a healthy subject. The surface electromyography (sEMG) signal was monitored to measure the level of muscle activation during stair ascent with and without assistance from the device.
The stair used in this study had two steps, with a 160 mm rise and 265 mm run. These dimensions are within the Japanese Building Standard Law. The participant was a 28-year-old healthy male with a 1.65 m body height and 54 kg body mass. The device was equipped with 3D-printed braces and slots, a rubber strap, and hook-and-loop fastener straps as shown in Figure 7. The weight of the device including connective equipment was 3.7 kg. The subject wore the device on the left leg. First, the participant placed their left foot on Step 1 in a natural position. Next, the participant climbs the stairs, lifting their right foot from the ground to Step 2 in a natural trajectory. A photograph of the participant while performing stair ascent is shown in Figure 8. The sEMG signal was measured during the stance phase of the supported leg.
A natural sEMG signal during stair ascent without wearing the device was compared with two support strategies. In the slow assistance configuration, the pump flow rate was limited to 0.58 cm3/sec, resulting in a gradual increase in actuator pressure. The supply pressure increased gradually similar to a ramp function until reaching the maximum pressure of 3 MPa in approximately 2 s. On the other hand, in the instant assistance configuration, the flow rate limit was increased to 2.33 cm3/s. This allows the supply pressure to increase to the maximum value of 3 MPa in a much shorter window. The subject performed ten trials of the experiment for each configuration.
Hydraulic pressure was supplied and controlled using a servo pump consisting of a fixed displacement water pump (ASP035-T110, LEVEX Corporation, Kyoto, Japan) and a 3-phase AC servo motor (HG-SR51B, Mitsubishi Electric Corporation, Tokyo, Japan). The pump is directly connected to the proposed device. This allows the supplied pressure to be directly controlled by varying the torque exerted by the servo motor. The servo motor was controlled using a servo amplifier (MR-J4a, Mitsubishi Electric Corporation, Tokyo, Japan) and a controller board (MicroLabBox, dSPACE Inc., MI, United States) operating at 1 kHz. The servo pump has a maximum working pressure of 5 MPa. The implementation of the hydraulic source equipment was discussed in detail in Kittisares et al. (2022), Kittisares et al. (2023).
The sEMG signal on the left Rectus femoris was measured using a surface electromyography device (FREEEMG 1000, BTS Bioengineering, MI, Italy). The signal was sampled at 1 kHz, and processed with a sliding window root-mean-square of 200 sample windows length. The signals were resampled and normalized to the stair ascent duration, and then the averages between the ten trials were calculated.
3 Results
3.1 Preliminary results
First, preliminary experiments were conducted to measure the properties of the HAM used in this study for the design process. The HAM used in this study has an initial braiding angle of 25°, an outer diameter of 12 mm and a contracting lenght of 166 mm. Other properties of the HAM used in this paper are summarized in Table 2. The HAM was initially fixed on one end, and the other end was fixed to a hydraulic cylinder rod with a load cell in between to measure the contraction force. The experimental methodology is as follows:
1. The hydraulic cylinder rod is adjusted so that the HAM is at its neutral length.
2. Hydraulic pressure is applied to the HAM.
3. The hydraulic cylinder is extended until the measured contraction force is reduced to zero.
4. The hydraulic cylinder contracts to its initial length.
5. The hydraulic cylinder is extended again until the contraction force reduces to zero.
The resulting theoretical and experimental force output are shown in Figure 9. It can be seen that the maximum contraction force predicted by the theoretical model agrees well with the experiment results especially at higher pressure, where the influences of rubber hardness and various frictions diminish in significance.
FIGURE 9. Experimental and theoretical force-contraction relationship of the HAM used in this paper.
As a result, the HAM was instead modeled using linear regression for the design process. Only the unloading curve of the HAM was modeled to reduce the effects of rubber hysteresis. The linear regression model of the HAM is displayed is Figure 10.
3.2 Undesired load measurement
The experimental results show a significant reduction in undesired force acting on the shank part as shown in Table 3. Moreover, the participant reports significantly reduced pain at the contact area at the braces.
TABLE 3. The mean and standard deviation of peak load acting on the lower shank brace during extension motion in N.
The experiment results show that in orthoses with traditional revolute joints, kinematic differences between a mechanical joint and a biological joint may cause discomfort and pain. On the other hand, the proposed four-bar linkage mechanism which aims to mimic the biomechanics of the human knee joint can significantly improve comfort by reducing undesired loads at connective equipment.
3.3 Support evaluation
The processed sEMG signal showed a reduction in muscle activity with the assistance of the device as shown in Figure 11. The maximum processed sEMG signal reduced from 52.34 µV without assistance to 26.09 µV with slow assistance, and 23.06 µV with instant assistance. This corresponds to a 50.15% reduction for slow assistance and 55.94% reduction for instant assistance.
4 Discussion
The optimized mechanism was compared to a simple revolute joint and four-bar mechanisms proposed in the literature. The positions of all mechanisms were optimized, and the coupler link of the four-bar linkage mechanism was extended with an optimal coupler point to minimize the errors. All mechanisms were compared to the data in Feng et al. (2016). The errors are summarized in Table 4.
Comparisons with previous four-bar linkage designs confirmed the importance of an asymmetric design to reduce human-robot misalignment. Although Karami et al. (2004) suggested that the kinematic differences between medial and lateral sides are negligible, comparisons with data reported in Feng et al. (2016) contradicts with their assumption; four-bar mechanisms in Zavatsky and O’Connor (1992) and Karami et al. (2004) showed a significantly reduced error compared to a revolute joint on the lateral side, from 5.69 mm to 1.72 mm and 1.81 mm, respectively. However, the errors were much larger on the medial side, at 5.08 and 5.49 mm, respectively. This highlights the importance of using an asymmetric four-bar linkage design, which has a much lower RMSE of 0.35 and 0.46 mm on the medial and lateral sides, respectively.
Experimental findings also supported the theoretical outcomes, as the (Karami et al., 2004) model exhibited a notably larger undesired load on the medial side. This highlights the importance of the asymmetrical design adopted in our exoskeleton for improved comfort.
The literature on the kinematics of stair ascent has seen several studies conducted, but there is a notable variation in their results. The reported peak torque normalized to body mass varies from as low as 0.58 Nm·kg−1 in Protopapadaki et al. (2007) to as high as 1.72 Nm·kg−1 in Larsen et al. (2009). The angle at which the peak torque occurred also varies between 40° and 70° (Andriacchi et al., 1980; McFadyen and Winter, 1988; Salsich et al., 2001; Riener et al., 2002; Hortobágyi et al., 2003; Reid et al., 2007; Reeves et al., 2009; Böhme et al., 2022). The maximum reported mean of peak flexion angle was 106° (Böhme et al., 2022).
One significant factor contributing to this variation is the age of participants involved in the studies. For instance, Hortobágyi et al. (2003) and Böhme et al. (2022) specifically examined the effects of participant demographics on stair ascent kinetics. The results revealed a significant difference in peak knee torque between old and young groups, highlighting the influence of participant characteristics on the observed kinetics. Other factors such as stair dimensions also impact the resulting knee torque during stair ascent.
The theoretical peak torque of the proposed device is 152.44 Nm which occurs at 57°. This is equivalent to 2.09 Nm·kg−1 normalized to body parameters reported in De Leva (1996) and Zatsiorsky (2002). Moreover, this value is greater than the 1.72 Nm·kg−1 reported in Larsen et al. (2009), which is the highest value found in the literature. Therefore, we believe that the developed device is capable of providing sufficient assistive torque for stair ascent assistance. The theoretical torque output of the device on both sides and the total torque are presented in Figure 12.
A human trial was conducted to evaluate the supportive capabilities of the proposed exoskeleton. sEMG signals were used to measure muscle activity during stair ascent with and without the device, and the results showed a significant reduction in muscle activity when the device provided assistance, with the sEMG signal reducing by 55.94% from 52.34 to 23.06 µV. This reduction in muscle activity indicated that the exoskeleton effectively offloaded the user’s muscles, reducing the effort required during stair ascent.
Two assisting strategies, namely, slow assistance, which gradually increases the assistive torque, and instant assistance, which instantaneously applies the assistive torque, were examined. Although the instant assistance scheme showed a slightly lower sEMG level, a more gentle application of assistive force gives the user more time to adjust and stabilize their motion. This finding may serve as another consideration for the mechanical design and hydraulic systems in future iterations.
The exoskeleton is powered by a hydraulic remote actuation system, which requires the device to be tethered. This limits the operating range of the device to a limited area. However, the proposed mechanism design can still be adopted in areas where the limited operating range is not an issue such as rehabilitation. Alternatively, adopting a smaller hydraulic pump design (Nath and Durfee, 2017; Mao et al., 2021) or a follower robot (Tani et al., 2011) can enable the exoskeleton for outdoor use.
In summary, this study proposes an exoskeleton designed for aiding stair ascent with a primary focus on the reduction of discomfort resulting from human-robot misalignment. The device incorporates a novel dual four-bar linkage mechanism that considers the asymmetry of the medial and lateral sides of the condyle, resulting in a more anatomically accurate motion. The kinematics of the mechanism were optimized using a genetic algorithm, aiming to replicate the translational motion of the knee joint at any orientation. This optimization process helped achieve a more natural movement pattern and improved comfort.
The effectiveness of the proposed device was assessed through two experiments. The first experiment evaluated discomfort by measuring the undesired load caused by human-robot misalignment, while the second experiment assessed the device’s efficacy in a human participant. Experiment results found that the developed device exhibits significantly lower undesired loads compared to traditional revolute joint mechanisms and previous designs found in the literature. Additionally, the muscle activity of the participant during stair ascent decreased significantly with the assistance of the device.
Future work includes the improvement of the mechanical design of the mechanism and support equipment. The mechanical components of the exoskeleton could undergo further analysis and redesign to enhance their compactness, efficiency, durability, and comfort. Another area of improvement lies in the hydraulic equipment. While the experimental pump and valves used in this study confirmed the effectiveness of the proposed control schemes, actual hydraulic application necessitates a further reduction in size and weight. Lastly, conducting a human trial specifically with elderly participants would be essential to validate the exoskeleton’s effectiveness for its intended use case.
Data availability statement
The raw data supporting the conclusion of this article will be made available by the authors, without undue reservation.
Ethics statement
Ethical approval was not required for the studies involving humans because the research participant was one of the authors. According to the university regulations, ethical approval from the Tokyo Institute of Technology’s Human Subjects Research Ethics Review Committee is not required for self-experimentation. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.
Author contributions
SK: Conceptualization, Investigation, Methodology, Writing–original draft. TI: Resources, Writing–review and editing. HN: Conceptualization, Supervision, Writing–review and editing. KS: Conceptualization, Funding acquisition, Project administration, Supervision, Writing–review and editing.
Funding
The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This work was supported by the JSPS KAKENHI Grant-in-Aid for Scientific Research(A) grant number JP18H03760.
Acknowledgments
The authors wish to thank Dr. Shingo Oono, Dr. Yunhao Feng, Mr. Shinki Tei, and Mr. Christian Brice for their assistance in this study.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
Akiyama, Y., Yamada, Y., Ito, K., Oda, S., Okamoto, S., and Hara, S. (2012). “Test method for contact safety assessment of a wearable robot-analysis of load caused by a misalignment of the knee joint,” in 2012 ieee ro-man: the 21st IEEE international symposium on robot and human interactive communication (IEEE), 539–544.
Andriacchi, T., Andersson, G., Fermier, R., Stern, D., and Galante, J. (1980). A study of lower-limb mechanics during stair-climbing. JBJS 62, 749–757. doi:10.2106/00004623-198062050-00008
Asker, A., Xie, S., and Dehghani-Sanij, A. A. (2021). “Multi-objective optimization of force transmission quality and joint misalignment of a 5-bar knee exoskeleton,” in 2021 IEEE/ASME international conference on advanced intelligent mechatronics (AIM) (IEEE), 122–127.
Bertomeu, J. M. B., Lois, J. M. B., Guillem, R. B., Del Pozo, Á. P., Lacuesta, J., Mollà, C. G., et al. (2007). Development of a hinge compatible with the kinematics of the knee joint. Prosthetics Orthot. Int. 31, 371–383. doi:10.1080/03093640601095842
Bessler-Etten, J., Schaake, L., Prange-Lasonder, G. B., and Buurke, J. H. (2022). Assessing effects of exoskeleton misalignment on knee joint load during swing using an instrumented leg simulator. J. neuroengineering rehabilitation 19, 13–18. doi:10.1186/s12984-022-00990-z
Biščević, M., Hebibović, M., and Smrke, D. (2005). Variations of femoral condyle shape. Coll. Antropol. 29, 409–414.
Blaha, J. D., Mancinelli, C. A., Simons, W. H., Kish, V. L., and Thyagarajan, G. (2003). Kinematics of the human knee using an open chain cadaver model. Clin. Orthop. Relat. Research® 410, 25–34. doi:10.1097/01.blo.0000063564.90853.ed
Böhme, M., Weiske, F., Jäkel, J., Zentner, J., and Witt, M. (2022). Evaluation of the power deficit of elderly people during stair negotiation: which joints should be assisted at least by an exoskeleton and with what amount? Wearable Technol. 3, e4. doi:10.1017/wtc.2022.1
Canadian Institute for Health Information (2011). National trauma registry 2011 report: hospitalizations for major injury in Canada, 2008–2009 data. Ottawa, Ont: CIHI.
Celebi, B., Yalcin, M., and Patoglu, V. (2013). “AssistOn-Knee: a self-aligning knee exoskeleton,” in IEEE international conference on intelligent robots and systems, 996–1002. doi:10.1109/IROS.2013.6696472
Chandra, R., and Omlin, C. W. (2007). “The comparison and combination of genetic and gradient descent learning in recurrent neural networks: an application to speech phoneme classification,” in Artificial intelligence and pattern recognition (citeseer), 286–293.
Chandrapal, M., Chen, X., and Wang, W. (2013). “Preliminary evaluation of a lower-limb exoskeleton-stair climbing,” in 2013 IEEE/ASME international conference on advanced intelligent mechatronics (IEEE), 1458–1463.
De Leva, P. (1996). Adjustments to zatsiorsky-seluyanov’s segment inertia parameters. J. biomechanics 29, 1223–1230. doi:10.1016/0021-9290(95)00178-6
Feng, Y., Tsai, T.-Y., Li, J.-S., Rubash, H. E., Li, G., and Freiberg, A. (2016). In-vivo analysis of flexion axes of the knee: femoral condylar motion during dynamic knee flexion. Clin. Biomech. 32, 102–107. doi:10.1016/j.clinbiomech.2015.12.006
Freudenstein, F. (1955). Approximate synthesis of four-bar linkages. Trans. Am. Soc. Mech. Eng. 77, 853–859. doi:10.1115/1.4014513
Gao, M., Wang, Z., Li, S., Li, J., Pang, Z., Liu, S., et al. (2021). Design and optimization of exoskeleton structure of lower limb knee joint based on cross four-bar linkage. AIP Adv. 11, 065124. doi:10.1063/5.0053899
Hortobágyi, T., Mizelle, C., Beam, S., and DeVita, P. (2003). Old adults perform activities of daily living near their maximal capabilities. Journals Gerontology Ser. A Biol. Sci. Med. Sci. 58, M453–M460. doi:10.1093/gerona/58.5.m453
Karami, M., Maurice, G., and Andre, J. (2004). A model of exo-prosthesis of the knee optimized with respect to the physiological motion of condyles. ITBM-RBM 25, 176–184. doi:10.1016/J.RBMRET.2004.03.003
Kim, J.-H., Shim, M., Ahn, D. H., Son, B. J., Kim, S.-Y., Kim, D. Y., et al. (2015). Design of a knee exoskeleton using foot pressure and knee torque sensors. Int. J. Adv. Robotic Syst. 12, 112. doi:10.5772/60782
Kittisares, S., Hirota, Y., Nabae, H., Endo, G., and Suzumori, K. (2022). Alternating pressure control system for hydraulic robots. Mechatronics 85, 102822. doi:10.1016/j.mechatronics.2022.102822
Kittisares, S., Hirota, Y., Nabae, H., and Suzumori, K. (2023). Open-looped pressure and volume control of multi-degree-of-freedom hydraulic systems. Mechatronics 95, 103068.
Kittisares, S., Nabae, H., Endo, G., Suzumori, K., and Sakurai, R. (2020). Design of knee support device based on four-bar linkage and hydraulic artificial muscle. Robomech J. 7, 16. doi:10.1186/s40648-020-00165-2
Koo, S., and Andriacchi, T. P. (2008). The knee joint center of rotation is predominantly on the lateral side during normal walking. J. Biomechanics 41, 1269–1273. doi:10.1016/J.JBIOMECH.2008.01.013
Kurosawa, H., Walker, P., Abe, S., Garg, A., and Hunter, T. (1985). Geometry and motion of the knee for implant and orthotic design. J. biomechanics 18, 487–499. doi:10.1016/0021-9290(85)90663-3
Kurumaya, S., Nabae, H., Endo, G., and Suzumori, K. (2017). Design of thin mckibben muscle and multifilament structure. Sensors Actuators A Phys. 261, 66–74. doi:10.1016/j.sna.2017.04.047
Larsen, A. H., Sørensen, H., Puggaard, L., and Aagaard, P. (2009). Biomechanical determinants of maximal stair climbing capacity in healthy elderly women. Scand. J. Med. Sci. sports 19, 678–686. doi:10.1111/j.1600-0838.2008.00845.x
Lee, K.-M., and Guo, J. (2010). Kinematic and dynamic analysis of an anatomically based knee joint. J. biomechanics 43, 1231–1236. doi:10.1016/j.jbiomech.2010.02.001
Liu, Y.-X., Zhang, L., Wang, R., Smith, C., and Gutierrez-Farewik, E. M. (2021). Weight distribution of a knee exoskeleton influences muscle activities during movements. IEEE Access 9, 91614–91624. doi:10.1109/access.2021.3091649
Mao, Z., Iizuka, T., and Maeda, S. (2021). Bidirectional electrohydrodynamic pump with high symmetrical performance and its application to a tube actuator. Sensors Actuators A Phys. 332, 113168. doi:10.1016/j.sna.2021.113168
McFadyen, B. J., and Winter, D. A. (1988). An integrated biomechanical analysis of normal stair ascent and descent. J. biomechanics 21, 733–744. doi:10.1016/0021-9290(88)90282-5
Mori, M., Suzumori, K., Takahashi, M., and Hosoya, T. (2010). Very high force hydraulic mckibben artificial muscle with a p-phenylene-2, 6-benzobisoxazole cord sleeve. Adv. Robot. 24, 233–254. doi:10.1163/016918609x12586209967366
Morita, R., Nabae, H., Endo, G., and Suzumori, K. (2018). A proposal of a new rotational-compliant joint with oil-hydraulic mckibben artificial muscles. Adv. Robot. 32, 511–523. doi:10.1080/01691864.2018.1464946
Nath, J. D., and Durfee, W. K. (2017). “Optimization and design principles of a minimal-weight, wearable hydraulic power supply,” in Dynamic systems and control conference (American Society of Mechanical Engineers), 58271, V001T30A002.
Phillips, B., and Zhao, H. (1993). Predictors of assistive technology abandonment. Assist. Technol. 5, 36–45. doi:10.1080/10400435.1993.10132205
Pinskerova, V., Iwaki, H., and Freeman, M. A. (2000). The shapes and relative movements of the femur and tibia at the knee. Orthopade 29, S3–S5. doi:10.1007/pl00003679
Protopapadaki, A., Drechsler, W. I., Cramp, M. C., Coutts, F. J., and Scott, O. M. (2007). Hip, knee, ankle kinematics and kinetics during stair ascent and descent in healthy young individuals. Clin. Biomech. 22, 203–210. doi:10.1016/j.clinbiomech.2006.09.010
Radcliffe, C. W. (1994). Four-bar linkage prosthetic knee mechanisms: kinematics, alignment and prescription criteria. Prosthetics Orthot. Int. 18, 159–173. doi:10.3109/03093649409164401
Reeves, N. D., Spanjaard, M., Mohagheghi, A. A., Baltzopoulos, V., and Maganaris, C. N. (2009). Older adults employ alternative strategies to operate within their maximum capabilities when ascending stairs. J. Electromyogr. Kinesiol. 19, e57–e68. doi:10.1016/j.jelekin.2007.09.009
Reid, S. M., Lynn, S. K., Musselman, R. P., and Costigan, P. A. (2007). Knee biomechanics of alternate stair ambulation patterns. Med. Sci. sports Exerc. 39, 2005–2011. doi:10.1249/mss.0b013e31814538c8
Riener, R., Rabuffetti, M., and Frigo, C. (2002). Stair ascent and descent at different inclinations. Gait posture 15, 32–44. doi:10.1016/s0966-6362(01)00162-x
Royer, T. D., and Martin, P. E. (2005). Manipulations of leg mass and moment of inertia: effects on energy cost of walking. Med. Sci. sports Exerc. 37, 649–656. doi:10.1249/01.mss.0000159007.56083.96
Salsich, G. B., Brechter, J. H., and Powers, C. M. (2001). Lower extremity kinetics during stair ambulation in patients with and without patellofemoral pain. Clin. Biomech. 16, 906–912. doi:10.1016/s0268-0033(01)00085-7
Sarkisian, S. V., Ishmael, M. K., Hunt, G. R., and Lenzi, T. (2020). Design, development, and validation of a self-aligning mechanism for high-torque powered knee exoskeletons. IEEE Trans. Med. Robotics Bionics 2, 248–259. doi:10.1109/tmrb.2020.2981951
Schulte, H. (1961). “The characteristics of the mckibben artificial muscle,” in The application of external power in prosthetics and orthotics, 94–115.
Séguin, É., and Doumit, M. (2020). “Review and assessment of walking assist exoskeleton knee joints,” in 2020 IEEE international conference on systems, man, and cybernetics (SMC) (IEEE), 1230–1235.
Séguin, É., and Doumit, M. (2023). Kinematic and kinetic assessment of a novel polycentric knee joint for powered walking assist exoskeletons. J. Phys. Med. Rehabilitation 5, 6–15. doi:10.33696/rehabilitation.5.034
Singer, J. C., and Lamontagne, M. (2008). The effect of functional knee brace design and hinge misalignment on lower limb joint mechanics. Clin. Biomech. 23, 52–59. doi:10.1016/j.clinbiomech.2007.08.013
Startzell, J. K., Owens, D. A., Mulfinger, L. M., and Cavanagh, P. R. (2000). Stair negotiation in older people: a review. J. Am. Geriatrics Soc. 48, 567–580. doi:10.1111/j.1532-5415.2000.tb05006.x
Sulzer, J. S., Roiz, R. A., Peshkin, M. A., and Patton, J. L. (2009). A highly backdrivable, lightweight knee actuator for investigating gait in stroke. IEEE Trans. Robotics 25, 539–548. doi:10.1109/TRO.2009.2019788
Tani, A., Endo, G., Fukushima, E. F., Hirose, S., Iribe, M., and Takubo, T. (2011). “Study on a practical robotic follower to support home oxygen therapy patients-development and control of a mobile platform,” in 2011 IEEE/RSJ international conference on intelligent robots and systems (IEEE), 2423–2429.
Tondu, B. (2012). Modelling of the mckibben artificial muscle: a review. J. Intelligent Material Syst. Struct. 23, 225–253. doi:10.1177/1045389x11435435
Treloar, L. R. G. (2005). The physics of rubber elasticity 3rd ed. edn. New York: Oxford University Press.
Verghese, J., Wang, C., Xue, X., and Holtzer, R. (2008). Self-reported difficulty in climbing up or down stairs in nondisabled elderly. Archives Phys. Med. rehabilitation 89, 100–104. doi:10.1016/j.apmr.2007.08.129
Wang, J., Li, X., Huang, T.-H., Yu, S., Li, Y., Chen, T., et al. (2018). Comfort-centered design of a lightweight and backdrivable knee exoskeleton. IEEE Robotics Automation Lett. 3, 4265–4272. doi:10.1109/LRA.2018.2864352
Woo, H., Kong, K., and Rha, D.-w. (2021). Lower-limb-assisting robotic exoskeleton reduces energy consumption in healthy young persons during stair climbing. Appl. Bionics Biomechanics 2021, 1–8. doi:10.1155/2021/8833461
Zavatsky, A. B., and O’Connor, J. J. (1992). A model of human knee ligaments in the sagittal plane: Part 1: response to passive flexion. Proc. Institution Mech. Eng. Part H J. Eng. Med. 206, 125–134. doi:10.1243/pime_proc_1992_206_280_02
Zeng, H., Zeng, B., Yuan, G., Liu, X., and Yu, Z. (2022). “Design and optimization of 2dof humanoid dual cross four-bar mechanism for knee joint of an exoskeleton,” in 2022 IEEE international conference on robotics and biomimetics (ROBIO) (IEEE), 555–562.
Keywords: exoskeleton, wearable robot, knee joint mechanism, physical human-robot interaction, stair ascent, hydraulic artificial muscle
Citation: Kittisares S, Ide T, Nabae H and Suzumori K (2023) Ergonomic dual four-bar linkage knee exoskeleton for stair ascent assistance. Front. Robot. AI 10:1285520. doi: 10.3389/frobt.2023.1285520
Received: 30 August 2023; Accepted: 14 November 2023;
Published: 06 December 2023.
Edited by:
Kenji Suzuki, University of Tsukuba, JapanReviewed by:
Erwin-Christian Lovasz, Politehnica University of Timișoara, RomaniaChristian Tamantini, Università Campus Bio-Medico di Roma, Italy
Copyright © 2023 Kittisares, Ide, Nabae and Suzumori. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Sarin Kittisares, c2FyaW4ta2l0dGlzYXJlc0BuZWMuY29t
†Present address: Sarin Kittisares, Visual Intelligence Research Laboratories, NEC Corporation, Kanagawa, Japan