- 1Robotic Rehabilitation Laboratory, Department of Mechanical Engineering, Center for Robotics of São Carlos, University of São Paulo, São Paulo, Brazil
- 2Intelligent Systems Laboratory, Department of Electrical Engineering, Center for Robotics of São Carlos, University of São Paulo, São Paulo, Brazil
The human-robot interaction has played an important role in rehabilitation robotics and impedance control has been used in the regulation of interaction forces between the robot actuator and human limbs. Series elastic actuators (SEAs) have been an efficient solution in the design of this kind of robotic application. Standard implementations of impedance control with SEAs require an internal force control loop for guaranteeing the desired impedance output. However, nonlinearities and uncertainties hamper such a guarantee of an accurate force level in this human-robot interaction. This paper addresses the dependence of the impedance control performance on the force control and proposes a control approach that improves the force control robustness. A unified model of the human-robot system that considers the ankle impedance by a second-order dynamics subject to uncertainties in the stiffness, damping, and inertia parameters has been developed. Fixed, resistive, and passive operation modes of the robotics system were defined, where transition probabilities among the modes were modeled through a Markov chain. A robust regulator for Markovian jump linear systems was used in the design of the force control. Experimental results show the approach improves the impedance control performance. For comparison purposes, a standard force controller based on the fixed operation mode has also been designed. The Markovian control approach outperformed the control when all operation modes were taken into account.
1. Introduction
Physical therapy represents a well-accepted procedure for improvements in the recovery of human motor function and promotion of higher performance in Activities of Daily Life (ADLs) (Krebs et al., 2008). Mainly when people have been affected by injuries such as stroke (Hatano, 1976) and Multiple Sclerosis (MS) (Cattaneo et al., 2002). Robotic-assisted therapy is a promising field for the development of rehabilitation tasks. Among the advantages offered by robotic devices are uniformity in the repetition of long-time routines, reliable records of measured variables, and motivation for the patient's participation using interactive environments like serious games (Lum et al., 2002; Chang and Kim, 2013; Gonçalves et al., 2014). However, the fact that these robots interact with humans during therapeutic movement, they require a high degree of security and reliability. Therefore, rehabilitation robots should identify activities performed by the patient to reach only pre-defined training objectives, whose principle is known as Assist-as-Needed Paradigm (Radomski and Trombly, 2013).
Impedance control has been used in the implementation of this kind of paradigm in rehabilitation robotic systems. It was initially proposed for manipulator robots to obtain a safe physical interaction with the environment (Hogan, 1985). Such a controller aims at establishing a dynamic relationship between the force and velocity of an actuator. Series elastic actuators (SEA) provide a simple and efficient solution for the implementation of impedance controllers (Calanca et al., 2016). However, the impedance control of SEAs requires an explicit force control loop whose performance is sensitive to uncertainties and time-varying human dynamics.
Colgate and Hogan (1988, 1989) addressed the problem of interaction control and analyzed the energy exchange between a robotic system and its environment, defined as passive. They also determined stability criteria for a coupled system. Some years later this analysis was brought into the context of human-robot interaction considering three new issues: (1) Human dynamics is now the environment; (2) This dynamics can exhibit passive and active behaviors; and, (3) The stability criterion has been reformulated as complementary stability (Buerger and Hogan, 2007). Such new concepts emphasize the way the human dynamics is taken into account. For example, Vallery et al. (2008) analyzed limits of coupled stability and performance of an SEA actuator for rehabilitation applications considering the human dynamics a spring and damping system. Kong et al. (2009) analyzed those limits considering the human dynamics only as a mass (inertia). In Oh and Kong (2017), the human dynamics was considered as stiffness, damping, and inertia. Li et al. (2017) proposed an adaptive control scheme for SEA-driven robots which consider two operation modes in the adaptation process, namely robot-in-charge and human-in-charge. Similar approaches were proposed in Yu et al. (2015) and Pan et al. (2017), however, the authors did not take into account the fact the human-robot system can be modeled by different operation modes related to abrupt changes in the dynamic behavior.
This paper reports on the implementation of an impedance controller in a robotic platform for ankle rehabilitation based on a Markovian approach. The platform uses an SEA and enables plantarflexion and dorsiflexion movements. The following three operation modes that may occur in the robot-human interaction were defined: (1) fixed mode, in which the platform is mechanically fixed; (2) resistive mode, in which the user makes efforts against the platform movement; and (3) passive mode, in which the user does not make any effort against the platform movement. Such operation modes are modeled as states of a Markov chain. Based on this modeling, a recursive robust regulator for discrete Markov jump linear systems (RR-DMJLS) proposed in Cerri and Terra (2017) is designed to regulate the force control. It guarantees mean square stability and optimal performance for this class of stochastic system (Jutinico et al., 2017). In order to check the effectiveness of the approach, we performed a comparative study with a standard force controller proposed in Pérez-Ibarra et al. (2017) which is designed based only on the higher-impedance operation mode (fixed). Although this control approach provides robust stability for the whole system, including all operation modes, its performance was outperformed by RR-DMJLS. We present actual results based on force- and impedance-control for both controllers.
The paper is organized as follows: Section 2 introduces the SEA-based robotic platform and its respective dynamic model; Section 3 describes the design of the robust controllers; Section 4 reports experimental results of a comparative study between the controllers; finally, Section 5 provides the conclusions and some final remarks for future work.
2. System Description and Modeling
The SEA-based Robotic Platform for Ankle Rehabilitation (SRPAR), Figure 1, is a device for robot-assisted training. It works under two conditions: guidance of a physiotherapist during pre-established dorsi/plantarflexion movements of the ankle and active participation of the patient by using serious games. Both conditions benefit individuals who have suffered a stroke. Also, the platform is a tool to evaluate the ankle force and range of movement (Gonçalves et al., 2013).
Figure 1. SEA-based Robotic Platform for Ankle Rehabilitation (SRPAR). (A) Platform (Gonçalves et al., 2014). (B) Squematic model.
The platform uses a DC motor (Maxon Motor RE 40, graphite brushes, 150 Watt DC motor) linked to a ballscrew through a belt and pulleys with 2:1 reduction ratio. A recirculating ballscrew nut converts the rotational motion of the screw in a linear motion. A pair of steel springs is attached to the nut and to a movable piece. When the motor is driven, the nut moves forward or backward compressing the springs. The movable part is connected to a kinematic chain which converts linear force into torque which is transferred to the user. We estimate the nut's position by measuring the motor rotation with a magneto-resistant incremental encoder. Finally, we estimate the spring force by measuring the spring deformation. A logarithmic sliding potentiometer is attached to the movable piece located between the springs. The potentiometer's cursor moves along with the piece generating a voltage proportional to the spring deformation.
2.1. Transfer Function Model
In order to describe the dynamic behavior of the system, we define three sub-systems in the SRPAR: motor-transmission system, series elastic element, and human-load system (Figure 1B). A set of assumptions is made to simplify the dynamic modeling, resulting in a linear model for the SRPAR. Although these simplifications can result in a limited model, mainly due to the presence of nonlinearities, the use of robust controllers to deal with uncertain parameters can improve the performance of the system.
Concerning the motor-transmission sub-system, although some studies deal with only the effect of the inertia in the motor model (Vallery et al., 2008; Calanca et al., 2014), in this paper we also consider the influence of the motor damping. The effects of the inertia and damping parameters of the pulley and ballscrew are also considered as in Yu et al. (2013) and dos Santos et al. (2015). In addition, the nonlinear effects of friction, backslash, and efficiency losses in the motor-transmission system are minimized by controlling the motor velocity instead of directly controlling the motor torque or current, as discussed in Wyeth (2006).
Regarding the series elastic configuration, in Petit et al. (2015) is presented a generic model for robotic systems with variable stiffness. They describe the output torque of the actuator by a nonlinear function that depends on the joint deflection and mechanical stiffness variation of the springs. In this paper, the springs are modeled as constant stiffness and operate in a linear region. Since the human limb is attached to the four-bar mechanism of the SRPAR, rotation of the ankle is transformed into a linear movement in the same direction of the spring force by a nonlinear Jacobian. However, due to a small range of allowed movements related to mechanical constraints of the SRPAR, this transformation is approximated by a linear relationship (see Equation 6). The gravity effects on the human foot are also neglected since the distance between the foots center of gravity and the rotation axis of the platform is small.
Different approaches have been proposed to model the dynamics of the human-load sub-system. For example, Tagliamonte and Accoto (2014) used a set of second-order plants to represent human dynamics in order to implement an impedance controller where passivity concepts are explored. In Lee et al. (2016), similar second-order models are used to measure the ankle mechanical impedance in a unified way. In this paper, we model the human dynamics as a set of second-order linear plants subject to parameter uncertainties.
In the following, we present a transfer function between the commanded motor velocity and the spring force Fs.
2.1.1. Dynamics of the Motor-Transmission System
Motor-transmission can be modeled as a second-order control system,
where Xw denotes the displacement of ball screw nut, Mmeq and Bmeq are respectively the equivalent inertia and damping of the system as defined in Equation (2), and Fmeq is the output force as defined in Equation (3),
In Equations (2) and (3), Mt and Bt are the mass and damping of the ball screw nut, J and C are torsional inertia and damping where subscripts m and p stand for motor and pulley, respectively. Np is the pulley ratio, is a rotational-to-linear factor where l is the ball screw lead. Kt is the motor constant, im is the motor current determined by the inner velocity control of the motor, and Kp and Ki are the proportional and integral gains of the controller; ωm and are actual and desired motor velocities, respectively.
2.1.2. Dynamics of the Human-Load System
Dynamics of the human ankle is modeled by a second-order system with inertia, damping and stiffness parameters given by:
where ϕl denotes the angular position of the ankle, τ is the torque, plat and h stand for platform and human being, and Gl(ϕl) represents the gravitational effects. Jl = Jplat + Jh and Cl = Cplat + Ch are the equivalent inertia and damping of the sub-system, respectively, and Kh is the ankle stiffness.
The linear displacement of the load, Xl, is expressed in terms of the angular movement of the human ankle joint ϕl, by:
where l1, l2, l3, and h are known distances of the platform (see Figure 1B). Based on linear and angular load velocities, we compute the following Jacobian:
Since we are considering a small range of allowed movements, approximately |ϕl| < 0.35 rad, this equation can be simplified by . As aforementioned the distance between the foot's center of gravity and the rotation axis of the platform is small, in this case we can neglect the gravitational effect Gl(ϕl). Hence, from Equations (4) and (6), the dynamics of the human-load system is given by:
where Ml, Bl, and Kl are respectively equivalent inertia, damping and stiffness of the human-load system, defined by:
2.1.3. Dynamics of the Series Elastic Actuator
Taking the Laplace transform of Equations (1) and (7), and solving for Xw and Xl, we obtain:
We make use of the Hooke's Law to define output spring force Fs:
From Equations (9) and (10), we have:
where Zmeq = Mmeqs + Bmeq and are the mechanical impedances of the motor-transmission and human-load system, respectively. Finally, the spring force Fs(s) is expressed as a function of the desired motor velocity and human torque τh, as:
thus, the system dynamics is defined by the transfer functions Gn(s) and Gh(s), given by:
where . The nominal SEA model is obtained fixing the output load making Xl = 0 (Robinson et al., 1999; dos Santos et al., 2015). Thus making Zl → ∞ in Equation (13), we obtain a transfer function G(s) that only considers platform parameters:
2.2. State Space Model
Consider again the system shown in Figure 1B. In order to simplify the model, the inner velocity loop control allows us to model the motor as a pure velocity source; therefore the torque of the motor τm is given by:
and, in consequence,
From Equations (1) and (17), and taking into account that the angular position of the motor ϕm is described in function of the displacement Xw by ϕm = ρNpXw, we obtain:
From Equations (7) and (10), we obtain the following expression:
Using Equations (6), (8), (18), and (19) it is possible to define the following state space representation of the SRPAR-human system:
where Fs is the spring force and, ϕm and ϕl are angular positions for motor and load, respectively. The system control input is the motor angular velocity wm and τh is the human torque which is considered as an input disturbance.
2.3. Experimental Validation
In order to validate the proposed theoretical model, we identify the frequency response function (FRF) of the force modeled in Equation (13). We consider in the human-load interaction, three specific operation modes: (1) a fixed mode, in which the platform is fixed in a neutral position, i.e., ϕl ≈ 0 and Zl → ∞; (2) a resistive mode, where the human being makes effort against the platform in order to hold it in the neutral position; and (3) a passive mode, when the user leaves the platform leads the movement. For all modes, we apply a desired motor velocity given by a chirp signal with an amplitude of 209.4 rad/s (2,000 rpm) and sweeping frequencies between 0 and 20 Hz (Figure 2).
Figure 2. Experimental identification. Frequency response measurements of theoretical (dashed) and experimental (solid) transfer functions between input and output Fs. Graphs show responses for passive (blue), resistive (red) and fixed (black) modes.
Due to variations in the activation level of the muscles acting on the ankle joint, abrupt changes in ankle mechanical impedance are expected. In addition, operation modes defined are properly matched with the phases of human gait pattern. Thus, the fixed mode can be associated with the mid-stance phase; the resistive mode with the initial contact, terminal stance and double support of the stance phase; and the passive mode with the swing phase. Table 1 shows the platform specifications, as well as the human parameters used for each mode and their corresponding lower limits. Parameters for Mode 1 were chosen to satisfy Zl → ∞, in order to obtain similar results to those presented in Robinson et al. (1999). For Modes 2 and 3, they were chosen from Lee et al. (2016) taking into account the actual human impedance during stance and swing phases of walking, respectively.
3. Control Approaches
The block diagram of the control system for the SRPAR is presented in Figure 3. The platform uses an EPOS driver that performs two internal control loops for motor velocity and current. They are based on PI controllers with Kp and Ki gains shown in (see Table 1). Platform sensors provide data to a signal conditioning block where SRPAR-human system variables are computed. The sampling frequency used in this process is 1 kHz.
In order to ensure an appropriate interaction between human and platform, we implement a standard impedance control configuration for SEAs that uses the following internal force control law:
where Fd is the desired force computed from a sequence of desired trajectories for load angular position and velocity . It is determined by the virtual stiffness Kv and damping Bv.
We aim to improve the performance and to guarantee the stability of the system for different modes of human activities, where changes among them are modeled as random jumps. In this sense, we design a recursive robust regulator for discrete-time Markov jump linear systems (RR-DMJLS). Disturbances and uncertainties due to human-robot interactions, mainly because of human parameters (inertia, stiffness, and damping), are considered in this control approach. For comparison purposes, we also design an force controller that does not take into account these different modes of human activities. We synthesize a fixed-gain controller using a similar approach presented in Mehling and O'Malley (2014) and dos Santos et al. (2015). Both controllers are presented in the following.
3.1. Recursive RR-DMJLS Force Control Design
In this section, we design a robust force controller for the SRPAR (Figure 4A). We present first nominal and uncertain representations for different operation modes of the system. Then, we model the system as a discrete-time Markovian jump linear system (DMJLS). In order to guarantee stability and robust performance, we use the recursive RR-DMJLS algorithm developed in Cerri and Terra (2017).
Figure 4. Force control approaches. (A) Recursive Robust Regulator for DMJLS: the block “Platform + Human” corresponds to the state variable model in Equation 20, Kint,θk and Ka,θk are the control gains. (B) control configuration of the system: Gn is the process plant, P is the augmented plant including the weight functions and Kc is the controller.
3.1.1. Nominal Model
Consider the model presented in Equation (20),
for each operation mode θ ∈ Θ: = {1, …, s}, where s is the number of nominal models, , , and are nominal parameter matrices, is the state vector, is the input control and is the input disturbance.
We discretized this model by using Faθ, k = I + FaθTsΩ, Baθ, k = ΩTsBaθ, and Gaθ, k = ΩTsGaθ, with , where Ts = 1 ms is the sample time, for each k ∈ ℤ+. To eliminate the steady state error, we augment the model by including an integral action:
where rk is a force reference signal and Ca = [0 − 1 0 0]. Fθ, k and Bθ, k are nominal matrices for three nominal models according to Equation (20), which are based on parameters presented in Table 1:
3.1.2. Uncertain Model
Consider the system presented in Section 3.1.1 subject to parametric uncertainties given by:
Uncertain matrices δFθ, k and δBθ, k are modeled by:
where is a nonzero matrix, and are known matrices, Δθ, k is an arbitrary matrix that satisfies ||Δθ, k|| ≤ 1. In order to identify matrices Hθ, k, EFθ, k and EBθ, k, we analyze frequency responses of the nominal and uncertain models described in Equations (24) and (28), where τhk = 0, by:
with . For each operation mode, we compute a transfer function Wa, θ in order to satisfy:
where σGnθ and σGunθ are singular values of the nominal and uncertain models, respectively, see Figure 5. Notice that upper bounds defined by singular values of Wa, θ are effective for frequencies until 1.7 Hz for resistive mode and 3.8 Hz for passive mode.
Figure 5. Relative errors and upper bounds. Relative errors between nominal and uncertain models with respect to inputs uk (green) and rk (blue). Graphs also show upper bounds for inputs uk (red) and rk (black).
Finally, matrices Hθ, k, EFθ, k, and EBθ, k are found using a genetic algorithm considering Equation (32):
and
3.1.3. Probability Matrix
Time transitions among modes defined in Section 2.3 for the system presented in Equation (28) can be modeled by a Markov chain , where θk is called the jump parameter and belongs to a finite set Θ: = {1, …, s}. Transitions among these different modes are determined by a probability matrix for state transitions where each input must satisfies the following constraints:
ℙ is defined heuristically based on empirical observations of the respective operation modes:
Different intervals for load velocity and position can describe different behaviors of the human-robot system. Namely, if the user is passive (1), resistive (2) or if the platform is fixed (3), ωl and ϕl provide the jump parameter where,
for each , where is the low-pass filtered signal from load velocity absolute value, with fc = 0.1 Hz and Ts = 1 ms, given by:
Since wlk is related to the frequency response of the system, the jump parameter θk is also related to the robustness of the regulator. In fact, robust stability and optimal performance is only guaranteed in the interval of frequencies in which relative errors are represented by upper bounds ||σWa, i(jω)|| (Figure 5).
3.1.4. RR-DMJLS Algorithm
Equation (28) is rewritten as a discrete-time Markov jump linear system subject to parametric uncertainties, by:
for all , where Fθk, k and Bθk, k are nominal parameter matrices for each mode given by Equation (25), xk is the state vector, uk is an input control, and δFθk, k and δBθk, k are uncertain matrices modeled as:
according to parameters presented in Equations (33) and (34).
Consider the robust control problem to regulate the DMJLS subject to parametric uncertainties defined in Equation (39). The solution for this problem is achieved through the min-max optimization problem:
for each and θk ∈ Θ, where is the uncertain penalized-regularized quadratic functional:
where and are defined in Equation (28); ; Pθk, k is a positive definite matrix; Qθk, k and Rθk, k are semi-definite weighting matrices. The solution to the optimization problem expressed in Equations (41) and (42) that guarantees the optimal state-control sequence for a fixed instant k and state θk, is given by the following Robust Regulator for Discrete Markov Jump Linear Systems (RR-DMJLS):
Robust Regulator for DMJLS (Cerri and Terra, 2017).
Initial Conditions: Set x0, θ0, ℙ, , ∀i ∈ Θ: = {1, …, s}.
Step 1: (Backward). Calculate for all :
Step 2: (Forward). Obtain for each :
.
Equation (43) uses the following auxiliary matrices:
In this formulation, μ > 0 is a penalty parameter responsible to guarantee the robustness of the RR-DMJLS. In fact, when μ → +∞ then . In consequence, the DMJLS closed-loop response is given by:
which provides the robust optimal response . Details of the necessary and sufficient conditions for existence of the mean square stabilizing solution and robustness of this regulator can be found in Cerri and Terra (2017).
Let μ = 9.998 × 106 and in order to satisfy Equations (44) and (45); weighting matrices R1, k = R2,k = R3,k = 1, Q1,k = Q2,k = Q3,k = I5 and ; and the probability matrix ℙ defined in Equation (36). By using the robust regulator presented in Equation (43), we obtain the following control law:
where Ka,θk is the gain to the states xak and Kint,θk is the gain to the state xintk. Table 2 shows the control gains obtained for three Markovian modes. We do not consider uncertainties in the third term of EFi,k, as a consequence, the algorithm decouples the state variable ϕm guaranteeing the controllability of the system (see K3).
Considering the control law presented in Equation (46), the closed-loop response for Equation (28) without considering the disturbance τhk, is given by:
where δFk + δBkK∞,θk,k = 0 guarantees the robustness of the system according to Equation (45).
3.2. Force Control Design
Consider the nominal model:
We use a mixed-sensitivity shaping approach to ensure tracking performance and disturbance rejection, and KcS to limit the control signal (Skogestad and Postlethwaite, 2007). The problem is defined as:
where we(s) and wu(s) are respectively performance and control weights, Kc is a stabilizing controller that bounds ℕ by an attenuation level γ, and is given by the usual Euclidean vector norm:
We define the performance weighting we(s) by:
where is the maximum steady-state error, Ms = 2 dB is the maximum peak of S, and ωb = 10π is related to the close-loop bandwidth. We determine the control input weighting wu(s) with
where Mu = 523.6 rad/s (5,000 rpm) is the maximum value for u. The control system is considered according to Figure 4B. Based on Equations (51) and (52), the force controller Kc(s) is obtained:
Finally, the controller is discretized by using a zero-order hold, with Ts = 1 ms,
4. Experimental Results
In order to evaluate the stability and performance of the proposed control approaches, time and frequency response tests are performed with a healthy user for three different operation modes presented in Section 2.3. We show a comparative study of force controllers and impedance controllers, according to Figure 4. This study was approved and carried out in accordance with the recommendations of the Ethics Committee of the Federal University of São Carlos (Number 26054813.1.0000.5504).
4.1. Force Controllers
In this section, robust force controllers presented in Section 3, RR-DMJLS and , are compared. Two performance criteria are used for this purpose. We consider the rise time tr and a normalized mean error between spring and desired forces defined as
where N = 8/Ts is the number of samples.
Figure 6 shows time responses of the system using the RR-DMJLS force controller. In these experiments, three different levels (100, 0, and − 100 N) of desired forces, Fd, are set during a total time of T = 8 s. In tests performed for fixed and resistive modes, shown in Figures 6A,B, the Markovian modes remained constant. Notice in the test shown in Figure 6C, the Markov chain changes between Modes 2 and 3. The RR-DMJLS responses are similar for three modes available, maintaining an appropriate tracking despite natural differences between human and robot dynamics. Notice that tr are similar to the respective desired force levels and the mean errors eqc are 14.24, 11.97, and 11.9%, for tests shown in Figures 6A–C, respectively.
Figure 6. Recursive RR-DMJLS force controller. (A) Fixed mode. (B) Resistive mode. (C) Resistive and passive modes. For each operation mode, graphs show desired (black) and actual (blue) spring forces (top), and Markov chains (bottom).
Figure 7 shows the force control response of the RR-DMJLS while tracking a sinusoidal force reference. In this experiment, the user is asked to be resistive to the movement of the platform during the first fifteen seconds, and then to remain passive during the next fifteen seconds. We observe that force control maintains a similar response despite the abrupt change in the human dynamics (resistive → passive). Notice that jumps between Markovian states reflect time transitions between different operation modes of the system. However, for a condition where the operation modes change more frequently, these transitions would be detected with a certain delay. We hypothesize that this delay is related to the jump parameter identification method considered (Equation 37). It could be improved by estimating alternative variables. For example, the stiffness and damping parameters of the human being.
Figure 7. Recursive RR-DMJLS force controller. Force response (solid), sinusoidal force reference (dashed) with a change of operation mode (top). Markov chain (bottom).
Figure 8 presents time responses of the system using the force control approach. In this case, also are applied three different levels of desired forces Fd in T = 8 s, for each operation mode: fixed, resistive, and passive. The rise time tr is lower for fixed and resistive modes in comparison with the passive mode. The mean errors obtained for fixed, resistive and passive modes were 5.89, 8.23, and 23.29%, respectively. Comparing mean errors between both controllers, we obtain better performance for the force controller for the fixed mode. For the passive mode, the RR-DMJLS provides better performance. However, when we design the control based on the passive mode, it does not stabilize the system when it is operating in the fixed mode. An advantage of the RR-DMJLS is the uniformity of performance obtained for the whole system.
Figure 9 shows frequency responses of the closed-loop system using the and recursive RR-DMJLS force controllers. For passive and resistive modes, we apply a desired force signal given by a chirp signal with amplitude of 100 N, sweeping frequencies between 0 and 8 Hz. Some indexes for both controllers are compared. For the force controller, shown in Figure 9A, we have: maximum magnitude during passive mode, |Gfp|max = −1.6 dB, and resistive mode, |Gfr|max = 0.86 dB; bandwidth for passive mode, Bwfp−3dB = 0.2 Hz, and bandwidth for resistive mode, Bwfr−3dB = 1.39 Hz; phase at cut-off frequency for passive mode, , and for resistive mode, . For the frequency response of the RR-DMJLS shown in Figure 9B, we obtain: |Gfp|max = 0.9 dB; |Gfr|max = 0.32 dB; Bwfp−3dB = 1.2 Hz; Bwfr−3dB = 1.5 Hz; ; and . Notice that the bandwidth of the closed-loop system is greater for the RR-DMJLS controller.
Figure 9. Frequency closed-loop response of the system with force control. (A) force control. (B) Recursive RR-DMJLS force control. Graphs show responses for passive (blue) and resistive (red) modes.
4.2. Impedance Control
To obtain the RR-DMJLS force control response during impedance controlled movements, we perform two experiments in which the system must track a kinematic reference. In both cases, the user was asked to be resistive during first ten seconds and then to be passive during the next ten seconds. Figure 10A shows the force and impedance control for a pure stiffness control configuration and Figure 10B a stiffness-damping control configuration. Notice that the torque tracking performance is similar for two modes in spite of the transition between them. Regarding the passive case, the position tracking is better for the pure-stiffness configuration. However, since this configuration has no damping parameter, the velocity tracking is worse. We can include a damping coefficient. However, it can decrease the performance of the position tracking. Thus, there exists a compromise between these control objectives that must be considered by the assistance strategy. Regarding the Markovian states, notice that increasing Bv it reduces the velocity of the system and enforces the system to remain in the same Markovian state, Figure 10B.
Figure 10. Impedance control with inner RR-DMJLS force control. Torque and impedance control responses for: (A) Kv = 15 N·m/rad and Bv = 0 N·m·s/rad, and (B) Kv = 15 N·m/rad and Bv = 5 N·m·s/rad. Graphs show desired (blue) and measured (red) values for the platform torque (top), angular position of the ankle joint (middle-top), angular velocity of the ankle joint (middle-bottom); and Markov chain (bottom).
Figure 11 shows time responses using the impedance control with the inner force control loop, for K = 15 N·m/rad, following a sinusoidal trajectory for ankle angular position. In this case, the user is asked to remain passive during the first ten seconds, and then to be resistive during the next ten seconds. Results show that the torque tracking performance is worse when the human being is in passive mode.
Figure 11. Impedance control with inner force control. Graphs show desired (blue) and measured (red) values for the platform torque, τplat (top), and angular position of the ankle joint (bottom).
In order to quantify the performance achieved by the proposed controllers, we compute the real stiffness and damping parameters of the system. For this purpose, we calculate the torque τKv generated by the virtual stiffness Kv and the torque τBv generated by the virtual damping Bv with
where is the angular position error and is the angular velocity error. We compute the root mean square (RMS) errors of the measured variables in the experiments shown in Figures 10, 11. The RMS of the angular error ϕe is given by:
where N = 10/Ts is the number of samples in each test (passive or resistive). In a similar way, we calculate RMS values for angular velocity error ωe, torque generated by virtual stiffness τKv, and damping τBv. Notice that, when Bv = 0 then τBv = 0 and τKv = τplat. Actual stiffness Kr and damping Br are given by:
see Table 3. The error between the virtual stiffness and the actual stiffness are calculated, eKv = |(Kv − Kr)/Kv|100% and the error between the virtual damping and the actual damping, eBv = |(Bv − Br)/Bv|100%. We compare results of the impedance control with Kv = 15 Nm/rad and Bv = 0 Nms/rad. Impedance control with RR-DMJLS presents higher stiffness accuracy in both passive and resistive modes, 15.28 Nm/rad and 16.13 Nm/rad, respectively. With controller, it provides 16.44 Nm/rad in passive mode and 7 Nm/rad in resistive mode. Stiffness errors eKv of the RR-DMJLS force control are smaller than the force control. This difference can be seen in the passive mode (θ = 3), where the eKv error of the is approximately seven times greater than the RR-DMJLS. In the test with Kv = 15N·m/ rad and Bv = 5N·m·s/ rad, the performance is preserved.
Figure 12 shows the frequency response for the impedance which is measured between output torque and angular position error. For passive and resistive modes, we apply a desired angular position trajectory given by a chirp signal with amplitude 0.2 rad, sweeping frequencies between 0 and 8 Hz. In these experiments, impedance controller is defined as pure stiffness configuration; therefore, magnitude of the impedance should be almost constant. Notice that it is guaranteed only until 1 Hz. Figure 12A shows the behavior of the RR-DMJLS-based impedance control. Figure 12B shows the frequency response for the -based impedance control. Notice for this controller that the performance decreases when the system operates in the passive mode. We can see that the RR-DMJLS is a more resilient impedance control if compared with -based control for different operating modes and desired impedances.
Figure 12. Frequency response for the measured impedance, , and force error, |Fs/Fd − 1| · 100%, for Kv = 15, Kv = 5 and Bv = 0. (A) Inner recursive RR-DMJLS force control. (B) Inner force control.
5. Discussion and Conclusions
The model-based robust force control approach was evaluated in a robotic platform for ankle rehabilitation, improving its impedance control performance. First, the robot-human dynamics was modeled considering the ankle impedance a second-order system with inertia, stiffness, and damping parameters. Since we do not have exact knowledge of the human parameters, our system is subject to parametric uncertainties and we have defined three operation modes related to the human-robot activity whose time transitions were modeled via a Markov chain. For comparison purposes, an force controller was also evaluated. Although it can guarantee coupled stability, the force control performance decreases when the system is in the passive operation mode. We have also designed and implemented an RR-DMJLS for dealing with abrupt changes and system uncertainties by guaranteeing robust mean square stability of the system. Experimental results show RR-DMJLS outperformed the force controller.
5.1. Related Work
The impedance control configuration used is based on Hogan (1985) and it is aimed at the regulation of the dynamical behavior in the interaction port by variables that do not depend on the environment. The actuator together with the controller are modeled as an impedance, Zr, with velocity inputs (angular) and force outputs (torque). The environment is considered an admittance, Ye, in the interaction port. Colgate and Hogan (1988, 1989) presented sufficient conditions for the determination of stability of two coupled systems and explained how two physically coupled systems with Zr and Ye with passive port functions can guarantee stability. These concepts have been useful for the implementation of interaction controls for almost three decades. The stability of two coupled systems is given by Zr and Ye eigenvalues and the performance is evaluated by through the impedance Zr.
Buerger and Hogan (2007) described a methodology in which an interaction control is designed for a robot module used for rehabilitation purposes. They considered an environment with restricted uncertain characteristics, therefore the admittance is rewritten as Ye(s) = Yn(s) + W(s)Δ(s). The authors also used a second-order dynamics to model the stiffness, damping, and inertia of the human parameters. Complementary stability for interacting systems was defined, where stability is determined by an environment subject to uncertainties. Therefore, a coupled stability problem is considered a robust stability problem.
Regarding the human modeling, the dynamic properties of the lower limbs and muscular activities vary considerably among subjects. This is relevant since SRPAR has been designed for users that suffer diseases that affect the human motor control system, e.g., stroke and other conditions that cause hemiplegia. Typically, such diseases change stiffness and damping in the ankle and knee joints, hence producing spasticity or hypertonia (Lin et al., 2006; Chow et al., 2012). Therefore, the development of a control strategy that guarantees a safe interaction between patient and platform, mainly in virtue of uncertainties related to the human being, is fundamental.
Li et al. (2017) and Pan et al. (2017) proposed adaptive control schemes for SEA-driven robots. They considered two operation modes in the adaptation process, namely robot-in-charge and human-in-charge, which are close related to the passive and resistive operation modes, respectively, proposed in this paper. However, the control adaptation is based on changes in the desired position input of the SEA controller and estimation of coordinate accelerations through nonlinear filtering.
In human-robot interaction control systems, the efficiency of the force actuator operation deserves special attention. Although SEAs are characterized by a low output impedance, an important requirement for improving such efficiency is the achievement of a precise and proportional output torque with respect to the desired input. Pratt (2002), Au et al. (2006), Kong et al. (2009), Mehling and O'Malley (2014), and dos Santos et al. (2015) developed force controllers for ankle actuators using SEA. In this paper, we proposed a force control methodology that can deal with system uncertainties and guarantee robust mean square stability. Similar performance was obtained in different tests performed. Accuracies of 98.14% for resistive mode and 92.47% for passive mode were obtained in the pure stiffness configuration. In the stiffness-damping configuration, with Kv = 15 and Bv = 5, the accuracy obtained in the resistive case was of 97.47% for stiffness and 97.2% for damping, and in the passive case was of 93.94% for stiffness and 94% for damping.
On the contrary, using a fixed-gain control approach based on synthesis, the performance was not similar among operation modes. We showed that this strategy can guarantee coupled stability; nevertheless, force control performance decreases when the system is in the passive operation mode. This is reflected in the impedance control accuracy for the pure stiffness configuration, falling from 90.4% in the resistive mode to 46.67% in the passive mode.
5.2. Shortcomings and Possible Improvements
In order to control the SRPAR, we proposed a methodology to force control based on RR-DMJLS. It considers a discrete-time Markovian model with three states associated with the operating modes of the system. The model was augmented for eliminating the steady state error through the inclusion of an integral action. We also found appropriate uncertain matrices considering frequency responses for relative errors between perturbed and nominal models.
Regarding the observation of the operation modes, in Figure 10A there exists a delay in the jump identification from resistive to passive mode, and in Figure 10B the proposed jump identification method was not even able to identify the jump between modes. This behavior is directly related to virtual damping Bv selected since load angular velocity is lower than 2 rad/s. A possible solution to the problem is the estimation of the virtual stiffness and damping of the human being for the definition of the bounds of the identification method.
Based on our observations of the system behavior, we have defined a probability matrix ℙ that models those transitions among different modes. We hypothesize the probabilities may vary in function of the user's physiological conditions, therefore, our probability matrix can be considered partially or completely uncertain. In a future study, we aim at using our methodology subject to uncertain transition probabilities with the unknown Markov chain proposed in Bortolin and Terra (2016).
Other approaches may improve our methodology. For example, a disturbance observer, as proposed in Kong et al. (2009), could compensate the effect of human torque τh in Equations (14) and (20). Optimal robust filter for DMJLS (Ishihara et al., 2015) and extended robust Kalman filter proposed in Inoue et al. (2016) could better estimate the states of the SRPAR.
Author Contributions
AJ, JJ, FE, and JP conceived research, performed the experiments and the data analysis, drafted the manuscript, and coded the controllers. MT and AS participated in the design of the controllers and in the draft of the manuscript. All authors read and approved the final manuscript.
Funding
This research is supported by Office of Research Administration of University of São Paulo, Coordination for Improvement of Higher Education Personnel (CAPES), Colciencias (Colombia), National Council for Scientific and Technological Development (CNPq) under grants 132221/2013-6 and 142080/2016-0, and São Paulo Research Foundation (FAPESP) under grants 2011/04074-3 and 2013/14756-0.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
Au, S. K., Dilworth, P., and Herr, H. (2006). “An ankle-foot emulation system for the study of human walking biomechanics,” in Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006 (Orlando, FL), 2939–2945.
Bortolin, D. C., and Terra, M. H. (2016). “Recursive robust regulator for markovian jump linear systems subject to uncertain transition probabilities with unknown markov chain,” in 2016 IEEE Conference on Control Applications (CCA), 774–779. doi: 10.1109/CCA.2016.7587912
Buerger, S. P., and Hogan, N. (2007). Complementary stability and loop shaping for improved human ndash;robot interaction. IEEE Trans. Robot. 23, 232–244. doi: 10.1109/TRO.2007.892229
Calanca, A., Capisani, L., and Fiorini, P. (2014). Robust force control of series elastic actuators. Actuators 3, 182–204. doi: 10.3390/act3030182
Calanca, A., Muradore, R., and Fiorini, P. (2016). A review of algorithms for compliant control of stiff and fixed-compliance robots. IEEE/ASME Trans. Mechatr. 21, 613–624. doi: 10.1109/TMECH.2015.2465849
Cattaneo, D., Nuzzo, C. D., Fascia, T., Macalli, M., Pisoni, I., and Cardini, R. (2002). Risks of falls in subjects with multiple sclerosis. Arch. Phys. Med. Rehabil. 83, 864–867. doi: 10.1053/apmr.2002.32825
Cerri, J. P., and Terra, M. H. (2017). Recursive robust regulator for discrete-time Markovian jump linear systems. IEEE Trans. Autom. Control. doi: 10.1109/TAC.2017.2707335
Chang, W. H., and Kim, Y.-H. (2013). Robot-assisted therapy in stroke rehabilitation. J. Stroke 15, 174–181. doi: 10.5853/jos.2013.15.3.174
Chow, J. W., Yablon, S. A., and Stokic, D. S. (2012). Coactivation of ankle muscles during stance phase of gait in patients with lower limb hypertonia after acquired brain injury. Clin. Neurophysiol. 123, 1599–1605. doi: 10.1016/j.clinph.2012.01.006
Colgate, E., and Hogan, N. (1989). The Interaction of Robots with Passive Environments: Application to Force Feedback Control. Berlin; Heidelberg: Springer.
Colgate, J. E., and Hogan, N. (1988). Robust control of dynamically interacting systems. Int. J. Control 48, 65–88. doi: 10.1080/00207178808906161
dos Santos, W. M., Caurin, G. A., and Siqueira, A. A. (2015). Design and control of an active knee orthosis driven by a rotary series elastic actuator. Control Eng. Pract. 58, 307–318. doi: 10.1016/j.conengprac.2015.09.008
Gonçalves, A., Siqueira, A. A., dos Santos, W. M., Consoni, L. J., do Amaral, L. M., and de OB Franzolin, S. (2013). “Development and evaluation of a robotic platform for rehabilitation of ankle movements,” in 22st International Congress Of Mechanical Engineering (Ribeirão Preto), 8291–8298.
Gonçalves, A. C. B. F., dos Santos, W. M., Consoni, L. J., and Siqueira, A. A. G. (2014). “Serious games for assessment and rehabilitation of ankle movements,” in Serious Games and Applications for Health (SeGAH), 2014 IEEE 3rd International Conference on (Rio de Janeiro), 1–6.
Hatano, S. (1976). Experience from a multicentre stroke register: a preliminary report. Bull. World Health Organ. 54, 541–553.
Hogan, N. (1985). Impedance control: an approach to manipulation. J. Dyn. Syst. Measure. Control 107(Pt. 1–3), 1–24. doi: 10.1115/1.3140702
Inoue, R. S., Terra, M. H., and Cerri, J. P. (2016). Extended robust kalman filter for attitude estimation. IET Control Theory Appl. 10, 162–172. doi: 10.1049/iet-cta.2015.0235
Ishihara, J. Y., Terra, M. H., and Cerri, J. P. (2015). Optimal robust filtering for systems subject to uncertainties. Automatica 52, 111–117. doi: 10.1016/j.automatica.2014.10.120
Jutinico, A. L., Jaimes, J. C., Escalante, F. M., Perez-Ibarra, J. C., Terra, M. H., and Siqueira, A. A. G. (2017). “Recursive robust regulator for discrete-time markovian jump linear systems: control of series elastic actuators,” in 20th IFAC World Congress (Toulouse).
Kong, K., Bae, J., and Tomizuka, M. (2009). Control of rotary series elastic actuator for ideal force-mode actuation in human 2013;robot interaction applications. IEEE/ASME Trans. Mechatr. 14, 105–118. doi: 10.1109/TMECH.2008.2004561
Krebs, H. I., Dipietro, L., Levy-Tzedek, S., Fasoli, S. E., Rykman-Berland, A., Zipse, J., et al. (2008). A paradigm shift for rehabilitation robotics. IEEE Eng. Med. Biol. Mag. 27, 61–70. doi: 10.1109/MEMB.2008.919498
Lee, H., Rouse, E. J., and Krebs, H. I. (2016). Summary of human ankle mechanical impedance during walking. IEEE J. Transl. Eng. Health Med. 4, 1–7. doi: 10.1109/JTEHM.2016.2601613
Li, X., Pan, Y., Chen, G., and Yu, H. (2017). Adaptive human-robot interaction control for robots driven by series elastic actuators. IEEE Trans. Robot. 33, 169–182. doi: 10.1109/TRO.2016.2626479
Lin, P.-Y., Yang, Y.-R., Cheng, S.-J., and Wang, R.-Y. (2006). The relation between ankle impairments and gait velocity and symmetry in people with stroke. Arch. Phys. Med. Rehabil. 87, 562–568. doi: 10.1016/j.apmr.2005.12.042
Lum, P. S., Burgar, C. G., Shor, P. C., Majmundar, M., and der Loos, M. V. (2002). Robot-assisted movement training compared with conventional therapy techniques for the rehabilitation of upper-limb motor function after stroke. Arch. Phys. Med. Rehabil. 83, 952–959. doi: 10.1053/apmr.2001.33101
Mehling, J. S., and O'Malley, M. K. (2014). “A model matching framework for the synthesis of series elastic actuator impedance control,” in 22nd Mediterranean Conference on Control and Automation (Palermo), 249–254.
Oh, S., and Kong, K. (2017). High-precision robust force control of a series elastic actuator. IEEE/ASME Trans. Mechatr. 22, 71–80. doi: 10.1109/TMECH.2016.2614503
Pan, Y., Wang, H., Li, X., and Yu, H. (2017). Adaptive command-filtered backstepping control of robot arms with compliant actuators. IEEE Trans. Cont. Syst. Technol. doi: 10.1109/TCST.2017.2695600
Petit, F., Dietrich, A., and Albu-Schffer, A. (2015). Generalizing torque control concepts: using well-established torque control methods on variable stiffness robots. IEEE Robot. Autom. Mag. 22, 37–51. doi: 10.1109/MRA.2015.2476576
Pratt, G. A. (2002). Low impedance walking robots1. Integr. Comp. Biol. 42:174. doi: 10.1093/icb/42.1.174
Pérez-Ibarra, J. C., Alarcn, A. L. J., Jaimes, J. C., Ortega, F. M. E., Terra, M. H., and Siqueira, A. A. G. (2017). “Design and analysis of force control of a series elastic actuator for impedance control of an ankle rehabilitation robotic platform,” in 2017 American Control Conference (ACC), 2423–2428. doi: 10.23919/ACC.2017.7963316
Radomski, M. V., and Trombly, C. A. (2013). Occupational Therapy for Physical Dysfunction, 7th Edn. Philadelphia, PA: LWW.
Robinson, D. W., Pratt, J. E., Paluska, D. J., and Pratt, G. A. (1999). “Series elastic actuator development for a biomimetic walking robot,” in Advanced Intelligent Mechatronics, 1999. Proceedings. 1999 IEEE/ASME International Conference on, 561–568. doi: 10.1109/AIM.1999.803231
Skogestad, S., and Postlethwaite, I. (2007). Multivariable Feedback Control: Analysis and Design, vol. 2. New York, NY: Wiley.
Tagliamonte, N. L., and Accoto, D. (2014). Passivity constraints for the impedance control of series elastic actuators. Proc. Inst. Mech. Eng. I 228, 138–153. doi: 10.1177/0959651813511615
Vallery, H., Veneman, J., van Asseldonk, E., Ekkelenkamp, R., Buss, M., and van Der Kooij, H. (2008). Compliant actuation of rehabilitation robots. IEEE Robot. Autom. Mag. 15, 60–69. doi: 10.1109/MRA.2008.927689
Wyeth, G. (2006). “Control issues for velocity sourced series elastic actuators,” in Proceedings of the Australasian Conference on Robotics and Automation (Auckland), 1–6.
Yu, H., Huang, S., Chen, G., Pan, Y., and Guo, Z. (2015). Humanrobot interaction control of rehabilitation robots with series elastic actuators. IEEE Trans. Robot. 31, 1089–1100. doi: 10.1109/TRO.2015.2457314
Keywords: robotic rehabilitation, impedance control, , Markovian jump linear systems, series elastic actuators, robust control, force control
Citation: Jutinico AL, Jaimes JC, Escalante FM, Perez-Ibarra JC, Terra MH and Siqueira AAG (2017) Impedance Control for Robotic Rehabilitation: A Robust Markovian Approach. Front. Neurorobot. 11:43. doi: 10.3389/fnbot.2017.00043
Received: 16 March 2017; Accepted: 07 August 2017;
Published: 24 August 2017.
Edited by:
Jan Veneman, Tecnalia, SpainReviewed by:
Thomas Sugar, Arizona State University, United StatesYongping Pan, National University of Singapore, Singapore
Copyright © 2017 Jutinico, Jaimes, Escalante, Perez-Ibarra, Terra and Siqueira. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Andres L. Jutinico, YWp1dGluaWNvQHVzcC5icg==