- 1Research Institute of Electrical Communication, Tohoku University, Sendai, Japan
- 2Japan Society for the Promotion of Science, Tokyo, Japan
- 3Biorobotics Laboratory, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
Deciphering how quadrupeds coordinate their legs and other body parts, such as the trunk, head, and tail (i.e., body–limb coordination), can provide informative insights to improve legged robot mobility. In this study, we focused on sprawling locomotion of the salamander and aimed to understand the body–limb coordination mechanisms through mathematical modeling and simulations. The salamander is an amphibian that moves on the ground by coordinating the four legs with lateral body bending. It uses standing and traveling waves of lateral bending that depend on the velocity and stepping gait. However, the body–limb coordination mechanisms responsible for this flexible gait transition remain elusive. This paper presents a central-pattern-generator-based model to reproduce spontaneous gait transitions, including changes in bending patterns. The proposed model implements four feedback rules (feedback from limb-to-limb, limb-to-body, body-to-limb, and body-to-body) without assuming any inter-oscillator coupling. The interplay of the feedback rules establishes a self-organized body–limb coordination that enables the reproduction of the speed-dependent gait transitions of salamanders, as well as various gait patterns observed in sprawling quadruped animals. This suggests that sensory feedback plays an essential role in flexible body–limb coordination during sprawling quadruped locomotion.
1. Introduction
Quadruped animals exhibit a high agility and adaptability to terrestrial environments. These locomotor abilities are achieved by coordinating their legs and other body parts, such as the trunk, head, and tail (i.e., through body–limb coordination). For instance, the bending of a cheetah's body improves its speed (Hildebrand, 1959), a horse's nodding reduces metabolic costs (Loscher et al., 2016), and the undulation of a salamander's tail facilitates dynamic balance (Bicanski et al., 2013b). These examples suggest that the body–limb coordination mechanisms play an essential role in animal locomotor skills. Decoding the body–limb coordination mechanisms will contribute to the design of highly functional legged robots and help understand the motor control of legged animals.
The salamander is an amphibian and is well-suited for investigating the body–limb coordination mechanisms because it exhibits a flexible body–limb coordination dependent on locomotion speed (Ashley-Ross, 1994). At slow speeds, salamanders show lateral-sequence walking gait (L-S walk) with standing waves of lateral body undulation in which the body oscillates synchronously while some points act as “nodes” and do not move. At higher speeds, they exhibit a walking trot gait with first standing waves (at medium speeds) and then traveling waves (at high speeds) of lateral undulation in which all body parts oscillate laterally, propagating the waves rostrocaudally. Despite this flexible body–limb coordination, the locomotor nervous systems of salamanders are simpler than those of mammals in that they have fewer neurons and less differentiated structures (Chevallier et al., 2008; Bicanski et al., 2013b). Therefore, salamanders likely possess flexible and simple body–limb coordination mechanisms.
The locomotion of salamanders and other vertebrate animals is controlled by distributed neural networks, called central pattern generators (CPGs), and sensory feedback from peripheral nerves (Cabelguen et al., 2003; Ryczko et al., 2020). In particular, decerebrate salamander experiments showed that neural communication between CPGs is responsible for coordinating axial and limb movements. Base on these finding, CPG networks have been modeled, and salamander locomotion investigated through numerical simulations and robot experiments (Ijspeert, 2001, 2020; Ijspeert et al., 2007; Harischandra et al., 2010, 2011; Bicanski et al., 2013a; Crespi et al., 2013; Liu et al., 2018). Most previous studies used an oscillator model with inter-oscillator couplings in which oscillators represent CPGs and inter-oscillator couplings represent neural communications between CPGs. These studies designed inter-oscillator couplings to coordinate axial and limb movements and reproduced various behaviors, such as walking, swimming, and turning (Ijspeert, 2001; Ijspeert et al., 2007; Bicanski et al., 2013a; Crespi et al., 2013; Liu et al., 2018). These studies intensively investigated the body–limb coordination mechanisms based on inter-oscillator couplings, and less attention was paid to the role of sensory feedback in body–limb coordination. Harischandra et al. (2011) proposed a CPG model with stretch sensory feedback and showed that sensory feedback contributes to gait generation and transition. However, the main focus of this study is interlimb coordination, as opposed to body–limb coordination. The role of sensory feedback in body–limb coordination remains elusive.
We aim to understand the contribution of sensory feedback to body–limb coordination. We previously proposed a decentralized control model with cross-coupled sensory feedback from the body to limb, and vice versa, in simulated and real sprawling quadruped robots (Suzuki et al., 2019, 2021). Body–limb coordination was successfully established by sensory couplings without inter-oscillator couplings. These studies also suggested that sensory feedback provides rapid convergence to a stable gait, easy parameter tuning, and high robustness against leg failure and morphological changes. However, the results cannot explain the body–limb coordination mechanisms responsible for gait transition because of the simplified body structure in which the body trunk had only one degree of freedom.
In this study, we investigate the mechanisms for coordination between the legs and a flexible elongated trunk and aim to reproduce the speed-dependent gait transition of salamanders. To this end, we extend our previous model to simulate a salamander robot with a multi-segmented trunk. The simulation results show that the proposed model can reproduce the gait transition between a standing wave pattern at low speed and a traveling wave pattern at high speed, by changing only one parameter related to the command from the brain. The model also reproduces several gait patterns observed in other sprawling quadruped animals by changing the sensory feedback strength. These results suggest that, in addition to inter-oscillator couplings (which are known to exist in the salamander spinal cord), sensory feedback could play an essential role in flexible body–limb coordination underlying sprawling quadruped locomotion.
The remainder of this paper is structured as follows. Section 2 contains a description of a decentralized control for body–limb coordination and details the effects of sensory feedback rules. Section 3 contains an outline of the simulation experiments and the results. In section 4, the potential role of sensory feedback in body–limb coordination is discussed, and recommendations for future studies are presented.
2. Model
2.1. Body
The body consists of n trunk segments and four legs, as shown in Figure 1. The segments are concatenated via yaw hinge joints with a parallel combination of a rotary actuator, passive spring, and passive damper. The fore- and hind-legs are attached on both sides of the k-th and l-th segments, respectively. Each leg has two rotary actuators in the yaw and roll directions, controlled by phase oscillators.
Figure 1. Body model. The trunk has n − 1 actuated degrees of freedom (DoFs), and denotes the angle of the j-th DoF from the head. The fore- and hind-legs are attached on both sides of the k-th and l-th segments, respectively (in the figure, n = 11, k = 3, and l = 7). Each leg has two DoFs controlled by phase oscillators. The subscript i denotes the leg identifier: (1, left fore; 2, right fore; 3, left hind; and 4, right hind), and and are the angles of the leg joints in the yaw and roll directions, respectively. The circle around the right foreleg shows the leg trajectory based on the oscillator phase ϕi. Variables mJ, mL, and mF are the masses of each joint, link, and foot, respectively.
Each foot tip has a force sensor that detects the normal force from the ground, and each trunk joint has angle and torque sensors. The angle sensors detect the angle of the j-th trunk joint from the head. Here, the j-th trunk joint connects the j-th and j + 1-th segments from the head. The variable is positive when the trunk joint bends to the right, as shown in Figure 1. The torque sensors detect the torque generated by the rotary actuators at the trunk joint.
2.2. Control Algorithm
The proposed decentralized control algorithm is an extension of our previous study (Suzuki et al., 2019). The controller is composed of oscillators, which represent CPGs. In order to focus on the potential role of sensory feedback as synchronization mechanism, inter-oscillator couplings are not modeled here; instead, nearby body parts are coupled through sensory feedback (Figure 2). The sensory feedback consists of the following four feedback rules:
1. Force feedback from limb to limb
2. Torque feedback from body to limb
3. Force feedback from limb to body
4. Angle feedback from body to body
Figure 2. Configuration of the feedback network. The circles and triangles represent the controllers and sensors, respectively. Each leg controller has one phase oscillator. The arrows show the four types of sensory feedback; blue indicate the force feedback from limb to limb and limb to body, orange indicates the torque feedback from body to limb, and gray indicates the angle feedback from body to body.
The first rule is responsible for coordinating the four legs as they move forward while supporting the body. The second and third rules comprise the cross-coupled feedback that establishes self-organized body–limb coordination. The fourth rule coordinates the lateral undulations of the multi-segmented body trunk. Through the interplay of these rules, it is expected that the model will generate flexible locomotion patterns. The following section describes each sensory feedback control in detail.
2.2.1. Leg Control
A phase oscillator is implemented in each leg, and its phase determines the target angle of the rotary actuators in the yaw and roll directions as follows:
where and denote the target angles, and represent the neutral angles, and represent the amplitudes of the yaw and roll actuators, respectively (Figure 1); ϕi is the oscillator phase and the subscript i denotes the leg identifier (1: left fore, 2: right fore, 3: left hind, and 4: right hind). When 0 < ϕi < π, the leg tends to be in the swing phase; otherwise, it tends to be in the stance phase. The time evolution of the phase is described as follows:
where ω [rad/s] denotes the intrinsic angular velocity of the phase oscillators; and σLL [rad/s], ρLL [1/N], σBL [rad/s], and ρBL [1/(N·m)] are the weights of the sensory feedback terms; and Ni [N] represents the normal force detected at the foot tip. Further, and [N·m] represent the torque generated by the k-th and l-th trunk actuators, respectively.
Equation (3) relates to the limb-to-limb feedback. The local feedback rule was proposed by Owaki et al. (2013). It generates adaptive interlimb coordination in response to the speed and physical properties of the robot (Owaki et al., 2013; Owaki and Ishiguro, 2017). Based on the sensory feedback effect, the oscillator phase is modulated to 3π/2 when Ni > 0. When the leg supports the body, the foot obtains a higher ground reaction force, that is, a higher Ni. Thus, this feedback implies that the leg remains on the ground when it supports the body. The local sensory information, denoted by Ni, describes the extent to which a specific leg provides support to the body, and it also indicates how much other legs are currently contributing to supporting the body. Using such sensory information, this feedback can generate adaptive interlimb coordination without neural communication between the legs.
Equation (4) relates to the body-to-limb feedback (Figures 3A, B). When the k-th trunk actuator bends the body to the right (), the oscillator phase of the left foreleg is modulated to π/2 to lift the legs, and the oscillator phase of the right foreleg is modulated to 3π/2 to place the legs on the ground. By phase modification, the left foreleg lifts from the ground, and the right foreleg is anchored to the ground. This facilitates the k-th trunk actuator to bend the body to the right (), and the robot moves forward when the anchored legs serve as a pivot. Similarly, the oscillator phases of the hind legs are modulated by the torque of the l-th trunk actuator.
Figure 3. Schematic of body-limb sensory feedback. (A) Schematic of the salamander robot model from the top view. The squared region around the forelegs indicates the body part illustrated by (B,C) to explain the feedback effect. (B) Body-to-limb sensory feedback mechanism: (i) the k-th trunk actuator bends the body to the right () and (ii) the k-th trunk actuator bends the body to the left (). When the k-th trunk actuator bends the body to the right, the left foreleg oscillator phase is modulated toward π/2 (to swing), and the right foreleg oscillator phase is modulated toward 3π/2 (to stance), and vice versa. (C) Limb-to-body sensory feedback mechanism: (i) the right foreleg is on the ground (N2 > 0) and (ii) the left foreleg is on the ground (N1 > 0).
2.2.2. Body Control
The torques at the trunk actuators are described as follows:
where is the actual angle of the trunk actuator. The variables σLB [N·m] and ρLB [1/N], σBB [N·m], and ρBB [1/rad] represent the weights of the sensory feedback.
Equation (6) relates to the limb-to-body feedback. The sensory feedback effect is such that the k-th and l-th trunk segments bend in response to ground contacts, as shown in Figures 3A, C. When the left foreleg is on the ground (N1 > 0), the k-th actuator bends the body to the left (). Similarly, when the right foreleg is on the ground (N2 > 0), the k-th trunk actuator bends the body to the right (). The interactions of the sensory feedback from body to limb and limb to body establish the relationship between the legs and trunk, providing longer strides and more powerful pushing-off against the ground. The interactions of the body-to-limb and limb-to-body feedback establish the relationship between the legs and trunk, providing longer strides and more powerful pushing-off against the ground (Suzuki et al., 2019, 2021).
Equation (7) relates to the body-to-body feedback. The local feedback rule is based on the curvature derivative control proposed in a previous study for snake-like locomotion (Date and Takita, 2007). It generates a torque proportional to the curvature derivative of the body curve such that the lateral body undulation propagates posteriorly. As reported in a previous study (Kano and Ishiguro, 2020), the control with additional sensory feedback can generate versatile undulation patterns. Therefore, it can potentially generate flexible, sensory-driven, intersegmental coordination, as an alternative to inter-oscillator couplings (as modeled in Ijspeert et al. (2007) for instance). The interplay between limb-to-body and body-to-body feedback arranges the waveform of the lateral body undulations.
3. Simulation Results
We conducted simulation experiments using the Open Dynamics Engine, which is an open-source library for simulating rigid body dynamics (Smith, 2005). Each trial was conducted on flat terrain for 60 s, with the oscillator phases initially set to random. The body size and weight were determined by considering those of a salamander robot developed as a prototype in our previous study (Suzuki et al. 2019b). The angular frequency and amplitude of the legs were chosen with physically plausible values. The other parameters were determined by trial and error, referring to the parameter sets of our previous simulation study [Suzuki et al., 2019]. The simulation time step was set to 0.01 s, and the control commands were updated at each time step. The results are provided in the following sections. We first show that the speed-dependent gait transition of salamanders can be successfully reproduced (section 3.1). Next, we demonstrate that two other gait patterns observed in other sprawling quadruped animals can be reproduced (section 3.2). Finally, we clarify which parameters affect the exhibited gait pattern by changing the feedback strength (section 3.3) and body parameters (section 3.4).
3.1. Speed-Dependent Gait Transition of Salamanders
To investigate whether the proposed model can reproduce the speed-dependent gait transition of salamanders, we performed a simulation by changing the parameter ω from 1.8 π to 3.8 π [rad/s] at period 16 [s] and from 3.8 π to 1.8 π [rad/s] at period 22 [s]. Figure 4 and Supplementary Video 1 show the results. The upper graph represents the lateral flexion of the trunk joint, wherein the colored region denotes the period when the trunk joint bends to the right (). The lower graph represents the gait diagram, wherein the colored region denotes the period when the foot is in contact with the ground (Ni > 0).
Figure 4. Spontaneous gait transition from L-S walk with standing waves to walking trot with traveling wave and vice versa. The upper graph represents the lateral flexion of the trunk joint, wherein the colored region denotes the period when the trunk joint bends to the right (). The lower graph represents the gait diagram, wherein the colored region denotes the period when the foot is in contact with the ground (Ni > 0). We set the parameter ω from 1.8 π to 3.8 π [rad/s] at period 16 [s], and from 3.8 π to 1.8 π [rad/s] at period 22 [s]. We confirmed that the gait transition was observed for any initial oscillator phase (for all 10 trials).
For ω = 1.8π, the bending of the body trunk (j = 3−6) is antiphase to that of the tail (j = 7−10), as shown in Figure 4. This pattern is a standing wave with nodes at the shoulder and the hip, similar to that of a salamander walking (Ashley-Ross, 1994). Next, the feet touched down in the following order: right hind (RH), right fore (RF), left hind (LH), and left fore (LF). The mean and standard deviation (SD) of the duty factor were 69.3 and 0.55%, respectively. The mean and SD of the diagonality were 21.9 and 1.26%, respectively. These values were calculated within 10–16 [s] for each of the 10 trials. The duty factor is the time percentage at which one foot spends in the stance phase during a gait cycle, and diagonality is the percentage of the cycle period by which the left/right hind footfall precedes the left/right fore-footfall. Thus, the gait was classified as a lateral-sequence (L-S) walk, according to Hildebrand's gait classification (Hildebrand, 1965; Cartmill et al., 2002). This gait was observed in salamander's slow-speed walking (Ashley-Ross, 1994). In conclusion, for ω = 1.8π, the model reproduced the bending and footfall patterns of a salamander's slow-speed walking.
For ω = 3.8π, the flexion duration moved posteriorly and continuously (Figure 4), indicating a traveling wave. The footfall pattern is such that the diagonally opposite feet were nearly synchronized. The mean and SD of the duty factor were 64.5% and 9.74 × 10−2, respectively. The mean and SD of the diagonality were 48.0 and 1.97%, respectively. These values are calculated within 18–22 [s] for each of the 10 trials. Thus, the gait was classified as a walking trot according to Hildebrand's gait classification (Hildebrand, 1965; Cartmill et al., 2002). The bending and footfall patterns were observed in a salamander's high-speed walking (Ashley-Ross, 1994). Therefore, the model also reproduced the gait pattern of a salamander's high-speed walking for ω = 3.8π.
When changing ω from 1.8 π to 3.8 π at period 16 [s], the gait pattern spontaneously and smoothly changed from a L-S walk with standing waves to a walking trot with traveling waves, as shown in Figure 4. Similarly, the reverse gait transition (from walking trot to L-S walk) was observed when changing ω from 3.8 π to 1.8 π at period 22 [s]. We confirmed that the gait transition was observed for any initial oscillator phase (for all 10 trials). Thus, the proposed model successfully reproduced the speed-dependent gait transition of salamanders, by simply changing the ω parameter.
We then analyzed the lateral bending waveform of each gait pattern and compared it with that of salamanders. Figure 5 shows the comparison of the body waveform between the simulated robot and the salamander, Dicamptodon teneborosus (Ashley-Ross, 1994). In Figures 5A,B, the stick figures were made by connecting the lateral positions of the body segments from the shoulder (j = 3) to the hip (j = 7) in the simulated robot for ω = 1.8π (Figure 5A) and ω = 3.8π (Figure 5B), respectively. All stick figures throughout one gait cycle were superimposed by lining them up on the shoulder segment. This analysis refers to Ashley-Ross's study (Ashley-Ross, 1994), and Figures 5C,D were adapted from the analysis of a salamander walking and trotting conducted in this study. These stick figures were made by connecting the marker point over the midline from the pectoral girdle to the pelvic girdle while walking (Figure 5C) and trotting (Figure 5D). All stick figures throughout one gait cycle were superimposed by lining them up on the anteriormost midline marker dot.
Figure 5. Simulated robot (left) and salamander D. teneborosus (right) during locomotion. The stick figures were made by connecting the positions of the body parts over the midline. All stick figures throughout one gait cycle were superimposed by lining them up on the anteriormost part of the body trunk. (A) Simulated robot for ω = 1.8π, (B) simulated robot for ω = 3.8π, (C) D. teneborosus while walking, (D) D. teneborosus while trotting. (C,D) Adapted from the Ashley-Ross's study (Ashley-Ross, 1994), with permission.
Figure 5A shows the body waveform alternate between two stable curve configurations; the curve features a half-wavelength from the shoulder and hip. This pattern is a standing wave with nodes at the shoulder and the hip, and is similar to that of a salamander's walking, as shown in Figure 5C. Figure 5B shows that the body waveform has no nodes; the trunk does not follow a simple side-to-side bending pattern (such as in Figure 5A). This pattern is a traveling wave, and is also similar to that of a salamander's trotting, as shown in Figure 5D. These results suggest that the model certainly generates two types of body waveforms, namely, standing and traveling waves; these waveforms are qualitatively similar to those exhibited by a salamander.
3.2. Reproduction of Gait Patterns Observed in Other Species
While salamanders exhibit a L-S walk with standing waves of lateral body undulation and walking trot gait with standing or traveling waves of, different gait patterns have been observed in other species that exhibit sprawling locomotion (Ritter, 1992). In this subsection, we demonstrate that the proposed model can reproduce such patterns by changing the control parameters.
L-S Walk With Intermediate Waves
Some species of lizards, such as Dipsosaurus dorsalis, also show speed-dependent gait transitions (Ritter, 1992). They use standing waves at lower speeds and traveling waves at higher speeds, similar to the salamander's gait. Interestingly, they also use “intermediate” waves at intermediate speeds in between the speeds for standing and traveling waves. The waveform has attributes of both standing and traveling waves. To investigate whether the proposed model can reproduce these gait patterns, we performed a simulation by setting the parameter ω to 2.3π, that is, in between standing and traveling waves; and the remaining parameters were the same as those used in section 3.1. Figure 6 and Supplementary Video 2 present the results. Figure 6A shows the diagram for lateral bending and the gait diagram. The footfall pattern was a L-S walk; the mean and SD of the duty factor were 66.8 and 0.23%, respectively; the mean and SD of the diagonality were 29.0 and 0.35%, respectively. These values were calculated from the 10 trials. The body flexion duration moves posteriorly but not continuously. The wave propagation has an irregular point at the hip (j = 7). Figures 6B,C show the lateral displacement of each body part toward the moving direction of the simulated robot and the lizard, D. dorsalis, respectively. In Figure 6B, the minimal lateral displacement point moves posteriorly, similar to traveling waves. However, there are several points at the same position (posterior to the shoulder) as if the nodes were present, similar to standing waves. Therefore, the waveform has attributes of both standing and traveling waves; thus, intermediate waves emerge. Figure 6C shows the waveform when the lizard exhibits intermediate waves. The numbered lines indicate the minimal lateral displacement points. The points moved posteriorly, and some of them were within a restricted portion of the mid-trunk. The tendency is qualitatively similar to that of the simulation results. Therefore, the proposed model without any modified parameter except for the control parameter ω reproduced gait patterns exhibited by the D. dorsalis.
Figure 6. Lateral-sequence walking with intermediate waves of lateral bending. The proposed model without any modified parameter except for the control parameter ω reproduced the gait pattern, as listed in Table 1. (A) The upper graph represents the lateral flexion of the trunk joint, wherein the colored region denotes the period when the trunk joint bends to the right (). The lower graph represents the gait diagram, wherein the colored region denotes the period when the foot is in contact with the ground (Ni > 0). (B) Waveform of lateral bending of the simulated robot. The superimposed figure was made from 12 stick figures. The stick figures were produced by connecting the lateral displacement of body segments from the center of mass (CoM). The moment of each stick figure is time-shifted every 1/12 gait cycle, and the line colors show the order of the stick figures (red: 1st and 7th; orange: 2nd and 8th; green: 3rd and 9th; cyan: 4th and 10th; blue: 5th and 11th; and violet: 6th and 12th). Note that the 1st and 7th stick figures are time-shifted by a half period of the gait cycle, thereby being mirror images of one another (the mirror images are in the same line color). (C) Waveform of lateral bending when Dipsosaurus dorsalis exhibits intermediate waves, adapted from Ritter (1992), with permission. The figure was made by a similar method to that applied for (B). The numbered lines indicate points of minimal lateral displacement in each stick figure.
L-S Walk With Traveling Waves
The salamander uses a traveling wave when performing a walking trot, but they have not been found to use traveling waves when using other slower walking gaits (Edwards, 1977). However, some lizards such as G. kingii, exhibit traveling waves, even at the lowest speed (Ritter, 1992). To investigate whether the proposed model can reproduce such gait patterns, we performed a simulation by setting the parameter ω to 2.3π, and the feedback gain from limb-to-body σLB and body-to-body σBB to lower values than those used in section 3.1 (σLB = 4.5 and σBB = 5.0, respectively). Figure 7 and Supplementary Video 3 show the results. Figure 7A shows the diagram for lateral bending and the gait diagram. The footfall pattern was a L-S walk; the mean and SD of the duty factor were 64.2% and 5.28 × 10−2, respectively. The mean and SD of the diagonality were 38.7 and 0.13%, respectively. These values were calculated from the 10 trials. The body flexion duration moves posteriorly and continuously. Figures 7B,C show the lateral displacement of each body part toward the moving direction of the simulated robot and the lizard, G. kingii, respectively. In Figure 6B, the minimal lateral displacement point moves posteriorly and continuously. The waveform is a traveling wave in which no node is present. Figure 6C shows the waveform when the lizard exhibits a traveling wave. The numbered lines indicate the minimal lateral displacement points. The figure shows that the points move posteriorly and continuously. The tendency is qualitatively similar to that of the simulation results. Therefore, the proposed model (with modified feedback gain parameters) reproduced the gait patterns exhibited by the G. kingii.
Figure 7. Lateral-sequence walking gait with traveling waves of lateral bending. The proposed model (with modified feedback gain parameters) reproduced the gait pattern, as listed in Table 1. (A) The upper graph represents the lateral flexion of the trunk joint, wherein the colored region denotes the period when the trunk joint bends to the right (). The lower graph represents the gait diagram, wherein the colored region denotes the period when the foot is in contact with the ground (Ni > 0). (B) Waveform of lateral bending of the simulated robot. The superimposed figure was made from 12 stick figures. The stick figures were produced by connecting the lateral displacement of body segments from the center of mass (CoM). The moment of each stick figure is time-shifted every 1/12 gait cycle, and the line colors show the order of the stick figure (red: 1st and 7th; orange: 2nd and 8th; green: 3rd and 9th; cyan: 4th and 10th; blue: 5th and 11th; violet: 6th and 12th). Note that the 1st and 7th stick figures are time-shifted by a half period of the gait cycle, thereby being mirror images of one another (the mirror images are in the same line color). (C) Waveform of lateral bending when Gerrhonotus kingii exhibits traveling waves, adapted from Ritter (1992), with permission. The figure was made by a similar method to that applied for (B). The numbered lines indicate points of minimal lateral displacement in each stick figure.
3.3. Effect of Sensory Feedback Strength on Gait Patterns
We performed simulations by changing various parameter sets, particularly, the feedback strengths, to specify the determinants of the gait patterns. For a quantitative gait evaluation, we used the two indices: diagonality and waveform index. The waveform index W was derived based on the gait evaluation method proposed by Kano et al. (2014) as follows:
where W denotes the waveform index. Dstd and Dtrv are the intergait distances of standing and traveling waves, respectively. r, rstd, and rtrv are the phase relationships between the trunk-joint angles (j = 3−10) of the exhibited wave, the standing wave, and the traveling wave, respectively. The phase of the trunk joint Φj can be defined by the timing of lateral flexion of the trunk joint; for example, Φj = 0 is the timing when the trunk joint bends to the right from the neutral angle (). Intergait distance is a measure for gait evaluation proposed by Kano et al. (2014). The distance shows the similarity of the specific gaits. For example, when a standing wave emerges, Dstd is lower and Dtrv is higher. Conversely, when a traveling wave emerges, Dstd is higher and Dtrv is lower. Therefore, when the waveform index W is positive, traveling waves emerge, when W is negative, standing waves emerge; and when W = 0, intermediate waves emerge. For further details of the derivation process, please refer to Kano et al. (2014).
The color maps in Figure 8 show the two indices when the intrinsic angular velocity ω is between 1.5π and 4.0π and the feedback gain from limb-to-limb σLL is between 0.00 and 7.50. In Figures 8B,D, the control parameters σLB and σBB are 7.0 and 7.7, respectively. In Figures 8C,D, the control parameters σLB and σBB are 4.5 and 5.0, respectively. The fluctuation in the upper left part of Figures 8C,D indicates that an unstable locomotion emerged, and the gait was not evaluated correctly. The squared regions indicate the parameter sets used in the other experiments (red: Figure 4 for ω = 1.8π described in section 3.1; blue: Figure 4 for ω = 3.8π described in section 3.1; yellow: Figure 6 described in section 3.2; and purple: Figure 7 described in section 3.2).
Figure 8. Color maps showing the two indices; diagonality and the waveform index, when the intrinsic angular velocity ω is between 1.5π and 4.0π, and the feedback gain from limb-to-limb σLL is between 0.00 and 7.50. (A) diagonality (σLB = 7.0, σBB = 7.7), (B) waveform index (σLB = 7.0, σBB = 7.7), (C) diagonality (σLB = 4.5, σBB = 5.0), (D) waveform index (σLB = 4.5, σBB = 5.0). In (A,C), the brighter region indicates a higher diagonality. In (B,D), the brighter region shows that a traveling wave emerges. The fluctuation in the upper left part of (C,D) indicates that an unstable locomotion emerged, and the gait was not evaluated correctly. The squared regions indicate the parameter sets used in the other experiments (red: Figure 4 for ω = 1.8π described in section 3.1; blue: Figure 4 for ω = 3.8π described in section 3.1; yellow: Figure 6 described in section 3.2; and purple: Figure 7 described in section 3.2).
According to Figures 8A,B, both the diagonality and the index W increases as ω increases. Therefore, a walking trot with a traveling wave emerges for large values of ω. Conversely, both indices decrease as σLL increases, and a L-S walk with a standing wave emerges for large values of σLL. Intermediate waves emerge for intermediate values of ω. Meanwhile, the values of both the diagonality and index W in Figures 8C,D are generally larger than those in Figures 8A,B. Therefore, for small σLB and σBB, a walking trot with a traveling wave emerges even at a relatively small value of ω. This tendency is qualitatively consistent with the behavior of G. kingii using traveling waves exclusively, even at extremely slow speeds (Ritter, 1992).
3.4. Effect of Body Size and Mass on Gait Patterns
We performed simulations by changing the body size and weight, and investigated the effect of these parameters on the exhibited gait patterns. This experiment used the same parameter set used in Figure 6 which is described in section 3.2 (i.e., for the L-S walk with intermediate waves). The color maps in Figure 9 show the two indices; diagonality and waveform index, when the body size and weight are between 50 and 150% of those, as listed in Table 1. Figure 9A shows that the diagonality tends to be higher for a larger body size and be lower for a heavier body. Figure 9B shows that the waveform index tends to be higher; that is, the waveform is relatively similar to traveling waves, for a larger body size.
Figure 9. Color maps showing the two indices; diagonality and the waveform index, when the body size and mass are between 50 and 150%, (A) diagonality, (B) waveform index. In (A), the brighter region indicates a higher diagonality. In (B), the brighter region shows that the waveform is relatively similar to the traveling waves. The control parameter set was used in Figure 6 is described in section 3.2; for the L-S walk with intermediate waves.
4. Discussion
To the best of our knowledge, this is the first study to demonstrate the spontaneous gait transition from lateral sequence walking with standing body waves, to walking trot with traveling body waves, in sprawling quadruped locomotion. The gait transition was achieved by changing only one parameter ω, which is related to a command from the brain. In the previous studies, Ijspeert et al. (2007) reproduced the salamander gait transitions from walking to swimming. This study also reproduced the standing- and traveling-wave patterns by modulating the strength of the descending command. However, the traveling waves were used for swimming but not for walking, and the walking pattern was uniquely determined by inter-oscillator couplings between the limbs and body CPGs. Harischandra et al. (2011) proposed a CPG model utilizing sensory feedback based on the Ijspeert's model and showed the gait transition from walk to trot. That study suggested that sensory modulation has an essential role for gait transition. However, because the body–limb coordination patterns were predetermined by inter-oscillator couplings, the transition of the bending patterns of the body trunk was not reproduced. In contrast, we designed a CPG controller based on sensory couplings through bidirectional feedback between the limbs and body without inter-oscillator couplings, and we demonstrated that the controller can reproduce flexible body–limb coordination patterns. This result suggests that the proposed sensory feedback mechanisms could play an important role in sprawling quadruped locomotion.
The proposed model changes the footfall pattern in response to the control and body parameters. Specifically, diagonality tends to be higher when the leg phase oscillator has a higher frequency. For example, the higher the intrinsic angular velocity of the oscillator ω, the higher the diagonality (Figures 8A,C). Meanwhile, the higher feedback gain of limb-to-limb σLL and body-to-limb σBL tend to have lower diagonality owing to the effect of the phase modification that decreases the phase frequency. Similarly, a heavier body tends to have a lower diagonality because a heavier body can obtain a higher reaction force Ni that enhances the limb-to-limb feedback. Furthermore, the higher feedback gain of limb-to-body σLB and body-to-body σBB tend to have lower diagonality because the feedback gain is related to the generated torque at the trunk, which enhances the body-to-limb feedback. Owing to the close interactions between the sensory feedback mechanisms, the proposed model generates flexible footfall patterns.
Sprawling quadruped animals use various body bending patterns. However, the mechanisms responsible for generating flexible bending patterns remain unclear. In this article, we presented a potential solution to generate various bending patterns. Our proposed model coordinates axial movements using curvature derivative control and sensory feedback from the legs. Curvature derivative control causes the angle of the trunk joint to follow that of the anterior trunk joint. Therefore, the control shapes a traveling wave of axial movements. Because the control gain (here is σBB) is related to the follow-up speed, the higher the feedback gain, the faster the wave speed of the traveling waves. Meanwhile, the feedback from the legs imposes bending of the trunk joint at the shoulder (j = 3) and hip (j = 7) in response to the ground contacts. Given that the footfall timings of diagonally opposite feet are roughly synchronized, the feedback tends to cause the bending of the shoulder antiphase with respect to that of the hip. As a result, a standing wave with nodes at the shoulder and hip emerges for a large feedback gain of curvature derivative control σBB, that is, when the wave speed is higher. When the σBB is lower, the wave speed is lower, and a traveling wave emerges. The intermediate wave emerges in the condition between those of the standing wave and traveling waves. Based on these mechanisms, the proposed model generates flexible bending patterns. Furthermore, increasing the body size has a similar effect of reducing the body-to-body feedback gain (Figure 9B) because a larger body size has a higher inertia that delays the wave speed of the body bending.
We hypothesized that a salamander possesses load and stretch sensors at each body part and that sensory information is transmitted to nearby body parts. At present, there is no definitive neurophysiological evidence for the proposed sensory feedback mechanism. However, several biological findings suggest that the proposed mechanism possibly exists. First, it has been reported that the salamander's body and limbs have mechanoreceptors (Chevallier et al., 2008; Ryczko et al., 2020). Second, similar feedback mechanisms were reported for other vertebrates. Specifically, cats utilize signals related to the force in leg muscles to initiate the transition from the stance to swing phase in each leg (Pearson et al., 2006), while lampreys utilize stretch receptors along the trunk to coordinate axial movements (Grillner, 1996). Third, the neural circuits for limb movements are located in particular vertebrae above and below the axial trunk network (Bicanski et al., 2013b). Therefore, sharing sensory signals among nearby body parts is feasible. Further biological studies are required to prove the validity of the proposed mechanisms. In addition, direct inter-oscillator couplings are known to exist within the salamander spinal cord, in particular in the axial networks (Ryczko et al., 2010), whereas in this study we purposely removed them in order to focus on sensory-driven synchronization mechanisms. Future studies should investigate this further once the actual neural circuits of the salamander spinal cord are better known. The finding of this study suggests that the role of inter-oscillator coupling in shaping the locomotor patterns might be less important than previously thought, compared to sensory-driven mechanisms.
In the future, we aim to develop a salamander robot and verify the proposed model in the real world. We will investigate the locomotion speed and cost efficiency for various gait patterns and contribution of the proposed sensory feedback mechanisms. This will contribute to an understanding of the merits of gait transitions in sprawling locomotion. Furthermore, we will investigate the robustness of ground property changes. Although this study used flat terrain as the experimental environment, we expect that the proposed sensory feedback mechanisms have some adaptability toward various ground properties, such as a granular surface and gravel road, owing to the body–limb sensory feedback mechanisms. Finally, we would like to elucidate a common principle underlying body–limb coordination by studying other animals. We have already proposed models for body–limb coordination of sea roaches (Kano et al., 2019) and quadrupeds that exhibit cheetah-like galloping (Fukuhara et al., 2020). Based on these studies, we aim to find commonalities to various legged animals, and establish a universal control framework for legged robots with high robustness and adaptability.
Data Availability Statement
The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author/s.
Author Contributions
SS, AIj, and AIs designed the study. AIs supervised the project. SS, TK, and AIs designed the mathematical model. SS carried out the simulation experiments and the initial draft of the manuscript. All authors are involved in revising the manuscript.
Funding
This work was supported by the Human Frontier Science Program (RGP0027/2017), the Grant-in-Aid for JSPS Research Fellows (No. 20J10805), and the Division for Interdisciplinary Advanced Research and Education, Tohoku University.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Acknowledgments
The authors would like to thank Dr. Akira Fukuhara, Kotaro Yasui, Taishi Mikami, and Hayato Amaike of Tohoku University for their helpful suggestions.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fnbot.2021.645731/full#supplementary-material
References
Ashley-Ross, M. (1994). Hindlimb kinematics during terrestrial locomotion in a salamander (Dicamptodon tenebrosus). J. Exp. Biol. 193, 255–283. doi: 10.1242/jeb.193.1.255
Bicanski, A., Ryczko, D., Cabelguen, J.-M., and Ijspeert, A. J. (2013a). From lamprey to salamander: an exploratory modeling study on the architecture of the spinal locomotor networks in the salamander. Biol. Cybern. 107, 565–587. doi: 10.1007/s00422-012-0538-y
Bicanski, A., Ryczko, D., Knuesel, J., Harischandra, N., Charrier, V., Ekeberg, Ö., et al. (2013b). Decoding the mechanisms of gait generation in salamanders by combining neurobiology, modeling and robotics. Biol. Cybern. 107, 545–564. doi: 10.1007/s00422-012-0543-1
Cabelguen, J.-M., Bourcier-Lucas, C., and Dubuc, R. (2003). Bimodal locomotion elicited by electrical stimulation of the midbrain in the salamander notophthalmus viridescens. J. Neurosci. 23, 2434–2439. doi: 10.1523/JNEUROSCI.23-06-02434.2003
Cartmill, M., Lemelin, P., and Schmitt, D. (2002). Support polygons and symmetrical gaits in mammals. Zool. J. Linnean Soc. 136, 401–420. doi: 10.1046/j.1096-3642.2002.00038.x
Chevallier, S., Ijspeert, A. J., Ryczko, D., Nagy, F., and Cabelguen, J.-M. (2008). Organisation of the spinal central pattern generators for locomotion in the salamander: biology and modelling. Brain Res. Rev. 57, 147–161. doi: 10.1016/j.brainresrev.2007.07.006
Crespi, A., Karakasiliotis, K., Guignard, A., and Ijspeert, A. J. (2013). Salamandra robotica ii: an amphibious robot to study salamander-like swimming and walking gaits. IEEE Trans. Robot. 29, 308–320. doi: 10.1109/TRO.2012.2234311
Date, H., and Takita, Y. (2007). “Adaptive locomotion of a snake like robot based on curvature derivatives,” in 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems (San Diego, CA), 3554–3559. doi: 10.1109/IROS.2007.4399635
Edwards, J. L. (1977). “The evolution of terrestrial locomotion,” in Major Patterns in Vertebrate Evolution, eds M. K. Hecht, P. C. Goody, and B. M. Hecht (Boston, MA: Springer), 553–577. doi: 10.1007/978-1-4684-8851-7_20
Fukuhara, A., Koizumi, Y., Suzuki, S., Kano, T., and Ishiguro, A. (2020). Decentralized control mechanism for body-limb coordination in quadruped running. Adapt. Behav. 28, 151–164. doi: 10.1177/1059712319865180
Grillner, S. (1996). Neural networks for vertebrate locomotion. Sci. Am. 274, 64–69. doi: 10.1038/scientificamerican0196-64
Harischandra, N., Cabelguen, J.-M., and Ekeberg, Ö. (2010). A 3d musculo-mechanical model of the salamander for the study of different gaits and modes of locomotion. Front. Neurorobot. 4:112. doi: 10.3389/fnbot.2010.00112
Harischandra, N., Knuesel, J., Kozlov, A., Bicanski, A., Cabelguen, J.-M., Ijspeert, A., et al. (2011). Sensory feedback plays a significant role in generating walking gait and in gait transition in salamanders: a simulation study. Front. Neurorobot. 5:3. doi: 10.3389/fnbot.2011.00003
Hildebrand, M. (1959). Motions of the running cheetah and horse. J. Mammal. 40, 481–495. doi: 10.2307/1376265
Hildebrand, M. (1965). Symmetrical gaits of horses. Science 150, 701–708. doi: 10.1126/science.150.3697.701
Ijspeert, A. J. (2001). A connectionist central pattern generator for the aquatic and terrestrial gaits of a simulated salamander. Biol. Cybern. 84, 331–348. doi: 10.1007/s004220000211
Ijspeert, A. J. (2020). Amphibious and sprawling locomotion: from biology to robotics and back. Annu. Rev. Control Robot. Auton. Syst. 3, 173–193. doi: 10.1146/annurev-control-091919-095731
Ijspeert, A. J., Crespi, A., Ryczko, D., and Cabelguen, J.-M. (2007). From swimming to walking with a salamander robot driven by a spinal cord model. Science 315, 1416–1420. doi: 10.1126/science.1138353
Kano, T., Ikeshita, Y., Fukuhara, A., and Ishiguro, A. (2019). Body-limb coordination mechanism underlying speed-dependent gait transitions in sea roaches. Sci. Rep. 9, 1–9. doi: 10.1038/s41598-019-39862-3
Kano, T., and Ishiguro, A. (2020). Decoding decentralized control mechanism underlying adaptive and versatile locomotion of snakes. Integr. Compar. Biol. 60, 232–247. doi: 10.1093/icb/icaa014
Kano, T., Owaki, D., and Ishiguro, A. (2014). A simple measure for evaluating gait patterns during multi-legged locomotion. SICE J. Control Meas. Syst. Integr. 7, 214–218. doi: 10.9746/jcmsi.7.214
Liu, Q., Yang, H., Zhang, J., and Wang, J. (2018). A new model of the spinal locomotor networks of a salamander and its properties. Biol. Cybern. 112, 369–385. doi: 10.1007/s00422-018-0759-9
Loscher, D. M., Meyer, F., Kracht, K., and Nyakatura, J. A. (2016). Timing of head movements is consistent with energy minimization in walking ungulates. Proc. R. Soc. B Biol. Sci. 283:20161908. doi: 10.1098/rspb.2016.1908
Owaki, D., and Ishiguro, A. (2017). A quadruped robot exhibiting spontaneous gait transitions from walking to trotting to galloping. Sci. Rep. 7, 1–10. doi: 10.1038/s41598-017-00348-9
Owaki, D., Kano, T., Nagasawa, K., Tero, A., and Ishiguro, A. (2013). Simple robot suggests physical interlimb communication is essential for quadruped walking. J. R. Soc. Interface 10:20120669. doi: 10.1098/rsif.2012.0669
Pearson, K., Ekeberg, Ö., and Büschges, A. (2006). Assessing sensory function in locomotor systems using neuro-mechanical simulations. Trends Neurosci. 29, 625–631. doi: 10.1016/j.tins.2006.08.007
Ritter, R. (1992). Lateral bending during lizard locomotion. J. Exp. Biol. 173, 1–10. doi: 10.1242/jeb.173.1.1
Ryczko, D., Charrier, V., Ijspeert, A., and Cabelguen, J.-M. (2010). Segmental oscillators in axial motor circuits of the salamander: distribution and bursting mechanisms. J. Neurophysiol. 104, 2677–2692. doi: 10.1152/jn.00479.2010
Ryczko, D., Simon, A., and Ijspeert, A. J. (2020). Walking with salamanders: from molecules to biorobotics. Trends Neurosci. 43, 916–930. doi: 10.1016/j.tins.2020.08.006
Smith, R. (2005). Open Dynamics Engine. Available online at: https://www.ode.org/
Suzuki, S., Kano, T., Ijspeert, A. J., and Ishiguro, A. (2019). Decentralized control with cross-coupled sensory feedback between body and limbs in sprawling locomotion. Bioinspir. Biomim. 14:066010. doi: 10.1088/1748-3190/ab3ef6
Suzuki, S., Kano, T., Ijspeert, A. J., and Ishiguro, A. (2019b). “A salamander robot driven by cross-coupled sensory feedback control between legs and trunk,” in 9th International Symposium on Adaptive Motion of Animals and Machines (AMAM) (Lausanne).
Keywords: salamander locomotion, body-limb coordination, gait transition, decentralized control, sensory feedback control
Citation: Suzuki S, Kano T, Ijspeert AJ and Ishiguro A (2021) Spontaneous Gait Transitions of Sprawling Quadruped Locomotion by Sensory-Driven Body–Limb Coordination Mechanisms. Front. Neurorobot. 15:645731. doi: 10.3389/fnbot.2021.645731
Received: 23 December 2020; Accepted: 09 June 2021;
Published: 30 July 2021.
Edited by:
Poramate Manoonpong, University of Southern Denmark, DenmarkReviewed by:
Lijun Zhu, Huazhong University of Science and Technology, ChinaGuoping Zhao, Darmstadt University of Technology, Germany
Copyright © 2021 Suzuki, Kano, Ijspeert and Ishiguro. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Shura Suzuki, c2h1cmEmI3gwMDA0MDtlb20ubWVjaC5lbmcub3Nha2EtdS5hYy5qcA==
†Present address: Shura Suzuki, Department of Mechanical Engineering, Osaka University, Suita, Japan