- 1Research Institute of Electrical Communication, Tohoku University, Sendai, Japan
- 2Japan Science and Technology Agency, CREST, Saitama, Japan
Insects exhibit adaptive and versatile locomotion despite their minimal neural computing. Such locomotor patterns are generated via coordination between leg movements, i.e., an interlimb coordination, which is largely controlled in a distributed manner by neural circuits located in thoracic ganglia. However, the mechanism responsible for the interlimb coordination still remains elusive. Understanding this mechanism will help us to elucidate the fundamental control principle of animals' agile locomotion and to realize robots with legs that are truly adaptive and could not be developed solely by conventional control theories. This study aims at providing a “minimal" model of the interlimb coordination mechanism underlying hexapedal locomotion, in the hope that a single control principle could satisfactorily reproduce various aspects of insect locomotion. To this end, we introduce a novel concept we named “Tegotae,” a Japanese concept describing the extent to which a perceived reaction matches an expectation. By using the Tegotae-based approach, we show that a surprisingly systematic design of local sensory feedback mechanisms essential for the interlimb coordination can be realized. We also use a hexapod robot we developed to show that our mathematical model of the interlimb coordination mechanism satisfactorily reproduces various insects' gait patterns.
1. Introduction
Insects exhibit tremendously versatile gait patterns owing to their locomotion speed and physical/environmental conditions (Hughes, 1957; Graham, 1972, 1977; Cruse, 1976; Foth and Graham, 1983a,b; Dean, 1991; Zollikofer, 1994a,b,c; Noah et al., 2004; Goldman et al., 2006; Sponberg and Full, 2008; Grabowska et al., 2012; Wosnitza et al., 2013). These locomotor patterns are generated via their interlimb coordination mechanism. Biological findings suggest that interlimb coordination in hexapedal locomotion is controlled largely in a decentralized manner by neural networks located in thoracic ganglia (Pearson and Iles, 1969, 1973; Bässler and Wegner, 1983; Dean, 1989; Brekowitz and Laurent, 1996). Thus, clarifying this interlimb coordination mechanism is expected to allow us to obtain the key to understanding the control principle underlying animals' agile locomotion and for realizing truly adaptive legged robots that could not be realized solely by conventional control methods.
Aiming to elucidate the mechanism responsible for the interlimb coordination in hexapedal locomotion, various studies have been conducted to date by focusing on specific insects, e.g., stick insects (Graham, 1972, 1977; Cruse, 1976; Foth and Graham, 1983a,b; Dean, 1991; Grabowska et al., 2012) and cockroaches (Hughes, 1957; Pearson and Iles, 1969; Noah et al., 2004; Goldman et al., 2006; Sponberg and Full, 2008) and/or by focusing on control paradigms, e.g., central pattern generators (CPGs) (Pearson and Iles, 1973; Bässler and Wegner, 1983; Bässler, 1986, 1993; Ryckebusch and Laurent, 1993; Büschges et al., 1995, 2004; Bässler and Büschges, 1998; Büschges, 2005; Borgmann et al., 2009; Daun-Gruhn and Büschges, 2011; Marder and Bucher, 2011) and chains of reflexes (Cruse, 1983, 1990; Cruse et al., 1998; Dürr et al., 2004; Schilling et al., 2013). The knowledge obtained from these past studies deepened biological understanding of the interlimb coordination mechanism greatly; however, the diversity of these approaches may have confused roboticists who want to build adaptive insect-like hexapod robots via bio-inspired approaches (Kimura et al., 1993; Beer et al., 1997; Altendorfer et al., 2001; Ritzmann et al., 2004; Ambe et al., 2013; Manoonpong et al., 2013).
In order to address this problem, in this study, we attempt to capture the control principle essential to understanding the interlimb coordination in a concise form that could help bridge the gap between biologists and roboticists, in the hope that a single control principle could adequately reproduce various aspects of insect locomotion. Since reduction is required for understanding the essence, we build a “minimal model” of the interlimb coordination mechanism on the basis of a mathematically tractable highly abstract model. To this end, we employ a unique approach in this study. We introduce a novel concept we named “Tegotae,” a Japanese concept describing the extent to which a perceived reaction matches an expectation. We then introduce a Tegotae function, which is a function that quantitatively measures Tegotae, whereby we can design a decentralized interlimb coordination mechanism in a systematic manner. We validated the Tegotae-based interlimb coordination model by using a physical hexapod robot that we developed. We confirmed that the model adequately reproduced various aspects of insect locomotion patterns. We expect that our minimal model, systematically derived from the concept of Tegotae, will provide substantial insight into the essence of the interlimb coordination mechanism to roboticists as well as biologists.
The following section presents the materials and methods used in this study. First, we describe a basic building block for the interlimb coordination mechanism. Second, we explain the Tegotae concept and the design scheme of local sensory feedback using the Tegotae-based approach. Third, we explain the developed robotic platform in detail. Section 3 presents the experimental results to validate our Tegotae-based control for the interlimb coordination mechanism. Finally, in Section 4, we discuss our results and future work.
2. Materials and Methods
2.1. Basic Building Block of Interlimb Coordination Mechanism Employed
To capture the control principle essential for the interlimb coordination mechanism, which works largely in a decentralized manner in insects' thoracic ganglia, it is important to determine a basic building block to be used for the distributed control system. From a control perspective, past studies have intensively argued mainly from the viewpoint of two distinct control paradigms: chains of reflexes (Cruse, 1983, 1990; Cruse et al., 1998; Dürr et al., 2004; Schilling et al., 2013) and CPGs (Pearson and Iles, 1973; Bässler and Wegner, 1983; Bässler, 1986, 1993; Ryckebusch and Laurent, 1993; Büschges et al., 1995, 2004; Bässler and Büschges, 1998; Büschges, 2005; Borgmann et al., 2009; Daun-Gruhn and Büschges, 2011; Marder and Bucher, 2011). In the chain-of-reflex approach, a control system is modeled by using many chained discontinuous reflexive events, in which locomotion can be generated purely from the interaction between sensory feedback signals and the body. However, the discontinuity in this approach may impede mathematical tractability (Daun-Gruhn and Büschges, 2011). In contrast, in the CPG approach, a control system is modeled by using directly coupled oscillators to generate feedforward motor commands, based on a continuous dynamical system, i.e., a set of differential equations, for the interlimb coordination. Considering the mathematical tractability stemming from a continuous model, we employ the CPG approach as a control paradigm. The CPG approach offers various ways to model a basic building block at different levels of abstraction (Ijspeert, 2008), ranging from detailed models using a single cell (Hodgkin and Huxley, 1952; Hellgren et al., 1992) to abstract oscillator models (Fitz-Hugh, 1969; Van der Pol, 1972; Kuramoto, 1984). Here we use a phase oscillator (Kuramoto, 1984) for each leg to build a minimal model of the interlimb coordination mechanism on the basis of a highly abstract model.
The time evolution of the oscillator phase is described by a differential equation as follows:
where ω is the intrinsic angular velocity; ϕi is the phase of the oscillator implemented into the ith leg; and fi is a local sensory feedback term, which plays an essential role in the interlimb coordination. This equation is one of the abstract oscillator models, i.e., the Kuramoto model (Kuramoto, 1984) (a case without coupling between oscillators and with local sensory feedback fi), which describes a one-dimensional, reduction model of oscillatory behaviors. Using the trigonometric functions (sin ϕi, cos ϕi, etc.) of oscillator phases enables us to generate a periodic motor command to control the legs of a robot. As an example of implementation, we describe the target angles and for the proportional and derivative (PD) control of the motors (as explained in Section 2.4 and Figure 6 in detail) through the following equations:
where A, B, and B′ are user-defined parameters, describing amplitudes in the yaw and roll direction for leg motion (see Section 2.4 and Table 1). Thus, the ith leg is actively controlled according to ϕi such that the ith leg is in the swing phase when 0 ≤ ϕi < π, i.e., sin ϕi > 0, and in the stance phase when π ≤ ϕi < 2π, i.e., sin ϕi < 0, as shown in Figure 1. Below, we explain how we design local sensory feedback fi by introducing the concept of “Tegotae” in a systematic manner.
Figure 1. Schematic of the basic building block for the control system. We used a phase oscillator (Kuramoto, 1984) with local sensory feedback for each leg for hexapedal interlimb coordination. The ith leg is actively controlled (see Figure 5) according to ϕi such that the ith leg is in the swing phase when 0 ≤ ϕi < π and in the stance phase when π ≤ ϕi < 2π.
2.2. Tegotae and Tegotae Function
Here we explain the core concept Tegotae in detail. Tegotae is a novel concept describing the extent to which a perceived reaction matches an expectation (intention) of a controller. For ease of understanding, let us explain it metaphorically. Imagine you want to lean against a wall nearby. Note that what you want to do, i.e., leaning against the wall, is regarded as the intention of the controller, i.e., your nervous system. When you lean against the wall, if you feel that the reaction force from the wall is sufficient for supporting your body, we say “good” Tegotae is obtained. If the reaction force you receive is insufficient (imagine the wall were a curtain/screen for example), “bad” Tegotae is obtained. Notice that Tegotae stems not only from the reaction received from the environment, but also from the consistency between the perceived reaction and the intention/expectation of the controller, i.e., what the controller wants to do.
Now the question is how to quantify Tegotae. Of course, there are various ways to accomplish this. As the initial step of the investigation, we quantify Tegotae in the simplest mathematical form, i.e., a function based on the type of separation of variables as follows:
Hereafter, we refer to the function Ti as the “Tegotae function”—a function that quantitatively measures Tegotae. ϕi is a control variable (in this case the phase of the oscillator), and N is the sensory information obtained from multiple sensors embedded in the body. Note that, the Tegotae function Ti is expressed as the product of two functions C(ϕi) and S(N): the former is a function expressing the intention of the controller, and the latter denotes the reaction obtained from the environment. Here, we design Ti such that it becomes more positive when enhanced Tegotae is detected. Next, we explain how we can design the sensory feedback term fi by using Ti.
2.3. Tegotae-Based Control
Given that the Tegotae function is defined, the local sensory feedback term fi is designed in such a way that the control system modulates ϕi in order to increase the amount of Tegotae received. Thus, because a continuous system is used, fi is expressed simply as the partial derivative of the Tegotae function Ti with respect to the control variable ϕi, as follows:
Note that we can systematically design decentralized controllers by only designing the Tegotae functions required.
Now, the question is how to define Ti(ϕi, N) to satisfactorily reproduce the hexapedal interlimb coordination observed in insect locomotion. In this study, we define Ti(ϕi, N) as follows:
As Equation (6) indicates, Ti(ϕi, N) consists of two Tegotae functions, Ti, 1(ϕi, N) and Ti, 2(ϕi, N), both of which are linearly coupled via the positive constants σ1 and σ2. The suffix i denotes the leg number (i:1, 2, …, 6). Sensory information N consists of vertical ground reaction forces (GRFs) acting on each leg . L(i) denotes a set consisting of the legs neighboring the ith leg, and nL is the number of elements in L(i) and kj (ka, kp, kc ≥ 0) denotes the weight for each GRF , as shown in Figure 2. Further, we present a detailed explanation of the approach we followed when designing these two Tegotae functions.
Figure 2. Definition of L(i), describing a set consisting of the legs neighboring the ith leg. The left, center, and right figures show the set of left fore (L1), left middle (L2), and left hind (L3) legs, respectively. kj (ka, kp, kc ≥ 0) denotes the weight for each GRF Nj.
Ti, 1 quantifies Tegotae on the basis of the information that is only locally available at the corresponding leg; when the local controller intends to be in the stance leg (−sin ϕi > 0), and results in receiving a ground reaction force () (Figure 3, top), Ti, 1 evaluates this situation as “good” Tegotae, and returns a positive value.
Figure 3. Definition of the “Tegotae” functions, which are expressed as the product of C(ϕi) and S(N). We design Ti such that it becomes more positive when enhanced Tegotae is detected. The upper and lower figures show the Ti, 1 and Ti, 2 functions for the left middle leg (L2), respectively.
On the other hand, Ti, 2 quantifies Tegotae on the basis of the relationship between the movements of the corresponding leg and its neighboring legs; when the local controller intends to be in the swing phase (sin ϕi > 0) and its neighboring legs offer good support to the body at that time () (Figure 3, bottom), Ti, 2 evaluates that the corresponding leg adequately establishes a relationship with its neighboring legs and returns a positive value.
By substituting Equations (6–8) into Equations (1) and (5), we obtain our interlimb coordination mechanism as follows:
Introduction of the Tegotae-based approach enables us to easily design a minimal model for hexapedal interlimb coordination in a systematic manner.
2.4. Robotic Platform for the Validation of Proposed Control Scheme
Figure 4 shows the structure of our hexapod robot. The robot consists of six leg segments (Figure 5) and a body segment. The robot is 0.40 m long, 0.30 m wide, 0.20 m high, and weighs 2.4 kg. The leg and body consist of carbon fiber rods and acrylonitrile butadiene styrene (ABS) resin printed using a 3-D printer. For each leg, we used two servo motors (Futaba Corporation, Japan: RS405CB), which generate leg motion during the swing and stance phases according to the corresponding oscillator phase (Figure 5B). As shown in Figure 6, we describe the target angles and for proportional and derivative (PD) control of the motors through the following equations:
Figure 4. Hexapod robot developed for the study. The robot is 0.40 m long, 0.30 m wide, 0.20 m high, and weighs 2.4 kg.
Figure 5. Detailed structure of the leg segment of the robot. (A) The leg consists of carbon fiber rods and ABS resin printed using a 3-D printer. The feet contain three-axis force sensors to detect GRFs. (B) Each leg is equipped with two servo motors, which generate leg motion during the swing and stance phases according to the corresponding oscillator phase.
Figure 6. Leg trajectory for a single leg, where and denote the target angles for proportional and derivative (PD) control of the motors in the yaw and roll directions, respectively. Based on this control scheme, we can generate periodic leg motion as shown in Figure 5B.
Based on this control scheme, we can generate periodic leg motion as shown in Figure 5B. From the viewpoint of neurophysiological findings for a locomotor CPG system in animals (Lafreniere-Roula and McCrea, 2005; Rybak et al., 2016), Equation (9) corresponds to the rhythm generator (RG) and Equations (10) and (11) correspond to a pattern formation (PF) network in the two-level CPG concept. For the robot, we choose parameter values A, B, B′ for the geometric path of the foot by tuning them through trial and error as shown in Table 1. We employ passive springs (MISUMI Corporation: WM8-20, 2.9 N/mm) in each leg for shock absorption. Furthermore, we use three-axis force sensors (OptoForce Ltd., Hungary: OMD-20-SE-40N) in the feet of the robot to detect ground reaction forces (GRFs), as shown in Figure 5A.
The body contains a main control board. We calculate the oscillator phase in each leg by using microcontrollers (mbed NXP LPC1768) on the main control board. We manipulated each servo motor installed in the legs using proportional-derivative (PD) control as explained above.
3. Experimental Results
To verify the proposed control scheme in the real world, we conducted five experiments: (i) steady walking, (ii) gait transition according to locomotion speed, (iii) adaptability to change in weight distribution, (iv) adaptability to leg amputation, and (v) effect of local sensory feedback. The control parameters that were used in experiments with the hexapod robot (Sections 3.1–3.5) are listed in Table 1. We conducted over 10 trials for each experiment: each trial was conducted on a treadmill for a period of 50 s using randomly selected initial phases.
3.1. Steady Walking
Figure 7 shows the results of measurements conducted when our robot was engaged in steady walking. Here, we set the parameter ω = 2.0 rad/s. Figure 7 shows the gait diagram (upper graph) and time evolution of the oscillator phases of the legs (lower graph, sin ϕi) for the period 0.0–20.0 s. In the gait diagram, the colored regions represent the stance phase, which is distinguished by using the threshold data value (1.5 N: less than 10% of the maximum force detected) from the force sensor. Hereafter, we use the gait diagrams and movies (i.e., Movies S1–S3) recorded by a video camera as a qualitative evaluation index and the average duty factors (the ratio of the stance phase to one period) as a quantitative evaluation index. For the quantitative analysis, the duty factors obtained by the gait diagrams reflect the direction of the robot motion (i.e., straightness) because the asymmetric duty factors in the left and right legs indicate turning in the locomotion. Moreover, the duty factors indirectly represent the foot point velocity during the locomotion because the leg trajectory of our robot is determined in response to oscillator phases (Figure 6). Thus, the data of the duty factors from the gait diagrams indirectly include physical information about the speed and the direction of the locomotion (see SM for more details). The gait pattern rapidly converges from the initial phase relationship to a tetrapod gait—the ipsilateral feet touch the ground in the order of hind, middle, and fore legs—within approximately two periods. Furthermore, we tested the effect of the variation in the initial oscillator phases on the gait patterns. The results confirmed that the initial patterns converged to the same gait patterns from any initial phase relationship (in 10 out of 10 trials: 100%).
Figure 7. Upper graph: Gait diagram. Lower graph: Corresponding phase sin ϕi. The gait pattern rapidly converges from the initial phase relationship to a tetrapod gait, in which the ipsilateral feet touch the ground in the order hind, middle, and fore legs, within approximately two periods. The results confirmed that the initial patterns converged to the same gait patterns from any initial phase relationship (in 10 out of 10 trials: 100%).
3.2. Gait Transitions According to Locomotion Speed
We tested the ability of the proposed control scheme to change the gait patterns according to the locomotion speed by linearly changing the parameter ω from 2.0 to 4.0 rad/s during the time period 40.0 to 42.0 s. Figure 8A shows the gait diagram (upper graph) and the time evolution of oscillator phases of legs (lower graph, sin ϕi), during the time period 30.0–50.0 s in this experiment. After ω was chenged, the gait pattern spontaneously changed from that of a tetrapod to that of a tripod—the (L1, R2, L3) and (R1, L2, R3) feet alternately touch the ground in the anti-phase (Movie S1). Figure 8B shows the profile of vertical and horizontal GRFs ( and ) in the same experiment. In this figure, the upper, middle, and lower graphs show the GRF profile of the front (L1), middle (L2), and hind (L3) legs, respectively. Furthermore, we confirmed this result for the gait transition in all 10 trials (10/10: 100%). The results indicate that leg coordination is appropriately modified according to the locomotion speed via Tegotae-based control.
Figure 8. (A) Upper graph: Gait diagram. Lower graph: Corresponding phase sin ϕi. We found spontaneous transition from the gait of a tetrapod to that of a tripod, in which the (L1, R2, L3) and (R1, L2, R3) feet alternately touch the ground in anti-phase, by changing only parameter ω from 2.0 to 4.0 rad/s in the period from 40.0 to 42.0 s (yellow highlight in the graph, Movie S1). We confirmed the same result for the gait transition in all 10 trials (10/10: 100%). (B) The profile of vertical and horizontal GRFs ( and ). The upper, middle, and lower graphs show the GRF profile of the front (L1), middle (L2), and hind (L3) legs, respectively.
3.3. Adaptability to Change in Weight Distribution
Here, we show the adaptability of our robot to changes in weight distribution by applying a load (500 g) to the hind portion of the body (upper photograph in Figure 9). The lower graphs in Figure 9 show the experimental result. Here, we changed the parameter ω from 2.0 to 4.0 rad/s during the period 40.0 to 42.0 s as in the previous gait transition experiments (Section 3.2). After changing ω, the gait pattern did not change to that of a tripod; instead, a tetrapod gait was maintained (Movie S2). We obtained the same results in 10 out of 10 trials (100%). Figure 10 compares the average duty factor of the front, middle, and hind legs without and with the load for 10 trials (ω = 4.0 rad/s). The duty factor, which is the ratio of the stance phase to one period, was calculated by using the gait patterns during six periods for each trial. This result indicates that the duty factor of the loaded hind legs is larger than that of legs that do not bear any load. This result demonstrates the adaptability of our proposed control scheme to changes in the weight distribution without requiring prior data about these changes.
Figure 9. Top: Location of a load (500 g) applied to our robot. Bottom: Gait diagram and corresponding phase sin ϕi. After changing ω, the gait pattern did not change to that of a tripod; instead, a tetrapod gait was maintained (Movie S2). We found the same results in 10 out of 10 trials (100%).
Figure 10. Average duty factor of each leg without and with a load through 10 trials (ω = 4.0 rad/s). This result indicates that the duty factors of the loaded hind legs and middle legs are larger than those of legs without a load, whereas the duty factor of the front legs becomes smaller.
3.4. Adaptability to Leg Amputation
Figure 11 shows the experimental results of the leg amputation test after both of the middle legs were amputated. In spite of the amputation, the robot was able to continue walking. Furthermore, the gait patterns converged to a trot or an L-S walk gait observed in quadrupeds—i. e. the (L1, R3) and (R1, L3) feet alternately touch the ground in nearly anti-phase, or more precisely, focusing on the timing of touch down, the feet touch the ground in the order from L1, R3, R1, L3 (Movie S3). Figure 12 compares the average duty factor of the front, middle, and hind legs for 10 trials of the leg amputation experiment. The duty factor of each leg was modulated according to the remaining number of legs, which mainly resulted in increasing the duty factor of the hind legs. Furthermore, we confirmed that the initial patterns converged to the same gait patterns from any initial phase relationship (in 10 out of 10 trials: 100%). These results also indicate that the proposed control scheme can achieve interlimb coordination according to the physical properties of the robot's body in a self-organizing manner, without any predefined gait patterns.
Figure 11. Upper graph: Gait diagram. Lower graph: Corresponding phase sin ϕi. The gait patterns converged to a trot or an L-S walk gait (in 10 out of 10 trials: 100%) observed in quadrupeds, in which case the (L1, R3) and (R1, L3) feet alternately touch the ground in anti-phase (Movie S3).
Figure 12. Average duty factor of front, middle, and hind legs in the leg amputation experiment in 10 trials. The duty factor of the hind legs mainly increased in the case of two-leg amputation experiments.
3.5. Effect of Local Sensory Feedback Concerning Neighboring Legs
The usefulness of our proposed local sensory feedback was verified based on the Tegotae approach by conducting experiments with the following conditions: we set the parameters ω = 2.0, σ1 = 0.2, σ2 = 0, which is a model similar to our previous model for quadrupeds (Owaki et al., 2012; Owaki and Ishiguro, 2017) or Barikhan's model for hexapod models (Barikhan et al., 2014). We conducted 10 trials in this experiment using randomly selected initial phases. Figure 13 shows the experimental results obtained using these parameters. The gait patterns mostly did not converge to insect-like gaits, e.g., tetrapod/tripod gaits, but converged to other patterns under many initial conditions (in 7 out of 10 trials: 70%) in this model. In these gaits, the left legs touched the ground in the order L3, L2, and L1 (hind to fore), whereas the right legs touched in the order R1, R2, and R3 (fore to hind). This result indicates that the model with only the second term in Equation (9) (similar to Barikhan's model) sometimes reproduced a gait pattern similar to that of insects, but its robustness against the initial conditions was insufficient.
Figure 13. Experimental results: ω = 2.0, σ1 = 0.2, σ2 = 0. The gait patters mostly did not converge to insect-like gaits, e.g., tetrapod/tripod gaits, but converge to other patterns under many initial conditions (in 7 out of 10 trials: 70%). In these gaits, the left legs touched the ground in the order L3, L2, and L1 (hind to fore), whereas the right legs touched in the order R1, R2, and R3 (fore to hind).
4. Discussion
The purpose of this study was to provide a minimal model for the interlimb coordination in hexapedal locomotion based on a novel concept named Tegotae. Using the Tegotae-based approach has enabled us to show how we can design the local sensory feedback for a decentralized interlimb coordination mechanism in a systematic manner. Moreover, we have demonstrated that our hexapod robot, which was developed for the validation of the proposed control scheme, satisfactorily reproduced various aspects of insect locomotion, i.e., steady walking, gait transition according to locomotion speed, and adaptability to changes in weight distribution and to leg amputation. As shown in Figure 8B, the role arrangement of the fore, middle, and hind legs can be achieved via the interlimb coordination mechanism: (i) the fore legs mainly generate breaking forces ( was mainly negative), (ii) middle legs mainly support the body ( was larger than those for the other legs), and (iii) hind legs mainly generate propulsion forces ( was mainly positive). Such adaptive behaviors are commonly observed for various species of insects, as shown in Table 2. This suggests that our Tegotae-based interlimb coordination model captures the essential mechanism for hexapedal interlimb coordination. As a control experiment, if we set the parameters σ1 = σ2 = 0, i.e., a condition without local sensory feedback, we can easily imagine that interlimb coordination did not occur, but the phase relationship between leg movement maintains the initial condition. Thus, in order to determine the usefulness of the proposed local sensory feedback, we verified the effect of the second and third terms of Equation (9) in Section 3.
In the previous study on quadruped locomotion (Owaki et al., 2012; Owaki and Ishiguro, 2017), we have proposed a simple interlimb coordination rule that well reproduced various quadruped gait patterns and well explained the underlying mechanism. The second term in Equation (9) corresponds to the quadruped interlimb coordination rule. Inspired by our model, Barikhan et al. (2014) also implemented an almost identical mechanism for a hexapedal interlimb coordination model and verified its usefulness by reproducing some insect-like locomotion in simulations. However, although our experiments about the effect of the third term in Equation (9) in Section 3.5 indicate that the model with only the second term in Equation (9) sometimes reproduces a gait pattern similar to that of insects, but its robustness against the initial conditions was insufficient. This is because the local load information on quadrupeds is totally reflected by physical information throughout the whole body (Owaki et al., 2012; Owaki and Ishiguro, 2017), whereas that on hexapods does not sufficiently include physical information for interlimb coordination. Thus, we concluded that the third term in Equation (9), which used sensory information about load distribution in neighboring legs, is essential for the reproduction of insect-like gait patterns and gait transitions. Moreover, we have already reported the local sensory feedback mechanism in Equation (9), but we did not previously confirmed the gait transition from tetrapod to tripod and the adaptability to change in the weight distribution and leg amputation (Goda et al., 2016). Here, we newly introduce anterior-posterior asymmetry in the parameter ka and kp, which mainly resulted in the stable gait transition according to locomotion speed, i.e., from tetrapod to tripod as well as the adaptability to change according to the weight distribution and as a results of leg amputation. Our main contribution is the versatility of reproduced behaviors concerning insects' locomotion: Barikhan's model (Barikhan et al., 2014) differs from ours in that it did not reproduce the gait transition from tetrapod to tripod and did not exhibit adaptability against changes in the weight distribution and robustness against initial conditions. Furthermore, our approach is unique; we have discussed the common underlying mechanism of interlimb coordination in the locomotion of both vertebrates and arthropods by using legged robots.
The proposed interlimb coordination model shows adaptability to changes in the weight distribution of the robot's body, where the gait pattern did not change to a tripod gait but maintained a tetrapod gait after changing ω and the average duty factor of the loaded hind legs automatically became larger than those of the unloaded fore legs. These results were reproduced in a self-organizing manner by using Tegotae-based control, without any need to provide prior data about these changes. We additionally obtained biological evidence for the adaptability to changes in the weight distribution by conducting experiments using two crickets (Gryllus bimaculatus). These experiments are described in the Supplementary Material in detail. Our results using the robot clearly show good agreement with our biological evidence of the influence of the load on the leg coordination in crickets: with a load, (1) they exhibit a tetrapod gait and (2) increase the duty factor of the middle and hind legs. Furthermore, another experiment using fruit flies confirmed the same effect of a vertical load (Mendes et al., 2014), which suggests that such adaptability is observed for various species of insects. This fact strongly supports that the essentiality of using vertical GRFs for sensory information S(N) when designing a Tegotae function for hexapedal interlimb coordination.
Furthermore, our model exhibited adaptability to the physical conditions resulting from a two-leg amputation. If we use a predefined neural connection for a tripod gait—where the (L1, R2, L3) and (R1, L2, R3) legs are in-phase—, we cannot reproduce a trot or an L-S walk pattern—where the (L1, R3) and (R1, L3) feet alternately touch the ground in nearly anti-phase—when the two legs are amputated (Figure 11). Owing to the Tegotae-based interlimb coordination mechanism using both local (Ni) and neighboring (Nj) load information (Equation 9), gait patterns were self-organized in response to load distribution stemming from the remaining number of legs, which is one of the advantages of our approach. Some biological studies have suggested that insects generally exhibit the L-S walk when their two middle legs are amputated. Hughes (1957) have shown that two-middle-leg amputee cockroaches exhibited a gait—the touch-down order was (L3, L1, R3, R1), i.e., the L-S walk in quadrupeds. Graham (1977) and Grabowska et al. (2012) have shown that two-middle-leg amputee stick insects exhibited the same gait as cockroaches (Hughes, 1957) because the contralateral touch down timing became same such that gaits could be symmetric about the body axis to ensure its stability. Here, we did not actually conduct various leg-amputation tests; we can expect adaptability to some extent against some conditions, e.g., amputating a front/hind leg, owing to the potential of our model, as we have shown. However, because our model did not include any directional or posture controls and learning algorithms as in Ren et al. (2015) and Cully et al. (2015) (here, we mainly focus on real-time adaptability), its direction of motion would vary according to the physical properties: a front-left-leg amputated robot will turn left when moving forward. According to the patterns of leg amputation, insects exhibit modulation of their spatial footfall patterns, i.e., they change the landing location of a stance leg to maintain their posture stability (Hughes, 1957; Graham, 1977; Cruse, 1983; Grabowska et al., 2012); thus, we intend to apply an additional Tegotae-based controller for the modulation of spatial footfall patterns, resulting in the adaptation to a large number of leg amputations.
In insect locomotion, it is well known that two types of sensory signals play an essential role in leg coordination: (1) sensory signals about the position and velocity of joints during movement (Büschges, 2005; Pearson et al., 2006) and (2) force signals from the leg segments (Pearson, 1972; Bässler, 1977; Cruse, 1985a,b; Duysens et al., 2000; Zill et al., 2004). Such sensory signals modulate not only the timing (phase) but also the magnitude of neural output stems from the nervous system, e.g., CPGs (Grillner, 2003; Büschges, 2005). In our Tegotae-based approach, as a first step for the investigation, we use only vertical GRFs detected by force sensors installed in the legs to modulate the phase of oscillators. The obtained control principle, where both local and neighboring leg load information is essential for the interlimb coordination, agrees with biological evidence (Pearson, 1972; Bässler, 1977; Cruse, 1985a,b; Duysens et al., 2000; Zill et al., 2004). To reproduce increased adaptability to different surfaces and typed of movement, e.g., uneven terrain, uphill/downhill, similar to insects, other types of sensory signals, e.g., horizontal GRFs, would requires us to design additional Tegotae functions. Furthermore, modulation of the magnitude of motor output from neural systems will also lead to a change in landing location of a stance leg for negotiating various leg amputation patterns as discussed in the above paragraph. These topics seem to be of general interest and will also be studied in further investigations.
In the past two decades, various hexapod robots were developed with the aim of reproducing the adaptive functions of insects and to understand their control mechanisms (Kimura et al., 1993; Beer et al., 1997; Altendorfer et al., 2001; Ritzmann et al., 2004; Steingrube et al., 2010; Ambe et al., 2013; Manoonpong et al., 2013; Dasgupta et al., 2015; Ramdya et al., 2017). Ours was the first study of its kind to demonstrate various aspects of insect locomotion with a minimal control principle without any interlimb neural communication between oscillators. To the best of our knowledge, no studies have been reported in which adaptability was reproduced in a completely self-organized manner by only using local and neighboring load information. In the CPG approach as a control paradigm in this study, local sensory feedback fi is described simply as a partial differential of the Tegotae function Ti with respect to the control variable ϕi. This aspect of our model also suggests a new design scheme of local sensory feedback in the chain-of-reflex approach based on the discontinuous basic process, which should also be discussed as a next step. Our minimal model, which is systematically derived from the concept of Tegotae, is expected to provide substantial insight into the essence of the hexapedal interlimb coordination mechanism to roboticists as well as biologists.
Author Contributions
AI and DO conceived the research and managed the data collection. MG and SM designed the robot and conducted the experiments. MG, SM, and DO conducted the analyses. All authors wrote the manuscript together.
Funding
We acknowledge the support provided by the Japan Science and Technology Agency (CREST).
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
We are grateful to R. Kobayashi (Hiroshima University), H. Aonuma (Hokkaido University), and T. Kano (Tohoku University) for their helpful comments.
Supplementary Material
The Supplementary Material for this article can be found online at: http://journal.frontiersin.org/article/10.3389/fnbot.2017.00029/full#supplementary-material
References
Altendorfer, R., Moore, N., Komsuoglu, H., Buehler, M., Brown, H. B. Jr., McMordie, D., et al. (2001). Rhex: a biologically inspired hexapod runner. Auton. Robots 11, 207–213. doi: 10.1023/A:1012426720699
Ambe, Y., Nachstedt, T., Manoonpong, P., Worgotter, F., Aoi, S., and Matsuno, F. (2013). “Stability analysis of a hexapod robot driven by distributed nonlinear oscillators with a phase modulation mechanism,” in IEEE/RSJ International Conference on Intelligent Robots and Systems (Tokyo), 5087–5092.
Barikhan, S. S., Wörgötte, F. F., and Manoonpong, P. (2014). “Multiple decoupled cpgs with local sensory feedback for adaptive locomotion behaviors of bio-inspired walking robots,” in SAB2014 (Castellon), 65–75.
Bässler, U. (1977). Sense organs in the femur of the stick insect and their relevance to the control of position of the femur-tiibia-joint. J. Comp. Physiol. 121, 99–113. doi: 10.1007/BF00614183
Bässler, U. (1986). On the definition of central pattern generator and its sensory control. Biol. Cybern. 54, 65–69. doi: 10.1007/BF00337116
Bässler, U. (1993). The walking- (and searching-) pattern generator of stick insects, a modular system composed of reflex chains and endogenous oscillators. Biol. Cybern. 69, 305–317. doi: 10.1007/BF00203127
Bässler, U., and Büschges, A. (1998). Pattern generation for stick insect walking movements -multisensory control of a locomotor program. Brain Res. Rev. 27, 65–88. doi: 10.1016/S0165-0173(98)00006-X
Bässler, U., and Wegner, U. (1983). Motor output of the denervated thoracic ventral nerve cord in the stick insect carausius morsus. J. Exp. Biol. 105, 127–145.
Beer, R. D., Quinn, R. D., Chiel, H. J., and Ritzmann, R. E. (1997). Biologically inspired approaches to robotics: what can we learn from insects? Commun. ACM 40, 30–38. doi: 10.1145/245108.245118
Borgmann, A., Hooper, S. L., and Buschges, A. (2009). Sensory feedback induced by front-leg stepping entrains the activity of central pattern generators in caudal segments of the stick insect walking system. J. Neurosci. 29, 2972–2983. doi: 10.1523/JNEUROSCI.3155-08.2009
Brekowitz, A., and Laurent, G. (1996). Central generation of grooming motor patterns and interlimb coordination in locusts. J. Neurosci. 16, 8079–8091.
Büschges, A. (2005). Sensory control and organization of neural networks mediating coordination of multisegmental organs for locomotion. J. Neurophysiol. 93, 1127–1135. doi: 10.1152/jn.00615.2004
Büschges, A., Ludwar, B., Bucher, D., Schmidt, J., and DiCaprio, R. A. (2004). Synaptic drive contributing to rhythmic activation of motoneurons in the deafferented stick insect walking system. Eur. J. Neurosci. 19, 1856–1862. doi: 10.1111/j.1460-9568.2004.03312.x
Büschges, A., Schmitz, J., and Bässler, U. (1995). Rhythmic pattern in the thoracic nerve cord of the stick insect induced by pilocarpine. J. Exp. Biol. 198, 435–456.
Cruse, H. (1976). The function of the legs in the free walking stick insect, carausis morosus. J. Comp. Physiol. 112, 235–262. doi: 10.1007/BF00606541
Cruse, H. (1983). The influence of load and leg amputation upon coordination in walking crustaceans: a model calculation. Biol. Cybern. 49, 119–125. doi: 10.1007/BF00320392
Cruse, H. (1985a). Coactivation influences between neighboring legs in walking insects. J. Exp. Biol. 114, 513–519.
Cruse, H. (1985b). Which parameters control the leg movement of a walking insect? II. the start of the swing phase. J. Exp. Biol. 116, 357–362.
Cruse, H. (1990). What mechanisms coordinate leg movement in walking arthropods? Trends Neurosci. 13, 15–21. doi: 10.1016/0166-2236(90)90057-H
Cruse, H., Kindermann, T., Schumm, M., Dean, J., and Schmitz, J. (1998). Walknet - a bioinspired network to control six-legged walking. Neural Netw. 11, 1435–1447. doi: 10.1016/S0893-6080(98)00067-7
Cully, A., Clune, J., Tarapore, D., and Mouret, J. (2015). Robots that can adapt like animals. Nature 521, 503–507. doi: 10.1038/nature14422
Dasgupta, S., Goldschmidt, D., Wörgötter, F., and Manoonpong, P. (2015). Distributed recurrent neural forward models with synaptic adaptation and cpg-based control for complex behaviors of walking robots. Front. Neurorobot. 9:10. doi: 10.3389/fnbot.2015.00010
Daun-Gruhn, S., and Büschges, A. (2011). From neuron to behavior: dynamic equation-based prediction of biological processes in motor control. Biol. Cybern. 105, 71–88. doi: 10.1007/s00422-011-0446-6
Dean, J. (1989). Leg coordination in the stick insect carausis morosus: effect of cutting thoracic connectives. J. Exp. Biol. 145, 103–131.
Dean, J. (1991). Effect of load on leg movement and step coordination of the stick insect carausius morosus. J. Exp. Biol. 159, 449–471.
Dürr, V., Schmitz, J., and Cruse, H. (2004). Behavior-based modeling of hexapod locomotion: linking biology and technical application. Arthropod Struct. Dev. 33, 237–250. doi: 10.1016/j.asd.2004.05.004
Duysens, J., Clarac, F., and Cruse, H. (2000). Load-regulating mechanisms in gait and posture: comparative aspects. Physiol. Rev. 80, 83–133.
Fitz-Hugh, R. (1969). Mathematical Models of Excitation and Propagation in Nerve. New York, NY: McGraw-Hill Book Co.
Foth, E., and Graham, D. (1983a). Influence of loading parallel to the body axis on the walking coordination of an insect I. Inspilateral effects. Biol. Cybern. 47, 17–23.
Foth, E., and Graham, D. (1983b). Influence of loading parallel to the body axis on the walking coordination of an insect II. Contralateral changes. Biol. Cybern. 48, 149–157. doi: 10.1007/BF00318082
Goda, M., Miyazawa, S., Itayama, S., Owaki, D., Kano, T., and Ishiguro, A. (2016). “Understanding interlimb coordination mechanism of hexapod locomotion via “tegotae”-based control,” in Living Machines 2016 (Edinburgh), 441–448.
Goldman, D. I., Chen, T. S., Dudek, D. M., and Full, R. J. (2006). Dynamics of rapid vertical climbing in cockroaches reveals a template. J. Exp. Biol. 209, 2990–3000. doi: 10.1242/jeb.02322
Grabowska, M., Godlewska, E., Schmidt, J., and Daun-Gruhn, S. (2012). Quadrupedal gaits in hexapod animals - inter-leg coordination in free-walking adult stick insects. J. Exp. Biol. 215, 4255–4266. doi: 10.1242/jeb.073643
Graham, D. (1972). A behavioural analysis of the temporal organization of walking movements in the 1st instar and adult stick insect (carausius morosus). J. Comp. Pysiol. 81, 23–52. doi: 10.1007/BF00693548
Graham, D. (1977). The effect of amputation and leg restraint on the free walking coordination of the stick insect carausisus morosus. J. Comp. Physiol. 116, 91–116. doi: 10.1007/BF00605519
Grillner, S. (2003). The motor infrastructure: from ion channels to neuronal networks. Nat. Rev. Neurosci. 4, 573–586. doi: 10.1038/nrn1137
Hellgren, J., Grillner, S., and Lansner, A. (1992). Computer simulation of the segmental neural network generating locomotion in lamprey by using populations of network interneurons. Biol. Cybern. 68, 1–13. doi: 10.1007/BF00203132
Hodgkin, A. L., and Huxley, A. F. (1952). A quantitative description of membrane current and its application to conduction and excitation in nerve. J. Physiol. 117, 500–544. doi: 10.1113/jphysiol.1952.sp004764
Hughes, G. M. (1957). The co-ordination of insect movements II. The effect of limb amputation and the cutting of commissures in the cockroach (blatta orientalis). J. Exp. Biol. 34, 306–333.
Ijspeert, A. J. (2008). Central pattern generators for locomotion control in animals and robots: a review. Neural Netw. 21, 642–653. doi: 10.1016/j.neunet.2008.03.014
Kimura, S., Yano, M., and Shimizu, H. (1993). A self-organizing model of walking patterns of insects. Biol. Cybern. 69, 183–193. doi: 10.1007/BF00198958
Kuramoto, Y. (1984). Chemical Oscillations, Waves, and Turbulence. Berlin; Heidelberg; New York, NY: Springer-Verlag.
Lafreniere-Roula, F. M., and McCrea, D. A. (2005). Deletions of rhythmic motoneuron activity during fictive locomotion and scratch provide clues to the organization of the mammalian central pattern generator. J. Neurophysiol. 94, 1120–1132. doi: 10.1152/jn.00216.2005
Manoonpong, P., Parlitz, U., and Wörgötter, F. (2013). Neural control and adaptive neural forward models for insect-like, energy-efficient, and adaptable locomotion of walking machines. Front. Neural Circuits 7:12. doi: 10.3389/fncir.2013.00012
Marder, E., and Bucher, D. (2011). Central pattern generators and the control of rhythmic movements. Curr. Biol. 11, 986–996. doi: 10.3389/fncir.2013.00012
Mendes, C. S., Bartos, I., Akay, T., Márka, S., and Mann, R. S. (2013). Quantification of gait parameters in freely walking wild type and sensory deprived Drosophila melanogaster. eLife. 2:e00231. doi: 10.7554/eLife.00231
Mendes, C. S., Rajendren, S. V., Bartos, I., Márka, S., and Mann, R. S. (2014). Kinematic responses to changes in walking orientation and gravitational load in Drosophila melanogaster. PLoS ONE 9:e109204. doi: 10.1371/journal.pone.0109204
Noah, J. A., Quimby, L., Frazier, S. F., and Zill, S. N. (2004). Walking on a ‘peg leg’: extensor muscle activities and sensory feedback after distal leg denervation in cockroaches. J. Comp. Physiol. 190, 217–231. doi: 10.1007/s00359-003-0488-x
Owaki, D., and Ishiguro, A. (2017). A quadruped robot exhibiting spontaneous gait transitions from walking to trotting to galloping. Sci. Rep. 7:277. doi: 10.1038/s41598-017-00348-9
Owaki, D., Kano, T., Nagasawa, T., Tero, A., and Ishiguro, A. (2012). Simple robot suggests physical interlimb communication is essential for quadruped walking. J. R. Soc. Interface. 10:20120669. doi: 10.1098/rsif.2012.0669
Pearson, K., Ekeberg, O., and Buschges, A. (2006). Assessing sensory function in locomotor systems using neuro-mechanical simulations. Trends Neurosci. 29, 625–631. doi: 10.1016/j.tins.2006.08.007
Pearson, K. G. (1972). Central programming and reflex control of walking in the cockroach. J. Exp. Biol. 56, 173–193.
Pearson, K. G., and Iles, I. F. (1969). Discharge patterns of coxal levator and depressor motoneurons of the cockroach, Perillaneta americana. J. Exp. Biol. 52, 139–165.
Pearson, K. G., and Iles, J. F. (1973). Nervous mechanisms underlying intersegmental co-ordination of leg movements during walking in the cockroach. J. Exp. Biol. 58, 725–744.
Ramdya, P., Thandiackal, R., Cherney, R., Asselborn, T., Benton, R., Ijspeert, A. J., et al. (2017). Climbing favours the tripod gait over alternative faster insect gaits. Nat Commun. 8:14494. doi: 10.1038/ncomms14494
Ren, G., Chen, W., Dasgupta, S., Kolodziejski, C. K., Wörgötter, F., and Manoonpong, P. (2015). Multiple chaotic central pattern generators with learning for legged locomotion and malfunction compensation. Inform. Sci. 294, 666–682. doi: 10.1016/j.ins.2014.05.001
Ritzmann, R. E., Quinn, R. D., and Fischer, M. S. (2004). Convergent evolution and locomotion through complex terrain by insects, vertebrates and robots. Arthropod. Struct. Dev. 33, 361–379. doi: 10.1016/j.asd.2004.05.001
Rybak, I. A., Shevtsova, N. A., Lafreniere-Roula, M., and McCrea, D. A. (2016). Modeling spinal circuitry involved in locomotor pattern generation: insights from deletions during fictive locomotion. J. Physiol. 557, 617–639. doi: 10.1113/jphysiol.2006.118703
Ryckebusch, S., and Laurent, G. (1993). Rhythmic patterns evoked in locust leg motor neurons by the muscarinic agonist pilocarpine. J. Neurophysiol. 69, 1583–1595.
Schilling, M., Hoinville, T., Schmitz, J., and Cruse, H. (2013). Walknet, a bio-inspired controller for hexapod walking. Biol. Cybern. 107, 397–419. doi: 10.1007/s00422-013-0563-5
Sponberg, S., and Full, R. J. (2008). Neuromechanical response of musculo-skeletal structures in cockroaches during rapid running on rough terrain. J. Exp. Biol. 211, 433–446. doi: 10.1242/jeb.012385
Steingrube, S., Timme, M., Wörgötter, F., and Manoonpong, P. (2010). Self-organized adaptation of a simple neural circuit enables complex robot behaviour. Nat. Phys. 6, 224–230. doi: 10.1038/nphys1508
Van der Pol, B. (1972). On relaxation oscillations. Lond. Edinb. Dublin Philos. Mag. J. Sci. 2, 978–992. doi: 10.1080/14786442608564127
Wosnitza, A., Bockemuhl, T., Dubbert, M., Scholz, H., and Buschges, A. (2013). Inter-leg coordination in the control of walking speed in drosophila. J. Exp. Biol. 216(Pt 3), 480–491. doi: 10.1242/jeb.078139
Zill, S., Schmitz, J., and Buschges, A. (2004). Load sensing and control of posture and locomotion. Arthropod. Struct. Dev. 33, 273–286. doi: 10.1016/j.asd.2004.05.005
Zollikofer, C. P. E. (1994a). Stepping pattern in ants I. Influence of speed and curvature. J. Exp. Biol. 192, 95–106.
Zollikofer, C. P. E. (1994b). Stepping pattern in ants II. Influence of body morphology. J. Exp. Biol. 192, 107–108.
Keywords: hexapedal locomotion, interlimb coordination, local sensory feedback, central pattern generator (CPG), Tegotae
Citation: Owaki D, Goda M, Miyazawa S and Ishiguro A (2017) A Minimal Model Describing Hexapedal Interlimb Coordination: The Tegotae-Based Approach. Front. Neurorobot. 11:29. doi: 10.3389/fnbot.2017.00029
Received: 11 November 2016; Accepted: 22 May 2017;
Published: 09 June 2017.
Edited by:
Poramate Manoonpong, University of Southern Denmark Odense, DenmarkReviewed by:
Jean-Baptiste Mouret, Institut National de Recherche en Informatique et en Automatique, FranceSakyasingha Dasgupta, IBM Research–Tokyo, Japan
Copyright © 2017 Owaki, Goda, Miyazawa and Ishiguro. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Dai Owaki, b3dha2lAcmllYy50b2hva3UuYWMuanA=