An Opposite-Bending-and-Extension Soft Robotic Manipulator for Delicate Grasping in Shallow Water

Collecting seafood animals (such as sea cucumbers, sea echini, scallops, etc.) cultivated in shallow water (water depth: ~30 m) is a profitable and an emerging field that requires robotics for replacing human divers. Soft robotics have several promising features (e.g., safe contact with the objects, lightweight, etc.) for performing such a task. In this paper, we implement a soft manipulator with an opposite-bending-and-extension structure. A simple and rapid inverse kinematics method is proposed to control the spatial location and trajectory of the underwater soft manipulator's end effector. We introduce the actuation hardware of the prototype, and then characterize the trajectory and workspace. We find that the prototype can well track fundamental trajectories such as a line and an arc. Finally, we construct a small underwater robot and demonstrate that the underwater soft manipulator successfully collects multiple irregular shaped seafood animals of different sizes and stiffness at the bottom of the natural oceanic environment (water depth: ~10 m).

Introduction

Collecting seafood animals cultivated in the shallow water is a promising industry, which requires growing autonomic and robotic technologies. Traditionally, human divers are assigned to manually collect the seafood animals such as sea cucumbers, sea echini, scallops, etc. (Figure 1a). However, long-time working under the water depth of 10–30 m would cause the divers suffering from severe occupational disease including rheumatism, gout, osteonecrosis, etc. Collecting seafood animals in the harsh, shallow water environment requires small underwater robot and flexible manipulation system. Previously, the rigid robotic arms used for underwater manipulation have several challenging issues such as delicate grasping fragile and squishy seafood animals. Meanwhile, the traditional rigid hydraulic arms usually have large mass. The huge inertia caused by the rigid arm during locomotion would induce significant vibration for the small underwater vehicle (Fernandez et al., 2013).

FIGURE 1

Figure 1. (a) Seafood collection by a human diver. (b) The snapshot of the underwater robot with a soft manipulator for grasping fragile sea animals. Multiple cameras are applied to provide underwater vision. The length of scale bar is 100 mm.

Soft robots provide an alternative way to collect these fragile sea animals, due to the properties of compliance and safe interaction. Recently, increasing studies on soft robotics have focused on the underwater applications. For example, robotic octopus arms achieved underwater locomotion (Calisti et al., 2011; Cianchetti et al., 2015); soft gripper has been used for biological sampling the coral reefs (Galloway et al., 2016); the origami gripper was applied to collecting delicate midwater organisms (Teoh et al., 2018); the jamming gripping was exploited in handling in deep sea (Licht et al., 2017); a soft glove was integrated to tele-operated control the soft wrist modules for biological underwater grasping (Kurumaya et al., 2018; Phillips et al., 2018).

Previously, the piecewise constant curvature (PCC) model has been developed (Webster Iii and Jones, 2010) and is used for modeling the flexible continuum robots (Webster et al., 2007) and soft elastomeric arms (Gong et al., 2017, 2018a,b), etc. The inverse kinematics modeling is another challenge issue. To address this challenge, previous studies have regarded the continuum joint as 3UPS-1PU-extensible structure for simplification and further developed the DH method for inverse kinematic modeling of flexible manipulator (Lakhal et al., 2014); Jacobian iteration was applied to determine the inverse kinematics for the underwater soft manipulator in the two-dimensional space (Marchese and Rus, 2016); machine learning algorithms were proposed to train a single soft actuator (Giorelli et al., 2015; Lee et al., 2017) and a two-dimensional soft manipulator (Jiang et al., 2017). Natural-CCD algorithm was proposed to generate simple, precise, and computationally efficient inverse kinematics (Martín et al., 2018). However, previous studies have not yet experimentally explored the spatial manipulation with inverse kinematics, particularly for the collecting tasks in natural underwater environment.

To complement a controllable underwater soft robotic manipulator for seafood grasping in shallow water, in this paper, we propose a novel inverse kinematic method. Based on an opposite-bending-and-extension structure of the robotic arm, our method enables point-point movements in three-dimensional space and trajectory planning. We mount the underwater soft manipulator on a small underwater vehicle and then demonstrate underwater picking and placing seafood animals. Our current study shows wide-open applications of soft robotic manipulator in the shallow water undersea environment.

Materials and Methods

System Overview

Soft robots have intrinsic compliance, which have significant advantages for grasping these seafood animals (for instance, sea cucumber has a modules of ~10⁶Pa). In order to implement the underwater grasping in shallow water, we construct a small underwater robot with a soft manipulator (modules around ~10⁵Pa), as shown in Figure 1b. The underwater soft manipulator can achieve 3-DOF movement and grasping. A 4-DOF underwater remotely operated vehicle (ROV) is integrated with two cameras, one of which is for grasping from near top view, while another is for guiding movement from large side view. Through live cameras, both the underwater soft manipulator and ROV are remotely controlled by the human operator on a boat. The underwater soft manipulator is 360 mm in length (300 mm for only the soft arm) and 34 mm in diameter, with a total mass of 322 g. The robot measures 600 mm long, 500 mm width, and 300 mm tall, with a weight of 10 kg, and operated depth of 50 m.

The Underwater Soft Manipulator

We design and fabricate an entirely soft, underwater manipulator with soft gripper as the end effector (Figure 2a) (Martinez et al., 2013; Polygerinos et al., 2015; Hao et al., 2018). The underwater soft manipulator consists four sections: two bending segments, one elongation segment, and one soft gripper (Figure 2b). This bending segments and elongation segment are designed to have a circle shaped cross-section to decrease the hydrodynamic resistance in the water flow (Gong et al., 2018b). Each bending segment has three individual chambers. Meanwhile, it is covered with rubber tendons to reduce radial ballooning of the chambers when pressurizing (Figure 2c). We apply the fiber-reinforced actuator on the elongation segments to provide extension in the vertical direction while grasping underwater (Figure 2e).

FIGURE 2

Figure 2. The design and principle mechanics of the underwater soft manipulator. (a) An overall side image of the underwater soft manipulator (scale bar 50 mm). (b) The underwater soft manipulator is applied modularized design that consisted of two bending segments, an elongating segment, and a soft gripper. θ₁ and θ₂ represent the bending angles of the two bending segments, and α represents the horizontal angle of the manipulator tip. The manipulator is actuated with an opposing curvature where θ₁ = θ₂ and α = 0. (c) The two bending segments had a joining angle of 180°. (d) θ₁, θ₂, and α are verified in one actuation with opposing curvature. The two bending angles (θ₁, θ₂) are almost equal, and the horizontal angle (α) is zero at each moment. (e) The fiber-reinforced elongating segment. The yellow arrow indicates the direction of elongation.

Note that we actuate the underwater soft manipulator in a special manner to simplify the kinematic modeling (will introduce later): the two bending segments are actuated with the same bending curvature but opposite bending direction. We regard that the kinematics is established on this opposite-bending-extension actuation condition. We integrate two bending segments at an included angle of 180° (Figure 2c). When we actuate the opposite chambers of the two bending segments, the underwater soft manipulator always perform the opposite-bending-extension condition even in the spatial space. Besides, the air pressures in the opposing chambers have linear relationship, which means only one pressure is required for the kinematics model. Under this linear relationship, the curve angles of two bending segments (θ₁, θ₂) are almost the same and the intersection angle at the horizontal level of the underwater soft manipulator tip (α) is zero, which is the soft gripper is always facing vertically down to the ground. Figure 2d shows θ₁, θ₂, and α in one trial when actuating the underwater soft manipulator. We find that the values of θ₁, θ₂, and α confirm the design to realize opposing curvature.

Kinematics Modeling

Figure 3a demonstrates the kinematics of the underwater soft manipulator. With opposite-bending-extension condition, the two bending segments shared the degrees of freedom (DOF) only have 2 DOF (x-y plane), while one bending segment has the DOF of the rotation φ and bending θ₁ (or θ₂). Due to the elongation segment (z-axis), we can achieve three DOF movements and grasping.

FIGURE 3

Figure 3. Kinematics of the underwater soft manipulator. (a) The two bending segments of the underwater soft manipulator are always actuated with opposing curvatures. Thus, the bending angles are always equal (θ₁ = θ₂). (b) The kinematic transformation map. We focused on inverse kinematics (f _inv) from the position parameters (x_i, y_i, z_i) to chamber lengths (l_i1, l_i2, l_i3, l_e) via arc parameters (κ_i, φ_i, θ_i). (c) Geometric schematic in a bending segment, where φ_i represents the rotation angle around the z-axis; θ_i represents the bending angle around the y-axis; r_i represents the radii of the bending curve; and L_i represents the centerline length of the bending segment. (d) Geometric schematic of the cross-section, where h represents the distance between the arm surface and the center of the cross-section.

Opposing curvature patterns offers plenty of advantages on kinematic modeling. First, the attitudes of two bending segments {κ_i, φ_i, θ_i} (κ_i refers to the bending curvature of the ith segment) have very straightforward relationships (Equations 4–6). And we only need to calculate the attitudes of one segments. Second, it reduces the number of inputs (seven independent chambers totally to four independent chambers). Thus, it reduces half of the computation contributed to the fast solution of kinematics.

The modeling procedure can be realized in two parts (Figure 3b): (1) the transformation between the coordinates of the end effector {x, y, z} and chambers length {l_i1, l_i2, l_i3, l_e} (l_ij, the indexes i and j mean segment i chamber j; l_e, the index e means the length of elongation segment; the same as below). The essential point of this part is how we can get an inverse solution from {x, y, z} (three parameters) to {l_i1, l_i2, l_i3, l_e} (four parameters) without other inputs. (2) The transformation between chambers length {l_i1, l_i2, l_i3, l_e} and the pressure {p_i1, p_i2, p_i3, p_e}, the directly actuation parameter. By reason of the nonlinear response of soft material and complexity of structures, it is complicated to figure out (2) in a theoretical way, so we finish this work via experiments (Figure 5), and we fit formulas for the model-based control recording these results. In order to simplify the kinematics model, we make the following assumptions:

a) The bending section have the constant curvature rate, and the elongation section is straight. The curves are tangent at the intersection points.

b) The chambers in the same segment are parallel, and the cross sections are equal in the same section.

Forward Kinematics

Previous studies have already shown how to solve the forward transformation questions (Webster Iii and Jones, 2010; Gong et al., 2017). Combining these methods with the structures and sizes of our soft arm (shown in Figure 3c), we can obtain coordinates of the segments tip {x, y, z} from the length of the chamber {l_i1, l_i2, l_i3, l_e} with the help of attitudes {κ_i, φ_i, θ_i}.

$\begin{array}{rcll}{\kappa }_1& =& \frac{1}{r_1}=\frac{2\sqrt{l_{11}^2+l_{12}^2+l_{13}^2-l_{11}{l}_{12}-l_{11}{l}_{13}-l_{12}{l}_{13}}}{(l_{11}+l_{12}+l_{13})d}& (1)\end{array}$

$\begin{array}{rcll}{\phi }_1& =& {tan}^{-1}\left(\frac{l_{12}+l_{13}-2l_{11}}{\sqrt{3}(l_{12}-l_{13})}\right)& (2)\end{array}$

$\begin{array}{rcll}{\theta }_1& =& \frac{2\sqrt{l_{11}^2+l_{12}^2+l_{13}^2-l_{11}{l}_{12}-l_{11}{l}_{13}-l_{12}{l}_{13}}}{3d}& (3)\end{array}$

In equations (1–3), d represents the radius of soft arm cross-section, and r₁ is the radius of the bending curve. Particularly, we use the surface length to represent the chamber length mainly considering it is more accessible for measurement. After we got the attitudes parameters from the bending segment 1, we can get attitudes of the bending segment 2:

$\begin{array}{rcll}{\kappa }_2& =& {\kappa }_1& (4)\end{array}$

$\begin{array}{rcll}{\phi }_2& =& {\phi }_1+\pi & (5)\end{array}$

$\begin{array}{rcll}{\theta }_2& =& {\theta }_1& (6)\end{array}$

Furthermore, we can also get the coordinate of soft arm tip {x, y, z} from the attitudes {κ_i, φ_i, θ_i} we got previously. Mathematically, we consider the underwater soft manipulator simply consisted of constant curvature curves (bending segments) and lines (elongation segments) based on the assumptions. The coordinate transformation in both curves and lines can be described by homogeneous matrixes shown in equation (7), where R is the rotation matrix, and p is the translation vector.

$\begin{array}{rc}\mathrm{\text{T}}={\left[\begin{array}{cc}R& p\\ 0& 1\end{array}\right]}_{4\times 4}& (7)\end{array}$

Figure 3c shows the modeling of a single segment. We define orientation angle φ_i represents the rotation angle around the z-axis, curvature angle θ_i represents the bending angle around the y-axis, where i indicates the ith segment. In the bending segments, we consider the bending procedure as: first the soft arm rotates around y-axis with angle θ_i; second, the soft arm rotates around z-axis with angle φ_i. Moreover, we need to post-multiply the homogeneous matrix with the rotation matrix R(-φ_i) and zero translation. The transformation matrix for the bending segment is demonstrated in equation (8) In elongation segments, we only need to consider the translation on z-axis with a length of l_e (Equation 9).

$\begin{array}{rc}{}_{i-1}^{i}T=\left[\begin{array}{cc}{R}_z\left({\phi }_i\right)& 0\\ 0& 1\end{array}\right]·\left[\begin{array}{cc}{R}_y\left({\theta }_i\right)& 0\\ 0& 1\end{array}\right]·\left[\begin{array}{cc}{R}_z\left(-{\phi }_i\right)& 0\\ 0& 1\end{array}\right]=\left[\begin{array}{cccc}co{s}^2{\phi }_i\cos {\theta }_i+si{n}^2{\phi }_i& \cos {\phi }_i\sin {\phi }_i\left(\cos {\theta }_i-1\right)& \cos {\phi }_i\sin {\theta }_i& r\cos {\phi }_i\left(1-\cos {\theta }_i\right)\\ \cos {\phi }_i\sin {\phi }_i\left(\cos {\theta }_i-1\right)& si{n}^2{\phi }_i\cos {\theta }_i+co{s}^2{\phi }_i& \sin {\phi }_i\sin {\theta }_i& r\sin {\phi }_i\left(1-\cos {\theta }_i\right)\\ -\cos {\phi }_i\sin {\theta }_i& -\sin {\phi }_i\sin {\theta }_i& \cos {\theta }_i& r\sin {\theta }_i\\ 0& 0& 0& 1\end{array}\right]& (8)\end{array}$

$\begin{array}{rc}{}_2^{3}T=\left[\begin{array}{cccc}1& 0& 0& 0\\ 0& 1& 0& 0\\ 0& 0& 1& l_e\\ 0& 0& 0& 1\end{array}\right]& (9)\end{array}$

Thus, we can get the forward transformation of the whole soft manipulator (Equation 10).

$\begin{array}{rc}{}_0^{3}T{=}_0^{1}T·{}_1^{2}T·{}_2^{3}T& (10)\end{array}$

Inverse Kinematics

With this inverse kinematics method, we can realize the coordinate based control and point to point movement of the underwater soft manipulator. That is the foundation of the picking and placing tasks, as well as the trajectory planning. Further, the quick solution of inverse kinematics also helps to improve the real-time control ability of soft manipulator. However, the inverse kinematics of soft robots (even continuum robots) is always a challenging problem (Webster Iii and Jones, 2010). The large group's nonlinear equations in the transformation matrix cause the huge complexity to the inverse solution.

We propose a rapid inverse solution on soft manipulators with the specific opposite-bending-extension condition. As we discuss above that the underwater soft manipulator has three DOF in coordinate space {x, y, z}. However, the underwater soft manipulator has four independent chambers {l_i1, l_i2, l_i3, l_e}. In order to get the chambers length {l_i1, l_i2, l_i3, l_e} (four outputs) from the coordinates {x, y, z} (three inputs), we propose a constraint condition: at most two chambers in a bending segment are actuated at the same time, so that at least one chamber in one bending segment is in initial length. Thus, the point of this method is to figure out which chamber is in initial length.

We also resolve the transformation from {x, y, z} to {l_i1, l_i2, l_i3, l_e} with the attitudes {κ_i, φ_i, θ_i}. First, we obtain the rotation angle φ₁ from the given inputs {x, y, z}.

$\begin{array}{rc}{\phi }_1=-{tan}^{-1}\left(\frac{y}{x}\right)& (11)\end{array}$

Then we evaluate φ₁ to figure out which two chambers need to be actuated. According to the geometry relationship in Figure 3d, we can give an equation where we represent the initial length with the attitudes parameters {κ_i, φ_i, θ_i}. The initial length of chambers can be pre-measured by camera calibration. Here, on the relationship κ_i = r_i⁻¹, we also regarded r_i as attitudes parameter κ_i.

$\begin{array}{l}{}_0^{3}T{=}_0^{1}T·{}_1^{2}T·{}_2^{3}T\\ \{\begin{array}{l}{l}_{i1\text{init}}={\theta }_1·\left(r_1-d\sin {\phi }_1\right),when\frac{\pi }{6}\le {\phi }_1<\frac{5\pi }{6}\hfill \\ l_{i2\text{init}}={\theta }_1·\left[r_1+d\cos \left({\phi }_1-\frac{\pi }{6}\right)\right],when\frac{5\pi }{6}\le {\phi }_1<\frac{3\pi }{2}\hfill \\ l_{i3\text{init}}={\theta }_1·\left[r_1-d\cos \left({\phi }_1+\frac{\pi }{6}\right)\right],when\frac{3\pi }{2}\le {\phi }_1<2\pi or0\le {\phi }_1<\frac{\pi }{6}\hfill \end{array}& (12)\end{array}$

Considering the geometry relationship shown in Figure 3D, we derive another equation from the given coordinate:

$\begin{array}{rc}\frac{x}{2}=r_1·cos{\phi }_1·(1-cos{\theta }_1)& (13)\end{array}$

In equations (12) and (13), we can found that only r₁ and θ₁ are the unknown quantities. Combining the two equations, we can solve the rest attitudes parameters. Then, we easily obtained the length of all chambers {l_i1, l_i2, l_i3, l_e}.

$\begin{array}{rc}\{\begin{array}{l}{l}_{i1}={\theta }_i\left(r_i-d\sin {\phi }_i\right)\hfill \\ l_{i2}={\theta }_i\left[r_i+d\cos \left({\phi }_i-\frac{\pi }{6}\right)\right]\hfill \\ l_{i2}={\theta }_i\left[r_i-d\cos \left({\phi }_i+\frac{\pi }{6}\right)\right]\hfill \\ l_e=-2r_1\sin {\theta }_1-z\hfill \end{array}& (14)\end{array}$

According to above equations, we obtain specific inverse transformation from {x, y, z} to {l_i1, l_i2, l_i3, l_e}. With the help of the pressure – length calibration (Figure 4), we can further transfer from {l_i1, l_i2, l_i3, l_e} to the actuating pressure {p_i1, p_i2, p_i3, p_e} for our model-based pneumatic control.

FIGURE 4

Figure 4. The multi-channel pneumatic actuation system for the underwater soft manipulator. The system contains a microcontroller, power source, DA converter, ten proportional valves, and ten air pressure sensors.

Actuation and Control

The current soft manipulator is actuated by pneumatic pressure. We implement a multi-channel pneumatic driving system, shown in Figure 5. The system has ten pneumatic channels while each channel can generate pressure independently with maximum of 500 kPa to actuate the chambers in the underwater soft manipulator. The system contains a microcontroller (STM32F103, STMicroelectronics, Italy and France), DA convertors (PCF8591, NXP, Netherland), proportional valves (ITV0030-2BL, SMC, Japan), pressure sensors (ISE30A, SMC, Japan), an air compressor, and related software. We apply PID method in the closed-loop control of pressure, which is continuously adjusted according to the data from pressure sensors.

FIGURE 5

Figure 5. Chamber lengths of the bending segments (red) and elongating segment (black) as a function of the actuation pressure.

To control the underwater soft manipulator, we program the inverse-kinematics-model-based control algorithm in MATLAB. Calculating pressures from the reference coordinates, the software can conduct the underwater soft manipulator to pick and place object at specific positions. The calculated pressures can be sent to actuation system via RS232 communication protocol. By dividing the trajectory path into small segments (0.5 mm) and inserting desired points, we can control the underwater soft manipulator to follow a specific trajectory. In the field application, we also balance the pressures in chambers of the underwater soft manipulator according to the water depth. The balance transformation is shown in the equation (15), where p_d is the pressure applied, p₀ is the pressure calculated, ρ_environment is the underwater environment density (1025 kg/m³ is considered as the sea water density), h_d is the depth where the robot works. It should be noted that the underwater soft manipulator is mainly designed for grasping fragile sea animals, which most of them are suspending in the water and have no load on the underwater soft manipulator. Currently, we have not considered the influence of the gravity and loads on control of the underwater soft manipulator.

$\begin{array}{rc}{p}_d=p_0+{\rho }_{environment}g{h}_d& (15)\end{array}$

Laboratory Experiments Setup for Characterizing the Underwater Soft Manipulator

In order to evaluate the capability of the kinematic model, we perform experiments on the model based location error and trajectory planning. We apply a stereo cameras system to capture the motions and trajectories. The underwater soft manipulator is mounted in water and actuated by the multi-channel pneumatic system. The stereo cameras is carefully calibrated, and the error is less than 0.5 mm. Moreover, we rebuild the motions and got the coordinates of marker points from the images of different views. We perform the location error in different directions (φ_i) with the distance (d) ranging from 0mm to 100 mm, 10 mm of step length. We also perform the trajectory planning ability with paths of line and circle. Then, we run the workspace simulation in MATLAB.

Results

Kinematic Model Validation, Trajectory Planning, and Workspace Simulation

The underwater soft manipulator is actuated to move different distances (d), and the average control errors (between the experiments and simulations) of both the distances and rotational angles of the manipulator's base (φ_i) are demonstrated in Figure 6. We found that the errors are within the range of 2.7~13.4 mm when the distances changing from 0mm to 100 mm. This error range is tolerant to the soft gripper while grasping [the tolerant deviation of gripper and objects that led to successful grasp (Hao et al., 2018)]. According to the kinematic model, simulation on the workspace of the soft arm is illustrated as Figure 7. The results show that the underwater soft manipulator collected a plate-shaped workspace with a size of approximately 400 mm in diameter and 100 mm height.

FIGURE 6

Figure 6. Control location error as a function of operating radius d (0 to 100 mm).

FIGURE 7

Figure 7. (a) The simulation of operating workspace of the underwater soft manipulator. (b) The front view of the workspace. (c) The top view of the workspace.

Furthermore, we demonstrate the trajectory planning ability of the underwater soft manipulator with paths of line shaped and arc shaped trajectories (Figure 8). While performing the line trajectory (Figure 8A), the underwater soft manipulator is actuated from the point A (−110, −64, −270) (unit: mm) to the point B (110, 64, −295) at a programmed speed of 32 mm/s. The red circles are tracked points from the experiments; the blue lines are the computer-programmed path. The black lines represent the underwater soft manipulator, and the black dots on the black lines represent the intersections of different segments. The results show that experiment trajectory has a small error from the desired path in 3D space. The tracked points match the programmed path well and the error is less than 6.6 mm (Figure 8B). In the arc shaped trajectory, the underwater soft manipulator is actuated from the point A (−55, −35, −285) to the point B (55, 35, −320) with a rotation angle of 120°, radius of 65 mm and programmed speed of 45 mm/s, as shown in Figure 8C. We observe a vibration when suddenly changed moving direction of the underwater soft manipulator (Figure 8D). Lines and arcs are the fundamental shapes of trajectory; therefore, we hope more complex trajectory tracking can be achieved in the future based on the current work.

FIGURE 8

Figure 8. Controlled soft manipulator following trajectories of a line (A) and an arc (C). Distance response with time while tracking (B) the line trajectory and (D) the arc trajectory.

Field Test of Underwater Grasping

To examine the capabilities of the underwater soft manipulator, we construct an underwater robot with the underwater soft manipulator (Figure 1b), and perform the underwater grasping of fragile marine seafood animals (e.g., sea cucumbers, echini, etc.) in the natural undersea environment. A 4-DOF underwater vehicle is integrated with two cameras, which provide images from near top view for the grasping and large side view for the movement guiding. The movements of the underwater vehicle is under PID control that enable stable swimming and hovering. The underwater robot is powered from a ship floating above the grasping area. Both the underwater soft manipulator and underwater vehicle are under remote control via the real-time underwater cameras (transmitting images via cables). Figure 9 shows the system architecture applied for the undersea grasping, which is realized in three main steps: (1) The underwater robot is operated to approach the targets area and performs hovering and searching the seafood animal targets. (2) The underwater robot sinks to the bottom of the ocean. Then the underwater soft manipulator is controlled via inverse kinematics model to approach the undersea animals with the soft gripper open. (3) The underwater soft manipulator picks the target and places it into the collecting basket. While working underwater, the environment pressure is variable in different operating depth. Thus, the actuating pressures in chambers of the underwater soft manipulator are balanced according to the depth change (see Equation 15).

FIGURE 9

Figure 9. System architecture of the underwater grasping robot. The system contains human-machine Interface, driving system and the underwater robot system. The underwater robot is operated to approach the target seafood animals by the human operator. Then the underwater soft manipulator is controlled pick and place the sea animals via inverse kinematics model. The whole process is monitored by cameras which facilitates the remote control of human operator.

Figure 10 shows the field grasping in the natural undersea environment (Figure 10a), where the depth is 10 m and the speed of current in the ocean bottom is about 2 m/s. The seabed is covered by sand and stones, and the animals spread around and even partially embedded in sand and rocks. Finally, we successfully grasp echini, sea cucumbers, and shells at the depth 10 m undersea within 20 min (Figures 10b,c).

FIGURE 10

Figure 10. Undersea grasping with the underwater soft manipulator mounted on a small underwater robot. (a) The underwater grasping is demonstrated in the natural undersea environment at 10 m depth. (b,c) Grasping undersea animals (echini and sea cucumbers) with soft manipulator.

Conclusion and Discussion

In this paper, we construct a soft manipulator and ROV system for seafood grasping in shallow water. The underwater soft manipulator is designed and actuated as opposite-bending-extension condition and can achieve 3-DOF movements in space. It is controllable with a simple but rapid inverse kinematics. The results show that the error is less than 13.4 mm, and we achieve the trajectory planning by tracing the paths of a line and an arc. The experimental tracking points fit the desired position well in both positions and timescale. Finally, we perform the field test—we tested the manipulation capacity of soft arm in the natural undersea environment. The soft arm manipulator successfully grasp sea animals at a sea depth of 10 m via an underwater robot. Hopefully, this robot can be used for dexterous grasping in shallow water environment (0–50 m), and can replace the human divers for safely harvesting the seafood efficiently, without any damage.

We propose a simple and universal inverse solution for the underwater soft manipulators whose structure and actuation are followed the opposite-bending-extension condition. Distinct from the previous D-H method (Lakhal et al., 2014), machine learning model (Giorelli et al., 2015; Lee et al., 2017), and Jacobian iteration (Marchese and Rus, 2016), this inverse kinematics can be applied for the whole manipulator and does not require heavy computational resources, which enables real-time control in application. This method has also been tested and validated at the natural oceanic environment. The results have proved that reducing the DOFs of the soft manipulator is a possible approach to solve the inverse kinematics problem. The underwater soft manipulator with inverse kinematics can operate in the natural unstructured undersea environment without precise kinematic and force sensory feedback as the rigid manipulators do. Furthermore, the rigid robotic arms and grippers for the underwater manipulations have a huge mass and inertia which impacts their maneuverability. In contrast, soft robots have advantages of compliance and lightweight and may play an important role in underwater manipulation. Compared with the rigid hydraulic manipulators, our soft manipulator has exceptional features of lightweight and low inertia. The underwater soft manipulator has a mass of 0.322 kg (almost zero mass in water), while with a length of 360 mm. The current prototype is significantly lighter than the traditional rigid hydraulic manipulators that commonly has a mass of tens of kilograms, e.g., a hydraulic manipulator with a length of 499 mm has a total mass of 17.2 kg (Fernandez et al., 2013). Thus, locomotion of the underwater soft manipulator has negligible inertial effect for the underwater vehicle than the traditional rigid underwater manipulator.

Previous studies have shown the promising features of soft robots for the deep sea application (Calisti et al., 2011; Cianchetti et al., 2015; Galloway et al., 2016; Licht et al., 2017; Kurumaya et al., 2018; Phillips et al., 2018; Teoh et al., 2018). In this paper, we demonstrate a soft manipulator system with dexterous motions, which aims for the shallow water seafood animal grasping (sea cucumbers, echini, etc.). In the 10 m depth natural, undersea environment, our soft manipulator showed controllable motions under the inverse kinematic model. It can be remotely controlled to pick and place at the specific location coordinated with the underwater cameras, and we achieve more than 80% of succession rate of grasping multiple irregular shaped objects of different sizes and stiffness. Our results show that the underwater soft manipulator has inherent advantages of compliance and is promising for the future underwater manipulation. In addition, the multi-channel pneumatic actuation system and pressure balancing method (equation 15) plays significant roles in the real-world underwater grasping. Thanks to the pressure balancing method, the pressure differential inside and outside of the chambers can be maintained as constant. As a result, the underwater soft manipulator is able to achieve almost identically motions in different operating depth and collect seafood animals in the natural unstructured environment.

In this study, the inverse kinematics method reduce the DOFs to only three. Taking into account the control of the spatial angles of the manipulator tip, which has not been included in this study yet, will further complement the current soft manipulator prototype. Furthermore, pneumatic actuation is applied during current field tests, which results in a slow response time (based on the fact that we used a bunch of long pneumatic tubes) that constrains the manipulator's speed. In future studies, we will employ multi-channel hydraulic actuators with a system that can be mounted on the robot to enhance the grasping efficiency, as well as exploit a fully untethered underwater robot. In order to extend the application of this soft manipulator into the deep sea collection, we will explore the impact of water depth, oceanic current to the locomotion precision and stability in the future study. We will also apply more advanced modeling and control methods (such as the machine learning) to compensate for the system errors, and increase the grasping accuracy and dynamic response under the unstructured environment.

Author Contributions

LW conceived the project. ZG accomplished the modeling, actuation, control, and kinematics experiments. ZG, BC, JL, XF, and ZL conducted the underwater robot system and demonstrated the underwater grasping experiments. LW and ZG prepared the manuscript, and all authors provided feedback during subsequent revisions.

Funding

This work is supported by the National Science Foundation projects, China, under contracts number 61633004, 61822303, and 61333016.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

This article is an extended version of our previous paper on IEEE Robosoft 2018 (Gong et al., 2018b). Permission of reusing the material is authorized by IEEE.

References

Calisti, M., Giorelli, M., Levy, G., Mazzolai, B., Hochner, B., and Laschi, C., et al. (2011). An octopus-bioinspired solution to movement and manipulation for soft robots. Bioinspir. Biomim. 6:036002. doi: 10.1088/1748-3182/6/3/036002

PubMed Abstract | CrossRef Full Text | Google Scholar

Cianchetti, M., Calisti, M., Margheri, L., Kuba, M., and Laschi, C. (2015). Bioinspired locomotion and grasping in water: the soft eight-arm octopus robot. Bioinspir. Biomim. 10:035003. doi: 10.1088/1748-3190/10/3/035003

PubMed Abstract | CrossRef Full Text | Google Scholar

Fernandez, J. J., Prats, M., Sanz, P. J., and Garcia, J. C. (2013). Grasping for the seabed: developing a new underwater robot arm for shallow-water intervention. IEEE Robot. Automat. Magaz. 20, 121–130. doi: 10.1109/MRA.2013.2248307

CrossRef Full Text | Google Scholar

Galloway, K. C., Becker, K. P., Phillips, B., Kirby, J., Licht, S., Tchernov, D., et al. (2016). Soft robotic grippers for biological sampling on deep reefs. Soft Robot. 3, 23–33. doi: 10.1089/soro.2015.0019

PubMed Abstract | CrossRef Full Text | Google Scholar

Giorelli, M., Renda, F., Calisti, M., Arienti, A., Ferri, G., and Laschi, C. (2015). Neural network and jacobian method for solving the inverse statics of a cable-driven soft arm with nonconstant curvature. IEEE Trans. Robot. 31, 823–834. doi: 10.1109/TRO.2015.2428511

CrossRef Full Text | Google Scholar

Gong, Z., Cheng, J., Chen, X., Sun, W., Fang, X., Hu, K., et al. (2018a). A bio-inspired soft robotic arm: kinematic modeling and hydrodynamic experiments. J. Bion. Eng. 15, 204–219. doi: 10.1007/s42235-018-0016-x

CrossRef Full Text | Google Scholar

Gong, Z., Cheng, J., Hu, K., Wang, T., and Wen, L. (2018b). “An inverse kinematics method of a soft robotic arm with three-dimensional locomotion for underwater manipulation,” in 2018 IEEE International Conference on Soft Robotics (Livorno: RoboSoft), 516–521.

Google Scholar

Gong, Z., Xie, Z., Yang, X., Wang, T., and Wen, L. (2017). “Design, fabrication and kinematic modeling of a 3D-motion soft robotic arm,” in IEEE International Conference on Robotics and Biomimetics (Qingdao), 509–514.

Google Scholar

Hao, Y., Gong, Z., Xie, Z., Guan, S., Yang, X., Wang, T., et al. (2018). A soft pneumatic robotic gripper with variable effective length. J. Bion. Eng. 15, 220–235. doi: 10.1007/s42235-018-0017-9

CrossRef Full Text | Google Scholar

Jiang, H., Wang, Z., Liu, X., Chen, X., Jin, Y., and You, X., et al. (2017). “A two-level approach for solving the inverse kinematics of an extensible soft arm considering viscoelastic behavior,” in IEEE International Conference on Robotics and Automation (Singapore), 6127–6133.

Google Scholar

Kurumaya, S., Phillips, B. T., Becker, K. P., Rosen, M. H., Gruber, D. F., and Galloway, K. C., et al. (2018). A modular soft robotic wrist for underwater manipulation. Soft Robot. 5:399–409. doi: 10.1089/soro.2017.0097<underline

PubMed Abstract | CrossRef Full Text | Google Scholar

Lakhal, O., Melingui, A., Chibani, A., Escande, C., and Merzouki, R. (2014). “Inverse kinematic modeling of a class of continuum bionic handling arm,” in IEEE/ASME International Conference on Advanced Intelligent Mechatronics (Besacon), 1337–1342.

Google Scholar

Lee, K. H., Fu, D. K., Leong, M. C., Chow, M., Fu, H. C., Althoefer, K., et al. (2017). Nonparametric online learning control for soft continuum robot: anenabling technique for effective endoscopic navigation. Soft Robot. 4, 324–337. doi: 10.1089/soro.2016.0065

PubMed Abstract | CrossRef Full Text | Google Scholar

Licht, S., Collins, E., Mendes, M. L., and Baxter, C. (2017). Stronger at depth: jamming grippers as deep sea sampling tools. Soft Robot. 4, 305. doi: 10.1089/soro.2017.0028

PubMed Abstract | CrossRef Full Text | Google Scholar

Marchese, A. D., and Rus, D. (2016). Design, kinematics, and control of a soft spatial fluidic elastomer manipulator. Int. J. Robot. Res. 35, 840–869. doi: 10.1177/0278364915587925

CrossRef Full Text | Google Scholar

Martín, A., Barrientos, A., and del Cerro, J. (2018). The Natural-CCD algorithm, a novel method to solve the inverse kinematics of hyper-redundant and soft robots. Soft Robot. 5, 242–257. doi: 10.1089/soro.2017.0009

PubMed Abstract | CrossRef Full Text | Google Scholar

Martinez, R. V., Branch, J. L., Fish, C. R., Jin, L., Shepherd, R. F., and Nunes, R. M. D., et al. (2013). Robotic tentacles with three-dimensional mobility based on flexible elastomers. Adv Mater. 25, 205–212. doi: 10.1002/adma.201203002

PubMed Abstract | CrossRef Full Text | Google Scholar

Phillips, B. T., Becker, K. P., Kurumaya, S., Galloway, K. C., Whittredge, G., Vogt, D. M., et al. (2018). A dexterous, glove-based teleoperable low-power soft robotic arm for delicate deep-sea biological exploration. Sci. Rep. 8:14779. doi: 10.1038/s41598-018-33138-y

PubMed Abstract | CrossRef Full Text | Google Scholar

Polygerinos, P., Wang, Z., Overvelde, J. T., Galloway, K. C., Wood, R. J., Bertoldi, K., et al. (2015). Modeling of soft fiber-reinforced bending actuators. IEEE Trans. Robot. 31, 778–789. doi: 10.1109/TRO.2015.2428504

CrossRef Full Text | Google Scholar

Teoh, Z. E., Phillips, B. T., Becker, K. P., Whittredge, G., Weaver, J. C., Hoberman, C., et al. (2018). Rotary-actuated folding polyhedrons for midwater investigation of delicate marine organisms. Sci. Robot. 3:eaat5276. doi: 10.1126/scirobotics.aat5276

CrossRef Full Text | Google Scholar

Webster Iii, R. J., and Jones, B. A. (2010). Design and kinematic modeling of constant curvature continuum robots: a review. Int. J. Robot. Res. 29, 1661–1683. doi: 10.1177/0278364910368147

CrossRef Full Text | Google Scholar

Webster, R. J., Okamura, A. M., and Cowan, N. J. (2007). “Toward active cannulas: miniature snake-like surgical Robots,” in IEEE/RSJ International Conference on Intelligent Robots and Systems, 2857–2863.

Google Scholar