Robotics have advanced significantly over the years, and human–robot interaction (HRI) is now playing an important role in delivering the best user experience, cutting down on laborious tasks, and raising public acceptance of robots. New HRI approaches are necessary to promote the evolution of robots, with a more natural and flexible interaction manner clearly the most crucial. As a newly emerging approach to HRI, multimodal HRI is a method for individuals to communicate with a robot using various modalities, including voice, image, text, eye movement, and touch, as well as bio-signals like EEG and ECG. It is a broad field closely related to cognitive science, ergonomics, multimedia technology, and virtual reality, with numerous applications springing up each year. However, little research has been done to summarize the current development and future trend of HRI. To this end, this paper systematically reviews the state of the art of multimodal HRI on its applications by summing up the latest research articles relevant to this field. Moreover, the research development in terms of the input signal and the output signal is also covered in this manuscript.
A multi-objective full-parameter optimization particle swarm optimization (MOFOPSO) algorithm is proposed in this paper to overcome the drawbacks of poor accuracy, low efficiency, and instability of the existing algorithms in the inverse kinematics(IK) solution of the manipulator. In designing the multi-objective function, the proposed algorithm considers the factors such as position, posture, and joint. To improve PSO, the proposed algorithm comprehensively analyzes all factors affecting the global and local searching abilities. Based on this, the initial population is designed following the localized uniform distribution method. Meanwhile, the inertia weight, asynchronous learning factor, and time factor are respectively designed by introducing the iteration factor. Finally, this paper tests the performance of MOFOPSO with three typical functions to obtain a better inverse kinematics solution of the 6-DOF manipulator. Also, six other algorithms are taken for performance comparison. The experimental results indicate that the proposed method not only ensures the stability of the manipulator but also achieves high accuracy and efficiency in solving the inverse kinematics of the 6-DOF manipulator.