About this Research Topic
The ability to efficiently process crossmodal information is a key feature of the human brain that provides a robust perceptual experience and behavioural responses. Consequently, the processing and integration of multisensory information streams such as vision, audio, haptics and proprioception play a crucial role in the development of autonomous agents and cognitive robots, yielding an efficient interaction with the environment also under conditions of sensory uncertainty.
Multisensory representations have been shown to improve performance in the research areas of human-robot interaction and sensory-driven motor behaviour. The perception, integration, and segregation of multisensory cues improve the capability to physically interact with objects and persons with higher levels of autonomy. However, multisensory input must be represented and integrated in an appropriate way so that they result in a reliable perceptual experience aimed to trigger adequate behavioural responses. The interplay of multisensory representations can be used to solve stimulus-driven conflicts for executive control. Embodied agents can develop complex sensorimotor behaviour through the interaction with a crossmodal environment, leading to the development and evaluation of scenarios that better reflect the challenges faced by operating robots in the real world. Such challenges include the modeling of lifelong learning, curriculum and developmental learning, and the autonomous exploration of the environment driven by intrinsic motivation and self-supervision. For this reason, the modeling of crossmodal processing in robots is of crucial interest for learning, memory, cognition, and behaviour, and particularly in the case of uncertain and ambiguous or incongruent multisensory input.
This Research Topic invites authors to submit new findings, theories, systems, and trends in multisensory learning for intelligent agents and robots with the aim to foster the development of novel and impactful research which will contribute to the understanding of human behaviour and the development of artificial systems operating in real world environments.
Topics of interest
- New methods and applications for crossmodal processing and multisensory integration (e.g. vision, audio, haptics, proprioception)
- Machine learning and neural networks for multisensory robot perception
- Computational models of crossmodal attention and perception
- Bio-inspired approaches for crossmodal learning
- Multisensory conflict resolution and executive control
- Sensorimotor learning for autonomous agents and robots
- Crossmodal learning for embodied and cognitive robots
Multisensory representations have been shown to improve performance in the research areas of human-robot interaction and sensory-driven motor behaviour. The perception, integration, and segregation of multisensory cues improve the capability to physically interact with objects and persons with higher levels of autonomy. However, multisensory input must be represented and integrated in an appropriate way so that they result in a reliable perceptual experience aimed to trigger adequate behavioural responses. The interplay of multisensory representations can be used to solve stimulus-driven conflicts for executive control. Embodied agents can develop complex sensorimotor behaviour through the interaction with a crossmodal environment, leading to the development and evaluation of scenarios that better reflect the challenges faced by operating robots in the real world. Such challenges include the modeling of lifelong learning, curriculum and developmental learning, and the autonomous exploration of the environment driven by intrinsic motivation and self-supervision. For this reason, the modeling of crossmodal processing in robots is of crucial interest for learning, memory, cognition, and behaviour, and particularly in the case of uncertain and ambiguous or incongruent multisensory input.
This Research Topic invites authors to submit new findings, theories, systems, and trends in multisensory learning for intelligent agents and robots with the aim to foster the development of novel and impactful research which will contribute to the understanding of human behaviour and the development of artificial systems operating in real world environments.
Topics of interest
- New methods and applications for crossmodal processing and multisensory integration (e.g. vision, audio, haptics, proprioception)
- Machine learning and neural networks for multisensory robot perception
- Computational models of crossmodal attention and perception
- Bio-inspired approaches for crossmodal learning
- Multisensory conflict resolution and executive control
- Sensorimotor learning for autonomous agents and robots
- Crossmodal learning for embodied and cognitive robots
Keywords: Multisensory Robots, Developmental Robot, Human Behavior Studies, Intelligent Robots
Important Note: All contributions to this Research Topic must be within the scope of the section and journal to which they are submitted, as defined in their mission statements. Frontiers reserves the right to guide an out-of-scope manuscript to a more suitable section or journal at any stage of peer review.
