Skip to main content

ORIGINAL RESEARCH article

Front. Robot. AI
Sec. Human-Robot Interaction
Volume 11 - 2024 | doi: 10.3389/frobt.2024.1418677
This article is part of the Research Topic Perceiving, Generating, and Interpreting Affect in Human-Robot Interaction (HRI) View all 8 articles

Socially interactive industrial Robots: A PAD model of Flow for emotional co-regulation

Provisionally accepted
Fabrizio Nunnari Fabrizio Nunnari 1*Dimitra Tsovaltzi Dimitra Tsovaltzi 1Matteo Lavit Nicora Matteo Lavit Nicora 2,3Sebastian Beyrodt Sebastian Beyrodt 1Pooja Prajod Pooja Prajod 4Lara Chehayeb Lara Chehayeb 1Ingrid Brdar Ingrid Brdar 5Antonella Delle Fave Antonella Delle Fave 6Luca Negri Luca Negri 6Elisabeth Andre Elisabeth Andre 4Patrick Gebhard Patrick Gebhard 1Matteo Malosio Matteo Malosio 2
  • 1 German Research Center for Artificial Intelligence (DFKI), Saarbrücken, Germany
  • 2 National Research Council (Venice), Venice, Italy
  • 3 University of Bologna, Bologna, Emilia-Romagna, Italy
  • 4 University of Augsburg, Augsburg, Bavaria, Germany
  • 5 University of Rijeka, Rijeka, Croatia
  • 6 University of Milano, Milano, Italy

The final, formatted version of the article will be published soon.

    This article presents the development of a socially interactive industrial robot. An Avatar is used to embody a cobot for collaborative industrial assembly tasks. The embodied covatar (cobot plus its avatar) is introduced to support Flow experiences through co-regulation, interactive emotion regulation guidance. A real-time continuous emotional modeling method and an aligned transparent behavioral model, BASSF (Boredom, Anxiety, Self-efficacy, Self-compassion, Flow) is developed. The BASSF model anticipates and co-regulates counterproductive emotional experiences of operators working under stress with cobots on tedious industrial tasks. The targeted Flow experience is represented in the three-dimensional Pleasure, Arousal, and Dominance (PAD) space. We present how, despite their noisy nature, PAD signals can be used to drive the BASSF model with its theory-based interventions. The empirical results and analysis provides empirical support for the theoretically defined model, and clearly points to the need for data pre-filtering and per-user calibration. The proposed post-processing method helps quantify the parameters needed to control the frequency of intervention of the agent; still leaving the experimenter with a run-time adjustable global control of its sensitivity. A controlled empirical study (Study 1, N=20), tested the model's main theoretical assumptions about Flow, Dominance, Self-Efficacy, and boredom, to legitimate its implementation in this context. Participants worked on a task for an hour, assembling pieces in collaboration with the covatar. After the task, participants completed questionnaires on Flow, their affective experience, and Self-Efficacy, and they were interviewed to understand their emotions and regulation during the task. The results from Study 1 suggest that the Dominance dimension plays a vital role in task-related settings as it predicts the participants' Self-Efficacy and Flow. However, the relationship between Flow, pleasure, and arousal requires further investigation. Qualitative interview analysis revealed that participants regulated negative emotions, like boredom, also without support, but some strategies could negatively impact well-being and productivity, which aligns with theory. Additional results from a first evaluation of the overall system (Study 2, N=12) align with these findings and provide support for the use of socially interactive industrial robots to support well-being, job satisfaction, and involvement, while reducing unproductive emotional experiences and their regulation.

    Keywords: human-robot interaction, socially interactive agents, Affective Computing, Affect modeling, Emotion (Co-)Regulation, Social signals, Pleasure, Arousal

    Received: 16 Apr 2024; Accepted: 19 Dec 2024.

    Copyright: © 2024 Nunnari, Tsovaltzi, Lavit Nicora, Beyrodt, Prajod, Chehayeb, Brdar, Delle Fave, Negri, Andre, Gebhard and Malosio. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

    * Correspondence: Fabrizio Nunnari, German Research Center for Artificial Intelligence (DFKI), Saarbrücken, Germany

    Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.