AUTHOR=Barros Pablo , Bloem Anne C. , Hootsmans Inge M. , Opheij Lena M. , Toebosch Romain H. A. , Barakova Emilia , Sciutti Alessandra TITLE=You Were Always on My Mind: Introducing Chef’s Hat and COPPER for Personalized Reinforcement Learning JOURNAL=Frontiers in Robotics and AI VOLUME=8 YEAR=2021 URL=https://www.frontiersin.org/journals/robotics-and-ai/articles/10.3389/frobt.2021.669990 DOI=10.3389/frobt.2021.669990 ISSN=2296-9144 ABSTRACT=
Reinforcement learning simulation environments pose an important experimental test bed and facilitate data collection for developing AI-based robot applications. Most of them, however, focus on single-agent tasks, which limits their application to the development of social agents. This study proposes the Chef’s Hat simulation environment, which implements a multi-agent competitive card game that is a complete reproduction of the homonymous board game, designed to provoke competitive strategies in humans and emotional responses. The game was shown to be ideal for developing personalized reinforcement learning, in an online learning closed-loop scenario, as its state representation is extremely dynamic and directly related to each of the opponent’s actions. To adapt current reinforcement learning agents to this scenario, we also developed the COmPetitive Prioritized Experience Replay (COPPER) algorithm. With the help of COPPER and the Chef’s Hat simulation environment, we evaluated the following: (1) 12 experimental learning agents, trained