Skip to main content

HYPOTHESIS AND THEORY article

Front. Robot. AI
Sec. Robot Learning and Evolution
Volume 11 - 2024 | doi: 10.3389/frobt.2024.1353870

Collective Predictive Coding Hypothesis: Symbol Emergence as Decentralized Bayesian Inference

Provisionally accepted
  • Ritsumeikan University, Kyoto, Japan

The final, formatted version of the article will be published soon.

    Understanding the emergence of symbol systems, especially language, requires the construction of a computational model that reproduces both the developmental learning process in everyday life and the evolutionary dynamics of symbol emergence throughout history. This study introduces the collective predictive coding (CPC) hypothesis, which emphasizes and models the interdependence between forming internal representations through physical interactions with the environment and sharing and utilizing meanings through social semiotic interactions within a symbol emergence system. The total system dynamics is theorized from the perspective of predictive coding. The hypothesis draws inspiration from computational studies grounded in probabilistic generative models and language games, including the Metropolis-Hastings naming game. Thus, playing such games among agents in a distributed manner can be interpreted as a decentralized Bayesian inference of representations shared by a multi-agent system.Moreover, this study explores the potential link between the CPC hypothesis and the free-energy principle, positing that symbol emergence adheres to the society-wide free-energy principle.Furthermore, this paper provides a new explanation for why large language models appear to possess knowledge about the world based on experience, even though they have neither sensory organs nor bodies. This paper reviews past approaches to symbol emergence systems, offers a comprehensive survey of related prior studies, and presents a discussion on CPCbased generalizations. Future challenges and potential cross-disciplinary research avenues are highlighted.

    Keywords: Symbol emergence, Emergent communication, predictive coding, Probabilistic generative models, Bayesian inference, multi-agent systems, language evolution

    Received: 11 Dec 2023; Accepted: 11 Jun 2024.

    Copyright: © 2024 Taniguchi. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

    * Correspondence: Tadahiro Taniguchi, Ritsumeikan University, Kyoto, Japan

    Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.