AUTHOR=Blaha Leslie M. , Abrams Mitchell , Bibyk Sarah A. , Bonial Claire , Hartzler Beth M. , Hsu Christopher D. , Khemlani Sangeet , King Jayde , St. Amant Robert , Trafton J. Gregory , Wong Rachel TITLE=Understanding Is a Process JOURNAL=Frontiers in Systems Neuroscience VOLUME=16 YEAR=2022 URL=https://www.frontiersin.org/journals/systems-neuroscience/articles/10.3389/fnsys.2022.800280 DOI=10.3389/fnsys.2022.800280 ISSN=1662-5137 ABSTRACT=

How do we gauge understanding? Tests of understanding, such as Turing's imitation game, are numerous; yet, attempts to achieve a state of understanding are not satisfactory assessments. Intelligent agents designed to pass one test of understanding often fall short of others. Rather than approaching understanding as a system state, in this paper, we argue that understanding is a process that changes over time and experience. The only window into the process is through the lens of natural language. Usefully, failures of understanding reveal breakdowns in the process. We propose a set of natural language-based probes that can be used to map the degree of understanding a human or intelligent system has achieved through combinations of successes and failures.