AUTHOR=Soboroff Ian , Awad George , Butt Asad , Curtis Keith TITLE=Evaluating Multimedia and Language Tasks JOURNAL=Frontiers in Artificial Intelligence VOLUME=3 YEAR=2020 URL=https://www.frontiersin.org/journals/artificial-intelligence/articles/10.3389/frai.2020.00032 DOI=10.3389/frai.2020.00032 ISSN=2624-8212 ABSTRACT=

Evaluating information access tasks, including textual and multimedia search, question answering, and understanding has been the core mission of NIST's Retrieval Group since 1989. The TRECVID Evaluations of Multimedia Access began in 2001 with a goal of driving content-based search technology for multimedia just as its progenitor, the Text Retrieval Conference (TREC) did for text and web1.