Skip to main content

ORIGINAL RESEARCH article

Front. Lang. Sci.
Sec. Psycholinguistics
Volume 4 - 2025 | doi: 10.3389/flang.2025.1488399

Cross-modal matching of monosyllabic and bisyllabic items varying in phonotactic probability and lexicality

Provisionally accepted
Kauyumari Sanchez Kauyumari Sanchez *
  • Cal Poly Humboldt, Arcata, United States

The final, formatted version of the article will be published soon.

    The current investigation expands the research of Vitevitch and Luce (1999) in an audio-visual cross-modal format. In two experiments, English words and nonwords varying in phonotactic probability were cross-modally compared in an AB matching task. Participants were presented with either visual-only (V) speech (a talker’s speaking face) or auditory-only (A) speech (a talker’s voice) in the A position. Stimuli in the B position were of the opposing modality (counterbalanced). Experiment 1 employed monosyllabic items, while experiment 2 employed bisyllabic items. Accuracy measures for experiment 1 revealed main effects for phonotactic probability and presentation order (A-V vs. V-A), while experiment 2 revealed main effects for lexicality and presentation order. Reaction time measures for experiment 1 revealed an interaction between probability and lexicality, with a main effect for presentation order. Reaction time measures for experiment 2 revealed two 2-way interactions: probability and lexicality and probability and presentation order, with significant main effects. Overall, the data suggests that 1) cross-modal research can be conducted with various presentation orders, 2) perception is guided by the most predictive components of a stimulus, and 3) more complex stimuli can support the results from experiments using simpler stimuli, but can also uncover new information.

    Keywords: audio-visual speech perception, multisensory perception, cross-modal speech, Psycholinguistics, language processing

    Received: 29 Aug 2024; Accepted: 13 Jan 2025.

    Copyright: © 2025 Sanchez. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

    * Correspondence: Kauyumari Sanchez, Cal Poly Humboldt, Arcata, United States

    Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.