Irene Lorenzini
Thierry Nazzi- Université Paris Cité, CNRS, Integrative Neuroscience and Cognition Center, Paris, France
Growing evidence shows that early speech processing relies on information extracted from speech production. In particular, production skills are linked to word-form processing, as more advanced producers prefer listening to pseudowords containing consonants they do not yet produce. However, it is unclear whether production affects word-form encoding (the translation of perceived phonological information into a memory trace) and/or recognition (the automatic retrieval of a stored item). Distinguishing recognition from encoding makes it possible to explore whether sensorimotor information is stored in long-term phonological representations (and thus, retrieved during recognition) or is processed when encoding a new item, but not necessarily when retrieving a stored item. In this study, we asked whether speech-related sensorimotor information is retained in long-term representations of word-forms. To this aim, we tested the effect of production on the recognition of ecologically learned, real familiar word-forms. Testing these items allowed to assess the effect of sensorimotor information in a context in which encoding did not happen during testing itself. Two groups of French-learning monolinguals (11- and 14-month-olds) participated in the study. Using the Headturn Preference Procedure, each group heard two lists, each containing 10 familiar word-forms composed of either early-learned consonants (commonly produced by French-learners at these ages) or late-learned consonants (more rarely produced at these ages). We hypothesized differences in listening preferences as a function of word-list and/or production skills. At both 11 and 14 months, babbling skills modulated orientation times to the word-lists containing late-learned consonants. This specific effect establishes that speech production impacts familiar word-form recognition by 11 months, suggesting that sensorimotor information is retained in long-term word-form representations and accessed during word-form processing.
Introduction
The relationship between speech perception and production in early phonological development is receiving growing attention. Perception/production links have been reported, between 6 and 18 months of age, for a wide range of experimental tasks, comprising audiovisual matching (Streri et al., 2016; Altvater-Mackensen et al., 2016); unfamiliar word-form processing (DePaolis et al., 2011, 2013; Majorano et al., 2014); speech segmentation (Hoareau et al., 2019); familiar words mispronunciation detection (Altvater-Mackensen et al., 2014); word learning (Altvater-Mackensen and Fikkert, 2010; Majorano et al., 2019) and categorical perception (Vilain et al., 2019). These studies show a boosting effect of growing production skills on perceptual processing and their shared interpretation is that early practice of speech sounds opens up a novel source of phonological knowledge: sensorimotor knowledge [i.e., phonological knowledge derived from speech-related motor and proprioceptive practice, cf. Guellaï et al. (2014)]. Following the setting of this perception/production coupling, the representation of “own” speech sounds (sounds that have been practiced by the infant) would become stronger (stronger memory trace, easier access) compared with the representation of “non-own” speech sounds, only experienced through the input.
In this perspective, babbling has been proposed as the basic mechanism underlying the setting of the perception/production coupling, a perceptuomotor activity allowing the perceptuo-cognitive connection between one’s speech actions and the proprioceptive and acoustic percepts generated by this action (e.g., Vihman et al., 2009). Neurofunctional evidence supports these hypotheses. Imada et al. (2006) investigated the respective activation to CV syllables of the superior temporal cortex (locus of auditory analysis) and inferior frontal regions (involved in speech motor analysis) from 0 to 12 months. They found that, from 6 months onward, activity in the superior temporal regions was progressively mirrored by activity in the inferior frontal regions. This trend was interpreted as evidence of the setting of a perceptuo-motor link, tentatively related to the onset of babbling-like movements.
Going beyond purely linguistic tasks, Keren-Portnoy et al. (2010) investigated the relationship between the development of speech production skills and of interrelated memory functions (phonological working memory). The authors found a significant correlation between speech production skills (length of experience with babbling) and phonological working memory as measured at 24 months in a word repetition task. They also found better retention, in the repetition task, of word-forms embedding consonants that were part of the participants’ babbling repertoires.
This topic has been recently rediscussed in a very comprehensive review by Vihman (2022), arguing that speech sound production and its interaction with the perceptual system might be fundamental for the development of phonological memory.
All in all, the interaction between perception and production during infancy has been linked to the development of a wide set of linguistic processing mechanisms as well as to the development of memory capacities. In this context, the onset of production has often been taken as the measure of reference, the point of departure of the perception/production link. However, going beyond this principle, a parallel line of investigation has shown that perception/production effects can also be observed before the onset of speech production, as early as at 3 months of age. At this early stage, fundamental perceptual capacities such as phoneme discrimination and audiovisual matching can be modulated by the administration of teething toys, which enhance or inhibit perception depending on whether they mirror or block the movements underlying the production of the heard sounds (Yeung and Werker, 2013; Bruderer et al., 2015; Choi et al., 2019, 2021). Importantly, neurofunctional evidence has confirmed that the interference obtained is perceptuo-motor rather than due to a general disturbance effect (Choi et al., 2021). Valuably amending previous conclusions, and showing that action/perception mechanisms in speech perception might be active from very early in life, these studies promote a debate that echoes investigations targeting the ontogeny of general action/perception mechanisms in the human brain. For instance, Del Giudice et al. (2009) proposed that mirror neurons might result from Hebbian learning allowed by the possibility to perceive one’s own action in infancy, while at the same time underlining that infants’ perceptual-motor system might be particularly efficient in providing input for Hebbian learning.
In summary, the perception/production coupling in speech development is precocious (preceding, in some form, experience with speech production) and consistent (spanning different developmental periods). However, more research is needed to clarify both the temporal timeline and the functional dynamics of this perception/action mechanism: is it active from birth? How is it modulated by the onset of speech production? In which ways does it influence phonological development? Research and debate on these points are just at their beginnings (Choi et al., 2019; Vilain et al., 2019).
The perception/production link in early word-form processing
The specific object of this study, the speech perception/production link in early word-form processing, has been addressed in foundational studies in the field. Capitalizing on extensive first-hand analyses of production, DePaolis et al. (2011) tested listening preferences around 10 months of age for pseudowords containing consonants that each participant: either regularly produced in babbling (“own-consonants”); or did not produce, but are common at the age tested (i.e., are within their reach in terms of articulatory development); or did not produce, and are generally not produced at the age tested (exceeding current articulatory development). The study revealed a significant preference, in more advanced babblers (infants who mastered at least two supraglottal consonants), for non-mastered, yet producible consonants. These results were replicated and extended in a longitudinal study by Majorano et al. (2014), who additionally reported longer listening in less advanced babblers for pseudowords containing own-consonants. No preference for any of the given consonant categories was found in pre-babbling infants.
Such patterns have been interpreted in agreement with the “Articulatory Filter Hypothesis.” Originally formulated by Vihman (1993), this perspective made the hypothesis that the perception/production coupling of speech sounds, as obtained through babbling practice, modifies infants’ attention to the speech signal. In other words, when an infant starts stably producing a new consonant, the representation of such a consonant integrates sensorimotor information and becomes richer, thus particularly salient in the speech stream. The investigations by DePaolis and colleagues and Majorano and colleagues were designed to test such hypothesis, for which they both provided empirical support. Beyond this, the finding of a preference for non-mastered consonants in more advanced producers by DePaolis et al. (2011), followed by the finding of a preference for own-consonants in less advanced producers by Majorano et al. (2014), were unexpected. This pattern was taken to show that well-practiced sounds become «overly familiar» stimuli, that start being processed with lesser cognitive effort than non-own consonants and trigger less attention (DePaolis et al., 2011, p. 598).
To sum up, the Articulatory Filter Hypothesis posits a form of representational coupling of phonological knowledge derived on the one side from perception and on the other side from production, which is hypothesized to support encoding and recognition of word-forms, as well as word-object learning. Here, we followed up on these previous results, and explored retention of sensorimotor information in long-term word-form representations.
The present study: Distinguishing encoding from recognition to test long-term word-form representations
Encoding can be defined as the process of translating information into a format that can be stored in the memory system; recognition as the automatic retrieval of a stored item (a word-form, in our case), triggered by the occurrence of an instance of such item (Melton, 1963; Atkinson and Shiffrin, 1968; Gillund and Shiffrin, 1984).
Previous studies have targeted the processing of new word-forms (e.g., DePaolis et al., 2011; Majorano et al., 2014). Thus, crucially, the tasks used entailed both an encoding and a recognition phase, and the perception/production effect could come from the former, the latter or both. The present study aimed at clarifying this issue: by using real familiar words, previously learned by participants in their daily environment, we excluded encoding from the experimental task and assessed recognition of word-forms stored in long-term memory.
Distinguishing encoding from recognition has relevant theoretical implications. In fact, showing that sensorimotor information is used for word-form encoding reveals that this information is part of what is processed when learning a new word. However, this does not necessarily imply that sensorimotor information is retained as part of the (multisensory) word-form representation, which is instead suggested if the effect is still obtained testing recognition. Two investigations have addressed this issue so far. Majorano et al. (2019) tested word learning at 11 months of age with an ecological learning procedure followed by a preferential looking task. The target items were composed of either Early-Learned Consonants (ELC) or Late-Learned Consonants (LLC), respectively being or not being part of typical babbling repertoires. The authors obtained evidence of word retention limited to the participants showing more advanced production and to ELC-words, thus signaling a specific effect of speech-related sensorimotor learning on long-term word-form storage. However, evidence of learning was overall weak: more vs. less advanced babblers preferred looking at the visual referent associated to ELC-words when it was contrasted with the referent associated to LLC-words, but, when the ELC referent was contrasted with a foil image, the whole group preferred looking at the foil.
In another vein, Laing and Bergelson (2020) analyzed babbling samples recorded from 10-to-11-month-olds and assessed whether or not the consonants uttered matched the name of the objects that the infants were attending to during the recordings, which implies the retrieval of a previously stored phonological form. The results revealed that infants with more advanced production skills were more likely to produce consonants mirroring the name of the contextual object. However, the authors failed to find strong evidence of a specific perception/production relationship (i.e., of babbling participants producing more object-matching consonants when the object’s name contained consonants belonging to their inventories).
With this study, we aimed at building on previous findings, further investigating the issue of the retention of sensorimotor information in long-term word-form representations. To these goals, we measured orientation times to familiar word-forms in French-learning infants displaying more vs. less advanced production skills, using the Headturn Preference Procedure without a familiarization phase. Differently from previous studies, we did not select our stimuli to mirror participants’ individual production patterns. We relied on evidence that French-learning infants of the age tested produce a majority of early-learned consonants (plosives and nasals, ELCs) and a minority of late-learned consonants [fricatives and liquids, LLCs; classification and terminology being taken from Majorano et al. (2019)]. In particular, De Boysson-Bardies and Vihman (1991) conducted a longitudinal study on babbling patterns in French learners based on transcription of home-recorded samples. The authors specified consonant count for the age range between 10 and 15 months of age, corresponding to the ages targeted in the present research. They reported no significant change in the relative production of ELC and LLC during this time period and, precisely, a ratio of 80% ELCs to 20% LLCs (Table 3, p. 303 of the original paper). Levitt and Utman (1992) presented a case study whose results agree with the tendencies identified by de Boysson-Bardies & Vihman (although note that the relative percentage of LLCs reported here appears slightly lower than those reported by de Boysson-Bardies & Vihman, which is related to the fact that Levitt & Utman also counted glides, while de Boysson-Bardies & Vihman did not).
Similar patterns are also observed cross-linguistically and beyond individual variation, due to the progressive attainment of neuromuscular control on the articulators (Green et al., 2000; McLeod and Crowe, 2018). On these bases, we contrasted words containing ELCs with words containing LLCs assuming that, at the group level, participants would master ELC production and be at the early stages of LLC production (production skills were then verified on the day of testing). While this methodological choice prevented us from obtaining individual-child results, it allowed us to use a wider variety of speech sounds and to test more homogeneous age groups than in previous studies (DePaolis et al., 2011; Majorano et al., 2014). Such studies have shown a perception/production relationship rooted in individual production patterns. Here, we proceeded in a different way, basing our stimulus selection on principles that are valid beyond individual variation. Note that Altvater-Mackensen et al. (2014) and Majorano et al. (2019) used analogous distinctions.
In a first experiment, we tested a group of 11-month-olds, as word-form recognition has been shown to emerge at that age (e.g., Hallé and de Boysson-Bardies, 1994; Vihman et al., 2004; Swingley, 2005; Poltrock and Nazzi, 2015; DePaolis et al., 2016; Vihman and Majorano, 2017). In Experiment 2, we then targeted a group of 14-month-olds. We chose this second age range because, based on previous evidence on babbling in French-learning 10-to-15-month-olds (De Boysson-Bardies and Vihman, 1991), we expected more advanced consonant production at this stage. Following the Articulatory Filter Hypothesis, wider experience with speech sound production should entail stronger perception/production effects, due to a broadening of the perception/production coupling to several sounds. At both ages, our hypothesis of a role of production in word-form recognition predicted differences in listening preferences as a function of word type (containing ELCs vs. LLCs) and, following DePaolis et al. (2011) and Majorano et al. (2014), of production skills. Specifically, we expected a preference for word-lists containing LLCs, which would be modulated by production level, being possibly stronger, or present only, in more advanced producers.
Experiment 1
Materials and methods
Participants
Thirty-two full-term healthy infants were included in the study (21 females, 11 males; mean age: 11 months, 12 days; range: 11 months–11 months, 29 days). All participants came from monolingual French-speaking homes and the parents reported no familial history of speech, language or hearing disorders. Six additional infants were tested but not included due to experimenter’s error (1) or fussiness (5). All parents gave informed consent prior to testing.
Production assessment: Parental questionnaire
For each infant, the type and quantity of consonants produced were estimated through a parental questionnaire. Specifically, we used the same questionnaire as Gonzalez-Gomez and Nazzi (2012) and Hoareau et al. (2019), originally adapted from Stoel-Gammon (1989). While, as compared with direct observation, this kind of questionnaire provides an indirect measure of infant production, previous studies have reported that such questionnaires can be reliable. For example, Ramsdell et al. (2012) reported reliability of a similar parental babbling questionnaire, administered to parents of infants aged from 10 to 12 months (in which, specifically, parents were asked to report the sounds produced by their infant in that period). Furthermore, use of the present questionnaire or of very similar versions has previously allowed to detect differences in production skills between groups of full-term and preterm infants at 10 months (Gonzalez-Gomez and Nazzi, 2012), a link between speech production and word-form segmentation abilities at 8 months (Hoareau et al., 2019), and differences in audiovisual matching before and after babbling onset at 9 months (Vilain et al., 2019).
The questionnaire was administered as a checklist in which, for each French consonant, parents had to choose whether their infant produced the consonant: (a) on a regular basis and with a stable and correct phonetic form; (b) sporadically and/or with variable phonetic forms; (c) did not yet produce the consonant. Only the consonants falling in category (a) were retained for analyses. We also asked whether infants produced reduplicated and variegated babbling. This was an exclusion criterion, as severe limitation of babbling patterns at this age might signal atypical production development (e.g., Whitehurst et al., 1991; Oller et al., 1999). No participant had to be excluded on this basis. The questionnaire was filled on the day of testing after the HPP procedure or, if this was not possible, within a week after testing. The questionnaire was administered by the first author in exactly the same way to all parents. Parents did not receive explicit instructions on how to formulate their judgments and none of the families displayed difficulties answering the questions.
Headturn preference procedure
Stimuli
Twenty familiar words were chosen from the French version of the Communicative Developmental Inventories (CDI; Kern, 2003): 10 words exclusively containing Early-Learned Consonants (ELCs, that emerge early in speech development and are produced through relatively simple articulation patterns: plosives and nasals) and 10 words exclusively containing Late-Learned Consonants (LLCs, entailing more complex articulatory dynamics and, thus, typically acquired later in development: fricatives and the lateral/l/). Vowel context was varied in an effort to balance the different types of vowels (height, openness, rounded/unrounded, nasalization, presence of diphthongs). Adult word frequency, syllabic length and the frequency of the initial, internal and final diphones were controlled between lists based on the Lexique corpus (New et al., 2004) and the Diphones corpus (New and Spinelli, 2013).
Familiar words were identified in the CDI following the familiarity criteria in Vihman et al. (2004) and Poltrock and Nazzi (2015). According to parental reports, the selected items were comprehended on average by 27% (range: 13–58%) of French-learning infants by 11 months of age (S. Kern: personal communication on MacArthur Bates specifying CDI scores in 55 11-month-old French-learners and 50 14-month-old French-learners). The familiarity of the words was also verified for each participant on the testing day. Concerning this point, because we were interested in testing the word-form level [which is phonological in nature and does not need meaning to be included in the representation, Werker and Curtin (2005)], parents were asked to rate how often their infants heard (and not how often their infants comprehended) the words tested. The possible answers were: 0 = Never; 1 = rarely: once per week; 2 = one time per day; 3 = several times per day. The mean response was 1.9 (SD = 0.45), similarly to Swingley (2005) and Poltrock and Nazzi (2015). Twenty-five infants were familiar with all the words. Of the seven infants who were unfamiliar with one or more of the words, parents chose answers 0 or 1 for a mean number of 4.5 words out of 20. Additionally, we asked families whether the infants were able to produce one or more of the test-words. None of the infants was reported to produce any of the words.
The stimuli were recorded in a sound-proofed booth in Infant Directed Speech by a French-native female speaker using an Audio-Technica ATR-20 microphone. Three tokens of each item were selected and six pseudo-randomized lists were constructed for each condition: six lists of familiar words containing ELCs and six lists of familiar words containing LLCs. In each list, each of the 10 words was presented twice, so that the list contained 20 tokens in total. The order of all items in the lists (including initial items) was pseudo-randomized, ensuring that each word was well-distributed within and across lists. All lists lasted 22.30 s, with an interstimulus interval varying between 550 and 630 ms. The stimuli were controlled for duration, intensity and fundamental frequency (stimuli; means, standard deviations and significance levels are given in Tables 1, 2).
Table 1. Test stimuli used in experiment 1: familiar words containing early vs. late-learned consonants (ELC; LLC).
Table 2. Experiment 1: acoustic characteristics of the stimuli.
Table 3. Experiment 1: quantity and type of consonant produced (parental questionnaires. 11-month-olds).
Procedure and apparatus
The experiment took place in a sound-attenuated booth containing a three-sided test booth made by pegboard panels. The test booth had two red lights and a loudspeaker (SONY xs−F1722) on each side and a green light at the center. All lights were at eye level for the participants. A hidden camera was accommodated in a 5 cm hole below the center light. A PC terminal (Dell Optiplex computer), an audio amplifier (Marantz PM4000), a TV screen connected to the camera, and a three-button response box were located outside the booth. The experimenter monitored the participant’s behavior on the TV screen and pressed the buttons of the response box according to the direction of the infant’s headturns, thus starting and stopping the flashing of the lights and the presentation of the sounds. Orientation times were measured and recorded on-line. The experimenter and the caregiver wore earplugs and listened to music over tight−fitting headphones, preventing them from hearing the stimuli.
We used the Headturn Preference Procedure (Kemler Nelson et al., 1995) without a familiarization phase. The participants were held on the lap of a caregiver sitting in the center of the test booth, facing the central panel. At the beginning of each trial, the central light blinked until the participant looked in that direction. The green light was then extinguished and the side light above one of the loudspeakers began to flash. When the infant made a turn of at least 30° toward the flashing light, the presentation of the sounds for the given trial was initiated and the red light on that side continued to flash for the entire duration of the trial. If the infant turned away by 30° for less than 2 s and then turned back again, the trial continued but the time spent looking away was not recorded. If the orientation time for a trial was shorter than 1.5 s, the trial was repeated. This minimum orientation time was used to ensure that the participants heard at least one or two words of each list.
Each session began with a training phase made up of two musical trials, allowing the participant to practice the association between headturn and presentation of the stimuli. Each infant listened to all 12 word-lists (six containing ELCs and six containing LLCs) and presentation side varied randomly from trial to trial (three trials on the left side and three trials on the right side for each condition). The order of the lists was pseudorandomized, with no more than two trials in a row of the same condition or on the same side. All infants provided data for all 12 trials.
Results and discussion
Production skills
The mean number of consonants produced in the group amounted to 5.4 (range: 3–8). The majority of the participants produced ELCs (plosives and nasals) while only a minority (seven out of 32 infants) were reported to produce an ELC: the lateral/l/; none was reported to produce fricatives. In summary, differences in production skills between the participants amounted to the number of ELCs in their phonetic inventories. This contradicted our expectations, based on De Boysson-Bardies and Vihman (1991), to find reduced but active production of LLCs at this age. The quantity and types of consonants produced per participant are shown in Table 3.
Headturn preference procedure
A repeated-measures analysis of covariance (ANCOVA) on orientation times was performed, with type of list (ELC word-forms vs. LLC word-forms) as within-subject variable and production skills (number of produced consonants, centered linear variable) as between-subject variable. The ANCOVA revealed no main effect of either Word-list (F = 2.758; p = 0.107) or babbling (F = 3.834; p = 0.060). However, the Word-list x babbling interaction was significant (F = 5.497; p = 0.026; η2 = 0.155), revealing that the effect of babbling on OTs varied for the two word-lists. We performed post hoc analyses as simple linear regression targeting the predictive power of babbling on OTs for either the ELC or LLC word-lists. Results show that babbling was a significant predictor of OTs for LLC word-lists (r2 = 0.229; p = 0.006) but not for ELC word-lists (r2 = 0.012; p = 0.550). In other words, OTs tended to increase with babbling scores (the marginal babbling effect), but the effect of babbling scores on OTs was significantly stronger for LLC vs. ELC word-lists and it was only significant for the LLC word-lists (cf. Figure 1). Accordingly, infants with relatively more advanced babbling oriented more to the LLC word-lists than infants with relatively less advanced babbling.
Figure 1. Orientation times to early-learned consonants (ELC) and late-learned consonants (LLC) word–lists at 11 months.
These results parallel the trends in DePaolis et al. (2011) and Majorano et al. (2014). This notwithstanding, it has to be noted that the relationship between the stimuli used and the babbling patterns observed in the group turned out to be different from our intentions. Our aim was to test the preference found by DePaolis et al. (2011) and Majorano et al. (2014), where “novel” consonants triggered longer orientation times in infants displaying richer babbling patterns. However, these studies identified such effect as long as target consonants were novel but within reach in terms of articulatory skills. Contrary to our expectations, such precondition was seemingly not satisfied in the present experiment. Based on former babbling surveys on French-learning infants, we expected production of a minority of fricatives and liquids to have started at 11 months of age (De Boysson-Bardies and Vihman, 1991). Contrary to our expectation, production of LLCs was very rarely reported in this group of 11-month-olds. Hypothetically, these infants might have been on the verge of producing LLCs that, thus, would have captured their attention following the pattern observed in previous investigations. However, the framework for our predictions being only incompletely fulfilled, we repeated the experiment with a new group of participants aged 14 months. We hypothesized that slightly older infants might have started LCC production and, thus, display a clearer perception-production interaction.
Experiment 2
Materials and methods
Participants
Thirty-two full-term healthy infants were included in the group (14 females, 18 males; mean age: 14 months, 11 days; range: 13 months, 28 days–14 months, 28 days). All came from monolingual French-speaking homes and had no familial history of speech, language or hearing disorders. Four additional infants were tested but not included due to fussiness. All parents gave written informed consent and completed an information sheet confirming the inclusionary criteria.
Production assessment: Parental questionnaire
Same as Experiment 1.
Headturn preference procedure
Stimuli
The selection of the stimuli followed the same criteria as Experiment 1 but was adapted to fit 14-month-olds. Hence, the test words were not the same (precisely, one of the ELC-words and four of the LLC-words had to be changed to respect our familiarity criteria, cf. Tables 4, 5 for the list of the stimuli used and their acoustic characteristics). Twenty familiar words were selected from the French version of the CDI so as to obtain 10 words exclusively containing ELCs and 10 words exclusively containing LLCs. The words were comprehended, at 14 months, by 46% of French-learning infants on average (range: 22–76%; based on parental reports by Kern, personal communication). This mean comprehension rate is slightly higher than in Experiment 1, due to an overall increase in comprehension rates between the two ages. As in Experiment 1, we asked families whether the infants were able to produce one or more of the test words. Percentage of production of the test words was negligible (two infants out of 32 were reported to say [tête], head; 1 infant was reported to say [ga] for [gateau], cake).
Table 4. Test stimuli used in experiment 2: familiar words containing early- vs. late-learned consonants (ELC; LLC).
Table 5. Experiment 2: acoustic characteristics of the stimuli.
As in Experiment 1, the familiarity of the words was verified for each participant. The mean answer was 1.95 (SD = 0.63), similar to Experiment 1. Most infants (22) were reported to be familiar with all words, and only 10 infants were reported not to be familiar with all the words (mean unfamiliar words = 3 out of 20).
The order of all items in the lists (including initial items) was pseudo-randomized, verifying that each word was well-distributed within and across lists. All lists lasted 22.07 seconds (interstimulus interval range: 550–630 ms). All subjects provided data for all trials.
Procedure and apparatus
Same as Experiment 1.
Results and discussion
Production skills
The mean number of consonants produced amounted to 6.2 (range: 3–9). While the variety of consonants produced across participants contained a majority of ELCs (plosives and nasals), 11 out of 32 infants were reported to stably produce at least one LLC, specifically, /l/and/or one fricative (/∫/,/s/,/ᴚ/or/z/). Thus, production skills at 14 months fitted better than at 11 months with the schema that we had planned for our stimuli: at the group level, ELC production was mastered; LLC production was at its beginning but more advanced and varied in comparison with the 11-month-old group (in which no participant produced any fricative consonant). The quantity and type of consonant produced are shown in Table 6.
Table 6. Experiment 2: quantity and type of consonant produced (parental questionnaires. 14-month-olds).
Although this is a cross-sectional study and, thus, it does not capture developmental trajectories, note that infants falling at the lower end (i.e., below the median value) of production skills at 14 months still produced fewer speech sounds than infants falling at the upper end of the range at 11 months (4.9 vs. 6.9 respectively): across the two age-groups, speech sensorimotor development appears age-independent. This highlights large interindividual variability in early babbling development, and further studies would be needed to identify the causes of such variability, as this is beyond the scope of the present study.
Headturn preference procedure
As in Experiment 1, a repeated-measures analysis of covariance (ANCOVA) on orientation times was performed, with type of list (ELC word-forms vs. LLC word-forms) as within-subject variable and production skills (n. of produced consonants, centered linear variable) as between-subject variable. The ANCOVA revealed no main effect of either Word-list (F = 0.867; p = 0.359) or babbling (F = 1.823; p = 0.187). The Word-list x babbling interaction was significant (F = 4.664; p = 0.039; η2 = 0.135), revealing that the effect of babbling on OTs varied for ELC vs. LLC word-lists. We thus performed post hoc analyses as simple linear regression targeting the predictive power of babbling on OTs for either ELC or LLC word-lists, showing that babbling was a significant predictor of OTs for LLC word-lists (r2 = 0.135; p = 0.038) but not for ELC word-lists (r2 = 0.007; p = 0.649).
Again, as seen in Figure 2, infants with more advanced babbling looked more to the target-words for LLC word-lists.
Figure 2. Orientation times to early-learned consonants (ELC) and late-learned consonants (LLC) word–lists at 14 months.
As in Experiment 1, babbling abilities modulated orientation times for the LCC word-lists, with longer orientation times in more advanced babblers. Importantly, here, our stimuli fitted more accurately the precondition outlined by DePaolis et al. (2011) that “novel” consonants should be within reach of the participants’ articulatory abilities. Indeed, at the group level, 14-month-olds mastered ELCs, and participants with relatively more advanced babbling skills had begun producing LLCs, including fricatives. Thus, the results obtained in this experiment replicate and confirm the pattern observed at 11 months. Overall, this study extends the previously observed listening preference for non-mastered (yet producible) consonants in infants with more advanced babbling to familiar word-form recognition. Importantly, this effect is found in a procedure that does not require word-form encoding.
General discussion
Former investigations have shown differential processing of newly encoded word-forms as a function of production abilities in infancy (DePaolis et al., 2011; Majorano et al., 2014). Here, we presented infants with lists of known word-forms made up of Early-Learned consonants (ELCs, that is, plosive or nasal consonants) and lists of known words made up of Late-Learned consonants (LLCs, that is, fricatives or the lateral/l/), and measured their attention to these two types of lists according to their babbling skills. We show that similar effects of production abilities hold for the processing of real familiar word-forms learned from the daily environment prior to coming to the lab.
Specifically, at both 11 and 14 months of age, we found that attention to LLC consonants was modulated by babbling abilities. However, at 11 months of age (Experiment 1), the preconditions of our experimental design were not entirely fulfilled. Specifically, following previous literature, we wanted to contrast well-mastered consonants (ELCs, in our stimuli) with consonants that were not yet mastered, but were within reach in terms of articulatory abilities (LLCs). However, LLC production was very rarely reported in this group, and, in particular, fricative production was entirely absent. To explain the effect of babbling on perception found at that age based on previous literature (e.g., DePaolis et al., 2011), we needed to assume that the 11-month-olds tested were on the point to produce fricatives, thus that fricatives could be considered as consonants rarely produced but within reach for the participants’ articulatory abilities. However, this point remained speculative. To clarify this issue, we tested an older group of 14-month-olds (Experiment 2), for whom LLC production was more productive and varied, and included fricatives. Results replicated the findings of Experiment 1.
Overall, Experiment 1 and 2 parallel and extend the results of DePaolis et al. (2011) and Majorano et al. (2014) demonstrating that the perception/production effect is at play in word-form recognition when the encoding phase is excluded from the experimental procedure.
The encoding/recognition distinction given by our results is important, in that it shows that infants store speech-related sensorimotor information in long-term word-form representations, and access this knowledge during word-form processing. Specifically, not only do they use sensorimotor information during phonological encoding [as shown in seminal studies by DePaolis et al. (2011) and Majorano et al. (2014)], but they appear to also store sensorimotor information in long-term representations and access such information during recognition. Our results support views according to which, when frequent phonological chunks start to be retained in long-term memory, the (multisensory) phonological representation of such items include sensorimotor information extracted from experience with speech sound articulation (among which, the Articulatory Filter Hypothesis). Indeed, the perception/production effect found in this study was observed at 11 months, the youngest age at which untrained familiar word-form recognition has been reported (Vihman, 2022). This shows that sensorimotor knowledge of speech sounds is stored in word-form representations since their onset.
To sum up, distinguishing recognition from encoding, in this context, has theoretical relevance for the perception/production relationship. In fact, it allows to explore whether sensorimotor information modulating consonant processing is part of what is retained in linguistic representations (and, thus, retrieved during recognition) or is processed when learning a new item (during encoding) but not necessarily retained in long-term memory. By showing that sensorimotor information is used for familiar word-form recognition, the present study shows that sensorimotor information is part of word-form memory traces. This is relevant to previous work supporting multisensoriality in early lexical representations but not directly exploring the role of the sensorimotor component (Havy et al., 2017). Complementarily, future investigations might try to isolate further the effect of speech-related sensorimotor information on word-form encoding vs. recognition, in order to evaluate the relative contribution of sensorimotor information in the two processes. This might be done through neurofunctional procedures exploring, for example, the different ERP components elicited in word learning, in more vs. less-advanced producers and for words containing produced vs. non-produced consonants [e.g., by mixing procedures such as those in Mills et al. (2005), Friedrich and Friederici (2008), and Von Holzen et al. (2018)]. In this connection, some details regarding the difficulty to distinguish recognition from encoding with behavioral studies are also worth discussing. First, it is important to underline that the experimental distinction between word-form encoding and recognition can be graded in subjects who are in the process of developing a lexicon, for whom different word-forms can have stronger or weaker memory traces. The consequence for our looking-time study is that, while the recorded orientation times should always reflect recognition (as we verified phonological familiarity of the items presented), they might, in some cases and to some extent, also capture a form of refreshing of the encoding phase (depending on the degree of familiarity of specific stimuli for a specific infant). Relatedly, it should also be considered that encoding is a prerequisite to recognition, so that goodness of encoding can affect efficiency in recognition (the better the former, the better the latter). Overall, the experimental distinction between these two processes is not without challenge and future investigations are needed, contrasting, for example, the presentation of familiar and unfamiliar stimuli containing either early- or late-learned consonants.
Our study is also relevant to the results obtained by Majorano et al. (2019) and Laing and Bergelson (2020). The authors formerly addressed the impact of production practice on long-term word-form retention: Majorano et al. with a word-learning task; Laing and Bergelson analyzing the similarity between consonants produced in babbling and the name of the object on which infant’s attention was focused while babbling. Both studies suggested a perception/production relationship in word retrieval, but failed to report strong and consistent effects of the participants’ specific babbling patterns. Our results show consistent and specific perception/production links, starting from 11 months, for long-term representations at the word-form (phonological) level. This encourages further research clarifying the reasons why such production effects have less readily emerged in investigations where the level of meaning was also at play.
With this investigation, we extend the novelty effect previously found for newly encoded pseudowords (DePaolis et al., 2011; Majorano et al., 2014) to familiar word-form recognition. At both 11 and 14 months of age, infants with more advanced babbling oriented more to familiar word-forms embedding ‘novel’ consonants than infants with less advanced babbling. This pattern of preference establishes an effect of speech-related sensorimotor knowledge on long-term speech sound representations.
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics statement
The studies involving human participants were reviewed and approved by Conseil d’évaluation éthique pour les recherches en santé (CERES) Paris Descartes. Written informed consent to participate in this study was provided by the participants’ legal guardian/next of kin.
Author contributions
IL: experimental design, testing, analyses, and manuscript writing. TN: supervision of experimental design and manuscript writing. Both authors contributed to the article and approved the submitted version.
Funding
This study was funded by the project “Laboratoire d’Excellence—Empirical Foundations of Linguistics” (LabEx EFL ANR-10-LABX-0083, contributing to the IdEx Université de Paris–ANR-18-IDEX-0001) and funded by the French national program “Investissement d’Avenir” (mobility grant LabEx EFL, 6th call for applications). During data analysis, IL was the recipient of the Marie Skłodowska-Curie Fellowship INCODE (grant agreement no. 895484, Horizon 2020).
Acknowledgments
We thank all the infants and parents who participated in the experiment. We also thank Melanie Hoareau for valuable assistance on the creation of the stimuli.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
The handling editor CP declared a shared parent affiliation with the authors at the time of review.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
Altvater-Mackensen, N., and Fikkert, P. (2010). The acquisition of the stop-fricative contrast in perception and production. Lingua 120, 1898–1909. doi: 10.1016/j.lingua.2010.02.010
Altvater-Mackensen, N., Mani, N., and Grossmann, T. (2016). Audiovisual speech perception in infancy: The influence of vowel identity and infants’ productive abilities on sensitivity to (mis)matches between auditory and visual speech cues. Dev. Psychol. 52, 191–204. doi: 10.1037/a0039964
Altvater-Mackensen, N., van der Feest, S. V., and Fikkert, P. (2014). Asymmetries in early word recognition: The case of stops and fricatives. Lang. Learn. Dev. 10, 149–178. doi: 10.1080/15475441.2013.808954
Atkinson, R. C., and Shiffrin, R. M. (1968). “Human memory: A proposed system and its control processes,” in Psychology of learning and motivation, Vol. 2, ed. K. W. Spence (Cambridge, MA: Academic Press), 89–195.
Bruderer, A. G., Danielson, D. K., Kandhadai, P., and Werker, J. (2015). Sensorimotor influences on speech perception in infancy. PNAS 112, 13531–13536. doi: 10.1073/pnas.1508631112
Choi, D., Bruderer, A., and Werker, J. (2019). Sensorimotor influences on speech perception in pre-babbling infants: Replication and extension of Bruderer et al. (2015). Psychon. Bull. Rev. 26, 1388–1399. doi: 10.3758/s13423-019-01601-0
Choi, D., Dehaene-Lambertz, G., Peña, M., and Werker, J. F. (2021). Neural indicators of articulator-specific sensorimotor influences on infant speech perception. Proc. Natl. Acad. Sci. U.S.A. 118:e2025043118 doi: 10.1073/pnas.2025043118
De Boysson-Bardies, B., and Vihman, M. M. (1991). Adaptation to language: Evidence from babbling and first words in four languages. Language 67, 297–319. doi: 10.1353/lan.1991.0045
Del Giudice, M., Manera, V., and Keysers, C. (2009). Programmed to learn? The ontogeny of mirror neurons. Dev. Sci. 12, 350–363. doi: 10.1111/j.1467-7687.2008.00783.x
DePaolis, R. A., Keren-Portnoy, T., and Vihman, M. M. (2016). Making sense of infant familiarity and novelty responses to words at lexical onset. Front. Psychol. 7:715. doi: 10.3389/fpsyg.2016.00715
DePaolis, R. A., Vihman, M. M., and Keren-Portnoy, T. (2011). Do production patterns influence the processing of speech in prelinguistic infants? Infant Behav. Dev. 34, 590–601. doi: 10.1016/j.infbeh.2011.06.005
DePaolis, R. A., Vihman, M. M., and Nakai, S. (2013). The influence of babbling patterns on the processing of speech. Infant Behav. Dev. 36, 642–649. doi: 10.1016/j.infbeh.2013.06.007
Friedrich, M., and Friederici, A. D. (2008). Neurophysiological correlates of online word learning in 14-month-old infants. Neuroreport 19, 1757–1761. doi: 10.1097/WNR.0b013e328318f014
Gillund, G., and Shiffrin, R. M. (1984). A retrieval model for both recognition and recall. Psychol. Rev. 91:1.
Gonzalez-Gomez, N., and Nazzi, T. (2012). Acquisition of nonadjacent phonological dependencies in the native language during the first year of life. Infancy 17, 498–524. doi: 10.1111/j.1532-7078.2011.00104.x
Green, J. R., Moore, C. A., Higashikawa, M., and Steeve, R. W. (2000). The physiologic development of speech motor control: Lip and jaw coordination. J. Speech Lang. Hear. Res. 43, 239–255. doi: 10.1044/jslhr.4301.239
Guellaï, B., Streri, A., and Yeung, H. H. (2014). The development of sensorimotor influences in the audiovisual speech domain: Some critical questions. Front. Psychol. 5:812. doi: 10.3389/fpsyg.2014.00812
Hallé, P. A., and de Boysson-Bardies, B. (1996). The format of representation of recognized words in infants’ early receptive lexicon. Infant Behav. Dev. 19, 463–481. doi: 10.1016/S0163-6383(96)90007-7
Hallé, P., and de Boysson-Bardies, B. (1994). Emergence of an early lexicon: Infants’ recognition of words. Infant Behav. Dev. 17, 119–129. doi: 10.1016/0163-6383(94)90047-7
Havy, M., Foroud, A., Fais, L., and Werker, J. F. (2017). The role of auditory and visual speech in word learning at 18 months and in adulthood. Child Dev. 88, 2043–2059.
Hoareau, M., Yeung, H. H., and Nazzi, T. (2019). Infants’ statistical word segmentation in an artificial language is linked to both parental speech input and reported production abilities. Dev. Sci. 22:e1283. doi: 10.1111/desc.12803
Imada, T., Zhang, Y., Cheour, M., Taulu, S., Ahonen, A., and Kuhl, P. K. (2006). Infant speech perception activates Broca’s area: A developmental magnetoencephalography study. Neuroreport 17, 957–962. doi: 10.1097/01.wnr.0000223387.51704.89
Kemler Nelson, D. G., Jusczyk, P. W., Mandel, D. R., Myers, J., Turk, A., and Gerken, L. (1995). The head-turn preference procedure for testing auditory perception. Infant Behav. Dev. 18, 111–116. doi: 10.1016/0163-6383(95)90012-8
Kern, S. (2003). Le compte-rendu parental au service de l’évaluation de la production lexicale des enfants français entre 16 et 30 mois. Glossa 85, 48–61.
Keren-Portnoy, T., Vihman, M. M., DePaolis, R. A., Whitaker, C. J., and Williams, N. M. (2010). The role of vocal practice in constructing phonological working memory. J. Speech Lang. Hear. Res. 53, 1280–93. doi: 10.1044/1092-4388(2009/09-0003)
Laing, C., and Bergelson, E. (2020). From babble to words: Infants’ early productions match words and objects in their environment. Cogn. Psychol. 122:101308.
Levitt, A. G., and Utman, J. G. A. (1992). From babbling towards the sound systems of English and French: A longitudinal two-case study. J. Child Lang. 19, 19–49.
Majorano, M., Bastianello, T., Morelli, M., Lavelli, M., and Vihman, M. M. (2019). Vocal production and novel word learning in the first year. J. Child Lang. 46, 606–616 doi: 10.1017/S0305000918000521
Majorano, M., Vihman, M. M., and DePaolis, R. A. (2014). The relationship between infants’ production experience and their processing of speech. Lang. Learn. Dev. 10, 179–204. doi: 10.1080/15475441.2013.829740
Melton, A. W. (1963). Implications of short-term memory for a general theory of memory. J. Verbal Learn. Verbal Behav. 2, 1–21.
McLeod, S., and Crowe, K. (2018). Children’s consonant acquisition in 27 languages: A cross-linguistic review. Am. J. Speech Lang. Pathol. 27, 1546–1571. doi: 10.1044/2018_AJSLP-17-0100
Mills, D. L., Plunkett, K., Prat, C., and Schafer, G. (2005). Watching the infant brain learn words: Effects of vocabulary size and experience. Cogn. Dev. 20, 19–31. doi: 10.1016/j.cogdev.2004.07.001
New, B., and Spinelli, E. (2013). Diphones-fr: A French database of diphone positional frequency. Behav. Res. Methods 45, 758–764. doi: 10.3758/s13428-012-0285-y
New, B., Pallier, C., Brysbaert, M., and Ferrand, L. (2004). Lexique 2: A new French lexical database. Behav. Res. Methods Instrum. Comput. 36, 516–524. doi: 10.3758/BF03195598
Oller, D. K., Eilers, R. E., Neal, A. R., and Schwartz, H. K. (1999). Precursors to speech in infancy: The prediction of speech and language disorders. J. Commun. Disord. 32, 223–245. doi: 10.1016/S0021-9924(99)00013-1
Poltrock, S., and Nazzi, T. (2015). Consonant/vowel asymmetry in early word form recognition. J. Exp. Child Psychol. 131, 135–148. doi: 10.1016/j.jecp.2014.11.011
Ramsdell, H. L., Oller, D. K., Buder, E. H., Ethington, C. A., and Chorna, L. (2012). Identification of prelinguistic phonological categories. J. Speech Lang. Hear. Res. 55, 1626–1639. doi: 10.1044/1092-4388(2012/11-0250)
Stoel-Gammon, C. (1989). Prespeech and early speech development of two late talkers. First Lang. 9, 207–223. doi: 10.1177/014272378900900607
Streri, A., Coulon, M., Marie, J., and Yeung, H. H. (2016). Developmental change in infants’ detection of visual faces that match auditory vowels. Infancy 21, 177–198. doi: 10.1111/infa.12104
Swingley, D. (2005). 11-Month-olds’ knowledge of how familiar words sound. Dev. Sci. 8, 432–443. doi: 10.1111/j.1467-7687.2005.00432.x
Vihman, M. M. (1993). Variable paths to early word production. J. Phon. 21, 61–82. doi: 10.1016/S0095-4470(19)31321-X
Vihman, M. M. (2022). The developmental origins of phonological memory. Psychol. Rev. doi: 10.1037/rev0000354 [Epub ahead of print].
Vihman, M., and Majorano, M. (2017). The role of geminates in infants’ early word production and word-form recognition. J. Child Lang. 44, 158–184. doi: 10.1017/S0305000915000793
Vihman, M., DePaolis, R. A., and Keren-Portnoy, T. (2009). “A dynamic systems approach to babbling and words,” in The Cambridge Handbook of Child Language. Cambridge Handbooks in Linguisitics, ed. B. L. Edith (Cambridge: Cambridge University Press), 163–184. doi: 10.1017/CBO9780511576164.010
Vihman, M., Nakai, S., dePaolis, R., and Halleì, P. (2004). The role of accentual pattern in early lexical representation. J. Mem. Lang. 50, 336–353. doi: 10.1016/j.jml.2003.11.004
Vilain, A., Dole, M., Lśvenbruck, H., Pascalis, O., and Schwartz, J. L. (2019). The role of production abilities in the perception of consonant category in infants. Dev. Sci. 22:e12830. doi: 10.1111/desc.12830
Von Holzen, K., Nishibayashi, L. L., and Nazzi, T. (2018). Consonant and vowel processing in word form segmentation: An infant ERP study. Brain Sci. 8:24. doi: 10.3390/brainsci8020024
Werker, J. F., and Curtin, S. (2005). PRIMIR: A developmental framework of infant speech processing. Lang. Learn. Dev. 1, 197–234. doi: 10.1080/15475441.2005.9684216
Whitehurst, G. J., Smith, M., Fischel, J. E., Arnold, D. S., and Lonigan, C. J. (1991). The continuity of babble and speech in children with specific expressive language delay. J. Speech Lang. Hear. Res. 34, 1121–1129. doi: 10.1044/jshr.3405.1121
Keywords: early word-form recognition, early word-form processing, perception-production link, infant speech perception, infant speech production
Citation: Lorenzini I and Nazzi T (2022) Early recognition of familiar word-forms as a function of production skills. Front. Psychol. 13:947245. doi: 10.3389/fpsyg.2022.947245
Received: 18 May 2022; Accepted: 26 July 2022;
Published: 16 September 2022.
Edited by:
Chotiga Pattamadilok, Centre National de la Recherche Scientifique (CNRS), FranceReviewed by:
Marilyn May Vihman, University of York, United KingdomJanet F. Werker, University of British Columbia, Canada
Copyright © 2022 Lorenzini and Nazzi. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Irene Lorenzini, aXJlbmUubG9yZW56aW5pQHBhcmlzZGVzY2FydGVzLmZy