Skip to main content

ORIGINAL RESEARCH article

Front. Psychol., 28 January 2022
Sec. Educational Psychology
This article is part of the Research Topic Reading and Writing Skills: Cognitive, Emotional, Creative, and Digital Approaches View all 41 articles

Vocabulary Repetition Following Multisensory Instruction Is Ineffective on L2 Sentence Comprehension: Evidence From the N400

\r\nReza PishghadamReza Pishghadam1Haniyeh JajarmiHaniyeh Jajarmi2Shaghayegh Shayesteh*Shaghayegh Shayesteh1*Azin KhodaverdiAzin Khodaverdi1Hossein NassajiHossein Nassaji3
  • 1Department of English, Ferdowsi University of Mashhad, Mashhad, Iran
  • 2Department of English, Bahar Institute of Higher Education, Mashhad, Iran
  • 3Department of English, University of Victoria, Victoria, BC, Canada

Putting the principles of multisensory teaching into practice, this study investigated the effect of audio-visual vocabulary repetition on L2 sentence comprehension. Forty participants were randomly assigned to experimental and control groups. A sensory-based model of instruction (i.e., emotioncy) was used to teach a list of unfamiliar vocabularies to the two groups. Following the instruction, the experimental group repeated the instructed words twice, while the control group received no vocabulary repetition. Afterward, their electrophysiological neural activities were recorded through electroencephalography while doing a sentence acceptability judgment task with 216 sentences under acceptable (correct) and unacceptable (pragmatically violated) conditions. A one-way analysis of variance (ANOVA), a multivariate analysis of variance (MANOVA), and a Bayesian repeated-measures ANOVA were used to compare the behavioral and neurocognitive responses [N400 as the main language-related event-related brain potential (ERP) effect] of the two groups. The results showed no significant N400 amplitude difference in favor of any of the groups. The findings corroborated the ineffectiveness of two repetitions preceded by multisensory instruction on L2 sentence comprehension.

Introduction

Comprehension in general and sentence comprehension, in particular, have been the pinnacle of many cognitive studies on L2 (e.g., Newman et al., 2012; Zheng and Lemhöfer, 2019). In such studies, sentence processing has been examined from multiple perspectives, including syntactic (Embick et al., 2000) and semantic (Dapretto and Bookheimer, 1999; Bookheimer, 2002). The semantic processing of a sentence relies, to a large extent, on the processing of individual words of that sentence. Therefore, vocabulary retention plays a significant role, hastening or hindering this process.

To improve vocabulary learning and retention, different strategies have been employed. As for one, central to vocabulary learning as a gradual process is the concept of repetition (Nation, 2015). Repetition is known to be mechanical or meaningful depending on the teaching methodology applied by teachers. Along with the changes in language teaching methodology from audio-lingual classroom drills grounded in the theory of behaviorism to communicative approaches, vocabulary repetition was constantly shaped and reshaped. Meaningful repetition practices took priority over simple mechanical ones to make learning more enduring (Horst, 2013; Kartchava and Nassaji, 2019; Hidalgo and Garcia Mayo, 2021).

Although researchers jointly agree that learning depends on the degree of any type of repetition with more repetitions leading to the better learning of the points (e.g., Thalheimer, 2003; Chen and Truscott, 2010; Laufer and Rozovski-Roitblat, 2011), there has been considerable debate over the optimal number of repetitions that ensures vocabulary learning and boosts comprehension (Peters, 2014; Nation, 2015; Liu, 2018). While Horst et al. (1998); Waring and Takaki (2003), and Webb (2007) respectively found 8, 10, and 12 repetitions as the optimal number, Vidal (2011) minimized the frequency to two and three meaningful repetitions in a reading context.

To capture the repetition effect, different approaches have been adopted. Unlike conventional approaches, which basically target learners’ performance and achievement, most recent studies have endeavored to employ neurocognitive tasks to get more reliable results. By virtue of this objective inspection, a few studies documented that repetition may have no effect (e.g., Amir Kassim et al., 2018) or even a negative effect (e.g., Peterson and Mulligan, 2012; Mulligan and Peterson, 2013) on human memory. As for one, Amir Kassim et al. (2018) deduced that, unlike visual and a combination of auditory and visual repetitions, two auditory repetitions have no effect on the participants’ recognition memory. Not only that, Peterson and Mulligan (2012) reported a negative repetition effect for the participants who went through a list of cue-target pairs twice compared to those who studied the pairs once only.

To further substantiate the findings, neurolinguists set out to record and examine the brain activity of the learners through electroencephalography (EEG) and event-related brain potential (ERP) techniques, evidencing that the human brain responds emphatically to any type of repetition (Van Strien et al., 2007). A review of the related literature reveals that such neurophysiological studies have mainly investigated the word repetition effect on the basis of pertinent ERP component modulations during the process of repetition (Henson, 2003; Maccotta and Buckner, 2004; Van Strien et al., 2007). Yet, the missing chain in the literature is how these word repetitions affect the overall comprehension of the learners.

To delve into the electrophysiological underpinning of sentence comprehension, researchers (e.g., Hagoort et al., 2004; Hald et al., 2006; Kos et al., 2012) have designed different sentence acceptability judgment tasks with semantically violated (sentences with the word knowledge violation, e.g., a caper is kind.) and pragmatically violated sentences (sentences with the world knowledge violation, e.g., a caper is sweet.). According to their findings, the neurocognitive mechanism of sentence comprehension manifests itself in a series of ERP components, with N400 as the most general component, providing insights into the neurobiology of meaning. The N400 effect, with its peak around 400 ms following the stimulus, is sensitive to semantic modifications (Xu et al., 2015; Payne et al., 2019). The amplitude of this negative-going deflection is basically defined by the degree of congruence between a word and its sentential context and the load of cognitive endeavor required to access the semantic memory (Kutas and Federmeier, 2000). The component is similarly influenced by other variables such as verbal working memory (e.g., Brown and Hagoort, 1999), word frequency (Dambacher et al., 2006), presentation modality (Kutas and Federmeier, 2011), and word priming (McRae et al., 2005). These amplitude changes may bring about different degrees of comprehension.

For improved comprehension, which is closely linked to vocabulary retention, not only vocabulary repetition practices but the nature of instruction may serve a pivotal role. It is commonly believed that a rudimentary path to deep processing and enhanced learning is the involvement of the senses. Underpinning the importance of senses in learning a language (Massaro, 2004), sensory teaching, pioneered by Montessori (1912), has been used by educators and teachers believing that senses, either in isolation or in different combinations, give way to inclusive learning, which engages all the learners with different needs (Hockings, 2010; Katai, 2011). Brain research findings have similarly corroborated the effect of multisensory instruction (MSI) on brain performance, particularly sentence comprehension, which is improved by the involvement of more sensory information channels and neural structures as a result of the interaction of more senses (Shams and Seitz, 2008; Pishghadam et al., 2020, 2021; Shayesteh et al., 2020).

What we hypothesize in this study is that, given the effectiveness of MSI in engendering in-depth learning (Baines, 2008), vocabulary repetition is likely to be redundant for sentence comprehension. To verify that, we used a validated sensory-based model of instruction, coined as emotioncy (a blend of emotion + frequency), and combined the five senses of auditory, visual, tactile, olfactory, and gustatory (see Pishghadam et al., 2017, 2020, 2021; Karami et al., 2019; Makiabadi et al., 2019; Shayesteh et al., 2020; Boustani et al., 2021). The model (Figure 1) presents us with two major combinations of the senses, namely exvolvement (i.e., a combination of auditory, visual, and tactile/kinesthetic) and involvement (i.e., a combination of auditory, visual, and tactile/kinesthetic, olfactory, and gustatory).

FIGURE 1
www.frontiersin.org

Figure 1. Emotioncy levels [reprinted with permission from “Emotioncy, extraversion, and anxiety in willingness to communicate in English,” by Pishghadam (2016), Proceedings of the 5th International Conference on Language, Education, and Innovation. London, United Kingdom].

To decide upon the number of vocabulary repetitions following our MSI, we drew upon the findings of a recent, relevant study conducted by Jajarmi et al. (2020). They adopted a bisensory (auditory + visual) approach according to the emotioncy model and taught a list of unknown English vocabulary items to a group of language learners. They used different numbers of repetitions to eventually come up with the minimum number of effective repetitions. Quite in line with Hintzman (1970), Nelson (1977), and Phaf (2012), using paper and pencil tests, Jajarmi et al. (2020) reported two repetitions as the threshold for making significant changes in vocabulary learning and that, one, three, four, and five repetitions make no further contribution to vocabulary learning as a result of bisensory instruction.

For the purpose of this study, and to examine if sentence comprehension is influenced by two vocabulary repetitions (as the minimum number of effective repetitions) following the MSI, we selected six vocabulary items of which the learners had no previous knowledge. We taught the words to a control group and an experimental group of participants. The control group received the MSI only, whereas the experimental group had the MSI followed by two audio-visual repetitions of the vocabulary items (see section “The Instruction” for details on the procedure). Thereafter, we compared the immediate behavioral and cognitive performance of the two groups, on a sentence acceptability judgment task (with correct and pragmatically violated sentences), for any probable neural response differences associated with sentence comprehension. In order to evaluate the differences, the ERP technique was employed. Based on the previous studies acknowledging the efficiency of using multiple senses in the process of learning and comprehension, and the ERP studies recognizing the N400 as an indicator of semantic access difficulty, we predicated that two vocabulary repetitions following the MSI may not reduce the N400 amplitude and facilitate semantic access during sentence comprehension. Therefore, we expect to observe no N400 amplitude difference between the control and experimental groups, concluding that MSI is a working theory that is not influenced by two vocabulary repetitions.

Materials and Methods

Participants

Forty-five (33 female and 12 male) native speakers of Persian, with English as their foreign language, volunteered to take our pretests, 3 of whom were not recruited to participate in the ERP experiment due to their pretest results. Moreover, the data for two of the participants were discarded because of excessive eye movement and muscle artifact. The participants’ age ranged from 18 to 30 years (M = 21.7, SD = 2.6). They were all right-handed (Oldfield, 1971), neurologically healthy, and had normal or corrected-to-normal vision. All of them were at the intermediate level of language proficiency, and their working memory score ranged from 10 to 12 (M = 11.3, SD = 1.3) (Wechsler, 1981). They neither had participated in the pilot tests nor had any knowledge of the six selected vocabulary items they were supposed to learn. For the purpose of this study, the participants were randomly assigned to a control group (G1, N = 20) and an experimental group (G2, N = 20). The participants gave written informed consent under a protocol approved by the Ferdowsi University of Mashhad Ethics Committee before the experiment and took part in the research according to their willingness to participate. They received either course credits or gifts for their participation.

Materials

Pretest Materials

The Emotioncy Scale

In order to make sure that the participants had no knowledge of the selected items for the experiment, an emotioncy scale was used (Borsipour, 2016). Each item measured the participants’ familiarity with the target words through a 6-point Likert scale with (1) not familiar; (2) heard; (3) heard and seen; (4) heard, seen, and touched; (5) heard, seen, touched, and used; and (6) heard, seen, touched, used, and done research on. The participants who had prior experiences with any of the six words were excluded in this phase.

The Oxford Quick Placement Test

The Oxford Quick Placement Test (OQPT) (Allan, 1992) was administered to measure the participants’ English proficiency level. This test has two parts, each containing 40 and 20 items, respectively. The items are in multiple-choice and cloze test formats, and the time to respond to the questions is 30 min. In this test, the obtained scores of 30–40 represent intermediate proficiency level in English.

The Digit Span Subtest of the Wechsler Adult Intelligence Scale III

Since working memory and specifically the phonological loop plays a substantial role in vocabulary learning and vocabulary retention (Gillam, 2002), we used the digit span subtest of the Wechsler Adult Intelligence Scale III (WAIS-III) (Wechsler, 1981) as a measure of homogeneity. Given that based on the results, the mean span for those who took the test was 11 with a standard deviation of 1, we selected those participants within the limited range of 10–12.

The Edinburgh Inventory of Handedness

The Edinburgh inventory of handedness (Oldfield, 1971), as a measure of hand laterality, was used to select right-handed individuals. The inventory includes 10 questions about writing, drawing, throwing, using scissors, using a toothbrush, using a knife (without a fork), using a spoon, using a broom (upper hand), striking a match, and opening a box, along with two supplementary questions: “which foot do you prefer to kick with?” and “which eye do you use when using only one?” According to the scale, the participants who did more than two of the mentioned activities with their left hand were excluded from the study.

Stimulus Materials (Vocabulary Items)

In order to choose the six vocabulary items, a list of 48 words (along with their Persian translation) which were the names of some edible things, including fruits, plants, and vegetables, was culled and put into the emotioncy scale (Borsipour, 2016). It should be mentioned that the translations of the words were not cognates in the L1 of the participants. Then the scale was randomly administered to 150 respondents (87 females and 63 males), who were different from the main participants of the study. Finally, six words of which 95% of the respondents had no prior knowledge, were selected for the MSI. The words were caper, longan, sorrel, salak, rambutan, and quinoa (Figure 2).

FIGURE 2
www.frontiersin.org

Figure 2. The six selected vocabulary items. Images reproduced with permission from www.pinterest.com.

Procedure

The Sentence Acceptability Judgment Task

A sentence acceptability judgment task was constructed according to a framework presented by Hagoort et al. (2004), Hald et al. (2006), and Kos et al. (2012), using Psychophysics Toolbox Version 3 (PTB-3) for MATLAB (version 2015a, The MathWorks, MA, United States). The task required the participants to judge the acceptability of the sentences they saw word by word on the screen. The six instructed vocabulary items were embedded in a number of 144 sentences (72 sentence pairs with 3–8 words each). Each pair comprised acceptable and unacceptable conditions of a sentence: a non-violated correct sentence (Co) and a sentence with pragmatic violation (Pr). In order to avoid conditioning, 72 unrelated sentences of similar length, complexity, and structure (36 correct and 36 pragmatically violated), including the names of animals, fruits, and objects, were added as fillers, making 216 sentences in total (Table 1). Each sentence pair was identical except for one word only (i.e., the critical word), which appeared at the sentence-final position. The critical words were matched across the two conditions in terms of average length in characters, word class, bigram frequency, and cloze probability (checked by two native speakers).

TABLE 1
www.frontiersin.org

Table 1. Example Sentences of the two different conditions in the sentence pairs in addition to the filler sentences.

The task consisted of three 10-min experimental blocks separated by two short breaks. In each block, each sentence was presented word by word in the center of the computer screen (Figure 3). The words were boldfaced in black lower case Times New Roman letters with 58-point font size against a light gray background. The first word of each sentence was capitalized, and the final word of each sentence was presented with a period. The viewing distance was about 100 cm for each participant. Each experimental block started with a 600 ms baseline before the stimulus onset. Each word was presented for 750–850 ms (randomly varied to avoid the predictability of the response time (RT) for participants in terms of their reaction times) followed by a blank screen for 300 ms as an inter-stimulus interval (before the appearance of the next word). After the final word, there was a blank screen for 2800 ms in which the participants were supposed to decide on the truthfulness of the sentences by pressing a key. They were asked to press the right arrow key on the computer keyboard if the sentence was correct, the down arrow key if the sentence was pragmatically wrong, and press no key if they did not know the response. After the response window, an eye image was displayed in the center of the screen for 3000 ms, allowing the participants to move their eyes and blink intentionally to prevent eye fatigue. There was a 300-ms blank page between the eye disappearance and the start of the next trial.

FIGURE 3
www.frontiersin.org

Figure 3. Screen simulations and temporal sequence of an experimental block of the sentence acceptability judgment task.

The Instruction

The data collection was split into pre-experimental (i.e., instruction) and experimental (i.e., ERP recording) phases. During the pre-experimental phase, each participant learned the six vocabulary items through the MSI. For the purpose of the instruction, along with the real fruits and vegetables, a PowerPoint presentation, which contained the name and some different pictures of the items, and a photo booklet were used to make it similar to a classroom environment. The participants received sensory instruction through inner emotioncy, which is the integration of auditory, visual, kinesthetic, smell, and taste, for the six words. The same amount of time was allocated to the instruction of each word. The whole instruction took approximately 20 min. Table 2 presents a sample instruction of one of the words and the information transferred to the participants.

TABLE 2
www.frontiersin.org

Table 2. A sample instruction for an involved word (using a combination of auditory, visual, and tactile/kinesthetic, olfactory, and gustatory senses).

After the instruction, the participants of G1 directly went for the ERP recording, yet the participants of G2 received two audio-visual repetitions for each word. For the first repetition, the participants of G2 were asked to look at the real objects on the desk and repeat the names after the instructor when the instruction was almost over. For the second repetition, they went through the same procedure (i.e., repetition) 15 min later when they had the EEG cap on. There was a time interval of 15 min between the second repetition and the ERP experiment, during which the participants went through a practice block of the task (see section “Electroencephalography Recording”) and got ready for the recording. According to Cepeda et al. (2006), the lag between the repetitions and the retention interval need to approximately match for optimal memory performance.

Electroencephalography Recording

The participants were tested individually in a sound-attenuated and dimly illuminated room. Prior to the main experiment, they went through a practice block of 20 items to get acquainted with the task requirements.

The EEG was recorded from 23 active Ag/AgCl-sintered electrodes mounted on an elastic electrode cap (g.GAMMAcap from g.tec medical engineering GmbH). The electrodes were placed according to the 10–20 international system of the American Electroencephalographic Society over midline sites at Fz, FCz, Cz, Pz, and Oz; frontal sites at AF3, AF4, F3, F4, F7, and F8; fronto-central sites at FC3 and FC4; fronto-temporal sites at FT7 and FT8; central sites at C3 and C4; parietal sites at P3, P4, P7, and P8; and occipital sites at PO7 and PO8. The optimal electrode arrangement was determined according to similar studies in the field (e.g., Salmon and Pratt, 2002; Hagoort et al., 2004; Van Berkum et al., 2005; Hald et al., 2006). All electrodes were referenced to the left mastoid and re-referenced to the average of the left and right mastoids. Vertical and horizontal eye movements were monitored via three additional electrodes placed above and below the left eye and on the left outer canthus. Electrode impedances were kept below 5 kΩ. The EEG and EOG signals were digitized online with a sampling frequency of 250 Hz and were amplified using the 32-channel wireless g.Nautilus EEG system (gtec, Austria), with a bandpass filter between 0.1 and 70 Hz and a notch filter of 50 Hz.

Data Analysis

All recorded EEG signal data were imported into MATLAB (MathWorks, 2015b). To analyze the waveforms, MATLAB along with the EEGLAB (an extension of MATLAB software) were used. The EEG data were bandpass filtered between 0.5 and 60 Hz. Afterward, the data were re-referenced to the mean of the linked mastoids. Poor EEG channels were replaced with their interpolated version applied to the remaining channels. No more than 2 channels were interpolated for each participant, with the majority of the interpolated channels positioned at parieto-occipital and occipital sites. High amplitude eye blinks and muscle artifacts were then removed using the Artifact Subspace Reconstruction (ASR) algorithm from the EEGLAB. The remaining high frequencies were eliminated using a low pass filter with a cut-off frequency of 25 Hz. Next, epochs from −200 to 1100 ms, with respect to the onset of the critical word, were segmented to a 200 ms pre-onset baseline. A linear detrend algorithm (using the 200 ms before the stimulus onset to 3 s after) was applied to the epoched data to further remove drifts. Noisy epochs with potentials exceeding ±70 μv were rejected. Finally, all remaining trials (see Table 3 for the descriptive statistics) were averaged.

TABLE 3
www.frontiersin.org

Table 3. Descriptive statistics for the number of averaged epochs.

For the critical words of the sentences, N400 was analyzed. Based on the findings of the previous literature (e.g., Danko et al., 2014; Yang et al., 2014; Molinaro et al., 2016; Volz et al., 2019), the N400 component was quantified as the mean amplitude in a latency window of 300–550 ms after the onset of the critical word and relative to a 200 ms baseline.

For the behavioral data analysis, a one-way between-groups analysis of variance (ANOVA) was performed to examine the main effect of repetition on the participants’ acceptability judgment of the correct and pragmatically violated sentences. For the ERP data analysis, as to the main effect of repetition, a multivariate analysis of variance (MANOVA) along with a Bayesian Repeated Measures ANOVA were run to test for the null hypothesis. All the statistical procedures were computed using an alpha level of 0.05, and to reduce the chance of a Type 1 error, Bonferroni adjustment was applied.

Results

Behavioral Results

Descriptive statistics of response accuracy (RA) scores and RTs for G1 and G2 are given in Table 4.

TABLE 4
www.frontiersin.org

Table 4. Descriptive statistics of response accuracy scores and response times for G1and G2.

A one-way between-groups ANOVA was performed to examine the main effect of repetition on the participants’ acceptability judgment of the correct and pragmatically violated sentences. The results of Levene’s test for homogeneity of variances showed that the assumption of homogeneity of variance was not violated (p > 0.05). The difference between the two groups did not reach significance regarding the main effect of repetition on RA in terms of both correct [F(1,38) = 0.21, p = 0.92, ηp2=0.14] and pragmatically violated [F(1,38) = 0.32, p = 0.58, ηp2=0.18] conditions.

Similarly, the results of RTs failed to show a significant difference between G1 and G2 in the amount of time it took them to judge the truthfulness of the sentences in terms of either of the conditions, that is, correct [F(1,38) = 0.33, p = 0.97, ηp2=0.21] and pragmatically violated [F(1,38) = 0.19, p = 0.89, ηp2=0.19].

Event-Related Brain Potential Results

At the next step, we analyzed the participants’ brain activity, recorded during the task, to find out whether they were in line with the behavioral results. Figure 4 shows grand-average ERPs time-locked to the onset of the critical word for the correct and pragmatically violated conditions in G1 and G2 at F3, F4, P3, P4, and Cz as sample electrode sites from the 23 inspected locations on the scalp. The grand-average waveforms for G1 and G2 showed different neural correlates of sentence processing, including a broadly distributed negative-going deflection (representing the N400) starting at about 300 ms after the onset of the critical word peaking at 400 ms. To find the location of the maximum N400 amplitude, we grouped the 23 electrodes into three regions of interest (ROIs): anterior (AF3/4, F3/4, F7/8, FT7/8, Fz), central (FC3/4, FCz, C3/4, Cz), and posterior (P3/4, P7/8, Pz, PO7/8, Oz). The F test result [F(2,78) = 17.02, p = 0.000; ηp2=0.30] revealed that the negativity in the anterior areas (M = 1.73 μv) was significantly larger than that of the central (M = 2.98 μv) and posterior regions (M = 3.97 μv).

FIGURE 4
www.frontiersin.org

Figure 4. (A) Grand-average (N = 20 per group) ERPs time-locked to the onset of the critical word for the correct (Cor) and pragmatically violated (Prag) conditions in G1 and G2 at F3/4, P3/4, and Cz as sample locations. (B) The topographic maps show the distribution of the N400 for both groups regarding both conditions. (C) The bar plots show no significant difference between the two groups with regard to correct (pink) and pragmatically violated sentences (blue).

Consequently, the two groups were compared on the N400 effect at the 23 electrodes. To this end, a one-way between-groups MANOVA was run to investigate group differences in the N400 mean amplitude in terms of the two linguistic conditions (i.e., correct and pragmatically violated). Preliminary assumption testing noted no violations of normality and homogeneity of variance-covariance matrices (p > 0.05). The multivariate effect of group regarding the N400 mean amplitudes signaled no significant effect for repetition in terms of the groups [F(8, 31) = 0.39, p = 0.97; Wilks’ Lambda = 0.40; ηp2=0.60].

To ensure the lack of difference between the mean amplitudes, the Bayesian Repeated Measures ANOVA [factors: electrode (23), condition (2); between-subject factor: group (G1 & G2)] was used. As Tables 5, 6 show, Bayesian analyses support the null hypothesis, indicating no main or interaction effect of the group (i.e., repetition).

TABLE 5
www.frontiersin.org

Table 5. Bayesian repeated measures model comparison for the N400.

TABLE 6
www.frontiersin.org

Table 6. Analysis of effects.

Discussion

Different studies reinforce that sentence comprehension is influenced by various factors, including MSI (Pishghadam et al., 2020, 2021; Shayesteh et al., 2020; Boustani et al., 2021). Given that this type of instruction is believed to activate several regions of the brain, it is considered one of the most effective ways of teaching. In order to explore if this whole-brain instruction technique may further improve learners’ L2 sentence comprehension, if it is followed by two vocabulary repetitions, we adopted a neurocognitive approach and used the ERP method.

The overall behavioral (RA & RT) and electrophysiological findings of the study supported our preliminary hypothesis that, unlike Jajarmi et al.’s (2020) findings, two repetitions may not actually boost the L2 vocabulary knowledge obtained through the MSI. To teach L2 vocabulary items to adults mainly, teachers generally adopt a unisensory approach (audition only), representing what Shayesteh et al. (2019) refer to as thin education, or integrate auditory and visual senses (bisensory instruction) and disregard senses of touch, taste, and smell due to limited time and instructional facilities. The influence of vocabulary repetition for this type of learning may not probably be analogous to the one following the MSI. Thus, confirming Nation’s (2001, p. 115) proposition that “the nature of the original learning” determines later retrieval, we suggest that the nature of instruction and learning modulates, to a considerable extent, the effect of subsequent instructional practices – like vocabulary repetition – employed to deepen student learning. Consequently, unlike the studies reporting that learning requires multiple repetitions (e.g., Webb, 2007), we put forward that the (two)repetition effect following multisensory instructional practices seems to be ineffective on L2 sentence comprehension. The justification may probably have its roots in the neurophysiological mechanism underlying the process of learning through multiple senses. The knowledge of words builds up through sensory experiences. That is, different kinds of input that enter the brain through different modalities cumulate and form a comprehensive whole (Shams and Seitz, 2008; Katai, 2011). Throughout this process, greater sensory information gateways and neural networks are activated, and more extended areas of the brain (including sensory-specific and multisensory convergence zones) are engaged (Driver and Noesselt, 2008; Goswami, 2008). Repetition, on the other hand, reinforces the neural connections across the synapses, strengthening the link between form and meaning (Gathercole and Baddeley, 1990), and adds to the quality of knowledge (Nation, 2001), which, in fact, facilitates later retrieval and comprehension. However, given that activating a small proportion of neurons in large scale networks may not affect the network output (Parker, 2010), we assume that the effect of two repetitions, with a short delay period, is so subtle that it does not modify the extensive network of neurons activated through the multiple senses approach.

Holding the view that senses may have a profound impact on vocabulary learning and sentence comprehension, we intend to suggest that, rather than challenging the irrefutable role of repetition as a step forward in language learning, the substantial role of senses in this process needs to be underlined, more than the past, by incorporating sensory-based models, such as emotioncy (Pishghadam et al., 2017; Karami et al., 2019; Makiabadi et al., 2019), into the regular curriculum. Such models lead the old multisensory movement toward entering a new phase which may open up new vistas for teachers and educators. Despite the time-consuming nature of multisensory education, it is strongly recommended that teachers make use of senses in their teaching practices, believing that the considerable merits compensate for the extra efforts exerted by teachers. Another pedagogical implication of the current study could be that two vocabulary repetitions seem redundant after multisensory learning, as opposed to bisensory learning (Jajarmi et al., 2020), since we witnessed no significant change between the cognitive reactions of the two groups. However, raising the number of repetitions may perhaps produce very different results. Therefore, repetition should not be entirely overlooked; instead, it should be more carefully probed and applied.

In the end, there are a few points that need to be taken into careful consideration in future endeavors. First and foremost is that, in addition to the effect of repetition happening in close temporal succession, the effect of spaced repetition with increasingly larger intervals on multisensory vocabulary learning should be meticulously verified since it is believed to produce improved long-term results (Rawson and Kintsch, 2005). Therefore, spacing of the repetitions may allow for probable differences in later performance, generating different results. Moreover, given that the task we used in this study checked the participants’ receptive vocabulary knowledge only, further research is required to investigate the effect of two repetitions on productive vocabulary knowledge as well. Last but not least, as a complementary action, future studies need to compare the cognitive processes underlying repetition after bisensory and MSI. It is needless to say that increasing the sample size may lead to more reliable conclusions.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics Statement

The studies involving human participants were reviewed and approved by the Ferdowsi University of Mashhad Ethics Committee. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

RP conceived and designed the experiments. HJ, SS, and AK performed the experiments. HJ and AK analyzed the data. RP, HJ, SS, and AK contributed to reagents, materials, and analysis tools. HJ, SS, and HN wrote the manuscript. RP and HN reviewed and edited the manuscript. All authors contributed to the article and approved the submitted version.

Funding

This work was supported by the Iran’s National Elites Foundation (INEF), the Cognition and Sensory Emotion Lab, Ferdowsi University of Mashhad, and a grant-in-aid of research from the Cognitive Sciences and Technologies Council (CSTC) in 2016 (Code 4251).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

Allan, D. (1992). The Oxford Quick Placement Test. Oxford: Oxford University Press.

Google Scholar

Amir Kassim, A., Rehman, R., and Price, J. M. (2018). Effects of modality and repetition in a continuous recognition memory task: repetition has no effect on auditory recognition memory. Acta Psychol. 185, 72–80. doi: 10.1016/j.actpsy.2018.01.012

CrossRef Full Text | Google Scholar

Baines, L. (2008). A Teacher’s Guide to Multisensory Learning: Improving Literacy by Engaging the Senses. Alexandria, VA: Association for Supervision and Curriculum Development.

Google Scholar

Bookheimer, S. (2002). Functional MRI of language: new approaches to understanding the cortical organization of semantic processing. Annu. Rev. Neurosci. 25, 151–188.

Google Scholar

Borsipour, B. (2016). Emotioncy and Willingness to Read: A Case of Iranian EFL Learners. Ph.D. thesis. Mashhad: Ferdowsi University of Mashhad.

Google Scholar

Boustani, N., Pishghadam, R., and Shayesteh, S. (2021). Multisensory input modulates P200 and L2 sentence comprehension: a one-week consolidation phase. Front. Psychol. 12:746813. doi: 10.3389/fpsyg.2021.746813

CrossRef Full Text | Google Scholar

Brown, C. M., and Hagoort, P. (eds) (1999). The Neurocognition of Language. Oxford: Oxford University Press.

Google Scholar

Cepeda, N. J., Pashler, H., Vul, E., Wixted, J. T., and Rohrer, D. (2006). Distributed practice in verbal recall tasks: a review and quantitative synthesis. Psychol. Bull. 132, 354–380. doi: 10.1037/0033-2909.132.3.354

PubMed Abstract | CrossRef Full Text | Google Scholar

Chen, C., and Truscott, J. (2010). The effects of repetition and L1 lexicalization on incidental vocabulary acquisition. Appl. Linguist. 31, 693–713. doi: 10.1093/applin/amq031

CrossRef Full Text | Google Scholar

Dambacher, M., Kliegl, R., Hofmann, M., and Jacobs, A. M. (2006). Frequency and predictability effects on event-related potentials during reading. Brain Res. 1084, 89–103. doi: 10.1016/j.brainres.2006.02.010

CrossRef Full Text | Google Scholar

Danko, S. G., Boytsova, J. A., Solovjeva, M. L., Chernigovskaya, T. V., and Medvedev, S. V. (2014). Event-related brain potentials when conjugating Russian verbs: the modularity of language procedures. Hum. Physiol. 40, 237–243. doi: 10.1134/s0362119714030050

CrossRef Full Text | Google Scholar

Dapretto, M., and Bookheimer, S. Y. (1999). Form and content: dissociating syntax and semantics in sentence comprehension. Neuron 24, 427–432. doi: 10.1016/s0896-6273(00)80855-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Driver, J., and Noesselt, T. (2008). Multisensory interplay reveals crossmodal influences on ‘sensory-specific’ brain regions, neural responses, and judgments. Neuron 57, 11–23. doi: 10.1016/j.neuron.2007.12.013

PubMed Abstract | CrossRef Full Text | Google Scholar

Embick, D., Marantz, A., Miyashita, Y., O’Neill, W., and Sakai, K. L. (2000). A syntactic specialization for Broca’s area. Proc. Natl. Acad. Sci. U.S.A. 97, 6150–6154. doi: 10.1073/pnas.100098897

PubMed Abstract | CrossRef Full Text | Google Scholar

Gathercole, S. E., and Baddeley, A. D. (1990). The role of phonological memory in vocabulary acquisition: a study of young children learning new names. Br. J. Psychol. 81, 439–454. doi: 10.1111/j.2044-8295.1990.tb02371.x

CrossRef Full Text | Google Scholar

Gillam, R. B. (2002). The role of working memory in vocabulary development. Perspect. Lang. Learn. Educ. 9, 7–11.

Google Scholar

Goswami, U. (2008). Principles of learning, implications for teaching: a cognitive neuroscience perspective. J. Philos. Educ. 42, 381–399. doi: 10.1111/j.1467-9752.2008.00639.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Hagoort, P., Hald, L., Bastiaansen, M., and Petersson, K. M. (2004). Integration of word meaning and world knowledge in language comprehension. Science 304, 438–441.

Google Scholar

Hald, L. A., Bastiaansen, M. C., and Hagoort, P. (2006). EEG theta and gamma responses to semantic violations in online sentence processing. Brain Lang. 96, 90–105. doi: 10.1016/j.bandl.2005.06.007

PubMed Abstract | CrossRef Full Text | Google Scholar

Henson, R. N. A. (2003). Neuroimaging studies of priming. Prog. Neurobiol. 70, 53–81. doi: 10.1016/s0301-0082(03)00086-8

CrossRef Full Text | Google Scholar

Hidalgo, M. A., and Garcia Mayo, M. P. (2021). The influence of task repetition type on young EFL learners’ attention to form. Lang. Teach. Res. 25, 565–586. doi: 10.1177/1362168819865559

CrossRef Full Text | Google Scholar

Hintzman, D. L. (1970). Effects of repetition and exposure duration on memory. J. Exp. Psychol. 83, 435–444. doi: 10.1037/h0028865

CrossRef Full Text | Google Scholar

Hockings, C. (2010). Inclusive Learning and Teaching in Higher Education: A Synthesis of Research. New York, NY: Higher Education Academy.

Google Scholar

Horst, J. S. (2013). Context and repetition in word learning. Front. Psychol. 4:149. doi: 10.3389/fpsyg.2013.00149

CrossRef Full Text | Google Scholar

Horst, M., Cobb, T., and Meara, P. (1998). Beyond a clock orange: acquiring second language vocabulary through reading. Read. Foreign Lang. 11, 207–223.

Google Scholar

Jajarmi, H., Pishghadam, R., and Moghimi, S. (2020). Barrasi tedade moasere tekrare vaje dar yadgiriye vajegane zabane englisi be onvane zabane khareji [Investigating the effective number of word repetitions on learning the vocabulary of English as a foreign language]. Lang. Transl. Stud. 54, 1–26.

Google Scholar

Karami, M., Pishghadam, R., and Baghaei, P. (2019). A probe into EFL learners’ emotioncy as a source of test bias: insights from differential item functioning analysis. Stud. Educ. Eval. 60, 170–178. doi: 10.1016/j.stueduc.2019.01.003

CrossRef Full Text | Google Scholar

Kartchava, E., and Nassaji, H. (2019). The role of task repetition and learner self-assessment in technology-mediated task performance. Int. J. Appl. Linguist. 170, 180–203. doi: 10.1075/itl.19013.kar

CrossRef Full Text | Google Scholar

Katai, Z. (2011). Multi-sensory method for teaching-learning recursion. Comput. Appl. Eng. Educ. 19, 234–243. doi: 10.1002/cae.20305

CrossRef Full Text | Google Scholar

Kos, M., Van den Brink, D., and Hagoort, P. (2012). Individual variation in the late positive complex to semantic anomalies. Front. Psychol. 3:318. doi: 10.3389/fpsyg.2012.00318

CrossRef Full Text | Google Scholar

Kutas, M., and Federmeier, K. D. (2000). Electrophysiology reveals semantic memory use in language comprehension. Trends Cogn. Sci. 4, 463–470. doi: 10.1016/S1364-6613(00)01560-6

CrossRef Full Text | Google Scholar

Kutas, M., and Federmeier, K. D. (2011). Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). Annu. Rev. Psychol. 62, 621–647. doi: 10.1146/annurev.psych.093008.131123

CrossRef Full Text | Google Scholar

Laufer, B., and Rozovski-Roitblat, B. (2011). Incidental vocabulary acquisition: the effects of task type, word occurrence and their combination. Lang. Teach. Res. 15, 391–411.

Google Scholar

Liu, S. (2018). Review on incidental vocabulary acquisition through reading. Theory Pract. Lang. Stud. 8, 702–711. doi: 10.17507/tpls.0806.22

CrossRef Full Text | Google Scholar

Maccotta, L., and Buckner, R. L. (2004). Evidence for neural effects of repetition that directly correlate with behavioral priming. J. Cogn. Neurosci. 16, 1625–1632. doi: 10.1162/0898929042568451

PubMed Abstract | CrossRef Full Text | Google Scholar

Makiabadi, H., Pishghadam, R., Naji Meidani, E., and Khajavy, G. H. (2019). Examining the role of emotioncy in willingness to communicate: a structural equation modeling approach. Rev. Psicodidáct. 24, 120–130.

Google Scholar

Massaro, D. W. (2004). “From multisensory integration to talking heads and language learning,” in The Handbook of Multisensory Processes, eds G. A. Calvert, C. Spence, and B. E. Stein (Cambridge, MA: Massachusetts Institute of Technology), 311–332. doi: 10.1007/s00426-005-0031-5

PubMed Abstract | CrossRef Full Text | Google Scholar

McRae, K., Hare, M., Elman, J. L., and Ferretti, T. R. (2005). A basis for generating expectancies for verbs from nouns. Mem. Cogn. 33, 1174–1184. doi: 10.3758/bf03193221

PubMed Abstract | CrossRef Full Text | Google Scholar

Molinaro, N., Su, J. J., and Carreiras, M. (2016). Stereotypes override grammar: social knowledge in sentence comprehension. Brain Lang. 155, 36–43. doi: 10.1016/j.bandl.2016.03.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Montessori, M. (1912). The Montessori Method. New York, NY: Cambridge Press.

Google Scholar

Mulligan, N. W., and Peterson, D. J. (2013). The negative repetition effect. J. Exp. Psychol. 39, 1403–1416. doi: 10.1037/a0031789

CrossRef Full Text | Google Scholar

Nation, I. S. (2001). Learning Vocabulary in Another Language. Cambridge: Cambridge Press.

Google Scholar

Nation, I. S. (2015). Principles guiding vocabulary learning through extensive reading. Read. Foreign Lang. 27, 136–145.

Google Scholar

Nelson, T. O. (1977). Repetition and depth of processing. J. Verb. Learn. Verb. Behav. 16, 151–171. doi: 10.3758/BF03213234

PubMed Abstract | CrossRef Full Text | Google Scholar

Newman, A. J., Tremblay, A., Nichols, E. S., Neville, H. J., and Ullman, M. T. (2012). The influence of language proficiency on lexical semantic processing in native and late learners of English. J. Cogn. Neurosci. 24, 1205–1223. doi: 10.1162/jocn_a_00143

PubMed Abstract | CrossRef Full Text | Google Scholar

Oldfield, R. C. (1971). The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 9, 97–113. doi: 10.1016/0028-3932(71)90067-4

CrossRef Full Text | Google Scholar

Parker, D. (2010). Neuronal network analyses: premises, promises and uncertainties. Philos. Trans. R. Soc. B Biol. Sci. 365, 2315–2328. doi: 10.1098/rstb.2010.0043

PubMed Abstract | CrossRef Full Text | Google Scholar

Payne, B. R., Stites, M. C., and Federmeier, K. D. (2019). Event-related brain potentials reveal how multiple aspects of semantic processing unfold across parafoveal and foveal vision during sentence reading. Psychophysiology 56, 1–15. doi: 10.1111/psyp.13432

PubMed Abstract | CrossRef Full Text | Google Scholar

Peters, E. (2014). The effects of repetition and time of post-test administration on EFL learners’ form recall of single words and collocations. Lang. Teach. Res. 18, 75–94. doi: 10.1177/1362168813505384

CrossRef Full Text | Google Scholar

Peterson, D. J., and Mulligan, N. W. (2012). A negative repetition effect in episodic memory. J. Exp. Psychol. 38, 1786–1791. doi: 10.1037/a0028220

CrossRef Full Text | Google Scholar

Phaf, R. H. (2012). Learning in Natural and Connectionist Systems: Experiments and a Model. Berlin: Springer.

Google Scholar

Pishghadam, R. (2016). “Emotioncy, extraversion, and anxiety in willingness to communicate in English,” in Proceedings of the 5th International Conference on Language, Education, and Innovation, eds W. A. Lokman, F. M. Fazidah, I. Salahuddin, and I. A. W. Mohd (London: Infobase Creation Sdn Bhd), 1–5. doi: 10.1002/9781118784235.eelt0980

CrossRef Full Text | Google Scholar

Pishghadam, R., Baghaei, P., and Seyednozadi, Z. (2017). Introducing emotioncy as a potential source of test bias: a mixed Rasch modeling study. Int. J. Test. 17, 127–140. doi: 10.1080/15305058.2016.1183208

CrossRef Full Text | Google Scholar

Pishghadam, R., Daneshvarfard, F., and Shayesteh, S. (2020). Oscillatory neuronal dynamics during L2 sentence comprehension: the effects of sensory enrichment and semantic incongruency. Lang. Cogn. Neurosci. 36, 903–920. doi: 10.1080/23273798.2021.1886312

CrossRef Full Text | Google Scholar

Pishghadam, R., Jajarmi, H., and Shayesteh, S. (2021). Sense combinations influence the neural mechanism of L2 comprehension in semantically violated sentences: insights from emotioncy. J. Neurolinguist. 58:100962. doi: 10.1016/j.jneuroling.2020.100962

CrossRef Full Text | Google Scholar

Rawson, K. A., and Kintsch, W. (2005). Rereading effects depend on time of test. J. Educ. Psychol. 97, 70–80. doi: 10.3389/fpsyg.2018.02517

PubMed Abstract | CrossRef Full Text | Google Scholar

Salmon, N., and Pratt, H. (2002). A comparison of sentence- and discourse-level semantic processing: an ERP study. Brain Lang. 83, 367–383. doi: 10.1016/s0093-934x(02)00507-2

PubMed Abstract | CrossRef Full Text | Google Scholar

Shams, L., and Seitz, A. R. (2008). Benefits of multisensory learning. Trends Cogn. Sci. 12, 411–417. doi: 10.1016/j.tics.2008.07.006

CrossRef Full Text | Google Scholar

Shayesteh, S., Pishghadam, R., and Khodaverdi, A. (2020). FN400 and LPC responses to different degrees of sensory involvement: a study of sentence comprehension. Adv. Cogn. Psychol. 16, 45–58. doi: 10.5709/acp-0283-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Shayesteh, S., Pishghadam, R., and Moghimi, S. (2019). Extending the boundaries of multisensory teaching: an introduction to the dual-continuum model of sensorial education. Int. J. Innov. Creat. Change 4, 64–82.

Google Scholar

Thalheimer, W. (2003). The Learning Benefits of Questions. Available online at: https://www.worklearning.com/wp-content/uploads/2017/10/Learning-Benefits-of-Questions-2014-v2.0.pdf (accessed April 21, 2018).

Google Scholar

Van Berkum, J. J., Brown, C. M., Zwitserlood, P., Kooijman, V., and Hagoort, P. (2005). Anticipating upcoming words in discourse: evidence from ERPs and reading times. J. Exp. Psychol. 31, 443–467. doi: 10.1037/0278-7393.31.3.443

PubMed Abstract | CrossRef Full Text | Google Scholar

Van Strien, J. W., Verkoeijen, P. P. J. L., Van der Meer, N., and Franken, I. H. A. (2007). Electrophysiological correlates of word repetition spacing: ERP and induced band power old/new effects with massed and spaced repetitions. Int. J. Psychophysiol. 66, 205–214. doi: 10.1016/j.ijpsycho.2007.07.003

CrossRef Full Text | Google Scholar

Vidal, K. (2011). A comparison of the effects of reading and listening on incidental vocabulary acquisition. Lang. Learn. 61, 219–258. doi: 10.1111/j.1467-9922.2010.00593.x

CrossRef Full Text | Google Scholar

Volz, K., Stark, R., Vaitl, D., and Ambach, W. (2019). Event-related potentials differ between true and false memories in the misinformation paradigm. Int. J. Psychophysiol. 135, 95–105. doi: 10.1016/j.ijpsycho.2018.12.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Waring, R., and Takaki, M. (2003). At what rate do learners learn and retain new vocabulary from reading a graded reader? Read. Foreign Lang. 15, 130–163.

Google Scholar

Webb, S. (2007). The effects of repetition on vocabulary knowledge. Appl. Linguist. 28, 46–65. doi: 10.1093/applin/aml048

CrossRef Full Text | Google Scholar

Wechsler, D. (1981). Wechsler Adult Intelligence Scale: WAIS-R Manual. New York, NY: Harcourt Brace Jovanovich.

Google Scholar

Xu, G., Zhong, W., Jin, H., and Mo, L. (2015). An ERP study on how subsequent sentence context can influence previous world knowledge constraints. J. Neurolinguist. 33, 96–103. doi: 10.1016/j.jneuroling.2014.09.003

CrossRef Full Text | Google Scholar

Yang, J. C., Chi, L., Teichholtz, S., Schneider, A., Nanakul, R., Nowacki, R., et al. (2014). ERP abnormalities elicited by word repetition in fragile X-associated tremor/ataxia syndrome (FXTAS) and amnestic MCI. Neuropsychologia 63, 34–42. doi: 10.1016/j.neuropsychologia.2014.08.001

PubMed Abstract | CrossRef Full Text | Google Scholar

Zheng, X., and Lemhöfer, K. (2019). The “semantic P600” in second language processing: when syntax conflicts with semantics. Neuropsychologia 127, 131–147. doi: 10.1016/j.neuropsychologia.2019.02.010

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: multisensory instruction, emotioncy, event-related brain potentials (ERPs), N400, repetition

Citation: Pishghadam R, Jajarmi H, Shayesteh S, Khodaverdi A and Nassaji H (2022) Vocabulary Repetition Following Multisensory Instruction Is Ineffective on L2 Sentence Comprehension: Evidence From the N400. Front. Psychol. 13:707234. doi: 10.3389/fpsyg.2022.707234

Received: 09 May 2021; Accepted: 03 January 2022;
Published: 28 January 2022.

Edited by:

Olivia López Martínez, University of Murcia, Spain

Reviewed by:

Andrés Antonio González-Garrido, University of Guadalajara, Mexico
Sabela Fondevila, Complutense University of Madrid, Spain

Copyright © 2022 Pishghadam, Jajarmi, Shayesteh, Khodaverdi and Nassaji. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Shaghayegh Shayesteh, shayesteh@um.ac.ir

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.