- 1Department of Psychology - Cognition and Behavior, Université de Liège, Liège, Belgium
- 2Fund for Scientific Research - FNRS, Brussels, Belgium
Short-term maintenance of verbal information is a core factor of language repetition, especially when reproducing multiple or unfamiliar stimuli. Many models of language processing locate the verbal short-term maintenance function in the left posterior superior temporo-parietal area and its connections with the inferior frontal gyrus. However, research in the field of short-term memory has implicated bilateral fronto-parietal networks, involved in attention and serial order processing, as being critical for the maintenance and reproduction of verbal sequences. We present here an integrative framework aimed at bridging research in the language processing and short-term memory fields. This framework considers verbal short-term maintenance as an emergent function resulting from synchronized and integrated activation in dorsal and ventral language processing networks as well as fronto-parietal attention and serial order processing networks. To-be-maintained item representations are temporarily activated in the dorsal and ventral language processing networks, novel phoneme and word serial order information is proposed to be maintained via a right fronto-parietal serial order processing network, and activation in these different networks is proposed to be coordinated and maintained via a left fronto-parietal attention processing network. This framework provides new perspectives for our understanding of information maintenance at the non-word-, word- and sentence-level as well as of verbal maintenance deficits in case of brain injury.
Short-term maintenance processes are a core ingredient of language repetition due to the inevitable temporal separation of input and output processes, implicating a delay period during which the input has to be temporarily maintained, even if often for a very brief time period such as during repetition of short, single word stimuli. However, the relationship between language repetition and maintenance processes remains poorly understood, partly due to the parallel and independent evolution of research in language processing and verbal short-term memory (STM) domains: many cognitive and neural models of language processing remain vague about the nature and neural underpinnings of maintenance processes, and most models of verbal STM, although acknowledging links with the language system, do not consider these links with much detail. In her recent review, Friederici (2012) highlighted the need for language processing architectures to consider and integrate interactions with STM. We here provide a review of studies that have investigated the cognitive and neural networks of maintenance processes and their interaction with language repetition/reproduction processes from various theoretical and methodological perspectives. We will attempt at bridging the gap between language processing and STM architectures, by proposing an integrative framework of verbal maintenance and language processing in which maintenance of verbal information is an emergent process, resulting from the temporary activation of both dorsal and ventral language processing pathways and their interaction with attentional control and sequence representation systems.
The Role of Dorsal and Ventral Pathways in STM Maintenance
Recent models of language repetition (Jacquemot and Scott, 2006; Hickok and Poeppel, 2007; Friederici, 2012; Hickok, 2012) assume that the posterior superior temporal gyrus (pSTG) plays a central function during language repetition, by providing, via the dorsal stream of speech processing, a sensorimotor interface linking acoustic codes in the superior temporal gyrus to articulatory codes in the posterior inferior frontal gyrus. This function has been considered to interface input and output phonological representations and to buffer verbal information via the temporary activation of these representations in language repetition tasks (Jacquemot and Scott, 2006; Hickok and Poeppel, 2007). The most compelling evidence supporting the pSTG region as a buffer function comes from patients presenting lesions in the pSTG area and whose language repetition deficit is most parsimoniously explained by difficulties in maintaining verbal information during repetition, such as in different cases of conduction aphasia or of the logopenic variant of primary progressive aphasia (Buchsbaum and D'Esposito, 2008; Gorno-Tempini et al., 2008; Buchsbaum et al., 2011). This is most clearly illustrated by patients with deep dysphasia, a rare but highly compelling form of conduction aphasia. These patients have severe difficulties in repeating single words, with marked lexicality and word imageability effects: repetition of familiar, concrete words is much less impaired than repetition of non-words or low imageability words (Michel and Andreewsky, 1983; Duhamel and Poncet, 1986; Howard and Franklin, 1988; Martin and Saffran, 1992; Trojano et al., 1992; Croot et al., 1999; Majerus et al., 2001; Tree et al., 2001; Wilshire and Fisher, 2004). A further hallmark characteristic is the production of semantic paraphasias during single word repetition. The most parsimonious account that has been proposed to explain this symptom constellation is a phonological decay impairment: activated phonological representations decay at an abnormally accelerated rate, with only some residual semantic activation left at the moment of production, explaining the strong influence of lexical and semantic variables on repetition performance (Martin and Saffran, 1992; Martin et al., 1994a). If abnormally increased decay of phonological representations is the defining feature of this syndrome, then the duration of the delay between input and output stages during language repetition should be a critical variable. This is supported by a case study with a deep dysphasic patient who has partially recovered from his language impairment, but who shows again semantic effects during repetition as soon as the delay between language input and output is increased (Martin et al., 1996). This interpretation has also been supported by connectionist implementations of the decay hypothesis within an interactive spreading activation model (Martin et al., 1996; Foygel and Dell, 2000). In sum, these patients, provide compelling evidence for a STM-based repetition impairment, and given their lesion overlap in the left posterior temporo/parietal area, can be considered to show impairment to the pSTG hub region of the dorsal language repetition stream.
A further argument often invoked for localizing phonological maintenance processes in the pSTG/inferior parietal area is the documentation of patients with specific phonological STM deficits: these patients typically show relatively spared single word repetition, but a severe reduction of multi-word repetition abilities, in association with lesions in the posterior superior temporal area extending to the supramarginal gyrus and the arcuate fasciculus, i.e., the dorsal repetition pathway (e.g., Warrington et al., 1971; Vallar et al., 1990; Basso et al., 1982; Majerus et al., 2004a; Takayama et al., 2004). This was also supported by early neuroimaging studies of verbal short-term maintenance, locating the verbal short-term storage function to the same posterior temporo-parietal neural substrate (Paulesu et al., 1993; Salmon et al., 1996; see Becker et al., 1999; Chein and Fiez, 2001 for an exhaustive review of these studies). These data suggest a close association between STM deficits in the phonological domain and lesions in the posterior part of the dorsal repetition pathway.
A different type of patients has been described with difficulties in maintaining semantic information during language repetition and comprehension tasks (e.g., Martin and Romani, 1994; Martin et al., 1994b, 1999; Freedman and Martin, 2001; Martin and He, 2004; Hoffman et al., 2009; Barde et al., 2010). The lesion involved here is located in the more anterior part of the left inferior prefrontal cortex and/or middle and inferior temporal cortex, which is part of the ventral stream of language processing (Hickok and Poeppel, 2007; Friederici, 2012), suggesting that the ventral pathway is also related to maintenance aspects during language reproduction, and this more specifically for semantic information [R. (Martin et al., 1994b, 1999); however, see Barde et al. (2010) for further involvement of the left angular gyrus area in some patients]. More specifically, these patients are generally poor in maintaining semantic information during sentence repetition/comprehension and show diminished lexicality and semantic effects during language repetition, as well as an increased rate of intrusion errors (Martin et al., 1994b, 1999). Although initially attributed to a semantic buffer deficit, their semantic maintenance difficulties have subsequently been linked to difficulties in inhibiting previously activated items, and have recently been related to a more general semantic control deficit1 (Hamilton and Martin, 2005, 2007; Jefferies et al., 2007; Hoffman et al., 2009). A second type of intervention of the ventral language pathway in maintaining semantic information in STM is illustrated by patients showing loss of semantic information, as is the case in patients with semantic dementia (Hodges et al., 1992). These patients present a progressive loss of semantic representations, with lesions typically involving the ventral speech stream, gray matter loss starting in inferior, anterior and medial regions of the temporal lobe and involving also the anterior inferior prefrontal and orbito-frontal cortex (Mummery et al., 2000; Good et al., 2002; Desgranges et al., 2007). During language repetition, in both single and multiple word/nonword repetition tasks, patients with semantic dementia present a marked reduction of lexicality effects, with word spans being severely impaired but non-word spans often remaining in the normal range (Patterson et al., 1994; Knott et al., 1997; Majerus et al., 2007a). The data from patients with semantic dementia show that temporary activation of long-term memory lexico-semantic representations is a further critical determinant of language repetition and maintenance. In sum, the data from patients with selective semantic STM or semantic knowledge impairment suggest that the ventral repetition pathway is involved in language maintenance processes by providing the necessary substrate for activation and representation the semantic information to be maintained, and by supporting semantic control processes which protect semantic memoranda against semantic intrusions.
A straightforward conclusion of these results, and which is a more or less implicit assumption of recent language processing models and language-based STM models (Martin and Saffran, 1992; Hickok and Poeppel, 2007; Acheson and MacDonald, 2009; Friederici, 2012; Hickok, 2012), is that temporary maintenance of phonological information during language repetition depends upon the dorsal pathway, and that temporary maintenance of semantic information during language repetition depends on the ventral pathway. In other words, the language processing networks could be considered to be sufficient for supporting short-term maintenance in language repetition tasks, via temporary activation of phonological, sensori-motor interface and semantic representations, and this from the encoding stage until the response is produced. Verbal information is considered here to be maintained via continuous activation all over the maintenance phase of underlying language representations initially activated during encoding (Martin and Saffran, 1992). This conclusion, although parsimonious, however, does not take into account the results of studies that have more directly explored the neural substrates of verbal short-term maintenance. In the STM research field, load effects are considered to be a core characteristic of maintenance processes: the higher the number of stimuli to be maintained, the higher the maintenance load, and the greater the solicitation of maintenance processes. This implies that regions involved in temporary maintenance of verbal information should be sensitive to maintenance load (Postle, 2006). Neural substrates supporting load effects have indeed been identified, but these typically involve areas outside dorsal and ventral repetition pathways: the superior parietal and intraparietal cortex as well as the dorsolateral prefrontal cortex have been shown to be sensitive to STM load (Awh et al., 1999; Rypma and D'Esposito, 1999; Leung et al., 2002, 2004; Rypma et al., 2002; Ranganath et al., 2004; Ravizza et al., 2004; Narayanan et al., 2005; Majerus et al., 2012). Similarly, Martin et al. (2003) investigated phonological and semantic maintenance processes by exploring load effects in phonological (rhyme judgment) and semantic (category judgment) STM tasks: for both tasks, load effects were observed outside the ventral and dorsal language processing pathways, and involved the superior parietal cortex, the intraparietal sulcus and the dorsolateral prefrontal cortex in the left hemisphere; activations in the language network were observed, with specific recruitment of regions of the dorsal language pathway (left supramarginal cortex) for the rhyme judgment task but these activations did not respond in a load-dependent manner. These results suggest that while dorsal and ventral language pathways are specialized in representing phonological and semantic information, respectively, they do not reflect maintenance processes per se if we consider these to be defined by load effects.
These data should, however, not be taken as a conclusive argument against a role of temporary activation of language representations during STM maintenance. Studies will need to assess load-effects in dorsal and ventral pathways using more sensitive neuroimaging methods such as multivariate voxel pattern analyses; these techniques have recently allowed to show load effects in occipital visual processing areas during visual maintenance tasks where univariate analyses failed to reveal any such effects (Emrich et al., 2013). Maintenance of six vs. two verbal items may not necessarily be associated with differential activation levels in language processing areas, as measured with traditional univariate analyses, but could rely on more subtle differences in activation patterns. Enhanced activation levels in fronto-parietal cortex areas may on the other hand reflect increasing attentional demands for distinguishing increasingly overlapping activation patterns in the language processing areas when maintaining six vs. two items. Also, most patients with apparent selective phonological STM impairment are likely to have difficulties at the level of processing and maintaining language representations. These patients typically present lesions in the dorsal language network (posterior superior temporal and temporo-parieral cortex) rather than the load-dependent fronto-parietal networks (Warrington et al., 1971; Basso et al., 1982; Vallar et al., 1990; Majerus et al., 2004a; Takayama et al., 2004). The vast majority of these patients show a history of aphasia, with residual phonological processing deficits in most cases (see Majerus, 2009). In their meta-analysis, Majerus (2009) showed a strong positive correlation between the severity of the phonological STM impairment and residual language processing impairment, suggesting that residual difficulties in representing and processing phonological information may at least partially explain phonological STM deficits in these patients (see also Buchsbaum and D'Esposito, 2008 and Postle, 2006).
Overall, the results from the language processing and STM research fields appear to be conflicting. On the one hand, the neuropsychological data reviewed here suggest that impairment at the dorsal and ventral language pathways is clearly associated with difficulties in tasks involving the maintenance of phonological and semantic information, respectively. On the other hand, studies from the STM research field highlight bilateral fronto-parietal networks as being related to core STM processes such as load effects. In order to understand this apparent paradox, we need to examine more deeply the nature of representations and processes involved in the maintenance of verbal information. In order to achieve this, a three-component framework is proposed here. In this architecture, a first component is related to temporary activation of language representations in the dorsal and ventral language processing networks: to-be-repeated language stimuli have to be represented at the item level that is, their phonological and lexico-semantic features need to be encoded, represented and maintained, and this will be achieved via continuous activation in the language pathways. Second, the serial order of the stimuli needs to be represented: this is more particularly the case when sequence information of the words or phonemes within the string of memoranda is unfamiliar. Third, although language repetition is a simple, straightforward task and will not require demanding executive control processes, at least in healthy, language non-impaired individuals, attentional focalization on the target stimulus/stimuli will be required ad minima, and these requirements will increase with increasing number and decreasing familiarity of the verbal stimuli to be repeated. The latter two components are proposed to be supported by the load-dependent, fronto-parietal networks typically associated with STM tasks. In the following sections, we will discuss empirical support for this three-component architecture of temporary maintenance for verbal stimuli.
Language Repetition Pathways and Maintenance of Item Information
Dorsal and ventral language processing networks are proposed here to have one specific function during verbal maintenance: they provide the representational basis for the encoding of phonological and semantic features of the items to be maintained and repeated. In other words, via its temporary activation, the language network ensures the encoding and representation of phonological and semantic item information during temporary maintenance of verbal information. Critically, this excludes the representation of novel serial order information, such as the arbitrary ordering of the words within a list of words to be repeated, such as a phone number. This distinction between the representation of item information and serial order information is in short-term maintenance tasks defines most of recent verbal STM models and is supported by empirical evidence that will be presented in this and the next section. These STM models consider that during maintenance of verbal information, verbal item information is directly represented within the language system, rather than by a copy in a dedicated STM buffer, while the representation of novel serial order will be processed via a specific serial order processing system to which the language system is connected (Burgess and Hitch, 1999, 2006; Martin et al., 1999; Brown et al., 2000; Gupta, 2003). Verbal item information is considered to be maintained via sustained activation of the phonological representations and semantic representations along the dorsal and ventral repetition pathways and which have also served to process the target item during perception and encoding.
The assumption that language processing networks mainly serve to represent phonological and semantic item information is supported by a number of behavioral and neuroimaging studies. At the behavioral level, it is well-established that linguistic variables, such as word frequency, word imageability and semantic valence and richness will determine the amount of item information that is correctly recalled in a word list immediate serial recall task (i.e., the number of items independently of their serial position), but not recall of serial order information (i.e., the number of items within correct serial position) (Hulme et al., 1991; Poirier and Saint-Aubin, 1996; Nairne and Kelley, 2004; Majerus and D'Argembeau, 2011). This shows that access to linguistic levels of representation affects maintenance of verbal item information, but not within-list serial position information. Second, neuroimaging studies have shown that, when maintaining items and their phonological characteristics, phonological processing areas in the pSTG area and adjacent inferior parietal cortex are activated at least during the initial stages of maintenance (Collette et al., 2001; Martin et al., 2003; Majerus et al., 2006a, 2010; Pa et al., 2008; Gettigan et al., 2011). Furthermore, in a recent MEG study, Herman et al. (2013) showed that processing of long non-word sequences, involving a delay below stimulus input and repetition, were associated with increased reverberating activity between posterior (temporo-parietal) and anterior (inferior frontal) sites of the dorsal pathway, suggesting sustained and synchronized activation of input and output phonological representations during maintenance of verbal stimuli. Similarly, when maintaining semantic item information, semantic processing areas in the inferior temporal lobe have been shown to present sustained activation over the maintenance interval (Fiebach et al., 2006, 2007). These data suggest that ventral and dorsal language pathways are involved in maintenance during language reproduction tasks, by providing the representational substrates necessary for encoding and representing the items, i.e., the phonological and semantic characteristics of the information to be maintained and repeated.
This is further supported by patients with semantic processing deficits. These patients typically present difficulties in repeating semantic item information, but not serial order information, with serial order recall being perfectly preserved (Majerus et al., 2007a; Papagno et al., 2013). These patients produce very specific item error patterns in repetition tasks, the so-called blending errors where phonological forms of different words are recombined to form nonsense phonological forms. Although these errors could be considered to reflect syllable or phoneme ordering errors, they are in fact a direct consequence of the loss of semantic information: lexico-semantic knowledge normally binds the phonological segments defining a word form to its semantic referent allowing for robust phonological item representations; if this knowledge is degraded, lexical phonological representations for a given word degrade, the word being processed like a non-word and leading to the phonological recombination errors which are typically observed when healthy participants repeat sequences of non-words (Treiman and Danis, 1988; Patterson et al., 1994; Jefferies et al., 2005; Acheson and MacDonald, 2009). In support of this interpretation, Jefferies et al. (2006) have shown that healthy adults conduct the same type of phonological recombination errors in word list immediate serial recall tasks when word stimuli are not recognized as lexical items anymore, for example when presented together with non-words in mixed and unpredictable word-nonword list repetition designs. More generally, these data also show that in the absence of long-term language knowledge, serial order information of phoneme order is difficult to maintain and serial ordering errors appear during repetition performance.
Finally, syntactic information will also support maintenance and recall of information, by binding item information and item order via long-term syntactic structures. This will again be the case for familiar information such as coherent sentences with canonical sentence structure. A number of studies have shown that verbal STM span can be significantly increased when presenting word lists organized as sentences; in this case word span will increase to about 16 words (Brener, 1940; Baddeley et al., 1984, 2009). Although this finding has been attributed to increased opportunities for the use of chunking processes, a straightforward interpretation of these results is the intervention of syntactic and conceptual long-term memory structures which will determine the syntactic and conceptual relations between the items, and therefore also their position in a sentence structure (Garrett, 1980). For example, the pronoun “the” will always precede its corresponding noun, and the sentence subject will precede the verb while the object will follow the verb for canonical sentence structures. At the conceptual level, the agent will generally precede the action and the beneficiary. This knowledge, embedded in the ventral pathway for the conceptual aspects and in the dorsal pathway for the syntactic aspects, will support both item and order recall in a sentence context (Friederici, 2012). However, if incoherent sentences are presented with words in scrambled order, sentence span will decrease and especially serial order errors will appear (Hoffman et al., 2012). In other words, the representations of the language system are able to support familiar item and order information, but not unfamiliar order information, as has already been shown for non-word repetition.
In sum, these data provide support for language representations in the dorsal and ventral speech streams as providing the representational basis for temporary maintenance of item information. Language processing models, such as those developed by Hickok and Poeppel (2007), Jacquemot and Scott (2006) and Friederici (2012), and recent STM models mentioned in this section show strong theoretical convergence here, both considering that temporary activation of long-term representations in the language network is a critical step of verbal maintenance. However, temporary activation of representations in the dorsal and ventral language bases are not the only processes that intervene during short-term maintenance of verbal information, and it is at this point that language processing and STM models start to diverge.
The Role of Fronto-Parietal Networks in Verbal Maintenance: Serial Order Processing
A hallmark characteristic of many recent verbal STM models is the consideration of mechanisms that allow for the temporary maintenance and reproduction of arbitrary sequence information that is, the ability to recall verbal items/phonemes as a function of their serial position during list/stimulus presentation (Henson, 1998; Burgess and Hitch, 1999, 2006; Brown et al., 2000; Gupta, 2003; Botvinick and Watanabe, 2007). Language processing models rarely consider this ability but assume that serial order information is an inherent part of linguistic structure and is supported by linguistic structure during language reproduction (Acheson and MacDonald, 2009; see also Postle, 2006). This assumption is valid when linguistic structure knowledge is available. The ordering of phonemes for familiar word forms will be determined by phoneme- and syllable-cooccurrence and transition probabilities encoded in phonological representations; the same will also be true for non-words, where sublexical phonotactic knowledge and syllable structure knowledge will determine output in non-word recall tasks (Treiman and Danis, 1988; Vitevitch and Luce, 1999; Dell et al., 2000; Majerus et al., 2004b; Acheson and MacDonald, 2009; Gupta and Tisdale, 2009). Likewise, during sentence repetition, syntactic and conceptual knowledge will constrain the order of the words during output (Dell, 1986). However, when this knowledge is not available serial order errors will occur during repetition. This is illustrated by non-word recall where sublexical phonotactic knowledge is not sufficient to accurately encode and reproduce the serial ordering of the phonemes, especially if the underlying phonological pattern of the non-word is highly unfamiliar; in that case, errors during non-word repetition will start to appear and these errors will be mainly phoneme order errors (Treiman and Danis, 1988; Gupta et al., 2005; Jefferies et al., 2006). This is also the case when the order of an arbitrary list of words needs to be maintained and repeated, such as when repeating a phone number, a list of unrelated words, a novel sequence of task instructions or a novel sequence of orally given directions.
While in the STM domain, many detailed models of the processes supporting the maintenance and reproduction of novel sequence information have been developed (e.g., Henson, 1998; Burgess and Hitch, 1999, 2006; Brown et al., 2000; Gupta, 2003; Botvinick and Plaut, 2006), the neural pathways associated with these processes have only been recently uncovered. Studies exploring the neural substrates associated with serial order maintenance and reproduction have observed a critical role of the inferior parietal cortex, and more specifically the intraparietal sulcus area. Marshuetz et al. (2000) observed higher activation in bilateral intraparietal sulci when maintaining the serial order of arbitrary letter sequences as opposed to maintaining letter identity (see also Marshuetz et al., 2006). When comparing serial order and item STM conditions with a stricter control of task difficulty, Majerus et al. (2006a, 2010) observed that maintenance and retrieval of serial order information for word lists as well as non-word lists is restricted to activation in the right intraparietal sulcus, in addition to activation in the bilateral superior frontal cortex and the right superior cerebellum; the superior frontal cortex contribution to serial order processing has also been observed by Henson et al. (2000) and has been associated with serial regrouping. On the other hand, activation is stronger in the dorsal and ventral language networks when maintaining item identity information such as in conditions where participants have to focus on and later recognize the phonological, orthographic or semantic characteristics of the memoranda (Majerus et al., 2006a). Furthermore, the fronto-parietal network supporting encoding and maintenance of serial order information appears to be domain general, the same network having been shown to be also involved in the short-term maintenance of serial order information for visual sequences such as sequences of unfamiliar faces (Majerus et al., 2007b, 2010).
The separation between language -based item maintenance processes, and serial order maintenance processes is also confirmed by patients presenting verbal STM deficits. Case studies with double dissociations between item-based and order-based maintenance deficits have been documented. Attout et al. (2012) described two patients, MB and CG, with poor performance in verbal repetition and reproduction tasks and poor digit spans. An exhaustive exploration of MB's performance profile for STM tasks maximizing either the retention of verbal item information or serial order information showed that patient MB had difficulties mainly in recognizing and reproducing item information; word and non-word list repetition was characterized by a significantly increased rate of omissions errors and phonological paraphasias but his serial recall was perfect: all words correctly recalled were reproduced in correct serial position. His item-based STM impairment was furthermore associated with a mild residual phonological processing impairment, in the context of a left posterior peri-sylvian cerebro-vascular accident. On the other hand, CG, a patient with traumatic brain injury2, showed the reverse profile: he showed an abnormally high rate of serial ordering errors in verbal repetition tasks, while showing perfect item reproduction abilities; he recalled as many items as controls, but had substantial difficulties in outputting the items in correct serial position. The existence of a double dissociation between item and order verbal maintenance deficits is also an important argument against unitary models of verbal STM such as the model by Botvinick and Plaut (2006) considering that item and order information are bound in a single representation during maintenance and reproduction of verbal sequential information. These dissociations are also contradicting language-based serial order coding accounts, where the maintenance of serial order is supposed to be achieved mainly via repeated cycling of the input sequence through the language production system (Page and Norris, 1998; Postle, 2006; Page et al., 2007; Acheson and MacDonald, 2009). As already noted, phonological, semantic and syntactic linguistic structures will support serial recall if the sequence information can be mapped onto existing long-term memory sequence structures (such as syllable frames, phonotactic constraints, lexical word form representations, scripts), however, this will not be possible when the sequence information is novel, arbitrary and highly unfamiliar (Treiman and Danis, 1988; Gupta et al., 2005; Jefferies et al., 2006). The evidence presented here is in favor of separate cognitive and neural substrates supporting item vs. order representation in language maintenance and reproduction tasks.
Importantly, the distinction between item and order maintenance capacities has further functional implications for language processing. The serial order maintenance capacities supporting novel sequence reproduction may be critical for language repetition and learning. A number of behavioral studies have shown that repetition and learning of novel phonological sequences is most strongly associated with serial order maintenance capacities, as opposed to item maintenance capacities: children and adults showing high serial order maintenance capacities as measured by serial order reproduction and reconstruction tasks have larger vocabulary knowledge bases and learn faster novel vocabulary; item STM tasks involving item recall independently of serial order position information are more weakly associated with performance in novel word repetition and learning tasks (Majerus et al., 2006b,c, 2008a; Mosse and Jarrold, 2008; Leclercq and Majerus, 2010). A theoretical interpretation of these findings is that the ability to temporarily maintain sequence information via a dedicated short-term storage system for order information allows the unfamiliar phoneme sequences which define a novel word to be maintained and replayed in correct order during the repetition and learning process, thereby increasing the strength of the new lexical phonological representation being created in the language knowledge base; this entails that the language pathways (where item representations—phonemes/syllables/complete word forms—are stored, temporarily activated and learnt) and the order maintenance system are interconnected and in close interaction (Gupta and MacWhinney, 1997; Burgess and Hitch, 1999, 2006; Gupta, 2003).
In the light of these data, we should expect that, at the neural level, single novel word repetition and learning is also associated with the fronto-parietal serial order processing network. In support of this hypothesis, Majerus et al. (2008b) observed a correlation between novel word learning capacities in healthy adults and the recruitment of the frontal part of the fronto-parietal serial order processing network. In the same vein, a MEG study exploring the time course of brain activity associated with the repetition of non-word syllable sequences, observed, in parallel to reverberating activity in the dorsal language pathway, an involvement of the right intraparietal sulcus area; the non-word syllable repetition task used in that study had strong serial order processing requirements, since the different non-word sequences were sampled each time from the same set of three syllables (ba, da, or pa) with syllable serial order being the distinguishing feature between the different non-word sequences (Herman et al., 2013); furthermore, the right IPS involvement was not just coincidental, but it was associated with behavioral success during the syllable repetition task. On the other hand, other studies investigating the neural substrates of novel word repetition or maintenance have observed activation restricted mainly to the dorsal language pathway (e.g., Strand et al., 2008; Papoutsi et al., 2009; Gettigan et al., 2011). These studies, however, most often control for task-general factors by including baseline conditions which factor out neural activation related to serial order processing, such as via the use of tone sequence processing conditions (Strand et al., 2008; Gettigan et al., 2011). As we have noted, the fronto-parietal network supporting serial order processing for verbal tasks also supports ordinal processing in other modalities (Majerus et al., 2007b, 2010; Dormal et al., 2012). By using these control conditions, the intervention of fronto-parietal serial processing mechanisms may have been masked. Similarly, other studies contrasted non-word conditions that varied according to a number of linguistic dimensions (such as articulatory constraints) and where the reference non-word condition already included serial order processing, which may again have masked the potential intervention of fronto- parietal serial order processes (Papoutsi et al., 2009). In sum, the intervention of fronto-parietal serial order processing mechanisms has been established for the maintenance and reproduction of order information in word, non-word and letter sequences; the conditions under which these processes also intervene in single non-word processing have to be further investigated.
The Role of Frontoparietal Networks in Verbal Maintenance: Attentional Focalization
A second hallmark feature of recent verbal STM models, and which is considered even less by language architectures than serial order processing, is attentional processing. Many recent models of STM consider that maintenance of verbal information does not only require temporary activation of language representations, but the maintenance of this activation over time until task completion is further under the control of attentional focalization processes (Cowan, 1995; Oberauer, 2002; Barrouillet et al., 2004; Engle and Kane, 2004). Although the role of attention has been acknowledged by early STM models, such as the working memory model by Baddeley and Hitch (1974), recent data show that attentional focalization intervenes not only in complex storage and processing tasks, but also in simple verbal tasks requiring only maintenance and output of a set of stimuli as is the case of language repetition tasks (Cowan et al., 2005; Majerus et al., 2009; Ötzekin et al., 2010). In other words, temporarily activated representations are considered to remain activated as long as required by being put in the focus of attention and by being re-activated each time they are the target of the focus of attention (Cowan, 1988, 1995). Direct neuroimaging evidence for this mechanism has been observed in the area of face processing, where Gratton et al. (2013) recently showed that items hold in the focus of attention are characterized by enhanced neural response in temporo-occipital face processing areas relative to items outside the focus of attention. This control of activation maintenance via attentional processes will further allow to ensure that activated input and output representations match, possibly via additional efference copies sent to the inferior parietal cortex, allowing that input information is correctly reproduced at output (Rauschecker and Scott, 2009). Attentional capacity is currently considered by many authors to be the core limiting factor of performance in verbal maintenance tasks, and the defining factor of maintenance capacity (Cowan, 1995; Oberauer, 2002; Barrouillet et al., 2004; Engle and Kane, 2004).
At the neuroimaging level, part of the fronto-parietal network that typically defines the neural substrates of verbal maintenance tasks has been associated with this attentional focalization function, and this more precisely at the level of the left intraparietal sulcus and the dorso-lateral prefrontal cortex (Salmon et al., 1996; Nystrom et al., 2000; Ravizza et al., 2004; Cowan et al., 2011; Majerus et al., 2012). Although bilateral fronto-parietal activity is typically observed in verbal maintenance tasks, only the left intraparietal sulcus and dorsolateral prefrontal cortex appears to be activated irrespective of the type of information to be maintained, and is considered to have a domain-general attentional control and focalization function in STM tasks (Majerus et al., 2010; Cowan et al., 2011). The right intraparietal sulcus area appears to have a more specific function and is activated more strongly when maintaining serial order information as we have seen in the previous section. This fronto-parietal network is also considered to support attentional focalization processes rather than a verbal buffer function since this network is sensitive to load-effects not only in the verbal domain, but also when temporarily maintaining other types of information such as faces, geometric stimuli, tactile stimuli or even social stimuli (e.g., Nystrom et al., 2000; Rämä et al., 2001; Hautzel et al., 2002; Todd and Marois, 2004; Brahmbhatt et al., 2008; Lycke et al., 2008; Meyer et al., 2012; Kaas et al., 2013). This has led to the currently dominant view in the STM research field that an important function of the fronto-parietal network is the control of task-related attention during the maintenance of verbal information, allowing attention to be directed and maintained on the target stimuli to be processed and maintained (Todd and Marois, 2004; Postle, 2006; Nee and Jonides, 2011, 2013). More specifically, this STM load-dependent fronto-parietal network has been shown to involve a well-known network in the attention research field, the dorsal attention network which allows attention to be oriented on target stimuli as a function of ongoing task requirements, in both verbal and visual domains (Todd and Marois, 2004; Majerus et al., 2012). This network has been shown to increase its activity with increasing STM load, while competing with a second attentional network during verbal maintenance tasks, the ventral attention network involved in detecting novel, task-irrelevant stimuli; the ventral network, involving the temporo-parietal junction and the orbito-frontal cortex, is deactivated as a function of the amount of verbal stimuli to be maintained, and this deactivation is associated with attentional blindness for distractor stimuli presented while the verbal stimuli are being maintained (Todd et al., 2005; Fougnie and Marois, 2007; Majerus et al., 2012). These data demonstrate the central role of task-related attentional processes as defining left-hemisphere fronto-parietal activity during maintenance of verbal stimuli.
In the light of these data, any model representing language repetition and maintenance processes should consider interactions with these domain-general attention networks, since they have been shown to be one of the main function of the left-centered fronto-parietal network recruited during temporary maintenance of verbal information. Furthermore, repetition of multiple word or non-word sequences will particularly require attentional control processes in order to ensure that input and output match (Rauschecker and Scott, 2009). While this network is consistently observed to be involved in tasks involving the maintenance and reproduction of multiple word or non-word stimuli (Ravizza et al., 2004; Majerus et al., 2006a, 2010; Ötzekin et al., 2010; Cowan et al., 2011), this is less consistently the case for single word and non-word repetition. On the one hand, single word repetition will probably require attentional focalization processes only to a minimal amount, since a single target has to be processed and the maintenance delay is very short due to a quasi-immediate succession of input and output processes. This is also in line with neuroimaging studies of verbal maintenance showing no or minimal recruitment of left fronto-parietal networks in low-load conditions (e.g., when a single or two letters have to be maintained; Majerus et al., 2012). However, this may be different for single non-word repetition, especially if the phonological structure of the non-word is highly unfamiliar and multisyllabic and will be difficult to map onto existing sublexical phonological representations along the dorsal language pathway. In that case, fronto-parietal maintenance mechanisms are likely to be challenged to a higher extent. Studies having investigated the neural substrates of single non-word repetition do not systematically observe activation of the left-centered fronto-parietal network (Pa et al., 2008; Strand et al., 2008; Papoutsi et al., 2009; Gettigan et al., 2011). This could, however, be related to the control conditions used in these studies, factoring out domain-general processes such as attentional focalization. As already noted in the previous section, most of these studies aim at exploring neural activations specifically associated with linguistic processing and maintenance, and therefore use baseline conditions which remove more general cognitive variables, for example by presenting tone or gesture sequences to be processed and maintained as a reference condition (e.g., Pa et al., 2008; Gettigan et al., 2011). On the other hand, when considering activations shared with processing of the control conditions, activation in intraparietal areas can be observed, as was for example the case in the study by Pa et al. (2008) comparing speech and gesture maintenance. Also, in their recent MEG study exploring the time course of neural activation during language repetition, Herman et al. (2013) observed activation in the left fronto-parietal network during non-word repetition. Interestingly, this network reacted in a load-dependent manner, with higher recruitment for repetition of 4-syllable non-words as compared to two-syllable non-words. Furthermore, it is important to note here that the involvement of the left fronto-parietal network occurred at a relatively late time point after encoding, between 500 and 700 ms post-stimulus onset, while activation in the dorsal language network was present about 40 ms post-stimulus onset. This later involvement of the fronto-parietal network is in line with its top-down attentional control function during language processing: language representations of to-be-repeated stimuli are first activated in the language processing networks, and their activation is then maintained and monitored via top-down task-related attentional control. Finally, in a recent neuroimaging study exploring functional connectivity patterns during a sentence processing task, Makuuchi and Friederici (2013) found further evidence for the involvement of fronto-parietal networks in language processing tasks. Using dynamic causal modeling, they observed functional connectivity between the left-hemisphere fronto-parietal network and core language processing areas during sentence processing, and the strength of this association increased as a function of the linguistic complexity of the verbal material and, by extension, of the amount of attentional focalization/control needed. These data show that the fronto-parietal network is not only co-activated during language processing tasks, but is an integral and integrated part of language processing networks.
Toward an Integrative Framework for Maintenance Processes during Language Repetition
In this review, aiming at elucidating the cognitive processes and neural networks involved in the maintenance of verbal information during language repetition, we have shown that research in the language and STM dosmains converge on one important factor: the importance of language knowledge supported by the dorsal and ventral pathways and its temporary activation during maintenance of verbal information. On the other hand, research in the STM domain points to two additional processes: those involved in maintaining novel sequence information, and those involved in maintenance control via attentional focalization processes. Although language processing models have given no or very little consideration to the latter two processes, the studies reviewed here show that temporary maintenance of verbal information can depend on all three factors identified here, especially when multiple word stimuli or long non-word stimuli need to be processed. Similarly, cognitive architectures of STM consider interactions between either language processing and serial order processing (e.g., Brown et al., 2000; Gupta, 2003; Burgess and Hitch, 2006), or language processing and attentional processing (e.g., Cowan, 1995; Oberauer, 2002; Barrouillet et al., 2004), but no STM model currently considers the three components of verbal maintenance identified here at the same time.
The integrative framework of verbal maintenance processes during language repetition proposed here considers language, serial order and attention components within a single model. An overview of this functional architecture and underlying neural networks is presented in Figure 1, for single word and non-word repetition, and in Figure 2, for word and non-word sequence repetition including sentence repetition. The basis of this architecture are the dorsal and ventral language pathways, where long-term phonological and semantic representations are activated upon presentation of a word (see Figure 1). More precisely, in the dorsal network, sublexical phonological representations in the posterior superior temporal area and the superior temporal sulcus will be activated and temporarily maintained (Binder et al., 2000; Scott et al., 2000); two different types of representation may be distinguished here: the posterior superior temporal area (planum temporale) has been proposed to support sensori-motor interface representations, which, in direct connection with the inferior frontal cortex, will allow target representations to get continuously reactivated and refreshed via subvocal articulatory rehearsal processes (the “doing” pathway; Hickok and Poeppel, 2007; Rauschecker and Scott, 2009); the more anterior superior temporal areas and superior temporal sulcus have been proposed to keep track of the initial perceptual properties of the target information (Buchsbaum et al., 2005). In the ventral network, activations in the anterior, middle and inferior temporal areas will represent the lexical and semantic properties of the target information (Scott et al., 2000; Binder et al., 2000, 2009; Friederici, 2012). Importantly, at this stage only item representations will be activated and maintained, allowing individual words to be maintained and repeated on the basis of their underlying phonological, lexical and semantic representations. However, as we have seen, these representations will not be sufficient to maintain sequence information, i.e., to maintain the (arbitrary) serial order in which the different words have been presented. Activation in the language pathways therefore needs to be synchronized with an additional system which allows for the coding of arbitrary sequence information (see Figure 2): this function is proposed to be supported by a fronto-parietal network centered on the right intraparietal sulcus, which will associate each activated item in the language network with a serial position marker ensuring that each item will be output in correct serial position at recall, as proposed by a number of computational models of serial order STM (Gupta and MacWhinney, 1997; Burgess and Hitch, 1999, 2006; Brown et al., 2000). Finally, attentional control will be needed to maintain the item and serial order representations activated over time and in the focus of attention, as a function of current task requirements. This function is proposed here to be supported by a fronto-parietal network centered around the left intra-parietal sulcus (Figure 2), in line with an increasing number of studies associating the fronto-parietal activations during verbal and non-verbal maintenance with the dorsal attention network (Todd and Marois, 2004; Cowan et al., 2011; Majerus et al., 2012). This network will interact with the other two networks in order to ensure synchronized activation and processing, which will lead to successful task performance and accurate reproduction of both item and order information.
Figure 1. Outline of the networks and processes proposed to support maintenance processes during single word and short non-word repetition. Maintenance during short non-word repetition is mainly supported by the dorsal language pathway, linking the superior and posterior temporal cortex to the posterior inferior frontal cortex, and, at the cognitive level, reflects temporary activation and interfacing of input and output phonological item representations. Maintenance of single word repetition is also supported by the dorsal language pathway, but with additional intervention of the ventral language pathway, linking the middle and anterior temporal cortex to a more anterior site of the inferior frontal cortex, and reflects temporary activation of semantic item representations. The frontal endpoints of each pathway are further involved in protecting to-be-maintained information against phonological and semantic interference, respectively. The numbers indicate the main Brodman areas characterizing each functional region identified here.
Figure 2. Outline of the networks and processes proposed to support maintenance during multiple non-word and word sequence repetition, including sentence repetition. Bilateral fronto-parietal networks, supporting domain-general attentional and serial order processing, intervene in addition to the dorsal and ventral language pathways involved in the maintenance of phonological and semantic item information. In the left hemisphere, the fronto-parietal network associating the left intraparietal sulcus to the left superior and middle prefrontal cortex is proposed to support the maintenance of multiple verbal stimuli by focusing attentional resources on the representations temporarily activated in the dorsal and ventral language pathways. In the right hemisphere, the fronto-parietal network associating the right intraparietal sulcus to the right superior and middle prefrontal cortex is proposed to support maintenance of the novel and unfamiliar serial order information that characterizes the order of occurrence of words within a list and of phonemes/syllables within a novel word, via connectivity with the left fronto-parietal network and the language pathways. The numbers indicate the main Brodman areas characterizing each functional region identified here.
This architecture of verbal maintenance is considered to be task-dependent: when repeating single words or short non-words with a familiar sublexical phonological structure in an immediate repetition task, processing is likely to be limited to the ventral and dorsal repetition pathways, respectively, since there will be no novel serial position information to be processed; requirements for extended maintenance via attentional focalization will also be minimal since the perceptual input will be processed by the language repetition pathways in a quasi instantaneous manner and the target item activation does not need to be protected against competitor stimuli. In accordance, patients with a severe single word repetition impairment often have lesions restricted to these pathways, and more precisely, the posterior part of the dorsal pathway (Buchsbaum et al., 2011). Furthermore, recent studies exploring the role of attentional processes on maintenance processes have shown that at output, not all information will be in the focus of attention, and some information can be directly retrieved from activated long-term memory (Nee and Jonides, 2008, 2011, 2013; Lewis-Peacock et al., 2012). Similarly, when repeating multiple word sequences, the serial order processing network may not be extensively recruited if output in correct serial position is not required. Previous studies have shown that healthy subjects can recruit the serial order processing network centered around the right intraparietal sulcus as a function of task demands: when processing of sequential aspects is stressed by task instructions, stronger recruitment of the right intraparietal sulcus is observed; but when task instructions focus on the maintenance of phonological and orthographic characteristics of the items, dorsal and ventral language processing streams are activated more strongly (Majerus et al., 2006a, 2010). The flexible recruitment of these different networks is supposed to be under the control of the fronto-parietal network centered around the left intraparietal sulcus involved in top-down attentional processing. For tasks with varying item and serial order processing demands, the left intraparietal sulcus has indeed been shown to be activated for both types of information but with differential functional connectivity patterns, connectivity being enhanced between the left intraparietal sulcus and language processing networks when item processing demands are high, and connectivity being enhanced between the left and right intraparietal sulci when serial processing demands are high (Majerus et al., 2006a, 2008b). These data suggest that attentional control by the left fronto-parietal network can be flexibly allocated to language processing and/or serial order processing networks, as a function of task demands.
A number of predictions are to be derived from the framework proposed here. First, a strong prediction of this framework is the greater involvement of the serial order processing and attentional processing components during non-word repetition, especially when the non-word sequence is long, complex and cannot be easily mapped to existing lexical and sublexical phonological structures, i.e., non-words with very low lexical neighborhood values and phonotactic probability values. In that case, the sequence of phonemes cannot be represented via existing sublexical phonological structures, and the novel sequence information needs to be maintained via strong connections between the phonological item representations supported by the dorsal repetition pathway, the novel sequence representations supported by the fronto-parietal network centered around the right intraparietal sulcus, and attentional resources supported by the fronto-parietal network centered around the left intraparietal sulcus (see Figure 2). As already mentioned, previous studies exploring the neural substrates of non-word repetition typically focused on the linguistic networks and/or used control conditions factoring out any possible contribution of the serial order and attention processing components identified here (e.g., Gettigan et al., 2011). In support of this, studies looking directly at the time course of activation patterns during non-word repetition, without using any baseline condition, observed in addition to involvement of the dorsal language pathway activation in left and right inferior parietal areas which was stronger for longer non-word sequences. Moreover, if output is delayed, there will be additional requirements for short-term maintenance, and in that case, the intervention of attention networks may be necessary for maintaining active the corresponding phonological representations even for short non-words. Future studies will need to determine in a systematic manner the conditions in which serial order and attention processing networks intervene during single non-word repetition. In order to answer these questions, studies will need to use experimental designs that allow for the detection of domain-general attention and serial order processing networks instead of factoring them out.
A second prediction is related to sentence repetition. Repeating long sentences with delayed semantic integration, as is for example the case for sentences involving multiple adjectives or subordinate clauses, should put relatively high demands on temporary maintenance processes, and hence should rely on attentional support processes. Martin et al. (2003) showed that sentences where semantic integration is delayed put higher demands on semantic short-term retention abilities. Likewise, verbatim sentence repetition has been shown to be determined by phonological short-term retention abilities (Martin et al., 1999). Therefore, sentence repetition should involve the language repetition pathways as well as the fronto-parietal attention networks involved in short-term maintenance. With respect to the involvement of serial order representation mechanisms, syntactic structure knowledge will on the one hand constrain and determine word order allowing word order to be represented via activation of existing word co-occurrence and syntactic structures in the language network. On the other hand, when this knowledge is not sufficient, as is the case for example for reversible sentence constructions with the two possible interpretations being semantically plausible (e.g., John is being pushed by Eaton vs. Eaton is being pushed by John), the specific coding of word order will be important, potentially needing the recruitment of the serial order representational system supported by the right intraparietal sulcus. In support of this, studies exploring the neural substrates of sentence repetition or generation have shown involvement of both left and right intraparietal sulcus areas (Haller et al., 2005; Tremblay and Small, 2011). In both of these studies, this involvement was even stronger during sentence production than sentence listening/reading: especially sentence production will require detailed attention to both word identity and word order in order to allow for accurate reproduction, while sentence comprehension can be achieved via conceptual level processes for which the retention of specific word order is less determinant, except for the semantically plausible reversible sentence constructions mentioned above. Importantly, Segaert et al. (2013) explored brain activity associated with sentence repetition and observed specific involvement of the right intraparietal sulcus when varying syntactic structure, but not when varying verbs, pointing more directly to a specific role of the right intraparietal sulcus area in supporting processing of syntactic order information; in the same study, the left intraparietal sulcus was involved in the processing of both syntactic structure and verbs, in line with its more general attention processing role.
The role of inhibitory and interference control processes during maintenance of verbal information also has to be briefly discussed. As noted in the first section of this review, the frontal part of the ventral language pathway, i.e., the ventrolateral prefrontal cortex, has been associated with resistance to semantic interference during maintenance of semantic information (Thompson-Schill et al., 2002; Martin et al., 2003; Hamilton and Martin, 2007). A similar mechanism has been proposed for the dorsal language pathway, with the posterior inferior prefrontal cortex associated with phonological interference control processes (Postle, 2005; Schnur et al., 2009; Barde et al., 2010). These studies raise the question of the networks that link these prefrontal phonological and semantic interference control processing areas with the fronto-parietal attention control networks, and this especially in the context of multi-word and sentence processing where there is strong susceptibility for semantic and phonological interference to occur. The results of the dynamic causal modeling study by Makuuchi and Friederici (2013) are informative here since they show that the left inferior parietal cortex is increasingly connected with the inferior frontal cortex (pars opercularis) as a function of the complexity of the sentences to be processed, indicating that the parietal regions involved in attentional control potentially interact with frontal areas supporting inhibitory/interference control processes during sentence processing. Future studies will need to determine the precise task and linguistic conditions in which these interactions between attentional control and interference control networks occur. Furthermore, these processes may also be important to support serial order recall. Hoffman et al. (2012) as well as Jefferies et al. (2008) observed that patients with inhibitory/interference control deficits produced large number of order errors in sentence recall and word list recall. This is also in line with the neuroimaging studies discussed earlier and showing that the network activated when processing serial order information is not limited to the right intraparietal sulcus, but also includes superior frontal and prefrontal areas, including the left inferior prefrontal cortex associated with control of interference/inhibition (Majerus et al., 2006a, 2010). Resolution of interference between items competing for the same serial position is likely to be a further important determining factor of serial order maintenance and recall, especially if word order in a STM lists conflicts with existing word order knowledge structure, as is for example the case when recalling incoherent sentences with words in unexpected sentence positions (Hoffman et al., 2012). This type of process is also often used to model serial order recall in computational models, via competitive cueing and winner-take-all mechanisms (e.g., Burgess and Hitch, 1999).
A further central question relates to the nature of the serial order processing system proposed here and the representations used to represent sequence information. As already noted, this system is supposed to support representation of novel and arbitrary serial order information, with linguistic sequence knowledge as encoded in sublexical, lexical and semantic representations supporting processing of familiar or partially familiar sequences. For the representation of novel, arbitrary order information a number of mechanisms have been proposed, computational models considering that serial order is represented either via episodic context, time-based representations or positional vectors (Gupta and MacWhinney, 1997; Henson, 1998; Brown et al., 2000; Burgess and Hitch, 2006). All these models are able to reproduce the main characteristics of serial position coding such as serial position effects (primacy and recency effects) and transposition gradients during serial recall (items from adjacent positions tend to be exchanged more frequently than items from distant positions). A few models also consider that serial position information may be coded within item representations themselves, by considering that items are represented with different activation levels as a function of serial position or contain rank order information (Page and Norris, 1998; Farrell and Lewandowsky, 2002; Botvinick and Plaut, 2006; Botvinick and Watanabe, 2007). As we have seen, the dissociations observed between item and order processing, at both neuropsychological and neuroimaging levels, are difficult to reconcile with these latter accounts. However, this still leaves the question of the nature of serial order codes open. A possible hypothesis is that the right intraparietal sulcus area involved in serial order coding is involved in the creation of temporary domain-general ordinal representations, allowing the encoding of relational information about items within a sequence, and this in a domain-general manner. This is supported by data showing that this region responds to ordinal information also in other domains such as number processing and alphabetic order processing (Pinel et al., 2001; Fias et al., 2007; Kaufmann et al., 2009; Dormal et al., 2012). The general principle of ordinal coding that is, the assumption that serial order representations vary along a dimension that is organized in some ordinal manner (e.g., ordinal ranks, time-based ordinal information, large-to-small primacy gradient principle) is also at the heart of many of the computational serial order STM models discussed here (Gupta and MacWhinney, 1997; Henson, 1998; Page and Norris, 1998; Brown et al., 2000; Farrell and Lewandowsky, 2002; Botvinick and Plaut, 2006)).
We also cannot exclude the possibility that the right intraparietal sulcus area identified here reflects an ancillary attentional function during the processing of serial order information, given the bilateral intraparietal sulci have been shown to be linked to task-related attention (Todd and Marois, 2004; Duncan, 2010; Majerus et al., 2012). In the studies linking the right intraparietal sulcus to processing and maintenance of serial order information, much care had been taken to equate the item and order STM conditions with respect to task difficulty, which was reflected by equal levels of task performance. However, this does not necessarily guarantee that attentional demands were exactly the same in the two conditions. It may even be the case that a specific form of attentional processes directly supports representation of serial order information. Van Dijck et al. (2013) showed that serial position coding in STM and spatial attention actually interact: they showed a rightward spatial attention bias in a dot detection task which linearly increased as a function of the serial position of the items being retrieved in a concurrent STM task, the bias being largest when items from the end of the STM list were retrieved, and the bias being non-existent when items from the start of the STM list were retrieved. These results give rise to a further hypothesis of serial order coding in STM, namely the involvement of spatial attention and spatial frames (i.e., left-to-right reference frame) as supporting the coding of serial position in STM; this hypothesis is in line with greater involvement of the right vs. left intraparietal sulcus, since the right inferior parietal cortex is known to support this type of attention processes (Bricolo et al., 2002). Finally, as already discussed, executive processes such as control of interference and inhibition supported by ventro-lateral prefrontal cortex are also an important factor associated with serial order maintenance and recall, and in some patients, deficits at this level may explain their serial order deficits (Jefferies et al., 2008; Hoffman et al., 2012). In sum, given the current co-existence of many alternative and not necessarily mutually exclusive hypotheses about the processing of novel, arbitrary serial order information, future studies will be needed to achieve a better understanding of the specific neural and cognitive codes and processes involved in serial order maintenance.
Conclusions
The account presented here considers that short-term maintenance of verbal information during repetition is not subtended by specific and dedicated storage buffers, contrary to a number of theoretical models of verbal maintenance (Martin et al., 1994b; Baddeley et al., 1998; Baddeley and Logie, 1999; Vallar and Papagno, 2002). Rather, short-term storage results from synchronized and flexible recruitment of language, attentional and serial order processing systems. In this sense, short-term maintenance is an emergent function which depends on neural networks shared with other cognitive functions, including language processing networks (Cowan, 1995; Postle, 2006; Buchsbaum and D'Esposito, 2008). This account is similar to proposals by Postle (2006) and Cowan (1995) who also consider STM as an emergent function, resulting from temporary activation of long-term memory knowledge bases in the language processing networks, and attentional selection and control processes via fronto-parietal networks. Like language processing architectures, these proposals do not specifically consider the role of serial order processing and maintenance. On the other hand, serial order processing has been the focus of very detailed computational frameworks of verbal STM, with some additional consideration for interactions with linguistic representational systems, but no consideration of attentional processes. The present work is an attempt at providing a bridge between three core component processes of verbal short-term maintenance, taking the form of an integrative cognitive and neural framework of the language, attention and serial order processes supporting maintenance during language repetition. This framework provides new perspectives for the understanding of language repetition and maintenance deficits, by allowing for a nuanced and integrative assessment of the multiple components that can lead to breakdown of maintenance of verbal information, including the consideration of the non-linguistic domain-general mechanisms involved in language repetition.
Conflict of Interest Statement
The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
This work was supported by grants F.R.S.-FNRS N°1.5.056.10 (Fund for Scientific Research FNRS, Belgium) and PAI-IUAP P7/11(Belgian Science Policy).
Footnotes
1. ^Note that for the patient described by Hamilton and Martin (2007), the patient's interference control deficits were not limited to semantic information, but also involved phonological information. See page 22 for a discussion of the role of the inferior prefrontal cortex for interference resolution at the semantic versus phonological level.
2. ^CG's specific brain lesion could not be clearly determined; a CT scan showed damage to the left anterior lobe; however other white matter lesions could not be excluded due to traumatic brain injury which leads to diffuse axonal injuries which often are not visible via standard CT or MRI scanning protocols (Arfanakis et al., 2002).
References
Acheson, D. J., and MacDonald, M. C. (2009). Verbal working memory and language production: common approaches to the serial ordering of verbal information. Psychol. Bull. 135, 50–68. doi: 10.1037/a0014411
Arfanakis, K., Haughton, V. M., Carew, J. D., Rogers, B. P., Dempsey, R. J., and Meyerand, M. E. (2002). Diffusion tensor MR imaging in diffuse axonal injury. Am. J. Neuroradiol. 23, 794–802.
Attout, L., Van der Kaa, M. A., George, M., and Majerus, S. (2012). Distinguishing verbal short-term memory and language impairment: the importance of short-term memory for serial order. Aphasiology 26, 355–382. doi: 10.1080/02687038.2011.604303
Awh, E., Jonides, J., Smith, E. E., Buxton, R. B., Frank, L. R., Love, T., et al. (1999). Rehearsal in spatial working memory: evidence from neuroimaging. Psychol. Sci. 10, 433–437. doi: 10.1111/1467-9280.00182
Baddeley, A., Gathercole, S., and Papagno, C. (1998). The phonological loop as a language learning device. Psychol. Rev. 105, 158–173. doi: 10.1037/0033-295X.105.1.158
Baddeley, A. D., and Hitch, G. J. (1974). “Working memory,” in The Psychology of Learning and Motivation, ed G. H. Bower (San Diego, CA: Academic Press), 47–90.
Baddeley, A. D., Hitch, G. J., and Allen, R. J. (2009). Working memory and binding in sentence recall. J. Mem. Lang. 61, 438–456. doi: 10.1016/j.jml.2009.05.004
Baddeley, A. D., Lewis, V., and Vallar, G. (1984). Exploring the articulatory loop. Q. J. Exp. Psychol. 36, 233–252.
Baddeley, A. D., and Logie, R. H. (1999). “Working memory: the multiple-component model,” in Models of Working Memory: Mechanisms of Active Maintenance and Executive Control, eds A. Miyake and P. Shah (Cambridge: Cambridge University Press), 28–61.
Barde, L. H. F., Schwartz, M. F., Chrysikou, E. G., and Thompson-Schill, S. L. (2010). Reduced short-term memory span in aphasia and susceptibility to interference: ontribution of material-specific maintenance deficits. Neuropsychologia 48, 909–920.
Barrouillet, P., Bernardin, S., and Camos, V. (2004). Time constraints and resource sharing in adults' working memory spans. J. Exp. Psychol. Gen. 133, 83–100. doi: 10.1037/0096-3445.133.1.83
Basso, A., Spinnler, H., Vallar, G., and Zanobio, M. E. (1982). Left hemisphere damage and selective impairment of auditory verbal short-term memory. A case study. Neuropsychologia 20, 263–274. doi: 10.1016/0028-3932(82)90101-4
Becker, J. T., MacAndrew, D. K., and Fiez, J. A. (1999). A comment on the functional localization of the phonological storage subsystem of working memory. Brain Cogn. 41, 27–38. doi: 10.1006/brcg.1999.1094
Binder, J. R., Desai, R. H., Graves, W. W., and Conant, L. I. (2009). Where is the semantic system? a critical review and meta-analysis of 120 functional neuroimaging studies. Cereb. Cortex 19, 2767–2796. doi: 10.1093/cercor/bhp055
Binder, J. R., Frost, J. A., Hammeke, T. A., Bellgowan, P. S. F., Springer, J. A., Kaufman, J. N., et al. (2000). Human temporal lobe activation by speech and nonspeech sounds. Cereb. Cortex 10, 512–528. doi: 10.1093/cercor/10.5.512
Botvinick, M., and Plaut, D. C. (2006). Short-term memory for serial order: a recurrent neural network model. Psychol. Rev. 113, 201–233. doi: 10.1037/0033-295X.113.2.201
Botvinick, M., and Watanabe, T. (2007). From numerosity to ordinal rank: a gain-field model of serial order representation in cortical working memory. J. Neurosci. 27, 8636–8642. doi: 10.1523/JNEUROSCI.2110-07.2007
Brahmbhatt, S. B., McAuley, T., and Barch, D. M. (2008). Functional developmental similarities and differences in the neural correlates of verbal and nonverbal working memory tasks. Neuropsychologia 46, 1020–1031. doi: 10.1016/j.neuropsychologia.2007.11.010
Brener, R. (1940). An experimental investigation of memory span. J. Exp. Psychol. 26, 467–482. doi: 10.1037/h0061096
Bricolo, E., Gianesini, T., Fanini, A., Bundesen, C., and Chelazzi, L. (2002). Serial attention mechanisms in visual search: a direct behavioral demonstration. J. Cogn. Neurosci. 14, 980–993. doi: 10.1162/089892902320474454
Brown, G. D. A., Preece, T., and Hulme, C. (2000). Oscillator-based memory for serial order. Psychol. Rev. 107, 127–181. doi: 10.1037/0033-295X.107.1.127
Buchsbaum, B. R., and D'Esposito, M. (2008). The search for the phonological store: from loop to convolution. J. Cogn. Neurosci. 20, 762–778. doi: 10.1162/jocn.2008.20501
Buchsbaum, B. R., Baldo, J., Okada, K., Berman, K. F., Dronkers, N. F., D'Esposito, M., et al. (2011). Conduction aphasia, sensory-motor integration, and phonological short-term memory – an aggregate analysis of lesion and fMRI data. Brain Lang. 119, 119–128. doi: 10.1016/j.bandl.2010.12.001
Buchsbaum, B. R., Olsen, R. K., Koch, P., and Berman, K. F. (2005). Human dorsal and ventral auditory streams subserve rehearsal-based and echoic processes during verbal working memory. Neuron 48, 687–697. doi: 10.1016/j.neuron.2005.09.029
Burgess, N., and Hitch, G. J. (1999). Memory for serial order: a network model of the phonological loop and its timing. Psychol. Rev. 106, 551–581. doi: 10.1037/0033-295X.106.3.551
Burgess, N., and Hitch, G. J. (2006). A revised model of short-term memory and long-term learning of verbal sequences. J. Mem. Lang. 55, 627–652. doi: 10.1016/j.jml.2006.08.005
Chein, J. M., and Fiez, J. A. (2001). Dissociating verbal working memory system components using a delayed serial recall task. Cereb. Cortex 11, 1003–1014. doi: 10.1093/cercor/11.11.1003
Collette, F., Majerus, S., Van der Linden, M., Dabe, P., Degueldre, C., Delfiore, G., et al. (2001). Contribution of long-term memory to verbal short-term memory tasks: a PET activation study. Memory 9, 249–259. doi: 10.1080/09658210143000056
Cowan, N. (1988). Evolving conceptions of memory storage, selective attention, and their mutual constraints within the human information-processing system. Psychol. Bull. 104, 163–191. doi: 10.1037/0033-2909.104.2.163
Cowan, N. (1995). Attention and Memory: An Integrated Framework. New York, NY: Oxford University Press.
Cowan, N., Elliott, E. M., Saults, J. S., Morey, C. C., Mattox, S., Hismjatullina, A., et al. (2005). On the capacity of attention: its estimation and its role in working memory and cognitive aptitudes. Cogn. Psychol. 51, 42–100. doi: 10.1016/j.cogpsych.2004.12.001
Cowan, N., Li, D., Moffitt, A., Becker, T. M., Martin, E. A., Saults, J. S., et al. (2011). A neural region of abstract working memory. J. Cogn. Neurosci. 23, 2852–2863. doi: 10.1162/jocn.2011.21625
Croot, K., Patterson, K., and Hodges, J. R. (1999). Familial progressive aphasia: insights into the nature and deterioration of single word processing. Cogn. Neuropsychol. 16, 705–747. doi: 10.1080/026432999380627
Dell, G. S. (1986). A spreading activation theory of retrieval in sentence production. Psychol. Rev. 93, 283–321. doi: 10.1037/0033-295X.93.3.283
Dell, G. S., Reed, K. D., Adams, D. R., and Meyer, A. S. (2000). Speech errors, phonotactic constraints, and implicit learning: a study of the role of experience in language production. J. Exp. Psychol. Learn. Mem. Cogn. 26, 1355–1367.
Desgranges, B., Matuszewski, V., Piolino, P., Chételat, G., Mézenge, F., Landeau, B., et al. (2007). Anatomical and functional alterations in Semantic Dementia: a voxel based MRI and PET study. Neurobiol. Aging 28, 1904–1913. doi: 10.1016/j.neurobiolaging.2006.08.006
Dormal, V., Dormal, G., Joassin, F., and Pesenti, M. (2012). A common right fronto-parietal network for numerosity and duration processing: an fMRI study. Hum. Brain Mapp. 33, 1490–1501. doi: 10.1002/hbm.21300
Duhamel, J. R., and Poncet, M. (1986). Deep dysphasia in a case of phonemic deafness: role of the right hemisphere in auditory language comprehension. Neuropsychologia 24, 769–779. doi: 10.1016/0028-3932(86)90076-X
Duncan, J. (2010). The multiple-demand (MD) system of the primate brain: mental programs for intelligent behavior. Trends Cogn. Sci. 14, 172–179. doi: 10.1016/j.tics.2010.01.004
Emrich, S. M., Riggall, A. C., LaRocque, J. J., and Postle, B. R. (2013). Distributed patters of activity in sensory cortex reflect the precision of multiple items maintained in visual short-term memory. J. Neurosci. 33, 6516–6523. doi: 10.1523/JNEUROSCI.5732-12.2013.
Engle, R. W., and Kane, M. J. (2004). “Executive attention, working memory capacity, and a two-factor theory of cognitive control,” in The Psychology of Learning and Motivation, ed B. H. Ross (San Diego, CA: Elsevier Academic Press), 145–199.
Farrell, S., and Lewandowsky, S. (2002). An endogenous distributed model of ordering in serial recall. Psychon. Bull. Rev. 9, 59–79. doi: 10.3758/BF03196257
Fias, W., Lammertyn, J., Caessens, B., and Orban, G. A. (2007). Processing of abstract ordinal knowledge in the horizontal segment of the intraparietal sulcus. J. Neurosci. 27, 8592–8596. doi: 10.1523/JNEUROSCI.2076-07.2007
Fiebach, C. J., Friederici, A. D., Smith, E. E., and Swinney, D. (2007). Lateral inferotemporal cortex maintains conceptual–semantic representations in verbal working memory. J. Cogn. Neurosci. 19, 2035–2049. doi: 10.1162/jocn.2007.19.12.2035
Fiebach, C. J., Rissman, J., and D'Esposito, M. (2006). Modulation of inferotemporal cortex during verbal working memory maintenance. Neuron 51, 251–261. doi: 10.1016/j.neuron.2006.06.007
Fougnie, D., and Marois, R. (2007). Executive working memory load induces inattentional blindness. Psychon. Bull. Rev. 14, 142–147. doi: 10.3758/BF03194041
Foygel, D., and Dell, G. S. (2000). Models of impaired lexical access in speech production. J. Mem. Lang. 43, 182–216. doi: 10.1006/jmla.2000.2716
Freedman, M. L., and Martin, R. C. (2001). Dissociable components of short-term memory and their relation to long-term learning. Cogn. Neuropsychol. 18, 193–226.
Friederici, A. D. (2012). The cortical language circuit: from auditory perception to sentence comprehension. Trends Cogn. Sci. 16, 262–268. doi: 10.1016/j.tics.2012.04.001
Garrett, M. F. (1980). “Levels of processing in sentence production,” in Language Production: Speech and Talk, Vol. 1 ed B. Butterworth (San Diego, CA: Academic Press), 177–220.
Gettigan, C., Warren, J. E., Eisner, F., Marshall, C. R., Shanmugalingam, P., and Scott, S. K. (2011). Neural correlates of sublexical processing in phonological working memory. J. Cogn. Neurosci. 23, 961–977. doi: 10.1162/jocn.2010.21491
Good, C. D., Scahill, R. I., Fox, N. C., Ashburner, J., Friston, K., Chan, D., et al. (2002). Automatic differentiation of anatomical patterns in the human brain: validation with studies of degenerative dementias. Neuroimage 17, 26–46. doi: 10.1006/nimg.2002.1202
Gorno-Tempini, M. L., Brambati, S. M., Ginex, V., Ogar, J., Dronkers, N. F., Marcone, A., et al. (2008). The logopenic/phonological variant of primary progressive aphasia. Neurology 17, 1227–1234. doi: 10.1212/01.wnl.0000320506.79811.da
Gratton, C., Sreenivasan, K. K., Silver, M. A., and D'Esposito, M. (2013). Attention selectively modifies the representation of individual faces in the human brain. J. Neurosci. 33, 6979–6989. doi: 10.1523/JNEUROSCI.4142-12.2013
Gupta, P. (2003). Examining the relationship between word learning, nonword repetition and immediate serial recall in adults. Q. J. Exp. Psychol. 56A, 1213–1236.
Gupta, P., Lipinski, J., Abbs, B., and Lin, P. H. (2005). Serial position effects in nonword repetition. J. Mem. Lang. 53, 141–162. doi: 10.1016/j.jml.2004.12.002
Gupta, P., and MacWhinney, B. (1997). Vocabulary acquisition and verbal short-term memory: computational and neural bases. Brain Lang. 59, 267–333. doi: 10.1006/brln.1997.1819
Gupta, P., and Tisdale, J. (2009). Does phonological short-term memory causally determine vocabulary learning? Toward a computational resolution of the debate. J. Mem. Lang. 61, 481–502. doi: 10.1016/j.jml.2009.08.001
Haller, S., Radue, E. W., Erb, M., Grodd, W., and Kircher, T. (2005). Overt sentence production in event-related fMRI. Neuropsychologia 43, 807–814. doi: 10.1016/j.neuropsychologia.2004.09.007
Hamilton, A. C., and Martin, R. C. (2005). Dissociations among tasks involving inhibition: a single-case study. Cogn. Affect. Behav. Neurosci. 5, 1–13. doi: 10.3758/CABN.5.1.1
Hamilton, A., and Martin, R. C. (2007). Proactive interference in a semantic short-term memory deficit: role of semantic and phonological relatedness. Cortex 43, 112–123. doi: 10.1016/S0010-9452(08)70449-0
Hartley, T., and Houghton, G. (1996). A linguistically constrained model of short-term memory for nonwords. J. Mem. Lang. 35, 1–31. doi: 10.1006/jmla.1996.0001
Hautzel, H., Mottaghy, F. M., Schmidt, D., Zemb, M., Shah, N. J., Müller-Gärtner, H.-W., et al. (2002). Topographic segregation and convergence of verbal, object, shape and spatial working memory in humans. Neurosci. Lett. 323, 156–160. doi: 10.1016/S0304-3940(02)00125-8
Henson, R. N. A. (1998). Short-term memory for serial order: the start-end model. Cogn. Psychol. 36, 73–137. doi: 10.1006/cogp.1998.0685
Henson, R. N. A., Burgess, N., and Frith, C. D. (2000). Recoding, storage, rehearsal, and grouping in verbal short-term memory: an fMRI study. Neuropsychologia 38, 426–440. doi: 10.1016/S0028-3932(99)00098-6
Herman, A. B., Houde, J. F., Vinogradov, S., and Nagarajan, S. S. (2013). Parsing the phonological loop: activation timing in the dorsal speech stream determines accuracy in speech reproduction. J. Neurosci. 33, 5439–5453. doi: 10.1523/JNEUROSCI.1472-12.2013
Hickok, G. (2012). Computational neuroanatomy of speech production. Nat. Rev. Neurosci. 13, 135–145.
Hickok, G., and Poeppel, D. (2007). The cortical organization of speech processing. Nat. Rev. Neurosci. 8, 393–402. doi: 10.1038/nrn2113
Hodges, J. R., Patterson, K. E., Oxbury, S., and Funnell, E. (1992). Semantic dementia. Progressive fluent aphasia with temporal lobe atrophy. Brain 115, 1783–1808.
Hoffman, P., Jefferies, E., Ehsan, S., Hopper, S., and Lambon Ralph, M. A. (2009). Selective short-term memory deficits arise from impaired domain-general semantic control mechanisms. J. Exp. Psychol. Learn. Mem. Cogn. 35, 137–156. doi: 10.1037/a0013985
Hoffman, P., Jefferies, E., Ehsan, S., Jones, R. W., and Lambon Ralph, M. A. (2012). How does linguistic knowledge contribute to short-term memory? Contrasting effects of impaired knowledge and executive control. Aphasiology 26, 383–403. doi: 10.1080/02687038.2011.581798
Howard, D., and Franklin, S. E. (1988). Missing the Meaning.A Cognitive Neuropsychological Study of the Processing of Words by an Aphasic Patient. Cambridge, MA: MIT.
Hulme, C., Maughan, S., and Brown, G. D. (1991). Memory for familiar and unfamiliar words: evidence for a long-term memory contribution to short-term memory span. J. Mem. Lang. 30, 685–701. doi: 10.1016/0749-596X(91)90032-F
Jacquemot, C., and Scott, S. K. (2006). What is the relationship between phonological short-term memory and speech processing? Trends Cogn. Sci. 10, 480–486.
Jefferies, E., Baker, S. S., Doran, M., and Lambon Ralph, M. A. (2007). Refractory effects in stroke aphasia: a consequence of poor semantic control. Neuropsychologia 45, 1065–1079. doi: 10.1016/j.neuropsychologia.2006.09.009
Jefferies, E., Frankish, C. R., and Lambon Ralph, M. A. (2006). Lexical and semantic binding in verbal short-term memory. J. Mem. Lang. 54, 81–98. doi: 10.1016/j.jml.2005.08.001
Jefferies, E., Hoffman, P., Jones, R., and Lambon Ralph, M. A. (2008). The impact of semantic impairment on verbal short-term memory in stroke aphasia and semantic dementia: a comparative study. J. Mem. Lang. 58, 66–87. doi: 10.1016/j.jml.2007.06.004
Jefferies, E., Jones, R. W., Bateman, D., and Lambon Ralph, M. A. (2005). A semantic contribution to nonword recall. Evidence for intact phonological processes in semantic dementia. Cogn. Neuropsychol. 22, 183–212. doi: 10.1080/02643290442000068
Kaas, A. L., van Mier, H., Visser, M., and Goebel, R. (2013). The neural substrate for working memory of tactile surface texture. Hum. Brain Mapp. 34, 1148–1162. doi: 10.1002/hbm.21500
Kaufmann, L., Vogel, S. E., Starke, M., Kremser, C., and Schocke, M. (2009). Numerical and non-numerical ordinality processing in children with and without developmental dyscalculia: evidence from fMRI. Cogn. Dev. 24, 486–494. doi: 10.1016/j.cogdev.2009.09.001
Knott, R., Patterson, K., and Hodges, J. R. (1997). Lexical and semantic binding effects in short-term memory: evidence from semantic dementia. Cogn. Neuropsychol. 14, 1165–1216. doi: 10.1080/026432997381303
Leclercq, A. L., and Majerus, S. (2010). Serial order short-term memory predicts vocabulary development: evidence from a longitudinal study. Dev. Psychol. 46, 417–427. doi: 10.1037/a0018540
Leung, H. C., Gore, J. C., and Goldman-Rakic, P. S. (2002). Sustained mnemonic response in the human middle frontal gyrus during on-line storage of spatial memoranda. J. Cogn. Neurosci. 14, 659–671. doi: 10.1162/08989290260045882
Leung, H. C., Seelig, D., and Gore, J. C. (2004). The effect of memory load on cortical activity in the spatial working memory circuit. Cogn. Affect. Behav. Neurosci. 4, 553–563. doi: 10.3758/CABN.4.4.553
Lewis-Peacock, J. A., Drysdale, A. T., Oberauer, K., and Postle, B. R. (2012). Neural evidence for a distinction between short-term memory and the focus of attention. J. Cogn. Neurosci. 24, 61–79. doi: 10.1162/jocn_a_00140
Lycke, C., Specht, K., Ersland, L., and Hugdahl, K. (2008). An fMRI study of phonological and spatial working memory using identical stimuli. Scand. J. Psychol. 49, 393–401.
Majerus, S. (2009). “Verbal short-term memory and temporary activation of language representations: the importance of distinguishing item and order information,” in Interactions between Short-Term and Long-Term Memory in the Verbal Domain, eds A. S. Thorn and M. Page (Hove: Psychology Press), 244–276.
Majerus, S., Attout, L., D'Argembeau, A., Degueldre, C., Fias, W., Maquet, P., et al. (2012). Attention supports verbal short-term memory via competition between dorsal and ventral attention networks. Cereb. Cortex 22, 1086–1097. doi: 10.1093/cercor/bhr174
Majerus, S., Norris, D., and Patterson, K. (2007a). What do patients with semantic dementia remember in verbal short-term memory? Sounds and order but not words. Cogn. Neuropsychol. 24, 131–151.
Majerus, S., Bastin, C., Poncelet, M., Van der Linden, M., Salmon, E., Collette, F., et al. (2007b). Short-term memory and the left intraparietal sulcus: focus of attention? Further evidence from a face short-term memory paradigm. Neuroimage 35, 353–367.
Majerus, S., Van der Linden, M., Poncelet, M., and Metz-Lutz, M. N. (2004a). Can phonological and semantic short-term memory be dissociated? Further evidence Landau-Kleffner Syndrome. Cogn. Neuropsychol. 21, 491–512.
Majerus, S., Van der Linden, M., Mulder, L., Meulemans, T., and Peters, F. (2004b). Verbal short-term memory reflects the sublexical organization of the phonological language network: evidence from an incidental phonotactic learning paradigm. J. Mem. Lang. 51, 297–306.
Majerus, S., Poncelet, M., Van der Linden, M., and Weekes, B. (2008a). Lexical learning in bilingual adults:the relative importance of short-term memory for serial order and phonological knowledge. Cognition 107, 395–419.
Majerus, S., Belayachi, S., De Smedt, B., Leclercq, A. L., Martinez, T., Schmidt, C., et al. (2008b). Neural networks for short-term memory for order differentiate high and low proficiency bilinguals. Neuroimage 42, 1698–1713.
Majerus, S., and D'Argembeau, A. (2011). Verbal short-term memory reflects the organization of long-term memory. Further evidence from short-term memory for emotional words. J. Mem. Lang. 64, 181–197. doi: 10.1016/j.jml.2010.10.003
Majerus, S., D'Argembeau, A., Martinez, T., Belayachi, S., Van der Linden, M., Collette, F., et al. (2010). The commonality of neural networks for verbal and visual short-term memory. J. Cogn. Neurosci. 22, 2570–2593. doi: 10.1162/jocn.2009.21378
Majerus, S., Heiligenstein, L., Gautherot, N., Poncelet, M., and Van der Linden, M. (2009). The impact of auditory selective attention on verbal short-term memory and vocabulary development. J. Exp. Child Psychol. 103, 66–86. doi: 10.1016/j.jecp.2008.07.004
Majerus, S., Lekeu, F., Van der Linden, M., and Salmon, E. (2001). Deep dysphasia: further evidence on the relationship between phonological short-term memory and language processing impairments. Cogn. Neuropsychol. 18, 385–410.
Majerus, S., Poncelet, M., Van der Linden, M., Albouy, G., Salmon, E., Sterpenich, V., et al. (2006a). The left intraparietal sulcus and verbal short-term memory: focus of attention or serial order? Neuroimage 32, 880–891.
Majerus, S., Poncelet, M., Greffe, C., and Van der Linden, M. (2006b). Relations between vocabulary development and verbal short-term memory: the importance of short-term memory for serial order information. J. Exp. Child Psychol. 93, 95–119.
Majerus, S., Poncelet, M., Elsen, B., and Van der Linden, M. (2006c). Exploring the relationship between new word learning and short-term memory for serial order recall, item recall and item recognition. Eur. J. Cogn. Psychol. 18, 848–873.
Makuuchi, M., and Friederici, A. D. (2013). Hierarchical functional connectivity between the core language system and the working memory system. Cortex (in press). doi: 10.1016/j.cortex.2013.01.007
Marshuetz, C., Reuter-Lorenz, P. A., Smith, M.-C., Jonides, J., and Noll, D. C. (2006). Working memory for order and the parietal cortex: an event-related functional magnetic resonance imaging study. Neuroscience 139, 311–316. doi: 10.1016/j.neuroscience.2005.04.071
Marshuetz, C., Smith, E. E., Jonides, J., DeGutis, J., and Chenevert, T. L. (2000). Order information in working memory: fMRI evidence for parietal and prefrontal mechanisms. J. Cogn. Neurosci. 12, 130–144. doi: 10.1162/08989290051137459
Martin, N., Dell, G. S., Saffran, E. M., and Schwartz, M. F. (1994a). Origins of paraphasias in deep dysphasia: testing the consequences of a decay impairment to an interactive spreading activation model of lexical retrieval. Brain Lang. 47, 609–660. doi: 10.1006/brln.1994.1061
Martin, R. C., Shelton, J. R., and Yaffee, L. S. (1994b). Language processing and working memory: neuropsychological evidence for separate phonological and semantic capacities. J. Mem. Lang. 33, 83–111. doi: 10.1006/jmla.1994.1005
Martin, N., and Saffran, E. M. (1992). A computational account of deep dysphasia: evidence from a single case study. Brain Lang. 43, 240–274. doi: 10.1016/0093-934X(92)90130-7
Martin, N., Saffran, E. M., and Dell, G. S. (1996). Recovery in deep dysphasia: evidence for a relation between auditory-verbal STM capacity and lexical errors in repetition. Brain Lang. 52, 83–113. doi: 10.1006/brln.1996.0005
Martin, R. C., and He, T. (2004). Semantic short-term memory and its role in sentence processing: a replication. Brain Lang. 89, 76–82. doi: 10.1016/S0093-934X(03)00300-6
Martin, R. C., Lesch, M. F., and Bartha, M. C. (1999). Independence of input and output phonology in word processing and short-term memory. J. Mem. Lang. 41, 3–29. doi: 10.1006/jmla.1999.2637
Martin, R. C., and Romani, C. (1994). Verbal working memory and sentence comprehension: a multiple-components view. Neuropsychology 8, 506–523. doi: 10.1037/0894-4105.8.4.506
Martin, R. C., Wu, D., Freedman, M., Jackson, E. F., and Lesch, M. (2003). An event-related fMRI investigation of phonological versus semantic short-term memory. J. Neurolinguist. 16, 341–360. doi: 10.1016/S0911-6044(03)00025-3
Meyer, M. L., Spunt, R. P., Berkman, E. T., Taylor, S. E., and Lieberman, M. D. (2012). Evidence for social working memory from a parametric functional MRI study. Proc. Natl. Acad. Sci. U.S.A. 109, 1883–1888. doi: 10.1073/pnas.1121077109
Michel, F., and Andreewsky, E. (1983). Deep dysphasia: an analogue of deep dyslexia in the auditory modality. Brain Lang. 18, 212–223. doi: 10.1016/0093-934X(83)90016-0
Mosse, E. K., and Jarrold, C. (2008). Hebb learning, verbal short-term memory, and the acquisition of phonological forms in children. Q. J. Exp. Psychol. 61, 505–514. doi: 10.1080/17470210701680779
Mummery, C. J., Patterson, K., Price, C. J., Ashburner, J., Frackowiak, R. S., and Hodges, J. R. (2000). A voxel-based morphometry study of semantic dementia: relationship between temporal lobe atrophy and semantic memory. Ann. Neurol. 47, 36–45.
Nairne, J. S., and Kelley, M. R. (2004). Separating item and order information through process dissociation. J. Mem. Lang. 50, 113–133. doi: 10.1016/j.jml.2003.09.005
Narayanan, N., Prabhakaran, V., Bunge, S. A., Christoff, K., Fine, E. M., and Gabrieli, J. D. (2005). The role of prefrontal cortex in the maintenance of verbal working memory information: an event-related fMRI analysis. Neuropsychology 19, 223–232. doi: 10.1037/0894-4105.19.2.223
Nee, D. E., and Jonides, J. (2008). Neural correlates of access to short-term memory. Proc. Natl. Acad. Sci. U.S.A. 105, 14228–14233. doi: 10.1073/pnas.0802081105
Nee, D. E., and Jonides, J. (2011). Dissociable contributions of prefrontal cortex and the hippocampus to short-term memory: evidence for a 3-state model of memory. Neuroimage 54, 1540–1548.
Nee, D. E., and Jonides, J. (2013). Neural evidence for a 3-state model of visual short-term memory. Neuroimage 74, 1–11. doi: 10.1016/j.neuroimage.2013.02.019
Nystrom, L. E., Braver, T. S., Sabb, F. W., Delgado, M. R., Noll, D. C., and Cohen, J. D. (2000). Working memory for letters, shapes, and locations: fMRI evidence against stimulus-based regional organization in human prefrontal cortex. Neuroimage 11, 424–446. doi: 10.1006/nimg.2000.0572
Oberauer, K. (2002). Access to information in working memory: exploring the focus of attention. J. Exp. Psychol. Learn. Mem. Cogn. 28, 411–421. doi: 10.1037/0278-7393.28.3.411
Ötzekin, I., Davachi, L., and McElree, B. (2010). Are representations in working memory distinct from representations in long-term memory?: neural evidence in support of a single store. Psychol. Sci. 21, 1123–1133. doi: 10.1177/0956797610376651
Pa, J., Wilson, S. M., Pickell, H., Bellugi, U., and Hickok, G. (2008). Neural organization of linguistic short-term memory is sensory modality-dependent: evidence from signed and spoken language. J. Cogn. Neurosci. 20, 2198–2210. doi: 10.1162/jocn.2008.20154
Page, M. P. A., Cumming, N., Madge, A., and Norris, D. (2007). Speech errors and the phonological similarity effect in short-term memory: evidence suggesting a common locus. J. Mem. Lang. 56, 49–64. doi: 10.1016/j.jml.2006.09.002
Page, M. P. A., and Norris, D. (1998). The Primacy model: a new model of immediate serial recall. Psychol. Rev. 105, 761–781. doi: 10.1037/0033-295X.105.4.761-781
Papagno, C., Vernice, M., and Cecchetto, C. (2013). Phonology without semantics? Good enough for verbal short-term memory. Evidence from a patient with semantic dementia. Cortex 49, 626–636. doi: 10.1016/j.cortex.2012.04.015
Papoutsi, M., de Zwart, J. A., Jansma, J. M., Pickering, M. J., Bednar, J. A., and Horwitz, B. (2009). From phonemes to articulatory codes: an fMRI study of the role of Broca's area in speech production. Cereb. Cortex 19, 2156–2165. doi: 10.1093/cercor/bhn239
Patterson, K. E., Graham, N., and Hodges, J. R. (1994). The impact of semantic memory loss on phonological representations. J. Cogn. Neurosci. 6, 57–69. doi: 10.1162/jocn.1994.6.1.57
Paulesu, E., Frith, C. D., and Frackowiak, R. S. J. (1993). The neural correlates of the verbal component of working memory. Nature 362, 342–345. doi: 10.1038/362342a0
Pinel, P. H., Dehaene, S., Rivière, D., and LeBihan, D. (2001). Modulation of parietal activation by semantic distance in a number comparison task. Neuroimage 14, 1013–1026. doi: 10.1006/nimg.2001.0913
Poirier, M., and Saint-Aubin, J. (1996). Immediate serial recall, word frequency, item identity and item position. Can. J. Exp. Psychol. 50, 408–412. doi: 10.1037/1196-1961.50.4.408
Postle, B. R. (2005). Delay-period activity in the prefrontal cortex: one function is sensory gating. J. Cogn. Neurosci. 17, 1679–1690. doi: 10.1162/089892905774589208
Postle, B. R. (2006). Working memory as an emergent property of the mind and brain. Neuroscience 139, 23–28. doi: 10.1016/j.neuroscience.2005.06.005
Rämä, P., Sala, J. B., Gillen, J. S., Pekar, J. J., and Courtney, S. M. (2001). Dissociation of the neural systems for working memory maintenance of verbal and nonspatial visual information. Cogn. Affect. Behav. Neurosci. 1, 161–171. doi: 10.3758/CABN.1.2.161
Ranganath, C., Cohen, M. X., Dam, C., and D'Esposito, M. (2004). Inferior temporal, prefrontal, and hippocampal contributions to visual working memory maintenance and associative memory retrieval. J. Neurosci. 24, 3917–3925. doi: 10.1523/JNEUROSCI.5053-03.2004
Rauschecker, J. P., and Scott, S. K. (2009). Maps and streams in the auditory cortex: nonhuman primates illuminate human speech processing. Nat. Neurosci. 12, 718–724. doi: 10.1038/nn.2331
Ravizza, S. M., Delgado, M. R., Chein, J. M., Becker, J. T., and Fiez, J. A. (2004). Functional dissociations within the inferior parietal cortex in verbal working memory. Neuroimage 22, 562–573. doi: 10.1016/j.neuroimage.2004.01.039
Rypma, B., and D'Esposito, M. (1999). The roles of prefrontal brain regions in components of working memory: effects of memory load and individual differences. Proc. Natl. Acad. Sci. U.S.A. 96, 6558–6563. doi: 10.1073/pnas.96.11.6558
Rypma, B., Berger, J. S., and D'Esposito, M. (2002). The influence of working memory demand and subject performance on prefrontal cortical activity. J. Cogn. Neurosci. 14, 721–731. doi: 10.1162/08989290260138627
Salmon, E., Van der Linden, M., Collette, F., Delfiore, G., Maquet, P., Degueldre, C., et al. (1996). Regional brain activity during working memory tasks. Brain 119, 1617–1625. doi: 10.1093/brain/119.5.1617
Schnur, T. T., Schwartz, M. F., Kimberg, D. Y., Hirshorn, E., Coslett, H. B., and Thompson-Schill, S. L. (2009). Localizing interference during naming: convergent neuroimaging and neuropsychological evidence for the function of Broca's area. Proc. Natl. Acad. Sci. U.S.A. 106, 322–327. doi: 10.1073/pnas.0805874106
Scott, S. K., Catrin Blank, C., Rosen, S., and Wise, R. J. S. (2000). Identification of a pathway for intelligible speech in the left temporal lobe. Brain 123, 2400–2406. doi: 10.1093/brain/123.12.2400
Segaert, K., Kempen, G., Petersson, K. M., and Hagoort, P. (2013). Syntactic priming and the lexical boost effect during sentence production and sentence comprehension: an fMRI study. Brain Lang. 124, 174–183. doi: 10.1016/j.bandl.2012.12.003
Strand, F., Forssberg, H., Klingberg, T., and Norrelgen, F. (2008). Phonological working memory with auditory presentation of pseudo-words: an event related fMRI Study. Brain Res. 1212, 48–54. doi: 10.1016/j.brainres.2008.02.097
Takayama, Y., Kinomoto, K., and Nakamura, K. (2004). Selective impairment of the auditory-verbal short-term memory due to a lesion of the superior temporal gyrus. Eur. Neurol. 51, 115–117. doi: 10.1159/000076792
Thompson-Schill, S. L., Jonides, J., Marshuetz, C., Smith, E. E., D'Esposito, M., Kan, I. P., et al. (2002). Effects of frontal lobe damage on interference effects in working memory. Cogn. Affect. Behav. Neurosci. 2, 109–120. doi: 10.3758/CABN.2.2.109
Todd, J. J., Fougnie, D., and Marois, R. (2005). Visual short-term memory load suppresses temporo-parietal junction activity and induces inattentional blindness. Psychol. Sci. 16, 965–972. doi: 10.1111/j.1467-9280.2005.01645.x
Todd, J. J., and Marois, R. (2004). Capacity limit of visual short-term memory in human posterior parietal cortex. Nature 428, 751–754. doi: 10.1038/nature02466
Tree, J. J., Perfect, T. J., Hirsh, K. W., and Copstick, S. (2001). Deep dysphasic performance in non-fluent progressive aphasia: a case study. Neurocase 7, 473–488. doi: 10.1093/neucas/7.6.473
Treiman, R., and Danis, C. (1988). Short-term memory errors for spoken syllables are affected by the linguistic structure of the syllables. J. Exp. Psychol. Learn. Mem. Cogn. 14, 145–152. doi: 10.1037/0278-7393.14.1.145
Tremblay, P., and Small, S. L. (2011). Motor response selection in overt sentence production: a functional MRI study. Front. Psychol. 2:253. doi: 10.3389/fpsyg.2011.00253
Trojano, L., Stanzione, M., and Grossi, D. (1992). Short-term memory and verbal learning with auditory phonological coding defect: a neuropsychological case study. Brain Cogn. 18, 12–33. doi: 10.1016/0278-2626(92)90108-X
Vallar, G., Basso, A., and Bottini, G. (1990). “Phonological processing and sentence comprehension: a neuropsychological case study,” in Neuropsychological Impairments of Short-Term Memory, eds G. Vallar and T. Shallice (New York, NY: Cambridge University Press), 448–476. doi: 10.1017/CBO9780511665547.022
Vallar, G., and Papagno, C. (2002). “Neuropsychological impairments of verbal short-term memory,” in The Handbook of Memory Disorders, eds A. D. Baddeley, M. D. Kopelman, and B. A. Wilson (Chichester: Wiley), 249–270.
Van Dijck, J.-P. H., Abrahamse, E., Majerus, S., and Fias, W. (2013). Spatial attention interacts with serial order retrieval in verbal working memory. Psychol. Sci. (in press).
Vitevitch, M. S., and Luce, P. A. (1999). Probabilistic phonotactics and neighborhood activation in spoken word recognition. J. Mem. Lang. 40, 374–408. doi: 10.1006/jmla.1998.2618
Warrington, E. K., Logue, V., and Pratt, R. T. C. (1971). The anatomical localisation of selective impairment of auditory verbal short-term memory. Neuropsychologia 9, 377–387. doi: 10.1016/0028-3932(71)90002-9
Keywords: language, repetition, short-term memory, working memory, serial order, attention
Citation: Majerus S (2013) Language repetition and short-term memory: an integrative framework. Front. Hum. Neurosci. 7:357. doi: 10.3389/fnhum.2013.00357
Received: 26 April 2013; Paper pending published: 03 June 2013;
Accepted: 21 June 2013; Published online: 12 July 2013.
Edited by:
Marcelo L. Berthier, University of Malaga, SpainCopyright © 2013 Majerus. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in other forums, provided the original authors and source are credited and subject to any copyright notices concerning any third-party graphics etc.
*Correspondence: Steve Majerus, Department of Psychology - Cognition and Behavior, Université de Liège, Boulevard du Rectorat, B33, 4000 Liège, Belgium e-mail: smajerus@ulg.ac.be