- 1Psychology Department, Middlesex University, London, UK
- 2School of Psychology, Plymouth University, Plymouth, UK
- 3Division of Psychology and Language Sciences, University College London, London, UK
It is well-documented that explicit memory (e.g., recognition) declines with age. In contrast, many argue that implicit memory (e.g., priming) is preserved in healthy aging. For example, priming on tasks such as perceptual identification is often not statistically different in groups of young and older adults. Such observations are commonly taken as evidence for distinct explicit and implicit learning/memory systems. In this article we discuss several lines of evidence that challenge this view. We describe how patterns of differential age-related decline may arise from differences in the ways in which the two forms of memory are commonly measured, and review recent research suggesting that under improved measurement methods, implicit memory is not age-invariant. Formal computational models are of considerable utility in revealing the nature of underlying systems. We report the results of applying single and multiple-systems models to data on age effects in implicit and explicit memory. Model comparison clearly favors the single-system view. Implications for the memory systems debate are discussed.
With the age distribution of the global population steadily increasing, there is great importance in studying and understanding changes in learning and memory in later adulthood. As well as providing a clearer picture of how these functions are affected by cognitive decline, research in this area can shed considerable light on the underlying structure of memory. This has substantial and wide-reaching implications. It is now well-established that explicit memory, the conscious experience of remembering previously learned information, declines with age and moreover the rate of decline is an important predictor of dementia (Wilson et al., 2011). In contrast, there have been numerous reports over the last few decades of age-invariant implicit memory in healthy subjects. Implicit memory, it is often argued, occurs outside of awareness, and is evident when prior experiences affect (e.g., facilitate) performance on tasks that do not require conscious recollection of those experiences (Schacter, 1987). Reports of differential effects of age on explicit and implicit memory have led many to conclude that the two are driven by functionally distinct memory systems. If true, then preservation of implicit memory might open up significant opportunities to remediate cognitive decline, aiding such important real-life demands as acquiring face-name pairs or learning medication routines. Moreover, because it has been suggested that implicit memory is preserved in healthy older individuals but not those with early Alzheimer's Disease, well-designed implicit tasks might provide a useful diagnostic tool for pathological aging (see Fleischman, 2007). In this article we review observations that have led researchers to conclude that implicit memory is preserved with age. We discuss various issues that undermine this interpretation, as well as the notion that the two forms of memory are controlled by separate systems.
Explicit and Implicit Memory in Normal Aging
Perhaps the best documented cognitive feature of growing older is that it is associated with a decline in the capacity to consciously learn and remember. Healthy older individuals often experience difficulties in remembering recently learned information, and typically perform worse than their younger counterparts on laboratory tests of explicit memory (reviewed in Mitchell, 1989; Light, 1991; Kausler, 1994). Such tests instruct participants to deliberately attempt to recall or recognize specific information from a prior episode. For example, in a recognition task, participants study a series of stimuli such as pictures or words and are later asked to discriminate between previously studied (old) and new items.
Explicit memory is thought to decline steadily throughout late adulthood. A study by Fleischman et al. (2004) reported progressive decline in individuals with a mean age of 78.6 years over a 4-year period on a battery of explicit tests involving immediate and delayed recall and recognition of stories, numbers, and words (see also Hultsch et al., 1992; Christensen et al., 1997; Davis et al., 2001). There is also an abundance of evidence from cross-sectional studies that individuals over the age of 60 perform significantly worse than individuals in their twenties on tests of recall and recognition (reviewed in Mitchell, 1989; Light, 1991).
Given the clear decline in explicit memory with age, there has been a profound interest over the past few decades in establishing whether implicit memory also declines. Implicit memory is evident when previously learned information affects (e.g., facilitates) performance on tasks that do not require the individual to consciously recollect the information. Previously encountered stimuli have a processing advantage over stimuli that were not previously encountered, a phenomenon known as repetition priming (henceforth priming). For example, seeing the word “cake” increases the likelihood that it will later be used to solve the word-fragment “c__e” even though there are several possible solutions. This type of word-completion task is commonly used in the laboratory to measure priming (e.g., Park and Shaw, 1992; Small et al., 1995; Spaan and Raaijmakers, 2011), and is usually disguised as an unrelated task. That is, following an initial phase in which a series of words are studied, participants are subsequently asked to complete word-fragments or stems with the first word that comes to mind, and no reference is made to the prior study phase. Perceptual identification is another commonly employed task that is used to compare the performance of different age groups (e.g., Fleischman and Gabrieli, 1998; Buchner and Wippich, 2000; Light et al., 2000; Mitchell and Bruss, 2003). Here, following a seemingly unrelated task in which a series of stimuli (usually pictures or words) are viewed, old and new items are presented either very briefly or in a degraded form, and participants are simply asked to identify them. Priming is revealed in the speeded or more accurate identification of old relative to new items.
The majority of studies that have investigated priming in normal aging have reported that it does not decline significantly (reviewed in Mitchell, 1989; Fleischman and Gabrieli, 1998; Fleischman, 2007). Several longitudinal studies have demonstrated stable priming with advancing age despite substantial declines in explicit memory (Hultsch et al., 1992; Christensen et al., 1997; Davis et al., 2001; Fleischman et al., 2004). Moreover, many cross-sectional studies employing a range of different tasks have reported non-significantly different priming between groups of young and older adults (e.g., Mitchell et al., 1990; Light et al., 1992; Park and Shaw, 1992; Schacter et al., 1992; Mitchell and Bruss, 2003; Wiggs et al., 2006; Soldan et al., 2009; Spaan and Raaijmakers, 2011).
The apparent sparing of implicit memory (priming) with age in the face of a clear decline in explicit memory has been a highly influential observation in the memory systems debate. It has been heavily cited in the literature as providing evidence that the two forms of memory are qualitatively distinct and driven by functionally independent cognitive and neural systems (e.g., Schacter, 1987; Tulving and Schacter, 1990; Schacter and Tulving, 1994; Squire, 1994, 2004, 2009; Gabrieli, 1998, 1999). Supporters of this multiple-systems perspective have argued that the decline in explicit but not implicit memory demonstrates that an explicit system succumbs to natural age-related changes in the brain, while an implicit system does not. There are, however, salient problems with the interpretation that implicit memory is completely spared with age.
Implicit Memory: Spared or Impaired in Normal Aging?
The idea that implicit memory remains stable as we age has come to be widely accepted, yet not all studies demonstrate preserved priming in older individuals. There are cases in the literature in which priming in older adults is significantly reduced in comparison to that in young adults (e.g., Chiarello and Hoyer, 1988; Abbenhuis et al., 1990; Davis et al., 1990; Hultsch et al., 1991; Ward et al., 2013). Moreover, in published studies that claim to have revealed preserved priming in older individuals, performance has most often been numerically reduced in these individuals compared to the young (see Fleischman and Gabrieli, 1998). Could there be a genuine decline in priming with age that often goes undetected? If the effect is very small, then because the majority of studies have used relatively small sample sizes, the answer to this question may be yes. Statistical power to detect small but real age effects may have been too low in many studies (a detailed discussion of this issue is provided in Mitchell and Bruss, 2003). La Voie and Light (1994) conducted an extensive meta-analysis, which uncovered a small but significant age effect on priming, calling into question the soundness of drawing a distinction between explicit and implicit memory systems. A decline in both forms of memory with age could point to a general impairment of a unitary memory system.
If both explicit and implicit forms of memory decline with age, why is the effect so much smaller on measures of implicit memory, to the extent that changes are difficult to detect statistically? One issue is that implicit tasks often have lower reliability than explicit tasks (see Buchner and Wippich, 2000; LeBel and Paunonen, 2011; Ward et al., 2013). To illustrate this, consider the comparison that is frequently made between performance on recognition and word-completion tasks. In a recognition task the goal to discriminate old from new items is relatively rigid, whereas the instructions in word-completion tasks—to complete stems or fragments with the first word that comes to mind—allow a considerable amount of flexibility in performance strategy. Put differently, it is clear to the individual that whichever strategy maximizes discrimination accuracy in recognition is better than all other strategies; in word-completion, by contrast, any strategy which successfully generates completions is as good as any other. Buchner and Wippich (2000) argued that this leads to high levels of response variability (noise) in implicit memory tasks, and they showed empirically that word-stem completion is a statistically less reliable task than recognition. More recently, Ward et al. (2013) demonstrated that the continuous identification (CID) task (described later) also has lower reliability than recognition. The corollary is that tasks with low reliability are unlikely to detect small differences in performance as a function of age. Indeed, Buchner and Wippich demonstrated how differences in measure reliability can explain the age differential pattern of performance on recognition and word-completion tasks. Conversely, Salthouse et al. (1999) reported an instance in which an implicit learning task (serial reaction time) had acceptable reliability levels, and was associated with a small but significant age effect.
There are several other measurement issues that could contribute toward differential age effects on explicit and implicit tasks. Typically the tasks differ in several characteristics, such as the available retrieval cues, the processing demands, and the type of response required, and different tasks are likely to be more or less sensitive to aging depending on their specific requirements and characteristics. For example, it is thought that conceptual processing is affected by age to a greater extent than perceptual processing (Jelicic et al., 1996), and whereas many explicit tasks require conceptual processing (e.g., cued recall), most implicit tasks are perceptual in nature (e.g., word-fragment completion, perceptual identification). Furthermore, there is evidence that production processes tend to diminish with age, while identification processes are relatively spared (e.g., Rybash, 1996), so this may explain why there are larger age effects on explicit tasks such as free recall in comparison to implicit tasks involving simple identification. Another important issue is that indices of explicit and implicit memory have traditionally been captured in separate experimental phases. That is, priming for a subset of previously studied items is usually measured prior to measuring explicit memory for another subset of items (e.g., Mitchell and Bruss, 2003), so it is perhaps not surprising that memory in the latter is weaker, especially in older individuals, due to the longer delay involved (evidence suggests that explicit memory declines rapidly over delays, e.g., Mitchell et al., 1990). Furthermore, even if tasks with comparable characteristics are used, scores may dissociate when they are presented in separate experimental phases because participants may adopt different response strategies or levels of motivation in the two.
From the evidence reviewed above, the following is clear: First, the interpretation that implicit memory is preserved with age is questionable. Second, there are several reasons why outcomes on explicit and implicit memory tests may differ as a function of age, even if the two tap the same underlying memory system. Thus, age-related dissociations between explicit and implicit memory do not necessarily constitute evidence for multiple memory systems. This general viewpoint is not new (see Buchner and Wippich, 2000; Dunn, 2003; Berry et al., 2006, 2008a,b; Nosofsky et al., 2012; Ward et al., 2013), but until recently there have been few attempts to overcome these key measurement issues. This was the main goal in the study by Ward et al. (2013). Healthy young and older adults studied pictures of everyday objects before performing a continuous identification with recognition (CID-R) task. This task captures a measure of recognition and priming for each item concurrently, ensuring that samples of memory are as comparable as possible. In the task, old and new pictures gradually clarified from a background mask and participants were asked to identify the item as quickly as possible (yielding a priming measure) before indicating whether they believed the item had been previously studied (yielding a recognition measure). Obtaining a clear dissociation using this method would constitute more compelling evidence for multiple memory systems relative to when items are judged on two separate occasions (i.e., in separate experimental phases). Two experiments demonstrated significantly weaker recognition memory in older relative to young adults, and there was a clear numerical reduction in priming with age. Importantly, the priming task was found to be objectively less reliable than the recognition task, and the age difference in priming became significant when the data were pooled across experiments to increase power. These findings are consistent with the single-system view.
Some have argued that reduced priming in older compared to young individuals is due to explicit contamination. That is, if participants notice during an implicit test that some items were previously studied (termed test awareness), they may voluntarily attempt to use an explicit processing strategy. For example, in a word-completion task, instead of completing stems or fragments with words that first come to mind, participants may try to explicitly recall items from the prior study phase (discussed in Spaan and Raaijmakers, 2011). Similarly, in a perceptual identification task, participants may try to recall the items shown in the study episode in an attempt to aid their identifications. The use of such a strategy could conceivably lead to an age difference in performance, because it is likely to be more beneficial to young individuals due to their superior explicit memory. The evidence for this argument, however, is mixed. Russo and Parkin (1993) found an age difference in priming on a fragmented picture completion task, but the effect disappeared when available explicit memory was equated between groups by asking young individuals to perform a dual task at study. Geraci and Barnhardt (2010) found greater levels of test awareness and priming in young relative to older adults on word-stem completion and category production tasks, and a greater relationship between the two, which was taken as evidence that test awareness mediates age effects in priming. Moreover, Park and Shaw (1992) demonstrated a small, non-significant age difference in priming on a word-stem completion task, but means were identical for young and older participants who were test unaware (0.08 proportion priming). On the other hand, however, priming effects in other studies have been largely unaffected by test awareness. For example, in Ward et al.'s (2013) study the numerical age difference in priming persisted when the data of aware participants were removed (mean proportions of 0.13 and 0.08 for young and older adults, respectively) (see also Light et al., 2000).
Ward et al. (2013) examined in detail the effect of explicit processing in the CID (continuous identification) task, and found no evidence that this affects the magnitude of priming obtained (Experiments 3A–C). Manipulations were introduced to facilitate successful explicit processing, including informing participants in advance which items were old and new, and varying the ratio of old to new test trials (in order to manipulate the likelihood that participants would become test aware—there is a greater likelihood that participants will become aware when there is a high number of old relative to new test trials). Even when participants received optimal explicit information, priming in young individuals did not differ from that in participants who received no explicit information and did not become test aware (Experiments 3A,B). Moreover, performance was not worsened in young individuals when explicit processing was made disadvantageous by providing incorrect “old/new” test cues (Experiment 3C). This suggests that priming in this task is not affected by optimal or adverse explicit processing, and thus the reliable age difference in priming is unlikely to have been driven by the differential use of an explicit processing strategy by young and older adults. Of course, caution must be taken when interpreting null results. An analysis revealed that Experiment 3A with 107 participants had adequate power to detect a relatively small effect of informing participants, if it had existed (power of 0.82 to detect an effect size of 0.28). The true numerical effect size was tiny (0.03), thus, if real, more than 7000 participants would have been needed to detect the effect statistically. Moreover, in Experiment 3B, the small numerical priming trend was in the opposite direction to that which would be expected if explicit processing were able to boost priming (i.e., greater priming in uninformed relative to informed conditions).
To summarize this section, it appears that both explicit and implicit memory decline with age, although the reduction in priming is usually much smaller than that in recognition, such that high statistical power is needed in order to detect it. Although many studies have reported a non-significant age difference in priming, the power issue combined with evidence that implicit tasks often have low reliability weakens the common claim that implicit memory is completely unaffected by aging. For this reason, these sorts of observations should not be taken as support for the view that explicit and implicit memory are driven by independent memory systems. A range of other studies, including the recent investigation by Ward et al. (2013) which aimed to overcome some critical measurement issues, suggest that there is a general memory decline that is simply picked up more easily on explicit tasks. This supports the view that a single system drives both explicit and implicit memory phenomena.
In the next section we describe how formal computational models have allowed more insight into the problem, and we discuss new evidence in relation to the application of such models to the data of Ward et al. (2013).
Evidence from Formal Single and Multiple Systems Models
Computational models can offer considerable theoretical insights into empirical dissociations, as simulations can provide an explicit (in the sense of precise and detailed) account of the cognitive mechanisms underlying task performance. Single-system models have successfully reproduced several dissociations that have previously been taken as support for multiple memory systems (e.g., Nosofsky and Zaki, 1998; Kinder and Shanks, 2001, 2003; Shanks and Perruchet, 2002; Shanks et al., 2003; Berry et al., 2006, 2008a,b, 2010, 2012; Newell and Dunn, 2008; Newell et al., 2010; Dunn et al., 2012; Nosofsky et al., 2012). The Berry et al. single system model assumes that a single memory signal drives performance on explicit and implicit tasks, but that there are in addition independent sources of random noise contributing to performance on these tasks. It assumes that the variance of the noise is typically greater in the implicit task, which is consistent with observations that these tasks have lower reliability than explicit tasks. Ward et al. (2013) previously showed that a larger age difference in recognition than priming could be explained well by this single-system model. A reduction in the strength of the signal gave rise to the pattern of performance seen in aging.
However, rather than simply showing that this single-system model can provide a good fit to the data, a crucial test is to determine whether it provides a better account of the data than multiple-systems models. Here we investigate this by formally comparing the fits of the single-system (SS) model and multiple-systems versions of the model to the data of Ward et al. (2013). To our knowledge this is the first attempt to formally fit multiple-systems models to empirical aging data. We first describe the models before explaining the fitting process and the findings.
In the SS model, it is assumed that every item at test is associated with a memory strength of evidence value, f, which is a normally distributed, random variable with mean μ and standard deviation σf (i.e., f ~ N(μ, σf)). Because old items are previously studied, the mean f of old items (μold) is greater than that of new items (μnew, set to equal zero). In order to derive a recognition judgment for the item, its value of f is combined with a value of noise, er, which is specific to the recognition task, giving the recognition strength variable Jr:
where er is another normally distributed random variable with a mean equal to zero and standard deviation σr (er ~ N(0, σr)). er is uncorrelated with f, and represents the influence of non-memorial factors upon task performance (e.g., trial-to-trial variability in the placement of a decision criterion for making an “old” judgment). If Jr exceeds a threshold, C, then the item will be judged old, or else it will be judged new. Thus, when μold is greater than μnew, a greater proportion of old than new items will tend to have values of Jr that exceed C; hence old items will be judged old more often than new ones.
Each item's value of f is also used to derive its identification RT (the basis of the priming measure). It is assumed that RT is a decreasing function of f such that greater values of f will tend to produce shorter identification RTs:
where b represents the identification RT intercept (and is the expected RT of new items), and s represents the rate of change in RT with f. Both s and b serve to scale the identification RT. ep is another source of noise, which is also a normally distributed, random variable (ep ~ N(0, σp)), is uncorrelated with er and f, and represents the influence of non-memorial factors upon performance in the identification task (e.g., the influence of extraneous perceptual factors upon identification, such as the amount of perceptual information available from the stimuli when presented at test; see Ostergaard, 1998). Thus, when μold is greater than μnew, old items will tend to have shorter identification RTs than new items (i.e., there will be a priming effect).
Because each item's recognition judgment and identification RT are derived from the same value of f in the SS model, it predicts that there will be associations between the recognition judgment and the identification RT. Greater values of f will tend to lead to a greater likelihood of an old judgment and also a relatively short identification RT. Thus, within item types, one prediction of the SS model is that there will be fluency effects, in other words that items judged old will tend to have shorter identification RTs than items judged new [i.e., RT(hit) < RT(miss) and RT(false alarm) < RT(correct rejection), where a hit is an old judgment to an old item, a miss is a new judgment to an old item, a false alarm is an old judgment to a new item, and a correct rejection is a new judgment to a new item] (Prediction 1). A second prediction concerns the relative magnitudes of the priming effect across all items and the priming effect for items judged new. The latter priming effect is shown if the identification RTs for old items not recognized (misses) are shorter than the identification RTs for new items judged new (correct rejections), and indicates that a priming effect is occurring even in the absence of overt recognition. In the model, the Jr values of misses will tend to be larger than those of correct rejections (because misses are old items), but the difference in Jr between all old and new items will tend to be greater than the difference in Jr to misses and correct rejections because all of the Jr values for misses and correct rejections are below C. Differences in Jr tend to reflect differences in identification RTs. Thus, the priming effect across all items [i.e., RT(new) − RT(old)] will tend to be greater than the priming effect for items judged new [i.e., RT(correct rejection − RT(miss)] (Prediction 2).
In the multiple-systems 1 (MS1) and multiple-systems 2 (MS2) models (see Berry et al., 2012), recognition judgments and identification RTs are derived in the same manner described above, except that in order to represent the multiple memory systems proposal that the sources of memory driving recognition and priming are distinct, one “explicit” source of memory strength, fr, is used to derive Jr, and a separate “implicit” source of strength, fp, is used to derive the RT, where fr ~ N(μr, σf), and fp ~ N(μp, σf). Importantly, μr|old and μp|old in the MS1 and MS2 models are free to vary independently of one another. This enables these models to reproduce findings of functional independence, that is, independent variables (e.g., aging) can, in principle, selectively affect the overall strength in one of the memory systems (i.e., selectively affect μr|old or μp|old).
In the MS1 model, an extra assumption is that the explicit and implicit strengths of a given item are uncorrelated [i.e., r(fr, fp) = 0], which represents a relatively strong interpretation of the claim that explicit and implicit memory systems are independent. This captures the claim that recognition and priming performance across items is completely uncorrelated (i.e., Tulving et al., 1982). In the MS2 model, the fp and fr signals of a given item may be correlated, with value w. This correlation could arise, for example, as a result of distinctiveness: a particularly distinctive item at study may be encoded strongly into both the explicit and implicit memory systems (and hence both fp and fr for that item will be relatively high). The MS2 model therefore offers a weaker interpretation of the idea that explicit and implicit memory systems are independent: although independent variables may selectively affect μr and μp (i.e., the systems are functionally independent), there may be associations between recognition judgments and identification RTs too. Thus, the MS2 model is more flexible than the SS and MS1 models. In fact, both the SS and MS1 models are special cases of the MS2 model: When w = 1 and μr = μp, the MS2 model is equivalent to the SS model; when w = 0, the MS2 model is equivalent to the MS1 model.
Results: Fitting the Models to the Data of Ward et al. (2013)
The models were fit to the data of Ward et al. (2013), Experiment 1. The behavioral procedure and findings were as follows: Healthy young and older adults studied two sets of 30 pictures of everyday objects, separated by a 60 min delay. Immediately following the second study phase, participants performed a CID-R task, which contained the 60 previously studied items (immediate and delayed), as well as an equal number of new items. The delay was included to reduce the strength of memory for a subset of items as much as possible. In the test, old and new pictures gradually clarified from a background mask and participants were asked to identify the item as quickly as possible (priming index) before deciding whether it was presented in either of the earlier study phases (recognition judgment). There were significant main effects of age and delay on recognition (d′, see Figure 1), with performance being superior for young relative to older adults at both retention intervals. Recognition was significantly reduced for items studied 60 min prior to testing, relative to those studied immediately before. Priming was calculated for each individual as the difference between the median identification RT for old (immediate and delayed) and new items, in proportion to their baseline (new item) RT [i.e., (RTnew − RTold[immediate or delayed])/RTnew; Figure 2]. Priming was numerically reduced in older compared to young individuals, but there was no significant main effect of age or delay (though as noted above, when Ward et al. pooled data from this and two other similar experiments, the age effect on priming reached significance).
Figure 1. Recognition performance for immediate and delayed items in Ward et al. (2013), Experiment 1. Left panel: discriminability performance (d′) [significant main effect of age group, F(1, 38) = 4.26, p = 0.04, η2p = 0.10, and delay, F(1, 38) = 5.76, p = 0.02, η2p = 0.13, and no significant interaction, F(1, 38) = 0.16, p = 0.69]. Right panel: proportion of hit and false-alarm responses. Bars indicate experimental data (error bars indicate SE of the mean), and symbols indicate the mean expected result from each model when fit to each individual's data. I, immediate; D, delayed; SS, single-system model; MS1, multiple-systems-1 model; MS2, multiple-systems-2 model.
Figure 2. Continuous identification (CID) task performance in Ward et al. (2013), Experiment 1. Left panel: priming effects [no significant main effect of age group, F(1, 38) = 1.78, p = 0.19, or delay, F(1, 38) = 0.02, p = 0.89, and no significant interaction, F(1, 38) = 0.04, p = 0.85]. The proportional priming effect was calculated as the difference in the median identification RT to new and old items divided by the median identification RT for new items. Bars indicate the mean of the median priming across participants (error bars indicate SE of the mean), and symbols indicate the mean expected proportional priming (relative to the expected identification RT for new items, see Table 3) from each model when fit to each individual's data. Right panel: mean identification RTs (ms) of immediate, delayed, and new items. Bars indicate experimental data (error bars indicate SE of the mean), and symbols indicate the mean expected result from each model when fit to each individual's data. Imm, immediate; Delay, delayed; SS, single-system model; MS1, multiple-systems-1 model; MS2, multiple-systems-2 model.
The models were fit to the data using maximum likelihood estimation. An outline is given here; full details of the general fitting procedure can be found in Berry et al. (2012). An automated procedure was used to find the values of the parameters that maximized the summed log likelihood across trials, for each participant. Certain parameter values were fixed (as in Berry et al., 2012): the mean f of new items was fixed to zero (i.e., μnew = 0 in the SS model, and μr|new = μp|new = 0 in the MS1 and MS2 models), the mean of ep and er were also fixed to zero, and the standard deviation of f for old and new items was fixed to equal the standard deviation of the noise associated with recognition, that is, (and so σ2Jr = σ2f + σ2r = 1). Finally, the value of s in the MS1 and MS2 models was fixed to that of the SS model. There are six free parameters in the SS model: μimmediate, the mean f of the immediate item distribution; μdelayed, the mean f of the delayed item distribution; C, the “old” judgment criterion; b, the identification RT intercept; s the rate of change in RT with changes in f; and σp, the variance of ep, the noise associated with the priming task. The MS1 model has seven free parameters: μr|immediate, the mean explicit memory strength of the immediate item distribution; μp|immediate, the mean implicit memory strength of the immediate item distribution; μr|delayed, the mean explicit memory strength of the delayed item distribution; μp|delayed, the mean implicit memory strength of the immediate item distribution; C, the “old” judgment criterion; b, the identification RT intercept; and σp, the variance of ep. The MS2 model has eight free parameters: like the MS1 model, μr|immediate, μp|immediate, μr|delayed, μp|delayed, b, C, and σp are free, but additionally, w, the correlation between fr and fp, is a free parameter.
The likelihood of each identification RT (RT) and recognition judgment Z on a given trial is given as follows:
where I is the item type and I = new, immediate, delayed; Φ is the cumulative normal distribution function; ϕ is the normal density function; and σ2RT = s2σ2f + σ2p. j = 1 when Z = “new,” and j = 2 when Z = “old”; C0 = −∞, C1 = C and C2 = ∞. μJr|RT,I and σ2Jr|RT are the mean and variance of the conditional distribution of Jr given RT, calculated as
and
where μr|new = 0 when I = new, μr|immediate ≥ 0 when I = immediate, and μr|delayed ≥ 0 when I = delayed; μp|new = 0 when I = new, μp|immediate ≥ 0 when I = immediate, and μp|delayed ≥ 0 when I = delayed. In the SS model, μr|new = μp|new = 0, μr|immediate = μp|immediate, μr|delayed = μp|delayed, and w = 1. In the MS1 model w = 0. In the MS2 model 0 ≤ w ≤ 1.
Given the best fitting parameter values for a model, the expected model results can be calculated analytically (see Table 1).
In the SS, MS1, and MS2 models, the expected values of RT conditional on judgment Z are given by the following:
where . j = 1 when Z = N, and j = 2 when Z = O; C0 = −∞, C1 = C and C2 = ∞.
Thus, Equation 6 gives the expected RT of hits for immediate items when I = immediate and Z = O; it gives the expected RT of hits for delayed items when I = delayed and Z = O; it gives the expected RT of false alarms when I = new and Z = O. Similarly, Equation 6 gives the expected RT of misses for immediate items when I = immediate and Z = N; it gives the expected RT of misses for delayed items when I = delayed and Z = N; and gives the expected RT of correct rejections when I = new and Z = N.
The maximum likelihood estimates of the parameters are given in Table 2, and the goodness of fit of the models is given in Table 3. Unsurprisingly, the greater flexibility of the MS2 model allows it to provide the best fit to the data, as indicated by the smallest ln(L) values. However, the Akaike Information Criterion (AIC, Akaike, 1973) and Bayesian Information Criterion (BIC, Schwarz, 1978) model evidence measures, which penalize models with more free parameters and which in the case of the BIC also take into account the number of data points being fit, clearly favored the SS model over the MS1 and MS2 models, as indicated by the lower AIC and BIC values (Burnham and Anderson, 1998). Figure 3 shows the proportion of participants that were best fit by each of the models. It is clear that the SS model was the best fitting model by the AIC and BIC measures for the vast majority of participants; a small minority were best fit by the MS1 model. None were best fit by the MS2 model.
Table 2. Mean and standard deviation (in parentheses) of the parameter estimates of the models (derived by maximum likelihood estimation).
Figure 3. Model selection results. Each bar represents the percentage of participants best fit by each model according to the Akaike Information Criterion (AIC) and the Bayesian Information Criterion (BIC). SS, single-system model; MS1, multiple-systems-1 model; MS2, multiple-systems-2 model.
The expected model results are presented in Figures 1, 2, 4. All models reproduced the trend for recognition memory to be greater for immediate than for delayed items. These effects all arise because μr is larger for young than for old participants and for immediate vs. delayed items, as shown in the top 2 rows of Table 2. The models all also predicted that priming in the young adult group would be greater than that in the older adult group (Figures 1, 2). With regards to the expected proportional priming effects (Figure 2; calculated as specified in Table 1), the SS model results mirror those of the recognition data: that is, priming in the older group is lower than that of the young group, and priming for immediate items is greater than that of delayed items. Under the MS1 and MS2 models, priming was lower in the older group than the young group for both immediate and delayed items. Furthermore, in the older group, the expected priming effect for delayed items was less than for immediate items; however, in the young group, the expected priming for delayed items was greater than for immediate items.
Figure 4. Predictions of the SS, MS1, and MS2 models (Berry et al., 2012) in the older group (panel A), younger group (panel B), and collapsed across groups (panel C). “Priming: Overall - judged new” refers to the difference in the overall priming effect and the priming effect for items judged new. Prediction 1 concerns whether fluency effects occur within new and old items (i.e., CR − FA and M − H). Prediction 2 concerns whether the magnitude of the priming effect overall (across all items) is greater than the priming effect for items judged new. Bars indicate 95% confidence intervals. I, immediate; D, delayed; CR, correct rejection, FA, false alarm; M, miss; H, hit; SS, single-system model; MS1, multiple-systems-1 model; MS2, multiple-systems-2 model.
The results concerning the specific predictions of the models are shown in Figure 4. In both groups, in line with the advance predictions of the SS model, there were trends for items judged old to have shorter identification RTs than items judged new (i.e., fluency effects, Prediction 1). This was the case within new items [i.e., RT(FA) < RT(CR)] and also within immediate and delayed old items [i.e., RT(H) < RT(M) for both item types], but this was only reliable for new items in the older group, t(19) = 2.61, p = 0.02. Similarly, in both groups, and for both immediate and delayed items, there was a trend for the priming effect to be greater than the priming effect for items judged new (Prediction 2; but all differences were non-significant). When the data were collapsed across groups, however, the fluency effects within new, immediate, and delayed items were reliable (Figure 4C): new items, t(39) = 3.14, p = 0.003; immediate items, t(39) = 2.42, p = 0.02; delayed items, t(39) = 2.21, p = 0.03. These differences are as predicted by the SS model, but not the MS1 model; they were reproduced by the MS2 model. The differences in the magnitude of priming overall and for items judged new were not reliable within the collapsed data: immediate items, t(39) = 1.50, p = 0.14; delayed items, t(39) = 1.09, p = 0.28.
In sum, the patterns of recognition and priming for young and older adults reported in Ward et al. (2013) are largely consistent with the single-system model, according to which any differences in performance with age are primarily consequences of a reduction in the strength of a single underlying memory signal. Two plausible multiple-system models fared considerably worse when using advanced model selection techniques. In the best fits of the MS1 and MS2 models, the mean strength of the implicit memory signal μp was lower for the older group than the young group (Table 2). From a multiple systems perspective, this could suggest that aging affects both the explicit and implicit memory systems, yet the poor performance of the MS1 model is evidence against the idea that the memory signals driving recognition and priming are completely independent. The qualitative results of the more flexible MS2 model were similar to the SS model. According to this model, there is a substantial degree of correlation between the explicit and implicit memory strengths of an individual item. However, the SS model was resoundingly preferred by the AIC and BIC measures.
Conclusions
The evidence presented in this article strongly draws into question the claim that implicit memory is preserved in normal aging. When appropriate methods and controls are used, priming is reduced in older individuals compared to young, although the effect is smaller than the reduction in explicit memory. Indeed, age differences in priming rarely reach significance, but this is likely to be due to a combination of low statistical power and low measure reliability. The profile of memory decline in aging suggests that there is a general impairment to a unitary memory system. Consistent with this, we provide new evidence that the patterns are more compatible with a formal single-system model than feasible multiple-systems alternatives.
It is important to note that even though age effects on priming may be small and hard to detect in low-powered studies, the single-system model emphatically predicts that such effects exist. This can be seen in the left panel of Figure 2, where the predictions of the model are shown for the Ward et al. (2013) data. Indeed, the predictions of the SS model are strongly constrained: whenever it predicts an age effect on recognition (reflected in a lower value of μr for older relative to young participants, see Table 2), it also predicts an effect on priming. It makes this prediction simply because recognition and priming are based on the same underlying signal and μr = μp. In one sense, therefore, it is important that studies are conducted which have adequate power to detect an effect of age on priming: the SS model could be falsified by a high-powered study which failed to detect such an effect. But in another sense it is less important whether age effects on priming are observed or not. All the models can predict such an effect (see Figure 2), and a far more discriminating test is to determine via formal model-fitting techniques (computing AIC and BIC, for instance) which model provides the best fit to the data. Put differently, little will be gained in our view from further studies asking whether age effects on priming reach the rather arbitrary cliff-edge criterion of p < 0.05. Instead, more will be learned from taking the underlying quantitative data and asking which theoretical model provides the best fit.
The results are consistent with previous applications of the single-system model to data from individuals with amnesia. For example, Conroy et al. (2005) reported intact priming on a word CID task in individuals with amnesia due to damage to the hippocampus and medial temporal lobe despite substantial impairment to recognition memory. This type of dissociation has been taken as strong evidence for multiple-systems views. The SS model was able to closely fit this pattern (Berry et al., 2012) but, like the present study, the model predicted a small deficit in priming in amnesia. Although controversial, this is consistent with proposals that, when carefully examined, priming is not completely preserved in amnesia (e.g., Ostergaard, 1999). Another commonly cited strand of evidence for multiple systems is that manipulations tend to produce different effects on tests of recognition and priming in healthy young individuals. For example, Butler and Klein (2009) showed that manipulating attention at study resulted in chance-level recognition for ignored items, whereas priming for such items was robust (see also Vuilleumier et al., 2005). The study by Berry et al. (2010) did not replicate this pattern: when recognition was at chance, priming was also absent. Moreover, the data patterns were again consistent with the predictions of the single-system model.
Lastly, the multiple-systems account argues that an implicit memory system is resistant to age-related decline, but in order to make this claim in the future one must provide evidence of completely equivalent priming in young and older individuals, or demonstrate conditions in which priming is greater in older relative to young adults, while at the same time explicit memory is weaker. This kind of double dissociation would present a challenge to the single system model, as the pattern would not occur if performance on explicit and implicit tasks is driven by a single memory signal. We hope that this discussion will lead to further useful developments in this longstanding debate.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
Abbenhuis, M. A., Raaijmakers, W. G. M., Raaijmakers, J. G. W., and Van Woerden, G. J. M. (1990). Episodic memory in dementia of the Alzheimer type and in normal ageing: similar impairment in automatic processing. Q. J. Exp. Psychol. A 42, 569–583. doi: 10.1080/14640749008401237
Akaike, H. (1973). “Information theory and an extension of the maximum likelihood principle,” in Second International Symposium on Information Theory, eds B. N. Petrov and F. Caski (Budapest: Academiai Kiado), 267–281.
Berry, C. J., Henson, R. N. A., and Shanks, D. R. (2006). On the relationship between repetition priming and recognition memory: insights from a computational model. J. Mem. Lang. 55, 515–533. doi: 10.1016/j.jml.2006.08.008
Berry, C. J., Shanks, D. R., and Henson, R. N. A. (2008a). A single-system account of the relationship between priming, recognition, and fluency. J. Exp. Psychol. Learn. Mem. Cogn. 34, 97–111. doi: 10.1037/0278-7393.34.1.97
Berry, C. J., Shanks, D. R., and Henson, R. N. A. (2008b). A unitary signal-detection model of implicit/explicit memory. Trends Cogn. Sci. 12, 367–373. doi: 10.1016/j.tics.2008.06.005
Berry, C. J., Shanks, D. R., Li, S., Rains, L. S., and Henson, R. N. A. (2010). Can “pure” implicit memory be isolated? A test of a single-system model of recognition and repetition priming. Can. J. Exp. Psychol. 64, 241–255. doi: 10.1037/a0021525
Berry, C. J., Shanks, D. R., Speekenbrink, M., and Henson, R. N. A. (2012). Models of recognition, repetition priming, and fluency: exploring a new framework. Psychol. Rev. 119, 40–79. doi: 10.1037/a0025464
Buchner, A., and Wippich, W. (2000). On the reliability of implicit and explicit memory measures. Cogn. Psychol. 40, 227–259. doi: 10.1006/cogp.1999.0731
Burnham, K. P., and Anderson, D. R. (1998). Model Selection and Inference. New York, NY: Springer. doi: 10.1007/978-1-4757-2917-7
Butler, B. C., and Klein, R. (2009). Inattentional blindness for ignored words: comparison of explicit and implicit tasks. Conscious. Cogn. 18, 811–819. doi: 10.1016/j.concog.2009.02.009
Chiarello, C., and Hoyer, W. J. (1988). Adult age differences in implicit and explicit memory: time course and encoding effects. Psychol. Ageing 3, 358–366. doi: 10.1037/0882-7974.3.4.358
Christensen, H., Henderson, A. A., Griffiths, K., and Levings, C. (1997). Does ageing inevitably lead to declines in cognitive performance? A longitudinal study of elite academics. Pers. Individ. Dif. 23, 67–78. doi: 10.1016/S0191-8869(97)00022-6
Conroy, M. A., Hopkins, R. O., and Squire, L. R. (2005). On the contribution of perceptual fluency and priming to recognition memory. Cogn. Affect. Behav. Neurosci. 5, 14–20. doi: 10.3758/CABN.5.1.14
Davis, H. P., Cohen, A., Gandy, M., Colombo, P., Van Dusseldorp, G., Simolke, N., et al. (1990). Lexical priming deficits as a function of age. Behav. Neurosci. 104, 288–297. doi: 10.1037/0735-7044.104.2.288
Davis, H. P., Trussell, L. H., and Klebe, K. J. (2001). A ten-year longitudinal examination of repetition priming, incidental recall, free recall, and recognition in young and elderly. Brain Cogn. 46, 99–104. doi: 10.1016/S0278-2626(01)80043-9
Dunn, J. C. (2003). The elusive dissociation. Cortex 39, 177–179. doi: 10.1016/S0010-9452(08)70096-0
Dunn, J. C., Newell, B. R., and Kalish, M. (2012). The effect of feedback delay and feedback type on perceptual category learning: the limits of multiple systems. J. Exp. Psychol. Learn. Mem. Cogn. 38, 840–859. doi: 10.1037/a0027867
Fleischman, D. A. (2007). Repetition priming in ageing and Alzheimer's disease: an integrative review and future directions. Cortex 43, 889–897. doi: 10.1016/S0010-9452(08)70688-9
Fleischman, D. A., and Gabrieli, J. D. E. (1998). Repetition priming in normal ageing and Alzheimer's disease: a review of findings and theories. Psychol. Ageing 13, 88–119. doi: 10.1037/0882-7974.13.1.88
Fleischman, D. A., Wilson, R. S., Gabrieli, J. D. E., Bienias, J. L., and Bennett, D. A. (2004). A longitudinal study of implicit and explicit memory in old persons. Psychol. Ageing 19, 617–625. doi: 10.1037/0882-7974.19.4.617
Gabrieli, J. D. E. (1998). Cognitive neuroscience of human memory. Annu. Rev. Psychol. 49, 87–115. doi: 10.1146/annurev.psych.49.1.87
Gabrieli, J. D. E. (1999). “The architecture of human memory,” in Memory: Systems, Process, or Function?, eds J. K. Foster and M. Jelicic (Oxford, UK: Oxford University Press), 205–231. doi: 10.1093/acprof:oso/9780198524069.003.0008
Geraci, L., and Barnhardt, T. M. (2010). Ageing and implicit memory: examining the contribution of test awareness. Conscious. Cogn. 19, 606–616. doi: 10.1016/j.concog.2010.03.015
Hultsch, D. F., Hertzog, C., Small, B. J., McDonald-Miszczak, L., and Dixon, R. (1992). Short-term longitudinal change in cognitive performance in later life. Psychol. Ageing 7, 571–584. doi: 10.1037/0882-7974.7.4.571
Hultsch, D. F., Masson, M. E. J., and Small, B. J. (1991). Adult age differences in direct and indirect tests of memory. J. Gerontol. 46, 22–30. doi: 10.1093/geronj/46.1.P22
Jelicic, M., Craik, F. I. M., and Moscovitch, M. (1996). Effects of ageing on different explicit and implicit memory tasks. Eur. J. Cogn. Psychol. 8, 225–234. doi: 10.1080/095414496383068
Kinder, A., and Shanks, D. R. (2001). Amnesia and the declarative/nondeclarative distinction: a recurrent network model of classification, recognition, and repetition priming. J. Cogn. Neurosci. 13, 648–669. doi: 10.1162/089892901750363217
Kinder, A., and Shanks, D. R. (2003). Neuropsychological dissociations between priming and recognition: a single-system connectionist account. Psychol. Rev. 110, 728–744. doi: 10.1037/0033-295X.110.4.728
La Voie, D., and Light, L. L. (1994). Adult age differences in repetition priming: a meta-analysis. Psychol. Ageing 9, 539–553. doi: 10.1037/0882-7974.9.4.539
LeBel, E. P., and Paunonen, S. V. (2011). Sexy but often unreliable: the impact of unreliability on the replicability of experimental findings with implicit measures. Pers. Soc. Psychol. Bull. 37, 570–583. doi: 10.1177/0146167211400619
Light, L. (1991). Memory and ageing: four hypotheses in search of data. Annu. Rev. Psychol. 42, 333–376. doi: 10.1146/annurev.ps.42.020191.002001
Light, L. L., La Voie, D., Valencia-Laver, D., Albertson Owens, S. A., and Mead, G. (1992). Direct and indirect measures of memory for modality in young and older adults. J. Exp. Psychol. Learn. Mem. Cogn. 18, 1284–1297. doi: 10.1037/0278-7393.18.6.1284
Light, L. L., Prull, M. W., and Kennison, R. F. (2000). Divided attention, aging, and priming in exemplar generation and category verification. Mem. Cogn. 28, 856–872. doi: 10.3758/BF03198421
Light, L. L., Prull, M. W., La Voie, D. J., and Healy, M. R. (2000). “Dual-process theories of memory in old age,” in Models of Cognitive Ageing: Debates in Psychology, eds T. J. Perfect and E. A. Maylor (New York, NY: Oxford University Press), 238–300.
Mitchell, D. B. (1989). How many memory systems? Evidence from ageing. J. Exp. Psychol. Learn. Mem. Cogn. 15, 31–49. doi: 10.1037/0278-7393.15.1.31
Mitchell, D. B., Brown, A. S., and Murphy, D. R. (1990). Dissociations between procedural and episodic memory: effects of time and ageing. Psychol. Ageing 5, 264–276. doi: 10.1037/0882-7974.5.2.264
Mitchell, D. B., and Bruss, P. J. (2003). Age differences in implicit memory: conceptual, perceptual, or methodological? Psychol. Ageing 18, 807–822. doi: 10.1037/0882-7974.18.4.807
Newell, B. R., and Dunn, J. C. (2008). Dimensions in data: testing psychological models using state-trace analysis. Trends Cogn. Sci. 12, 285–290. doi: 10.1016/j.tics.2008.04.009
Newell, B. R., Dunn, J. C., and Kalish, M. (2010). The dimensionality of perceptual category learning: a state-trace analysis. Mem. Cogn. 38, 563–581. doi: 10.3758/MC.38.5.563
Nosofsky, R. M., Little, D. R., and James, T. W. (2012). Activation in the neural network responsible for categorization and recognition reflects parameter changes. Proc. Natl. Acad. Sci. U.S.A. 109, 333–338. doi: 10.1073/pnas.1111304109
Nosofsky, R. M., and Zaki, S. R. (1998). Dissociations between categorization and recognition in amnesic and normal individuals: an exemplar-based interpretation. Psychol. Sci. 9, 247–255. doi: 10.1111/1467-9280.00051
Ostergaard, A. L. (1998). The effects on priming of word frequency, number of repetitions, and delay depend on the magnitude of priming. Mem. Cogn. 26, 40–60. doi: 10.3758/BF03211369
Ostergaard, A. L. (1999). Priming deficits in amnesia: now you see them, now you don't. Int. J. Neuropsychol. Soc. 5, 175–190. doi: 10.1017/S1355617799533018
Park, D. C., and Shaw, R. J. (1992). Effect of environmental support on implicit and explicit memory in younger and older adults. Psychol. Ageing 7, 632–642. doi: 10.1037/0882-7974.7.4.632
Russo, R., and Parkin, A. J. (1993). Age differences in implicit memory: more apparent than real. Mem. Cogn. 21, 73–80. doi: 10.3758/BF03211166
Rybash, J. M. (1996). Implicit memory and ageing: a cognitive neuropsychological perspective. Dev. Neuropsychol. 12, 127–179. doi: 10.1080/87565649609540644
Salthouse, T. A., McGuthry, K. E., and Hambrick, D. Z. (1999). A framework for analysing and interpreting differential ageing patterns: application to three measures of implicit learning. Ageing Neuropsychol. Cogn. 6, 1–18. doi: 10.1076/anec.6.1.1.789
Schacter, D. L. (1987). Implicit memory: history and current status. J. Exp. Psychol. Learn. Mem. Cogn. 13, 501–518. doi: 10.1037/0278-7393.13.3.501
Schacter, D. L., Cooper, L. A., and Valdiserri, M. (1992). Implicit and explicit memory for novel visual objects in older and younger adults. Psychol. Ageing 2, 299–308. doi: 10.1037/0882-7974.7.2.299
Schwarz, G. (1978). Estimating the dimension of a model, Ann. Stat. 6, 461–464. doi: 10.1214/aos/1176344136
Shanks, D. R., and Perruchet, P. (2002). Dissociation between priming and recognition in the expression of sequential knowledge. Psychon. Bull. Rev. 9, 362–367. doi: 10.3758/BF03196294
Shanks, D. R., Wilkinson, L., and Channon, S. (2003). Relationship between priming and recognition in deterministic and probabilistic sequence learning. J. Exp. Psychol. Learn. Mem. Cogn. 29, 248–261. doi: 10.1037/0278-7393.29.2.248
Small, B. J., Hultsch, D. F., and Masson, M. E. J. (1995). Adult age differences in perceptually based, but not conceptually based implicit tests of memory. J. Gerontol. Psychol. Sci. 50, 162–170. doi: 10.1093/geronb/50B.3.P162
Soldan, A., Hilton, J. H., Cooper, L. A., and Stern, Y. (2009). Priming of familiar and unfamiliar visual objects over delays in young and older adults. Psychol. Ageing 24, 93–104. doi: 10.1037/a0014136
Spaan, P. E. J., and Raaijmakers, J. G. W. (2011). Priming effects from young-old to very old age on a word-stem completion task: minimising explicit contamination. Aging Neuropsychol. Cogn. 18, 86–107. doi: 10.1080/13825585.2010.511146
Squire, L. R. (1994). “Declarative and nondeclarative memory: multiple brain systems supporting learning and memory,” in Memory Systems, eds D. L. Schacter and E. Tulving (Cambridge, MA: MIT Press), 203–231.
Squire, L. R. (2004). Memory systems of the brain: a brief history and current perspective. Neurobiol. Learn. Mem. 82, 171–177. doi: 10.1016/j.nlm.2004.06.005
Squire, L. R. (2009). Memory and brain systems: 1969-2009. J. Neurosci. 29, 12711–12716. doi: 10.1523/JNEUROSCI.3575-09.2009
Tulving, E., and Schacter, D. L. (1990). Priming and human memory systems. Science 247, 301–306. doi: 10.1126/science.2296719
Tulving, E., Schacter, D. L., and Stark, H. A. (1982). Priming effects in word-fragment completion are independent of recognition memory. J. Exp. Psychol. Learn. Mem. Cogn. 8, 336–342. doi: 10.1037/0278-7393.8.4.336
Vuilleumier, P., Schwartz, S., Duhoux, S., Dolan, R. J., and Driver, J. (2005). Selective attention modulates neural substrates of repetition priming and “implicit” visual memory: suppressions and enhancements revealed by fMRI. J. Cogn. Neurosci. 17, 1245–1260. doi: 10.1162/0898929055002409
Ward, E. V., Berry, C. J., and Shanks, D. R. (2013). An effect of age on implicit memory that is not due to explicit contamination: implications for single and multiple-systems theories. Psychol. Aging 28, 429–442. doi: 10.1037/a0031888
Wiggs, C. L., Weisberg, J., and Martin, A. (2006). Repetition priming across the adult lifespan – the long and short of it. Ageing Neuropsychol. Cogn. 13, 308–325. doi: 10.1080/138255890968718
Keywords: aging, implicit memory, priming, recognition, models of memory
Citation: Ward EV, Berry CJ and Shanks DR (2013) Age effects on explicit and implicit memory. Front. Psychol. 4:639. doi: 10.3389/fpsyg.2013.00639
Received: 12 June 2013; Accepted: 28 August 2013;
Published online: 23 September 2013.
Edited by:
Vinciane Gaillard, Université Libre de Bruxelles, BelgiumReviewed by:
Zoltan Dienes, University of Sussex, UKPierre Perruchet, Centre National de la Recherche Scientifique, France
Copyright © 2013 Ward, Berry and Shanks. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Emma V. Ward, Psychology Department, Middlesex University, Town Hall (TG68), The Burroughs, London, NW4 4BT, UK e-mail: e.ward@mdx.ac.uk