Christoph Naefgen
Robert GaschlerIt has long been appreciated that mechanistic explanations of cognition can be tested better when experiment-based studies are complemented with non-experimental studies. For instance, work on executive functions (e.g., Engle et al., 1999; Miyake et al., 2000; Friedman and Miyake, 2004; Oberauer, 2005; Schmiedek et al., 2007) has used between-person variability to more precisely identify candidate mechanisms that explain phenomena related to executive functioning. Notably, such approaches are often focused on analyzing between-person variability rather than on within-person variability. Yet, when seeking mechanistic explanations, cognitive psychologists usually want to know what causes a within-person effect or change (cf. Lewin, 1931; Hommel, 2020a,b), rather than what makes people different from one-another. To counteract risks of ecological fallacy, inquiries should therefore focus on describing and accounting for within-person variability rather than between-person variability. Within-person variability can present as effects of experimental conditions on the individual (rather than group-average effects; cf. Marciano and Yeshurun, 2017) or as spontaneous fluctuation (i.e., day-to-day variability).
Here we present a way of differentiating what we call cognitive resources and common factors from each other using within-person covariance patterns. While several research traditions in cognitive psychology already emphasize within-person variability as a notable phenomenon [e.g., early language development (van Geert and van Dijk, 2002), intermediate phenotypes of ADHD (Castellanos et al., 2005), affect (Eid and Diener, 1999)], we provide some elaboration on uses of within-person variability for readers coming from backgrounds where it usually is not as emphasized (i.e., experiment-based cognitive psychology). Even for those already generally familiar, the specific perspective we describe could be novel, as it focuses co-variation rather than measures of variability. The scope of this paper thus extends to research contexts where theories have a cognitive resource or a common factor as an element and the proposed method serves the purpose of constraining the plausible theory space or to test that aspect of already specified theories (some general areas where this could be useful are attention, executive functioning, dual-tasking).
We link the concept of a cognitive resource to that of a trade-off, signified by negative correlations between two measures on a within-person level of analysis, differentiating it from cases where a common factor is dominant, which results in positive within-person correlations. The two scenarios are described in the following segments and illustrated in Figure 1.
Figure 1. Simulated data illustrating the two scenarios described in this opinion paper that can occur when investigating the correlations between two theoretically-linked measures on a within-person level. The different colors denote different “participants”, the thin colorful lines illustrate the within-person correlations for each simulated participant. The black triangles are places in the mean values for the two measures for each participant and the thick black lines are the between-person correlations resulting out of these averaged values. In the left panel we illustrate what a trade-off scenario would look like and in the right panel what a common factor scenario would look like.
Short Characterization of the Two Views
Resource = Trade-Off = Negative Correlation
There are extreme cases where there is little doubt that cognitive processing is characterized by a trade-off. For instance, visual fixations are allocated to one or the other of two sufficiently distinct objects in space at a time (e.g., Eriksen and Yeh, 1985; Eriksen and St. James, 1986). Accordingly, allocating the processing of visual information at high acuity to one object necessarily precludes the other object from receiving such privileged processing. Furthermore, the literature on working memory suggests that only one object can be held in the narrow focus of attention in working memory (while approximately four objects can be held in the broad focus of attention) and that shifting the focus from one object held in working memory to another costs time and effort (e.g., Oberauer, 2002; Oberauer and Hein, 2012). This again indicates that granting privileged processing to one object implies withholding it from another object. Maniscalco et al. (2017) reported negative within-subject correlations of performance and metacognition in a vigilance task and used the negatively linked within-session changes to argue for a trade-off and a common resource. Similarly, Drury (1994) wrote about the speed-accuracy trade-off in industrial contexts and the negative correlation between speed and accuracy that appears when people perform resource-limited1 tasks.
Common Factor = Positive Correlation
While a negative within-person correlation suggests the allocation of a limited resource, a positive correlation suggests a common factor. A common factor influences different tasks but is not limitedly allocated between the tasks. It can, for instance, be based on (1) a strategy that positively influences different tasks (cf. Gaschler et al., 2014) and is not “used up” when applied to a task), (2) differences in the substrate of the cognitions (e.g., faster overall neuronal transmission rates, Salthouse, 1992), but also (3) environmental factors (e.g., strength of a distraction affecting both tasks). In cognitive psychology, theories explaining cognitive functioning in different tasks by such a common factor are especially prominent in work on cognitive aging, a domain where experimental manipulation cannot be applied broadly and between-person differences as well as trajectories of change within individuals are scrutinized. For instance, based on shared age-related variance across various measures of speed and attenuation of age-correlations after speed-variance is controlled for, Salthouse (1996) has argued that between-person differences and within-person change in the speed of basic processes are common factors behind cognitive aging. Slowing corrupts performance as relevant operations cannot be finished within the available time, products of cognitive processes cannot be combined as results of earlier processing are no longer available when later processes are finished. In a similar vein, based on simulations with neural networks on cognitive aging, Li et al. (cf. Li et al., 2000; Li, 2013; Li and Rieckmann, 2014) have argued for differences in the neural gain parameter as the one common cause of between-person and within-person differences in performance across different tasks.
An example of a common factor is Drury's (1994) observation that providing workers in aircraft inspection with well-defined boundaries to the search area can simultaneously increase speed and accuracy. Workers are thus not just shifted on the speed-accuracy curve in a trade-off manner but their performance benefits overall. As this illustrates, the common factor view is not limited to trait-like factors. This is very important for our argument, because otherwise the contrast we are proposing is not empirically identifiable, as the trade-offs would be visible within-person and the common factors would be visible only between-person. And while this is still possible in cases where a common factor only differs between persons but within each person remains perfectly stable and should be kept in mind, the methods we propose remains viable as long as the common factor has fluctuation in its strength.
On the within-person level, some variables of interest that have been shown to affect performance in tasks commonly used in cognitive psychology are the functioning of working memory, attentional control, motivation (e.g., Adam and deBettencourt, 2019 or Brose et al., 2012), as well as physiological fluctuations such as circadian rhythm, distribution of blood in the body, general stress, or availability of nutrition (e.g., Slaughter, 1901; Hasher et al., 1999). Within-person fluctuations have also been documented for goal-planning (e.g., Wiebe et al., 2018), and self-regulation (e.g., Berg et al., 2014). These variables can lead to positively correlated day-to-day changes in different performance measures.
One thing to mind is that while we use within-person correlations of measurements to illustrate our point, the theoretical conclusions are based on correlations of the underlying constructs. Capacity can be distributed to either increase speed or increase accuracy, but the measurement of accuracy can equally be measured in terms of percentage of correct responses or of percentages of errors. The main solutions here, in the spirit of the Research Topic's focus on mechanistic theories and specified cognitive structures, are having a solid theory of how the empirical measurements come about and an awareness that an approach like ours has neither the capacity nor the purpose of replacing good theories. A particularly difficult dynamic here is one in which the distribution of a cognitive resource is governed by a system that can be more or less efficient, that is, a common factor. For example, the action control system can be set to be more flexible or more stable (a cognitive resource, as the control system's balance can only lie in one place at a time) and shifting to flexibility improves task switch performance and worsens repetition performance (and vice versa), but metacontrol adaptivity (how efficient these shifts happen) is a common factor, as it increases the overall performance (cf. Mekern et al., 2019).
A constraint of this approach is that it is tailored to situations in which the amount of available cognitive resources is roughly fixed, at least within the time frame of data acquisition. Once a change in available resources is plausible, the logic we present here is not as easily applied anymore (for one example consider the “less is more” hypothesis of language acquisition, Newport, 1988, 1990, in which an increase in cognitive capacities between early childhood and adulthood leads to reduced language acquisition efficiency since they lead to change in “how” language stimuli are processed).
Within-Person Covariance as Constraint on Potential Mechanisms
Studies of within-person variability can be used as a first step to constrain the search space for later experimental research to test mechanistic accounts. If it turns out that two measures are correlated negatively within participants (i.e., trade-off), this suggests that processes or representations overlap and are used competitively. An example that most experimental cognitive psychologists will be familiar with is the speed-accuracy trade-off (SAT), which is the phenomenon that for decision making systems the speed with which a decision is made negatively correlates with the accuracy with which the decision is made. Discovered relatively early in the history of modern psychology (Henmon, 1911, for a broader overview see Heitz, 2014), the SAT can, for cognitive psychologists, sometimes be more of a problem to be dealt with (e.g., Vandierendonck, 2018; Liesefeld and Janczyk, 2019), but it illustrates our point about trade-offs well: There seems to be some sort of limit on decision quality gained per time invested, which in accumulator models would be the velocity of evidence accumulation (see, e.g., Bogacz et al., 2010). Shifting toward speed at the cost of accuracy or vice versa results in a negative within-person correlation (Bakdash and Marusich, 2017). As such, the SAT is not only a confound adding noise to be controlled but also an epistemological signal to be used, as it indicates the presence of a cognitive resource.
As an example on the level of task representations, Schuck et al. (2015) used fMRT to track how redundant variants of representing a task as a color- vs. a spatial task were represented and found a negative coupling (space or color) rather than redundant coding in task-set relevant brain areas. In the applied domain this might mean that on some days people may approach a traffic light with a task-set strongly weighing color and on other days focusing on light position instead (cf. Overton and Brown, 1957, for a between-person difference perspective on this issue). Follow-up work can target active and passive mechanisms clearing redundant parts from task representations. Apart from task sets, trade-offs are also documented on the level of features. A central aspect of the Theory of Event Coding (Hommel et al., 2001) is that features (such as the code “left”) already used for an event file (such as planning a left arm movement) are less available when concurrently needed in a different task (i.e., recognizing a left-pointing arrow, Wühr and Müsseler, 2001).
In case of a positive correlation, candidates for a common factor can be tested. For instance, Brose et al. (2012) documented that days with lower working memory performance, were days with more negative affect and reduced control of attention, suggesting, to follow-up on the role of working memory in emotion regulation.
As mentioned, studies of within-person variability can not only be used to constrain first steps in constructing mechanistic theories, but also to test them. Some theories strongly linked to experimental work can make predictions on the covariance structure of task performance that can be tested in multi-session datasets that allow for day-to-day fluctuation. For instance, bottleneck-theories in dual-tasking (cf. Pashler, 1994; Tombu and Jolicœur, 2005) can be taken to suggest that measures of performance in the two tasks should correlate negatively within subjects.
Lastly, this approach can also be turned on its head to inform how to design environments in which there are multiple related concurrent tasks where good performance in one task is desired and in the other irrelevant. If it is established that a cognitive resource is divided among the tasks, then minimizing the amount of resources used by the irrelevant tasks is a design goal, while if a common factor pattern is established, no such precautions need to be taken. Cognitive load theory in the context of instructional design is an example of this logic: If a student is to learn a subject from teaching materials and needs to use a cognitive resource on both parsing the material and then processing the material, lowering the resource draw of the parsing component will free up resources for the processing component (Sweller et al., 1998).
Distinguishing Within- and Between-Person Correlation
Correlative studies can help evaluate to what extent mechanisms implying a trade-off structure or mechanisms implying a common factor structure are relevant. Potential outcomes can be that there is evidence only for one or the other case, or that both mechanisms contributed (potentially with different weight). Importantly, to fully harvest the potential of correlative studies for constraining candidate mechanisms, the studies should not be limited to cross-sectional assessment of correlation.
An example involving typing might illustrate that correlations across persons are logically independent from correlations within person (Hamaker, 2012). In cross-sectional studies, the between-person correlation between the time needed for a typing task and error rate might be positive: Some people are good typists. They type quickly and accurately. In contrast, the within-person correlation obtained in a longitudinal study across many typing sessions might be negative: On occasions a person types faster, the error rate will be higher.
A small but growing body of research is now using intensive repeated measures, wherein participants complete tasks on many sessions, to examine within-person coupling of indicators of different cognitive processes. For example, Brose et al. (2012) studied within-person and between-person differences in working memory, control of attention, and affect in 101 young adults across 100 sessions. They obtained evidence for the common factor view (positive correlations), within- and between persons. They found that the same variables that predict between-person differences in working memory performance (cross-sectional correlations) also predict within-person (session-to-session) differences in working memory performance (longitudinal correlations). Given the logical independence of the within- and between-person variability, these results suggest that findings from prior studies of between-person differences that were at risk for ecological fallacy may be at least partially informative about within-person cognitive processes (Molenaar, 2004; Hamaker, 2012).
In summary, we think that the concept of a cognitive resource can be made epistemologically useful and empirically tractable by contrasting it with the concept of a common factor and identifying the two concepts with negative and positive within-person correlations on theoretically related measures. The epistemological use is primarily one of restricting the theoretical space within which mechanistic explanations are to be searched for, but also includes testing hypotheses.
Author Contributions
CN wrote the first draft of the manuscript and created the figure. All authors wrote and revised sections of the manuscript and read and approved the submitted version.
Funding
This research was funded within the priority program on multitasking SPP1772 of the German Research Foundation (DFG) awarded to Robert Gaschler (GA 2246/1-2) and supported by the FernUniversität in Hagen.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Acknowledgments
We thank Monica Mary Heil for proofreading the manuscript.
Footnotes
1. ^Drury is referring to “task processing resources”, not industrial resources, here.
References
Adam, K. C. S., and deBettencourt, M. T. (2019). Fluctuations of attention and working memory. J. Cogn. 2, 33. doi: 10.5334/joc.70
Bakdash, J. Z., and Marusich, L. R. (2017). Repeated measures correlation. Front. Psychol. 8, 456. doi: 10.3389/fpsyg.2017.00456
Berg, C. A., Wiebe, D. J., Suchy, Y., Hughes, A. E., Anderson, J. H., Godbey, E. I., et al. (2014). Individual differences and day-to-day fluctuations in perceived self-regulation associated with daily adherence in late adolescents with type 1 diabetes. J. Pediatr. Psychol. 39, 1038–1048. doi: 10.1093/jpepsy/jsu051
Bogacz, R., Wagenmakers, E.-J., Forstmann, B. U., and Nieuwenhuis, S. (2010). The neural basis of the speed–accuracy tradeoff. Trends Neurosci. 33, 10–16. doi: 10.1016/j.tins.2009.09.002
Brose, A., Schmiedek, F., Lövdén, M., and Lindenberger, U. (2012). Daily variability in working memory is coupled with negative affect: the role of attention and motivation. Emotion 12, 605–617. doi: 10.1037/a0024436
Castellanos, F. X., Sonuga-Barke, E. J. S., Scheres, A., Di Martino, A., Hyde, C., and Walters, J. R. (2005). Varieties of attention-deficit/hyperactivity disorder-related intra-individual variability. Biol. Psychiatry 57, 1416–1423. doi: 10.1016/j.biopsych.2004.12.005
Drury, C. G. (1994). The speed—accuracy trade-off in industry. Ergonomics 37, 747–763. doi: 10.1080/00140139408963686
Eid, M., and Diener, E. (1999). Intraindividual variability in affect: reliability, validity, and personality correlates. J. Pers. Soc. Psychol. 76, 662–676. doi: 10.1037/0022-3514.76.4.662
Engle, R. W., Tuholski, S. W., Laughlin, J. E., and Conway, A. R. A. (1999). Working memory, short-term memory, and general fluid intelligence: a latent-variable approach. J. Exp. Psychol. Gen. 128, 309–331. doi: 10.1037/0096-3445.128.3.309
Eriksen, C. W., and St. James, J. D. (1986). Visual attention within and around the field of focal attention: a zoom lens model. Percept. Psychophys. 40, 225–240. doi: 10.3758/BF03211502
Eriksen, C. W., and Yeh, Y.-Y. (1985). Allocation of attention in the visual field. J. Exp. Psychol. Hum. Percept. Perform. 11, 583–597. doi: 10.1037/0096-1523.11.5.583
Friedman, N. P., and Miyake, A. (2004). The relations among inhibition and interference control functions: a latent-variable analysis. J. Exp. Psychol. Gen. 133, 101–135. doi: 10.1037/0096-3445.133.1.101
Gaschler, R., Marewski, J. N., Wenke, D., and Frensch, P. A. (2014). Transferring control demands across incidental learning tasks–stronger sequence usage in serial reaction task after shortcut option in letter string checking. Front. Psychol. 5, 1388. doi: 10.3389/fpsyg.2014.01388
Hamaker, E. L. (2012). “Why researchers should think “within-person”: a paradigmatic rationale,” in Handbook of Research Methods for Studying Daily Life, eds M. R. Mehl and T. S. Conner (The Guilford Press), 43–61.
Hasher, L., Zacks, R. T., and May, C. P. (1999). “Inhibitory control, circadian arousal, and age,” in Attention and Performance XVII: Cognitive Regulation of Performance: Interaction of Theory and Application, eds D. Gopher and A. Koriat (The MIT Press),653–675.
Heitz, R. P. (2014). The speed-accuracy tradeoff: history, physiology, methodology, and behavior. Front. Neurosci. 8, 150. doi: 10.3389/fnins.2014.00150
Henmon, V. A. C. (1911). The relation of the time of a judgment to its accuracy. Psychol. Rev. 18, 186–201. doi: 10.1037/h0074579
Hommel, B. (2020a). Dual-task performance: theoretical analysis and an event-coding account. J. Cogn. 3, 29. doi: 10.5334/joc.114
Hommel, B. (2020b). Pseudo-mechanistic explanations in psychology and cognitive neuroscience. Top. Cogn. Sci. 12, 1294–1305. doi: 10.1111/tops.12448
Hommel, B., Müsseler, J., Aschersleben, G., and Prinz, W. (2001). The Theory of Event Coding (TEC): a framework for perception and action planning. Behav. Brain Sci. 24, 849–878; discussion: 878–937. doi: 10.1017/s0140525x01000103
Lewin, K. (1931). The conflict between Aristotelian and Galileian modes of thought in contemporary psychology. J. Gen. Psychol. 5, 141–177. doi: 10.1080/00221309.1931.9918387
Li, S.-C. (2013). Neuromodulation and developmental contextual influences on neural and cognitive plasticity across the lifespan. Neurosci. Biobehav. Rev. 37, 2201–2208. doi: 10.1016/j.neubiorev.2013.07.019
Li, S.-C., Lindenberger, U., and Frensch, P. A. (2000). Unifying cognitive aging: from neuromodulation to representation to cognition. Neurocomput. Int. J. 32–33, 879–890. doi: 10.1016/S0925-2312(00)00256-3
Li, S.-C., and Rieckmann, A. (2014). Neuromodulation and aging: implications of aging neuronal gain control on cognition. Curr. Opin. Neurobiol. 29, 148–158. doi: 10.1016/j.conb.2014.07.009
Liesefeld, H. R., and Janczyk, M. (2019). Combining speed and accuracy to control for speed-accuracy trade-offs(?). Behav. Res. Methods 51, 40–60. doi: 10.3758/s13428-018-1076-x
Maniscalco, B., McCurdy, L. Y., Odegaard, B., and Lau, H. (2017). Limited cognitive resources explain a trade-off between perceptual and metacognitive vigilance. J. Neurosci. 37, 1213–1224. doi: 10.1523/JNEUROSCI.2271-13.2016
Marciano, H., and Yeshurun, Y. (2017). Large inter-individual and intra-individual variability in the effect of perceptual load. PLoS ONE 12, e0175060. doi: 10.1371/journal.pone.0175060
Mekern, V. N., Sjoerds, Z., and Hommel, B. (2019). How metacontrol biases and adaptivity impact performance in cognitive search tasks. Cognition 182, 251–259. doi: 10.1016/j.cognition.2018.10.001
Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., and Wager, T. D. (2000). The unity and diversity of executive functions and their contributions to complex “Frontal Lobe” tasks: a latent variable analysis. Cogn. Psychol. 41, 49–100. doi: 10.1006/cogp.1999.0734
Molenaar, P. C. M. (2004). A manifesto on psychology as idiographic science: bringing the person back into scientific psychology, this time forever. Meas. Interdiscipl. Res. Perspect. 2, 201–218. doi: 10.1207/s15366359mea0204_1
Newport, E. L. (1988). Constraints on learning and their role in language acquisition: studies of the acquisition of American sign language. Lang. Sci. 10, 147–172. doi: 10.1016/0388-0001(88)90010-1
Newport, E. L. (1990). Maturational constraints on language learning. Cogn. Sci. 14, 11–28. doi: 10.1207/s15516709cog1401_2
Oberauer, K. (2002). Access to information in working memory: exploring the focus of attention. J. Exp. Psychol. Learn. Mem. Cogn. 28, 411–421. doi: 10.1037/0278-7393.28.3.411
Oberauer, K. (2005). Binding and inhibition in working memory: individual and age differences in short-term recognition. J. Exp. Psychol. Gen. 134, 368–387. doi: 10.1037/0096-3445.134.3.368
Oberauer, K., and Hein, L. (2012). Attention to information in working memory. Curr. Direct. Psychol. Sci. 21, 164–169. doi: 10.1177/0963721412444727
Overton, R. K., and Brown, W. L. (1957). Unrecognized weakness and compensatory learning. Am. J. Psychol. 70, 126–127. doi: 10.2307/1419244
Pashler, H. (1994). Dual-task interference in simple tasks: data and theory. Psychol. Bull. 116, 220–244. doi: 10.1037/0033-2909.116.2.220
Salthouse, T. A. (1992). Influence of processing speed on adult age differences in working memory. Acta Psychol. 79, 155–170. doi: 10.1016/0001-6918(92)90030-H
Salthouse, T. A. (1996). The processing-speed theory of adult age differences in cognition. Psychol. Rev. 103, 403–428. doi: 10.1037/0033-295x.103.3.403
Schmiedek, F., Oberauer, K., Wilhelm, O., Süß, H.-M., and Wittmann, W. W. (2007). Individual differences in components of reaction time distributions and their relations to working memory and intelligence. J. Exp. Psychol. Gen. 136, 414–429. doi: 10.1037/0096-3445.136.3.414
Schuck, N. W., Gaschler, R., Wenke, D., Heinzle, J., Frensch, P. A., Haynes, J.-D., et al. (2015). Medial prefrontal cortex predicts internally driven strategy shifts. Neuron 86, 331–340. doi: 10.1016/j.neuron.2015.03.015
Slaughter, J. W. (1901). The fluctuations of the attention in some of their psychological relations. Am. J. Psychol. 12, 313–334. doi: 10.2307/1412281
Sweller, J., van Merrienboer, J. J. G., and Paas, F. G. W. C. (1998). Cognitive architecture and instructional design. Educ. Psychol. Rev. 10, 251–296. doi: 10.1023/A:1022193728205
Tombu, M., and Jolicœur, P. (2005). Testing the predictions of the central capacity sharing model. J. Exp. Psychol. Hum. Percept. Perform. 31, 790–802. doi: 10.1037/0096-1523.31.4.790
van Geert, P., and van Dijk, M. (2002). Focus on variability: new tools to study intra-individual variability in developmental data. Infant Behav. Dev. 25, 340–374. doi: 10.1016/S0163-6383(02)00140-6
Vandierendonck, A. (2018). Further tests of the utility of integrated speed-accuracy measures in task switching. J. Cogn. 1, 8. doi: 10.5334/joc.6
Wiebe, D. J., Baker, A. C., Suchy, Y., Stump, T. K., and Berg, C. A. (2018). Individual differences and day-to-day fluctuations in goal planning and type 1 diabetes management. Health Psychol. 37, 638–646. doi: 10.1037/hea0000624
Keywords: cognitive resources, common factor, trade-off, intra-individual analyses, inter-individual and intra-individual differences
Citation: Naefgen C and Gaschler R (2022) Trade-Off vs. Common Factor—Differentiating Resource-Based Explanations From Their Alternative. Front. Psychol. 13:774938. doi: 10.3389/fpsyg.2022.774938
Received: 13 September 2021; Accepted: 14 February 2022;
Published: 11 March 2022.
Edited by:
Bernhard Hommel, University Hospital Carl Gustav Carus, GermanyReviewed by:
Vanessa R. Simmering, University of Kansas, United StatesCopyright © 2022 Naefgen and Gaschler. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Christoph Naefgen, christoph.naefgen@fernuni-hagen.de