Alexander Skulmowski*
Günter Daniel Rey- Psychology of Learning with Digital Media, Chemnitz University of Technology, Chemnitz, Germany
In recent years, research on embodied cognition has inspired a number of studies on multimedia learning and instructional psychology. However, in contrast to traditional research on education and multimedia learning, studies on embodied learning (i.e., focusing on bodily action and perception in the context of education) in some cases pose new problems for the measurement of cognitive load. This review provides an overview over recent studies on embodied learning in which cognitive load was measured using surveys, behavioral data, or physiological measures. The different methods are assessed in terms of their success in finding differences of cognitive load in embodied learning scenarios. At the same time, we highlight the most important challenges for researchers aiming to include these measures into their study designs. The main issues we identified are: (1) Subjective measures must be appropriately phrased to be useful for embodied learning; (2) recent findings indicate potentials as well as problematic aspects of dual-task measures; (3) the use of physiological measures offers great potential, but may require mobile equipment in the context of embodied scenarios; (4) meta-cognitive measures can be useful extensions of cognitive load measurement for embodied learning.
Embodied Learning Scenarios and Cognitive Load
In response to the findings concerning the influence of bodily perception, activity, and the physical environment on cognition in the fields of cognitive psychology and neuroscience (i.e., embodied cognition; Barsalou, 1999, 2003, 2008; Wilson, 2002; Glenberg, 2010; Shapiro, 2011), researchers investigating multimedia learning have begun to transfer insights gained from more basic embodiment research into applied settings (Paas and Sweller, 2012; Choi et al., 2014). Research on embodied learning usually focuses on the application of principles derived from embodiment research to the presentation of learning contents in educational settings (van Gog et al., 2009; Lindgren and Johnson-Glenberg, 2013).
A large part of educational research in the area of multimedia learning is concerned with learning settings in which, among others, the influence of visual and auditive design characteristics of learning materials is investigated (see Mayer, 2005, for an overview). However, formats of online education have been referred to as “disembodied” (Dall’Alba and Barnacle, 2005, p. 730). Still, even studies that include only very basic forms of bodily involvement and action beyond standard user interfaces are currently presented as being linked to embodiment research (e.g., Agostinho et al., 2015; Dubé and McEwen, 2015). Though, a large number of studies focusing on embodied learning deal with more sophisticated learning scenarios involving technology such as tangible user interfaces (e.g., Pouw et al., 2016a; Skulmowski et al., 2016) and mixed reality environments (e.g., Johnson-Glenberg et al., 2014, 2016). Therefore, the term embodied learning scenarios currently needs to be interpreted broadly (see Johnson-Glenberg et al., 2014, for a taxonomy).
Clark (1999, p. 348) introduced the theoretical distinction between “simple embodiment” and “radical embodiment”; Clark (1999) characterizes the former type of studies as embodied cognition research dealing with theoretical entities such as mental representation and computation, whereas the latter type of embodiment theory is described by Clark (1999) as rejecting these concepts (for further overviews, see Gallagher, 2005; Lindblom, 2015). However, educational researchers incorporating insights from embodied cognition usually do not exclusively align with the theoretical assumptions of either of these two views of embodiment. Thus, embodied learning currently needs to be considered to be a rather broad term. It includes studies based on the notion of multimodal mental representations related to Barsalou’s (1999) model (see Skulmowski et al., 2016, for an example), as well as theoretical assumptions derived from non-representational accounts focusing on the bodily enactment of learning contents (for overviews on enactivism in the context of learning, see Gallagher and Lindgren, 2015; Hutto et al., 2015; see Lindgren et al., 2016, for a study that exemplifies the enactive approach).
When applied to educational settings involving the measurement of cognitive load during learning, these theoretical models are operationalized in a multitude of ways. Interventions based on embodiment have been introduced to a large number of subjects and educational contexts, including physics (e.g., Johnson-Glenberg et al., 2014, 2016; Pouw et al., 2016a), language learning (Post et al., 2013), mathematics (e.g., Ruiter et al., 2015), and reading comprehension (e.g., Glenberg et al., 2004).
As a number of recent embodiment studies in the field of multimedia learning have revealed negative results concerning the effectiveness of body-based (and in some cases activity-based) forms of instruction (e.g., Post et al., 2013; Song et al., 2014; see Tran et al., 2017), a closer look at the cognitive mechanisms relevant to embodied learning seems warranted. The field of multimedia learning research employs a wide array of measures in order to assess the cognitive demands that learning materials impose on learners (see Brünken et al., 2003, for an overview). Cognitive load theory (CLT; Sweller, 1988; Sweller et al., 1998) is considered to have exhibited a major influence on the field of learning and instruction (Ozcinar, 2009); therefore, a large part of educational research concerned with embodied learning relates the findings of embodied cognition research to CLT (e.g., Paas and Sweller, 2012; Skulmowski et al., 2016). Conversely, progress in the field of cognitive load measurement is regarded to be important for the future of CLT (Paas et al., 2003). The objective of this review is to present subjective, behavioral, and physiological measurements of cognitive load in the context of embodied learning scenarios and to provide an assessment concerning the success of these instruments in recent studies.
Cognitive Load Theory
The CLT model is built upon the premise that cognitive capacity is inherently limited by the availability of working memory resources (Sweller et al., 1998), based on the working memory model introduced by Baddeley (1992). CLT has been conceived as a computationalist framework right from the beginning (Sweller, 1988), implying a theoretical alignment with “simple embodiment” as defined by Clark (1999, p. 348).
In order to achieve an optimal exploitation of resources, CLT suggests interventions aimed at manipulating cognitive load, which is theoretically subdivided into three types of cognitive load (Sweller et al., 1998). These load types are described in the following section.
Load Types
CLT researchers subscribe to a model dividing learners’ cognitive resources into three distinct kinds of cognitive load, namely the components intrinsic load, extraneous load, and germane load (Sweller et al., 1998). Intrinsic load is defined as measuring the inherent difficulty of learning contents (Sweller, 1994; Sweller and Chandler, 1994). Instructional factors concerning the design of learning materials are thought to influence the second component of CLT, the so-called extraneous load (Sweller, 1994; Sweller et al., 1998). CLT models usually include a third component, namely germane load, that is thought to be associated with the generation of knowledge structures in long-term memory (Sweller et al., 1998). Some researchers suggest to consider germane load as being linked to meta-cognitive processes (Valcke, 2002; Young et al., 2016). Moreover, there has been a debate around the issue whether it is actually necessary to distinguish between three types of cognitive load that called into doubt several assumptions made regarding germane load (de Jong, 2010; Kalyuga, 2011). Whelan (2007) reviewed several neuroscientific studies on learning and provided interpretations regarding the neural underpinnings of CLT.
Cognitive Load Measurement for Embodied Learning
The measurement of cognitive load is generally regarded as a difficult task (e.g., de Jong, 2010; Martin, 2014), with some researchers even arguing against the use of distinct measures for the three load types (Kalyuga, 2011). In the following we will present and review methods that have been used to measure cognitive load in embodied learning scenarios, evaluate their success and highlight new developments.
Subjective Methods
One method of cognitive load measurement is the use of subjective scales (Paas et al., 2003). One commonly used question item developed by Paas (1992) asks participants for an indication of their mental effort during a learning task. In the following, we will provide some examples of recent embodiment studies that used this item:
Castro-Alonso et al. (2015a) found significant differences for the item developed by Paas (1992) when comparing animated learning materials with static depictions in the context of a brick construction task. Significant results of this item (Paas, 1992) indicating less cognitive load for static forms of instruction compared to animations were found in one trial of a related study (Experiment 1 in Wong et al., 2015). In contrast, other embodiment studies did not reveal significant effects using variants of this item (e.g., Ruiter et al., 2015; Pouw et al., 2016a). The mental effort item developed by Paas (1992) has been used in various studies to compute the instructional efficiency (Paas and van Merriënboer, 1993) of learning interventions (e.g., Castro-Alonso et al., 2014).
Another method of survey-based cognitive load measurement is the NASA Task Load Index (NASA-TLX; Hart and Staveland, 1988), which was recently used in studies concerning embodied learning (Skulmowski and Rey, 2017) and problem-solving (Kaspar and Vennekötter, 2015). The NASA-TLX survey contains of six question items: mental demand, physical demand, temporal demand, performance, effort, and frustration. Neither in the two studies reported by Skulmowski and Rey (2017) nor in the two experiments described by Kaspar and Vennekötter (2015) did the NASA-TLX result in significant differences concerning most of the cognitive variables of the NASA-TLX. The variable effort was significantly affected by the embodiment manipulation of sensing weight during a problem-solving task in Experiment 1 of Kaspar and Vennekötter (2015); the variable physical demands was significantly affected by the embodiment manipulation targeted at increasing physical exertion during a word learning task in both experiments of Skulmowski and Rey (2017). For a comparison between the NASA-TLX and the mental effort scale developed by Paas (1992), see Naismith et al. (2015).
Recently, cognitive load surveys measuring the three distinct load types were presented (e.g., Eysink et al., 2009; Leppink et al., 2013). The cognitive load survey instrument presented by Leppink et al. (2013) contains question items aimed at measuring intrinsic, extraneous, and germane load. However, the question items of this instrument (Leppink et al., 2013, p. 1070) refer to “instructions”, “explanations”, as well as “concepts” and “definitions”, suggesting that this survey may not be the optimal choice for instructional settings that rely less strongly on verbal instructions.
Another cognitive load survey was developed by Eysink et al. (2009) and contains one question item aimed at measuring intrinsic cognitive load, three items targeted at extraneous load, one item for germane load, and a last item for overall load. Eysink et al. (2009) used their cognitive load survey in order to measure cognitive load in the context of learning with (interactive) simulations (see Plass et al., 2009, for an overview of research on simulations). Hence, due to the links between research on interactive learning media and embodiment that have been suggested in the literature (see Lindgren and Johnson-Glenberg, 2013; Castro-Alonso et al., 2015b), one may assume that this survey could be appropriate for embodied learning research. Skulmowski et al. (2016) used this survey in a study investigating the effects of different interaction designs on learning. The study (Skulmowski et al., 2016) revealed a correspondence of the extraneous load ratings with retention scores (i.e., higher retention scores when extraneous load was lower and vice versa), providing evidence for the appropriateness of this questionnaire in embodied learning scenarios.
In summary, subjective measures may provide useful for cognitive load measurement in embodied scenarios if an appropriate survey is chosen. However, there are some general problems and theoretical issues related to the use of cognitive load questionnaires (see also de Jong, 2010). Van Gog and Paas (2008) highlight the problem that different phrasings in cognitive load question items might lead to results that may not be comparable. Furthermore, Leppink et al. (2013) suggest to conduct additional research specifically aimed at determining how participants understand cognitive load question items in different contexts. Lastly, Skulmowski et al. (2016) propose to subdivide extraneous load into more fine-grained components in the context of embodiment.
Behavioral Measures of Cognitive Load
Behavioral measures of cognitive load are an alternative to subjective measures (see Brünken et al., 2003, for an overview). In recent embodiment studies, a variety of behavioral measures have been utilized. For instance, Pouw et al. (2016a) included an analysis of reaction times alongside mental effort questions and performance measures. Dubé and McEwen (2015) used measures of response latency to investigate behavioral aspects of touchscreen interaction types in the context of embodied learning. Eye movements were used as an indicator of cognitive activity in a study presented in Pouw et al. (2016b). As the study (Pouw et al., 2016b) involved bodily activity in the form of gesturing, a mobile eye tracker was used.
Research on multimedia learning has made use of dual-task performance as a measure of cognitive load (e.g., Brünken et al., 2002). The procedure developed by Park and Brünken (2015) has been suggested for use in embodied learning research (Pouw et al., 2016c). However, recent findings suggest that specific types of dual-tasks may more strongly negatively affect performance in text-based forms of instruction compared to learning materials that additionally include pictures (van Genuchten et al., 2014). Kirschner et al. (2011) argue that the dual-task method may not be adequate for more elaborate settings. Therefore, we think that further research should be conducted to assess how dual-task measurements affect different cognitive processes involved in embodied learning scenarios.
Physiological Measures of Cognitive Load
Physiological measures of cognitive load (for overviews, see Brünken et al., 2003; Paas et al., 2003) include electroencephalography (EEG; e.g., Antonenko et al., 2010), heart rate (e.g., Paas et al., 1994), and pupil dilation (e.g., van Gerven et al., 2004). However, the application of brain imaging to embodied scenarios involving extensive movement may also introduce new difficulties (Gramann et al., 2014); in some cases requiring complex setups (e.g., Ehinger et al., 2014). On the other hand, EEG recordings can now be generated using low-budget EEG headsets (e.g., Debener et al., 2012; Palermo et al., 2017).
Pupil dilation was used in a variety of studies to measure cognitive load during learning and related cognitive tasks (e.g., van Gerven et al., 2004; Mitra et al., 2016). Recent research supports the idea that pupil dilation may be a valuable measure of mental demands in the context of movement-related studies (Jiang et al., 2015). Again, it should be noted that embodied learning scenarios in which participants perform movements may require the use of specialized hardware in the form of mobile eye tracking devices (e.g., Pouw et al., 2016b). As an increasing number of embodied learning scenarios are presented using immersive virtual reality equipment and related technologies (for a meta-analysis, see Merchant et al., 2014), pupillometric measurements may be obtained using eye trackers integrated into head-mounted displays (e.g., Skulmowski et al., 2014). In addition, other non-invasive physiological measures such as functional near-infrared spectroscopy were recently used in the context of embodied learning (Brucker et al., 2015).
Outlook and Conclusion
In this review we have summarized the most widely used methods of cognitive load measurement as they pertain to embodied learning scenarios. Yet, several developments within the field of cognitive load measurement should be taken into greater account when investigating embodied learning. Repeated-measures study designs have been revealed to provide more appropriate measurements of cognitive load (e.g., van Gog et al., 2012; see Leppink and van Merriënboer, 2015), but only few studies on embodied learning have so far implemented repeated measurements of cognitive load (see Wong et al., 2015, for an example).
A number of recent studies on embodied learning employed meta-cognitive ratings in the form of judgments of learning, i.e., predictive self-assessments on how well one will be able to recall learning contents (e.g., Alban and Kelley, 2013; Skulmowski and Rey, 2017; for an overview on metacognition, see Dunlosky and Metcalfe, 2009). A study investigating the effects of a drawing activity on learning revealed that judgments of learning are even better predictors of learning results than cognitive load measurements (Schleinschok et al., 2017). Theoretical advances concerning embodied cognition have focused on the aspect of prediction (e.g., Clark, 2013, 2015) and there have been suggestions toward emphasizing meta-cognitive judgments within CLT (see Valcke, 2002; Skulmowski et al., 2016).
Judging from recent research on embodied learning, we can draw a number of conclusions for cognitive load measurement. Considering the reviewed studies utilizing subjective methods, cognitive load surveys appear to be a viable choice for measuring cognitive load in embodied learning. Yet, the different wordings found across different cognitive load surveys may pose a difficulty for choosing an appropriate survey for learning settings based on embodiment theory (see Subjective Methods).
Behavioral and physiological measures of cognitive load are objective alternatives to subjective cognitive load surveys (Brünken et al., 2003; Paas et al., 2003). In Section “Behavioral Measures of Cognitive Load” we have presented arguments in favor and against the use of dual-task performance as cognitive load measurement. From the reviewed research on physiological measures, we can see an enormous potential for these types of measures for educational and applied research based on embodied cognition. However, embodied learning may require specialized equipment allowing to perform mobile recordings (see Physiological Measures of Cognitive Load).
To conclude, researchers interested in embodied learning have a wide variety of tools for cognitive load measurement at their disposal. Yet, as we have seen, some methods are more appropriate than others for specific situations. Therefore, further research is necessary to determine more detailed guidelines regarding the use of cognitive load measurement methods in embodied scenarios.
Author Contributions
AS created the initial draft of the manuscript. GR provided critical revisions to the draft. Both authors read and approved the final manuscript.
Funding
This research received funding from the German Research Foundation/DFG, GRK 1780/1. The publication costs of this article were funded by the German Research Foundation/DFG and the Technische Universität Chemnitz in the funding program Open Access Publishing.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
Agostinho, S., Tindall-Ford, S., Ginns, P., Howard, S. J., Leahy, W., and Paas, F. (2015). Giving learning a helping hand: finger tracing of temperature graphs on an iPad. Educ. Psychol. Rev. 27, 427–443. doi: 10.1007/s10648-015-9315-5
Alban, M. W., and Kelley, C. M. (2013). Embodiment meets metamemory: weight as a cue for metacognitive judgments. J. Exp. Psychol. Learn. Mem. Cogn. 39, 1628–1634. doi: 10.1037/a0032420
Antonenko, P., Paas, F., Grabner, R., and van Gog, T. (2010). Using electroencephalography to measure cognitive load. Educ. Psychol. Rev. 22, 425–438. doi: 10.1007/s10648-010-9130-y
Barsalou, L. (2003). Situated simulation in the human conceptual system. Lang. Cogn. Process. 18, 513–562. doi: 10.1080/01690960344000026
Barsalou, L. W. (1999). Perceptions of perceptual symbols. Behav. Brain Sci. 22, 637–660. doi: 10.1017/S0140525X99532147
Barsalou, L. W. (2008). Grounded cognition. Annu. Rev. Psychol. 59, 617–645. doi: 10.1146/annurev.psych.59.103006.093639
Brucker, B., Ehlis, A. C., Häußinger, F. B., Fallgatter, A. J., and Gerjets, P. (2015). Watching corresponding gestures facilitates learning with animations by activating human mirror-neurons: an fNIRS study. Learn. Instr. 36, 27–37. doi: 10.1016/j.learninstruc.2014.11.003
Brünken, R., Plass, J. L., and Leutner, D. (2003). Direct measurement of cognitive load in multimedia learning. Educ. Psychol. 38, 53–61. doi: 10.1207/S15326985EP3801_7
Brünken, R., Steinbacher, S., Plass, J. L., and Leutner, D. (2002). Assessment of cognitive load in multimedia learning using dual-task methodology. Exp. Psychol. 49, 109–119. doi: 10.1027//1618-3169.49.2.109
Castro-Alonso, J. C., Ayres, P., and Paas, F. (2014). Learning from observing hands in static and animated versions of non-manipulative tasks. Learn. Instr. 34, 11–21. doi: 10.1016/j.learninstruc.2014.07.005
Castro-Alonso, J. C., Ayres, P., and Paas, F. (2015a). Animations showing Lego manipulative tasks: three potential moderators of effectiveness. Comput. Educ. 85, 1–13. doi: 10.1016/j.compedu.2014.12.022
Castro-Alonso, J. C., Ayres, P., and Paas, F. (2015b). “The potential of embodied cognition to improve STEAM instructional dynamic visualizations,” in Emerging Technologies for STEAM Education, eds X. Ge, D. Ifenthaler, and J. M. Spector (New York, NY: Springer), 113–136. doi: 10.1007/978-3-319-02573-5_7
Choi, H. H., van Merriënboer, J. J., and Paas, F. (2014). Effects of the physical environment on cognitive load and learning: towards a new model of cognitive load. Educ. Psychol. Rev. 26, 225–244. doi: 10.1007/s10648-014-9262-6
Clark, A. (1999). An embodied cognitive science? Trends Cogn. Sci. 3, 345–351. doi: 10.1016/S1364-6613(99)01361-3
Clark, A. (2013). Whatever next? Predictive brains, situated agents, and the future of cognitive science. Behav. Brain Sci. 36, 181–204. doi: 10.1017/S0140525X12000477
Clark, A. (2015). Surfing Uncertainty: Prediction, Action, and the Embodied Mind. Oxford: Oxford University Press.
Dall’Alba, G., and Barnacle, R. (2005). Embodied knowing in online environments. Educ. Philos. Theory 37, 719–744. doi: 10.1111/j.1469-5812.2005.00153.x
de Jong, T. (2010). Cognitive load theory, educational research, and instructional design: some food for thought. Instr. Sci. 38, 105–134. doi: 10.1007/s11251-009-9110-0
Debener, S., Minow, F., Emkes, R., Gandras, K., and Vos, M. (2012). How about taking a low-cost, small, and wireless EEG for a walk? Psychophysiology 49, 1617–1621. doi: 10.1111/j.1469-8986.2012.01471.x
Dubé, A. K., and McEwen, R. N. (2015). Do gestures matter? The implications of using touchscreen devices in mathematics instruction. Learn. Instr. 40, 89–98. doi: 10.1016/j.learninstruc.2015.09.002
Ehinger, B. V., Fischer, P., Gert, A. L., Kaufhold, L., Weber, F., Pipa, G., et al. (2014). Kinesthetic and vestibular information modulate alpha activity during spatial navigation: a mobile EEG study. Front. Hum. Neurosci. 8:71. doi: 10.3389/fnhum.2014.00071
Eysink, T. H., de Jong, T., Berthold, K., Kolloffel, B., Opfermann, M., and Wouters, P. (2009). Learner performance in multimedia learning arrangements: an analysis across instructional approaches. Am. Educ. Res. J. 46, 1107–1149. doi: 10.3102/0002831209340235
Gallagher, S. (2005). How the Body Shapes the Mind. Oxford: Oxford University Press. doi: 10.1093/0199271941.001.0001
Gallagher, S., and Lindgren, R. (2015). Enactive metaphors: learning through full-body engagement. Educ. Psychol. Rev. 27, 391–404. doi: 10.1007/s10648-015-9327-1
Glenberg, A. M. (2010). Embodiment as a unifying perspective for psychology. Wiley Interdiscip. Rev. Cogn. Sci. 1, 586–596. doi: 10.1002/wcs.55
Glenberg, A. M., Gutierrez, T., Levin, J. R., Japuntich, S., and Kaschak, M. P. (2004). Activity and imagined activity can enhance young children’s reading comprehension. J. Educ. Psychol. 96, 424–436. doi: 10.1037/0022-0663.96.3.424
Gramann, K., Ferris, D. P., Gwin, J., and Makeig, S. (2014). Imaging natural cognition in action. Int. J. Psychophysiol. 91, 22–29. doi: 10.1016/j.ijpsycho.2013.09.003
Hart, S. G., and Staveland, L. E. (1988). Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. Adv. Psychol. 52, 139–183. doi: 10.1016/S0166-4115(08)62386-9
Hutto, D. D., Kirchhoff, M. D., and Abrahamson, D. (2015). The enactive roots of STEM: rethinking educational design in mathematics. Educ. Psychol. Rev. 27, 371–389. doi: 10.1007/s10648-015-9326-2
Jiang, X., Zheng, B., Bednarik, R., and Atkins, M. S. (2015). Pupil responses to continuous aiming movements. Int. J. Hum. Comput. Stud. 83, 1–11. doi: 10.1016/j.ijhcs.2015.05.006
Johnson-Glenberg, M. C., Birchfield, D. A., Tolentino, L., and Koziupa, T. (2014). Collaborative embodied learning in mixed reality motion-capture environments: two science studies. J. Educ. Psychol. 106, 86–104. doi: 10.1037/a0034008
Johnson-Glenberg, M. C., Megowan-Romanowicz, C., Birchfield, D. A., and Savio-Ramos, C. (2016). Effects of embodied learning and digital platform on the retention of physics content: centripetal force. Front. Psychol. 7:1819. doi: 10.3389/fpsyg.2016.01819
Kalyuga, S. (2011). Cognitive load theory: how many types of load does it really need? Educ. Psychol. Rev. 23, 1–19. doi: 10.3389/fpsyg.2016.00420
Kaspar, K., and Vennekötter, A. (2015). Embodied information in cognitive tasks: haptic weight sensations affect task performance and processing style. Adv. Cogn. Psychol. 11, 64–76. doi: 10.5709/acp-0172-0
Kirschner, P. A., Ayres, P., and Chandler, P. (2011). Contemporary cognitive load theory research: the good, the bad and the ugly. Comput. Hum. Behav. 27, 99–105. doi: 10.1016/j.chb.2010.06.025
Leppink, J., Paas, F., van der Vleuten, C. P., van Gog, T., and van Merriënboer, J. J. (2013). Development of an instrument for measuring different types of cognitive load. Behav. Res. Methods 45, 1058–1072. doi: 10.3758/s13428-013-0334-1
Leppink, J., and van Merriënboer, J. J. (2015). The beast of aggregating cognitive load measures in technology-based learning. Educ. Technol. Soc. 18, 230–245.
Lindgren, R., and Johnson-Glenberg, M. (2013). Emboldened by embodiment: six precepts for research on embodied learning and mixed reality. Educ. Res. 42, 445–452. doi: 10.3102/0013189X13511661
Lindgren, R., Tscholl, M., Wang, S., and Johnson, E. (2016). Enhancing learning and engagement through embodied interaction within a mixed reality simulation. Comput. Educ. 95, 174–187. doi: 10.1016/j.compedu.2016.01.001
Martin, S. (2014). Measuring cognitive load and cognition: metrics for technology-enhanced learning. Educ. Res. Eval. 20, 592–621. doi: 10.1080/13803611.2014.997140
Mayer, R. E. (2005). “Cognitive theory of multimedia learning,” in The Cambridge Handbook of Multimedia Learning, ed. R. E. Mayer (Cambridge: Cambridge University Press), 31–48. doi: 10.1017/CBO9780511816819.004
Merchant, Z., Goetz, E. T., Cifuentes, L., Keeney-Kennicutt, W., and Davis, T. J. (2014). Effectiveness of virtual reality-based instruction on students’ learning outcomes in K-12 and higher education: a meta-analysis. Comput. Educ. 70, 29–40. doi: 10.1016/j.compedu.2013.07.033
Mitra, R., McNeal, K. S., and Bondell, H. D. (2016). Pupillary response to complex interdependent tasks: a cognitive-load theory perspective. Behav. Res. Methods doi: 10.3758/s13428-016-0833-y [Epub ahead of print].
Naismith, L. M., Cheung, J. J., Ringsted, C., and Cavalcanti, R. B. (2015). Limitations of subjective cognitive load measures in simulation-based procedural training. Med. Educ. 49, 805–814. doi: 10.1111/medu.12732
Ozcinar, Z. (2009). The topic of instructional design in research journals: a citation analysis for the years 1980-2008. Australas. J. Educ. Technol. 25, 559–580. doi: 10.14742/ajet.1129
Paas, F., and Sweller, J. (2012). An evolutionary upgrade of cognitive load theory: using the human motor system and collaboration to support the learning of complex cognitive tasks. Educ. Psychol. Rev. 24, 27–45. doi: 10.1007/s10648-011-9179-2
Paas, F., Tuovinen, J. E., Tabbers, H., and van Gerven, P. W. (2003). Cognitive load measurement as a means to advance cognitive load theory. Educ. Psychol. 38, 63–71. doi: 10.1207/S15326985EP3801_8
Paas, F. G. (1992). Training strategies for attaining transfer of problem-solving skill in statistics: a cognitive-load approach. J. Educ. Psychol. 84, 429–434. doi: 10.1037/0022-0663.84.4.429
Paas, F. G., and van Merriënboer, J. J. (1993). The efficiency of instructional conditions: an approach to combine mental effort and performance measures. Hum. Fact. 35, 737–743.
Paas, F. G., van Merriënboer, J. J., and Adam, J. J. (1994). Measurement of cognitive load in instructional research. Percept. Mot. Skills 79, 419–430. doi: 10.2466/pms.1994.79.1.419
Palermo, E., Laut, J., Nov, O., Cappa, P., and Porfiri, M. (2017). Spatial memory training in a citizen science context. Comput. Hum. Behav. 73, 38–46. doi: 10.1016/j.chb.2017.03.017
Park, B., and Brünken, R. (2015). The rhythm method: a new method for measuring cognitive load—an experimental dual-task study. Appl. Cogn. Psychol. 29, 232–243. doi: 10.1002/acp.3100
Plass, J. L., Homer, B. D., and Hayward, E. O. (2009). Design factors for educationally effective animations and simulations. J. Comp. High. Educ. 21, 31–61. doi: 10.1007/s12528-009-9011-x
Post, L. S., Van Gog, T., Paas, F., and Zwaan, R. A. (2013). Effects of simultaneously observing and making gestures while studying grammar animations on cognitive load and learning. Comput. Hum. Behav. 29, 1450–1455. doi: 10.1016/j.chb.2013.01.005
Pouw, W. T., Eielts, C., van Gog, T., Zwaan, R. A., and Paas, F. (2016a). Does (non-) meaningful sensori-motor engagement promote learning with animated physical systems? Mind Brain Educ. 10, 91–104. doi: 10.1111/mbe.12105
Pouw, W. T., Mavilidi, M. F., van Gog, T., and Paas, F. (2016b). Gesturing during mental problem solving reduces eye movements, especially for individuals with lower visual working memory capacity. Cogn. Proc. 17, 269–277. doi: 10.1007/s10339-016-0757-6
Pouw, W. T., van Gog, T., Zwaan, R. A., and Paas, F. (2016c). Augmenting instructional animations with a body analogy to help children learn about physical systems. Front. Psychol. 7:860. doi: 10.3389/fpsyg.2016.00860
Ruiter, M., Loyens, S., and Paas, F. (2015). Watch your step children! Learning two-digit numbers through mirror-based observation of self-initiated body movements. Educ. Psychol. Rev. 27, 457–474. doi: 10.1007/s10648-015-9324-4
Schleinschok, K., Eitel, A., and Scheiter, K. (2017). Do drawing tasks improve monitoring and control during learning from text? Learn. Instr. doi: 10.1016/j.learninstruc.2017.02.002 [Epub ahead of print].
Skulmowski, A., Bunge, A., Kaspar, K., and Pipa, G. (2014). Forced-choice decision-making in modified trolley dilemma situations: a virtual reality and eye tracking study. Front. Behav. Neurosci. 8:426. doi: 10.3389/fnbeh.2014.00426
Skulmowski, A., Pradel, S., Kühnert, T., Brunnett, G., and Rey, G. D. (2016). Embodied learning using a tangible user interface: the effects of haptic perception and selective pointing on a spatial learning task. Comput. Educ. 92–93, 64–75. doi: 10.1016/j.compedu.2015.10.011
Skulmowski, A., and Rey, G. D. (2017). Bodily effort enhances learning and metacognition: investigating the relation between physical effort and cognition using dual-process models of embodiment. Adv. Cogn. Psychol. 13, 3–10. doi: 10.5709/acp-0202-9
Song, H. S., Pusic, M., Nick, M. W., Sarpel, U., Plass, J. L., and Kalet, A. L. (2014). The cognitive impact of interactive design features for learning complex materials in medical education. Comput. Educ. 71, 198–205. doi: 10.1016/j.compedu.2013.09.017
Sweller, J. (1988). Cognitive load during problem solving: effects on learning. Cogn. Sci. 12, 257–285. doi: 10.1207/s15516709cog1202_4
Sweller, J. (1994). Cognitive load theory, learning difficulty, and instructional design. Learn. Instr. 4, 295–312. doi: 10.1016/0959-4752(94)90003-5
Sweller, J., and Chandler, P. (1994). Why some material is difficult to learn. Cogn. Instr. 12, 185–233. doi: 10.1207/s1532690xci1203_1
Sweller, J., van Merrienboer, J. J., and Paas, F. G. (1998). Cognitive architecture and instructional design. Educ. Psychol. Rev. 10, 251–296. doi: 10.1023/A:1022193728205
Tran, C., Smith, B., and Buschkuehl, M. (2017). Support of mathematical thinking through embodied cognition: nondigital and digital approaches. Cogn. Res. Princ. Implic. 2:16. doi: 10.1186/s41235-017-0053-8
Valcke, M. (2002). Cognitive load: updating the theory? Learn. Instr. 12, 147–154. doi: 10.1016/S0959-4752(01)00022-6
van Genuchten, E., Hooijdonk, C., Schüler, A., and Scheiter, K. (2014). The role of working memory when ‘learning how’ with multimedia learning material. Appl. Cogn. Psychol. 28, 327–335. doi: 10.1002/acp.2998
van Gerven, P. W., Paas, F., van Merriënboer, J. J., and Schmidt, H. G. (2004). Memory load and the cognitive pupillary response in aging. Psychophysiology 41, 167–174. doi: 10.1111/j.1469-8986.2003.00148.x
van Gog, T., Kirschner, F., Kester, L., and Paas, F. (2012). Timing and frequency of mental effort measurement: evidence in favour of repeated measures. Appl. Cogn. Psychol. 26, 833–839. doi: 10.1002/acp.2883
van Gog, T., and Paas, F. (2008). Instructional efficiency: revisiting the original construct in educational research. Educ. Psychol. 43, 16–26. doi: 10.1080/00461520701756248
van Gog, T., Paas, F., Marcus, N., Ayres, P., and Sweller, J. (2009). The mirror neuron system and observational learning: implications for the effectiveness of dynamic visualizations. Educ. Psychol. Rev. 21, 21–30. doi: 10.1007/s10648-008-9094-3
Whelan, R. R. (2007). Neuroimaging of cognitive load in instructional multimedia. Educ. Res. Rev. 2, 1–12. doi: 10.1016/j.edurev.2006.11.001
Wilson, M. (2002). Six views of embodied cognition. Psychon. Bull. Rev. 9, 625–636. doi: 10.3758/BF03196322
Wong, M., Castro-Alonso, J. C., Ayres, P., and Paas, F. (2015). Gender effects when learning manipulative tasks from instructional animations and static presentations. Educ. Technol. Soc. 18, 37–52.
Keywords: embodied cognition, learning, cognitive load theory, cognitive load, measurement
Citation: Skulmowski A and Rey GD (2017) Measuring Cognitive Load in Embodied Learning Settings. Front. Psychol. 8:1191. doi: 10.3389/fpsyg.2017.01191
Received: 26 March 2017; Accepted: 29 June 2017;
Published: 02 August 2017.
Edited by:
Claudia Repetto, Università Cattolica del Sacro Cuore, ItalyReviewed by:
Jessica Lindblom, University of Skövde, SwedenThea Ionescu, Babeş-Bolyai University, Romania
Copyright © 2017 Skulmowski and Rey. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Alexander Skulmowski, YWxleGFuZGVyLnNrdWxtb3dza2lAcGhpbC50dWNoZW1uaXR6LmRl