Skip to main content

ORIGINAL RESEARCH article

Front. Psychol., 15 February 2022
Sec. Cognition
This article is part of the Research Topic Advancing the use of Eye-Tracking and Pupillometric data in Complex Environments. View all 11 articles

Spontaneous Eye Blink Rate During the Working Memory Delay Period Predicts Task Accuracy

  • 1Department of Psychology, The City College of the City University of New York, New York, NY, United States
  • 2Behavioral and Cognitive Neuroscience Program, The Graduate Center of the City University of New York, New York, NY, United States
  • 3Department of Neurosurgery, Cedars-Sinai Medical Center, Los Angeles, CA, United States

Spontaneous eye blink rate (sEBR) has been linked to attention and memory, specifically working memory (WM). sEBR is also related to striatal dopamine (DA) activity with schizophrenia and Parkinson’s disease showing increases and decreases, respectively, in sEBR. A weakness of past studies of sEBR and WM is that correlations have been reported using blink rates taken at baseline either before or after performance of the tasks used to assess WM. The goal of the present study was to understand how fluctuations in sEBR during different phases of a visual WM task predict task accuracy. In two experiments, with recordings of sEBR collected inside and outside of a magnetic resonance imaging bore, we observed sEBR to be positively correlated with WM task accuracy during the WM delay period. We also found task-related modulation of sEBR, including higher sEBR during the delay period compared to rest, and lower sEBR during task phases (e.g., stimulus encoding) that place demands on visual attention. These results provide further evidence that sEBR could be an important predictor of WM task performance with the changes during the delay period suggesting a role in WM maintenance. The relationship of sEBR to DA activity and WM maintenance is discussed.

Introduction

The healthy human blinks around 15–20 times per minute (Tsubota et al., 1996), however the precorneal tear film, which lubricates the eye, only begins drying up approximately 25 s after a blink ends (Norn, 1969). This suggests that we blink more often than needed to maintain a lubricated precorneal tear film. Previous research has found task-related modulation of spontaneous eye blink rate (sEBR), which indicates that blinking could be reflective of cognitive factors (Siegle et al., 2008; Oh et al., 2012). For example, reading is accompanied by low levels of sEBR, while high levels of sEBR have been reported during conversation (Bentivoglio et al., 1997). More recent studies have found that sEBR correlates with attentional load and fatigue (Maffei and Angrilli, 2018), attentional control (Colzato et al., 2009; Unsworth et al., 2019a), can track working memory updating and gating (Rac-Lubashevsky et al., 2017), and can predict differences in exploration during reinforcement learning (Van Slooten et al., 2019). In addition, a growing body of literature continues to provide evidence supporting sEBR as an effective measure of striatal dopamine (DA) activity (Jongkees and Colzato, 2016). However, whether sEBR does indeed reflect DA activity is still debated today (Dang et al., 2017; Sescousse et al., 2018).

The connection between sEBR and DA first came from observations of neurological and psychiatric disorders that found decreased sEBR in patients with Parkinson’s (Hall, 1945; Reddy et al., 2013), a neurodegenerative disorder that affects the dopaminergic system in the brain, causing symptoms like rigidity (Dauer and Przedborski, 2003). Schizophrenia has also been suggested to provide evidence for a connection between sEBR and DA due to excessive DA activity in the striatum (Howes et al., 2015) and increased sEBR in schizophrenia patients (Adamson, 1995; Swarztrauber and Fujikawa, 1998). Additionally, sEBR and DA has previously been investigated in pharmacological studies, which have observed an increase in sEBR after administration of DA agonists, while DA antagonists decreased sEBR in primates (Elsworth et al., 1991; Jutkiewicz and Bergman, 2004). In one study, researchers found sEBR was correlated with dopamine levels specifically in the caudate nucleus in monkeys, suggesting that DA could regulate blink rate (Taylor et al., 1999). This is further supported by another study that found sEBR to be closely related to in vivo and positron emission tomography measures of striatal D2 receptor density in the ventral striatum and caudate nucleus of adult male vervet monkeys (Groman et al., 2014). These findings provide valuable evidence for sEBR being a viable measure of striatal DA activity and have led to many researchers to adopt sEBR as a measure of DA activity. Moreover, sEBR is an easy-to-record physiological measure that is non-invasive and affordable.

One cognitive process of interest, that is also closely related to DA activity, is working memory (WM) which is the process of actively holding information online and manipulating it to meet task demands (Baddeley, 1992). Prior research has found substantial evidence that demonstrates the importance of dopaminergic neurotransmission and the role of the prefrontal cortex during WM function (Fuster and Alexander, 1971; Funahashi et al., 1989; Courtney et al., 1998; Wager and Smith, 2003; Cools and Robbins, 2004), especially during WM maintenance (Fuster and Alexander, 1971; Funahashi et al., 1989; Constantinidis et al., 2018). Specifically, human studies investigating DA in WM tasks have found both caudate dopamine activity during WM maintenance and DA synthesis capacity to be positively correlated with WM capacity, a measure of the amount of information that can be held in WM (Cools et al., 2008; Landau et al., 2009). Though it is widely accepted that the PFC plays an important role in WM function (Roberts et al., 1998), many researchers still debate the PFC’s role in WM (Seamans and Yang, 2004). One model that attempts to elucidate the PFC’s role in WM function is the prefrontal cortex basal ganglia WM model (PBWM; Frank et al., 2001; Hazy et al., 2006). PBWN is a computational neural network model that suggests that WM requires robust maintenance and rapid selective updating. This model states that the frontal cortex facilitates robust, active maintenance through recurrent excitation in frontal neurons, while the basal ganglia orchestrates a gating mechanism that controls the flow of information into WM (Frank et al., 2001). Previous research has pointed toward DA being important for this sustained firing activity in the PFC during WM maintenance (Sawaguchi, 2001; Durstewitz and Seamans, 2008; De Frias et al., 2010). The relationship between DA and WM performance is believed to follow an inverted U-shape, in which too little or too much dopamine impairs performance, as seen in psychopharmacological studies (Stewart and Plenz, 2006). In one study, the effects of administered dopaminergic drugs on PFC function depended on baseline levels of performance, whereas administration of bromocriptine, a dopamine agonist, impaired performance for individuals with higher working memory abilities while improving performance for individuals with lower working memory abilities (Kimberg et al., 1997).

Although sEBR has been used in prior research to investigate cognitive functions like WM, many of these studies relied on baseline levels of sEBR to investigate these relationships (Tharp and Pickering, 2011; Zhang et al., 2015; Unsworth et al., 2019b). Few studies have investigated the relationship between phasic sEBR during a WM task. Phasic sEBR refers to the measuring of sEBR in response to stimulus conditions while tonic sEBR refers to baseline levels of blinking (Bacher and Allen, 2009). To the best of our knowledge, only one other study has examined sEBR as a function of the different task phases (e.g., stimulus encoding, maintenance during the delay period, and stimulus probe periods) of a WM task (Bacher et al., 2017). Bacher et al. (2017) found modulation of sEBR across these different phases are developed in infants as young as 10 months, indicating that sEBR can reflect dopamine function in early human development. They also observed higher sEBR during the Hide (delay) phase of the task in relation to the Reveal phase, which is when the experimenter revealed the toy’s location to the child. This modulation of sEBR was suggested to reflect the engagement of cognitive resources that have become available during the Hide phase and transiently elevated DA activity that is needed to update and maintain mental representations (Bacher et al., 2017).

The goal of the current study was to investigate how fluctuations in sEBR during different phases of a Sternberg visual WM task (Figure 1) relate to performance, and how sEBR fluctuations change across task demands. First, we hypothesized that sEBR during the WM Delay period, when stimuli are being maintained, would be positively correlated with task performance and that there would be a non-linear relationship such that low and high sEBR would correlate with worse performance. Second, we hypothesized differences in sEBR across phases of the WM task with differences between phasic sEBR during the WM delay and tonic sEBR during non-task rest periods.

FIGURE 1
www.frontiersin.org

Figure 1. Task design. Each trial began with an encoding period where three novel complex scenes were presented for 1,400 ms each. The encoding period was followed by a delay period where a fixation cross was presented on a gray background for a varied amount of time (2 s, 5 s, or 9 s). After the delay period, the probe was presented for 1,400 ms and participants had to identify whether the image was a new image or one of the previously presented images with a button press. After the probe, a scrambled image was presented for 2,000 ms which indicated the end of the trial followed by jittered blank space before the start of the next trial.

Materials and Methods

Participants

The experiments were conducted under a protocol approved by the Institutional Review Board of the City University of New York Human Research Protection Program (CUNY HRPP IRB). All methods were carried out in accordance with the relevant guidelines and regulations of the CUNY HRPP IRB committee. All participants were recruited either by flyers posted throughout the City College of New York campus or by web postings on the City College of New York SONA online experimental scheduling system. All participants had normal or corrected-to-normal vision with no reported neurological or psychiatric disorders. Participants were either compensated $15 per hour or received one psychology course credit per hour of participation in the study. Written informed consent was obtained from all participants in the study.

Participants selected for Experiment 1 and Experiment 2 were part of a larger study. Nineteen healthy participants (8 males; M = 23.79; SD = 7.72) were recruited for Experiment 1. In Experiment 1, sEBR was measured inside a 3 tesla Siemens Prisma MRI scanner. In Experiment 2, sEBR was recorded in a sound attenuated EEG booth during acquisition of EEG data while participants sat upright. Fifty-three healthy participants (29 males; M = 23.58; SD = 5.79) were recruited for Experiment 2. Three participants were removed from Experiment 1 including one participant who was removed for noisy data and two who were removed for task performance below or close to chance. A total of 19 participants were removed from Experiment 2 for multiple reasons including 11 participants who were removed due to bad EOG channel quality, four participants who were removed because of a stimulus marker malfunction, three participants who were removed due to outlier detection, and two who were removed for failing to adhere to the protocol. The final sample for the analysis in Experiment 1 was 16 subjects, and for Experiment 2 was 34 subjects.

Task and Procedure

Prior to the start of the task, participants completed a 5-min Rest period which consisted of staring at a black fixation cross that was shown on a gray background. Participants completed another 5-min Rest period after completing three runs of the task. This fixation cross was also used during the delay period of the task. Participants completed three runs, each run containing 54 trials, of a modified version of the Sternberg WM task (Sternberg, 1966). Naturalistic scenes were used as stimuli and were sampled from the SUN database (Xiao et al., 2010). The task consisted of a stimulus encoding period, delay period, probe period, and post-probe scrambled stimulus period (which served as a visual baseline and to signal end of trial). During the encoding period, participants were shown three subsequent novel scenes for 1400 ms each. During the delay period, a black fixation cross was shown on a gray background for varied lengths (either 2, 5, or 9 s long). The delay period duration was randomized from trial to trial to engage subjects’ attention consistently across trials because they could not predict when the delay period would end. Each three runs of the task had 18 trials of each delay duration with order of presentation randomized. The probe was presented for 1400 ms after the delay period and consisted of a new image (one that has not been presented yet) or an old image (one that was shown during encoding). The chance of receiving a new probe was 50%. Participants indicated whether the image presented was either a new or an old image with a button press. After the probe, a Fourier phase-scrambled scene was shown for 2000 ms, indicating the end of the current trial followed by a jittered period of blank screen.

sEBR Recording

Participants were not given instructions about when to blink during the experiment. Previous studies have found blink rate to be stable between 10 am and 5 pm (Barbato et al., 2000; Doughty and Naase, 2006). For both Experiment 1 and Experiment 2, sEBR was recorded between 10:00 am and 3:00 pm. During Experiment 1, eye blinks were recorded inside a three tesla Siemens Prisma MRI scanner using an MRI compatible EyeLink 1,000 Eye Tracker (SR Research) and was recorded at 500 Hz. In Experiment 2, eye blinks were recorded using an electrooculogram (EOG) that was recorded during 64-channel scalp electroencephalogram using a Brain Products cap and active electrode recording system. EOGs were placed above the left eye and below the right eye to track blinking. Blink detection was performed using MNE Python via the function “find_eog_events” (Gramfort et al., 2013). Blink epochs were evaluated for each run of the task for all participants. Runs with blink epochs which did not resemble the standard blink shape were removed from the analysis. Only participants with 2 or more runs of good eye-tracking data were used in the analysis. The first 2 s of all delay periods were used in the analysis. In Experiment 1 and 2, sEBR was computed by dividing the total number of blinks by the total period duration for any given phase resulting in units of blinks per minute:

s E B R = t o t a l b l i n k s t o t a l p e r i o d d u r a t i o n

Statistical Analysis

Statistical analyses were computed using JASP Version 0.16. sEBR and task accuracy data were checked for outliers prior to analysis and were removed. Because the relationship between sEBR and WM performance is believed to follow an “inverted U-shape,” we did not consider Pearson’s r the optimal measure for this analysis because it is limited to evaluating only a linear relationship between two variables. Instead, we computed Spearman’s rho, which can describe monotonic functions, whereas the value of one variable changes the other variable changes but not necessarily at a constant rate. We also used polynomial regression analysis, which is more appropriate for quantifying non-linear associations. Specifically, we investigated the non-linear relationship between task accuracy and sEBR during the Delay period of the task for both Experiment 1 and Experiment 2 using a second order polynomial regression model. Unidimensional reliability analyses were computed using task accuracy and sEBR as input variables and Cronbach’s α as the frequentist scale reliability statistic. Post-hoc statistical power calculations were computed for each experiment and the combined samples of both experiments with G*Power Version 3.1.9.6 using the correlation between sEBR during the Delay period and task accuracy. Parameters included the Exact test family, Correlation: Bivariate normal model with an α error probability of 0.05, the sample size, and the correlation coefficient as the effect size.

Results

Experiment 1

In Experiment 1, we examined the relationship between sEBR and WM task performance while the duration of the WM delay period interval was varied. The first 2 s of all Delay periods were used in the analysis. First, because of the previously reported non-linear relationship between DA and WM task performance (Cools and D’Esposito, 2011), Spearman’s rho correlation coefficient (rs) was used to analyze the relationship between sEBR and task accuracy. After performing Bonferroni multiple comparisons correction on values of p, we found no significant relationship between sEBR during the phases of the task and task accuracy (Figure 2A). However, there was a strong positive correlation between sEBR during the Delay period and task accuracy (rs = 0.526, p = 0.036; Figure 2A). We then examined the correlation between sEBR during the whole trial period and task accuracy to make sure that this relationship was not driving the relationship between sEBR during the Delay and task accuracy. There was no significant relationship between sEBR during the whole trial and task accuracy (rs = 0.149, p = 0.582; Figure 2B). Descriptive statistics and reliability measures for Experiment 1 are presented in Table 1. Second, we computed a repeated measures ANOVA test to compare participants’ sEBR across the task phases. A Mauchly’s test of sphericity was first computed to check the assumption of sphericity in the data and was found to be significant (p = 0.012). Greenhouse-Geisser and Huynh-Feldt ε values were smaller than 0.75 so a Greenhouse-Geisser correction was performed. There were significant differences in sEBR between group means [F (1.948, 29.213) = 33.196, p < 0.001]. A post-hoc test using the Holm correction revealed that sEBR was significantly lower during Encoding (18.9 ± 11.0 sEBR, p < 0.001) and Probe (11.3 ± 8.0 sEBR, p < 0.001) periods compared to the Delay period (39.4 ± 19.5 sEBR; Figure 3). There was no significant difference in sEBR between the Delay and Scrambled period (p = 0.682). sEBR was also significantly lower during Encoding (18.9 ± 11.0 sEBR, p < 0.001) and Probe (11.3 ± 8.0 sEBR, p < 0.001) periods compared to the Scrambled period (40.9 ± 15.2 sEBR; Figure 3). Finally, we investigated the difference between phasic sEBR during the Delay period and tonic sEBR during the Rest period. We performed a paired samples T test to compare sEBR during the Delay and during Rest. We observed sEBR to be significantly higher during the Delay period (39.4 ± 19.5 sEBR) compared to the Rest period (28.6 ± 14.7 sEBR), t(15) = 2.885, p = 0.0011 (Figure 4A). We then investigated the correlation between tonic sEBR during the Rest period and task accuracy. There was no significant correlation between sEBR during the Rest period and task accuracy (rs = 0.259, p = 0.333; Figure 4B).

FIGURE 2
www.frontiersin.org

Figure 2. Correlation between sEBR during different phases of the task and task accuracy in Experiment 1. Correlation plots show sEBR (blinks/min) on the x-axis and task accuracy on the y-axis. (A) These four plots are encoding (top left), the first 2 s of the delay (top right), probe (bottom left), and scrambled (bottom right) periods. The delay period shows a positive correlation (p = 0.036 but not significant after multiple comparisons correction) between task accuracy and sEBR during the first 2 s of the delay period. (B) This plot represents the relationship between sEBR during the whole trial and task accuracy. Fitted line represents linear regression model fit. Shaded region depicts 95% confidence interval.

TABLE 1
www.frontiersin.org

Table 1. Descriptive statistics and split-half reliability for Experiment 1.

FIGURE 3
www.frontiersin.org

Figure 3. ANOVA test of sEBR across task periods in Experiment 1. Bar plots show task period on the x-axis and sEBR (blinks/min) on the y-axis. Delay period sEBR was significantly greater than Encoding and Probe sEBR. Scrambled sEBR was also significantly greater than Encoding and Probe sEBR. Error bars depict 95% confidence interval. Each colored circle represents an individual participant; some colors may be presented twice in one bar due to limited primary colors available for display. Values of p were adjusted for comparing a family of 4. ***p < 0.001.

FIGURE 4
www.frontiersin.org

Figure 4. Paired T tests between Delay period sEBR and Rest sEBR and correlation between Rest sEBR and task accuracy in Experiment 1. (A) Bar plots show task period on the x-axis and sEBR on the y-axis. Delay period sEBR was significantly higher than Rest sEBR. Error bars depict 95% confidence interval. (B) Correlation plot of sEBR during the Rest period on the x-axis and task accuracy on the y-axis. Fitted line represents linear regression model fit. Shaded region depicts 95% confidence interval. **p < 0.01.

Experiment 2

Experiment 2 included a larger sample of subjects with a task design identical to Experiment 1. First, we examined the relationship between sEBR during each WM task phase and task accuracy. After performing Bonferroni correction on values of p, we found that sEBR during the WM delay period was correlated positively with task performance (rs = 0.508, p = 0.002), with no significant relationships observed between sEBR in other task periods and task performance (Figure 5A). We then examined the relationship between sEBR during the whole trial and task accuracy to make sure that the significant relationship between Delay sEBR and task accuracy was not driven by sEBR during the whole trial. We found no significant relationship between whole trial sEBR and task accuracy (rs = 0.192, p = 0.278; Figure 5B). Descriptive statistics and reliability measures for Experiment 2 are presented in Table 2. We then repeated the same analysis of comparing sEBR across the task phases by computing a repeated measures ANOVA test. A Mauchly’s test of sphericity was first computed to check the assumption of sphericity in the data and was found to be significant (p < 0.001). Greenhouse-Geisser and the Huynh-Feldt ε values were smaller than 0.75 so a Greenhouse-Geisser correction was performed. There were significant differences in sEBR between group means [F (1.578,52.058) = 66.958, p < 0.001]. A post-hoc test using the Holm correction revealed that sEBR was significantly lower during Encoding (11.6 ± 8.0 sEBR, p < 0.001), Probe (7.3 ± 4.1 sEBR, p < 0.001), and Scrambled (19.5 ± 10.6 sEBR, p < 0.001) periods compared to the Delay period (35.6 ± 18.3 sEBR; Figure 6). sEBR was also significantly lower during the Encoding (11.6 ± 8.0 sEBR, p < 0.001) and Probe (7.3 ± 4.1 sEBR, p < 0.001), periods compared to the Scrambled period (19.5 ± 10.6 sEBR; Figure 6). Additionally, sEBR was significantly lower during the Probe (7.3 ± 4.1 sEBR, p = 0.047), period compared to the Encoding period (11.6 ± 8.0 sEBR; Figure 6). We then investigated the difference between sEBR during the Delay period and sEBR during the Rest period. We performed a paired samples T test to compare sEBR during the Delay and during Rest. We observed sEBR to be significantly higher during the Delay period (35.6 ± 18.3 sEBR) compared to the Rest period (17.7 ± 11.1 sEBR), t(33) = 6.005, p < 0.001 (Figure 7A). We then investigated the correlation between tonic sEBR during the Rest period and task accuracy. There was no significant correlation between sEBR during the Rest period and task performance (rs = −0.053, p = 0.768; Figure 7B).

FIGURE 5
www.frontiersin.org

Figure 5. Correlation between sEBR during different phases of the task and task accuracy in Experiment 2. Correlation plots show sEBR on the x-axis and task accuracy on the y-axis. (A) These four plots are encoding (top left), the first 2 s of the delay (top right), probe (bottom left), and scrambled (bottom right) periods. The delay period shows a strong positive correlation (p = 0.002, significant after a multiple comparison correction) between task accuracy and sEBR during the first 2 s of the delay period. (B) This plot represents the relationship between sEBR during the whole trial and task accuracy. Fitted line represents linear regression model fit. Shaded region depicts 95% confidence interval. Values of p for (A) after Bonferroni correction: **p < 0.0025.

TABLE 2
www.frontiersin.org

Table 2. Descriptive statistics and split-half reliability for Experiment 2.

FIGURE 6
www.frontiersin.org

Figure 6. ANOVA test of sEBR across task periods in Experiment 2. Bar plots show task period on the x-axis and sEBR on the y-axis. Delay period sEBR was significantly greater than Encoding, Probe, and Scrambled sEBR. Scrambled sEBR was also significantly greater than Encoding and Probe sEBR. Encoding sEBR was significantly greater than Probe sEBR. Error bars depict 95% confidence interval. Each colored circle represents an individual participant; some colors may be presented twice in one bar due to limited primary colors available for display. Values of p were adjusted for comparing a family of 4. *p < 0.05, and ***p < 0.001.

FIGURE 7
www.frontiersin.org

Figure 7. Paired T tests between Delay period sEBR and Rest sEBR and correlation between Rest sEBR and task accuracy in Experiment 2. (A) Bar plots show task period on the x-axis and sEBR on the y-axis. Delay period sEBR was significantly higher than Rest sEBR. Error bars depict 95% confidence interval. (B) Correlation plot of sEBR during the Rest period on the x-axis and task accuracy on the y-axis. Fitted line represents linear regression model fit. Shaded region depicts 95% confidence interval. ***p < 0.001.

Polynomial Regression Model

To investigate whether sEBR during the Delay varies non-linearly with task performance, we computed a quadratic polynomial regression model between sEBR during the Delay period of Experiment 1 and Experiment 2 and task accuracy. There was no significant polynomial regression relationship found between task accuracy and the first 2 s of the Delay in Experiment 1 (β = 0.324, p = 0.741) nor between task accuracy and the first 2 s of the Delay in Experiment 2 (β = −0.568, p = 0.322; Figure 8).

FIGURE 8
www.frontiersin.org

Figure 8. Polynomial regression model between task accuracy and sEBR during the first 2 s of the delay for Experiment 1 and Experiment 2. Regression plots show sEBR during the first 2 s of the Delay on the x-axis and task accuracy on the y-axis. (A) Polynomial regression model fitted on sEBR during the Delay and task accuracy in Experiment 1. (B) Polynomial regression model fitted on sEBR during the Delay and task accuracy in Experiment 2. Fitted red line represents polynomial regression model fit. The relationship between sEBR and WM performance appears to be non-linear and explains about 20% of the variance in Experiment 2 but does not reach significance.

Reliability and Statistical Power

Reliability of each measure was computed using a split-half analysis procedure. Each measure was divided into two subsets, at random, by trial and recomputed. Correlation coefficients were then calculated on both subsets across participants. The split-half reliability correlation coefficient was permuted 1,000 times and the average of the correlations is reported for each independent measure. Before averaging, all correlations were Fisher Z-transformed and then transformed back after averaging. In order to correct for underestimation resulting from splitting the number of observations in half, the Spearman-Brown correction was applied (Parsons et al., 2019). Reliability was not computed for sEBR during the rest period since it contained no trials. Descriptive statistics and split-half reliability measures are summarized in Tables 1 and 2 for experiment 1 and experiment 2, respectively. Correlations between sEBR and performance with associated values of p and confidence intervals are summarized in Tables 3 and 4 for experiment 1 and experiment 2, respectively. Post-hoc statistical power calculations using as the effect size the correlation between sEBR during the Delay period and task accuracy showed inadequate power for experiment 1 (N = 16, 1-β error probability = 0.53, critical r = 0.49). Power for experiment 2 was good (N = 34, 1-β error probability = 0.87, critical r = 0.33). Given that experiments 1 and 2 utilized different methods of quantifying blinks (camera based vs. EOG) but a similar task design, the two sample sizes were combined with very good power obtained (N = 50, 1-β error probability = 0.96, critical r = 0.27).

TABLE 3
www.frontiersin.org

Table 3. Correlations between sEBR and performance for Experiment 1.

TABLE 4
www.frontiersin.org

Table 4. Correlations between sEBR and performance for Experiment 2.

Discussion

In the present study, we investigated the temporal fluctuations in sEBR across a WM paradigm and its relation to WM task accuracy in two experiments, inside and outside an MRI scanner, and using two methods of collecting sEBR. Using the same Sternberg working memory paradigm, we observed a strong positive relationship between sEBR and task performance only during the WM task delay in both experiments. We also found a significant difference in sEBR between task phases and a difference between Delay period sEBR and baseline sEBR.

Our first hypothesis was that phasic sEBR during the Delay period of the WM task would be positively correlated with task accuracy and that we would also observe a non-linear relationship where high and low sEBR would be predictive of low performance. We observed a strong positive correlation between sEBR during the Delay period in both Experiment 1 and Experiment 2 with task accuracy. However, only in Experiment 2 was this relationship significant. We believe that the lack of significance in Experiment 1 is due to the smaller sample size and thus lack of power, which our formal post-hoc power analyses confirmed. While the sample size in Experiment 2 was also small, we observed a similar correlation and reliability statistic as well as higher power while recording sEBR using a different method (electrooculogram instead of camera-based eye-tracking hardware). Nevertheless, a correlation between sEBR and task performance of approximately 0.50 is a very high correlation in psychology, especially between a behavioral measure and a physiological measure (Gignac and Szodorai, 2016). The replication of a similar correlation between Delay period sEBR and WM performance across two separate experiments strengthens our findings but with the confidence interval being so wide with the relatively small sample size one cannot be certain the true correlation is so large. Previous research has found that correlations begin to stabilize at even larger sample sizes (Schönbrodt and Perugini, 2013). Thus, future studies should include an additional experiment with high statistical power to replicate these findings and to determine whether the observed effect stabilizes with even larger sample sizes.

If we interpret sEBR as an indirect measure of striatal DA activity, as other studies have postulated, we can speculate that higher sEBR during the WM delay was correlated with task accuracy due to DA regulating the maintenance and updating of representations in WM (Westbrook and Braver, 2016). The other results support this idea since no other task period was significantly correlated with task accuracy. Many studies that have investigated the relationship between sEBR and cognitive functions have used baseline levels of sEBR taken before or after tasks in their analysis (Tharp and Pickering, 2011; Zhang et al., 2015; Unsworth et al., 2019b). However, we show that while the WM task Delay period sEBR was correlated positively with task accuracy, baseline levels of sEBR were not. Our results highlight the importance of examining phasic and tonic sEBR when investigating the relationships between sEBR and other cognitive functions. The results also highlight that blinking may be an important component of working memory function; however, future studies, including within-subject analyses using larger number of trials, are needed to understand the role of blinking during WM maintenance. Additionally, future studies should investigate whether higher blink rates during the WM delay lead to a correct response. Since task difficulty was not controlled for in this study, participants’ task performance in both experiments was relatively high (see Tables 1 and 2). These limitations make our current dataset incapable of investigating these questions.

We also investigated the proposed “Inverted U-shape” relationship between DA and WM performance by computing a polynomial regression model on sEBR during the delay and task accuracy (Cools and D’Esposito, 2011). Though the model showed a non-linear trend in Experiment 2, the model was not significant. We believe that failure to achieve non-linear model significance was due to lack of extreme (sub- and supraoptimal) sEBRs observed in the pool of participants, which are typically found in clinical populations (e.g., with Schizophrenia; Adamson, 1995; Swarztrauber and Fujikawa, 1998). Future studies should investigate sEBR with healthy subjects and with subjects that have been observed to have extreme sEBR in order to have a wider variety of sEBRs and to better understand its connection with DA. Additionally, other methods of DA measures could be used to investigate DA during the delay period, such as correlations with neuromelanin-sensitive MRI, which can detect neuromelanin, a product of dopamine metabolism (Cassidy et al., 2019).

Our second hypothesis was that we would see significant differences in sEBR across the WM task as well as between sEBR during Rest and during the Delay period. We found sEBR to be the lowest during periods like Encoding and Probe in both Experiments, while sEBR during the Delay was the highest. Our results support previous findings which found task-related modulation of sEBR (Siegle et al., 2008; Oh et al., 2012). Prior work has found sEBR to be lower during tasks that require visual attention (Fukuda et al., 2005; Oh et al., 2012). This would explain the lower sEBR’s observed during the Encoding period when participants are encoding information into WM and during the Probe period where participants are retrieving information from WM. We also found that sEBR was the highest during the Delay period when participants were maintaining information in WM. This was also demonstrated in a different study which investigated sEBR during an A-not-B WM task where infants had to search for a hidden toy by making an eye movement to one of two locations (Bacher et al., 2017). Higher sEBR during the WM delay could be due to DA regulating the maintenance and updating of representations in WM (Westbrook and Braver, 2016), but this remains speculation until further studies directly measure dopaminergic activity during task performance. Our results further support this interpretation since Delay period sEBR was significantly higher than baseline sEBR during the Rest period. Lower sEBR during the Rest period could be explained since there is no need to update or maintain WM during this period.

To conclude, we investigated temporal changes of sEBR during different phases of a WM task and its relation to WM performance. We observed a significant positive correlation between sEBR and WM task performance during the Delay period, but not during the other phases of the task. Additionally, we found evidence for an association of sEBR during both stimulus encoding and WM probe retrieval, potential reflecting visual attention. To the best of our knowledge, this is the first study to investigate phasic and tonic sEBR during different phases of a WM task using complex visual scenes. Future studies should continue to investigate sEBRs in relation to direct measures of cortical (especially PFC) and subcortical dopamine and assess linear and non-linear relationships to task performance in healthy and clinical populations (e.g., Schizophrenia and Parkinson’s disease).

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics Statement

The studies involving human participants were reviewed and approved by the Institutional Review Board of the City University of New York Human Research Protection Program (CUNY HRPP IRB). The participants provided their written informed consent to participate in this study.

Author Contributions

TE designed the study. JO, CR, and BG performed the research. JO analyzed and interpreted the data, prepared the figures, and wrote the final manuscript. CR, BG, and TE edited and reviewed the manuscript. All authors contributed to the article and approved the submitted version.

Funding

Research reported in this publication was supported by the National Institute of Mental Health of the National Institutes of Health under Award Number R56MH116007 (TE).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

Adamson, T. A. (1995). Changes in blink rates of Nigerian schizophrenics treated with chlorpromazine. West Afr. J. Med. 14, 194–197.

PubMed Abstract | Google Scholar

Bacher, L. F., and Allen, K. J. (2009). Sensitivity of the rate of spontaneous eye blinking to type of stimuli in young infants. Dev. Psychobiol. 51, 186–197. doi: 10.1002/dev.20357

PubMed Abstract | CrossRef Full Text | Google Scholar

Bacher, L. F., Retz, S., Lindon, C., and Bell, M. A. (2017). Intraindividual and Interindividual differences in spontaneous eye blinking: relationships to working memory performance and frontal EEG asymmetry. Infancy 22, 150–170. doi: 10.1111/infa.12164

PubMed Abstract | CrossRef Full Text | Google Scholar

Baddeley, A. (1992). Working memory. Science 255, 556–559. doi: 10.1126/science.1736359

CrossRef Full Text | Google Scholar

Barbato, G., Ficca, G., Muscettola, G., Fichele, M., Beatrice, M., and Rinaldi, F. (2000). Diurnal variation in spontaneous eye-blink rate. Psychiatry Res. 93, 145–151. doi: 10.1016/S0165-1781(00)00108-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Bentivoglio, A. R., Bressman, S. B., Cassetta, E., Carretta, D., Tonali, P., and Albanese, A. (1997). Analysis of blink rate patterns in normal subjects. Mov. Disord. 12, 1028–1034. doi: 10.1002/mds.870120629

PubMed Abstract | CrossRef Full Text | Google Scholar

Cassidy, C. M., Zucca, F. A., Girgis, R. R., Baker, S. C., Weinstein, J. J., Sharp, M. E., et al. (2019). Neuromelanin-sensitive MRI as a noninvasive proxy measure of dopamine function in the human brain. Proc. Natl. Acad. Sci. U. S. A. 116, 5108–5117. doi: 10.1073/pnas.1807983116

PubMed Abstract | CrossRef Full Text | Google Scholar

Colzato, L. S., Van Den Wildenberg, P. M., Van Wouwe, N. C., Pannebakker, M. M., and Hommel, B. (2009). Dopamine and inhibitory action control: evidence from spontaneous eye blink rates. Exp. Brain Res. 196, 467–474. doi: 10.1007/s00221-009-1862-x

PubMed Abstract | CrossRef Full Text | Google Scholar

Constantinidis, C., Funahashi, S., Lee, D., Murray, J. D., Qi, X. L., Wang, M., et al. (2018). Persistent spiking activity underlies working memory. J. Neurosci. 38, 7020–7028. doi: 10.1523/JNEUROSCI.2486-17.2018

PubMed Abstract | CrossRef Full Text | Google Scholar

Cools, R., and D’esposito, M. (2011). Inverted-U-shaped dopamine actions on human working memory and cognitive control. Biol. Psychiatry 69, E113–E125. doi: 10.1016/j.biopsych.2011.03.028

PubMed Abstract | CrossRef Full Text | Google Scholar

Cools, R., Gibbs, S. E., Miyakawa, A., Jagust, W., and D’esposito, M. (2008). Working memory capacity predicts dopamine synthesis capacity in the human striatum. J. Neurosci. 28, 1208–1212. doi: 10.1523/JNEUROSCI.4475-07.2008

PubMed Abstract | CrossRef Full Text | Google Scholar

Cools, R., and Robbins, T. W. (2004). Chemistry of the adaptive mind. Philos. Trans. A. Math. Phys. Eng. Sci. 362, 2871–2888. doi: 10.1098/rsta.2004.1468

CrossRef Full Text | Google Scholar

Courtney, S. M., Petit, L., Maisog, J. M., Ungerleider, L. G., and Haxby, J. V. (1998). An area specialized for spatial working memory in human frontal cortex. Science 279, 1347–1351. doi: 10.1126/science.279.5355.1347

PubMed Abstract | CrossRef Full Text | Google Scholar

Dang, L. C., Samanez-Larkin, G. R., Castrellon, J. J., Perkins, S. F., Cowan, R. L., Newhouse, P. A., et al. (2017). Spontaneous eye blink rate (EBR) is uncorrelated with dopamine D2 receptor availability and Unmodulated by dopamine Agonism in healthy adults. eNeuro 4:ENEURO.0211-17.2017. doi: 10.1523/ENEURO.0211-17.2017

PubMed Abstract | CrossRef Full Text | Google Scholar

Dauer, W., and Przedborski, S. (2003). Parkinson’s disease: mechanisms and models. Neuron 39, 889–909. doi: 10.1016/S0896-6273(03)00568-3

CrossRef Full Text | Google Scholar

De Frias, C. M., Marklund, P., Eriksson, E., Larsson, A., Oman, L., Annerbrink, K., et al. (2010). Influence of COMT gene polymorphism on fMRI-assessed sustained and transient activity during a working memory task. J. Cogn. Neurosci. 22, 1614–1622. doi: 10.1162/jocn.2009.21318

PubMed Abstract | CrossRef Full Text | Google Scholar

Doughty, M. J., and Naase, T. (2006). Further analysis of the human spontaneous eye blink rate by a cluster analysis-based approach to categorize individuals with ‘normal’versus ‘frequent’eye blink activity. Eye Contact Lens 32, 294–299. doi: 10.1097/01.icl.0000224359.32709.4d

PubMed Abstract | CrossRef Full Text | Google Scholar

Durstewitz, D., and Seamans, J. K. (2008). The dual-state theory of prefrontal cortex dopamine function with relevance to catechol-O-Methyltransferase genotypes and schizophrenia. Biol. Psychiatry 64, 739–749. doi: 10.1016/j.biopsych.2008.05.015

PubMed Abstract | CrossRef Full Text | Google Scholar

Elsworth, J. D., Lawrence, M. S., Roth, R. H., Taylor, J. R., Mailman, R. B., Nichols, D. E., et al. (1991). D1 and D2 dopamine receptors independently regulate spontaneous blink rate in the vervet monkey. J. Pharmacol. Exp. Ther. 259, 595–600.

PubMed Abstract | Google Scholar

Frank, M. J., Loughry, B., and O’reilly, R. C. (2001). Interactions between frontal cortex and basal ganglia in working memory: A computational model. Cogn. Affect. Behav. Neurosci. 1, 137–160. doi: 10.3758/CABN.1.2.137

PubMed Abstract | CrossRef Full Text | Google Scholar

Fukuda, K., Stern, J. A., Brown, T. B., and Russo, M. B. (2005). Cognition, blinks, eye-movements, and pupillary movements during performance of a running memory task. Aviat. Space Environ. Med. 76(Suppl.), C75–C85.

Google Scholar

Funahashi, S., Bruce, C. J., and Goldman-Rakic, P. S. (1989). Mnemonic coding of visual space in the monkey’s dorsolateral prefrontal cortex. J. Neurophysiol. 61, 331–349. doi: 10.1152/jn.1989.61.2.331

PubMed Abstract | CrossRef Full Text | Google Scholar

Fuster, J. M., and Alexander, G. E. (1971). Neuron activity related to short-term memory. Science 173:652. doi: 10.1126/science.173.3997.652

CrossRef Full Text | Google Scholar

Gignac, G. E., and Szodorai, E. T. (2016). Effect size guidelines for individual differences researchers. Personal. Individ. Differ. 102, 74–78. doi: 10.1016/j.paid.2016.06.069

CrossRef Full Text | Google Scholar

Gramfort, A., Luessi, M., Larson, E., Engemann, D. A., Strohmeier, D., Brodbeck, C., et al. (2013). MEG and EEG data analysis with MNE-python. Front. Neurosci. 7:267. doi: 10.3389/fnins.2013.00267

CrossRef Full Text | Google Scholar

Groman, S. M., James, A. S., Seu, E., Tran, S., Clark, T. A., Harpster, S. N., et al. (2014). In the blink of an eye: relating positive-feedback sensitivity to striatal dopamine D2-like receptors through blink rate. J. Neurosci. 34, 14443–14454. doi: 10.1523/JNEUROSCI.3037-14.2014

PubMed Abstract | CrossRef Full Text | Google Scholar

Hall, A. (1945). The origin and purposes of blinking. Br. J. Ophthalmol. 29, 445–467. doi: 10.1136/bjo.29.9.445

PubMed Abstract | CrossRef Full Text | Google Scholar

Hazy, T. E., Frank, M. J., and O’reilly, R. C. (2006). Banishing the homunculus: making working memory work. Neuroscience 139, 105–118. doi: 10.1016/j.neuroscience.2005.04.067

PubMed Abstract | CrossRef Full Text | Google Scholar

Howes, O., Mccutcheon, R., and Stone, J. (2015). Glutamate and dopamine in schizophrenia: An update for the 21st century. J. Psychopharmacol. 29, 97–115. doi: 10.1177/0269881114563634

PubMed Abstract | CrossRef Full Text | Google Scholar

Jongkees, B. J., and Colzato, L. S. (2016). Spontaneous eye blink rate as predictor of dopamine-related cognitive function-A review. Neurosci. Biobehav. Rev. 71, 58–82. doi: 10.1016/j.neubiorev.2016.08.020

PubMed Abstract | CrossRef Full Text | Google Scholar

Jutkiewicz, E. M., and Bergman, J. (2004). Effects of dopamine D1 ligands on eye blinking in monkeys: efficacy, antagonism, and D1/D2 interactions. J. Pharmacol. Exp. Ther. 311, 1008–1015. doi: 10.1124/jpet.104.071092

PubMed Abstract | CrossRef Full Text | Google Scholar

Kimberg, D. Y., D’esposito, M., and Farah, M. J. (1997). Effects of bromocriptine on human subjects depend on working memory capacity. Neuroreport 8, 3581–3585. doi: 10.1097/00001756-199711100-00032

PubMed Abstract | CrossRef Full Text | Google Scholar

Landau, S. M., Lal, R., O’Neil, J. P., Baker, S., and Jagust, W. J. (2009). Striatal dopamine and working memory. Cereb. Cortex 19, 445–454. doi: 10.1093/cercor/bhn095

PubMed Abstract | CrossRef Full Text | Google Scholar

Maffei, A., and Angrilli, A. (2018). Spontaneous eye blink rate: An index of dopaminergic component of sustained attention and fatigue. Int. J. Psychophysiol. 123, 58–63. doi: 10.1016/j.ijpsycho.2017.11.009

PubMed Abstract | CrossRef Full Text | Google Scholar

Norn, M. S. (1969). Desiccation of the precorneal film. I. Corneal wetting-time. Acta. Ophthalmol. 47, 865–880. doi: 10.1111/j.1755-3768.1969.tb03711.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Oh, J., Jeong, S. Y., and Jeong, J. (2012). The timing and temporal patterns of eye blinking are dynamically modulated by attention. Hum. Mov. Sci. 31, 1353–1365. doi: 10.1016/j.humov.2012.06.003

PubMed Abstract | CrossRef Full Text | Google Scholar

Parsons, S., Kruijt, A.-W., and Fox, E. (2019). Psychological science needs a standard practice of reporting the reliability of cognitive-behavioral measurements. Adv. Methods Pract. Psychol. Sci. 2, 378–395. doi: 10.1177/2515245919879695

CrossRef Full Text | Google Scholar

Rac-Lubashevsky, R., Slagter, H. A., and Kessler, Y. (2017). Tracking real-time changes in working memory updating and gating with the event-based eye-blink rate. Sci. Rep. 7:2547. doi: 10.1038/s41598-017-02942-3

PubMed Abstract | CrossRef Full Text | Google Scholar

Reddy, V. C., Patel, S. V., Hodge, D. O., and Leavitt, J. A. (2013). Corneal sensitivity, blink rate, and corneal nerve density in progressive Supranuclear palsy and Parkinson disease. Cornea 32, 631–635. doi: 10.1097/ICO.0b013e3182574ade

PubMed Abstract | CrossRef Full Text | Google Scholar

Roberts, A. C., Robbins, T. W., and Weiskrantz, L. E. (1998). The Prefrontal Cortex: Executive and Cognitive Functions. United Kingdom: Oxford University Press.

Google Scholar

Sawaguchi, T. (2001). The effects of dopamine and its antagonists on directional delay-period activity of prefrontal neurons in monkeys during an oculomotor delayed-response task. Neurosci. Res. 41, 115–128. doi: 10.1016/S0168-0102(01)00270-X

PubMed Abstract | CrossRef Full Text | Google Scholar

Schönbrodt, F. D., and Perugini, M. (2013). At what sample size do correlations stabilize? J. Res. Pers. 47, 609–612. doi: 10.1016/j.jrp.2013.05.009

CrossRef Full Text | Google Scholar

Seamans, J. K., and Yang, C. R. (2004). The principal features and mechanisms of dopamine modulation in the prefrontal cortex. Prog. Neurobiol. 74, 1–58. doi: 10.1016/j.pneurobio.2004.05.006

PubMed Abstract | CrossRef Full Text | Google Scholar

Sescousse, G., Ligneul, R., Van Holst, R. J., Janssen, L. K., De Boer, F., Janssen, M., et al. (2018). Spontaneous eye blink rate and dopamine synthesis capacity: preliminary evidence for an absence of positive correlation. Eur. J. Neurosci. 47, 1081–1086. doi: 10.1111/ejn.13895

PubMed Abstract | CrossRef Full Text | Google Scholar

Siegle, G. J., Ichikawa, N., and Steinhauer, S. (2008). Blink before and after you think: blinks occur prior to and following cognitive load indexed by pupillary responses. Psychophysiology 45, 679–687. doi: 10.1111/j.1469-8986.2008.00681.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Sternberg, S. (1966). High-speed scanning in human memory. Science 153:652. doi: 10.1126/science.153.3736.652

CrossRef Full Text | Google Scholar

Stewart, C. V., and Plenz, D. (2006). Inverted-U profile of dopamine-NMDA-mediated spontaneous avalanche recurrence in superficial layers of rat prefrontal cortex. J. Neurosci. 26, 8148–8159. doi: 10.1523/JNEUROSCI.0723-06.2006

PubMed Abstract | CrossRef Full Text | Google Scholar

Swarztrauber, K., and Fujikawa, D. G. (1998). An electroencephalographic study comparing maximum blink rates in schizophrenic and nonschizophrenic psychiatric patients and nonpsychiatric control subjects. Biol. Psychiatry 43, 282–287. doi: 10.1016/S0006-3223(97)00028-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Taylor, J. R., Elsworth, J. D., Lawrence, M. S., Sladek, J. R., Roth, R. H., and Redmond, D. E. (1999). Spontaneous blink rates correlate with dopamine levels in the caudate nucleus of MPTP-treated monkeys. Exp. Neurol. 158, 214–220. doi: 10.1006/exnr.1999.7093

PubMed Abstract | CrossRef Full Text | Google Scholar

Tharp, I. J., and Pickering, A. D. (2011). Individual differences in cognitive-flexibility: the influence of spontaneous eyeblink rate, trait psychoticism and working memory on attentional set-shifting. Brain Cogn. 75, 119–125. doi: 10.1016/j.bandc.2010.10.010

PubMed Abstract | CrossRef Full Text | Google Scholar

Tsubota, K., Hata, S., Okusawa, Y., Egami, F., Ohtsuki, T., and Nakamori, K. (1996). Quantitative videographic analysis of blinking in normal subjects and patients with dry eye. Arch. Ophthalmol. 114, 715–720. doi: 10.1001/archopht.1996.01100130707012

PubMed Abstract | CrossRef Full Text | Google Scholar

Unsworth, N., Miller, A. L., and Robison, M. K. (2019a). Individual differences in encoding strategies and free recall dynamics. Q. J. Exp. Psychol. 72, 2495–2508. doi: 10.1177/1747021819847441

PubMed Abstract | CrossRef Full Text | Google Scholar

Unsworth, N., Robison, M. K., and Miller, A. L. (2019b). Individual differences in baseline oculometrics: examining variation in baseline pupil diameter, spontaneous eye blink rate, and fixation stability. Cogn. Affect. Behav. Neurosci. 19, 1074–1093. doi: 10.3758/s13415-019-00709-z

CrossRef Full Text | Google Scholar

Van Slooten, J. C., Jahfari, S., and Theeuwes, J. (2019). Spontaneous eye blink rate predicts individual differences in exploration and exploitation during reinforcement learning. Sci. Rep. 9:17436. doi: 10.1038/s41598-019-53805-y

PubMed Abstract | CrossRef Full Text | Google Scholar

Wager, T. D., and Smith, E. E. (2003). Neuroimaging studies of working memory: A meta-analysis. Cogn. Affect. Behav. Neurosci. 3, 255–274. doi: 10.3758/CABN.3.4.255

CrossRef Full Text | Google Scholar

Westbrook, A., and Braver, T. S. (2016). Dopamine does double duty in motivating cognitive effort. Neuron 89, 695–710. doi: 10.1016/j.neuron.2015.12.029

PubMed Abstract | CrossRef Full Text | Google Scholar

Xiao, J., Hays, J., Ehinger, K. A., Oliva, A., and Torralba, A. (2010). “Sun database: Large-scale scene recognition from abbey to zoo”, in 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition: IEEE; June 13, 2010, 3485–3492.

Google Scholar

Zhang, T., Mou, D., Wang, C., Tan, F., Jiang, Y., Lijun, Z., et al. (2015). Dopamine and executive function: increased spontaneous eye blink rates correlate with better set-shifting and inhibition, but poorer updating. Int. J. Psychophysiol. 96, 155–161. doi: 10.1016/j.ijpsycho.2015.04.010

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: spontaneous eye blink rate, working memory, delay period, dopamine, attention

Citation: Ortega J, Plaska CR, Gomes BA and Ellmore TM (2022) Spontaneous Eye Blink Rate During the Working Memory Delay Period Predicts Task Accuracy. Front. Psychol. 13:788231. doi: 10.3389/fpsyg.2022.788231

Received: 01 October 2021; Accepted: 11 January 2022;
Published: 15 February 2022.

Edited by:

Steven Matthew Thurman, United States Army Research Laboratory, United States

Reviewed by:

Stephen B. R. E. Brown, Red Deer Polytechnic, Canada
Matthew Robison, University of Texas at Arlington, United States

Copyright © 2022 Ortega, Plaska, Gomes and Ellmore. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Timothy M. Ellmore, tellmore@ccny.cuny.edu

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.