Skip to main content

ORIGINAL RESEARCH article

Front. Psychol., 17 March 2023
Sec. Cognitive Science
This article is part of the Research Topic Cognitive mechanisms of visual attention, working memory, emotion, and their interactions View all 15 articles

Reward prospect affects strategic adjustments in stop signal task

  • 1Department of Physiology and Pharmacology, Sapienza University, Rome, Italy
  • 2Behavioral Neuroscience PhD Program, Sapienza University, Rome, Italy
  • 3Department of Occupational and Environmental Medicine, Epidemiology and Hygiene, INAIL, Rome, Italy
  • 4Department of Education, University of Roma Tre, Rome, Italy

Interaction with the environment requires us to predict the potential reward that will follow our choices. Rewards could change depending on the context and our behavior adapts accordingly. Previous studies have shown that, depending on reward regimes, actions can be facilitated (i.e., increasing the reward for response) or interfered (i.e., increasing the reward for suppression). Here we studied how the change in reward perspective can influence subjects’ adaptation strategy. Students were asked to perform a modified version of the Stop-Signal task. Specifically, at the beginning of each trial, a Cue Signal informed subjects of the value of the reward they would receive; in one condition, Go Trials were rewarded more than Stop Trials, in another, Stop Trials were rewarded more than Go Trials, and in the last, both trials were rewarded equally. Subjects participated in a virtual competition, and the reward consisted of points to be earned to climb the leaderboard and win (as in a video game contest). The sum of points earned was updated with each trial. After a learning phase in which the three conditions were presented separately, each subject performed 600 trials testing phase in which the three conditions were randomly mixed. Based on the previous studies, we hypothesized that subjects could employ different strategies to perform the task, including modulating inhibition efficiency, adjusting response speed, or employing a constant behavior across contexts. We found that to perform the task, subjects preferentially employed a strategy-related speed of response adjustment, while the duration of the inhibition process did not change significantly across the conditions. The investigation of strategic motor adjustments to reward’s prospect is relevant not only to understanding how action control is typically regulated, but also to work on various groups of patients who exhibit cognitive control deficits, suggesting that the ability to inhibit can be modulated by employing reward prospects as motivational factors.

1. Introduction

In everyday life, it is important to behave appropriately in relation to the shifting situations we encounter and the effects of our choices. This requires, for example, assessing the potential reward that could be obtained in a specific context before deciding whether or not to act, and being able to stop quickly if sudden changes in the environment make the action no longer useful. A widely used experimental paradigm to study choice behavior is the Stop-Signal Task (SST) in both human and non-human primates (Vince, 1948; Logan and Cowan, 1984; Hanes and Carpenter, 1999; Scangos and Stuphorn, 2010; Brunamonti et al., 2012; Pani et al., 2014; Montanari et al., 2017; Schall et al., 2017; Pani et al., 2018; Bardella et al., 2020; Fiori et al., 2020; Giarrocco et al., 2021; Andujar et al., 2022; Hervault et al., 2022; Pani et al., 2022; Bardella et al., 2023; Marc et al., 2023). The SST requires the subjects to respond as quickly as possible when a Go Signal is presented (for example by pressing a button) and to interrupt the response when unpredictably a Stop Signal is presented after a variable time from the Go Signal. In its original conception, this task creates a competition between two processes: the Go process, triggered by the Go Signal, and the Stop process, triggered by the Stop Signal (race model, Logan and Cowan, 1984). The competition is evident especially in Stop Trials, when first the Go Signal and then the Stop Signal are presented. The choice of moving or stopping that the subject makes will depend on the speed of each of the processes (Logan and Cowan, 1984; Boucher et al., 2007), and on the delay between the Go Signal and Stop Signal (Stop Signal Delay, SSD). The race model suggests that the higher these SSDs are, the greater the probability of moving despite the presentation of the Stop Signal. Effects of choice competition are also present in the trials where only the Go Signal is presented. Indeed, the Go process is affected when subjects know that a Stop Signal is possible as demonstrated by the observation that the same Go responses in tasks without Stop Trials are faster (Mirabella et al., 2008; Pani et al., 2013).

The dual-task nature of the paradigm makes it possible to study two control strategies that support behavior in accordance with the dual-mechanisms framework (DMC): proactive control and reactive control (Braver et al., 2007; Braver, 2012). Correct performance in Stop Trials often requires reactive control, as it allows us to quickly inhibit or reorganize our actions when an unexpected event occurs, rendering planned actions no longer appropriate. The SST provides a measure of this control corresponding to the latency of the reactive inhibition process, i.e., the Stop Signal Reaction Time (SSRT). However, proactive control is also necessary to achieve optimal performance in the task. It allows us to reach a balance between the demand of the task (i.e., responding as quickly as possible), and making as few mistakes as possible on Stop Trials (i.e., optimize the inhibition process). In the SST, for example, the subjects tend to procrastinate their responses as a Stop Signal could possibly be presented. Depending on the context, both control processes can be affected by different factors, such as attention, reward, and motivation (Engelmann and Pessoa, 2007; Mohanty et al., 2008; Engelmann et al., 2009; Krebs et al., 2009; Pessoa and Engelmann, 2010; Padmala et al., 2011; Stoppel et al., 2011; Marc et al., 2023).

Despite thorough exploration of various features of inhibition processes, few studies have investigated how reward can influence motor control, and whether the influence of reward varies depending on how the reward is manipulated. Some studies have manipulated the reward only in the Stop Trials (e.g., Boehler et al., 2012, 2014; Verbruggen and McLaren, 2018). For example, Boehler et al. (2012, 2014), found that SSRTs were shorter when the Stop Signal was associated with a reward for the correct trials, compared to when no reward was associated. However, other studies have not found the evidence to confirm this effect (Schevernels et al., 2015; Verbruggen and McLaren, 2018). In further investigations, the tasks were administered in blocks, and the subjects were informed a priori about the reward they would receive for the Correct Stop Trial (Leotti and Wager, 2010; Greenhouse and Wessel, 2013). In these studies, subjects adopted strategies pertaining to the lengthening of RTs, to improve their ability to inhibit. However, when only Go Trials were rewarded, response inhibition was impaired (Padmala and Pessoa, 2010).

To extend this line of research, we investigated how reward perspective can influence one or both controls, reactive and proactive. To this aim, we administered a modified SST in which three different proportions of reward values were randomly presented by informing the subjects about them at the beginning of each trial. Subjects could gain a higher reward (points in a virtual game) for correct Go Trials than for correct Stop Trials, or the same amount of reward for both correct Go and Stop trials, or even a higher reward for correct Stop Trials than for correct Go trials. We found that the subjects employed a strategy based on the modulation of the response’s speed to the Go signal, while the duration of the inhibition process remained unaffected, therefore showing that the behavioral adjustment relied on proactive control.

2. Materials and methods

2.1. Subjects

We estimated a priori the sample size of 14 subjects, on the basis of power 0.90 to detect an effect size in a within-subject design of 0.42 based on partial eta squared (η2p) 0.15 using GPower 3.1.9.7 (Faul et al., 2007, 2009), as reported in the previous studies employing similar tasks(Mirabella et al., 2008; Andujar et al., 2022; Marc et al., 2023). Eighteen subjects (4 males & 14 females, mean age = 26.5) were recruited for the study. All the subjects were right-handed, had normal or corrected vision, and had no history of psychiatric or neurological disorders.

All subjects were checked for race model violations and respect the unimodality assumption for Stop Signal Delay (SSD) in the Stop Trials prior to testing. Four participants out of 18 were excluded because they did not respect the unimodality assumption for Stop Signal Delay (SSD) in the Stop Trials (see methods for details). All procedures were performed in accordance with the Declaration of Helsinki and after obtaining a written informed consent from each subject. The procedure was approved by the Ethics Committee of “Roma Tre” University.

2.2. Apparatus and task

Subjects were seated in a darkened and sound attenuated chamber, in front of a 20-inch monitor (LCD, 1920 × 1,080 resolution, 60 Hz) placed 40 cm away. Stimuli presentation and behavioral events collection were controlled using the MATLAB-Psychophysics Toolbox Version 3 (PTB-3). They performed a modified version of the Stop Signal Task (Logan and Cowan, 1984; Logan, 1994). As in the classical SST, they were required to perform two types of trials, Go Trials (the majority of trials, 70%) and Stop Trials (the minority of trials, 30%), but presented under three different experimental conditions, indicated by a Cue Signal, (i.e., G+, S+ or N) presented at the beginning of each trial (Figure 1).

FIGURE 1
www.frontiersin.org

Figure 1. Behavioral paradigm. (A,B) Modified version of the Stop-Signal Task (sequence of events for the Neutral Condition; i.e. Cue: N). Each trial started with the Cue Signal, which indicated the type of reward condition to the subject; i.e., the amount of the reward they should expect if they correctly performed the Go Trial (see A) or a Stop trial (see B). After a variable delay, a Go Signal (right or left arrow) appeared and the subject had to press the arrow key on the keyboard according to the Go Signal to receive the reward as points (see A). Occasionally, at a variable delay (SSD) from the Go Signal, a Stop Signal appeared and the subject had to inhibit the action to receive the reward (see B). (C) Overview of the Cue Signals associated with the respective rewards for each Cue Condition. The amount of reward for every Cue Condition was differently associated with Go and Stop Trials as follows: Go+ Condition (G+, as Cue Signal) was associated with higher reward for successful Go Trials compared to successful Stop Trials; Stop+ Condition (S+, as Cue Signal) was associated with reversed reward amount; Neutral Condition (N, as Cue Signal) was associated with equal amounts of reward for successful Go or Stop Trials.

In Go Trials, after a variable time (900–1,200 ms) from the Cue Signal, a Go Signal (left or right pointing arrow) was presented. The Go Signal required the subjects to press the left or right arrow key on the keyboard as fast as possible with their right index or middle finger, indicated by the presented Go Signal, within an upper reaction time of 1.5 s. If the subject responded correctly (i.e., Correct Go Trial), visual and positive auditory feedback (1 s) were presented with the score obtained in relation to the trial condition.

If the subject did not respond correctly (Failed Go Trial) by failing to press the corresponding key to the Go Signal or not responding within the upper reaction time (Go omission) after the Go Signal, visual feedback, “0 Score” or “0 Score, too late!,” respectively, was provided along with a negative audio feedback.

In Stop Trials, the initial sequence of events was identical to that of the Go Trials, but after a variable time from the Go Signal presentation (Stop Signal Delay [SSD]), a Stop Signal appeared, which required subjects to inhibit the movement triggered by the Go Signal. If the subject withheld the movement correctly (Correct Stop Trial), after the disappearance of the Stop Signal (1 s.), a visual and positive auditory feedback (1 s.) appeared with the score obtained in relation to the trial condition. If the subject did not respond correctly (Failed Stop Trial), by failing to inhibit the movement, visual feedback, “0 Score,” was provided to the subjects along with a negative audio feedback.

In the Stop Trials, a staircase procedure adjusted the SSD based on subjects’ performance. The SSD started at an initial value of 50 milliseconds (ms), and the SSDs following Correct Stop Trials were increased by one step (50 ms) while SSDs following Error Stop Trials were decreased by one step in the next Stop Trial. The minimum and maximum limits of the SSD presentation were set to 50 milliseconds and 1 s, respectively. The intertrial interval was 500 ms.

This method keeps the probability of error at the presentation of the stop signal around 50%, deterring the subject from using strategies in which he is expected to wait for the stop signal (Verbruggen et al., 2019).

The two types of trials, Stop and Go Trials, were presented with the same proportions (i.e., 30% Stop Trials and 70% Go Trials) in the three different experimental conditions in mixed order.

Go + Condition. In the Go+ condition, subjects were informed that performing Correct Go Trials would allow them to earn a higher reward (+30 points), whereas Correct Stop Trials would allow them to earn a lower reward (+5 points).

Stop + Conditions. On the contrary, in the Stop+ condition, subjects were informed that Correct Go Trials would allow them to earn a lower reward (+5 points), whereas Correct Stop Trials would allow them to earn a higher reward (+30 points).

Neutral Conditions. In the Neutral condition, the amount of reward subjects could earn was the same in Correct Go Trials and Correct Stop Trials (+17 points).

For all the conditions, the positive auditory feedback was the same but differed in pitch according to the amount of reward the subject received upon the completion of a correct trial (i.e., high frequency = +30 scores; low frequency = +5 score).

2.3. Experimental procedure

Subjects executed the three different experimental Cue Conditions in two phases, a learning phase and a testing phase.

2.3.1. Learning phase

Each subject performed separately, in blocks of 200 trials, the three conditions with an independent staircase procedure for the presentation of the SSDs. The order in which the blocks were presented was randomized and counterbalanced between all subjects.

2.3.2. Test phase

One week after the learning phase, each subject performed a single block of 600 trials comprising the three conditions in a mixed order, with an equal probability of presentation and randomized trial-by-trial. In this way, the subjects became aware of which reward they would earn at each trial only at the presentation of the Cue signal. In the test phase, 1/3 of the trials (Go and Stop Trials) were designated to the Go+ condition, 1/3 to the Neutral condition and 1/3 to the Stop+ condition. Within this phase, three independent staircases for the three conditions were used.

2.3.3. Instructions

Before each block, subjects were instructed to perform the task in that specific condition, incentivizing them to respond as quickly as possible and at the same time to be ready to stop at the appearance of the Stop Signal to earn as many rewards (points) as possible to outperform the other subjects. Additionally, the staircase procedure was also explained to subjects to further discourage a waiting strategy (see Verbruggen et al., 2019). Immediately afterwards, an actual and updated ranking of the previous subjects’ scores for that condition was shown, inviting the subject to beat the current record. Except for the first subject, who was shown the highest score attainable with the best performance in the task.

2.4. Data analysis

Since the Learning Phase served only for the subjects to become familiar with the three Cue Conditions and to understand the experimental procedures, the reported analyses were performed only on the Test Phase.

To verify whether there was an effect of the Cue Condition on the subject’s strategy across the conditions, we considered different variables as follows: (1) the reaction time (RT) in Go Trials; (2) the probability of Go omissions; (3) the probability of response [p(response)] in Stop Trials (Failed Stop); (4) the average SSD and (5) Stop Signal Reaction Time (SSRT). The RTs in Go Trials were calculated as the time between the appearance of the Go signal and the subjects’ response. All subjects’ performances were checked for compliance with assumption of independence of race model and unimodality tests for SSDs in the Stop Trials prior to further analyses. Hartigan’s dip test statistic for unimodality was applied on RTs and SSDs (Hartigan, 1985; Hartigan and Hartigan, 1985). In order to test for significance, bootstrap was set at 1,000.

Four subjects were excluded because they did not respect the unimodality assumption for SSD in the Stop Trials (Mean = 0.08; p < 0.05).

Then, the probability of Go omission was calculated as the number of Go omissions divided by the total number of Go Trials. The probability of response in Stop Trials (Failed Stop) was calculated as the number of Failed Stop Trials divided by the total number of Stop Trials. SSRT was calculated using the integration method (with replacement of Go omission) (see Verbruggen et al., 2019), after verifying that none of the subjects had violated the horse race model’s assumption of independence, and the p(response) in Stop Trials was between 35 and 65%. All variables of interest were computed for each subject individually and for each Cue Condition in the Test Phase. To test whether the three Cue Conditions influenced the subjects’ strategy, comparisons between Cue Conditions and within subjects were performed by repeated measures factorial ANOVAs, followed by post-hoc comparisons by Tukey–Kramer test. To assess how typical or uncommon the effect measured within the population mean is we applied Bayesian analysis (Ince et al., 2021, 2022). Bayesian prevalence returns a posterior distribution over the population prevalence, given the observed distribution of RTs for each Cue Condition. From this, we computed the maximum a posterior (MAP) estimate, that is the value of the population parameter. To quantify the uncertainty of this estimate, calculation of Bayesian highest posterior density intervals (HPDIs) allowed us to have a range within which the true population value lies with the specified probability.

Finally, we investigated with an exploratory approach which internal component (Luce, 1986; Ratcliff, 1988) could explain the difference between the conditions highlighted in the RTs distribution by fitting the drift diffusion model (DDM) to the data through DMAT toolbox (Vandekerckhove and Tuerlinckx, 2007, 2008).

Following this model, the decision process is represented as an accumulation of evidence toward a decision criterion represented by a boundary. More specifically, subjects start to accumulate sensory evidence at an initial point (z) until the process reaches a boundary [or threshold (a)], and the response (choice) is generated. There are diverse parameters that can explain the features of the RTs distributions observed. Specifically: (a) the boundary separation (a), that is the distance between two boundaries, one corresponding to the correct responses and the other to wrong responses; b) the starting point of the evidence accumulation process (z); (c) the rate of growth toward the boundary [drift rate (v)]; (d) the duration of the non-decision process (Ter); (e) the variability in starting point (sz); (f) the variability in non-decision time (st); (g) and the variability in stimulus quality (η) (Ratcliff, 1979, 2002; Voss et al., 2004; Ratcliff and McKoon, 2008).

In our investigation we postulate that the accumulation process (i.e., decision process) in our task is influenced by the Cue signal which, by providing information about the reward schedule, introduces a choice bias before the presentation of the Go signal (Ratcliff, 1985; Carpenter and Williams, 1995; Gold and Shadlen, 2002; Ratcliff and McKoon, 2008; Lauwereyns, 2011). Previous studies have identified two ways in which a priori information can bias the decision process: by shifting the starting point for the accumulation process of sensory information over time to a decision threshold (Edwards, 1965; Link and Heath, 1975; Ratcliff, 1985; Voss et al., 2004; Bogacz et al., 2006; Diederich and Busemeyer, 2006; Wagenmakers et al., 2008); or by changing the drift rate, i.e., the speed at which sensory information accumulates over time (Ashby, 1983; Ratcliff, 1985; Diederich and Busemeyer, 2006).

Both models would generate faster RTs in the Go+ condition and slower RTs in the Stop+ condition.

We therefore fitted the DDM to the RTs from each subject and each condition (Go +, Stop +, Neutral) with three different models. In the first both drift rate(v) and starting point(z) varied between conditions. In the second and the third either the drift rate(v) only, or the starting point(z) only, varied.

The RTs data were divided into percentiles, and we used a chi-square (χ2) percentile-based method as an estimation method. The relative fit of the models was tested as follows: the difference in BIC scores was calculated for each individual subject and model and the model with the lowest BIC was found to be a better fit to the data.

Finally, we applied the non-parametric Friedman’s test to assess whether the estimated parameters were different between conditions.

The RTs data were divided into percentiles, and we used a multinomial Likelihood percentile-based method as estimation method. Finally, we applied the non-parametric Friedman’s test to assess whether the estimated parameters were different between conditions.

Data processing and analysis were performed by custom functions developed in Matlab.1

3. Results

3.1. Influence of reward on reaction time

One of the aims of the experiment was to assess how the reward context could modulate the strategy used by the subjects in order to execute or inhibit their movement. Therefore, we first tested whether the RTs changed between Cue Conditions using repeated measures ANOVA (Figure 2).

FIGURE 2
www.frontiersin.org

Figure 2. Reaction times [RTs (ms)] (mean and ± 1SEM) of Go Trials in the different cue conditions (G+, N, S+).

We found that subjects adjusted RTs according to the Cue Conditions [Go+ Condition (Mean = 619 ms, SD = 180 ms, SEM = 48 ms); Neutral Condition (Mean = 652 ms, SD = 191 ms, SEM = 51 ms); Stop+ Condition (Mean = 686 ms, SD =208 ms, SEM = 56 ms)], F(2,26) = 9.71; p < 0.001.

Post-hoc analysis shows that the responses in both Go+ and Neutral Conditions were faster than responses in Stop+ Condition, p = 0.01 and p = 0.02. This suggests that the subjects were slower in responding in the Stop+ Condition, in which a higher reward was provided for Correct Stop Trials, while no significant difference was found between RTs in the Neutral and Go+ Condition, p = 0.07.

3.2. Influence of reward condition on inhibition strategy

To assess whether the reward prospects exerted an influence on the subjects’ inhibition ability, for each Cue Condition we analyzed three variables: SSRTs, mean of SSDs, and p(response) to the Stop Signal. First, repeated measures ANOVA was used to analyze SSRTs between conditions [Go+ Condition (Mean = 230 ms, SD = 41 ms, SEM = 11 ms); Neutral Condition (Mean = 253 ms, SD = 46 ms, SEM = 12 ms); Stop+ Condition (Mean = 230 ms, SD = 32 ms, SEM = 8 ms)], as it measures the time it takes for each subject to successfully interrupt the action in progress (Figure 3). Results showed no significant differences between conditions, F (2,26) = 3.17; p = 0.058.

FIGURE 3
www.frontiersin.org

Figure 3. Stop signal reaction time [SSRT (ms)] (mean and ± 1SEM) estimated in the different cue conditions (G+, N, S+).

We also tested another closely related behavioral marker dependent on the inhibition process, namely the SSD, between Cue Conditions [Go+ Condition (Mean = 352 ms, SD = 179 ms, SEM = 48 ms); Neutral Condition (Mean = 368 ms, SD = 175 ms, SEM = 46 ms); Stop+ Condition (Mean = 420 ms, SD = 195 ms, SEM = 52 ms)]. Specifically, SSDs can provide crucial insights into behavioral adjustments through the inhibition task (van Boxtel et al., 2001; Band et al., 2003). Repeated measures ANOVA analysis showed a main effect of Cue Conditions (Figure 4A) on SSDs F(2,26) = 8.45; p = 0.001.

FIGURE 4
www.frontiersin.org

Figure 4. (A) Average stop-signal delays (SSD) (mean and ± 1SEM) and (B) probabilities to respond to the stop-signal [p(response)] (mean and ± 1SEM) as a function of cue conditions (G+, N, S+).

Post-hoc analyses revealed that SSDs were significantly longer when correct performance was rewarded more in Stop Trials, i.e., Stop+ Condition, than at the Neutral and Go+ Condition (p = 0.01; p = 0.03, respectively), and no significant difference was found between SSDs in the Go+ and Neutral Condition (p = 0.6). Despite the increase in SSDs in the Neutral and Stop+ Conditions, subjects did not show significant differences in p(response) on Stop Trials (Figure 4B), F(2,26) = 0.46; p = 0.6, nor in the probability of Go omission, F(2,26) = 2.19; p = 0.1. These results suggest that the increase in SSDs between Cue Conditions shows a greater capacity for inhibition in subjects when correct Stop Trials were rewarded more than correct Go Trials.

3.3. Proactive strategic adjustment to the reward conditions

Our analysis suggests that subjects coped with the task by lengthening their RTs according to the different Cue Conditions, while their probability of response (p(response)) and inhibition speed (SSRTs) were kept constant. These data suggest that the subject adopted a proactive strategy. If this was the case, we should expect that the SSDs changed accordingly to the RTs. Indeed, by slowing down their RTs, subjects should be able to inhibit at the same speed (SSRT), and at the same probability (p(response)) at longer SSDs. To test this hypothesis, we estimated the correlation between RTs and SSRTs in the different Cue Conditions (Figure 5A), and we found that there was no correlation (Pearson correlation, r < 0.25; p > 0.5). We then tested the correlation between RTs and SSDs in the different Cue Conditions (Figure 5B), and we found a significant positive correlation (Pearson correlation, r > 0.97, p < 0.001).

FIGURE 5
www.frontiersin.org

Figure 5. Scatter diagrams show (A) RTs as a function of SSRTs and (B) RTs as a function of SSDs in each Cue Condition.

3.4. Prevalence of the effects in the population

Once we established that the results support the adoption of a proactive strategy to perform the task, we tested the prevalence in the population of the main effects we found. To this aim, we employed Bayesian inference by applying t-tests to paired within-subject samples at the first level to compare the distribution of RTs between Cue Conditions (Figure 6).

FIGURE 6
www.frontiersin.org

Figure 6. Bayesian inference of population prevalence for RTs. Each panel shows posterior density (black curve) with MAP (red circle), 50% and 96% HPDI (thick/thin blue lines), obtained from within-subject inference at p = 0.05 of RTs for each Cue Condition interaction: (A) RTs tested on Go+ Condition versus Neutral Condition; (B) RTs tested on Go+ condition versus Stop+ Condition; (C) RTs tested on Stop+ Condition versus Neutral Condition.

The population prevalence proportion of the within-subject t-test between RTs in the Go+ and Neutral Cue Conditions (Figure 6A) showed the MAP estimate of prevalence to be 0.85 (96% HPDI: [0.59 0.97]), whereas RTs in the Go+ vs. Stop+ (Figure 6B) and Stop+ vs. Neutral (Figure 6C) Conditions showed the MAP estimate of prevalence to be equal 1 (96% HPDI: [0.80 1]).

Based on this result, we concluded that it is highly probable that more than 59% of the population would show a true significant effect when comparing the Go+ condition to the Neutral condition, and we would also consider it highly probable that the result obtained between the Go+ vs. Stop+ and Stop+ vs. Neutral RTs would recur at 80% when tested in the same experiment.

We also tested the effect found for SSDs. Similarly, we applied the t-tests to paired within-subject samples at the first level to compare the SSD distribution between conditions (Figure 7).

FIGURE 7
www.frontiersin.org

Figure 7. Bayesian inference of population prevalence for SSDs. Each panel shows posterior density (black curve) with MAP (red circle), 50% and 96% HPDI (thick/thin blue lines), obtained from within-subject inference at p = 0.05 of RTs for each Cue Condition interaction: (A) SSDs tested on Go+ Condition versus Neutral Condition; (B) SSDs tested on Go+ Condition versus Stop+ Condition; (C) SSDs tested on Stop+ Condition versus Neutral Condition.

The effects found in SSDs are not as strong as those shown in RTs. In fact, this analysis shows that if other subjects were to be tested in the same experiment, the probability of obtaining the same results is possible between 32% (MAP = 0.55, 96% HPDI: [0.28 0.79], 50% HPDI: [0.46 0.64], Figure 7A) and 39% of the tested subjects (MAP = 0.62, 96% HPDI [0.35 0.85], 50% HPDI: [0.46 0.64], Figures 7C,D).

These data integrate the previous findings by showing that despite the subjects employing the strategy of elongating the RTs when higher reward is provided for Stop than for Go trials, some change in the speed of inhibition can also be at play. In fact, as also shown by the SSRT results, the tendency to decrease SSRTs in the Stop+ Condition, could indicate that for some subjects the higher reward for Stop Trials can also lower SSRT.

3.5. Fitting the drift diffusion model to the RTs distribution

We evaluate different models to investigate which parameters of the DDM could explain the changes in RTs distributions associated with the different reward conditions. Specifically, in the Go+ condition the shortening of RTs with respect to the Stop+ condition can be explained by: a higher drift rate (drift rate (v)), i.e. a fast decision process; a higher starting point (starting point (z)) for the decision process, that has been set following the Cue signal; or a modulation of both (Figure 8A). We estimated three different models (model 1 = ‘affect Drift and Starting point’; model 2 = ‘effect only on v’ and model 3 = ‘effect only on z’). We also tested intermediate models to evaluate the goodness of the fit.

FIGURE 8
www.frontiersin.org

Figure 8. Fit data to drift diffusion model (DDM). (A) Fit data to drift diffusion model (DDM). (A) Effects explained with DDM. the effect at the starting point z, we assume that it is close to the boundary in the Go+ condition, in the middle of the threshold (a) in the neutral condition, and finally moving away from the correct boundary in the Stop+ condition. Similarly in the drift model (v), we assume that it increases for the Go+ condition and decreases in the Neutral and Stop+ conditions. (B) The zscore average of the effect of the starting point parameter (z) and the zscore average of the parameters of the drift rate(v) (right panel). Error bars represent 1 SE from the mean.

The sum of Bayesian information criterion values (BIC; Schwarz, 1978) across subjects show a lower value for the model ‘effect only on z’ than for the drift model (BIC: ‘effect only on v’ = 2.25 + e04; ‘effect only on z’ = 2.25 + e04; ‘effect on drift and z’=: 2.18 + e04). At the individual level, we compared the BICs of the models within each subject for the two model without interaction, and we found that for 10 out of 14 subjects the fitting was better with ‘effect only on z’; and for the others 4 showed better fitting was obtained for the model ‘effect only on v’.

Finally, the mixed model, even at the individual level, had the lowest values of BIC. Therefore, we took this as the model that fitted best with our data.

To assess how the estimated parameters vary between conditions, we applied the Friedman test that shows a significant difference across conditions for the starting point(z) (p < 0.01), but no difference was found for the drift rate(v) across conditions. The post-hoc shows a significant difference between the Go+ condition and the Stop + condition (p < 0.01), but no difference is present between the Neutral condition and the Go+ (p = 0.14) and versus Stop+ (p = 0.38) (Figure 8B). To conclude the changes in RTs observed between conditions can be mostly related to changes in the starting point of the accumulation process.

4. Discussion

The primary goal of this study was to compare how different reward conditions affect the strategy of control in a complex context. Previous studies have shown that the reward perspective influences cognitive functions, such as working memory (Gilbert and Fiez, 2004; Beck et al., 2010) and attention (Krebs et al., 2009; Padmala et al., 2011; Stoppel et al., 2011; Schevernels et al., 2015). In these studies, the reward availability, compared to conditions when no reward was delivered, enabled an improvement in proactive processes through top-down control (Pessoa and Engelmann, 2010; Chelazzi et al., 2013). The few studies that have investigated the influence of reward on response inhibition have employed paradigms in which the motivation revolved around the presence or absence of reward (Scheres et al., 2001; Greenhouse and Wessel, 2013; Rosell-Negre et al., 2014), or specifically, for response inhibition the type of Stop Signal presented informed about the presence or type of reward (Boehler et al., 2012, 2014; Wilbertz et al., 2014).

In the wake of these studies, we administered a modified SST, in which we introduced different amounts of reward following a dynamic presentation that varied trial by trial, to investigate how reward influenced the proactive and/or reactive strategy on Go and Stop processes. Our results show that the value of the reward has an effect on the RTs of the subjects. Subjects tended to be faster when correctly responding to the Go Signal was rewarded more than correctly performing the Stop Trials, compared to the other context when response inhibition was rewarded more.

Subjects tended to respond faster when the Go trials were rewarded more than the Stop Trials, and vice versa. This is congruent with previous findings, revealing the effects of reward bias on Stop-signal task performance (Leotti and Wager, 2010; Padmala and Pessoa, 2010). Slowing down in the Stop+ versus Neutral and Go+ condition, can be attributed to adjustments in proactive inhibitory control by trading speed at the Go Trial for success at the Stop Trials (Verbruggen et al., 2009; Aron, 2011). These adjustments were performed according to the cues presented at the beginning of the trials.

No significant effect on SSRTs was observed across conditions, which is coherent with other studies (Logan et al., 1986; Ramautar et al., 2004; Lansbergen et al., 2007; Zandbelt et al., 2013; Verbruggen and McLaren, 2018; Andujar et al., 2022). This could be due to the strategy used by the subjects.

In our task a staircase algorithm has been employed to change the SSD according to the performance in Stop Trials. The goal of this procedure was to keep the p(response) as close as possible to 0.50. Therefore, an important index to consider in our study is SSD, and how it changed according to the context to provide information regarding the strategy that the subjects have been using during the task (van Boxtel et al., 2001; Band et al., 2003).

In line with the goal of the staircase procedure, we did not find a difference in p(response) between conditions; however, we found that SSDs correlated positively with RTs, and longer SSDs were attributed to the Stop + condition. This shows that the subjects were able to inhibit the movement at longer SSD by lengthening their RT. Thus, the higher reward for Correct Stop Trials prompted the subjects to slow down their response that, consequently, required the increase of SSD to obtain the p(response) by the staircase algorithm. In this context, we observed only slight changes in the SSRT, supporting the idea that subjects approached the task mostly changing their RT while keeping their speed of inhibition unaffected.

However, our prevalence analysis has shown that SSD changes were not as strong as RT changes. This suggests that the subjects could also have partially adopted another strategy, based on the concurrent modulation of the speed of inhibition. It is indeed possible that in Stop+ trials the subjects have also shortened their SSRT, thus making them able to inhibit at an even longer SSD.

Our results are consistent with the theoretical approach which suggests that adopting a proactive control strategy in reward conditions improves goal attainment (Braver, 2012). In this sense Jimura et al. (2010) argued that the adoption of a proactive control strategy involves the maintenance and preparatory updating of task goals, which facilitates performance in reward contexts.

We investigated the behavioral results by employing the Drift Diffusion Model and we found that in most subjects the choice bias is mainly determined by adjusting the starting point of the accumulation process rather than by changing the accumulation rate itself. This suggests that, at least in this study, proactive control is obtained by adjusting the starting point of the response preparation process following the Go presentation. Thus, following the Stop+ cue, the lowering of the starting point will require more time to reach the boundary producing longer RTs. These findings are in line with results obtained from cortical premotor neuronal recordings in primates performing similar tasks (Giamundo et al., 2021). Indeed, premotor neuronal activity reflects the level of motivation to move before the Go signal: higher activity for the Go+ than for Neutral and Stop+ conditions (see Figure 3 of Giamundo et al., 2021). This modulation is reminiscent of the starting point modulation that we observed. Furthermore, human studies that used model-based approaches to investigate bias in choice behavior show similar results(Ratcliff, 1988; Voss et al., 2004; Palmer et al., 2005; Bogacz et al., 2006; Forstmann et al., 2010; Mulder et al., 2012).

One of the interesting results of the study concerns the Neutral condition. Subjects tended to have RTs whose values were between the RTs of the Go+ and Stop+ Condition but had slightly longer SSDs compared to the Go+ Condition, and higher SSRTs compared to the other two Conditions, thus slightly increasing the p(response) in Stop trials.

It could be argued that this condition implies greater cognitive effort for the subject, because the reward of correct Go and Stop Trials have equal value, implying greater effort to do the two types of trials correctly.

In line with the theory of effort allocation, these results show that subjects are able to improve performance if the task has a high value relative to cognitive effort (i.e., Go+ and Stop+ Condition) and, conversely, performance decreases if the task has a low value relative to task demand(i.e., Neutral condition) (Kurzban et al., 2013; Thomson et al., 2015; Massar et al., 2016).

Instead, in the Go+ and Stop+ conditions, the higher reward and a lower one could be seen by the subject as a reinforcement (+30 points) and a punishment (+5 points, in accordance with the Cue Condition) by shifting the focus to performing one type of trials correctly rather than the other.

Moreover, previous studies suggest such reward perception encourages flexible behavior (Maddox and Markman, 2010), in fact in the Go+ and Stop+ Conditions, the strategy adopted changes and appears to be consistent with receiving the high reward (Verbruggen et al., 2017; Verbruggen and McLaren, 2018).

With these results, subsequent studies could investigate how reward value influences motor control, using electrophysiological measures of cognitive effort to test their relationship. Furthermore, the results obtained through Bayesian analysis show a reproducibility of the SSD-related effect of less than 40%. In order to verify whether a reactive strategy was used more in some subjects, a future study should also include testing the reactive strategy within the task.

5. Conclusion

In accordance with previous studies, subjects could employ different strategies to perform the task, including adjusting the speed of response or modulating the efficiency of inhibition. Subjects preferentially adjusted their speed of response, although in some cases a concurrent adjustment of the speed of inhibition could have been at play.

The investigation of strategic motor adjustments based on reward perspectives is relevant not only for understanding how action control is typically regulated, but also for studying genetic underpinnings of control strategies (Mione et al., 2015) and various groups of patients with cognitive control deficits (Brunamonti et al., 2011; Pani et al., 2013; Duprez et al., 2016; Olivito et al., 2017; Menghini et al., 2018). These studies will help to understand how the control processes (proactive and reactive) can be regulated by using reward perspectives as motivational factors.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The procedure was approved by the Ethics Committee of “Roma Tre” University. The patients/participants provided their written informed consent to participate in this study.

Author contributions

PP and VG conceived the original idea. PP, EB, and SFe supervised the project. VG created the task and collected the data. PP, IM, and VG conceived and performed the data analysis. VG, IM, SR, and PP wrote the paper. All authors contributed to the article and approved the submitted version.

Funding

This study was partially supported by a Sapienza grant (RM11916B89232364 to PP).

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Footnotes

References

Andujar, M., Marc, I. B., Giuffrida, V., Ferraina, S., Brunamonti, E., and Pani, P. (2022). Response preparation affects cognitive motor control. Hum. Factors 00187208221132749:001872082211327. doi: 10.1177/00187208221132749

PubMed Abstract | CrossRef Full Text | Google Scholar

Aron, A. R. (2011). From reactive to proactive and selective control: developing a richer model for stopping inappropriate responses. Biol. Psychiatry 69, e55–e68. doi: 10.1016/j.biopsych.2010.07.024

CrossRef Full Text | Google Scholar

Ashby, F. G. J. J. O. M. P. (1983). A biased random walk model for two choice reaction times. J. Math. Psychol 27, 277–297. doi: 10.1016/0022-2496(83)90011-1

CrossRef Full Text | Google Scholar

Band, G. P., van der Molen, M. W., and Logan, G. D. (2003). Horse-race model simulations of the stop-signal procedure. Acta Psychol. 112, 105–142. doi: 10.1016/s0001-6918(02)00079-3

PubMed Abstract | CrossRef Full Text | Google Scholar

Bardella, G., Giarrocco, F., Giuffrida, V., Brunamonti, E., Pani, P., and Ferraina, S. (2023). Response inhibition in premotor cortex corresponds to a complex reshuffle of the mesoscopic information network. 2021.2003.2015.435381. J bioRxiv [Preprint]. doi: 10.1101/2021.03.15.435381

CrossRef Full Text | Google Scholar

Bardella, G., Pani, P., Brunamonti, E., Giarrocco, F., and Ferraina, S. (2020). The small scale functional topology of movement control: Hierarchical organization of local activity anticipates movement generation in the premotor cortex of primates. Neuroimage 207:116354. doi: 10.1016/j.neuroimage.2019.116354

PubMed Abstract | CrossRef Full Text | Google Scholar

Beck, S. M., Locke, H. S., Savine, A. C., Jimura, K., and Braver, T. S. (2010). Primary and secondary rewards differentially modulate neural activity dynamics during working memory. PLoS One 5:e9251. doi: 10.1371/journal.pone.0009251

PubMed Abstract | CrossRef Full Text | Google Scholar

Boehler, C. N., Hopf, J.-M., Stoppel, C. M., and Krebs, R. M. (2012). Motivating inhibition – reward prospect speeds up response cancellation. Cognition 125, 498–503. doi: 10.1016/j.cognition.2012.07.018

PubMed Abstract | CrossRef Full Text | Google Scholar

Boehler, C. N., Schevernels, H., Hopf, J.-M., Stoppel, C. M., and Krebs, R. M. (2014). Reward prospect rapidly speeds up response inhibition via reactive control. Cogn. Affect. Behav. Neurosci. 14, 593–609. doi: 10.3758/s13415-014-0251-5

PubMed Abstract | CrossRef Full Text | Google Scholar

Bogacz, R., Brown, E., Moehlis, J., Holmes, P., and Cohen, J. D. (2006). The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. Psychol. Rev. 113, 700–765. doi: 10.1037/0033-295x.113.4.700

PubMed Abstract | CrossRef Full Text | Google Scholar

Boucher, L., Palmeri, T. J., Logan, G. D., and Schall, J. D. (2007). Inhibitory control in mind and brain: an interactive race model of countermanding saccades. Psychol. Rev. 114, 376–397. doi: 10.1037/0033-295x.114.2.376

PubMed Abstract | CrossRef Full Text | Google Scholar

Braver, T. S. (2012). The variable nature of cognitive control: a dual mechanisms framework. Trends Cogn. Sci. 16, 106–113. doi: 10.1016/j.tics.2011.12.010

PubMed Abstract | CrossRef Full Text | Google Scholar

Braver, T. S., Gray, J. R., and Burgess, G. C. (2007). “Explaining the many varieties of working memory variation: dual mechanisms of cognitive control” in Variation in working memory (New York, NY, US: Oxford University Press), 76–106.

Google Scholar

Brunamonti, E., Ferraina, S., and Paré, M. (2012). Controlled movement processing: evidence for a common inhibitory control of finger, wrist, and arm movements. Neuroscience 215, 69–78. doi: 10.1016/j.neuroscience.2012.04.051

PubMed Abstract | CrossRef Full Text | Google Scholar

Brunamonti, E., Pani, P., Papazachariadis, O., Onorati, P., Albertini, G., and Ferraina, S. (2011). Cognitive control of movement in down syndrome. Res. Dev. Disabil. 32, 1792–1797. doi: 10.1016/j.ridd.2011.03.008

CrossRef Full Text | Google Scholar

Carpenter, R. H., and Williams, M. L. (1995). Neural computation of log likelihood in control of saccadic eye movements. Nature 377, 59–62. doi: 10.1038/377059a0

PubMed Abstract | CrossRef Full Text | Google Scholar

Chelazzi, L., Perlato, A., Santandrea, E., and Della Libera, C. (2013). Rewards teach visual selective attention. Vis. Res. 85, 58–72. doi: 10.1016/j.visres.2012.12.005

PubMed Abstract | CrossRef Full Text | Google Scholar

Diederich, A., and Busemeyer, J. R. (2006). Modeling the effects of payoff on response bias in a perceptual discrimination task: bound-change, drift-rate-change, or two-stage-processing hypothesis. Percept. Psychophys. 68, 194–207. doi: 10.3758/bf03193669

PubMed Abstract | CrossRef Full Text | Google Scholar

Duprez, J., Houvenaghel, J.-F., Naudet, F., Dondaine, T., Auffret, M., Robert, G., et al. (2016). Evaluating cognitive action control using eye-movement analysis: an oculomotor adaptation of the simon task. Front. Hum. Neurosci. 10:84. doi: 10.3389/fnhum.2016.00084

PubMed Abstract | CrossRef Full Text | Google Scholar

Edwards, W. J. J. O. M. P. (1965). Optimal strategies for seeking information: models for statistics, choice reaction times, and human information processing. J. Math. Psychol. 2, 312–329. doi: 10.1016/0022-2496(65)90007-6

CrossRef Full Text | Google Scholar

Engelmann, J., Damaraju, E., Padmala, S., and Pessoa, L. (2009). Combined effects of attention and motivation on visual task performance: transient and sustained motivational effects. Front. Hum. Neurosci. 3:3. doi: 10.3389/neuro.09.004.2009

PubMed Abstract | CrossRef Full Text | Google Scholar

Engelmann, J., and Pessoa, L. (2007). Motivation sharpens exogenous spatial attention. Emotion 7, 668–674. doi: 10.1037/1528-3542.7.3.668

PubMed Abstract | CrossRef Full Text | Google Scholar

Faul, F., Erdfelder, E., Buchner, A., and Lang, A.-G. (2009). Statistical power analyses using G*power 3.1: tests for correlation and regression analyses. Behav. Res. Methods 41, 1149–1160. doi: 10.3758/BRM.41.4.1149

PubMed Abstract | CrossRef Full Text | Google Scholar

Faul, F., Erdfelder, E., Lang, A.-G., and Buchner, A. (2007). G*power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav. Res. Methods 39, 175–191. doi: 10.3758/BF03193146

PubMed Abstract | CrossRef Full Text | Google Scholar

Fiori, L., Marc, I. B., Ramawat, S., Tatarelli, T., Chini, G., Ranavolo, A., et al. (2022). Motor inhibition parameters are reflected in the kinetic and kinematic of gait initiation in a step version of the Stop Signal Task. Gait & Posture. 97:9. doi: 10.1016/j.gaitpost.2022.09.021

PubMed Abstract | CrossRef Full Text | Google Scholar

Forstmann, B. U., Brown, S., Dutilh, G., Neumann, J., and Wagenmakers, E. J. (2010). The neural substrate of prior information in perceptual decision making: a model-based analysis. Front. Hum. Neurosci. 4:40. doi: 10.3389/fnhum.2010.00040

PubMed Abstract | CrossRef Full Text | Google Scholar

Giamundo, M., Giarrocco, F., Brunamonti, E., Fabbrini, F., Pani, P., and Ferraina, S. (2021). Neuronal activity in the premotor cortex of monkeys reflects both cue salience and motivation for action generation and inhibition. J. Neurosci. 41, 7591–7606. doi: 10.1523/JNEUROSCI.0641-20.2021

PubMed Abstract | CrossRef Full Text | Google Scholar

Giarrocco, F., Bardella, G., Giamundo, M., Fabbrini, F., Brunamonti, E., Pani, P., et al. (2021). Neuronal dynamics of signal selective motor plan cancellation in the macaque dorsal premotor cortex. Cortex 135, 326–340. doi: 10.1016/j.cortex.2020.09.032

PubMed Abstract | CrossRef Full Text | Google Scholar

Gilbert, A. M., and Fiez, J. A. (2004). Integrating rewards and cognition in the frontal cortex. Cogn. Affect. Behav. Neurosci. 4, 540–552. doi: 10.3758/CABN.4.4.540

CrossRef Full Text | Google Scholar

Gold, J. I., and Shadlen, M. N. (2002). Banburismus and the brain: decoding the relationship between sensory stimuli, decisions, and reward. Neuron 36, 299–308. doi: 10.1016/s0896-6273(02)00971-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Greenhouse, I., and Wessel, J. R. (2013). EEG signatures associated with stopping are sensitive to preparation. Psychophysiology 50, 900–908. doi: 10.1111/psyp.12070

PubMed Abstract | CrossRef Full Text | Google Scholar

Hanes, D. P., and Carpenter, R. H. S. (1999). Countermanding saccades in humans. Vis. Res. 39, 2777–2791. doi: 10.1016/S0042-6989(99)00011-5

CrossRef Full Text | Google Scholar

Hartigan, P. M. (1985). Algorithm AS 217: computation of the dip statistic to test for Unimodality. J. R. Stat. Soc. Ser. C 34, 320–325. doi: 10.2307/2347485

CrossRef Full Text | Google Scholar

Hartigan, J. A., and Hartigan, P. M. (1985). The dip test of Unimodality. Ann. Stat. 13, 70–84. doi: 10.1214/aos/1176346577

CrossRef Full Text | Google Scholar

Hervault, M., Zanone, P.-G., Buisson, J.-C., and Huys, R. (2022). Hold your horses: differences in EEG correlates of inhibition in cancelling and stopping an action. Neuropsychologia 172:108255. doi: 10.1016/j.neuropsychologia.2022.108255

PubMed Abstract | CrossRef Full Text | Google Scholar

Ince, R. A. A., Kay, J. W., and Schyns, P. G. (2022). Within-participant statistics for cognitive science. Trends Cogn. Sci. 26, 626–630. doi: 10.1016/j.tics.2022.05.008

PubMed Abstract | CrossRef Full Text | Google Scholar

Ince, R. A. A., Paton, A. T., Kay, J. W., and Schyns, P. G. (2021). Bayesian inference of population prevalence. elife 10:e62461. doi: 10.7554/eLife.62461

PubMed Abstract | CrossRef Full Text | Google Scholar

Jimura, K., Locke, H. S., and Braver, T. S. J. P. O. T. N. A. O. S. (2010). Prefrontal cortex mediation of cognitive enhancement in rewarding motivational contexts. PNAS 107, 8871–8876. doi: 10.1073/pnas.1002007107

CrossRef Full Text | Google Scholar

Krebs, R. M., Schott, B. H., Schütze, H., and Düzel, E. (2009). The novelty exploration bonus and its attentional modulation. Neuropsychologia 47, 2272–2281. doi: 10.1016/j.neuropsychologia.2009.01.015

PubMed Abstract | CrossRef Full Text | Google Scholar

Kurzban, R., Duckworth, A., Kable, J. W., and Myers, J. (2013). An opportunity cost model of subjective effort and task performance. Behav. Brain Sci. 36, 661–679. doi: 10.1017/s0140525x12003196

PubMed Abstract | CrossRef Full Text | Google Scholar

Lansbergen, M. M., Böcker, K. B., Bekker, E. M., and Kenemans, J. L. J. C. N. (2007). Neural correlates of stopping and self-reported impulsivity. Clin. Neurophysiol. 118, 2089–2103. doi: 10.1016/j.clinph.2007.06.011

CrossRef Full Text | Google Scholar

Lauwereyns, J. (2011). The anatomy of bias: How neural circuits weigh the options. Cambridge, MA: MIT Press.

Google Scholar

Leotti, L. A., and Wager, T. D. (2010). Motivational influences on response inhibition measures. J. Exp. Psychol. Hum. Percept. Perform. 36, 430–447. doi: 10.1037/a0016802

PubMed Abstract | CrossRef Full Text | Google Scholar

Link, S., and Heath, R. J. P. (1975). A sequential theory of psychological discrimination. Psychometrika 40, 77–105. doi: 10.1007/BF02291481

CrossRef Full Text | Google Scholar

Logan, G. D. (1994). “On the ability to inhibit thought and action: a users' guide to the stop signal paradigm” in Inhibitory processes in attention, memory, and language (San Diego, CA, US: Academic Press), 189–239.

Google Scholar

Logan, G. D., and Burkell, J. J. J. O. E. P. H. P., Performance (1986). Dependence and independence in responding to double stimulation: a comparison of stop, change, and dual-task paradigms. J. Exp. Psychol. Hum. Percept. Perform. 12, 549–563. doi: 10.1037/0096-1523.12.4.549

CrossRef Full Text | Google Scholar

Logan, G. D., and Cowan, W. B. (1984). On the ability to inhibit thought and action: a theory of an act of control. Psychol. Rev. 91, 295–327. doi: 10.1037/0033-295X.91.3.295

CrossRef Full Text | Google Scholar

Luce, R.D. (1986). Response times: their role in inferring elementary mental organization. New York: Oxford University Press.

Google Scholar

Maddox, W. T., and Markman, A. B. (2010). The motivation-cognition Interface in learning and decision-making. Curr. Dir. Psychol. Sci. 19, 106–110. doi: 10.1177/0963721410364008

PubMed Abstract | CrossRef Full Text | Google Scholar

Marc, I. B. G. V., Ramawat, S., Fiori, L., Fontana, R., Bardella, G., Fagioli, S., et al. (2023). Restart errors reaction time of a two-step inhibition process account for the violation of the race model’s independence in multi-effector selective stop signal task. Front. Hum. Neurosci. 17:1106298. doi: 10.3389/fnhum.2023.1106298

CrossRef Full Text | Google Scholar

Massar, S. A., Lim, J., Sasmita, K., and Chee, M. W. (2016). Rewards boost sustained attention through higher effort: a value-based decision making approach. Biol. Psychol. 120, 21–27. doi: 10.1016/j.biopsycho.2016.07.019

PubMed Abstract | CrossRef Full Text | Google Scholar

Menghini, D., Armando, M., Calcagni, M., Napolitano, C., Pasqualetti, P., Sergeant, J. A., et al. (2018). The influence of generalized anxiety disorder on executive functions in children with ADHD. Eur. Arch. Psychiatry Clin. Neurosci. 268, 349–357. doi: 10.1007/s00406-017-0831-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Mione, V., Canterini, S., Brunamonti, E., Pani, P., Donno, F., Fiorenza, M. T., et al. (2015). Both the COMT Val158Met single-nucleotide polymorphism and sex-dependent differences influence response inhibition. Front. Behav. Neurosci. 9:127. doi: 10.3389/fnbeh.2015.00127

PubMed Abstract | CrossRef Full Text | Google Scholar

Mirabella, G., Pani, P., and Ferraina, S. (2008). Context influences on the preparation and execution of reaching movements. Cogn. Neuropsychol. 25, 996–1010. doi: 10.1080/02643290802003216

PubMed Abstract | CrossRef Full Text | Google Scholar

Mohanty, A., Gitelman, D. R., Small, D. M., and Mesulam, M. M. (2008). The spatial attention network interacts with limbic and monoaminergic systems to modulate motivation-induced attention shifts. Cereb. Cortex 18, 2604–2613. doi: 10.1093/cercor/bhn021

PubMed Abstract | CrossRef Full Text | Google Scholar

Montanari, R., Giamundo, M., Brunamonti, E., Ferraina, S., and Pani, P. (2017). Visual salience of the stop-signal affects movement suppression process. Exp. Brain Res. 235, 2203–2214. doi: 10.1007/s00221-017-4961-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Mulder, M. J., Wagenmakers, E.-J., Ratcliff, R., Boekel, W., and Forstmann, B. U. (2012). Bias in the brain: a diffusion model analysis of prior probability and potential payoff. J. Neurosci. 32, 2335–2343. doi: 10.1523/JNEUROSCI.4156-11.2012

CrossRef Full Text | Google Scholar

Olivito, G., Brunamonti, E., Clausi, S., Pani, P., Chiricozzi, F. R., Giamundo, M., et al. (2017). Atrophic degeneration of cerebellum impairs both the reactive and the proactive control of movement in the stop signal paradigm. Exp. Brain Res. 235, 2971–2981. doi: 10.1007/s00221-017-5027-z

PubMed Abstract | CrossRef Full Text | Google Scholar

Padmala, S., Bauer, A., and Pessoa, L. (2011). Negative emotion impairs conflict-driven executive control. Front. Psychol. 2:192. doi: 10.3389/fpsyg.2011.00192

PubMed Abstract | CrossRef Full Text | Google Scholar

Padmala, S., and Pessoa, L. (2010). Interactions between cognition and motivation during response inhibition. Neuropsychologia 48, 558–565. doi: 10.1016/j.neuropsychologia.2009.10.017

PubMed Abstract | CrossRef Full Text | Google Scholar

Palmer, J., Huk, A. C., and Shadlen, M. N. (2005). The effect of stimulus strength on the speed and accuracy of a perceptual decision. J. Vis. 5, 1–404. doi: 10.1167/5.5.1

PubMed Abstract | CrossRef Full Text | Google Scholar

Pani, P., Di Bello, F., Brunamonti, E., D'Andrea, V., Papazachariadis, O., and Ferraina, S. (2014). Alpha- and beta-band oscillations subserve different processes in reactive control of limb movements. Front. Behav. Neurosci. 8:383. doi: 10.3389/fnbeh.2014.00383

PubMed Abstract | CrossRef Full Text | Google Scholar

Pani, P., Giamundo, M., Giarrocco, F., Mione, V., Fontana, R., Brunamonti, E., et al. (2022). Neuronal population dynamics during motor plan cancellation in nonhuman primates. Proc. Natl. Acad. Sci. U. S. A. 119:e2122395119. doi: 10.1073/pnas.2122395119

PubMed Abstract | CrossRef Full Text | Google Scholar

Pani, P., Giarrocco, F., Giamundo, M., Montanari, R., Brunamonti, E., and Ferraina, S. (2018). Visual salience of the stop signal affects the neuronal dynamics of controlled inhibition. Sci. Rep. 8:14265. doi: 10.1038/s41598-018-32669-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Pani, P., Menghini, D., Napolitano, C., Calcagni, M., Armando, M., Sergeant, J. A., et al. (2013). Proactive and reactive control of movement are differently affected in attention deficit hyperactivity disorder children. Res. Dev. Disabil. 34, 3104–3111. doi: 10.1016/j.ridd.2013.06.032

PubMed Abstract | CrossRef Full Text | Google Scholar

Pessoa, L., and Engelmann, J. B. (2010). Embedding reward signals into perception and cognition. Front. Neurosci. 4:17. doi: 10.3389/fnins.2010.00017

PubMed Abstract | CrossRef Full Text | Google Scholar

Ramautar, J., Kok, A., and Ridderinkhof, K. J. B., cognition (2004). Effects of stop-signal probability in the stop-signal paradigm: the N2/P3 complex further validated. Brain Cogn. 56, 234–252. doi: 10.1016/j.bandc.2004.07.002

CrossRef Full Text | Google Scholar

Ratcliff, R. (1979). Group reaction time distributions and an analysis of distribution statistics. Psychol. Bull. 86, 446–461. doi: 10.1037/0033-2909.86.3.446

PubMed Abstract | CrossRef Full Text | Google Scholar

Ratcliff, R. (1985). Theoretical interpretations of the speed and accuracy of positive and negative responses. Psychol. Rev. 92, 212–225. doi: 10.1037/0033-295X.92.2.212

PubMed Abstract | CrossRef Full Text | Google Scholar

Ratcliff, R. (1988). Continuous versus discrete information processing modeling accumulation of partial information. Psychol. Rev. 95, 238–255. doi: 10.1037/0033-295x.95.2.238

PubMed Abstract | CrossRef Full Text | Google Scholar

Ratcliff, R. (2002). A diffusion model account of response time and accuracy in a brightness discrimination task: fitting real data and failing to fit fake but plausible data. Psychon. Bull. Rev. 9, 278–291. doi: 10.3758/bf03196283

PubMed Abstract | CrossRef Full Text | Google Scholar

Ratcliff, R., and McKoon, G. (2008). The diffusion decision model: theory and data for two-choice decision tasks. Neural Comput. 20, 873–922. doi: 10.1162/neco.2008.12-06-420

PubMed Abstract | CrossRef Full Text | Google Scholar

Rosell-Negre, P., Bustamante, J. C., Fuentes-Claramonte, P., Costumero, V., Benabarre, S., and Barros-Loscertales, A. (2014). Reward anticipation enhances brain activation during responseinhibition. Cogn. Affect. Behav. Neurosci. 14, 621–634. doi: 10.3758/s13415-014-0292-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Scangos, K. W., and Stuphorn, V. (2010). Medial frontal cortex motivates but does not control movement initiation in the countermanding task. J. Neurosci. 30, 1968–1982. doi: 10.1523/jneurosci.4509-09.2010

PubMed Abstract | CrossRef Full Text | Google Scholar

Schall, J. D., Palmeri, T. J., and Logan, G. D. (2017). Models of inhibitory control. Philos. Trans. R. Soc. Lond. Ser. B Biol. Sci. 372:20160193. doi: 10.1098/rstb.2016.0193

PubMed Abstract | CrossRef Full Text | Google Scholar

Scheres, A., Oosterlaan, J., and Sergeant, J. A. (2001). Response inhibition in children with DSM-IV subtypes of AD/HD and related disruptive disorders: the role of reward. Child Neuropsychol. 7, 172–189. doi: 10.1076/chin.7.3.172.8746

PubMed Abstract | CrossRef Full Text | Google Scholar

Schevernels, H., Bombeke, K., Van der Borght, L., Hopf, J. M., Krebs, R. M., and Boehler, C. N. (2015). Electrophysiological evidence for the involvement of proactive and reactive control in a rewarded stop-signal task. NeuroImage 121, 115–125. doi: 10.1016/j.neuroimage.2015.07.023

PubMed Abstract | CrossRef Full Text | Google Scholar

Schwarz, G. (1978). Estimating the dimension of a model. Ann. Stat. 6, 461–464. doi: 10.1214/aos/1176344136

CrossRef Full Text | Google Scholar

Stoppel, C. M., Boehler, C. N., Strumpf, H., Heinze, H. J., Hopf, J. M., and Schoenfeld, M. A. (2011). Neural processing of reward magnitude under varying attentional demands. Brain Res. 1383, 218–229. doi: 10.1016/j.brainres.2011.01.095

PubMed Abstract | CrossRef Full Text | Google Scholar

Thomson, D. R., Besner, D., and Smilek, D. (2015). A resource-control account of sustained attention: evidence from mind-wandering and vigilance paradigms. Perspect. Psychol. Sci. 10, 82–96. doi: 10.1177/1745691614556681

PubMed Abstract | CrossRef Full Text | Google Scholar

van Boxtel, G. J. M., van der Molen, M. W., Jennings, J. R., and Brunia, C. H. M. (2001). A psychophysiological analysis of inhibitory motor control in the stop-signal paradigm. Biol. Psychol. 58, 229–262. doi: 10.1016/S0301-0511(01)00117-X

PubMed Abstract | CrossRef Full Text | Google Scholar

Vandekerckhove, J., and Tuerlinckx, F. (2007). Fitting the Ratcliff diffusion model to experimental data. Psychon. Bull. Rev. 14, 1011–1026. doi: 10.3758/BF03193087

PubMed Abstract | CrossRef Full Text | Google Scholar

Vandekerckhove, J., and Tuerlinckx, F. (2008). Diffusion model analysis with MATLAB: a DMAT primer. Behav. Res. Methods 40, 61–72. doi: 10.3758/BRM.40.1.61

PubMed Abstract | CrossRef Full Text | Google Scholar

Verbruggen, F., Aron, A. R., Band, G. P. H., Beste, C., Bissett, P. G., Brockett, A. T., et al. (2019). A consensus guide to capturing the ability to inhibit actions and impulsive behaviors in the stop-signal task. elife 8:e46323. doi: 10.7554/eLife.46323

CrossRef Full Text | Google Scholar

Verbruggen, F., Chambers, C. D., Lawrence, N. S., and McLaren, I. P. (2017). Winning and losing: effects on impulsive action. J. Exp. Psychol. Hum. Percept. Perform. 43, 147–168. doi: 10.1037/xhp0000284

PubMed Abstract | CrossRef Full Text | Google Scholar

Verbruggen, F., Logan, G. D. J. N., and Reviews, B. (2009). Models of response inhibition in the stop-signal and stop-change paradigms. Neurosci. Biobehav. Rev. 33, 647–661. doi: 10.1016/j.neubiorev.2008.08.014

CrossRef Full Text | Google Scholar

Verbruggen, F., and McLaren, R. (2018). Effects of reward and punishment on the interaction between going and stopping in a selective stop-change task. Psychol. Res. 82, 353–370. doi: 10.1007/s00426-016-0827-5

PubMed Abstract | CrossRef Full Text | Google Scholar

Vince, M. A. (1948). The intermittency of control movements and the psychological refractory period. Br. J. Psychol. Gen. Sect. 38, 149–157. doi: 10.1111/j.2044-8295.1948.tb01150.x

CrossRef Full Text | Google Scholar

Voss, A., Rothermund, K., and Voss, J. (2004). Interpreting the parameters of the diffusion model: an empirical validation. Mem. Cogn. 32, 1206–1220. doi: 10.3758/bf03196893

PubMed Abstract | CrossRef Full Text | Google Scholar

Wagenmakers, E. J., van der Maas, H. L., Dolan, C. V., and Grasman, R. P. (2008). EZ does it! Extensions of the EZ-diffusion model. Psychon. Bull. Rev. 15, 1229–1235. doi: 10.3758/pbr.15.6.1229

PubMed Abstract | CrossRef Full Text | Google Scholar

Wilbertz, T., Deserno, L., Horstmann, A., Neumann, J., Villringer, A., Heinze, H.-J., et al. (2014). Response inhibition and its relation to multidimensional impulsivity. Neuroimage 103, 241–248. doi: 10.1016/j.neuroimage.2014.09.021

CrossRef Full Text | Google Scholar

Zandbelt, B. B., Bloemendaal, M., Neggers, S. F., Kahn, R. S., and Vink, M. J. H. B. M. (2013). Expectations and violations: delineating the neural network of proactive inhibitory control. Hum. Brain Mapp. 34, 2015–2024. doi: 10.1002/hbm.22047

CrossRef Full Text | Google Scholar

Keywords: stop signal task, cognitive control, inhibitory control, reward, strategic adjustments, motor control

Citation: Giuffrida V, Marc IB, Ramawat S, Fontana R, Fiori L, Bardella G, Fagioli S, Ferraina S, Brunamonti E and Pani P (2023) Reward prospect affects strategic adjustments in stop signal task. Front. Psychol. 14:1125066. doi: 10.3389/fpsyg.2023.1125066

Received: 15 December 2022; Accepted: 20 February 2023;
Published: 17 March 2023.

Edited by:

Chaoxiong Ye, University of Jyväskylä, Finland

Reviewed by:

Silvia Spadacenta, Hertie Institute for Clinical Brain Research, Germany
Kerstin Fröber, University of Regensburg, Germany

Copyright © 2023 Giuffrida, Marc, Ramawat, Fontana, Fiori, Bardella, Fagioli, Ferraina, Brunamonti and Pani. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Pierpaolo Pani, pierpaolo.pani@uniroma1.it

These authors share first authorship

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.