Skip to main content

BRIEF RESEARCH REPORT article

Front. Psychol., 10 May 2022
Sec. Quantitative Psychology and Measurement

Appropriately Tuning Stochastic-Psychometric Properties of the Balloon Analog Risk Task

  • 1Department of Neuroscience, Imaging, and Clinical Sciences, G D’Annunzio University of Chieti-Pescara, Chieti, Italy
  • 2Institute for Advanced Biomedical Technologies (ITAB), G D’Annunzio University of Chieti-Pescara, Chieti, Italy

The Balloon Analog Risk Task (BART) allows to experimentally assess individuals’ risk-taking profiles in an ecologically sound setting. Many psychological and neuroscientific studies implemented the BART for its simplicity and intuitive nature. However, some issues in the design of the BART are systematically unconsidered in experimental paradigms, which may bias the estimation of individual risk-taking profiles. Since there are no methodological guidelines for implementing the BART, many variables (e.g., the maximum explosion probabilities, the rationale underlying stochastic events) vary inconstantly across experiments, possibly producing contrasting results. Moreover, the standard version of the BART is affected by the interaction of an individual-dependent, unavoidable source of stochasticity with a trial-dependent, more ambiguous source of stochasticity (i.e., the probability of the balloon to explode). This paper shows the most appropriate experimental choices for having the lowest error in the approximation of risk-taking profiles. Performance tests of a series of simulated data suggest that a more controlled, eventually non-stochastic version of the BART, better approximates original risk-taking profiles. Selecting optimal BART parameters is particularly important in neuroscience experiments to optimize the number of trials in a time window appropriate for acquiring neuroimaging data. We also provide helpful suggestions to researchers in many fields to allow the implementation of optimized risk-taking experiments using the BART.

Introduction

The administration of psychometric tests is a crucial phase in scientific investigations aimed at understanding human behavior, including cognitive and behavioral individual differences, predispositions toward clinical and subclinical symptoms, and the neurocognitive framework supporting psychometric variability (Lenhard et al., 2019; Zickar, 2020; Tonini et al., 2021). To achieve such aims, it is crucial that the statistical-mathematical structure and the psychological-philosophical background of psychometric instruments are sound, unbiased, and consistent (Nichols et al., 2017; Steiner and Frey, 2022). Ideally, reproducible simulations should test task performance variations for their psychometric and stochastic properties, including their general efficiency in measuring latent behavior (Schonberg et al., 2011; Bajracharya and Duboz, 2013; Donkin et al., 2017; Fitzpatrick, 2019).

The Balloon Analog Risk Task (BART) is a valuable laboratory-based psychometric instrument to assess risk-taking behavior in healthy and clinical populations. From its initial development (Lejuez et al., 2002), the BART has been used in many experiments, producing a large body of literature. The widespread utilization of the BART is motivated by its capability in recreating an ecological experience to uncover (neuro)cognitive underpinnings of risk-taking in healthy subjects (Lejuez et al., 2002, 2003, 2005; Weafer et al., 2011; De Groot, 2020; Guenther et al., 2021). However, measurements of risk-taking behavior are also interesting for clinical research since risk-taking indexed by BART scores has been associated with dysfunctional psychophysiological phenotypes, including anxiety (Maner et al., 2007; Buelow and Barnhart, 2017), clinical disorders (Hunt et al., 2005; Swogger et al., 2010; Dominguez, 2011; Cheng et al., 2012; Robbins et al., 2012; Reddy et al., 2014; Brown et al., 2015; Fischer et al., 2015; Tikàsz et al., 2019; Boka et al., 2020; Luk et al., 2021), abuse of heavy drugs (Hopko et al., 2006; Vassilva and Conrod, 2019), smoking attitudes (Lejuez et al., 2003, 2005; Dean et al., 2011; Hanson et al., 2014), alcohol consumption and related symptoms (Skeel et al., 2008; Fernie et al., 2010; Ashenhurst et al., 2011; Weafer et al., 2011; DeMartini et al., 2014; King et al., 2014), gambling (Holt et al., 2003; Mishra et al., 2017), risky sexual behavior (Lejuez et al., 2004; Bornovalova et al., 2008; Lawyer, 2013; for reviews on risk-taking and related dysfunctions see: Leigh, 1999; Turner et al., 2004; Isles et al., 2019). Moreover, BART use has been suggested as a potential marker for dissecting disease-related endophenotypes (Long et al., 2020).

The experimental design of the BART is intuitive and straightforward (Lejuez et al., 2002). In every trial, a balloon is presented, and the participant is asked to either take an award proportional to the current balloon size or attempt inflating the balloon to increase the value of the award. Every time the participant chooses to inflate the balloon, it can be inflated or explode. The explosion of the balloon implies that the award for the current trial is zero (or a negative value). For its simplicity and ecological validity, the BART has been used in neuroimaging studies (Rao et al., 2008; Cazzell et al., 2012; Sela et al., 2012; Congdon et al., 2013; Helfinstein et al., 2014; Xu et al., 2016; Guo et al., 2018; De Groot and Strien, 2019) and showed reliability for both behavioral and neural responses (White et al., 2008; Li et al., 2020).

Although the underlying paradigm is reasonably practical, the BART in its standard design entails unsolved criticalities that may hinder the usefulness of the collected data. Previous works discussed putative issues of the BART, including the censoring of information, the confusion of risk with the expected value, a poor distinguishing between uncertainty and risk, and the ambiguity in the definition of adaptive versus maladaptive behavior (Schonberg et al., 2011; De Groot and Thurik, 2018; De Groot, 2020; Canning et al., 2022). While these concerns are relevant, a significant source of inaccuracies in the BART is the unsafe interaction between two stochastic processes. First, individual uncertainty and noisy behavior are non-avoidable sources of stochasticity. In other words, there is a certain degree of uncertainty in subjective choices, which is subjective and driven by the context and the outcomes generated in previous trials, which blends with noisy behavior (Schonberg et al., 2011; Isles et al., 2019; Yakobi and Danckert, 2021). Consequently, this first stochasticity is a mix of noise and useful subject-specific information. Second, implementing random consequences of individual choices (inflating vs. explosion) means decreasing experimental control over the paradigm and introducing an additional source of stochasticity. We refer to these two sources of stochasticity as “individual-dependent stochasticity” and “design-dependent stochasticity,” respectively. Since the impact of the design-dependent stochasticity has not been appropriately investigated yet, the present study explicitly addresses the design-dependent stochasticity in the BART.

In this study, we show that the power of the BART to reconstruct individual risk-taking profiles significantly raises if its methodological implementation is controlled. More specifically, controllable sources of stochasticity must be handled to achieve accurate experiments. To propose an unbiased, reproducible, and controlled version of the BART, we implement a series of simulations with varying parameters such as explosion probability, virtual risk-taking profiles, number of inflations, number of trials, number of subjects, noise. Importantly, varying these parameters likely allows to model the possible experimental variations of the BART and to test their relative efficiency. Findings from these simulations will therefore assist psychologists and other researchers in psychometric measurements of risk-taking. For example, an optimal paradigm will aid in situations in which researchers must improve their experimental paradigm due to time and instrumental limitations, like, for example, in the case of clinical neuroimaging experiments. The evidence reported by our investigation, together with the implementation of naturalistic and unbiased measures (Schmitz et al., 2016; Coon and Lee, 2021; Yakobi and Danckert, 2021; Steiner and Frey, 2022), will allow scientists to adopt the BART in the best possible way following their experimental demand.

Materials and Methods

The great majority of studies implementing the BART linearly or exponentially modulate the probability of balloon explosion across consecutive inflations. Generally, the explosion probability is modulated to increase between 0 (0% explosion, the balloon will surely inflate) and 1 (100% explosion, the balloon will explode).

Modeling Explosions in Multiple Variants of the BART

Conceptually, we implemented a series of simulations to control how explosion probabilities were modeled. We incorporated and expanded the variations used in past studies utilizing the BART to investigate the impact of the following parameters in the reconstruction of actual risk-taking profiles: the explosion probability maximum threshold; the function used to calculate monotonically increasing explosion probabilities across inflations; the number of inflation events & the number of trials; the number of virtual players (participants); the noise in the virtual players’ behavior; the implementation of non-stochastic (i.e., deterministic) explosions.

Simulating Virtual Risk-Taking Profiles

We tested the performance of different BART versions using a series of simulations implemented in MatLab (The Mathworks, version 2019b). In these simulations, several risk-taking profiles were initially generated. Assuming N virtual subjects and T trials per subject, the simulation of risk-taking profiles ultimately produced, for each virtual subject n, and for each trial t, a series of K monotonically decreasing numbers comprised between 100 and 0 (where 100 = the virtual subject will surely try to inflate the balloon at this inflation event, and 0 = the virtual subject will surely choose the award). The parameters K, N, and T were varied according to different parameters (see below). We used two sets of risk-taking profiles for the simulations: the first set comprehended monotonically decreasing cosine functions starting from 100 and ending in a random number between 0 and 80; the second set was generated using random numbers varying between 0 and 100 reordered to represent monotonically decreasing functions. These simulated profiles were chosen since they approximate realistic risk-taking profiles from real subjects reported in the BART literature (Schonberg et al., 2011; Yakobi and Danckert, 2021), thus simulating both subjects with a regular behavior and subjects with an irregular (noisier) behavior. Example profiles are shown in Figures 1A,B.

FIGURE 1
www.frontiersin.org

Figure 1. Parameters for the simulation. (A) Examples of virtual players with non-linear decrease in the risk-taking profile modeled using the cosine function. (B) Examples of virtual players with random decrease in the risk-taking profile. (C) Combination of parameters used to model explosions in the different versions of the stochastic Balloon Analog Risk Task (BART) analyzed. The three functions used to model explosion probabilities in consecutive inflations are coded by colors (linear, exponential, and logarithmic). The three thresholds indicating maximum explosion probabilities are coded by the line type (50, 75, and 100%).

Simulating Decision Matrices

After generating individual risk-taking profiles, the BART was run for each subject, using T trials and a maximum of K inflation events. Before the actual simulation of the BART, an individual decision matrix was generated. That matrix was a T-by-K (trial-by-possible inflations) binary matrix indicating if the virtual subject chooses to inflate/take the prize for each possible event of the task. The decision matrix was generated as follows. In each trial, a decision of the nth virtual subject is simulated by extracting a random number between 1 and 100: if the random number is above the critical threshold for that nth subject, in the tth trial, and in the kth inflation event, then the corresponding decision for the current trial is set to “take the award”; alternatively, if the random number is below the critical threshold for that nth subject in the kth inflation event, then the corresponding decision for the current trial is set to “try inflating the balloon.” Importantly, modeling exactly the same degree of intra-subject variability (i.e., subject-related stochasticity) is mandatory to investigate the accuracies of different parametrizations of the BART. The decision matrix was simulated for each virtual subject (i.e., from each risk-taking profile) at each simulation cycle before running the BART itself. To note, this stage entailed the first, unavoidable source of stochasticity in the BART.

The BART

The individual decision matrix was subsequently applied to the task. In each trial, the virtual decision is used to prompt the BART algorithm alternatively toward the “take the award” or “try inflating the balloon” choice. The “take award” option leads to obtaining a certain amount of money and going to the subsequent trial. Instead, the “try inflating the balloon” option led to the extraction of a random number between 1 and 100: if the random number was below the critical explosion threshold in the kth inflation event, in the tth trial, then the balloon exploded; alternatively, if the random number is equal or above the threshold, then the trial continues to the next inflation (kth + 1). This stage was modeled for three explosion probability functions: linear increase function, exponential increase function, and logarithmic increase function. Moreover, three maximum explosion thresholds were set: 50, 75, and 100%. These functions are represented in Figure 1C. To note, this stage represented the second source of stochasticity in the BART.

Simulation Parameters

Investigating an increasing number of maximum inflation events (K) and trials (T) is crucial since it influences the psychometric properties of the BART (Lejuez et al., 2002; Fecteau et al., 2007; Rao et al., 2008). Furthermore, many neuroimaging experiments must comply with time and instrumental limitations, utilizing fewer trials in event-related designs. We selected a range of combinations of K and T to allow a comprehensive examination of the effect of double sources of stochasticity in the BART. Thus, K was tuned to have the values [6 10 16 24 48]. At the same time, the number of trials was varied systematically to investigate both scenarios with time limitations (e.g., neuroimaging studies or experiments with time limitations in general) and less coerced procedures (e.g., behavioral studies). Expressly, with a low number of inflations (K = 6, K = 10, K = 16), the total number of trials T was set to 48. Instead, with a high number of inflations (K = 24, K = 48), T was set to 150. We did not expect the number of subjects N to impact errors particularly. However, given the importance of combining trial number and sample size in neuroscience (Nichols et al., 2017; Chen et al., 2022), we investigated variable sample sizes in the current study, ranging from 20 to 100 virtual subjects [20, 50, 100]. Finally, we investigated two levels of noise in the virtual subjects: in the low-noise condition, each individual decision of the decision matrix was distorted by adding a random number in the range [−0.1 0.1]; instead, in the high-noise condition, each individual decision of the decision matrix was distorted by adding a random number in the range [−0.4 0.4].

Non-stochastic BART

In the standard, stochastic BART (s-BART), each time the virtual participant attempted to inflate the balloon, it alternatively exploded or not depending on a random number. Instead, in the deterministic BART (d-BART), balloons were programmed to explode from a particular inflation event without the need for further unavoidable randomizations. In the d-BART, when the virtual subject attempted inflating the balloon (i.e., when the kth-by-tth element of the decision matrix was “try inflating”), it deterministically exploded or not based on the maximum number of inflations allowed for that balloon: if the max number of inflations was exceeded, then the balloon exploded; if not, then the trial continued to the next inflation event. We also implemented this d-BART in the simulations since it may be presumed that avoiding the second source of stochasticity may improve the estimation of risk-taking profiles.

Statistics

Reconstructed profiles were averaged and plotted separately for each parametrization. The performance was assessed using linear mixed-effects regression models. The dependent variable was the estimation error (the difference between the real risk-taking profile and the reconstructed profile). Fixed effects were added for the factor threshold (three levels: 50, 75, and 100%) and the factor function (three levels: linear, exponential, and logarithmic). Random intercepts were added for each virtual subject, and random intercepts and slopes were added concerning the grouping factor inflation (e.g., for the analysis of a simulation with 10 inflation events, the grouping factor inflation had 10 levels). Thus, the model was in the Wilkinson form “error ~ threshold * function + (1|subject) + (threshold + function|inflation).” Secondly, we compared the best combination of threshold & function from the s-BART with the d-BART. The linear mixed-effects models were applied independently for each combination of trials, inflations, and noise levels. Linear contrasts within the model were used to directly compare appropriate levels of the fixed factors.

Results

We ran each simulation scenario (i.e., each unique combination of parameters) 100 times separately for low and high noise levels. After each cycle, original risk-taking profiles were reconstructed for each virtual subject using each combination of parameters for modeling explosions (linear increase with 100% maximum threshold, linear increase with 75% maximum threshold, linear increase with 50% maximum threshold, exponential increase with 100% maximum threshold, exponential increase with 75% maximum threshold, exponential increase with 50% maximum threshold, logarithmic increase with 100% maximum threshold, logarithmic increase with 75% maximum threshold, logarithmic increase with 50% maximum threshold, deterministic BART).

Figure 2A shows the performance of different parameter combinations with low levels of noise. The fixed factors and the interaction were significant in almost every situation, indicating an effect of both threshold and function used to model balloon explosion on the error in estimating original risk-taking profiles. More specifically, with six maximum inflations (K = 6), we found a trend for threshold (pTHR = 0.07), a non-significant effect for function (pFUN = 0.49), and a significant interaction threshold-by-function (pINT < 0.001). With higher K values, these effects were always significant (K = 10: pTHR < 0.001, pFUN = 0.04, pINT < 0.001; K = 16: pTHR < 0.001, pFUN = 0.004, pINT < 0.001; K = 24: pTHR < 0.001, pFUN < 0.001, pINT < 0.001; K = 48: pTHR < 0.001, pFUN < 0.001, pINT < 0.001). Linear contrasts of interest for the effects of interest are reported in Table 1 (center columns). The performance of different parameter combinations with high levels of noise are shown in Figure 2B. Also in this case, the fixed factors and the interaction effects were significant. More specifically, with six maximum inflations (K = 6), we found a significant effect of threshold (pTHR = 0.03), a non-significant effect for function (pFUN = 0.47), and a significant interaction threshold-by-function (pINT < 0.001). With 10 maximum inflations (K = 10), we found a trend for threshold (pTHR < 0.001), a trend for function (pFUN = 0.05), and a significant interaction threshold-by-function (pINT < 0.001). With higher Ks, effects were always significant (K = 16: pTHR < 0.001, pFUN = 0.03, pINT < 0.001; K = 24: pTHR < 0.001, pFUN < 0.001, pINT < 0.001; K = 48: pTHR < 0.001, pFUN < 0.001, pINT < 0.001). Linear contrasts of interest for the effects of interest are reported in Table 1 (right columns).

FIGURE 2
www.frontiersin.org

Figure 2. Estimation errors of the stochastic version of the Balloon Analog Risk Task (BART) implemented in the simulations. The three functions used to model explosion probabilities in consecutive inflations are coded by colors (linear, exponential, and logarithmic). The three thresholds indicating maximum explosion probabilities are coded by the marker and line type (only 50 and 100% thresholds are shown to improve readability). (A) Results with low noise levels in the virtual participants’ decisions. (B) Results with high noise levels in the virtual participants’ decisions. Legend: ***p < 0.001; **p < 0.01; *p < 0.05.

TABLE 1
www.frontiersin.org

Table 1. Direct contrasts showing the accuracy increase when using lower thresholds and exponential functions.

Results related to the comparison of the s-BART versus d-BART are shown in Figure 3A (low noise levels) and 3B (high noise levels). For simplicity, we reported the comparison between the best s-BART model (i.e., 50% threshold and exponential explosion probability) and the d-BART model. Although the differences are smaller than in the previous models, it can be observed that the s-BART slightly outperforms the d-BART. With K = 6, the effect was not significant neither with low (p = 0.12) or high noise (p = 0.06). Instead, with higher number of inflations, the stochastic exponential and low threshold (50%) BART always outperformed the deterministic BART with both low noise levels (K = 10: p = 0.006; K = 16: p < 0.001; K = 24: p < 0.001; K = 48: p = 0.002) and high noise levels (K = 10: p = 0.002; K = 16: p = 0.001; K = 24: p < 0.001; K = 48: p = 0.009).

FIGURE 3
www.frontiersin.org

Figure 3. Estimation errors of the stochastic versus deterministic Balloon Analog Risk Task (BART) implemented in the simulations. With respect to stochastic BART, only results relative to explosions modeled with exponential function and 50% threshold are shown for comparison. (A) Results with low noise levels in the virtual participants’ decisions. (B) Results with high noise levels in the virtual participants’ decisions. Legend: ***p < 0.001; **p < 0.01; *p < 0.05.

These results demonstrate that both the threshold and the function used to model stochastic explosions in the BART affect the performance in approximating original risk-taking profiles, independently on the noise level, maximum number of inflation events, and number of trials. Moreover, a crucial effect of the noise levels on the risk-taking profile estimation is appreciable: higher noise levels impact the approximation of information relative to the risk-taking profiles in earlier inflation events (first half), while the difference between high-noise and low-noise simulations is reduced in later inflations (second half). Finally, we show that the stochastic (standard) modeling of explosion probabilities is better than the deterministic modeling. The results reported here entail simulations with players’ virtual risk-taking profiles modeled using monotonically decreasing functions generated using random numbers, with N = 50. However, such effects are equivalent when varying the number of players (N = 20 and N = 100) and using monotonically decreasing functions with an exponential decrease to model virtual players’ risk-taking profiles.

Discussion

Our study investigates a theoretical-methodological issue in one of the most frequently employed psychometric instruments to assess the risk propensity of individuals: the Balloon Analog Risk Task (Lejuez et al., 2002). We investigated the relationship between forms of stochasticity and expected psychometric measurements in experiments involving the BART. Two types of stochasticity coexist in this task: the first one reflects an informative variability related to individual uncertainty and noise (De Groot and Thurik, 2018; De Groot, 2020; Yakobi and Danckert, 2021); the second one arises when the experimental design is not appropriately controlled and theoretically does not convey any helpful information on risk-taking profiles.

We demonstrate that controlling the stochastic trial parametrization in the BART leads to a better approximation of the original risk-taking profiles. We show that using exponential functions to model explosion probabilities reduces estimation errors up to 9–10% for the original virtual risk-taking profiles. Moreover, using lower thresholds (maximum probability of explosions) reduces estimation errors up to 4–5%. Interaction effects in our models demonstrate that lower maximum thresholds of explosion probabilities (50 and 75%) combined with exponential functions for modeling stochastic explosions are the best combination to allow an efficient estimation of true risk-taking profiles. These results are consistent across many prior profiles (virtual participants) and across noise levels in the dataset. Finally, we demonstrate that the optimized version of the stochastic BART (s-BART) has a slightly better performance than the non-stochastic, deterministic BART (d-BART) although only the d-BART allows the complete control of the trial structure.

Given our findings, we recommend designing BART experiments to maximize the valuable information gathered from participants. A good choice would be to use a deterministic version of the BART with a maximum number of inflations between 10 and 16 or, alternatively, a stochastic version of the BART in which explosion probabilities are modeled using an exponential function ranging from 0 (first inflation) to 50% or 75%. This would allow gathering a sufficient number of trials even with a short administration (e.g., 10 min). Employing a version of the BART in which more inflation events are allowed (more than 20 inflations) may be helpful for a fine-grained resolution of risk-taking profiles only if there are enough trials (and time).

Suboptimal designs may have biased the approximation of individual risk-taking behavior in previous studies (see also Kılıç et al., 2020; Yakobi and Danckert, 2021), as some studies already suggested (Bishara et al., 2009; Purcell et al., 2017; De Groot and Thurik, 2018; Canning et al., 2022). For example, Maner et al. (2007) reported effects of anxiety on risk-taking, while a later study did not find such association (Buelow and Barnhart, 2017). King et al. (2014) reviewed the associations between impulsivity and alcohol consumption and observed discrepancies among studies that involved the BART. Some studies showed the BART to predict impulsivity related to alcohol abuse (Fernie et al., 2010; Rose et al., 2014) or to be unrelated with impulsivity (Skeel et al., 2008; Rieser et al., 2019). Moreover, DeMartini et al. (2014) found BART scores to correlate positively with the quantity of alcohol consumption but negatively with the frequency of alcohol consumption, while Ashenhurst et al. (2011) found that higher BART scores negatively correlate with alcohol-related symptoms but are unrelated to alcohol use. The literature about risky decision-making in clinical conditions is hard to interpret considering associations with BART scores: whereas some studies reported abnormal behavioral BART scores in people with schizophrenia (Dominguez, 2011; Reddy et al., 2014; Brown et al., 2015; Boka et al., 2020), other studies did not reproduce such results (Fischer et al., 2015; Tikàsz et al., 2019; Luk et al., 2021). At the same time, studies demonstrated both positive (Reddy et al., 2014) and negative (Dominguez, 2011) associations with symptom severity, while another study did not find associations (Cheng et al., 2012).

A limitation of the present study is that we did not simulate the influence of expected return on the risk-taking dynamics, so that we were not able to include losses versus zero-gain in case of balloon explosions (Schonberg et al., 2011; De Groot and Thurik, 2018; De Groot, 2020; Canning et al., 2022). In other words, our results can be interpreted as stemming from individuals with no differences regarding the impact of the expected win on risk-taking behavior. More in general, a simulation scenario like ours does not efficiently incorporate subjective priors and their eventual modification throughout the execution of the task. However, our results indicate that exponential functions and lower thresholds for balloon explosion provide a better estimation of behavioral profiles. This effect is presumably independent of the effect of expected values on behavior. Thus, our findings likely hold as demonstrated by our investigation of multiple simulated risk-taking profiles. It is also helpful to mention that the non-stochastic d-BART implies a more stringent selection of the number of trials compared to the s-BART. When selecting the number of trials (T) for the d-BART, T must always be a product of the maximum number of inflations. For example, with eight maximum inflation events, the total number of trials is 64, with each class of explosion repeated six times (8*6 = 64).

Since researchers can manipulate numerous facets of each experimental paradigm, even simple experimental procedures may have infinite applicative variants. However, choosing the proper experimental parameters is not always straightforward and intuitive. Researchers in all disciplines, including cognitive scientists, psychologists, and neuroscientists, should confidently select the most appropriate and unbiased experimental settings to generate reliable data and consequently make rational and safe claims (Schonberg et al., 2011; Bajracharya and Duboz, 2013; Donkin et al., 2017; Fitzpatrick, 2019; Chen et al., 2022). Our findings show how to optimize the reconstruction of original risk-taking profiles by allowing the extraction of the optimal amount of information through the administration of the BART. According to our findings, we suggest to model explosion probabilities using exponential monotonic increases and using a threshold (maximum explosion probability) between 50 and 75%. By limiting stochasticity unrelated with subject-specific information, our findings are particularly meaningful for the implementation of the BART in neuroimaging studies and for the investigation of clinical and subclinical phenotypes. Future clinical research will benefit from the improvement of this psychometric instrument for detecting aberrant decision-making processes, thus allowing to accurately monitor the efficacy of treatment targeting the pathophysiology of risky behaviors (Pettorruso et al., 2021). The accurate extraction of neurocognitive profiles will hopefully help guide clinicians in the selection of more personalized interventions. Researchers interested in applying this psychometric instrument to study risky behavior in both healthy and clinical population will greatly benefit from this design.

Data Availability Statement

The original contributions presented in the study are included in the article/supplementary material; further inquiries can be directed to the corresponding author.

Author Contributions

SD contributed to conception and design of the study, performed the statistical analysis, and wrote the first draft of the manuscript. SE supervised the study. All authors contributed to manuscript revision, read, and approved the submitted version.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

Ashenhurst, J. R., Jentsch, J. D., and Ray, L. A. (2011). Risk-taking and alcohol use disorders symptomatology in a sample of problem drinkers. Exp. Clin. Psychopharmacol. 19, 361–370. doi: 10.1037/a0024412

PubMed Abstract | CrossRef Full Text | Google Scholar

Bajracharya, K., and Duboz, R. (2013). “Comparison of three agent-based platforms on the basis of a simple epidemiological model (WIP).” in Proceedings of the symposium on theory of modeling and simulation—DEVS integrative M&S symposium, 6–11.

Google Scholar

Bishara, A. J., Pleskac, T. J., Fridberg, D. J., Yechiam, E., Lucas, J., Busemeyer, J. R., et al. (2009). Similar processes despite divergent behavior in two commonly used measures of risky decision making. J. Behav. Decis. Mak. 22, 435–454. doi: 10.1002/bdm.641

PubMed Abstract | CrossRef Full Text | Google Scholar

Boka, E., Del Pozzo, J., Goetz, D., Remsen, B., Walsh-Messinger, J., Getz, M., et al. (2020). Ineffective risk-reward learning in schizophrenia. Psychiatry Res. 293:113370. doi: 10.1016/j.psychres.2020.113370

PubMed Abstract | CrossRef Full Text | Google Scholar

Bornovalova, M. A., Geadz, M. A., Kahler, C., Aklin, W. M., and Lejuez, C. M. (2008). Sensation seeking and risk-taking propensity as mediators in the relationship between childhood abuse and HIV-related risk behavior. Child Abuse Negl. 32, 99–109. doi: 10.1016/j.chiabu.2007.04.009

PubMed Abstract | CrossRef Full Text | Google Scholar

Brown, E. C., Hck, S. M., Gold, J. M., Carpenter, W. T., Fischer, B. A., Prentice, K. P., et al. (2015). Integrating frequency and magnitude information in decision-making in schizophrenia: An account of patient performance on the Iowa gambling task. J. Psychiatr. Res. 66–67, 16–23. doi: 10.1016/j.jpsychires.2015.04.007

PubMed Abstract | CrossRef Full Text | Google Scholar

Buelow, M. T., and Barnhart, W. R. (2017). The influence of math anxiety, math performance, worry, and test anxiety on the Iowa gambling task and balloon analogue risk task. Assessment 24, 127–137. doi: 10.1177/1073191115602554

PubMed Abstract | CrossRef Full Text | Google Scholar

Canning, J. R., Schallert, M. R., and Larimer, M. E. (2022). A systematic review of the balloon analogue risk task (BART) in alcohol research. Alcohol Alcohol. 57, 85–103. doi: 10.1093/alcalc/agab004

PubMed Abstract | CrossRef Full Text | Google Scholar

Cazzell, M., Li, L., Lin, Z.-J., Patel, S. J., and Liu, H. (2012). Comparison of neural correlates of risk decision making between genders: an exploratory fNIRS study of the balloon analogue risk task (BART). NeuroImage 62, 1896–1911. doi: 10.1016/j.neuroimage.2012.05.030

PubMed Abstract | CrossRef Full Text | Google Scholar

Chen, G., Pine, D. S., Brotman, M. A., Smith, A. R., Cox, R. W., Taylor, P. A., et al. (2022). Hyperbolic trade-off: the importance of balancing trial and subject sample sizes in neuroimaging. NeuroImage 247:118786. doi: 10.1016/j.neuroimage.2021.118786

PubMed Abstract | CrossRef Full Text | Google Scholar

Cheng, G. L. F., Tang, J. C. Y., Li, F. W. S., Lau, E. Y. Y., and Lee, T. M. C. (2012). Schizophrenia and risk-taking: impaired reward but preserved punishment processing. Schizophr. Res. 136, 122–127. doi: 10.1016/j.schres.2012.01.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Congdon, E., Bato, A. A., Schonberg, T., Mumford, J. A., Karlsgodt, K. H., Sabb, F. W., et al. (2013). Differences in neural activation as a function of risk-taking task parameters. Front. Neurosci. 7:173. doi: 10.3389/fnins.2013.00173

PubMed Abstract | CrossRef Full Text | Google Scholar

Coon, J., and Lee, M. D. (2021). A Bayesian method for measuring risk propensity in the Balloon Analogue Risk Task. Behav. Res. Methods 54, 1010–1026. doi: 10.3758/s13428-021-01634-1

CrossRef Full Text | Google Scholar

De Groot, K. (2020). Burst beliefs – methodological problems in the balloon analogue risk task and implications for its use. J. Trial Error 1, 1–10. doi: 10.36850/mr1

CrossRef Full Text | Google Scholar

De Groot, K., and Strien, J. W. (2019). Event-related potentials in response to feedback following risk-taking in the hot version of the Columbia card task. Psychophysiology 56:e13390. doi: 10.1111/psyp.13390

PubMed Abstract | CrossRef Full Text | Google Scholar

De Groot, K., and Thurik, R. (2018). Disentangling risk and uncertainty: when risk-taking measures are not About risk. Front. Psychol. 9:2194. doi: 10.3389/fpsyg.2018.02194

PubMed Abstract | CrossRef Full Text | Google Scholar

Dean, A. C., Sugar, C. A., Hellemann, G., and London, E. D. (2011). Is all risk bad? Young adult cigarette smokers fail to take adaptive risk in a laboratory decision-making test. Psychopharmacology 215, 801–811. doi: 10.1007/s00213-011-2182-y

PubMed Abstract | CrossRef Full Text | Google Scholar

DeMartini, K. S., Leeman, R. F., Corbin, W. R., Toll, B. A., Fucito, L. M., Lejuez, C. W., et al. (2014). A new look at risk-taking: using a translational approach to examine risk-taking behavior on the balloon analogue risk task. Exp. Clin. Psychopharmacol. 22, 444–452. doi: 10.1037/a0037421

PubMed Abstract | CrossRef Full Text | Google Scholar

Dominguez, D. G. (2011). The relationship between risk-taking, substance abuse and aggression in Schizophrenia. doctoral dissertation. Barnard College.

Google Scholar

Donkin, E., Dennis, P., Ustalakov, A., Warren, J., and Clare, A. (2017). Replicating complex agent based models, a formidable task. Environ. Model Softw. 92, 142–151. doi: 10.1016/j.envsoft.2017.01.020

CrossRef Full Text | Google Scholar

Fecteau, S., Pascual-Leone, A., Zald, D. H., Liguori, P., Théoret, H., Boggio, P. S., et al. (2007). Activation of prefrontal cortex by transcranial direct current stimulation reduces appetite for risk during ambiguous decision making. J. Neurosci. 27, 6212–6218. doi: 10.1523/JNEUROSCI.0314-07.2007

PubMed Abstract | CrossRef Full Text | Google Scholar

Fernie, G., Cole, J. C., Goudie, A. J., and Field, M. (2010). Risk-taking but not response inhibition or delay discounting predict alcohol consumption in social drinkers. Drug Alcohol Depend. 112, 54–61. doi: 10.1016/j.drugalcdep.2010.05.011

PubMed Abstract | CrossRef Full Text | Google Scholar

Fischer, B. A., McMahon, R. P., Kelly, D. L., Wehring, H. J., Meyer, W. A., Feldman, S., et al. (2015). Risk-taking in schizophrenia and controls with and without cannabis dependence. Schizophr. Res. 161, 471–477. doi: 10.1016/j.schres.2014.11.009

PubMed Abstract | CrossRef Full Text | Google Scholar

Fitzpatrick, B. G. (2019). Issues in reproducible simulation research. Bull. Math. Biol. 81, 1–6. doi: 10.1007/s11538-018-0496-1

PubMed Abstract | CrossRef Full Text | Google Scholar

Guenther, B., Galizzi, M. M., and Sanders, J. G. (2021). Heterogeneity in risk-taking During the COVID-19 pandemic: evidence from the UK lockdown. Front. Psychol. 12:643653. doi: 10.3389/fpsyg.2021.643653

PubMed Abstract | CrossRef Full Text | Google Scholar

Guo, H., Zhang, Z., Da, S., Sheng, X., and Zhang, X. (2018). High-definition transcranial direct current stimulation (HD-tDCS) of left dorsolateral prefrontal cortex affects performance in balloon analogue risk task (BART). Brain Behav. 8:e00884. doi: 10.1002/brb3.884

PubMed Abstract | CrossRef Full Text | Google Scholar

Hanson, K. L., Thayer, R. E., and Tapert, S. F. (2014). Adolescent marijuana users have elevated risk-taking on the balloon analog risk task. J. Psychopharmacol. 28, 1080–1087. doi: 10.1177/0269881114550352

PubMed Abstract | CrossRef Full Text | Google Scholar

Helfinstein, S. M., Schonberg, T., Congdon, E., Karlsgodt, K. H., Mumford, J. A., Sabb, F. W., et al. (2014). Predicting risky choices from brain activity patterns. Proc. Natl. Acad. Sci. U. S. A. 111, 2470–2475. doi: 10.1073/pnas.1321728111

PubMed Abstract | CrossRef Full Text | Google Scholar

Holt, D. D., Green, L., and Myerson, J. (2003). Is discounting impulsive? Evidence from temporal and probability discounting in gambling and non-gambling college students. Behav. Process. 64, 355–367. doi: 10.1016/S0376-6357(03)00141-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Hopko, D. R., Lejuez, C. W., Daughters, S. B., Aklin, W. M., Osborne, A., Simmons, B. L., et al. (2006). Construct validity of the balloon analogue risk task (BART): relationship with MDMA use by inner-city drug users in residential treatment. J. Psychopathol. Behav. Assess. 28, 95–101. doi: 10.1007/s10862-006-7487-5

CrossRef Full Text | Google Scholar

Hunt, M. K., Hopko, D. R., Bare, R., Lejuez, C. W., and Robinson, E. V. (2005). Construct validity of the balloon analog risk task (BART): associations with psychopathy and impulsivity. Assessment 12, 416–428. doi: 10.1177/1073191105278740

PubMed Abstract | CrossRef Full Text | Google Scholar

Isles, A. R., Winstanley, C. A., and Humby, T. (2019). Risk taking and impulsive behaviour: fundamental discoveries, theoretical perspectives and clinical implications. Philos. Trans. R. Soc. B 374:20180128. doi: 10.1098/rstb.2018.0128

PubMed Abstract | CrossRef Full Text | Google Scholar

Kılıç, A., van Tilburg, W. A. P., and Igou, E. R. (2020). Risk-taking increases under boredom. J. Behav. Decis. Mak. 33, 257–269. doi: 10.1002/bdm.2160

CrossRef Full Text | Google Scholar

King, K. M., Patock-Peckam, J. A., Dager, A. D., Thimm, K., and Gates, J. R. (2014). On the mismeasurement of impulsivity: trait, behavioral, and neural models in alcohol research among adolescents and young adults. Alcohol 1, 19–32. doi: 10.1007/s40429-013-0005-4

CrossRef Full Text | Google Scholar

Lawyer, S. R. (2013). Risk taking for sexual versus monetary outcomes using the balloon analogue risk task. Psychol. Rec. 63, 803–820. doi: 10.11133/j.tpr.2013.63.4.007

CrossRef Full Text | Google Scholar

Leigh, B. C. (1999). Peril, chance, and adventure: concepts of risk, alcohol use and risky behavior in young adults. Addiction 94, 371–383. doi: 10.1046/j.1360-0443.1999.9433717.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Lejuez, C. W., Aklin, W., Bornovalova, M., and Moolchan, E. (2005). Differences in risk-taking propensity across inner-city adolescent ever- and never-smokers. Nicotine Tob. Res. 7, 71–79. doi: 10.1080/14622200412331328484

PubMed Abstract | CrossRef Full Text | Google Scholar

Lejuez, C. W., Aklin, W. M., Jones, H. A., Richards, J. B., Strong, D. R., Kahler, C. W., et al. (2003). The balloon analogue risk task (BART) differentiates smokers and nonsmokers. Exp. Clin. Psychopharmacol. 11, 26–33. doi: 10.1037/1064-1297.11.1.26

PubMed Abstract | CrossRef Full Text | Google Scholar

Lejuez, C. W., Read, J. P., Whaler, C. W., Richards, J. B., Ramsey, S. E., Stuart, G. L., et al. (2002). Evaluation of a behavioral measure of risk taking: the balloon analogue risk task (BART). J. Exp. Psychol. Appl. 8, 75–84. doi: 10.1037/1076-898X.8.2.75

PubMed Abstract | CrossRef Full Text | Google Scholar

Lejuez, C. W., Simmons, B. L., Aklin, W. M., Daughters, S. B., and Dvir, S. (2004). Risk-taking propensity and risky sexual behavior of individuals in residential substance use treatment. Addict. Behav. 29, 1643–1647. doi: 10.1016/j.addbeh.2004.02.035

PubMed Abstract | CrossRef Full Text | Google Scholar

Lenhard, A., Lenhard, W., and Gary, S. (2019). Continuous norming of psychometric tests: a simulation study of parametric and semi-parametric approaches. PLoS One 14:e0222279. doi: 10.1371/journal.pone.0222279

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, X., Pan, Y., Fang, Z., Lei, H., Zhang, X., Shi, H., et al. (2020). Test-retest reliability of brain responses to risk-taking during the balloon analogue risk task. NeuroImage 209:116495. doi: 10.1016/j.neuroimage.2019.116495

PubMed Abstract | CrossRef Full Text | Google Scholar

Long, E. C., Kaneva, R., Vasilev, G., Moeller, F. G., and Vassileva, J. (2020). Neurocognitive and psychiatric markers for addiction: common vs. specific endophenotypes for heroin and amphetamine dependence. Curr. Top. Med. Chem. 20, 585–597. doi: 10.2174/1568026620666200131124608

PubMed Abstract | CrossRef Full Text | Google Scholar

Luk, M. S. K., Chang, W. C., Chong, C. S. Y., Siu, C. M. W., Chan, S. K. W., Lee, E. M. H., et al. (2021). Altered risky decision making in patients with early non-affective psychosis. Eur. Arch. Psychiatry Clin. Neurosci. 271, 723–731. doi: 10.1007/s00406-019-00994-2

PubMed Abstract | CrossRef Full Text | Google Scholar

Maner, J. K., Richey, A., Cromer, K., Mallott, M., Lejuez, C. W., and Schmidt, N. B. (2007). Dispositional anxiety and risk-avoidant decision-making. Personal. Individ. Differ. 42, 665–675. doi: 10.1016/j.paid.2006.08.016

CrossRef Full Text | Google Scholar

Mishra, S., Lalumière, M. L., and Williams, R. J. (2017). Gambling, risk-taking, and antisocial behavior: a replication study supporting the generality of deviance. J. Gambl. Stud. 33, 15–36. doi: 10.1007/s10899-016-9608-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Nichols, T., Das, S., Eickoff, S. B., Evans, A. C., Glatard, T., Hanke, M., et al. (2017). Best practices in data analysis and sharing in neuroimaging using MRI. Nat. Neurosci. 20, 299–303. doi: 10.1038/nn.4500

PubMed Abstract | CrossRef Full Text | Google Scholar

Pettorruso, M., Miuli, A., Di Natale, C., Montemitro, C., Zoratto, F., De Rision, L., et al. (2021). Non-invasive brain stimulation targets and approaches to modulate gamblbing-related decisions: a systematic review. Addict. Behav. 112:106657. doi: 10.1016/j.addbeh.2020.106657

PubMed Abstract | CrossRef Full Text | Google Scholar

Purcell, J. R., Herms, E. N., Morales, J., Hetrick, W. P., Wisner, K. M., and Browkn, J. W. (2017). A review of risky decision-making in psychosis-spectrum disorders. Clin. Psychol. Rev. 91:102112. doi: 10.1016/j.cpr.2021.102112

PubMed Abstract | CrossRef Full Text | Google Scholar

Rao, H., Korczykowski, M., Pluta, J., Hoang, A., and Detre, J. A. (2008). Neural correlates of voluntary and involuntary risk taking in the human brain: an fMRI study of the balloon analog risk task (BART). NeuroImage 42, 902–910. doi: 10.1016/j.neuroimage.2008.05.046

PubMed Abstract | CrossRef Full Text | Google Scholar

Reddy, L. F., Lee, J., Davis, M. C., Altshuler, L., Glahn, D. C., Miklowitz, D. J., et al. (2014). Impulsivity and risk taking in bipolar disorder and schizophrenia. Neuropsychopharmacology 39, 456–463. doi: 10.1038/npp.2013.218

PubMed Abstract | CrossRef Full Text | Google Scholar

Rieser, N. M., Shaul, L., Blankers, M., Koeter, M. W. J., Schippers, G. M., and Goudriaan, A. M. (2019). The predictive value of impulsivity and risk-taking measures for substance use in substance dependent offenders. Front. Behav. Neurosci. 13:192. doi: 10.3389/fnbeh.2019.00192

PubMed Abstract | CrossRef Full Text | Google Scholar

Robbins, T. W., Gillan, C. M., Smith, D. G., de Wit, S., and Ersche, T. D. (2012). Neurocognitive endophenotypes of impulsivity and compulsivity: towards dimensional psychiatry. Trends Cogn. Sci. 16, 81–91. doi: 10.1016/j.tics.2011.11.009

PubMed Abstract | CrossRef Full Text | Google Scholar

Rose, A. K., Jones, A., Clarke, N., and Christiansen, P. (2014). Alcohol-induced risk taking on the BART mediates alcohol priming. Psychopharmacology 231, 2273–2280. doi: 10.1007/s00213-013-3377-1

PubMed Abstract | CrossRef Full Text | Google Scholar

Schmitz, F., Manske, K., Preckel, F., and Wilhelm, O. (2016). The multiple faces of risk-taking: scoring alternatives for the balloon-analogue risk task. Eur. J. Psychol. Assess. 32, 17–38. doi: 10.1027/1015-5759/a000335

CrossRef Full Text | Google Scholar

Schonberg, T., Fox, C., and Poldrack, R. A. (2011). Mind the gap: bridging economic and naturalistic risk-taking with cognitive neuroscience. Trends Cogn. Sci. 15, 11–19. doi: 10.1016/j.tics.2010.10.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Sela, T., Kilim, A., and Lavidor, M. (2012). Transcranial alternating current stimulation increases risk-taking behavior in the balloon analog risk task. Front. Neurosci. 6, 1–11. doi: 10.3389/fnins.2012.00022

PubMed Abstract | CrossRef Full Text | Google Scholar

Skeel, R. L., Pilarski, C., Pytlak, K., and Neudecker, J. (2008). Personality and performance-based measures in the prediction of alcohol use. Psychol. Addict. Behav. 22, 402–409. doi: 10.1037/0893-164X.22.3.402

PubMed Abstract | CrossRef Full Text | Google Scholar

Steiner, M. D., and Frey, R. (2022). Representative design in psychological assessment: a case study using the balloon analogue risk task (BART). J. Exp. Psychol. Gen. 150, 2117–2136. doi: 10.1037/xge0001036

PubMed Abstract | CrossRef Full Text | Google Scholar

Swogger, M. T., Walsh, Z., Lejuez, C. W., and Kosson, D. S. (2010). Psychopathy and risk taking among jailed inmates. Crim. Justice Behav. 37, 439–452. doi: 10.1177/0093854810361617

PubMed Abstract | CrossRef Full Text | Google Scholar

Tikàsz, A., Dumais, A., Lipp, O., Stip, E., Lalonde, P., Laurelli, M., et al. (2019). Reward-related decision-making in schizophrenia: a multimodal neuroimaging study. Psychiatry Res. Neuroimaging 286, 45–52. doi: 10.1016/j.pscychresns.2019.03.007

PubMed Abstract | CrossRef Full Text | Google Scholar

Tonini, E., Quidé, Y., Kaur, M., Whitford, T. J., and Green, M. J. (2021). Structural and functional neural correlates of schizotypy: a systematic review. Psychol. Bull. 147, 828–866. doi: 10.1037/bul0000260

PubMed Abstract | CrossRef Full Text | Google Scholar

Turner, C., McClure, R., and Pirozzo, S. (2004). Injury and risk-taking behavior: a systematic review. Accid. Anal. Prev. 36, 93–101. doi: 10.1016/S0001-4575(02)00131-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Vassilva, J., and Conrod, P. J. (2019). Impulsivities and addictions: a multidimensional integrative framework informing assessment and interventions for substance use disorders. Philos. Trans. R. Soc. B 374:20180137. doi: 10.1098/rstb.2018.0137

PubMed Abstract | CrossRef Full Text | Google Scholar

Weafer, J., Milich, R., and Fillmore, M. T. (2011). Behavioral components of impulsivity predict alcohol consumption in adults with ADHD and healthy controls. Drug Alcohol Depend. 113, 139–146. doi: 10.1016/j.drugalcdep.2010.07.027

PubMed Abstract | CrossRef Full Text | Google Scholar

White, T. L., Lejuez, C. W., and de Wit, H. (2008). Test-retest characteristics of the balloon analogue risk-task (BART). Exp. Clin. Psychopharmacol. 16, 565–570. doi: 10.1037/a0014083

PubMed Abstract | CrossRef Full Text | Google Scholar

Xu, S., Pan, Y., Wang, Y., Spaeth, A. M., Qu, Z., and Rao, H. (2016). Real and hypothetical monetary rewards modulate risk taking in the brain. Sci. Rep. 6:29520. doi: 10.1038/srep29520

PubMed Abstract | CrossRef Full Text | Google Scholar

Yakobi, O., and Danckert, J. (2021). Boredom proneness is associated with noisy decision-making, not risk-taking. Exp. Brain Res. 239, 1807–1825. doi: 10.1007/s00221-021-06098-5

PubMed Abstract | CrossRef Full Text | Google Scholar

Zickar, M. J. (2020). Measurement development and evaluation. Annu. Rev. Organ. Psych. Organ. Behav. 7, 213–232. doi: 10.1146/annurev-orgpsych-012119-044957

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: BART, psychometrics, task optimization, risk-taking, computational neuroscience, stochasticity

Citation: Di Plinio S, Pettorruso M and Ebisch SJH (2022) Appropriately Tuning Stochastic-Psychometric Properties of the Balloon Analog Risk Task. Front. Psychol. 13:881179. doi: 10.3389/fpsyg.2022.881179

Received: 22 February 2022; Accepted: 22 April 2022;
Published: 10 May 2022.

Edited by:

Henry W. Chase, University of Pittsburgh, United States

Reviewed by:

Sara Garofalo, University of Bologna, Italy
Lucas Keller, University of Konstanz, Germany

Copyright © 2022 Di Plinio, Pettorruso and Ebisch. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Simone Di Plinio, simone.diplinio@unich.it

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.