Christian Rominger*
Andreas Fink
Mathias Benedek
Bernhard Weber
Corinna M. Perchtold-Stefan
Andreas R. Schwerdtfeger
- Department of Psychology, University of Graz, Graz, Austria
Psychometrically sound instruments that assess temporal dynamics of creative abilities are limited. The Ambulatory Battery of Creativity (ABC) is designed to assess creative ideation performance multiple times in everyday life and was proven to capture the intra-individual dynamic of creative abilities reliably and validly. The present ambulatory study aimed to replicate and extend the psychometric evidence of the novel ABC. Sixty-nine participants worked on the ABC during a 5-day ambulatory assessment protocol. Each day, participants completed six randomly presented items of the verbal and the figural ABC. Matching previous psychometric analyses, the results indicated good between-person (≥0.80) and good within-person (≥0.72) reliability. Furthermore, evidence for between-person and within-person validity of the ABC was obtained. Performance in the verbal and the figural ABC were interrelated and correlated with an independent measure of creative potential. The verbal ABC was further associated with openness, self-reported creative behavior, creative activities, and creative achievements, thus providing additional evidence of construct validity, especially for the verbal ABC. Finally, the verbal and the figural ABC yielded convincing within-person validity: Longer response times and higher subjective originality ratings were associated with more original ideas. This replication and extension of the ABC’s psychometric properties indicates that it enables a reliable and valid assessment of moment-to-moment fluctuations of creative ideation abilities in everyday life, which may facilitate the investigation of exciting new research questions related to dynamic aspects of creative ability.
Introduction
Creative potential is the skill of a person to produce novel and useful ideas (Dietrich, 2004; Runco and Jaeger, 2012; Benedek et al., 2014). Creativity research typically aims to assess participants’ creative potential during a single appointment, mostly in the laboratories, and sometimes in less controlled settings. This approach aims to control for situational and contextual influences by keeping them as stable as possible. The reduction of situational (error-) variance is thought to increase the measurement accuracy of people’s creative abilities (Guilford, 1950). However, this valuable and fruitful approach has one prominent pitfall. It misses the chance to assess the temporal dynamics and within-person variation of creative ideation abilities, which constitute important and meaningful aspects of creativity (Barbot, in press; Corazza et al., in press; Rominger et al., in pressa). In line with this, neuroscientific research indicated that meaningful within-person brain dynamics are linked with creative ideation performance (Schwab et al., 2014; Beaty et al., 2016; Rominger et al., 2019b,2020b,in pressc; Agnoli et al., 2020). However, the comparatively low number of studies on intra-individual dynamics of creative abilities might be due to the absence of proper psychometric methods, which would allow a reliable assessment of meaningful fluctuations in creative ideation performance (but see e.g., serial order effect in idea generation; Beaty and Silvia, 2012). This seems even more pronounced, when creativity researchers target to assess creative ideation performance in people’s everyday life (Rominger et al., in pressa).
The Ambulatory Battery of Creativity (ABC) measures creative abilities and their fluctuations in everyday life contexts by a repeated application of divergent thinking task items (Rominger et al., in pressb). The battery consists of a verbal and a figural version embedded in a signal-contingent ecological momentary assessment protocol (Shiffman et al., 2008). The ABC runs on smartphones, which prompt participants to find the most original use for an everyday object or the most original completion of a picture fragment. In contrast to more conventional assessment data, ecological momentary assessment data capture ecologically valid and meaningful within-person variation (covariations across measurements) and additionally allow to assess reliable between-person variance (aggregation across measurement prompts and items; Shrout and Lane, 2012; Bolger and Laurenceau, 2013; Nezlek, 2017; Sliwinski et al., 2018). The assessment of creative abilities in continuously changing situations in a natural environment allows to estimate between- and within-person variance, as well as the reliability indices by applying the generalizability theory analysis (Cronbach, 1972; Brennan, 2001, for review see, Shrout and Lane, 2012).
A first application of the ABC in combination with the generalizability theory analysis indicated that 8% of the assessed creative ability variance was due to between-person and 33% was due to performance variation within a person (Rominger et al., in pressb). In contrast, Silvia et al. (2008) reported a between-person variance of 63% for a verbal divergent thinking task. This divergence of observed variance proportions between data of the ABC and a single assessment of creative abilities suggests that creative ideation performance shows a high within-person fluctuation, which can only be observed when we assess creative ideation performance multiple times throughout various situations (Rominger et al., in pressb). On a theoretical basis, suggested that high within-person variations in creative ideation performance can be assumed, since numerous contextual variables such as affect (Baas et al., 2008; De Dreu et al., 2008; Nijstad et al., 2010), physical activity (Rominger et al., 2022), heart rate variability (Silvia et al., 2014; Rominger et al., 2019a), substance intake (e.g., alcohol, Benedek et al., 2017; caffeine, Zabelina and Silvia, 2020), semantic context (Fink et al., 2012), basic cognitive functions (e.g., executive functions, Zabelina et al., 2019; memory, Benedek et al., 2018; attention, Benedek, 2018) affect creative ideation performance and all these variables continuously fluctuate as we live our daily lives. In line with this argumentation, the performance measure of basic cognitive functions such as working memory, assessed by means of an ambulatory version of the classical n-back task, showed comparable within-person variance proportion (Dirk and Schmiedek, 2016; Sliwinski et al., 2018). A replication of these distributions of variances would further justify the application of the ABC to capture creative abilities in real-life settings, which allows a reliable and meaningful differentiation between within- and between-person variation of creative abilities.
The study of Rominger et al. (in pressb) indicated good within-person reliability of 0.70, which was higher than reported for basic cognition performance measures in the field (e.g., Sliwinski et al., 2018; see also Schmiedek et al., 2013; Brose et al., 2014; Schuster et al., 2015; Calamia, 2019; for an overview see Moore et al., 2017). In analogy to the convincing within-person reliably, the between-person scores showed good reliability and stability indices as well (≥0.80; for other cognitive tests see e.g., van Patten et al., 2021). To sum up, Rominger et al. (in pressb) indicated that the ABC can reliably assess within- and between-person variance in creative abilities. The promising reliability of the ABC argues for the assessment of creative ideation performance in everyday life situations, and the application in future studies (Rominger et al., in pressa). Importantly, the findings are not restricted to good reliability estimates, since the ABC additionally shows evidence of criterion validity.
Specifically, the within-person validity was indicated by a significant prediction of creative abilities via the response time and the subjective originality rating of each single prompt. Prompts with longer response times and higher subjective ratings were associated with a better performance in the verbal and figural ABC (Rominger et al., in pressb). First, this pattern of findings strengthens the assumption that response time can serve as an index of creative exploration (Barbot, 2018; Rominger et al., in pressb). In line with the serial order effect creative ideas seemed to increase across time (i.e., Beaty and Silvia, 2012). Second, the findings are in accordance with the view that people can monitor and evaluate their own ideas (i.e., creative metacognition; Karwowski et al., 2020). Furthermore, a positive association of the between-person score with self-rated creative behavior and the personality trait openness (McCrae, 1987; Silvia, 2008) add to the validity evidence of the verbal ABC. The remaining four Big-Five factors were not significantly linked to the ABC performance. This pattern of finding is in some agreement with literature indicating openness and extraversion as the two most important predictors of creativity (Puryear et al., 2017). The figural ABC performance was significantly associated with the verbal ABC performance. Although the study of Rominger et al. (in pressb) offered convincing first evidence for validity, associations with real-life creativity have not been explored to date. Kaufman and Beghetto (2009) discriminated between four types of creativity: Mini-c, Little-c, Pro-c, and Big-c. While Mini-c refers to personally meaningful creative experiences, Little-c refers to everyday creativity and creative activities. Pro-c is not as eminent as Big-c, however, it receives some public approval such as publishing a paper or blogging recipes. Thus, to assess everyday creative activities (capturing aspects of Little-c) and creative achievements (capturing aspects of Pro-c), we administered the Inventory of Creative Activities and Achievements (ICAA), developed by Diedrich et al. (2018). Both scales of the ICAA were previously associated with the performance in Alternate Uses tasks (AU-task; Guilford, 1967; see Diedrich et al., 2018).
Taken together, the present study aimed (1) to replicate the findings by Rominger et al. (in pressb). First, we were interested if the within-person variation of creative ideation performance would be comparably high again (compared to between-person variation) and second, we investigated if the ABC assesses between- and within-person creative ideation performance reliably and validly (by means of the very same approach used by Rominger et al., in pressb). (2) We aimed to extend the criterion validity of the ABC to real-life creativity assessments by applying the ICAA (Jauk et al., 2014; Diedrich et al., 2018). (3) We investigated additional indications of within-person validity of the assessed fluctuations of creative abilities by taking contextual factors into account. In particular we assessed the consumption of alcohol, caffeine, and nicotine, which were found to impact creative idea generation performance in experimental settings (Benedek et al., 2017; Zabelina and Silvia, 2020).
Materials and methods
Participants
A total of 69 students participated in this study. An a-priori calculated power analysis using the software GPower 3.1 (Faul et al., 2009) indicated that a sample size of 59 participants was required to detect a medium to large effect (r = 0.35) for validation analyses of between-person variance. The sample showed an age range between 18 and 54 years (M = 23.78, SD = 5.06; 45 women). Forty-five participants were majoring in psychology (65.20%). All participants were free of cardiovascular, neurological, or mental disorders as well as psychotropic or cardiovascular medication according to self-report. Participants were recruited via email and social media. Depending on the number of answered prompts, participants received between 15 and 30 Euros for participation (Gerteis and Schwerdtfeger, 2016). The study was approved by the institutional ethics review board (GZ. 39/100/63 ex 2020/21). All participants gave informed consent to participate in the study. No participant was excluded from analyses.
Procedure
The study included one online meeting and two appointments (one to distribute and one to collect the equipment). During an online meeting, participants gave informed consent and worked on all relevant questionnaires delivered as an online survey. On the following day, at the first appointment, participants received detailed information on how to install the required software and to answer the prompts of the ABC. A short user manual was distributed including information on app use, frequently asked questions, time schedule of the study, and staff contact information. Participants were monitored throughout five consecutive days including weekends. A minimum of 4 prompts and a maximum of 10 prompts were delivered each day between 9:00 a.m. and 10:30 p.m. for each version of the ABC (verbal and figural). During ambulatory assessment, participants could contact the experimenter via email and the chat function implemented in the movisensXS app. After ambulatory assessment, participants returned the equipment (e.g., smartphones provided for non-Android users) and received their remuneration.
Material
Ambulatory battery of creativity
We collected creative ideation performance data in the verbal and figural domain in everyday life via the Android-based app movisensXS (Version 1.4.3, movisens GmbH). Acoustic signals reminded participants to answer the prompts, which could be declined or delayed for either 5-, 10-, 15-, or 20-min. Multiple delays could not exceed 20 min in total.
Verbal ambulatory battery of creativity
The verbal ABC is a modified version of the Alternative Uses task (AU-task; Guilford, 1967). Thirty conventional everyday objects are randomly applied (see e.g., Fink et al., 2007, 2009). Within a time-limit of 60 s, participants generate one best possible creative and original use for an object. The response time from item onset to the start of typing the idea into the smartphone served as an index of creative exploration (and creative ideation; Rominger et al., in pressb; M = 14.27 s, SD = 13.83 s). Finally, participants rated the originality of their produced idea on a visual analog scale from “not original at all” to “very original” (ranging from 0 to 100, M = 46.26, SD = 23.09; Rominger et al., 2019b; Rominger et al., in pressb).
Figural ambulatory battery of creativity
Creative ideation performance in the figural domain was assessed by means of a modified version of the Picture completion task (Torrance Test of Creative Thinking, TTCT; Torrance, 1966). Participants were requested to complete picture fragments in a creative and original way on the display of their smartphone. The maximum time was again 60 s. Finally, participants were requested to give their drawings a title. The response time from item onset to starting the drawing was considered as an index of the exploration and creative ideation time in the creative thinking process (M = 10.53, SD = 7.89; Rominger et al., in pressb; Barbot, 2018; for a neurophysiological differentiation of idea generation and elaboration see e.g., Rominger et al., 2018, 2020b). The total drawing time (time until saving minus starting time) served as an index of creative idea elaboration (M = 27.79, SD = 15.09). In total, 30 picture fragments were randomly presented (20 from the picture completion task of the TTCT and 10 from the study of Rominger et al., 2018, 2020b). After completion, participants rated the originality of their drawing on an analogous scale from “not original at all” to “very original” ranging from 0 to 100, M = 48.83, SD = 24.15).
External originality ratings: Creative ideation performance in the verbal and figural version of the ambulatory battery of creativity
Four independent judges (two women and two men between 20 and 30 years of age) rated the creativity of all given responses (Silvia et al., 2008; Benedek et al., 2013; Forthmann et al., 2020). The judges had no extensive previous experience in originality ratings and were all well instructed. All raters were recruited via personal contact. The rating procedure was identical as described in Rominger et al. (in pressb). Similar ideas were removed (per item) to reduce the burden for judges, before the ideas (per item) were presented in random order to judges. The well instructed judges should gain an overview of all answers before providing the rating and should use the full range of the rating scale from 1 to 4 (not original to very original). In an analogous manner, all drawings (separately per picture fragment) were presented in random order to the same four judges. The figural ideas were rated by applying a rating-software (programmed in PsycoPy, Peirce, 2007), which randomly presented 10 completed drawings of the sample to the judges to gain an overview of participants’ drawings. After this, the judges rated one randomly presented drawing after the other with self-paced breaks between items. Each judge did the ratings at home and in isolation. The ratings took between 3 days and 1 week in total. The inter-rater-reliability (two-way random effects, consistency, multiple raters) as measured with ICC (2, k) was 0.75 for both the ratings of verbal (M = 1.90, SD = 0.59) and figural (M = 1.95, SD = 0.62) responses. We estimated the creative potential of a person (i.e., between-person performance level) via two separate multilevel null models with person as random factor predicting creative ideation performance in the verbal and figural ABC. The resulting intercepts (per person) were used as estimates of each person’s creative potential. This multilevel approach to estimate the creative potential takes the structure of data into account and is largely equivalent to an aggregated mean score per person (see Rominger et al., in pressb).
Assessment of contextual information: Consumption of alcohol, caffeine, and nicotine
At each prompt, participants were asked to answer if they had consumed alcohol (within the last 60 min, yes/no), caffeine (within the last 10 min, yes/no), or nicotine (within the last 10 min, yes/no).
Between-person criterion variables
Creative potential
In order to assess interindividual differences in creative potential, we administered the Test for Creative Thinking—Drawing Production online (TCT-DP; Urban and Jellen, 1995). We asked participants to complete the abstract picture fragments with their image editing software, in a free-associative, and original way. The time limit was 15 min and was monitored during the online meeting. The generated drawings were then sent to the experimenter. Two independent and trained raters (one man and one woman) scored the TCT-DP in accordance with the test manual (e.g., unconventionality, inclusion of new elements, graphic combinations, etc.). Each criterion was scored between 0 and 6. The two scorings showed substantial correlation indicating high interrater reliability (r = 0.97). The mean score of both raters per criterion was used as index of creative potential assessed and served as criterion for validity analyses (M = 1.56, SD = 0.54).
Self-assessment of creative ideation behavior
Creative ideation behavior was assessed by a German version of Runco’s Ideational Behavior Scale (RIBS; Runco et al., 2001; see e.g., Diedrich et al., 2018), which includes 17 statements such as “I come up with an idea or solution other people have never thought of.” Participants responded to the items on a scale ranging from 1 (never) to 5 (very often; M = 64.59, SD = 14.80; α = 0.92). The scale reflects creative ideation skills and is commonly used as a criterion measure of divergent thinking performance (Plucker et al., 2006; Diedrich et al., 2018; for an overview see, Runco et al., 2014).
Self-assessment of real-life creativity: Creative activities and creative achievements
As further criterion variables, creative activities (Cact) and creative achievements (Cach) were assessed by means of the Inventory of Creative Activities and Achievements (ICAA; Diedrich et al., 2018). This questionnaire asks for eight different domains of creative activities and achievements (i.e., literature, music, arts and crafts, cooking, sports, visual arts, performing arts, science, and engineering). The sum score of creative activities showed an internal consistency of α = 0.81 and served as an index of everyday little-c creativity. Furthermore, the internal consistency of the sum of creative achievements score was α = 0.70, which indexes Pro-C creativity.
Personality assessment
The 60-items NEO-FFI by Costa and McCrae (1992, German translation; Borkenau and Ostendorf, 1997) was used to assess participants’ openness, neuroticism, extraversion, agreeableness, and conscientiousness. Openness in particular was consistently associated with creative ideation performance and the potential for open problem solving (McCrae, 1987; Silvia, 2008). The internal consistency of openness in the present study was α = 0.75 (M = 34.48, SD = 6.51; neuroticism: α = 0.85, M = 22.45, SD = 4.39; conscientiousness: α = 0.82, M = 31.65, SD = 6.96; agreeableness: α = 0.68, M = 33.80, SD = 5.57; and extraversion: α = 0.73, M = 27.39, SD = 6.12).
Psychometric analysis strategy
Reliability analyses
Consistent with Rominger et al. (in pressb), we firstly calculated reliability analyses at the between- (RKR) and the within-person (R_C) level for both versions of the ABC separately using generalizability theory analysis (Cronbach, 1972; Brennan, 2001, for review see, Shrout and Lane, 2012). Following Nezlek (2017), we differentiated between Level 1, which were the four raters, Level 2, which were the prompts, and the person level (Level 3). Raters were considered as items (Level 1; Nezlek, 2017) measuring creative ideation performance in different situations in daily life context. Generalizability theory analysis is especially suited to assess reliability of ecological momentary assessment data, allowing the partitioning of between-person, within-person, and error variance by decomposing the observed variance associated with person, item (i.e., rater), measurement occasion (i.e., prompt), and their respective interactions. To estimate reliability, we used the methods described by Revelle and Wilt (2019) by applying the software psych (version 2.2.5; Revelle, 2022) running in R (version 4.2.0; R Core Team, 2021). Secondly, to estimate the stability of the assessed creative potential, creative potential based on the first half of prompts was correlated with the creative potential based on the second half of prompts (i.e., split-half reliability). All reliability analyses were calculated separately for the verbal and figural ABC and corrected with the Spearman-Brown correction formular (Bühner, 2011).
Validity analyses
For criterion validity estimates at the between-person level, creative ideation performance in the ABC was correlated with the creative potential assessed by means of the TCT-DP, the self-reported creative behavior, the personality trait openness to experience (as well as the other personality measures for discriminant validity), and the creative activities as well as the creative achievements.
To evaluate the within-person validity, two multi-level models with response time at Level 2 (between-person, group mean) and Level 1 (within-person, group mean centered) and subjective ratings of the creative quality of ideas at Level 2 (between-person, group mean) and Level1 (within-person, group mean centered) as well as gender and age as fixed effects and participants as random effects were calculated. We predicted the (externally rated) creative abilities for the verbal and figural ABC, respectively. Finally, we evaluated meaningful within-person variation of creative abilities associated with the consumption of alcohol, nicotine, and caffein in two further multi-level models.
Results
Descriptive statistics
Overall, the ABC delivered 4,600 prompts, of which 3,118 were answered (67.98%). For the verbal ABC, we collected 1,558 ecological momentary assessment responses and for the figural ABC 1,569 ecological momentary assessment responses. Furthermore, 12.75% (n = 200) of all completed figural ABC responses got lost randomly due to transmission errors of the drawings. This resulted in a total of 1,549 available ecological momentary assessment responses for the verbal ABC and 1,369 responses for the figural ABC. Incomplete responses were discarded from multi-level analyses (9 responses of the verbal ABC and 1 response of the figural ABC). Alcohol consumption was reported for 61 figural and 72 verbal prompts, nicotine consumption for 60 figural and 65 verbal prompts, and caffeine intake for 80 figural and 98 for verbal prompts.
Reliability analysis
The between-person variance of creative abilities was between 6 and 7%. The reliabilities of these scores were estimated with RKR = 0.80 for the verbal and RKR = 0.85 for the figural ABC. The proportion of within-person variance was 36 and 30%, respectively, with reliability estimates of R_C = 0.73 for the verbal and R_C = 0.72 for the figural ABC (see Table 1). This indicates that both the verbal and the figural ABC could reliably assess systematic within-person and between-person variations of creative abilities.
Table 1. Variance decomposition of creative abilities in the verbal and figural ABC task and summary of reliability estimates.
Stability
In addition to reliability estimates, we explored the stability of the between-person creative ability scores for the verbal and the figural ABC. The first half of prompts was correlated with performance estimation based on the second half of prompts. This analysis showed evidence for good split-half reliability of the verbal ABC (r = 0.65; Spearman-Brown corrected r = 0.79) and the figural ABC (r = 0.57; Spearman-Brown corrected r = 0.73, see Figure 1). These analyses indicate that the verbal and the figural ABC delivers reliable and stable estimates of creative potential.
Figure 1. Scatter plot of first and second half performance (i.e., split-half stability) for the verbal (left) and the figural ABC (right). Slope and corresponding credibility intervals are depicted.
Evidence for between-person validity
Creative potential
The creative ideation performance on the verbal ABC significantly correlated with the creative potential assessed by means of the TCT-DP (r = 0.27, p = 0.024). Similarly, the figural ABC also positively correlated with the TCT-DP (r = 0.31, p = 0.010). This indicates criterion validity of both the verbal and the figural ABC, which was further strengthened by a significant correlation between both versions of the ABC (r = 0.52, p < 0.001).
Self-assessment of creative ideation behavior, creative activities, and creative achievements
The self-reported creative ideation behavior (RIBS) was significantly associated with the verbal ABC (r = 0.31, p = 0.009). The between-person level of the performance in the verbal ABC was also associated with creative achievements (Cach: r = 0.31, p = 0.010) and creative activities (Cact: r = 0.32, p = 0.008) of the ICAA. The performance assessed by means of the figural ABC was not correlated with these measures (see Table 2).
Table 2. Overview of Pearson correlations of between-person variables, separately for the verbal and the figural ABC.
Personality
The personality trait openness to experience was significantly correlated with the creative potential assessed by the verbal ABC (r = 0.43, p < 0.001). Neuroticism, conscientiousness, agreeableness, and extraversion showed no significant association with creative performance, which points to evidence of discriminant validity (see Table 2). The between-person variation of the figural ABC performance was not significantly associated with any measure of the Big-Five (see Table 2). However, extraversion showed a trend for a negative association with the figural ABC (r = −0.22, p = 0.064).
Evidence for within-person validity of the ambulatory battery of creativity
Associations of response time and subjective originality ratings with verbal and figural ambulatory battery of creativity performance
The multilevel model for the verbal ABC showed that higher average response times, but not the subjective originality ratings (at the person Level 2) predicted creative abilities (see Table 3). On the within-person level (Level 1, group mean centered), longer response times (at a trend level) and higher subjective creativity ratings were associated with higher creative ideation performance (see Table 3).
Table 3. Multilevel model predicting verbal ABC abilities.
The pattern of findings at Level 1 was virtually the same for the figural ABC (see Table 4). All three group mean centered variables (i.e., subjective originality ratings, response time, and drawing time) significantly predicted the creative performance outcome of the figural ABC (see Table 4). Furthermore, subjective ratings at Level 2 as well as the drawing time at Level 2 also predicted originality of the figural ABC, but not the group mean of the response time.
Table 4. Multilevel model predicting figural ABC abilities.
Contextual co-variation of creative abilities in the verbal and figural ambulatory battery of creativity as an additional indicator of within-person validity
As a further evaluation of the within-person validity of the ABC, we investigated if the consumption of alcohol, caffeine, and nicotine is associated with creative ideation performance in everyday life. For the verbal ABC, alcohol consumption significantly predicted creative performance of the associated prompt (see Table 5).
Table 5. Multilevel model for the consumption of alcohol, caffeine, and nicotine predicting performance in the verbal and the figural ABC.
Nicotine and alcohol consumption negatively predicted the figural creative ability of the associated prompt. Furthermore, caffeine consumption positively predicted creative ideation performance of the figural ABC at a trend level (see Table 5).
Discussion
This study aimed to replicate and extend previous findings on the psychometric properties of the novel ABC, which assesses creative ideation performance multiple times in the field. Thus, the ABC seeks to measure people’s creative potential as well as the moment-to-moment fluctuations of creative abilities (Rominger et al., in pressa). We replicated the promising reliability estimates shown previously (Rominger et al., in pressb) and observed additional evidence for criterion validity, which suggests that the ABC is well suited to assess interindividual differences (i.e., people’s creative potential, between-person variance) as well as moment-to-moment fluctuations of creative abilities (i.e., within-person variance) in everyday life contexts. Therefore, this instrument, designed to capture dynamic variation as well as static individual differences in creative abilities, can be applied to address new questions in creativity research from a new, fresh, and ecologically more valid perspective (Rominger et al., in pressa).
The present application of the ABC replicates the proportion of variance reported by Rominger et al. (in pressb), where creative abilities showed a higher variation within person (∼33%) compared to between person (∼8%). This division of variances underscores the importance to assess creative ideation performance multiple times within an ever-changing environment, or otherwise creativity research would miss a meaningful source of information.
Should we apply the ambulatory battery of creativity to assess a person’s creative potential?
Despite the circumstance that the present findings are based on a young academic sample of moderate size, at least for the verbal ABC the answer is a clear yes. Here, taking the effort to assess a person’s creative potential throughout diverse situations of everyday life provides an ecologically valid estimate of people’s creative abilities as exhibited outside the laboratory and in everyday life. Although the proportion of variance at the level of a person was only 6%, the reliability estimate was good, which was further strengthened by a good stability of the estimated creative potential. Replicating the findings of Rominger et al. (in pressb), the between-person level of creative performance showed the expected associations with a laboratory measure of creative potential (TCT-DP), self-reported creative behavior (RIBS), and the personality trait openness (McCrae, 1987; Silvia, 2008). Given the reliability and validity evidence of the verbal ABC, this instrument constitutes an important extension of psychometrically sound methods to study creative abilities in the field. Additionally, the present study reported an association of the verbal ABC with creative activities and creative achievements (Jauk et al., 2014; Diedrich et al., 2018), which indicates that the verbal version of the ABC captures individual differences in creative potential predicting aspects of Little-c and Pro-c creativity.
Although, both measures of the ABC were substantially correlated with each other (r = 0.52) and with the TCT-DP, the figural ABC showed a divergent correlation pattern. It may be assumed that the verbal and the figural ABC might assess different aspects of creativity (at least at the level of a person). In contrast to the verbal version, the figural ABC might more strongly capture aspects of mini-c creativity (i.e., personally meaningful creative experiences; Kaufman and Beghetto, 2009). In line with this assumption, we found no association of the figural ABC with creative achievements and creative activities. However, people who considered their drawings as more original (at the aggregated level of a person, Level 2) showed a higher creative potential in the figural domain. Additionally, although most available research indicated virtually no or at best only small positive associations between extraversion and creative potential measures (Fink and Neubauer, 2008; Kandler et al., 2016; Puryear et al., 2017), the figural ABC was negatively associated with extraversion by trend. Since this constitutes a novel finding by means of the ambulatory assessment of figural creativity, future studies should investigate its robustness and replicability.
Taken together, the ABC constitutes a promising instrument to capture interindividual differences of creative potential in the verbal and the figural domain. The additional effort, in contrast to assessing creative ideation performance only once (or twice; Erwin et al., 2022), is justified by the benefit of a measure with a higher ecological validity, which might reveal associations that are not observed when creative abilities are assessed under more constant conditions (Rominger et al., in pressa).
Should we use the ambulatory battery of creativity to assess within-person variation of creative abilities?
Our recommendation is yes. As stated by Rominger et al. (in pressa), beside the increased ecological validity, the assessment of within-person variation and the dynamic fluctuation of creative abilities constitutes a promising advantage of the ABC in the field. Measuring creative ideation performance only once would overlook the meaningful distribution of variation of creative abilities in people’s everyday life.
Most of the psychometric properties of the verbal and figural ABC are comparable. We found a considerable amount of variation within person (∼30%; Dirk and Schmiedek, 2016; Sliwinski et al., 2018), which crucially justifies the additional effort of studying fluctuations of creative abilities multiple times in ever changing environments of people’s daily lives. Furthermore, the reliability estimates were high for both ABC versions (≥0.70), especially when comparing the reliability estimates with cognitive tasks assessed in the field (see e.g., Sliwinski et al., 2018). This difference in reliability estimates between cognitive and creative ideation measures might be due to the nature of the quantification of the measures itself. High quality of interrater agreement of the originality ratings by external and independent judges is an important prerequisite of the ABC and strongly impact the reliability of the observed within-person variation. In contrast, however, reliability of cognitive performance in ecological momentary assessments is quantified via the number of correct answers (and reaction times) of at least two items presented per prompt.
Furthermore, both, the verbal and the figural ABC measure meaningful variations of creative abilities over time and situations, which were associated with the fluctuation of subjective ratings as well as the response times during the tasks. In accordance with Rominger et al. (in pressb), subjective ratings and response times positively predicted the creative ideation outcome of each prompt. The response times might serve as an indicator of the creative ideation process associated with the effort and the number of generated ideas to finally reach an original idea (i.e., fluency component of creativity; see e.g., Barbot, 2018). Furthermore, the drawing time, as an indicator of idea elaboration, additionally predicted the originality of each drawing (Barbot, 2018).
Analyzing the effects of situational context on creative abilities, we found that prompts associated with alcohol consumption predicted higher performance in the verbal ABC, but less creative outcome in the figural ABC. Alcohol is known to reduce cognitive control, but no consistent associations with creative performance have been observed with conventional assessments so far (Jarosz et al., 2012; Benedek et al., 2017; Benedek and Zöhrer, 2020). This might point to a high sensitivity and a potential domain specificity of the ABC versions with respect to within-person performance variations. Furthermore, nicotine showed a negative association with fluctuation of creative abilities assessed by means of the figural ABC, which constitutes a novel finding since previous studies investigating interindividual differences of tobacco use found no substantial associations with creativity (Plucker and Dana, 1998; Plucker et al., 2009). Additionally, caffeine seemed to positively predict the originality of the figural ABC (Zabelina and Silvia, 2020). This pattern of intraindividual effects indicate validity of the assessed moment-to-moment fluctuation. However, not at least due to the comparatively low number of prompts associated with substance consumption in the present study (e.g., ∼60 for nicotine consumption), these findings need replication in future studies applying the ABC in contexts with a higher probability of alcohol intake and nicotine consumption (e.g., later assessment time, experimental manipulation of substance intake during conducting an ecological momentary assessment protocol). Furthermore, beyond the pure effects of substance use on the creative ideation performance it might also be assumed that other contextual variables such as social context (which might be associated with alcohol and nicotine consumption) might have impacted creative ideation performance in the present study.
Conclusion and future perspectives
In accordance with the tradition of ambulatory assessment of cognitive performance and intelligence, the reliable and stable assessment of creative abilities may serve as an ecologically valid marker of health and illness (Waters and Li, 2008; Koo and Vizer, 2019; Papp et al., 2021; van Patten et al., 2021; Zlatar et al., 2022). Furthermore, the measurement of creative abilities and creative cognitive functions could offer meaningful, incremental, important, and ecologically more valid information about a person’s state of health as well as state of illness, which could be useful in eHealth/mHealth approaches. Original and useful ideas can help in handling daily problems (Perchtold-Stefan et al., in press), which makes creative ideation crucial for an adaptive interaction with the environment and determines the success of our everyday life functioning. This supports the assumption that creative abilities can serve as an index of brain health and cognitive reserve (e.g., Fusi et al., 2020; Rominger et al., 2022), which is further strengthened by the findings that creative abilities are (multidimensionally) associated with effects of aging (Fusi et al., 2020), wellbeing, positive affect (Rominger et al., 2020a), mindfulness (Baas et al., 2014), as well as physical activity (Rominger et al., 2020a,2022). Similar to these variables of health, the ecologically valid measure of creative abilities might also provide relevant information about clinical samples such as patients suffering from schizophrenia (Acar et al., 2018) and (frontotemporal) dementia (Fusi et al., 2021).
The application of the ABC seems especially advantageous when information about the temporal dynamics of creative abilities as well as potential influences of contextual variables are of interest (Weizenbaum et al., 2020) such as tracking creative performance in digital health interventions or person-centered care and assessment concepts (Koo and Vizer, 2019). Knowing in which contexts people show higher creative abilities might allow to derive at personalized advises to reach specific contexts if more creative abilities are needed. These opportunities will greatly expand the avenues for future creativity research topics toward the dynamics of creative thinking abilities and facilitate new insights into the mechanisms of creative cognition in healthy as well as clinically relevant samples (Rominger et al., in pressa).
By applying the ABC, future studies could target the assessment of dynamic changes of creative abilities in people’s everyday life in an ecologically valid manner. This enables a new and fresh perspective on creativity research by focusing on the moment-to-moment fluctuations of creative abilities. Future studies could advance this approach by adding further psychological or contextual variables such as affect, wellbeing, and attention as well as environmental surroundings, participant’s physical activity, or neurophysiological indicators (e.g., ECG, EEG; Weizenbaum et al., 2020), which might allow psychophysiological triggering and robust predictions of creative states (Agnoli et al., 2020; Schwerdtfeger and Rominger, 2021; Rominger and Schwerdtfeger, 2022; Rominger et al., in pressc). A more complex assessment of psychological and psychophysiological states in combination with the ABC could gain further highly relevant information on how, when, and why people show higher creative abilities.
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics statement
The studies involving human participants were reviewed and approved by Karl-Franzens-Universität Graz Ethikkomission (Universitätsplatz 3, 8010 Graz, Austria). The patients/participants provided their written informed consent to participate in this study.
Author contributions
CR, AF, and AS contributed to the conception and design of the study. CR and BW organized the database. CR performed the statistical analysis and wrote the first draft of the manuscript. CR, AF, MB, CP-S, and AS wrote sections of the manuscript. All authors contributed to the manuscript revision, read, and approved the submitted version.
Funding
This publication cost for this article was funded by the University of Graz.
Acknowledgments
We thank Tanja Purgaj for her valuable help in data collection and study application. Furthermore, we especially thank Peter Brugger for programming the mobile version of the picture completion task implemented in the current version of the ABC.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
Acar, S., Chen, X., and Cayirdag, N. (2018). Schizophrenia and creativity: A meta-analytic review. Schizophr. Res. 195, 23–31. doi: 10.1016/j.schres.2017.08.036
Agnoli, S., Zanon, M., Mastria, S., Avenanti, A., and Corazza, G. E. (2020). Predicting response originality through brain activity: An analysis of changes in EEG alpha power during the generation of alternative ideas. NeuroImage 207:116385. doi: 10.1016/j.neuroimage.2019.116385
Baas, M., De Dreu, C. K., and Nijstad, B. A. (2008). A meta-analysis of 25 years of mood-creativity research: Hedonic tone, activation, or regulatory focus? Psychol. Bull. 134, 779–806. doi: 10.1037/a0012815
Baas, M., Nevicka, B., and Ten Velden, F. S. (2014). Specific mindfulness skills differentially predict creative performance. Pers. Soc. Psychol. Bull. 40, 1092–1106. doi: 10.1177/0146167214535813
Barbot, B. (2018). The dynamics of creative ideation: Introducing a new assessment paradigm. Front. Psychol. 9:229. doi: 10.3389/fpsyg.2018.02529
Barbot, B. (in press). Intra-individual variability in creativity. Eur. Psychol. doi: 10.1027/1016-9040/a000470.
Beaty, R. E., and Silvia, P. J. (2012). Why do ideas get more creative across time? An executive interpretation of the serial order effect in divergent thinking tasks. Psychol. Aesthet. Creat. Arts 6, 309–319. doi: 10.1037/a0029171
Beaty, R. E., Benedek, M., Silvia, P. J., and Schacter, D. L. (2016). Creative cognition and brain network dynamics. Trends Cogn. Sci. 20, 87–95. doi: 10.1016/j.tics.2015.10.004
Benedek, M. (2018). “Internally directed attention in creative cognition,” in The Cambridge handbook of the neuroscience of creativity, eds R. E. Jung and O. Vartanian (Cambridge: Cambridge University Press), 180–194.
Benedek, M., and Zöhrer, L. (2020). Creativity on tap 2: Investigating dose effects of alcohol on cognitive control and creative cognition. Conscious. Cogn. 83:102972. doi: 10.1016/j.concog.2020.102972
Benedek, M., Jauk, E., Sommer, M., Arendasy, M., and Neubauer, A. C. (2014). Intelligence, creativity, and cognitive control: The common and differential involvement of executive functions in intelligence and creativity. Intelligence 46, 73–83. doi: 10.1016/j.intell.2014.05.007
Benedek, M., Mühlmann, C., Jauk, E., and Neubauer, A. C. (2013). Assessment of divergent thinking by means of the subjective top-scoring method: Effects of the number of top-ideas and time-on-task on reliability and validity. Psychol. Aesthet. Creat. Arts 7, 341–349. doi: 10.1037/a0033644
Benedek, M., Panzierer, L., Jauk, E., and Neubauer, A. C. (2017). Creativity on tap? Effects of alcohol intoxication on creative cognition. Conscious. Cogn. 56, 128–134. doi: 10.1016/j.concog.2017.06.020
Benedek, M., Schües, T., Beaty, R. E., Jauk, E., Koschutnig, K., Fink, A., et al. (2018). To create or to recall original ideas. Brain processes associated with the imagination of novel object uses. Cortex 99, 93–102. doi: 10.1016/j.cortex.2017.10.024
Bolger, N., and Laurenceau, J.-P. (2013). Intensive longitudinal methods: An introduction to diary and experience sampling research. New York, NY: Guilford Press.
Borkenau, P., and Ostendorf, F. (1997). NEO-fünf-faktoren inventar (NEO-FFI) nach costa und mccrae. Göttingen: Hogrefe.
Brose, A., Lövdén, M., and Schmiedek, F. (2014). Daily fluctuations in positive affect positively co-vary with working memory performance. Emotion 14, 1–6. doi: 10.1037/a0035210
Bühner, M. (2011). Einführung in die test- und fragebogenkonstruktion. 3., aktualisierte und erweiterte Auflage. London: Pearson.
Calamia, M. (2019). Practical considerations for evaluating reliability in ambulatory assessment studies. Psychol. Assess. 31, 285–291. doi: 10.1037/pas0000599
Corazza, G. E., Agnoli, S., and Mastria, S. (in press). The dynamic creativity framework. Eur. Psychol. doi: 10.1027/1016-9040/a000473
Costa, P. T., and McCrae, R. R. (1992). Normal personality assessment in clinical practice: The NEO personality inventory. Eur. Psychol. 4, 5–13. doi: 10.1037/1040-3590.4.1.5
Cronbach, L. J. (1972). The dependability of behavioral measurements: Theory of generalizability for scores and profiles. New York, NY: Wiley.
De Dreu, C. K., Baas, M., and Nijstad, B. A. (2008). Hedonic tone and activation level in the mood-creativity link: Toward a dual pathway to creativity model. J. Pers. Soc. Psychol. 94, 739–756. doi: 10.1037/0022-3514.94.5.739
Diedrich, J., Jauk, E., Silvia, P. J., Gredlein, J. M., Neubauer, A. C., and Benedek, M. (2018). Assessment of real-life creativity: The inventory of creative activities and achievements (ICAA). Psychol. Aesthet. Creat. Arts 12, 304–316. doi: 10.1037/aca0000137
Dietrich, A. (2004). The cognitive neuroscience of creativity. Psychonomic Bull. Rev. 11, 1011–1026.
Dirk, J., and Schmiedek, F. (2016). Fluctuations in elementary school children’s working memory performance in the school context. J. Educ. Psychol. 108, 722–739. doi: 10.1037/edu0000076
Erwin, A. K., Tran, K., and Koutstaal, W. (2022). Evaluating the predictive validity of four divergent thinking tasks for the originality of design product ideation. PLoS One 17:e0265116. doi: 10.1371/journal.pone.0265116
Faul, F., Erdfelder, E., Buchner, A., and Lang, A.-G. (2009). Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behav. Res. 41, 1149–1160. doi: 10.3758/BRM.41.4.1149
Fink, A., and Neubauer, A. C. (2008). Eysenck meets martindale: The relationship between extraversion and originality from the neuroscientific perspective. PAID 44, 299–310.
Fink, A., Benedek, M., Grabner, R. H., Staudt, B., and Neubauer, A. C. (2007). Creativity meets neuroscience: Experimental tasks for the neuroscientific study of creative thinking. Methods 42, 68–76. doi: 10.1016/j.ymeth.2006.12.001
Fink, A., Grabner, R. H., Benedek, M., Reishofer, G., Hauswirth, V., Fally, M., et al. (2009). The creative brain: Investigation of brain activity during creative problem solving by means of EEG and fMRI. Hum. Brain Mapp. 30, 734–748. doi: 10.1002/hbm.20538
Fink, A., Koschutnig, K., Benedek, M., Reishofer, G., Ischebeck, A., Weiss, E. M., et al. (2012). Stimulating creativity via the exposure to other people’s ideas. Hum. Brain Mapp. 33, 2603–2610. doi: 10.1002/hbm.21387
Forthmann, B., Szardenings, C., and Holling, H. (2020). Understanding the confounding effect of fluency in divergent thinking scores: Revisiting average scores to quantify artifactual correlation. Psychol. Aesthet. Creat. Arts 14, 94–112. doi: 10.1037/aca0000196
Fusi, G., Crepaldi, M., Colautti, L., Palmiero, M., Antonietti, A., Rozzini, L., et al. (2021). Divergent thinking abilities in frontotemporal dementia: A mini-review. Front. Psychol. 12:652543. doi: 10.3389/fpsyg.2021.652543
Fusi, G., Lavolpe, S., Crepaldi, M., and Rusconi, M. L. (2020). The controversial effect of age on divergent thinking abilities: A systematic review. J. Creat. Behav. 55, 374–395. doi: 10.1002/jocb.461
Gerteis, A. K. S., and Schwerdtfeger, A. R. (2016). When rumination counts. Perceived social support and heart rate variability in daily life. Psychophysiology 53, 1034–1043. doi: 10.1111/psyp.12652
Jarosz, A. F., Colflesh, G. J. H., and Wiley, J. (2012). Uncorking the muse: Alcohol intoxication facilitates creative problem solving. Conscious. Cogn. 21, 487–493. doi: 10.1016/j.concog.2012.01.002
Jauk, E. V., Benedek, M., and Neubauer, A. C. (2014). The road to creative achievement: A latent variable model of ability and personality predictors. Eur. J. Pers. 28, 95–105. doi: 10.1002/per.1941
Kandler, C., Riemann, R., Angleitner, A., Spinath, F. M., Borkenau, P., and Penke, L. (2016). The nature of creativity: The roles of genetic factors, personality traits, cognitive abilities, and environmental sources. J. Pers. Soc. Psychol. 111, 230–249. doi: 10.1037/pspp0000087
Karwowski, M., Czerwonka, M., and Kaufman, J. C. (2020). Does intelligence strengthen creative metacognition? Psychol. Aesthet. Creat. Arts 14, 353–360. doi: 10.1037/aca0000208
Kaufman, J. C., and Beghetto, R. A. (2009). Beyond big and little. The four C model of creativity. Rev. Gen. Psychol. 13, 1–12. doi: 10.1037/a0013688
Koo, B. M., and Vizer, L. M. (2019). Mobile technology for cognitive assessment of older adults: A scoping review. Innov. Aging 3:igy038. doi: 10.1093/geroni/igy038
McCrae, R. R. (1987). Creativity, divergent thinking, and openness to experience. J. Pers. Soc. Psychol. 52, 1258–1265. doi: 10.1037/0022-3514.52.6.1258
Moore, R. C., Swendsen, J., and Depp, C. A. (2017). Applications for self-administered mobile cognitive assessments in clinical research: A systematic review. Int. J. Methods Psychiatr. Res. 26:e1562. doi: 10.1002/mpr.1562
Nezlek, J. B. (2017). A practical guide to understanding reliability in studies of within-person variability. J. Res. Pers. 69, 149–155. doi: 10.1016/j.jrp.2016.06.020
Nijstad, B. A., De Dreu, C. K. W., Rietzschel, E. F., and Baas, M. (2010). The dual pathway to creativity model: Creative ideation as a function of flexibility and persistence. Eur. Rev. Soc. Psychol. 21, 34–77. doi: 10.1080/10463281003765323
Papp, K. V., Samaroo, A., Chou, H.-C., Buckley, R., Schneider, O. R., Hsieh, S., et al. (2021). Unsupervised mobile cognitive testing for use in preclinical Alzheimer’s disease. Alzheimers Dementia 13:e12243. doi: 10.1002/dad2.12243
Peirce, J. W. (2007). PsychoPy-psychophysics software in Python. J. Neurosci. Methods 162, 8–13. doi: 10.1016/j.jneumeth.2006.11.017
Perchtold-Stefan, C. M., Papousek, I., Rominger, C., and Fink, A. (in press). Creativity in an affective context – reappraisal inventiveness and malevolent creativity as extensions of creativity research towards more real-world creative behavior. Eur. Psychol. doi: 10.1027/1016-9040/a000448.
Plucker, J. A., and Dana, R. Q. (1998). Alcohol, tobacco, and marijuana use: Relationships to undergraduate students’ creative achievement. J. Coll. Stud. Dev. 39, 472–483.
Plucker, J. A., Mcneely, A., and Morgan, C. (2009). Controlled Substance-related beliefs and use: Relationships to undergraduates’ creative personality traits. J. Creat. Behav. 43, 94–101. doi: 10.1002/j.2162-6057.2009.tb01308.x
Plucker, J. A., Runco, M. A., and Lim, W. (2006). Predicting ideational behavior from divergent thinking and discretionary time on task. Creat. Res. J. 18, 55–63. doi: 10.1207/s15326934crj1801_7
Puryear, J. S., Kettler, T., and Rinn, A. N. (2017). Relationships of personality to differential conceptions of creativity: A systematic review. Psychol. Aesthet. Creat. Arts 11, 59–68. doi: 10.1037/aca0000079
R Core Team, R. (2021). R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing.
Revelle, W. (2022). Psych: Procedures for personality and psychological research R package version 2.2.5, Evanston, IL.
Revelle, W., and Wilt, J. (2019). Analyzing dynamic data: A tutorial. Pers. Individ. Differ. 136, 38–51. doi: 10.1016/j.paid.2017.08.020
Rominger, C., and Schwerdtfeger, A. R. (2022). Feelings from the heart part II. Simulation and validation of static and dynamic HRV decrease-trigger algorithms to detect stress in firefighters. Sensors 8:2925. doi: 10.3390/s22082925
Rominger, C., Schwerdtfeger, A. R., Benedek, M., Perchtold-Stefan, C. M., and Fink, A. (in pressa). Ecological momentary assessment of creative ideation: Measuring creative potential in an everyday life context. Eur. Psychol.
Rominger, C., Fink, A., Benedek, M., Weber, B., Perchtold-Stefan, C. M., Papousek, I., et al. (in pressb). Reliability and validity of a novel ambulatory battery of creativity (ABC). Psychol. Aesthet. Creat. Arts
Rominger, C., Gubler, D. A., Makowski, L., and Troche, S. J. (in pressc). More creative ideas are associated with increased right posterior power and frontal-parietal/occipital coupling in the upper alpha band: A within-subjects study. Int. J. Psychophysiol.
Rominger, C., Papousek, I., Perchtold, C. M., Benedek, M., Weiss, E. M., Weber, B., et al. (2020b). Functional coupling of brain networks during creative idea generation and elaboration in the figural domain. NeuroImage 207:116395. doi: 10.1016/j.neuroimage.2019.116395
Rominger, C., Fink, A., Weber, B., Papousek, I., and Schwerdtfeger, A. R. (2020a). Everyday bodily movement is associated with creativity independently from active positive affect: A Bayesian mediation analysis approach. Sci. Rep. 10:11985. doi: 10.1038/s41598-020-68632-9
Rominger, C., Papousek, I., Perchtold, C. M., Benedek, M., Weiss, E. M., Schwerdtfeger, A. R., et al. (2019b). Creativity is associated with a characteristic U-shaped function of alpha power changes accompanied by an early increase in functional coupling. Cogn. Affect. Behav. Neurosci. 19, 1012–1021. doi: 10.3758/s13415-019-00699-y
Rominger, C., Papousek, I., Fink, A., Perchtold, C. M., Lackner, H. K., Weiss, E. M., et al. (2019a). Creative challenge: Regular exercising moderates the association between task-related heart rate variability changes and individual differences in originality. PLoS One 14:e0220205. doi: 10.1371/journal.pone.0220205
Rominger, C., Papousek, I., Perchtold, C. M., Weber, B., Weiss, E. M., and Fink, A. (2018). The creative brain in the figural domain. Distinct patterns of EEG alpha power during idea generation and idea elaboration. Neuropsychologia 118, 13–19. doi: 10.1016/j.neuropsychologia.2018.02.013
Rominger, C., Schneider, M., Fink, A., Tran, U. S., Perchtold-Stefan, C. M., and Schwerdtfeger, A. R. (2022). Acute and chronic physical activity increases creative ideation performance: A systematic review and multilevel meta-analysis. Sports Med. Open 8:62. doi: 10.1186/s40798-022-00444-9
Runco, M. A., and Jaeger, G. J. (2012). The standard definition of creativity. Creativity Res. J. 24, 92–96. doi: 10.1080/10400419.2012.650092
Runco, M. A., Plucker, J. A., and Lim, W. (2001). Development and psychometric integrity of a measure of ideational behavior. Creativity Res. J. 13, 393–400.
Runco, M. A., Walczyk, J. J., Acar, S., Cowger, E. L., Simundson, M., and Tripp, S. (2014). The incremental validity of a short form of the ideational behavior scale and usefulness of distractor, contraindicative, and lie scales. J. Creative Behav. 48, 185–197. doi: 10.1002/jocb.47
Schmiedek, F., Lövdén, M., and Lindenberger, U. (2013). Keeping it steady: Older adults perform more consistently on cognitive tasks than younger adults. Psychol. Sci. 24, 1747–1754. doi: 10.1177/0956797613479611
Schuster, R. M., Mermelstein, R. J., and Hedeker, D. (2015). Acceptability and feasibility of a visual working memory task in an ecological momentary assessment paradigm. Psychol. Assess. 27, 1463–1470. doi: 10.1037/pas0000138
Schwab, D., Benedek, M., Papousek, I., Weiss, E. M., and Fink, A. (2014). The time-course of EEG alpha power changes in creative ideation. Front. Hum. Neurosci. 8:310. doi: 10.3389/fnhum.2014.00310
Schwerdtfeger, A. R., and Rominger, C. (2021). Feelings from the heart: Developing HRV decrease-trigger algorithms via multilevel hyperplane simulation to detect psychosocially meaningful episodes in everyday life. Psychophysiology 58:e13914. doi: 10.1111/psyp.13914
Shiffman, S., Stone, A. A., and Hufford, M. R. (2008). Ecological momentary assessment. Annu. Rev. Clin. Psychol. 4, 1–32. doi: 10.1146/annurev.clinpsy.3.022806.091415
Shrout, P. E., and Lane, S. P. (2012). “Psychometrics,” in Handbook of research methods for studying daily life, eds M. R. Mehl, T. S. Conner, and M. Csikszentmihalyi (New York, NY: Guilford Press), 302–320.
Silvia, P. J. (2008). Discernment and creativity. How well can people identify their most creative ideas? Psychol. Aesthet. Creat. Arts 2, 139–146. doi: 10.1037/1931-3896.2.3.139
Silvia, P. J., Beaty, R. E., Nusbaum, E. C., Eddington, K. M., and Kwapil, T. R. (2014). Creative motivation. Creative achievement predicts cardiac autonomic markers of effort during divergent thinking. Biol. Psychol. 102, 30–37. doi: 10.1016/j.biopsycho.2014.07.010
Silvia, P. J., Winterstein, B. P., Willse, J. T., Barona, C. M., Cram, J. T., Hess, K. I., et al. (2008). Assessing creativity with divergent thinking tasks. Exploring the reliability and validity of new subjective scoring methods. Psychol. Aesthet. Creat. Arts 2, 68–85. doi: 10.1037/1931-3896.2.2.68
Sliwinski, M. J., Mogle, J. A., Hyun, J., Munoz, E., Smyth, J. M., and Lipton, R. B. (2018). Reliability and validity of ambulatory cognitive assessments. Assessment 25, 14–30. doi: 10.1177/1073191116643164
Torrance, P. E. (1966). Torrance test of creative thinking: Norms-technical manual research edition -verbal tests, FORMS A and B –figural tests, forms A and B. Princeton, NJ: Personnel Press.
Urban, K. K., and Jellen, H. G. (1995). Test zum schöpferischen Denken – zeichnerisch: (TSD-Z). Frankfurt: Swets Test Services.
van Patten, R., Iverson, G. L., Muzeau, M. A., and VanRavenhorst-Bell, H. A. (2021). Test-retest reliability and reliable change estimates for four mobile cognitive tests administered virtually in community-dwelling adults. Front. Psychol. 12:734947. doi: 10.3389/fpsyg.2021.734947
Waters, A. J., and Li, Y. (2008). Evaluating the utility of administering a reaction time task in an ecological momentary assessment study. Psychopharmacology 197, 25–35. doi: 10.1007/s00213-007-1006-6
Weizenbaum, E., Torous, J., and Fulford, D. (2020). Cognition in context: Understanding the everyday predictors of cognitive performance in a new era of measurement. JMIR Mhealth Uhealth 8:e14328. doi: 10.2196/14328
Zabelina, D. L., and Silvia, P. J. (2020). Percolating ideas: The effects of caffeine on creative thinking and problem solving. Conscious. Cogn. 79:102899. doi: 10.1016/j.concog.2020.102899
Zabelina, D. L., Friedman, N. P., and Andrews-Hanna, J. (2019). Unity and diversity of executive functions in creativity. Conscious. Cogn. 68, 47–56. doi: 10.1016/j.concog.2018.12.005
Zlatar, Z. Z., Campbell, L. M., Tang, B., Gabin, S., Heaton, A., Higgins, M., et al. (2022). Daily level association of physical activity and performance on ecological momentary cognitive tests in free-living environments: A mobile health observational study. JMIR Mhealth Uhealth 10:e33747. doi: 10.2196/33747
Keywords: creativity, ecological momentary assessment, ecological validity, smartphone, mobile phone, experience sampling
Citation: Rominger C, Fink A, Benedek M, Weber B, Perchtold-Stefan CM and Schwerdtfeger AR (2022) The ambulatory battery of creativity: Additional evidence for reliability and validity. Front. Psychol. 13:964206. doi: 10.3389/fpsyg.2022.964206
Received: 08 June 2022; Accepted: 16 August 2022;
Published: 16 September 2022.
Edited by:
Thomas M. Brinthaupt, Middle Tennessee State University, United StatesCopyright © 2022 Rominger, Fink, Benedek, Weber, Perchtold-Stefan and Schwerdtfeger. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Christian Rominger, christian.rominger@uni-graz.at