Na Chen
Katsumi Watanabe
Makoto Wada- 1Department of Rehabilitation for Brain Functions, Research Institute of National Rehabilitation Center for Persons With Disabilities, Tokorozawa, Japan
- 2Faculty of Science and Engineering, Waseda University, Tokyo, Japan
- 3Faculty of Arts, Design, and Architecture, University of New South Wales, Sydney, NSW, Australia
Crossmodal correspondences between visual features (e.g., color/shape) and tastes have been extensively documented in recent years. Visual colors and shapes have been shown to consensually match to specific tastes. Meanwhile, individuals with autism spectrum disorder are reported to have atypical sensory processing and deficits in multisensory integration. However, the influence of autistic traits on the formation of such correspondences is relatively unknown. Here, we examined whether autistic traits could influence visual–taste associations using an online questionnaire survey among Japanese participants. The results showed that the participants exhibited strong color–taste, shape–taste, and shape–color associations, and the proportions of choosing the consensual color–taste/shape–color associations were significantly associated with autistic traits. The participants with higher autistic quotient scores chose fewer of the consensual color–taste/shape–color associations while there was no difference in choosing shape–taste associations. We interpreted the results as statistical learning with a reduced prior knowledge effect in participants with higher autistic quotient scores.
Introduction
Which taste best matches the color yellow? When asked to match a basic taste with a color, people choose some tastes more frequently than the others (e.g., yellow–sour/red–sweet; O’Mahony, 1983; Spence et al., 2015; Woods and Spence, 2016; Velasco et al., 2016a). These naturally biased color–taste associations might be explained by learning with frequent exposure to the color of foods/drinks in the environment (Spence et al., 2015; Saluja and Stevenson, 2018; Higgins and Hayes, 2019; Spence, 2019). Spence (2011) defined the tendency to match distinct features or dimensions of experience across sensory modalities as crossmodal correspondences. There are four main types of crossmodal correspondences: structural, statistical, emotional, and semantic. Structural correspondence arises from the peculiarities of the neural systems when the sensory information is coded; for example, some correspondences arise when two unimodal stimulus properties are represented by the same neural substrate or processed in neighboring or interconnected brain areas (e.g., brightness–loudness; Lewkowicz and Turkewitz, 1980; Ramachandran and Hubbard, 2001; Walsh, 2003; Mondloch and Maurer, 2004; Rouw and Scholte, 2007; Knöferle and Spence, 2012). In addition, researchers reported that some correspondences are innate (e.g., brightness–auditory pitch; Ludwig et al., 2011), though other researchers argued that the correspondence could be acquired by correlations in the environment (Spence and Deroy, 2012a). Statistical correspondence is acquired through statistical learning with repeated exposures to co-occurrences in the natural environment (a Bayesian prior, e.g., lightness–position; Parise and Spence, 2013; Parise et al., 2014; Brunel et al., 2015). Emotional correspondence arises based on the emotional associations that people have with sensory stimuli (e.g., the valence or arousal; music–color; Palmer et al., 2013; Wang et al., 2016; Turoman et al., 2018; Aryani et al., 2020; Motoki et al., 2020; Spence, 2020). Semantic correspondence stems from the linguistic terms or semantic information underlying these sensory properties (e.g., “high/low” pitch in sound–position; Melara and Marks, 1990; Chen et al., 2015a; Velasco et al., 2016b). These accounts of crossmodal correspondence are intertwined and not mutually exclusive and some crossmodal correspondences could be explained by combinations of more than one hypothesis (Spence, 2011).
Crossmodal correspondences between visual features (color/shape) and basic tastes have been widely studied, and specific color–taste/shape–taste associations have been observed (e.g., yellow–sour, red–sweet, angular shapes–sour/bitter, and round shapes–sweet associations; Spence and Gallace, 2011; Spence, 2012, 2019; Spence and Ngo, 2012; Bremner et al., 2013; Wan et al., 2014; Spence et al., 2015; Velasco et al., 2015, 2016a,b; Saluja and Stevenson, 2018; Turoman et al., 2018; Higgins and Hayes, 2019; Spence and Levitan, 2021). Statistical/semantic/emotional correspondence hypotheses were suggested to explain some of these visual–taste associations. For example, color–taste associations might be explained by the statistical learning of co-occurrences in the environment (e.g., colors of foods and drinks; Spence et al., 2015; Foroni et al., 2016; Saluja and Stevenson, 2018; Higgins and Hayes, 2019; Spence, 2019). Meanwhile, shape–taste associations might be based on the semantic/emotional correspondence account, such as the hedonic dimension (Spence and Deroy, 2012b, 2013a; Salgado-Montejo et al., 2015; Velasco et al., 2015, 2016b; Blazhenkova and Kumar, 2018; Turoman et al., 2018; Motoki and Velasco, 2021). In addition, Wan et al. (2014) examined visual (color/shape/texture)–taste associations among participants from four different cultures (i.e., China, India, Malaysia, and the United States). They found that some visual (color/shape)–taste associations are immune to cultural backgrounds, and some are culturally specific, implying the different natures of visual–taste associations. Simultaneously, studies have shown that people also systematically associate geometric shapes with colors (e.g., circle–red and triangle–yellow), which might be explained by statistical/emotional/semantic correspondence hypotheses (Albertazzi et al., 2013; Malfatti, 2014; Chen et al., 2015a, 2016; Dreksler and Spence, 2019; Hanada, 2019). Possibly, people learned to establish crossmodal correspondences between colors, shapes, and tastes and exploit that mapping information (i.e., a Bayesian prior) to integrate multisensory features efficiently (Spence, 2011; Parise and Spence, 2013; Spence and Deroy, 2013b; Chen et al., 2015b; Chen and Watanabe, 2021).
Autism spectrum disorder (ASD) refers to a type of neurodevelopmental disorder, characterized by behavioral dysfunctions in specific developmental areas, such as social interaction, communication, and a restricted range of interests and stereotyped behaviors (American Psychiatric Association, 2013). In addition to social and behavioral symptoms, people with ASD are reported to have difficulties in sensory processing, including over- or under-sensitivity to sensory stimuli, and deficits in multisensory integration (Iarocci and McDonald, 2006; Bennetto et al., 2007; Oberman and Ramachandran, 2008; Foss-Feig et al., 2010; Cascio et al., 2012a; Tavassoli and Baron-Cohen, 2012; Occelli et al., 2013; Stevenson et al., 2014a; Wallace and Stevenson, 2014; DuBois et al., 2017). The impaired ability to integrate multisensory information in individuals with ASD may arise from an underlying impairment in perceiving the relationships between cross-modal inputs (Stevenson et al., 2014a). For example, the most studied “bouba–kiki” effect (i.e., people associate rounded shapes with words like “bouba” or “maluma,” and spiky shapes with words like “kiki” or “takete”; Köhler, 1947) was reported to be less pronounced in individuals with autism compared to controls (Oberman and Ramachandran, 2008; Occelli et al., 2013; Gold and Segal, 2017; Król and Ferenc, 2020). Oberman and Ramachandran (2008) found that children with ASD do not show the “bouba–kiki” effect that neurologically typical adults and children show (the neurotypical children chose expected sound–shape associations 88% of the time, while children with ASD chose only 56% of the time, compared to the chance of 50%). They suggested that an impairment in multisensory integration systems, such as a mirror neuron-like system, prevents the systematic bias for sound–shape mappings in individuals with autism (Iarocci and McDonald, 2006; Rizzolatti et al., 2009). Sensory irregularity in autism may hinder the construction of structural correspondences (Ramachandran and Hubbard, 2001). While individuals with autism were suggested to exhibit impaired ability to integrate multisensory signals, some showed intact or excess integration of low-level multisensory information (e.g., audio–visual integration; Mottron and Burack, 2001; Foss-Feig et al., 2010; Kwakye et al., 2011; Stevenson et al., 2014b). A Bayesian prior framework posits that, individuals with autism perceive the world as a consequence of hypo-priors or reduced reliance on previous perceptual experiences, and that the current sensory input is given proportionately greater weight than the learned priors, resulting in prediction errors, which may be related to atypical multisensory integration (Mitchell and Ropar, 2004; Fiser et al., 2010; Pellicano and Burr, 2012; Van Boxtel and Lu, 2013; Robertson and Baron-Cohen, 2017; Stevenson et al., 2017). Some visual–taste associations are suggested to be statistically constructed; it is possible that the autistic traits interfere with the statistical learning experience and consequently, influence those crossmodal correspondences.
Studies suggested that individuals with ASD, especially in children with ASD, exhibited more restricted food preferences than the typically developed controls, which may be related to atypical sensory processing of visual (color/shape), taste, smell, and/or texture sensory information in autistic perception (Shore, 2001; Lane et al., 2014; Zobel-Lachiusa et al., 2015; Chistol et al., 2018). To our knowledge, there is almost no study that examined crossmodal correspondences between taste perception and other sensory dimensions in individuals with ASD. Learning the influence of autistic traits on crossmodal correspondence between taste and visual (color/shape) may help to shed light on the eating problems in ASD. In the present study, we aimed to examine the relationship between visual (color–shape)–taste associations and autistic tendency to reveal the effect of autistic traits on these associations. It has been suggested that ASD characteristics are continuously distributed in the general population (Baron-Cohen et al., 2001). The Autism-Spectrum Quotient (AQ) has been developed as a measure to assess autistic traits among typical-intelligence individuals both with and without ASD diagnoses (Baron-Cohen et al., 2001; Wakabayashi et al., 2004, 2006). Here, an online questionnaire survey with a short version of the AQ questionnaire (AQ-10) was used (Kurita et al., 2005; Booth et al., 2013; Maeda et al., 2017). We predicted that participants would show specific visual(color–shape)–taste associations, which were correlated with the autistic tendency, and the participants with higher AQ scores show fewer of the consensual (i.e., commonly agreed) visual–taste associations. Furthermore, we used the same visual color and shape stimuli and the forced choice method from a previous study, with the aim to compare visual(color/shape)–taste associations in Japanese and that from the other four cultural backgrounds (i.e., China, India, Malaysia, and the United States; Wan et al., 2014).
Materials and Methods
Participants
Eighty-five Japanese (52 females; 57 participants were 15–29years old, 20 participants were 30–49years old, and eight participants were above 50years of age) volunteered to participate in an online questionnaire survey. Sample size was determined by the criteria that are needed to be able to detect a correlation coefficient of 0.3 with an alpha of 0.05 and power of 80% (Bujang and Baharum, 2016). The participants were mainly from research participant pools of the National Rehabilitation Center for Persons with Disabilities and students of Waseda University. Eleven participants reported being diagnosed with developmental disorders (four participants with ASD, one participant with ADHD, one participant with intellectual disability, one participant with learning disability, two participants with depression, one participant with panic disorder, and one participant with cyclic vomiting syndrome). Three participants who filled out the questionnaire with missing responses were excluded, and 82 participants’ responses were used for data analysis. All participants were Japanese and agreed to participate in the questionnaire survey. This study was reviewed and approved by the Ethics Committee of the National Rehabilitation Center for Persons with Disabilities (2020-082).
Materials
This study was conducted using Google forms (see Supplementary Material for details).1 The questionnaire was presented in Japanese. Text descriptors of “甘味(sweet),” “酸味(sour),” “旨味(umami),” “苦味(bitter),” and “塩味(salty)” were used as the five basic taste terms, presented in Japanese MS Gothic font size 9. The text description and the image were presented with a white background, and the questionnaire survey was designed with a gray background (RGB: 240, 240, 240).
The 11 color patches and 15 geometric shapes were used as visual stimuli (Wan et al., 2014). The color patches included: Black (RGB: 0, 0, 0), Blue (RGB: 0, 0, 255), Brown (RGB: 165, 42, 42), Green (RGB: 0, 255, 0), Gray (RGB: 128, 128, 128), Orange (RGB: 255, 165, 0), Pink (RGB: 255, 192, 203), Purple (RGB: 128, 0, 128), Red (RGB: 255, 0, 0), White (RGB: 255, 255, 255), and Yellow (RGB: 255, 255, 0). The geometric shape stimuli were created using the Adobe Illustrator CC program (Adobe Systems Incorporated-2021). They were drawn in black ink in 1pt. line width, including Arrow, Asymmetrical star, Blob, Circle, Cloud, Cross, Diamond, Drop, Ellipse, Heart, Moon, Rectangle, Square, Star, and Triangle (as shown in Figure 1). In the first session of color–taste associations, the color stimulus was presented at the center of the screen in 190×190pixels. In the second session of the shape–taste associations, the shape stimulus was fitted in a 150×150-pixel-box. In the third session of the shape–color associations, the shape stimuli were the same as in the second session, and the color patches as choices were listed vertically in random in 38×38pixels.
Figure 1. The 15 shape stimuli used in the study.
Design and Procedure
In this study, the participants undertook four sequential sessions (color–taste matching task, shape–taste matching task, shape–color matching task, and AQ-10 survey session). In addition, questionnaires on preference ratings, taste expectation, taste perception, and food behavior from other studies were simultaneously conducted. At the beginning of the online questionnaire survey, participants read the instructions and gave the consent to participate in it. After participants agreed to join by clicking the “agree” button, they were asked to fill in their demographic information, including age range, gender, diagnosed mental disorder, and birthplace. Participants were, then, prepared for the questionnaire survey. During the first session of the color-taste matching task, a color patch was presented at the center of the screen, and participants were asked to choose a taste that best matched the color of the five vertically listed basic taste words (i.e., sweet, sour, salty, umami, and bitter), by clicking on the taste word. Participants were directed to the Wikipedia website for an explanation of the term “Umami.” After making the choice, participants were asked how confident they were on their preceding match, indicated on a five-point horizontal scale with the following options, arranged from left to right: very unconfident (I am not sure and have chosen completely randomly), unconfident, neutral, confident, and very confident (I am very sure and confident about this match). The procedure was identical for the three matching tasks (i.e., color–taste, shape–taste, and shape–color). The color and shape targets were presented in the same order for all participants, and the choices were presented in random order. The shape targets in the shape–taste and shape–color matching tasks were presented in different orders.
Finally, the participants completed a Japanese version of the AQ-10 questionnaire survey (Kurita et al., 2005; Maeda et al., 2017). The AQ-10 is a short version of the self-reported AQ-50 questionnaire that was developed to meet the need for a brief and sensitive screen for ASD (Allison et al., 2012; Booth et al., 2013). Participants were asked to rate the degree to which the content of each item fits them on a four-point Likert scale (“definitely agree,” “slightly agree,” “slightly disagree,” and “definitely disagree”). For example, item 1 states, “I prefer to do things with others rather than on my own.” The AQ was scored using a binary Likert scoring method (1-1-0-0; Baron-Cohen et al., 2001), that items that participants indicated either definite or slightly agreement with an autism trait were given a score of 1 and otherwise 0. A total AQ score was calculated by summing all scores for each item (1–10). Higher AQ scores indicate a greater magnitude of ASD traits. The sample of participants with the AQ score distribution is shown in Figure 2. To further understand the effect of autistic traits, participants were divided into three groups. While a score over 6 is considered the cut-off for a suspicion of ASD (National Institute for Health and Clinical Excellence, 2012; Booth et al., 2013; Murray et al., 2017), to balance the sample size across the three AQ groups, we used an AQ score of 5 as the criterion for the high AQ group (AQ≥5; 29 participants), an AQ score of 2 as the criterion for the low AQ group (AQ≤2; 28 participants), and participants with an AQ score between them were grouped into the medium AQ group (AQ=3, 4; 25 participants).
Figure 2. Distribution of participants’ AQ scores.
Data Analysis
At first, the frequency of taste choice for each color (color–taste associations), the frequency of taste choice for each shape (shape–taste associations), and the frequency of color choice for each shape (shape–color associations) were calculated, respectively. A Chi-square test for independence was conducted to assess whether some choices were chosen more frequently than the others for certain targets. Moreover, adjusted residual analysis was used to show which choice was significantly associated with a certain target (i.e., the consensual color–taste/shape–taste/shape–color associations). Then, the proportion of making the consensual choices (i.e., significant cross-modal associations) in each participant was calculated. For example, if some participant chooses all the significantly associated tastes for each color, the proportion of the consensual color–taste associations should be 1. The AQ scores were not normally distributed (W=0.90, p<0.001; Shapiro–Wilk’s test); thus, log-transformed AQ scores were used in the analysis (Alan, 2010). Correlation analyses were performed between the proportions of consensual cross-modal associations and the autistic traits (i.e., log-transformed AQ scores; Pearson’s method; Hidaka and Yaguchi, 2018). Further, one-way Analysis of Variance (ANOVA) was used to examine the differences between the three AQ groups (i.e., high/medium/low AQ group) on the proportion of the consensual cross-modal associations in order to clarify overall trends. Data analyses were performed with R 4.0.0 software (R Core Team, 2020).
Results
Color–Taste Associations
The frequency of the taste choices for each color is shown in Figure 3 (see Supplementary Table S1 for more details). The Chi-square test for independence showed significant associations between colors and tastes (x2=1298.7, df=40, p<0.001, Cramer’s V=0.60). The adjusted residual analysis showed which taste was chosen more frequently than expected by chance for each color (a positive residual value indicates more frequently chosen than expected and a negative residual indicates less frequently chosen than expected; here, only positive residuals were used; Agresti, 2007; Chen et al., 2015a). Significant associations were observed between Pink and Sweet (z=17.19, p<0.001; Bonferroni corrected z>3.32, p<0.05; to test all 55 cells in the contingency table, the new alpha level is α=0.05/55=0.00091, with the corresponding critical value z=N(0,1)1- α/2=3.32); Yellow and Sour (z=15.41); Orange and Sour (z=9.69); Blue and Salty (z=7.43); White and Salty (z=13.23); Green and Bitter (z=11.82); Black and Bitter (z=10.53); Brown and Umami (z=10.92); Red and Umami (z=5.57); Gray and Salty (z=5.40); Gray and Bitter (z=4.35); Purple and Bitter (z=3.32).
Figure 3. Frequency of taste choices for each color. Note that the frequency of the sweet, sour, salty, bitter, and umami taste terms for the color stimuli are represented by the fill-in colors pink, yellow, white, green, and brown, respectively.
The averaged confidence ratings for each of the observed color–taste associations were calculated. A significant correlation was observed between the choice frequency and the confidence rating of each color–taste association (r=0.28, p=0.04). Thus, the participants were more confident when making the more consensual color–taste associations.
Color–Taste Associations and AQ Scores
The proportion of making the consensual color–taste associations (i.e., 12 significant color–taste associations) in each participant was calculated. Correlation analysis showed that the proportion of consensual color–taste associations and log (AQ) scores was significantly correlated (r=−0.24, p=0.027). Participants with lower AQ scores chose the more of the consensual color–taste associations. One-way ANOVA showed that the proportion of choosing consensual color–taste associations were significantly different among the three AQ groups [see Figure 4; F(2, 79)=6.68, p=0.002, ηp2=0.14]. A post hoc pairwise comparison showed that the proportion of consensual color–taste associations in the low AQ group (mean=0.77, SD=0.16) was higher than those in the medium AQ group (mean=0.62, SD=0.16; Tukey’s HSD, p=0.003), and the high AQ group (mean=0.64, SD=0.16; Tukey’s HSD, p=0.008), and no difference between the medium and high AQ groups (Tukey’s HSD, p=0.91). Thus, participants in the low AQ group chose more of the consensual color–taste associations than those in the medium and high AQ groups.
Figure 4. Proportion of consensual color–taste associations in the three AQ groups. Error bar represents the standard mean error. Asterisks indicate significant differences (**p<0.01).
Shape–Taste Associations
The frequency of taste choices for each shape was calculated (Figure 5; Supplementary Table S2). The Chi-square test for independence showed that shapes and tastes were significantly associated (x2=998.84, df=56, p<0.001, Cramer’s V=0.45). The adjusted residual analysis showed that some tastes were chosen more frequently for specific shapes. For example, shapes with sharp angles were significantly associated with sour taste (e.g., Triangle: z=8.43; Star: z=6.69; Asymmetrical Star: z=11.61; Arrow: z=4.09; Bonferroni corrected z>3.40, p<0.05; to test all 75 cells in the contingency table, the new alpha level is α=0.05/75=0.00067, with the corresponding critical value z=N(0,1)1-α/2=3.40); round shapes were significantly associated with sweet taste (Heart: z=14.91, Circle: z=7.72, Cloud: z=5.32, Drop: z=5.86); right-angled shapes were significantly associated with salty taste (Rectangle: z=4.72, Diamond: z=7.29, Square: z=5.29). Other significant associations were observed between Ellipse and Umami (z=6.44), Blob and Bitter (z=7.92), and Cross and Bitter (z=4.93).
Figure 5. Frequency of taste choices for each shape. Note that the frequency of the sweet, sour, salty, bitter, and umami taste terms for the shape stimuli are represented by the fill-in colors pink, yellow, white, green, and brown, respectively.
The averaged confidence ratings for each of the observed shape–taste associations were calculated. A significant correlation was observed between the choice frequency and the confidence ratings of each shape–taste association (r=0.29, p=0.015). Thus, participants were more confident when choosing the more consensual shape–taste associations.
Shape–Taste Associations and AQ Scores
The proportion of choosing significant shape–taste associations (14 in all) were calculated for each participant. Correlation analysis showed that there was no significant correlation (r=0.07, p=0.54) between the proportion of consensual shape–taste associations and log (AQ) scores. Further ANOVA analysis showed no significant difference between the three AQ groups in the proportion of consensual shape–taste associations, F(2, 79)=0.72, p=0.49, ηp2=0.02 (low AQ group: mean=0.50, SD=0.12; medium AQ group: mean=0.49, SD=0.17; high AQ group: mean=0.54, SD=0.18; Figure 6). Thus, autistic traits have little effect on the shape–taste associations.
Figure 6. Proportion of consensual shape–taste associations in the three AQ groups. Error bar represents the standard mean error.
Shape–Color Associations
The frequency of color choices for each shape was calculated (Figure 7; Supplementary Table S3). The Chi-square test showed that there were significant associations between shapes and colors (x2=2468.9, df=140, p<0.001, Cramer’s V=0.45). The adjusted residual analysis showed that some colors were chosen more frequently for specific shapes [Bonferroni corrected z>3.61, p<0.05; to test all 165 cells in the contingency table, the new alpha level is α=0.05/165=0.00030, with the corresponding critical value z=N(0, 1)1-α/2=3.61]. The results showed that a circle was associated with red (z=5.63) and pink (z=5.63), a triangle with yellow (z=5.55), and a square with blue (z=6.15). A stereotypical pattern of shape–color associations was observed, in which people chose the color for a shape based on associative learning with co-occurrence in the environment. For example, pink was chosen more frequently for the heart shape (z=23.30), yellow was chosen more frequently for star (z=15.23), moon (z=15.50), and asymmetrical star (z=7.76) shapes, white for a cloud (z=18.79), blue for a drop (z=17.38), red for a cross (z=14.30), and so on. Other significant associations were observed between arrow with red (z=7.63), blob with green (z=7.42) and purple (z=6.78), ellipse and orange (z=5.32), and rectangle and brown (z=5.04). In order to restrain the observed significant shape–color associations, more Chi-square tests for goodness of fit and residual analysis were used on each shape to further test whether the color choices were still significant. Finally, the blob-purple (z’=1.77) and rectangle-brown (z’=0.31) associations failed to reach significance and were excluded from further analysis.
Figure 7. Frequency of color choices for each shape.
The averaged confidence ratings for each of the observed shape–color association were calculated. A significant correlation was observed between the choosing frequency and the confidence ratings of each shape–color association (r=0.39, p<0.001). Thus, participants were more confident when choosing the more consensual shape–color associations.
Shape–Color Associations and AQ Scores
Correlation analysis between the proportion of the 14 significant shape–color associations and the log (AQ) scores showed a significant correlation (r=−0.29, p=0.007). Further ANOVA analysis showed that there was a significant difference in the proportion of choosing consensual shape–color associations between the three AQ groups [see Figure 8; F(2, 79)=4.35, p=0.016, ηp2=0.10]. A post hoc pairwise comparison showed that the proportion of participants choosing consensual shape–color associations in the low AQ group (mean=0.65, SD=0.13) was higher than that of the high AQ group (mean=0.54, SD=0.15; Tukey’s HSD, p=0.009), and similar to that of the medium AQ group (mean=0.59, SD=0.15; Tukey’s HSD, p=0.34). Moreover, there was no significant difference between the high and medium AQ groups (Tukey’s HSD, p=0.31).
Figure 8. Proportion of consensual shape–color associations in the three groups. Error bar represents the standard mean error. Asterisks indicate significant differences (**p<0.01).
Discussion
In the present study, we investigated the color–taste/shape–taste/shape–color associations in Japanese participants and the relationship between these associations and the autistic traits. The results showed that the participants established strong color–taste/shape–taste/shape–color associations (e.g., yellow–sour, triangle–sour, and triangle–yellow), which are consistent with previous findings (Wan et al., 2014; Chen et al., 2015a; Spence et al., 2015; Velasco et al., 2015, 2016a; Spence, 2019). Moreover, significant associations were observed between the proportion of choosing consensual color–taste/shape–color associations and autistic traits. That is, the participants with higher AQ scores chose fewer of the consensual color–taste/shape–color associations, while there was no difference in shape–taste associations. Thus, the autistic traits might play a role in the construction of color–taste/shape–color associations.
When forced to choose a taste matching a color, our participants showed specific patterns of color–taste associations. For example, pink color was associated with sweet, yellow and orange colors were associated with sour, green with bitter, blue with salty, brown and red with umami. For non-chromatic colors, white was associated with salty, black with bitter, and gray with both salty and bitter tastes. These results were consistent with previous findings, suggesting associations between red/pink with sweet, yellow with sour, white/blue with salty, black/green with bitter among different culture backgrounds (Déribéré, 1978; O’Mahony, 1983; Koch and Koch, 2003; Skrandies and Reuther, 2008; Tomasik-Krótki and Strojny, 2008; Wan et al., 2014; Spence et al., 2015; Saluja and Stevenson, 2018; Spence and Levitan, 2021). These color–taste mapping may come from statistical learning with colors of foods/drinks in the world (e.g., pink pairing with sweet candy, green vegetables tasting bitter, and yellow lemons tasting sour; Koch and Koch, 2003; Spence et al., 2015; Saluja and Stevenson, 2018; Higgins and Hayes, 2019). Culturally specific color–taste associations were also observed; for example, Japanese people associated brown/red with umami tastes, while no specific color–umami association was observed among four cultural backgrounds in a previous study (Tomasik-Krótki and Strojny, 2008; Wan et al., 2014; Saluja and Stevenson, 2018). This might be related to the fact Japanese people are more familiar with the umami taste and thus, the taste is more important due to its significant involvement in Japanese daily food behavior (Kawamura and Kare, 1987; Lindemann et al., 2002; Lioe et al., 2010). It is well-known that the umami taste is first identified by a Japanese chemist – Ikeda Kikunae in 1909, referring to the savory taste from meat or seaweed. Ikeda also suggested that umami taste would be associated with yellow and red colors (Ikeda, 2002). Here, the observed brown/red-umami associations might be stemmed from the Japanese seasoning sources (e.g., “Miso,” “soy source,” and so on) which are mainly colored in brown and red (Otsuka, 1998; Lioe et al., 2010; Hajeb and Jinap, 2015). Compared with a previous study using the same color stimuli (Wan et al., 2014), robust color–taste associations were observed in Japanese people (see Figure 3). Around 80% of the participants chose sweet taste for pink, sour for yellow, bitter for green, salty for white, and bitter for black, suggesting that our participants were highly consistent with the taste choices for some colors. It should be noted that most of the participants were from east Japan and thus, might share a highly similar regional food behavior. These results provide further evidence for the correspondence hypothesis between colors and tastes (Koch and Koch, 2003; Spence et al., 2015; Higgins and Hayes, 2019; Spence, 2019; Spence and Levitan, 2021).
Specific shape–taste associations were also observed. For example, sharp shapes were associated with sour (e.g., asymmetrical star, star, triangle, and arrow), rounded shapes were associated with sweet (e.g., heart, circle, drop, and cloud) and umami (i.e., ellipse), and right-angled shapes were associated with salty (e.g., diamond, rectangle, and square). These results showed both consistent and culturally specific shape–taste associations [e.g., associations between cross/rectangle/square with bitter, and cloud/heart/star with sweet in Wan et al. (2014); round shapes associate with sweet tastes, angular shapes associate with sour/bitter/salty taste in Spence and Ngo (2012) and Velasco et al. (2015, 2016b)]. Specifically, Japanese people showed umami–ellipse and right-angled shape–salty associations. Similarly, as the umami taste is more familiar to Japanese people, it allows them to establish specific associations with both colors and shapes. When mapped onto colors, both umami and sweet were associated with red (umami–red/brown and sweet–red/pink). For shape–taste associations, both umami and sweet were associated with rounded shapes (umami–ellipse and sweet–circle/heart/drop/cloud). This might be related to the similarity between umami and sweet taste (e.g., familiarity and pleasantness; Obrist et al., 2014; Spence and Levitan, 2021), and/or that their sensory receptors share some common subunit (Li et al., 2002). Obrist et al. (2014) described both umami and sweet taste as full, mouth-filling experience, and umami also tasted as with lots of things to it, which may lead to the umami–ellipse association. Several studies proposed emotional/semantic correspondence hypotheses to explain shape–taste associations (Spence and Deroy, 2012b, 2013a; Salgado-Montejo et al., 2015; Velasco et al., 2015, 2016b,c; Blazhenkova and Kumar, 2018; Turoman et al., 2018; De Sousa et al., 2020; Hamamoto et al., 2020; Motoki and Velasco, 2021). For example, Velasco et al. (2016b) suggested that semantic meanings (e.g., hedonic) underlying shapes and tastes could explain some of the shape–taste associations. Turoman et al. (2018) showed that the affective factors of pleasantness and threat underlie some shape–taste correspondences. The observed shape–taste associations might stem from a common semantic basis. For instance, both the sharp shapes and sour taste may convey some exciting/stimulating semantic meanings, and the round shapes and sweet taste may share hedonic/pleasant semantic information, leading to these shape–taste associations.
For the shape–color associations, we observed that our participants tended to associate shapes with colors more frequently encountered in the environment. For example, moon and star shapes were associated with yellow, heart with pink, cloud with white, drop with blue, and cross/arrow with red. The heart–pink association (instead of heart–red) might be related to the Japanese cultural background, that Japanese people often use pink–heart related symbols to express “Kawaii (lovely/cute)” emotion/semantic meanings. Thus, the co-occurrences and regularities in the world might lead to some of the observed shape–color associations (Jacobsen and Wolsdorff, 2007; Chen et al., 2015a; Hanada, 2019). Moreover, for some geometric shapes, such as circle associated with red and pink, triangle with yellow, and square with blue, these associations were consistent with previous findings, and some might be explained by semantic associations (e.g., “warm/cold”; Albertazzi et al., 2013; Chen et al., 2015a, 2016). Strictly speaking, shape–color associations are intramodal, mostly studied within visual dimensions, and grounded in the field of crossmodal correspondence (Dreksler and Spence, 2019). Colors and shapes are commonly used in crossmodal correspondences, while the associations between colors and shapes have been relatively less studied. Learning shape–color associations can provide further evidence for the connections between sensory dimensions. Future studies may examine the relationship between intramodal and crossmodal correspondences to better understanding the binding of sensory information.
The ability to establish specific crossmodal correspondences between sensory dimensions could be influenced by individual differences (Bremner et al., 2013; Fernández-Prieto et al., 2015; Hamilton-Fletcher et al., 2018). Here, we observed that our participants with higher AQ scores tended to make fewer of the consensual color–taste/shape–color associations, suggesting that the autistic traits play a role in constructing crossmodal correspondences. This result was consistent with previous findings that individuals with autism showed atypical sensory processing and deficits in binding sensory information across modalities (Oberman and Ramachandran, 2008; Foss-Feig et al., 2010; Cascio et al., 2012a; Kujala et al., 2013; Occelli et al., 2013; Visser et al., 2013; Stevenson et al., 2014b, 2016; Wada et al., 2014; Gold and Segal, 2017; Król and Ferenc, 2020; Yaguchi and Hidaka, 2020), as evident in audio–visual processing (Gelder et al., 1991; Mongillo et al., 2008; Irwin et al., 2011; Collignon et al., 2013; Bebko et al., 2014; Stevenson et al., 2014b; Hidaka and Yaguchi, 2018), audio–tactile processing (Russo et al., 2010), and visual–tactile processing (Cascio et al., 2012a; Noel et al., 2020). For example, Occelli et al. (2013) found that children with ASD showed lower proportion of expected takete–maluma associations, and the performance varied as a function of the severity of the symptomatology. Hidaka and Yaguchi (2018) showed that the brightness–loudness association and a newly learned association (motion direction–pitch pair) correlated with autistic traits, suggesting that ASD traits are involved in sensory associative learning. According to the Bayesian priors (“hypo-priors”) hypothesis, the sensory-perceptual representations of the world are built based on a Bayesian statistic; based on prior knowledge, a weighted, generated model is constructed from sensory inputs and an internal probability map. Individuals with autism tend to have a decreased ability to perform statistical learning with co-occurrences and regularities in the environment, leading to difficulties in associating and integrating sensory information across modalities (Pellicano and Burr, 2012; Stevenson et al., 2014a, 2017). The autistic effect was observed on color–taste/shape–color associations, which might be mainly constructed through statistical learning with regularities in the environment (Koch and Koch, 2003; Spence et al., 2015; Saluja and Stevenson, 2018; Hanada, 2019; Higgins and Hayes, 2019; Spence, 2019), while no significant autistic effect was observed on shape–taste associations, which might be mainly explained by semantic meaning correspondences (e.g., hedonic dimensions; Salgado-Montejo et al., 2015; Velasco et al., 2015, 2016b,c; Blazhenkova and Kumar, 2018; Turoman et al., 2018; De Sousa et al., 2020; Hamamoto et al., 2020; Motoki and Velasco, 2021). Some studies suggested that the semantic/pleasant ratings on sensory inputs are similar between individuals with autism and controls (Cascio et al., 2012b; Galle et al., 2013; Damiano et al., 2014; Singh, 2019). For example, Damiano et al. (2014) reported that individuals with ASD and neurotypical controls showed no differences in hedonic response to sweet taste. Moreover, shape–taste associations are likely different in nature from color–taste associations. Given flavors always have colors attached whereas flavors often do not have a shape, as in drinks that simply conform to the receptacle in which they are placed (Spence and Deroy, 2012b, 2013a). Besides, the consensual shape–taste associations (mean frequency=51.39%, SD=14.37) were relatively weaker than the consensual color–taste associations (mean frequency=62.09%, SD=17.82) and shape–color associations (mean frequency=55.31%, SD=22.91), which might influence the strength of relationship with autistic traits.
One limitation of the present study is that we used the Japanese Kanji word “旨味 (Umami)” to represent the “うま味 (Umami)” in the questionnaire. The word “うま味 (Umami)” is the technical word for the umami taste, while the “旨味 (Umami)” also indicates deliciousness. According to multiple Japanese dictionaries (e.g., Digital Daijisen and Wikipedia), both of them convey the same meaning of umami taste. Another limitation is that the four sessions (i.e., color–taste association, shape–taste association, shape–color association, and AQ survey) in the questionnaire were sequentially presented due to the questionnaire design of the platform. It may influence the choices that participants made. Future studies should present different sessions in a randomized order. In addition, we used the forced choice method for the questionnaire to meet the previous study (Wan et al., 2014). In some combinations, multiple associations could exist in some participants, and thus, using Check-All-That-Apply (CATA) method might be considered in future studies (Dooley et al., 2010).
For background of the limited food preference, not only the associations between taste (color/shape) and vision but also various factors, such as texture, sound, and smell, could be important. It would be interesting to investigate the relationship between autistic traits and other crossmodal correspondences, such as sound–taste association (Wang et al., 2016; Motoki et al., 2020), as well as their relationship to the limited food preference in ASD.
In summary, the present study showed specific and robust color–taste/shape–taste/shape–color associations in Japanese people with some culturally specific influences on the observed associations. Moreover, the degree of autistic traits was found to be related to the strength of color–taste/shape–color associations, but not to shape–taste associations. This might be explained by a Bayesian prior hypothesis that autistic perception may have different levels of statistical learning with regularities in the world, leading to a lower prior knowledge effect on constructing those learned associations. These results provide further evidence for the “hypo-priors” account for autistic perception and shed light on the nature of visual–taste associations. Future studies may work on crossmodal correspondences in diagnosed ASD patients, to further address the associative learning effect using novel crossmodal correspondences, and to better understand the autistic effect on such correspondences.
Data Availability Statement
The datasets presented in this study can be found in online repositories. The names of the repository/repositories and accession number(s) can be found in the article/Supplementary Material.
Ethics Statement
This study was reviewed and approved by the Ethics Committee of the National Rehabilitation Center for Persons With Disabilities (2020-082). This study was conducted online, participants agreed to join the study by clicking the “agree” button at the beginning of the online questionnaire survey, after they read the instruction of participating in the study. Participants under 18 joined the questionnaire with the agreement of their legal guardian/next of kin.
Author Contributions
NC, KW, and MW designed and performed the experiments. NC analyzed the data and wrote the manuscript. KW and MW provided the critical revisions. All authors contributed to the article and approved the submitted version.
Funding
This work was supported by the Grant-in-Aid for Scientific Research (grant numbers: 17H06344, 17H00753, 19K22885, 20H04595, 20K22296, 21K13759, and 21H05053) from the Japan Society for the Promotion of Science.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Acknowledgments
We would like to thank Yukie Tsuchizaki, Mio Ozaki, Shinya Yamamoto, Koyo Nakamura, and Michiko Yoshie for helping with the participant recruiting, Naomi Ishii for her technical assistance, and Reiko Fukatsu for her continuous encouragement.
Supplementary Material
The Supplementary Material for this article is available at: https://www.frontiersin.org/articles/10.3389/fpsyg.2021.714277/full#supplementary-material
Footnotes
References
Agresti, A. (2007). Categorical Data Analysis: Wiley Series in Probability and Statistics. 2nd Edn. Hoboken, NJ: Wiley.
Alan, C. L. (2010). Perceptual compensation is correlated with individuals' “autistic” traits: implications for models of sound change. PLoS One 5:e11950. doi: 10.1371/journal.pone.0011950
Albertazzi, L., Da Pos, O., Canal, L., Micciolo, R., Malfatti, M., and Vescovi, M. (2013). The hue of shapes. J. Exp. Psychol. Hum. Percept. Perform. 39, 37–47. doi: 10.1037/a0028816
Allison, C., Auyeung, B., and Baron-Cohen, S. (2012). Toward brief “Red Flags” for autism screening: the short autism spectrum quotient and the short quantitative checklist in 1,000 cases and 3,000 controls. J. Am. Acad. Child Adolesc. Psychiatry 51, 202–212.e7. doi: 10.1016/j.jaac.2011.11.003
American Psychiatric Association (2013). Diagnostic and Statistical Manual of Mental Disorders (DSM-5). Washington, DC, USA: American Psychiatric Press, Inc.
Aryani, A., Isbilen, E. S., and Christiansen, M. H. (2020). Affective arousal links sound to meaning. Psychol. Sci. 31, 978–986. doi: 10.1177/0956797620927967
Baron-Cohen, S., Wheelwright, S., Skinner, R., Martin, J., and Clubley, E. (2001). The autism-spectrum quotient (AQ): evidence from Asperger syndrome/high-functioning autism, males and females, scientists and mathematicians. J. Autism Dev. Disord. 31, 5–17. doi: 10.1023/A:1005653411471
Bebko, J. M., Schroeder, J. H., and Weiss, J. A. (2014). The McGurk effect in children with autism and Asperger syndrome. Autism Res. 7, 50–59. doi: 10.1002/aur.1343
Bennetto, L., Kuschner, E. S., and Hyman, S. L. (2007). Olfaction and taste processing in autism. Biol. Psychiatry 62, 1015–1021. doi: 10.1016/j.biopsych.2007.04.019
Blazhenkova, O., and Kumar, M. M. (2018). Angular versus curved shapes: correspondences and emotional processing. Perception 47, 67–89. doi: 10.1177/0301006617731048
Booth, T., Murray, A. L., McKenzie, K., Kuenssberg, R., O’Donnell, M., and Burnett, H. (2013). Brief report: an evaluation of the AQ-10 as a brief screening instrument for ASD in adults. J. Autism Dev. Disord. 43, 2997–3000. doi: 10.1007/s10803-013-1844-5
Bremner, A. J., Caparos, S., Davidoff, J., de Fockert, J., Linnell, K. J., and Spence, C. (2013). “Bouba” and “Kiki” in Namibia? A remote culture makes similar shape–sound matches, but different shape–taste matches to westerners. Cognition 126, 165–172. doi: 10.1016/j.cognition.2012.09.007
Brunel, L., Carvalho, P. F., and Goldstone, R. L. (2015). It does belong together: cross-modal correspondences influence cross-modal integration during perceptual learning. Front. Psychol. 6:358. doi: 10.3389/fpsyg.2015.00358
Bujang, M. A., and Baharum, N. (2016). Sample size guideline for correlation analysis. World J. Soc. Sci. Res. 3, 37–46. doi: 10.22158/wjssr.v3n1p37
Cascio, C. J., Foss-Feig, J. H., Burnette, C. P., Heacock, J. L., and Cosby, A. A. (2012a). The rubber hand illusion in children with autism spectrum disorders: delayed influence of combined tactile and visual input on proprioception. Autism 16, 406–419. doi: 10.1177/1362361311430404
Cascio, C. J., Moana-Filho, E. J., Guest, S., Nebel, M. B., Weisner, J., Baranek, G. T., et al. (2012b). Perceptual and neural response to affective tactile texture stimulation in adults with autism spectrum disorders. Autism Res. 5, 231–244. doi: 10.1002/aur.1224
Chen, N., Tanaka, K., Matsuyoshi, D., and Watanabe, K. (2015a). Associations between colors and shapes in Japanese observers. Psychol. Aesthet. Creat. Arts 9, 101–110. doi: 10.1037/a0038056
Chen, N., Tanaka, K., Namatame, M., and Watanabe, K. (2016). Color–shape associations in deaf and hearing people. Front. Psychol. 7:355. doi: 10.3389/fpsyg.2016.00355
Chen, N., Tanaka, K., and Watanabe, K. (2015b). Color–shape associations revealed with implicit association tests. PLoS One 10:e0116954. doi: 10.1371/journal.pone.0116954
Chen, N., and Watanabe, K. (2021). Color–shape associations affect feature binding. Psychon. Bull. Rev. 28, 169–177. doi: 10.3758/s13423-020-01799-4
Chistol, L. T., Bandini, L. G., Must, A., Phillips, S., Cermak, S. A., and Curtin, C. (2018). Sensory sensitivity and food selectivity in children with autism spectrum disorder. J. Autism Dev. Disord. 48, 583–591. doi: 10.1007/s10803-017-3340-9
Collignon, O., Charbonneau, G., Peters, F., Nassim, M., Lassonde, M., Lepore, F., et al. (2013). Reduced multisensory facilitation in persons with autism. Cortex 49, 1704–1710. doi: 10.1016/j.cortex.2012.06.001
Damiano, C. R., Aloi, J., Burrus, C., Garbutt, J. C., Kampov-Polevoy, A. B., and Dichter, G. S. (2014). Intact hedonic responses to sweet tastes in autism spectrum disorder. Res. Autism Spectr. Disord. 8, 230–236. doi: 10.1016/j.rasd.2013.12.003
De Sousa, M. M., Carvalho, F. M., and Pereira, R. G. (2020). Do typefaces of packaging labels influence consumers' perception of specialty coffee? A preliminary study. J. Sens. Stud. 35:e12599. doi: 10.1111/joss.12599
Déribéré, M. (1978). Relationship between perfumes and colors. Color. Res. Appl. 3, 115–116. doi: 10.1002/col.5080030307
Dooley, L., Lee, Y. S., and Meullenet, J. F. (2010). The application of check-all-that-apply (CATA) consumer profiling to preference mapping of vanilla ice cream and its comparison to classical external preference mapping. Food Qual. Prefer. 21, 394–401. doi: 10.1016/j.foodqual.2009.10.002
Dreksler, N., and Spence, C. (2019). A critical analysis of colour–shape correspondences: examining the replicability of colour–shape associations. Iperception 10:2041669519834042. doi: 10.1177/2041669519834042
DuBois, D., Lymer, E., Gibson, B. E., Desarkar, P., and Nalder, E. (2017). Assessing sensory processing dysfunction in adults and adolescents with autism spectrum disorder: a scoping review. Brain Sci. 7:108. doi: 10.3390/brainsci7080108
Fernández-Prieto, I., Navarra, J., and Pons, F. (2015). How big is this sound? Crossmodal association between pitch and size in infants. Infant Behav. Dev. 38, 77–81. doi: 10.1016/j.infbeh.2014.12.008
Fiser, J., Berkes, P., Orbán, G., and Lengyel, M. (2010). Statistically optimal perception and learning: from behavior to neural representations. Trends Cogn. Sci. 14, 119–130. doi: 10.1016/j.tics.2010.01.003
Foroni, F., Pergola, G., and Rumiati, R. I. (2016). Food color is in the eye of the beholder: the role of human trichromatic vision in food evaluation. Sci. Rep. 6:37034. doi: 10.1038/srep37034
Foss-Feig, J. H., Kwakye, L. D., Cascio, C. J., Burnette, C. P., Kadivar, H., Stone, W. L., et al. (2010). An extended multisensory temporal binding window in autism spectrum disorders. Exp. Brain Res. 203, 381–389. doi: 10.1007/s00221-010-2240-4
Galle, S. A., Courchesne, V., Mottron, L., and Frasnelli, J. (2013). Olfaction in the autism spectrum. Perception 42, 341–355. doi: 10.1068/p7337
Gelder, B. D., Vroomen, J., and Van der Heide, L. (1991). Face recognition and lip-reading in autism. Eur. J. Cogn. Psychol. 3, 69–86. doi: 10.1080/09541449108406220
Gold, R., and Segal, O. (2017). The bouba-kiki effect and its relation to the Autism Quotient (AQ) in autistic adolescents. Res. Dev. Disabil. 71, 11–17. doi: 10.1016/j.ridd.2017.09.017
Hajeb, P., and Jinap, S. (2015). Umami taste components and their sources in Asian foods. Crit. Rev. Food Sci. Nutr. 55, 778–791. doi: 10.1080/10408398.2012.678422
Hamamoto, Y., Motoki, K., and Sugiura, M. (2020). Assessing the relationship between drive for thinness and taste–shape correspondences. Multisens. Res. 34, 69–92. doi: 10.1163/22134808-bja10030
Hamilton-Fletcher, G., Pisanski, K., Reby, D., Stefańczyk, M., Ward, J., and Sorokowska, A. (2018). The role of visual experience in the emergence of cross-modal correspondences. Cognition 175, 114–121. doi: 10.1016/j.cognition.2018.02.023
Hanada, M. (2019). Associations of visual forms with colors: the minor role of emotion as the mediator. Color. Res. Appl. 44, 568–580. doi: 10.1002/col.22382
Hidaka, S., and Yaguchi, A. (2018). An investigation of the relationships between autistic traits and crossmodal correspondences in typically developing adults. Multisens. Res. 31, 729–751. doi: 10.1163/22134808-20181304
Higgins, M. J., and Hayes, J. E. (2019). Learned color taste associations in a repeated brief exposure paradigm. Food Qual. Prefer. 71, 354–365. doi: 10.1016/j.foodqual.2018.08.013
Iarocci, G., and McDonald, J. (2006). Sensory integration and the perceptual experience of persons with autism. J. Autism Dev. Disord. 36, 77–90. doi: 10.1007/s10803-005-0044-3
Irwin, J. R., Tornatore, L. A., Brancazio, L., and Whalen, D. H. (2011). Can children with autism spectrum disorders “hear” a speaking face? Child Dev. 82, 1397–1403. doi: 10.1111/j.1467-8624.2011.01619.x
Jacobsen, T., and Wolsdorff, C. (2007). Does history affect aesthetic preference? Kandinsky's teaching of colour-form correspondence, empirical aesthetics, and the Bauhaus. Des. J. 10, 16–27. doi: 10.2752/146069207789271902
Kawamura, Y., and Kare, M. R. (1987). Umami: A Basic Taste. Physiology, Biochemistry, Nutrition, Food Science. New York, NY: Marcel Dekker.
Knöferle, K., and Spence, C. (2012). Crossmodal correspondences between sounds and tastes. Psychon. Bull. Rev. doi: 10.3758/s13423-012-0321-z [Epub ahead of print]
Koch, C., and Koch, E. C. (2003). Preconceptions of taste based on color. J. Psychol. 137, 233–242. doi: 10.1080/00223980309600611
Król, M. E., and Ferenc, K. (2020). Silent shapes and shapeless sounds: the robustness of the diminished crossmodal correspondences effect in autism spectrum conditions. Psychol. Res. 84, 1507–1516. doi: 10.1007/s00426-019-01163-9
Kujala, T., Lepistö, T., and Näätänen, R. (2013). The neural basis of aberrant speech and audition in autism spectrum disorders. Neurosci. Biobehav. Rev. 37, 697–704. doi: 10.1016/j.neubiorev.2013.01.006
Kurita, H., Koyama, T., and Osada, H. (2005). Autism-Spectrum quotient-Japanese version and its short forms for screening normally intelligent persons with pervasive developmental disorders. Psychiatry Clin. Neurosci. 59, 490–496. doi: 10.1111/j.1440-1819.2005.01403.x
Kwakye, L. D., Foss-Feig, J. H., Cascio, C. J., Stone, W. L., and Wallace, M. T. (2011). Altered auditory and multisensory temporal processing in autism spectrum disorders. Front. Integr. Neurosci. 4:129. doi: 10.3389/fnint.2010.00129
Lane, A. E., Geraghty, M. E., Young, G. S., and Rostorfer, J. L. (2014). Problem eating behaviors in autism spectrum disorder are associated with suboptimal daily nutrient intake and oral sensory over-sensitivity. Infant Child Adolesc. Nutr. 6, 172–180. doi: 10.1177/1941406414523981
Lewkowicz, D. J., and Turkewitz, G. (1980). Cross-modal equivalence in early infancy: auditory–visual intensity matching. Dev. Psychol. 16, 597–607. doi: 10.1037/0012-1649.16.6.597
Li, X., Staszewski, L., Xu, H., Durick, K., Zoller, M., and Adler, E. (2002). Human receptors for sweet and umami taste. Proc. Natl. Acad. Sci. 99, 4692–4696. doi: 10.1073/pnas.072090199
Lindemann, B., Ogiwara, Y., and Ninomiya, Y. (2002). The discovery of umami. Chem. Senses 27, 843–844. doi: 10.1093/chemse/27.9.843
Lioe, H. N., Selamat, J., and Yasuda, M. (2010). Soy sauce and its umami taste: a link from the past to current situation. J. Food Sci. 75, R71–R76. doi: 10.1111/j.1750-3841.2010.01529.x
Ludwig, V. U., Adachi, I., and Matsuzawa, T. (2011). Visuoauditory mappings between high luminance and high pitch are shared by chimpanzees (pan troglodytes) and humans. Proc. Natl. Acad. Sci. 108, 20661–20665. doi: 10.1073/pnas.1112605108
Maeda, Y., Kaneyama, Y., and Sato, H. (2017). Investigation on the autistic spectrum tendency of university student: using AQ-J-10 (in Japanese). Kansai Psychol. Res. 8, 23–29.
Malfatti, M. (2014). Shape-to-Color Associations in Non-synesthetes: Perceptual, Emotional, and Cognitive Aspects. doctoral dissertation. University of Trento.
Melara, R. D., and Marks, L. E. (1990). Processes underlying dimensional interactions: correspondences between linguistic and nonlinguistic dimensions. Mem. Cogn. 18, 477–495. doi: 10.3758/BF03198481
Mitchell, P., and Ropar, D. (2004). Visuo-spatial abilities in autism: a review. Infant Child Dev. 13, 185–198. doi: 10.1002/icd.348
Mondloch, C. J., and Maurer, D. (2004). Do small white balls squeak? Pitch-object correspondences in young children. Cogn. Affect. Behav. Neurosci. 4, 133–136. doi: 10.3758/CABN.4.2.133
Mongillo, E. A., Irwin, J. R., Whalen, D. H., Klaiman, C., Carter, A. S., and Schultz, R. T. (2008). Audiovisual processing in children with and without autism spectrum disorders. J. Autism Dev. Disord. 38, 1349–1358. doi: 10.1007/s10803-007-0521-y
Motoki, K., Saito, T., Park, J., Velasco, C., Spence, C., and Sugiura, M. (2020). Tasting names: systematic investigations of taste-speech sounds associations. Food Qual. Prefer. 80:103801. doi: 10.1016/j.foodqual.2019.103801
Motoki, K., and Velasco, C. (2021). Taste-shape correspondences in context. Food Qual. Prefer. 88:104082. doi: 10.1016/j.foodqual.2020.104082
Mottron, L., and Burack, J. A. (2001). “Enhanced perceptual functioning in the development of autism,” in The Development of Autism: Perspectives From Theory and Research. ed. P. R. Zelazo (Routledge: Lawrence Erlbaum Associates), 131–148.
Murray, K., Johnston, K., Cunnane, H., Kerr, C., Spain, D., Gillan, N., et al. (2017). A new test of advanced theory of mind: the “Strange Stories Film Task” captures social processing differences in adults with autism spectrum disorders. Autism Res. 10, 1120–1132. doi: 10.1002/aur.1744
National Institute for Health and Clinical Excellence (2012). Autism: recognition, referral, diagnosis and management of adults on the autism spectrum [CG23]. London: NICE.
Noel, J., Failla, M., Quinde-Zlibut, J., Williams, Z., Gerdes, M., Tracy, J., et al. (2020). Visual-tactile spatial multisensory interaction in adults with autism and schizophrenia. Front. Psych. 11:578401. doi: 10.3389/fpsyt.2020.578401
Oberman, L. M., and Ramachandran, V. S. (2008). Preliminary evidence for deficits in multisensory integration in autism spectrum disorders: The mirror neuron hypothesis. Soc. Neurosci. 3, 348–355. doi: 10.1080/17470910701563681
Obrist, M., Comber, R., Subramanian, S., Piqueras-Fiszman, B., Velasco, C., and Spence, C. (2014). “Temporal, affective, and embodied characteristics of taste experiences.” in Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems – CHI ‘14 ; April 26, 2014 (New York, USA: ACM Press), 2853–2862.
Occelli, V., Esposito, G., Venuti, P., Arduino, G. M., and Zampini, M. (2013). The Takete–Maluma phenomenon in autism spectrum disorders. Perception 42, 233–241. doi: 10.1068/p7357
O’Mahony, M. (1983). Gustatory responses to nongustatory stimuli. Perception 12, 627–633. doi: 10.1068/p120627
Otsuka, S. (1998). Umami in Japan, Korea, and Southeast Asia. Food Rev. Int. 14, 247–256. doi: 10.1080/87559129809541159
Palmer, S. E., Schloss, K. B., Xu, Z., and Prado-León, L. R. (2013). Music–color associations are mediated by emotion. Proc. Natl. Acad. Sci. 110, 8836–8841. doi: 10.1073/pnas.1212562110
Parise, C. V., Knorre, K., and Ernst, M. O. (2014). Natural auditory scene statistics shapes human spatial hearing. Proc. Natl. Acad. Sci. 111, 6104–6108. doi: 10.1073/pnas.1322705111
Parise, C., and Spence, C. (2013). “Audiovisual cross-modal correspondences in the general population,” in The Oxford Handbook of Synesthesia. eds. J. Simner and E. Hubbard (Oxford: Oxford University Press), 790–815.
Pellicano, E., and Burr, D. (2012). When the world becomes ‘too real’: a Bayesian explanation of autistic perception. Trends Cogn. Sci. 16, 504–510. doi: 10.1016/j.tics.2012.08.009
R Core Team (2020). R: a language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing.
Ramachandran, V. S., and Hubbard, E. M. (2001). Synaesthesia—a window into perception, thought and language. J. Conscious. Stud. 8, 3–34.
Rizzolatti, G., Fabbri-Destro, M., and Cattaneo, L. (2009). Mirror neurons and their clinical relevance. Nat. Clin. Pract. Neurol. 5, 24–34. doi: 10.1038/ncpneuro0990
Robertson, C. E., and Baron-Cohen, S. (2017). Sensory perception in autism. Nat. Rev. Neurosci. 18, 671–684. doi: 10.1038/nrn.2017.112
Rouw, R., and Scholte, H. S. (2007). Increased structural connectivity in grapheme-color synesthesia. Nat. Neurosci. 10, 792–797. doi: 10.1038/nn1906
Russo, N., Foxe, J. J., Brandwein, A. B., Altschuler, T., Gomes, H., and Molholm, S. (2010). Multisensory processing in children with autism: high-density electrical mapping of auditory–somatosensory integration. Autism Res. 3, 253–267. doi: 10.1002/aur.152
Salgado-Montejo, A., Alvarado, J. A., Velasco, C., Salgado, C. J., Hasse, K., and Spence, C. (2015). The sweetest thing: The influence of angularity, symmetry, and the number of elements on shape-valence and shape-taste matches. Front. Psychol. 6:1382. doi: 10.3389/fpsyg.2015.01382
Saluja, S., and Stevenson, R. J. (2018). Cross-modal associations between real tastes and colors. Chem. Senses 43, 475–480. doi: 10.1093/chemse/bjy033
Shore, S. M. (2001). Beyond the Wall: Personal Experiences With Autism and Asperger Syndrome. 1st Edn. Shawnee Mission, KS: Autism Asperger Publisher Co.
Singh, A. (2019). Influences of Autism Spectrum Disorder on Sensory and Emotional Responses to Smell and Taste Cues. master dissertation. University of Arkansas.
Skrandies, W., and Reuther, N. (2008). Match and mismatch of taste, odor, and color is reflected by electrical activity in the human brain. J. Psychophysiol. 22, 175–184. doi: 10.1027/0269-8803.22.4.175
Spence, C. (2011). Crossmodal correspondences: a tutorial review. Atten. Percept. Psychophys. 73, 971–995. doi: 10.3758/s13414-010-0073-7
Spence, C. (2012). Managing sensory expectations concerning products and brands: capitalizing on the potential of sound and shape symbolism. J. Consum. Psychol. 22, 37–54. doi: 10.1016/j.jcps.2011.09.004
Spence, C. (2019). On the relationship (s) between color and taste/flavor. Exp. Psychol. 66, 99–111. doi: 10.1027/1618-3169/a000439
Spence, C. (2020). Assessing the role of emotional mediation in explaining crossmodal correspondences involving musical stimuli. Multisens. Res. 33, 1–29. doi: 10.1163/22134808-20191469
Spence, C., and Deroy, O. (2012a). Crossmodal correspondences: innate or learned? Iperception 3, 316–318. doi: 10.1068/i0526ic
Spence, C., and Deroy, O. (2012b). On the shapes of tastes and flavours. Petits Propos Culinaires 97, 75–108.
Spence, C., and Deroy, O. (2013a). On the shapes of flavours: a review of four hypotheses. Theor. Hist. Sci. 10, 207–238. doi: 10.12775/ths-2013-0011
Spence, C., and Deroy, O. (2013b). How automatic are crossmodal correspondences? Conscious. Cogn. 22, 245–260. doi: 10.1016/j.concog.2012.12.006
Spence, C., and Gallace, A. (2011). Tasting shapes and words. Food Qual. Prefer. 22, 290–295. doi: 10.1016/j.foodqual.2010.11.005
Spence, C., and Levitan, C. A. (2021). Explaining crossmodal correspondences between colours and tastes. Iperception 12, 1–28. doi: 10.1177/20416695211018223
Spence, C., and Ngo, M. K. (2012). Assessing the shape symbolism of the taste, flavour, and texture of foods and beverages. Flavour 1:12. doi: 10.1186/2044-7248-1-12
Spence, C., Wan, X., Woods, A., Velasco, C., Deng, J., Youssef, J., et al. (2015). On tasty colours and colourful tastes? Assessing, explaining, and utilizing crossmodal correspondences between colours and basic tastes. Flavour 4, 1–17. doi: 10.1186/s13411-015-0033-1
Stevenson, R. A., Segers, M., Ferber, S., Barense, M. D., Camarata, S., and Wallace, M. T. (2016). Keeping time in the brain: autism spectrum disorder and audiovisual temporal processing. Autism Res. 9, 720–738. doi: 10.1002/aur.1566
Stevenson, R. A., Siemann, J. K., Schneider, B. C., Eberly, H. E., Woynaroski, T. G., Camarata, S. M., et al. (2014a). Multisensory temporal integration in autism spectrum disorders. J. Neurosci. 34, 691–697. doi: 10.1523/JNEUROSCI.3615-13.2014
Stevenson, R. A., Siemann, J. K., Woynaroski, T. G., Schneider, B. C., Eberly, H. E., Camarata, S. M., et al. (2014b). Evidence for diminished multisensory integration in autism spectrum disorders. J. Autism Dev. Disord. 44, 3161–3167. doi: 10.1007/s10803-014-2179-6
Stevenson, R. A., Toulmin, J. K., Youm, A., Besney, R. M., Schulz, S. E., Barense, M. D., et al. (2017). Increases in the autistic trait of attention to detail are associated with decreased multisensory temporal adaptation. Sci. Rep. 7, 1–10. doi: 10.1038/s41598-017-14632-1
Tavassoli, T., and Baron-Cohen, S. (2012). Taste identification in adults with autism spectrum conditions. J. Autism Dev. Disord. 42, 1419–1424. doi: 10.1007/s10803-011-1377-8
Tomasik-Krótki, J., and Strojny, J. (2008). Scaling of sensory impressions. J. Sens. Stud. 23, 251–266. doi: 10.1111/j.1745-459X.2008.00153.x
Turoman, N., Velasco, C., Chen, Y. C., Huang, P. C., and Spence, C. (2018). Symmetry and its role in the crossmodal correspondence between shape and taste. Atten. Percept. Psychophys. 80, 738–751. doi: 10.3758/s13414-017-1463-x
Van Boxtel, J. J., and Lu, H. (2013). A predictive coding perspective on autism spectrum disorders. Front. Psychol. 4:19. doi: 10.3389/fpsyg.2013.00209
Velasco, C., Michel, C., Youssef, J., Gamez, X., Cheok, A. D., and Spence, C. (2016a). Colour–taste correspondences: designing food experiences to meet expectations or to surprise. Int. J. Food Des. 1, 83–102. doi: 10.1386/ijfd.1.2.83_1
Velasco, C., Woods, A. T., Deroy, O., and Spence, C. (2015). Hedonic mediation of the crossmodal correspondence between taste and shape. Food Qual. Prefer. 41, 151–158. doi: 10.1016/j.foodqual.2014.11.010
Velasco, C., Woods, A., Liu, J., and Spence, C. (2016c). Assessing the role of taste intensity and hedonics in taste–shape correspondences. Multisens. Res. 29, 209–221. doi: 10.1163/22134808-00002489
Velasco, C., Woods, A. T., Marks, L. E., Cheok, A. D., and Spence, C. (2016b). The semantic basis of taste-shape associations. PeerJ 4:e1644. doi: 10.7717/peerj.1644
Visser, E., Zwiers, M. P., Kan, C. C., Hoekstra, L., van Opstal, A. J., and Buitelaar, J. K. (2013). Atypical vertical sound localization and sound-onset sensitivity in people with autism spectrum disorders. J. Psychiatry Neurosci: JPN. 38, 398–406. doi: 10.1503/jpn.120177
Wada, M., Suzuki, M., Takaki, A., Miyao, M., Spence, C., and Kansaku, K. (2014). Spatio-temporal processing of tactile stimuli in autistic children. Sci. Rep. 4:5985. doi: 10.1038/srep05985
Wakabayashi, A., Baron-Cohen, S., Wheelwright, S., and Tojo, Y. (2006). The autism-spectrum quotient (AQ) in Japan: a cross-cultural comparison. J. Autism Dev. Disord. 36, 263–270. doi: 10.1007/s10803-005-0061-2
Wakabayashi, A., Tojo, Y., Baron-Cohen, S., and Wheelwright, S. (2004). The Autism-Spectrum Quotient (AQ) Japanese version: evidence from high-functioning clinical group and normal adults. Shinrigaku Kenkyu 75, 78–84. doi: 10.4992/jjpsy.75.78
Wallace, M. T., and Stevenson, R. A. (2014). The construct of the multisensory temporal binding window and its dysregulation in developmental disabilities. Neuropsychologia 64, 105–123. doi: 10.1016/j.neuropsychologia.2014.08.005
Walsh, V. (2003). A theory of magnitude: common cortical metrics of time, space and quantity. Trends Cogn. Sci. 7, 483–488. doi: 10.1016/j.tics.2003.09.002
Wan, X., Woods, A. T., van den Bosch, J. J., McKenzie, K. J., Velasco, C., and Spence, C. (2014). Cross-cultural differences in crossmodal correspondences between basic tastes and visual features. Front. Psychol. 5:1365. doi: 10.3389/fpsyg.2014.01365
Wang, Q. J., Wang, S., and Spence, C. (2016). “Turn up the taste”: assessing the role of taste intensity and emotion in mediating crossmodal correspondences between basic tastes and pitch. Chem. Senses 41, 345–356. doi: 10.1093/chemse/bjw007
Woods, A. T., and Spence, C. (2016). Using single colors and color pairs to communicate basic tastes. IPerception 7:2041669516658817. doi: 10.1177/2041669516658817
Yaguchi, A., and Hidaka, S. (2020). Autistic communication and imagination sub-traits are related to audiovisual temporal integration in the stream–bounce illusion. Multisens. Res. 1, 1–16. doi: 10.1163/22134808-bja10042
Keywords: color–taste association, shape–taste association, shape–color association, autistic traits, crossmodal correspondence
Citation: Chen N, Watanabe K and Wada M (2021) People With High Autistic Traits Show Fewer Consensual Crossmodal Correspondences Between Visual Features and Tastes. Front. Psychol. 12:714277. doi: 10.3389/fpsyg.2021.714277
Edited by:
Varun Dutt, Indian Institute of Technology Mandi, IndiaReviewed by:
Kosuke Motoki, Miyagi University, JapanCharles Spence, University of Oxford, United Kingdom
Copyright © 2021 Chen, Watanabe and Wada. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Na Chen, imminana7@gmail.com; Makoto Wada, wada-makoto@rehab.go.jp