Skip to main content

ORIGINAL RESEARCH article

Front. Psychol., 30 November 2023
Sec. Quantitative Psychology and Measurement

Social Appearance Anxiety Scale: a psychometric investigation and evaluation of the influence of individual characteristics on social appearance anxiety in Brazilian adults who practice physical exercise

  • 1Department of Biological Sciences, School of Pharmaceutical Sciences, São Paulo State University (UNESP), São Paulo, Brazil
  • 2William James Center for Research (WJCR), University Institute of Psychological, Social, and Life Sciences (ISPA), Lisbon, Portugal
  • 3Flu Pedagogy, Nord University, Bodø, Norway
  • 4Faculty of Medicine and Health Technology, Tampere University, Tampere, Finland
  • 5Department of Ear and Oral Diseases, Tampere University Hospital, Tampere, Finland
  • 6School of Dentistry, São Paulo State University (UNESP), São Paulo, Brazil
  • 7Postgraduate Program in Food, Nutrition, and Food Engineering, São Paulo State University (UNESP), Araraquara, São Paulo, Brazil

Introduction: Evaluating signs of anxiety related to body appearance is becoming increasingly important in contemporary society and, in this sense, the Social Appearance Anxiety Scale (SAAS) seems an interesting alternative of measurement.

Objectives: To evaluate the psychometric properties of the Portuguese version of the SAAS when applied to Brazilian adults who practice physical exercise and verify the influence of individual characteristics on participants’ social appearance anxiety.

Methods: This was a cross-sectional study conducted online. The participants completed the SAAS and a demographic questionnaire. The psychometric properties of the SAAS one-factor model were evaluated using confirmatory factor analysis. A structural model was built for men and women to verify the influence of individual characteristics of the participants on social appearance anxiety.

Results: 1,495 individuals participated in the study (70.8% women; mean age = 29.5, SD = 8.9 years). The data obtained with the SAAS presented good indicators of validity and reliability for both genders (CFI > 0.97, TLI > 0.97, SRMR = 0.04, α > 0.97, ω > 0.85). For both men and women, greater levels of social appearance anxiety were observed among younger participants, who had a higher body mass index, self-reported an eating disorder, and perceived a change in their body after the onset of the COVID-19 pandemic. For women specifically, higher income and having started physical exercise more recently were associated with greater levels of social appearance anxiety.

Conclusion: The findings supported the validity and reliability of the data obtained with the SAAS and revealed that when investigating social appearance anxiety in future research and clinical protocols, specific individual characteristics should be considered.

1 Introduction

Anxiety can be characterized by apprehension and somatic symptoms of tension, in which an individual anticipates imminent danger or a catastrophe, causing a series of bodily adaptations to occur to mobilize the subject in the face of this possible situation. This emotion is understood as a future-oriented, long-acting, and broadly focused response to a threat [American Psychiatric Association (APA), 2013]. When anxiety exists excessively or persists beyond appropriate periods for the individual’s developmental level, an anxiety disorder can occur, with behaviors that can harm the individual’s life, such as social avoidance [American Psychiatric Association (APA), 2013]. When anxiety is related to the negative judgment of others about the appearance of one’s own body, a state of social physical anxiety is experienced (Hart et al., 1989).

The concept of social physique anxiety emerged in the 1980s when Hart et al. (1989) investigated the degree of anxiety that people have during physical assessment in gyms in a North American context. These authors described this concept as a state of body-related anxiety in response to potentially real and imaginary judgments from other individuals. To analyze signs and symptoms suggestive of social physique anxiety, Hart et al. (1989) developed the Social Physique Anxiety Scale (SPAS). The SPAS is a psychometric scale composed of 12 items and has been used in different contexts (Hagger et al., 2007; Neves et al., 2018). However, psychometric evidence indicates the fragility of the factorial model of SPAS (da Silva et al., 2022). Therefore, the use of other scales can be interesting to obtain valid and reliable data on social anxiety and physical appearance. Based on that, Hart et al. (2008) proposed the Social Appearance Anxiety Scale (SAAS). This scale assesses social appearance anxiety, which is a broader concept than that assessed by the SPAS. The SAAS items encompass content related to the fear that an individual has that their appearance will be evaluated by other people and that this will harm their life in different contexts (e.g., job opportunities and peer relationships). Therefore, the SAAS includes content that goes beyond a body concern (Hart et al., 2008).

The SAAS has 16 items, written as statements, with a 5-point Likert-type response scale (Hart et al., 2008). The scale has already been translated and cross-culturally adapted for different countries (Hart et al., 2008; Claes et al., 2012; Dakanalis et al., 2016; Radix et al., 2018). In addition, studies have shown adequate psychometric properties of this scale, suggesting its good ability to screen signs and symptoms of social appearance anxiety (Claes et al., 2012; Papapanou et al., 2023). Donofre et al. (2021) developed a Portuguese version of the SAAS for the Brazilian context, but its psychometric properties have not yet been evaluated. It would be important to attest the validity and reliability of the data obtained with this version, considering that the Brazilian population is largely concerned with body appearance (Santos Silva et al., 2011). This is probably related to the pursuit of a socially accepted body standard, which has gained emphasis since the beginning of the 21st century (Witt and Schneider, 2011). Thus, using the SAAS to screen for social appearance anxiety becomes important. However, conducting psychometric evaluation is crucial to ensure the validity and reliability of the data obtained by the scale, serving as a necessary methodological step before intervention studies (Marôco, 2021).

Understanding the relationship between social appearance anxiety and individual characteristics is also relevant to develop appropriate scientific and clinical protocols. Relationships have been found between higher scores of social appearance anxiety and younger age, as well as unemployment (Papapanou et al., 2023). Characteristics such as body mass index and body fat and their relationships with social appearance anxiety have also been studied (Levinson and Rodebaugh, 2011). Therefore, it seems interesting to verify how similar characteristics relate to appearance anxiety in other contexts. The experience of a current or previous eating disorder may also be related to social appearance anxiety, as people with this condition suffer constant disturbances in body image and have difficulty engaging in social relationships [American Psychiatric Association (APA), 2013]. During the COVID-19 pandemic, people’s routine changed significantly and this may have influenced the perception and possibly dissatisfaction of their body appearance (Castro et al., 2021), possibly contributing to greater social anxiety. Furthermore, some studies (Brunet and Sabiston, 2009; Baillot et al., 2020; Herring et al., 2021) have explored the relationships between characteristics of physical exercise (e.g., intensity and frequency) and social physique anxiety. A recent study conducted with the Italian population aimed to investigate the relationship between autonomous motivation and physical activity (Galli et al., 2022). The study examined the role of behavioral intention and anxiety in this context. The findings revealed that anxiety, depending on its levels, might increase the influence of the intention to engage in physical exercise, particularly within the context of COVID-19. These studies demonstrate the importance of better understanding these issues, particularly because people who engage in physical exercise may be a population with more concerns related to appearance and greater anxiety in general.

Given the above, this study was conducted with two aims. The first aim was to evaluate the psychometric properties of the Portuguese version of the SAAS when applied to Brazilian adults who practice physical exercise. Given the evidence that the SAAS one-factor model (original) presents adequate parameters of validity and reliability in different contexts, the hypothesis of the present study was that this model would also present good psychometric indicators in the Brazilian context. The second aim was to verify the influence of participants’ characteristics on social appearance anxiety. For that, a structural model was elaborated, which included the characteristics mentioned in the literature as relevant to social appearance anxiety. This model was tested for men and women separately, as these groups have different experiences in relation to body image, which is already well explained in the literature (Cash et al., 2004; Griffiths et al., 2016). For the second aim, the hypothesis was that younger participants, having a higher socioeconomic level, possessing a higher BMI, practicing physical exercises for longer, having already had an eating disorder (self-report), and reporting having noticed a change in the body image after the onset of the COVID-19 pandemic would present greater social appearance anxiety.

2 Methods

2.1 Study design and sampling method

This was a cross-sectional study with non-probabilistic sampling. The minimum sample size was estimated using the recommendation of 10 participants for each parameter estimated in the factorial model of the SAAS and in the final structural model (Hair et al., 2019). A total of 38 parameters was estimated, and a loss rate of 10% also was added; therefore, the minimum sample size was 423 individuals. As the analyses were performed separately for men and women, this minimum sample size was designed for each gender.

2.2 Participants and procedures

Brazilian adults who self-reported practicing physical exercise – including those performed at home, in a public environment such as parks or squares, or at gyms – participated in the study. Inclusion criteria were age between 18 and 59 years old and exercising for at least 3 months. Exclusion criteria were pregnant or lactating women. To ensure the eligibility of participants, a screening questionnaire was used before the definitive data collection.

Data collection was conducted from May to August of 2021 through a non-probabilistic online survey using Google Forms® (Alphabet Inc., CA, USA). When accessing the survey, participants had to be logged in with an e-mail to limit one response per person. Participants were invited to voluntarily complete the survey through various channels, aiming to obtain a broad and diverse sample. Initially, the invitations were sent from the researchers’ email addresses to the directors and coordinators of several undergraduate and graduate courses at state, federal, and private universities in Brazil. This strategy especially reached the academic community (i.e., students and professors). Additionally, the research was also promoted through WhatsApp groups and Instagram profiles, where the research aims, and participation process were shared. When individuals agreed to participate, they were asked to promote the study to other people through their social networks and individual groups, adopting a snowball sampling strategy.

All individuals who agreed to participate first voluntarily accessed the link to the survey and signed the informed consent form (first page). Afterward, the participants completed the items for sample characterization (demographic questionnaire), followed by the SAAS and the SPAS. This study followed the guidelines of the Declaration of Helsinki and was approved by the Research Ethics Committee of the Faculty of Pharmaceutical Sciences of Araraquara (UNESP) (CAAE: 22051619.8.0000.5426).

2.3 Measures

2.3.1 Sample characterization

A demographic questionnaire was developed by the authors to include data on age, gender (“How do you identify?”: male; female; transgender; non-binary; others; and prefer not to answer), region of Brazil residing (North; Northeast; Central-west; South; and Southeast), marital status (single; married; separate; and divorced), race (white; black; biracial or multiracial; Asian; indigenous; and prefer not to inform), level of education (complete primary education; complete high school; complete higher education; and complete postgraduate), work activity (no; yes), monthly family income (< R$ 1.254,00; R$ 1.255,00 to R$ 2.004,00; R$ 2.005,00 to R$ 8.640,00; R$ 8.641,00 to R$11.261,00; > R$ 11.262,00 – the exchange rate in October 2022 was 1 U$ dollar to 5.27 reais[R$]), weight and height, how long have been exercising (less than 6 months; from 6 months to 1 year; from 1 year to 1 year and a half; from 1 year and a half to 2 years; more than 2 years) and weekly frequency (1 to 7 or more), and if they were a professional athlete (no; yes). Having already received a medical diagnosis of an eating disorder (no; yes) and self-perception of changes in body appearance and exercise practice after the onset of the COVID-19 pandemic (not even a little; lightly; a little bit; much; extremely) were also included.

2.3.2 Social Appearance Anxiety Scale (SAAS)

This scale was originally proposed in English by Hart et al. (2008) to assess social appearance anxiety as a one-factor model. SAAS has 16 items (e.g., “I feel nervous when having my picture taken”). The first (“I feel comfortable with the way I appear to others”) is inverted in relation to the others. Response scale ranges from not at all (1) to extremely (5), with higher scores indicating greater social appearance anxiety. Participants completed the Portuguese version of the SAAS (Donofre et al., 2021).

2.3.3 Social Appearance Anxiety Scale (SAAS)

This scale was originally proposed in English by Hart et al. (1989) to assess social physique anxiety as a one-factor model. SPAS had 12 items, seven of which are negative statements and five are positive ones. The response scale is presented in a 5-point Likert-type scale ranging from not at all (1) to extremely characteristic (5). After reversing the responses to regular items (for a review, see da Silva et al., 2022) a higher score indicated greater social physical anxiety. Participants completed a Portuguese version of the SPAS, in which all items are written in the same direction (i.e., negative statements) (da Silva et al., 2022).

2.3.4 Godin-shephard leisure-time physical activity questionnaire (GSLTPAQ)

The questionnaire was proposed by Godin and Shephard (1985) to differentiate between sedentary and active individuals. GSLTPAQ has two questions. The first question has three sub-items where individuals indicate the number of times they practice physical activities for at least 15 min at (i) vigorous, (ii) moderate, and (iii) light intensity, considering 7 days per week. The second question measures the frequency of leisure-time activities that cause sweating. To calculate the final score, the frequency indicated by the participant in the first question is multiplied by an effort coefficient ([9 × vigorous] + [5 × moderate] + [3 × light]). Higher scores indicate a higher level of physical activity. The participants completed the Portuguese version of the GSLTPAQ (Sao-Joao et al., 2013).

2.4 Data analysis

Analyzes were performed separately for men and women. First, mean, median, mode, standard deviation, skewness, and kurtosis were calculated for all SAAS items to verify the distribution of participants’ responses and identify the psychometric sensitivity of the data. Absolute values of skewness and kurtosis lower than 3 and 7, respectively, were indicative of a non-severe violation of the normal distribution of the data (Marôco, 2021).

The factorial validity of the SAAS one-factor model was estimated using Confirmatory Factor Analysis (CFA). The Weighted Least Squares Mean and Variance Adjusted (WLSMV) estimation method was used. The goodness-of-fit indices used in CFA were the Comparative Fit Index (CFI), Tucker-Lewis Index (TLI), and Standardized Root Mean Square Residual (SRMR) (Fornell and Larcker, 1981; Byrne, 2010). Values of CFI and TLI values ≥0.95 and SRMR <0.07 were indicative of adequate factorial validity of the model (Hu and Bentler, 1999; Hair et al., 2019). The factor loading (λ) of each SAAS item was calculated and those with values greater than 0.50 were kept in the model. To assess convergent validity, that is, the adequacy of the items for the composition of the factor, the average variance extracted (AVE) was estimated from the values of the factor loadings (Fornell and Larcker, 1981). Values of AVE ≥ 0.50 indicated adequate convergent validity (Fornell and Larcker, 1981). To assess concurrent validity, which is the relationship between latent concepts, a correlational analysis was conducted between the one-factor model of the SAAS (Hart et al., 2008) and the one-factor model of the SPAS (da Silva et al., 2022). In this analysis, we hypothesized that both scales, which assess related concepts, would present a strong and significant correlation (p < 0.05).

The reliability was assessed using the ordinal alpha (α) and omega (ω) coefficients and values ≥0.70 indicated adequacy (Zumbo et al., 2007; Gadermann et al., 2012). To assess the equivalence of the one-factor model of the SAAS across independent subsamples, measurement invariance tests were performed using multigroup analysis (Chen, 2007). For that, the sample of each gender (men: n = 426, women: n = 1,058) was randomly split into two parts and the analysis was performed for men (subsample 1: n = 213 vs. subsample 2: n = 213) and women (subsample 1: n = 529 vs. subsample 2: n = 529). Initially, the configural invariance (baseline model) was guaranteed. Subsequently, the equivalence of factor loadings (metric model), thresholds (scalar model), and residuals (residual model) was evaluated, which were compared two by two through the difference (Δ) in the CFI values. When a reduction in CFI values < −0.01 was observed, the one-factor SAAS model showed strong invariance (Chen, 2007).

The last step consisted of verifying the influence of individual characteristics on participants’ social appearance anxiety. For that, a structural model was built for each gender using the structural equation modeling. In both models, the independent variables were age (continuous), monthly income (1: <R$1,254; 2: R$1,255–2,004; 3: R$2,005–8,640; 4: R$8,641–11,261; 5: >R$11,262.00), BMI (continuous), length of exercising (1: <6 months, 2: 6 months to 1 year, 3: 1 to 1.5 year, 4: 1.5 to 2 years, 5: >2 years), self-reported diagnosis of an eating disorder (0: no, 1: yes), and self-report of change in body appearance during the COVID-19 pandemic (1: not at all, 2: slightly, 3: a little, 4: a lot, 5: extremely). The pathways (β) were analyzed and compared to the critical ratios of z (Marôco, 2021). A significance level of 5% was used. The fit of the models was assessed using CFI, TLI, and SRMR indices considering the previously mentioned adequacy values (Hu and Bentler, 1999). The analyses were performed using the R software (v. 4.1.3), with RStudio (v. 2022.02.0 + 443), using the foreign, lavaan, SemTools, and psych packages.

3 Results

A total of 1,524 individuals completed the survey; however, 29 did not complete all the SAAS items and were excluded from the analyses. Thus, the final sample was 1,495 individuals, of which 70.8% identified themselves as woman, 28.5% as men, 0.3% as non-binary, 0.3% chose the category others, and 0.1% chose not to respond. Considering that most identified themselves as man or woman, the analyses were separated for these groups and the others were excluded from the psychometric analyses, as the sample size was too small to be used. These individuals were included in the descriptive analyses referring to the total sample.

The mean age for the total sample was 29.5 (SD = 8.9) years (men: M = 30.0, SD = 9.4 years; women: M = 29.4, SD = 8.7 years). The mean BMI of the total sample was 24.7 (SD = 4.7) kg/m2 (men: M = 25.7, SD = 4.0 kg/m2; women: M = 24.4, SD = 4.9 kg/m2). GSLTPAQ data showed that 87.8% of the participants were physically active (92.7% men, 85.7% women), 8.8% were moderately active (6.1% men, 9.9% women) and 3.4 insufficiently active (1.2% men, 4.3% women). No participant was sedentary, as this was an exclusion criterion.

Table 1 presents the characterization of the sample. Most participants indicated that they live in the Southeastern region of Brazil, are white, have a high level of education, have been exercising for over 2 years, and reported not having received a medical diagnosis of an eating disorder. According to BMI, most participants were eutrophic. Most reported that they noticed a change in their own body appearance after the onset of the COVID-19 pandemic and that change was a little worse and promoted dissatisfaction. For physical exercise, most participants reported that the practice was very modified after the onset of the COVID-19 pandemic and that this change was a little worse and promoted dissatisfaction.

TABLE 1
www.frontiersin.org

Table 1. Sample characterization.

Table 2 presents the descriptive analysis of the responses given to the SAAS items. No item showed extreme values for the skewness and/or kurtosis in any of the samples, assuming there was psychometric sensitivity of the data.

TABLE 2
www.frontiersin.org

Table 2. Descriptive analysis of the responses given to the items of the Social Appearance Anxiety Scale (SAAS) for the samples.

Table 3 presents the psychometric indicators of the SAAS for the men and women samples. The SAAS one-factor model showed adequate fit indices and factor loading of items (see Table 2) above 0.50 for both samples. In the convergent validity and reliability analyses, the values found for AVE, α, and ω were adequate for both samples (Table 3). Measurement invariance tests showed that the one-factor model of the SAAS presents strong equivalence between independent subsamples according to each gender, indicating its external validity (Table 3).

TABLE 3
www.frontiersin.org

Table 3. Psychometric indicators of the Social Appearance Anxiety Scale (SAAS) for samples.

About SPAS, the one-factor model presented adequate fit to the data of both samples of the present study (women: CFI = 0.984, TLI = 0.981, SRMR = 0.040, λ = 0.812–0.959, AVE = 0.783, α = 0.975, ω = 0.968; men: CFI = 0.985; TLI = 0.982; SRMR = 0.040; λ = 0.798–0.962; AVE = 0.783; α = 0.975; ω = 0.968). The correlation between SAAS and SPAS was 0.11 (p < 0.05) for men and 0.21 (p < 0.05) for women.

Table 4 presents the results of the structural models tested for each gender to verify the influence of individual characteristics on participants’ social appearance anxiety. For men, the variables income and how long they had been practicing physical exercise were not significantly related to social appearance anxiety. Therefore, these variables were excluded from the model. The refined model for men presented adequate fit to the data (CFI = 0.975, TLI = 0.981, SRMR = 0.048) and included the variables age, BMI, self-report of diagnosis of an eating disorder, and self-report of change in body appearance after the onset of the COVID-19 pandemic. Younger men, who had a higher BMI, self-reported a diagnosis of an eating disorder, or experienced perceived body changes after the onset of the COVID-19 pandemic presented higher levels of social appearance anxiety. For women, all independent variables tested were significant and the model presented an adequate fit to the data (CFI = 0.966, TLI = 0.979, SRMR = 0.051). Greater social appearance anxiety was observed among younger women, who had higher income, reported having started physical exercise more recently, reported having already received a diagnosis of an eating disorder, and perceived a change in their body after the onset of the COVID-19 pandemic.

TABLE 4
www.frontiersin.org

Table 4. Structural model tested in the samples.

4 Discussion

To the best of our knowledge, this is the first study that evaluated the psychometric properties of the Portuguese version of the SAAS one-factor model for men and women Brazilian adults who practice physical exercise. The study that translated and cross-culturally adapted the SAAS into Portuguese verified only its content validity and internal consistency (Donofre et al., 2021). Therefore, our study contributes to providing evidence on construct validity (i.e., factorial, convergent, and concurrent), measurement invariance in independent subsamples, and reliability. These data allow for verifying how the scale operates in assessing social appearance anxiety. Furthermore, we identified different individual characteristics for each gender that influenced the level of social appearance anxiety. Those results can be useful for clinical assessments, epidemiological protocols, and intervention studies, among others, aiming at improving people’s relationship with physical appearance and reducing social anxiety.

In factorial validity analysis of the SAAS one-factor model, excellent values for goodness-of-fit indices for both samples were obtained in CFA. A study conducted in Italy (Dakanalis et al., 2016) found similar results among adolescents from the community and those diagnosed with eating disorders. These results indicate that the SAAS one-factor model maintains a good fit across populations of distinct ages and clinical conditions. Still, the factor loadings of the 16 items of the SAAS were all adequate. Importantly, item 1 which is inverted in relation to the others presented adequate factor loading, but the values were low when compared to the other items. A study conducted in Belgium (Claes et al., 2012) also found similar results for women diagnosed with an eating disorder, with all factor loadings of the items being>0.70, except for item 1 which was 0.50. This can be explained by item wording, which being inverted seems to make it difficult for the reader to understand, but not to the point of demonstrating the need to remove it from the model.

We found adequate convergent validity of the SAAS one-factor model for the Brazilian data. As we did not find studies that used a similar methodology (i.e., AVE values), direct comparisons were not possible. In the present work, the convergent validity was analyzed from the factorial loadings of the items to investigate the extent of shared variance to assess the construct. This methodology was proposed by (Fornell and Larcker, 1981) and is recommended by specialized literature (Hair et al., 2019; Marôco, 2021).

The study that developed the SAAS (Hart et al., 2008) and other research works (Levinson and Rodebaugh, 2011; Claes et al., 2012; Dakanalis et al., 2016) examined the correlation between the scale and other measures of social anxiety, body image, and eating disorders, obtaining satisfactory results, with significant values for adequacy. To assess concurrent validity, we calculated the correlation between the SAAS and SPAS which, despite not being high, was statistically significant. A possible explanation for the low values of the correlations found in the present study is that despite the similarity between the concepts evaluated by each scale, they have a different construction. While the SPAS assesses social physique anxiety as a concern at the level only of the physical body and it does not include items assessing other domains of appearance-related anxiety (Hart et al., 2008) the SAAS investigates social appearance anxiety in different everyday contexts, such as in affective and professional life (Hart et al., 2008). The original study of the SAAS (Hart et al., 2008), also found a significant correlation (r = 0.59, p = 0.005) between the SAAS and SPAS for the total sample including men and women. This value in our study had a slightly smaller magnitude, and this disparity may be due to cultural issues, indicating that, in the Brazilian context, participants may have perceived the concepts captured by the SAAS and SPAS as different.

For reliability, we found adequate values for both genders (α and ω > 0.86), demonstrating that the SAAS one-factor model was able to produce consistent results to assess the latent concept (i.e., social appearance anxiety). These findings corroborate with the original study of the SAAS (Hart et al., 2008), as well as studies conducted in Turkey (Sahin and Topkaya, 2015) and Brazil (Donofre et al., 2021). In the measurement invariance tests, we found ΔCFI values < −0.01, indicating that the SAAS one-factor model was equivalent across independent subsamples evaluated within each gender, suggesting external validity, i.e., even under different conditions the factorial structure was maintained. A study conducted in Italy (Dakanalis et al., 2016) with adolescents also showed that the SAAS one-factor model was invariant across different groups, such as eating disorder present vs. eating disorder absent; girls vs. boys; and younger vs. older adolescents, among others. Although the Italian study did not analyze independent subsamples within each gender as we did, the results suggest that the SAAS one-factor model was equivalent across those different groups. Importantly, this does not mean that the groups share the same scores, but that the scale operates similarly between the groups or subsamples; therefore, comparisons between the groups are adequate. Future studies may focus on comparing social appearance anxiety scores between groups with characteristics like those of studies that guaranteed the measurement invariance.

Different relations were found in the structural model tested for men and women. Higher monthly income was associated with greater social appearance anxiety among those who identified as women. A study using the SAAS conducted in Turkey with university students to determine the relationship between social appearance anxiety and happiness in overweight girls found no significant difference between the average SAAS scores and the economic level of the participants (Unver et al., 2022). However, a study carried out with low-income women in southern Brazil found that body image dissatisfaction was higher among higher-income women (Kops et al., 2018). Thus, considering the differences between the concepts (i.e., social appearance anxiety and dissatisfaction with body image), it can be explained that they are different constructs that can overlap. Furthermore, a distinct conception of a beautiful or standard body can be found among women of different socioeconomic levels (Kops et al., 2018; Albuquerque et al., 2021), so these issues still need to be further explored. For men, income was not a significant predictor to influence social appearance anxiety. This may be associated with a social construction where those who identify as men and who have a higher income consider other aspects than physical appearance for success and social acceptance. Future studies should explore this hypothesis.

Among women, the more years that they have practiced physical exercise, the lower their social appearance anxiety. This result can be compared to that of a Canadian study carried out with people with obesity (Baillot et al., 2020), which found that participants with experienced lower levels of social physique anxiety had higher levels of moderate-to-vigorous physical activity. Moreover, physical exercise may positively influence the individual’s self-assessment of body image (Naivar Sen et al., 2020). A scoping review (Sabiston et al., 2018) pointed out that based on results and the most frequent published associations, participation in physical activity and sport was related to a more positive body image, without causal conclusions. However, there are also situations in which individuals experience social physique anxiety in environments where their bodies can be observed by other people. In this case, exercising can be an arduous task (Sabiston et al., 2018; Herring et al., 2021), so social physique anxiety can potentially hinder motivation for physical activity (Brunet and Sabiston, 2009). Therefore, not all people will adhere to the exercise in the same way or for similar reasons and it is necessary to develop individualized plans to understand the motives and underlying barriers (Campos et al., 2022).

Men did not exhibit a correlation between engagement in physical exercise and social appearance anxiety. A meta-analysis (Bassett-Gunter et al., 2017) evaluated the relationship between physical activity and body image specifically focusing on men. The study discussed that while social physique anxiety was significantly related to exercise in cross-sectional studies, similar results were not found in intervention studies. In this way, it is possible to reflect that the relief of symptoms of social physique anxiety was not considered a motivating mechanism for practicing physical exercise. Generally, men seek to practice physical exercises aiming at objective and/or perceptual body changes, such as the increase and definition of muscle mass, in addition to stimulating self-efficacy. Thus, the practice of physical exercise can to some extent contribute to the reduction of social anxiety levels with appearance, but this is not the driving reason to perform such activity.

In addition, to understand the disparities between men and women in findings related to the duration of their exercise habits and social appearance anxiety, it is important to consider physical activity as an integral component of a healthy lifestyle. A study using data from the ELSA-Brasil (Patrão et al., 2017) aimed to identify psychosocial factors associated with the adoption of a healthy lifestyle from a gender perspective. Four lifestyle indicators were examined, one of which was engagement in recreational physical exercise. The authors (Patrão et al., 2017) found that women generally led a healthier lifestyle compared to men. They also found that men who had housekeepers presented healthier dietary habits and engaged in more physical exercise. Furthermore, greater satisfaction with body image was associated with a healthier lifestyle among men, while this association was not observed among women (Patrão et al., 2017).

Comparing data from the ELSA-Brasil to a Portuguese cohort, a study found that Brazilian women tended to perceive themselves as lighter than their actual weight (Patrão et al., 2022). This perception was associated with various factors, including self-perceived poor health and a lack of physical activity (Patrão et al., 2022). This highlights body image-related issues, such as appearance anxiety, and physical exercise as components of lifestyle and health. Therefore, they can be understood and experienced differently across genders and influenced by the specific cultural and behavioral aspects of a population.

Despite the differences, some similarities have been observed in the structural models between men and women. Age was significantly related to social appearance anxiety in both genders, indicating that younger adults suffer from greater anxiety. This result can be explained by varied reasons, one of which is the greater exposure of younger people to social networks and the media. A Brazilian study (Sousa Silva et al., 2018) analyzed the imagery-discursive construction considering the impact of Instagram on the self-assessment of body image. The authors observed that the body image considered as “standard” in this network (i.e., thin and with prominent muscular definition) acts coercively on those who are outside the standards, generating a desire to rebuild the body and one’s own identity that can cause suffering and psychic exhaustion. Younger individuals, who are generally less able to neutralize emotions in situations that cause stress and discontent (Campos et al., 2020), when in contact with influences such as social media, may present greater social anxiety due to the appearance of the body.

Having a higher BMI significantly influenced to have greater social appearance anxiety for both genders. This corroborates other studies that used the SAAS (Radix et al., 2018). Another study found that SAAS did not significantly correlate with BMI but with body fat content (Levinson and Rodebaugh, 2011). These findings may suggest that people diagnosed as overweight or obese may suffer greater pressure from society and develop a state of anxiety. In both sexes, it is known that larger bodies due to a higher percentage of body fat are less desired and also stigmatized (Voges et al., 2019). Thus, further studies that assess the relationship between social appearance anxiety and body fat or BMI measurements are important in different samples, so that care strategies in favor of these people’s mental health can be developed later.

In both men and women, having already received a medical diagnosis of an eating disorder influenced the higher level of social appearance anxiety. The authors of the SAAS suggested that this scale should be evaluated in clinical contexts such as in patients who experience an eating disorder (Hart et al., 2008). Although we did not collect data on a clinical sample, some participants self-reported having been diagnosed with an eating disorder before the study, and these individuals were more susceptible to social appearance anxiety. Studies (Dakanalis et al., 2016; Radix et al., 2018) have shown that an eating disorder diagnosis can serve as a warning indicator for researchers when evaluating social appearance anxiety. This supports the importance of knowing the clinical history of an individual to develop more effective preventive or interventional approaches.

The report of a perceived change in appearance after the onset of the COVID-19 pandemic was significantly related to greater social appearance anxiety among both men and women. The social isolation to contain the advances of COVID-19 had its unquestionable importance, however, it exacerbated the situations of stress and anxiety among young adults in Brazil (Campos et al., 2020). Castro et al. (2021) identified in a Brazilian sample of resistance training practitioners that social distancing led to changes in different areas of the participants’ lives, including an increase in sedentary behavior, amount of sleep, and greater body image dissatisfaction, which is in line with the result of the present study. As the SAAS assesses an important concept related to the social context (Hart et al., 2008), it can be a useful tool to collect data that can support the development of care strategies in favor of physical and mental health.

Although this study has several strengths it also has limitations. First, the cross-sectional design of the study, which does not allow for establishing a cause-and-effect relationship between the variables investigated in the structural models. The second refers to the sample that mostly included women. Furthermore, the majority of participants are individuals from the Southeastern region of Brazil, whites, and with a high educational level, which does not allow generalization of the results to all Brazilian contexts. The third limitation is associated with the variables included in the structural models, as they were selected based on the literature and our experience, and this may have excluded characteristics considered by other researchers as relevant. Thus, we suggest that future research protocols consider these limitations to develop future studies.

Despite the mentioned limitations, the present study can contribute to the scientific and clinical communities’ understanding of social appearance anxiety from the use of a psychometric scale. The methodological strategies used to assess the psychometric properties of the SAAS can be useful in developing future research protocols that aim to study mental health and body image. Furthermore, the use of the SAAS becomes promising to investigate signs and symptoms that can cause psychological distress, being a relevant tool for professionals who work especially in the health area. Thus, the identification of social appearance anxiety can be measured in a valid and reliable way from the SAAS, contributing to the development of preventive and interventionist strategies. Finally, the results of the structural models indicate important characteristics elucidating groups vulnerable to experiencing social distress to their body appearance, serving as a warning indicator to professionals in the healthcare context.

5 Conclusion

The data obtained with the Portuguese version of the SAAS presented good indicators of validity and reliability when applied to Brazilian adult samples of both genders who practice physical exercise. Participants’ individual characteristics influenced the level of social appearance anxiety and were different between genders. Only women, those with higher income and who have started physical exercise more recently presented greater social appearance anxiety. For both men and women, younger age, higher BMI, having already been diagnosed with an eating disorder, and self-perception of body change after the onset of the COVID-19 pandemic were significant predictors of greater social appearance anxiety.

The satisfactory psychometric properties of the SAAS indicate its effectiveness in screening for signs of social appearance anxiety. Additionally, the various individual characteristics that influence this type of anxiety highlight the critical need to consider multiple factors when examining men and women. These findings can be valuable for future research protocols, prevention strategies, and mental health interventions.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The studies involving humans were approved by Research Ethics Committee of the Faculty of Pharmaceutical Sciences of Araraquara (UNESP). The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.

Author contributions

GD: Conceptualization, Data curation, Formal analysis, Investigation, Validation, Visualization, Writing – original draft. JC: Conceptualization, Methodology, Visualization, Writing – review & editing. PS: Conceptualization, Investigation, Methodology, Writing – review & editing. JM: Investigation, Methodology, Software, Writing – review & editing. LC: Conceptualization, Funding acquisition, Methodology, Resources, Software, Visualization, Writing – review & editing. WS: Conceptualization, Investigation, Methodology, Project administration, Supervision, Writing – original draft.

Funding

The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This study was financed by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior-Brazil (CAPES)-Finance Code 001.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

The author(s) declared that they were an editorial board member of Frontiers, at the time of submission. This had no impact on the peer review process and the final decision.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

Albuquerque, L. S., Griep, R. H., Aquino, E. M. L., Cardoso, L. O., Chor, D., and Fonseca, M. J. M. (2021). Fatores associados à insatisfação com a Imagem Corporal em adultos: análise seccional do ELSA-Brasil. Cien. Saude Colet. 26, 1941–1954. doi: 10.1590/1413-81232021265.07152019

PubMed Abstract | CrossRef Full Text | Google Scholar

American Psychiatric Association (APA) (2013). Diagnostic and statistical manual of mental disorders: DSM-5. 5th. Washington, D.C.: American Psychiatric Publishing

Google Scholar

Baillot, A., Black, M., Brunet, J., and Romain, A. J. (2020). Biopsychosocial correlates of physical activity and sedentary time in adults with severe obesity. Clin Obes 10:e12355, 1–9. doi: 10.1111/cob.12355

PubMed Abstract | CrossRef Full Text | Google Scholar

Bassett-Gunter, R., McEwan, D., and Kamarhie, A. (2017). Physical activity and body image among men and boys: a meta-analysis. Body Image 22, 114–128. doi: 10.1016/j.bodyim.2017.06.007

PubMed Abstract | CrossRef Full Text | Google Scholar

Brunet, J., and Sabiston, C. M. (2009). Social physique anxiety and physical activity: a self-determination theory perspective. Psychol. Sport Exerc. 10, 329–335. doi: 10.1016/j.psychsport.2008.11.002

CrossRef Full Text | Google Scholar

Byrne, B. M. (2010). Structural equation modeling with Amos: Basic concepts, applications and programming. 2nd edn. New York: Routledge.

Google Scholar

Campos, L. A., dos Santos, A., Sampaio, M. M. B., Marôco, J., and Campos, J. A. D. B. (2022). Exercise motives among university students – a Brazil-Portugal transnational study. Front. Psychol. 13:1009762. doi: 10.3389/fpsyg.2022.1009762

PubMed Abstract | CrossRef Full Text | Google Scholar

Campos, J. A. D. B., Martins, B. G., Campos, L. A., Maroco, J., Saadiq, R. A., and Ruano, R. (2020). Early psychological impact of the COVID-19 pandemic in Brazil: a National Survey. J. Clin. Med. 9:2976. doi: 10.3390/jcm9092976

PubMed Abstract | CrossRef Full Text | Google Scholar

Cash, T. F., Morrow, J. A., Hrabosky, J. I., and Perry, A. A. (2004). How has body image changed? A cross-sectional investigation of college women and men from 1983 to 2001. J. Consult. Clin. Psychol. 72, 1081–1089. doi: 10.1037/0022-006X.72.6.1081

PubMed Abstract | CrossRef Full Text | Google Scholar

Castro, B. M., Trindade, T. B., Augusto, P. V. S., Medeiros, M. A., Moraes, W. M. A. M., and Prestes, J. (2021). The impact of quarantine on body image and lifestyle habits in resistance training practitioners. Rev. Bras. Med. Esporte 27, 16–20. doi: 10.1590/1517-8692202127012020_0053

CrossRef Full Text | Google Scholar

Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct. Equ. Modeling 14, 464–504. doi: 10.1080/10705510701301834

CrossRef Full Text | Google Scholar

Claes, L., Hart, T. A., Smits, D., Van den Eynde, F., Mueller, A., and Mitchell, J. E. (2012). Validation of the social appearance anxiety scale in female eating disorder patients. Eur. Eat. Disord. Rev. 20, 406–409. doi: 10.1002/erv.1147

PubMed Abstract | CrossRef Full Text | Google Scholar

da Silva, W. R., Donofre, G. S., Neves, A. B., Maroco, J., Teixeira, P. A., and Campos, J. A. D. B. (2022). Investigating method effects associated with the wording direction of items of the social physique anxiety scale. Eat. Weight Disord. 27, 2857–2867. doi: 10.1007/s40519-022-01439-x

PubMed Abstract | CrossRef Full Text | Google Scholar

Dakanalis, A., Carra, G., Calogero, R., Zanetti, M. A., Volpato, C., Riva, G., et al. (2016). The social appearance anxiety scale in Italian adolescent populations: construct validation and group discrimination in community and clinical eating disorders samples. Child Psychiatry Hum. Dev. 47, 133–150. doi: 10.1007/s10578-015-0551-1

PubMed Abstract | CrossRef Full Text | Google Scholar

Donofre, G. S., Campos, J. A. D. B., Marôco, J., and Silva, W. R. (2021). Cross-cultural adaptation of the social appearance anxiety scale to the Portuguese language. J. Bras. Psiquiatr. 70, 261–265. doi: 10.1590/0047-2085000000336

CrossRef Full Text | Google Scholar

Fornell, C., and Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. J. Mark. Res. 18, 39–50. doi: 10.1177/002224378101800104

CrossRef Full Text | Google Scholar

Gadermann, A. M., Guhn, M., and Zumbo, B. D. (2012). Estimating ordinal reliability for Likert-type and ordinal item response data: a conceptual, empirical, and practical guide. Pract. Assess. Res. Eval. 17, 1–13. doi: 10.7275/n560-j767

CrossRef Full Text | Google Scholar

Galli, F., Giancamilli, F., Palombi, T., Vitale, J. A., Borghi, S., De Maria, A., et al. (2022). Anxiety, motives, and intention for physical activity during the Italian COVID-19 lockdown: an observational longitudinal study. Int. J. Environ. Res. Public Health 19:4689. doi: 10.3390/ijerph19084689

PubMed Abstract | CrossRef Full Text | Google Scholar

Godin, G., and Shephard, R. J. (1985). A simple method to assess exercise behavior in the community. Can. J. Appl. Sport Sci. 10, 141–146.

Google Scholar

Griffiths, S., Hay, P., Mitchison, D., Mond, J. M., McLean, S. A., Rodgers, B., et al. (2016). Sex differences in the relationships between body dissatisfaction, quality of life and psychological distress. Aust. N. Z. J. Public Health 40, 518–522. doi: 10.1111/1753-6405.12538

PubMed Abstract | CrossRef Full Text | Google Scholar

Hagger, M. S., Asci, F. H., Lindwall, M., Hein, V., Mulazimoglu-Balli, O., Tarrant, M., et al. (2007). Cross-cultural validity and measurement invariance of the social physique anxiety scale in five European nations. Scand. J. Med. Sci. Sports 17, 703–719. doi: 10.1111/j.1600-0838.2006.00615.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Hair, J. F., Black, W. C., Babin, B. J., and Anderson, R. E. (2019). Multivariate Data Analysis 8th. Hampshire, UK: Cengage Learning.

Google Scholar

Hart, T. A., Flora, D. B., Palyo, S. A., Fresco, D. M., Holle, C., and Heimberg, R. G. (2008). Development and examination of the social appearance anxiety scale. Assessment 15, 48–59. doi: 10.1177/1073191107306673

CrossRef Full Text | Google Scholar

Hart, E. A., Leary, M. R., and Rejeski, W. J. (1989). The measurement of social physique anxiety. J. Sport Exerc. Psychol. 11, 94–104. doi: 10.1123/jsep.11.1.94

CrossRef Full Text | Google Scholar

Herring, M. P., Gordon, B. R., McDowell, C. P., Quinn, L. M., and Lyons, M. (2021). Physical activity and analogue anxiety disorder symptoms and status: mediating influence of social physique anxiety. J. Affect. Disord. 282, 511–516. doi: 10.1016/j.jad.2020.12.163

PubMed Abstract | CrossRef Full Text | Google Scholar

Hu, L., and Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct. Equ. Modeling 6, 1–55. doi: 10.1080/10705519909540118

CrossRef Full Text | Google Scholar

Kops, N. L., Bessel, M., Knauth, D. R., Caleffi, M., and Wendland, E. M. (2018). Body image (dis)satisfaction among low-income adult women. Clin. Nutr. 38, 1317–1323. doi: 10.1016/j.clnu.2018.05.022

PubMed Abstract | CrossRef Full Text | Google Scholar

Levinson, C. A., and Rodebaugh, T. L. (2011). Validation of the social appearance anxiety scale: factor, convergent, and divergent validity. Assessment 18, 350–356. doi: 10.1177/1073191111404808

PubMed Abstract | CrossRef Full Text | Google Scholar

Marôco, J. (2021). Análise de equações estruturais: fundamentos teóricos, software e aplicações. Portugal: Pêro Pinheiro.

Google Scholar

Naivar Sen, C. K., Gurleyik, D., and Psouni, E. (2020). The role of physical activity on parental rejection and body image perceptions. Int. J. Environ. Res. Public Health 17:2176. doi: 10.3390/ijerph17072176

PubMed Abstract | CrossRef Full Text | Google Scholar

Neves, A. B., Neves, A. N., Zanetti, M. C., Brandão, M. R. F., and Ferreira, L. (2018). Validação Psicométrica da Social Physique Anxiety Scale. Revista Iberoamericana de Psicología del Ejercicio y el Deporte 13, 193–202.

Google Scholar

Papapanou, T. K., Bacopoulou, F., Michou, M., Kanaka-Gantenbein, C., Vlachakis, D., Chrousos, G. P., et al. (2023). Validation of the Greek version of social appearance anxiety scale in adolescents and young adults. EMBnet.j. 28:e1027. doi: 10.14806/ej.28.0.1027

CrossRef Full Text | Google Scholar

Patrão, A. L., Almeida, M. C., Henriques, A., Matos, S. M. A., Barros, H., Harter Griep, R., et al. (2022). Body image distortion among Brazilian and Portuguese women with children: a comparative study between the ELSA-Brasil and Generation XXI cohorts. Prev. Med. 164:107316. doi: 10.1016/j.ypmed.2022.107316

PubMed Abstract | CrossRef Full Text | Google Scholar

Patrão, A. L., Almeida, M. C., Matos, S. M. A., Chor, D., and Aquino, E. M. L. (2017). Gender and psychosocial factors associated with healthy lifestyle in the Brazilian longitudinal study of adult health (ELSA-Brasil) cohort: a cross-sectional study. BMJ Open 7:e015705. doi: 10.1136/bmjopen-2016-015705

PubMed Abstract | CrossRef Full Text | Google Scholar

Radix, A. K., Rinck, M., Becker, E. S., and Legenbauer, T. (2018). The mediating effect of specific social anxiety facets on body checking and avoidance. Front. Psychol. 9:2661. doi: 10.3389/fpsyg.2018.02661

PubMed Abstract | CrossRef Full Text | Google Scholar

Sabiston, C. M., Pila, E., Vani, M., and Thogersen-Ntoumani, C. (2018). Body image, physical activity, and sport: a scoping review. Psychol. Sport Exerc. 42, 48–57. doi: 10.1016/j.psychsport.2018.12.010

CrossRef Full Text | Google Scholar

Sahin, E., and Topkaya, N. (2015). Factor structure of the social appearance anxiety scale in Turkish early adolescents. Univers. J. Educ. Res. 3, 513–519. doi: 10.13189/ujer.2015.030806

CrossRef Full Text | Google Scholar

Santos Silva, D. A., Nahas, M. V., de Sousa, T. F., Del Duca, G. F., and Peres, K. G. (2011). Prevalence and associated factors with body image dissatisfaction among adults in southern Brazil: a population based study. Body Image 8, 427–431. doi: 10.1016/j.bodyim.2011.05.009

CrossRef Full Text | Google Scholar

Sao-Joao, T. M., Rodrigues, R. C., Gallani, M. C., Miura, C. T., Domingues Gde, B., and Godin, G. (2013). Cultural adaptation of the Brazilian version of the Godin-Shephard leisure-time physical activity questionnaire. Rev. Saude Publica 47, 479–487. doi: 10.1590/s0034-8910.2013047003947

PubMed Abstract | CrossRef Full Text | Google Scholar

Sousa Silva, A. F., Neves, L. S., Japur, C. C., Penaforte, T. R., and Penaforte, F. R. O. (2018). Construção imagético-discursiva da beleza corporal em mídias sociais: repercussões na percepção sobre o corpo e o comer dos seguidores. Demetra 13, 395–411. doi: 10.12957/demetra.2018.33305

CrossRef Full Text | Google Scholar

Unver, H., Kurt, N., and Bicer Sahin, F. (2022). Happiness and social appearance anxiety in overweight young girls. Eur. Rev. Med. Pharmacol. Sci. 26, 6821–6826. doi: 10.26355/eurrev_202209_29784

CrossRef Full Text | Google Scholar

Voges, M. M., Giabbiconi, C.-M., Schöne, B., Waldorf, M., Hartmann, A. S., and Vocks, S. (2019). Gender differences in body evaluation: do men show more self-serving double standards than women? Front. Psychol. 10:544. doi: 10.3389/fpsyg.2019.00544

PubMed Abstract | CrossRef Full Text | Google Scholar

Witt, J. S. G. Z., and Schneider, A. P. (2011). Nutrição Estética: valorização do corpo e da beleza através do cuidado nutricional. Cien. Saude Colet. 16, 3909–3916. doi: 10.1590/S1413-81232011001000027

CrossRef Full Text | Google Scholar

Zumbo, B. D., Gadermann, A. M., and Zeisser, C. (2007). Ordinal versions of coefficients alpha and theta for Likert rating scales. J. Mod. Appl. Stat. Methods 6, 21–29. doi: 10.22237/jmasm/1177992180

CrossRef Full Text | Google Scholar

Keywords: anxiety, physical appearance, validation study, population characteristics, structural equation modeling

Citation: Donofre GS, Campos JADB, dos Santos PC, Marôco J, Campos LA and da Silva WR (2023) Social Appearance Anxiety Scale: a psychometric investigation and evaluation of the influence of individual characteristics on social appearance anxiety in Brazilian adults who practice physical exercise. Front. Psychol. 14:1261605. doi: 10.3389/fpsyg.2023.1261605

Received: 19 July 2023; Accepted: 16 November 2023;
Published: 30 November 2023.

Edited by:

Holmes Finch, Ball State University, United States

Reviewed by:

Ana Luísa Patrão, University of Porto, Portugal
Stefania Mancone, University of Cassino, Italy
Kusuma Minayati, University of Indonesia, Indonesia

Copyright © 2023 Donofre, Campos, dos Santos, Marôco, Campos and da Silva. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Lucas Arrais Campos, lucas.arraisdecampos@tuni.fi

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.