Víctor Dujo López
David González Trijueque
José L. Graña Gómez
José M. Andreu Rodríguez- 1Department of Personality, Assessment and Clinical Psychology I, Faculty of Psychology, Complutense University of Madrid, Madrid, Spain
- 2Department of Clinical Psychology, Faculty of Psychology and Educational Sciences, Francisco de Vitoria University, Madrid, Spain
Background: The NAQ (Negative Acts Questionnaire) has been widely used in more than 40 countries to measure the mobbing phenomenon. This research aims to present a psychometric study based on the Spanish version of the NAQ-R carried out by González-Trijueque and Graña (2013). As opposed to the original scale, this sample contains 23 items and a three-dimension model (personal bullying, work-related bullying, and physically intimidating forms of bullying).
Methods: We used a heterogeneous occupational sample of 2,538 Spanish employees to analyze internal consistency and concurrent validity. In addition, a Confirmatory Factor Analysis was carried out based on the GLS (generalized least squares) method.
Results: Results showed high internal reliability (Cronbach’s alpha = 0.91) and high correlations containing clinical symptoms, burn-out indicators, and coping resources. The Confirmatory Factor Analysis developed upon the heterogeneous occupational sample validates the three-dimension structure in the Spanish version of the NAQ-R aimed to measure harassment behaviors at the workplace.
Conclusion: The NAQ-R reaffirms its validity and reliability as a measure for mobbing-related behaviors. Hence, the scale may become a useful tool in research and forensic practice.
Introduction
Based on the epidemiological data, workplace harassment highlights the devastating impact at both human and organizational levels (EUROFOUND, 2017; Rodríguez-Muñoz et al., 2017; Hogh et al., 2019; El Ghaziri et al., 2020). From the perspective of forensic psychology, this paper validates one of the main instruments to measure mobbing with practical and clear implications for the development of forensic psychology in the justice administration.
From a psycho-legal perspective, the legal definition of mobbing has drawn on the doctrine of case law, psychology, and psychiatry literature. Therefore, relying on instruments with good psychometric properties for the measurement of mobbing, experts are guaranteed with a suitable tool, not only in forensic and psychological terms but also for Legal Psychology with regard to establishing psychological constructs in law courts (González-Trijueque and Graña, 2013).
We are looking toward a growing reality that in the last years has become a socio-occupational phenomenon and it turned into a topic of international interest as a result of the impact at both personal and socio-economic levels (Einarsen et al., 2011; EUROFOUND, 2015, 2017). We are not facing an isolated event but a process where an employee or employees experience different types of negative behaviors from co-workers. Within this persistent and long-term exposure may exist a power role between the formal and informal pair. Assuming the previously mentioned, this also may present a significant risk to the employee’s health (Fidalgo et al., 2009).
Mobbing prevalence data is heterogeneous, varying from 2 to 17% (Nielsen et al., 2011). Figures gathered from the Spanish working population showed a prevalence rate of 13.2% (Barómetro Cisneros, 2009). The Sixth European Working Conditions Survey (EUROFOUND, 2017) displays that at least 5% of the European workforce had been exposed to harassment behaviors within 12 months prior to the study. The health sector reported the greatest intensity of workers exposed to these behaviors. Since 2010, there has been a growing trend that is explained by the economic crisis with the subsequent socio-labor impact (EUROFOUND, 2015).
In addition to what we already know about this phenomenon, it is necessary to specify that while negative behaviors are key in conceptualizing mobbing, its essence is significant not only for the heterogeneous nature of behaviors but also in the tenacity and systematicity of experience (Einarsen et al., 2003; Trépanier et al., 2015) as the long-term exposure tends to wear down the coping strategies of the victims. It is therefore important to note that the harassment pattering occurs mostly when a power imbalance exists as a core feature of mobbing. The situation limits victims’ response and they can find difficulty in defending themselves. The imbalance of power often can come from a formal power structure of the organizational context (Hutchinson et al., 2006; Park et al., 2018) or may also be informal, based on experience, knowledge or access to support from influential persons (Einarsen et al., 2003).
Since the eighties, numerous methods were developed to measure harassment both qualitatively and quantitatively. Questionnaires remain the most used methods because they are very quick and easy to use (Leymann, 1990). Mobbing is a complex phenomenon with various facets and its measurement is a demanding task (Cowie et al., 2002; Einarsen et al., 2003). Three measurement methods can be applied in the assessment of mobbing. The first one asks the participants whether they identify with the definition of mobbing. In the second one, the operational criterion method is carried out through questionnaires, and the third method combines the previous two considered to be the best approach for the assessment of mobbing (Mikkelsen and Einarsen, 2001; Salin, 2001; Nielsen et al., 2011).
Within the subjective approach, the person being assessed is required to reply to a yes/no question whether they consider themselves as mobbing victims. The main problem of this approach is that subjective experience of harassment refers to targets’ perceptions of their experience and cultural values, which creates interpersonal variability (Niedl, 1995).
The objective approach, based on Leymann’s work, consists of a set of items measuring employee’s exposure to harassment behaviors. Harassment-related items were excluded to avoid victimization and socio-cultural biases (Giorgi et al., 2011; León-Pérez et al., 2019a). This method presents methodological issues such as the definition of an arbitrary cutoff point and heterogeneity among harassment behaviors considering that each questionnaire differs in terms of the number of items and topic, and the important variability within the harassment behaviors. This implies that a low-level exposure could be severe depending on each negative act (Notelaers et al., 2006).
Among the most important research instruments on the behavioral report method, there is the Leymann (1990) LIPT-60 (Leymann Inventory of Psychological Terrorization) and the NAQ-R (Einarsen and Hoel, 2001; Einarsen et al., 2009; Nolfe et al., 2012). At the national (Spanish) level, there are several different versions of the NAQ-R: the NAQ-RE (Sáez et al., 2003); two reduced versions, the NAQ-14 (Moreno-Jiménez et al., 2007) and the S-NAQ (León-Pérez et al., 2019b) and the NAQ-P, and an adapted version for perpetrators (Escartín et al., 2012).
At the international level, the NAQ (Einarsen and Raknes, 1997) is one of the most widely used instruments to evaluate any form of negative behavior (Nielsen et al., 2009, 2011). The original scale involved 24 items measuring exposure within the last 6 months without being identified as harassment using a five-item Likert scale (1, Never; 2, Now and Then; 3, Monthly; 4, Weekly; 5, Daily). By taking this into consideration, non-harassment-related behaviors are to avoid respondents to previously act in a non-judgmental way with regard to their role as victims, thus achieving more impartial results. Once the responses are gathered, a definition of mobbing is presented to the participants, allowing them to identify whether they experienced it or not (González-Trijueque and Graña, 2013).
Internal consistency of the NAQ has shown high internal consistency as measured by Cronbach’s alpha, which was 0.87 for personal harassment and 0.81 for work-related harassment (Einarsen and Hoel, 2001). Although the original scale showed high internal consistency containing items with good validity and evidence of good construct validity, the scale also had some constraints. Its validity was tested within a limited Scandinavian cultural context, so additional issues were found in the mainstreaming of the results as well as in its factor structure. Hence, a revised scale was needed. The NAQ-R was developed with the aim of achieving a greater cross-cultural validity while developing and refining the items based on the original scale (Einarsen et al., 2009).
All items in the NAQ-R scale are developed in behavioral terms with no reference to bullying or harassment. Cronbach’s alpha for the 22 items in the NAQ-R indicates a satisfactory internal consistency. In order to test the underlying dimension of the NAQ-R, a confirmatory approach with a positive outcome was pursued (Einarsen et al., 2009). Following the original NAQ, the NAQ-R is a 22-item scale containing an additional item used to describe behavioral terms without referring to mobbing definition, which comprises a reliable and valid measure of exposure to mobbing (Einarsen et al., 2009).
The NAQ-R has been validated within numerous international studies (Nielsen et al., 2011; Charilaos et al., 2015), indicating a satisfactory transcultural construct validity (Table 1; González-Trijueque and Graña, 2009). When conducting the in-depth study, based on its conceptualization, it can be used as a one-dimensional model (mobbing as one-factor); bidimensional (mobbing and personal harassment assessment); or three-dimensional (added to the previous factors, physical and/or sexual harassment). The results of the three models show a high correlation: 0.96 for personal and work-related harassment; 0.89 for work-related harassment and intimidation; and 0.83 for personal harassment and intimidation (Einarsen et al., 2009).
Table 1. Cross-cultural validation of the NAQ-R.
González-Trijueque and Graña (2013) added one sexual harassment-related item to the Spanish version of the NAQ-R, thus containing 23 items in total. Based on the review of the literature and with the objective to define a three-dimension model measuring all the existing violence subtypes, the authors deemed it necessary to make a distinction between personal, workplace, physical, and sexual harassment. The results reported a high internal consistency with significant reliability in regard to the Cronbach’s alpha, which was 0.93 (exceeding the 0.90 of the original scale). In this sense, when analyzing the internal consistency of each subscale, the personal-related harassment was the most accurate (0.93) followed by work-related harassment (0.81) and physical abuse (0.66). With reference to the concurrent validity, there is a positive and relevant correlation between the NAQ-R scores and both psychopathological symptoms and burnout. Therefore, the questionnaire is a reliable and valid instrument when assessing mobbing.
A revised scale is needed as the previous Spanish scale (González-Trijueque and Graña, 2013) did not include a confirmatory approach to successfully replicate the factor structure.
Objectives And Hypotheses
Objective #1: Psychometric study of a Spanish version of the NAQ-R (reliability and validity).
Objective #2: To analyze the concurrent validity between the NAQ-R and clinical symptoms (BSI), burn-out symptoms (MBI), and coping strategies (COPE).
Objective #3: To assess the use of the NAQ-R in the forensic framework as a future research direction.
Hypothesis #1: The NAQ-R is a suitable instrument for measuring psychological harassment at work. The instrument will adequately discriminate between harassed and non-harassed victims.
Hypothesis #2: Victims will show more clinical and burnout related symptoms than the non-harassed group of active employees.
Hypothesis #3: The coping strategies of the victims will depend on the type of harassment they were exposed to (psychological, work-related and physical).
Materials and Methods
Participants
For this study, we used a heterogeneous occupational sample including 2,538 employees from the Community of Madrid as the only inclusion criteria. The sampled covered the working population included in the census of the Madrid Region. Data were collected from the National Statistical Institute.
Measurements
Socio-demographic data and socio-occupational questionnaires were included ad hoc for this study and additional instruments were used: the Spanish version of the NAQ-R (González-Trijueque and Graña, 2013), the Brief Symptom Inventory (BSI) (Derogatis, 1975, 1993, Spanish adapted version of Aragón et al., 2000), the Maslach Burnout Inventory (MBI) (Maslach and Jackson, 1986, 1997, published in Spanish by TEA, 1997), and the Brief COPE questionnaire (Carver, 1997, Spanish adapted version of Crespo and López, 2003). The NAQ-R is the instrument chosen for this study as it is the most widely used measurement questionnaire for the study of the prevalence of psychological harassment at work and has been validated across many countries and instruments (Notelaers and Einarsen, 2013).
The BSI evaluates clinically relevant psychological symptoms measuring distress and psychiatric disorders covering the following nine symptom dimensions: Psychoticism (Psy), Paranoid Ideation (Par), Phobic Anxiety (Pho), Hostility (Hos), Anxiety (Ans), Depression (Dep), Interpersonal Sensitivity (Int), Obsession–Compulsion (Obs), and Somatization (Som); and the global indices of distress: Global Severity Index (GSI), Positive Symptom Distress Index (PSDI), and Positive Symptom Total (PST). In addition to the total score of the scale, the MBI measures Personal Accomplishment (PA), Depersonalization (DP), and Emotional Exhaustion (EE). In the present study, the shortened version of the Brief COPE was used in order to compile the results under the different subscales: (A) Active coping, (B) Planning, (C) Use of instrumental support, (D) Use of emotional support, (E) Religion, (F) Acceptance, (G) Denial, (H) Substance use, (I) Humor, (J) Self-distraction, (K) Behavioral disengagement, (L) Venting, (M) Positive reframing, and (N) Self-blame.
Methodology
The stratified sample was collected thanks to 250 student assistants from the Faculty of Psychology at the Complutense University who were properly trained in mobbing research and data collection. In addition, regular meetings with all the students have taken place to improve their knowledge and skills in the context of mobbing and data collection procedures. The task entrusted to each student was to distribute voluntarily and confidentially 16 questionnaires to the working population in their community, thus fulfilling the criteria inclusion. Based on the census of each geographical area, all 250 students were allocated to different areas within the Community of Madrid. After analyzing a total of 4,000 questionnaires distributed, the final number of valid respondents was 2,538. Eventually, a total of 1,462 questionnaires were excluded as clearly not meeting the specific criterion due to inconsistent or random answers. For the purpose of applying the latter criterion, four items of similar content were included in the set of questions specifically developed for this study.
The objective was to take a representative sample of the active working population. To this end, the working population is taken as a reference based on the census of the Region of Madrid. The data from the census was obtained from the National Institute of Statistics (“Revision of the population projections in the Community of Madrid 1996–2011”); these data were confidential. To achieve the objectives of the study, all 250 research assistants were assigned to different areas of the Community of Madrid considering the population census and the following geographical areas in order to obtain the study sample:
a) Center of Madrid 51% (126 research assistants)
b) Northern metropolitan area 5% (12 research assistants)
c) Western metropolitan area 5% (14 research assistants)
d) Southern metropolitan area 18% (45 research assistants)
e) Eastern metropolitan area 8% (21 research assistants)
f) Peripheral metropolitan area 13% (32 research assistants).
Each research assistant is assigned a census. The assistant contacts the participants by phone and explains how they are required to give their consent and how to proceed in order to send the protocols anonymously to a post office box created specifically for this purpose. Participating in the study is voluntary and confidential. The protocols are anonymous and contain simple instructions to familiarize respondents with and facilitate the entire process. The steps to be followed for sending and receiving the protocols are as follows:
1. Students contact the candidate by phone.
2. They are given all the information related to the study and information concerning confidentiality and personal data.
3. Once the candidate agrees to participate (then becomes a participant), he/she is sent an envelope containing the protocol to be completed and a consent form including the same information provided in writing.
4. During the whole process, participants can contact their reference research assistant (each student has 16 participants under his/her charge).
5. Once the participant has filled in the form, he or she will send it anonymously to the postal address provided.
Statistical Analysis
SPSS (19.0 version) was used to gather statistical analysis in order to examine internal consistency and concurrent validity. Additionally, the coefficient of reliability of Cronbach’s alpha was employed for the main scale and the three subscales. Pearson’s bivariate correlations determined the concurrent validity within symptoms, burnout indicators, and coping. The multivariate kurtosis pointed to the non-normality of the obtained data (Mardia coefficient = 735.4). Consequently, Generalized Least Squares (GLS) was used as estimation method.
Results
Descriptive Statistical Analysis
Participants in the sample (Table 2) reported a higher perception of harassment during the last 6 months with regard to performing tasks below their level of competence (item 3:1.93), someone withholding information (item 1:1.71), and unmanageable workload (item 21:2.00). Behaviors showing lower scores are related to intimidating actions item 9 (1.71); item 20 (1.18) and physical and sexual-related behaviors: item 22 (1.06) and (1.07).
Table 2. Statistical description of data.
A sample of multi-occupational workers among different sectors is used to obtain representative and widespread results and to estimate the prevalence of harassment within the sample. The industries included in the sample are health, education, administration, financial, and business services, communications, transport, hospitality, trade, food and textiles, construction, agriculture, livestock, and fishing, mining, energy chemical, and metal industries, electrical equipment, and vehicles.
Using overall samples of employees and avoiding targeting strictly workplace harassment victims (in forensic and clinical samples) comes from the need to assess whether the questionnaire discriminates between harassed and non-harassed. Also, because when analyzing the correlation with clinical symptoms, vulnerability features are more usual in studies involving clinical samples rather than using multi-occupational samples of active workers (Lind et al., 2009).
Of the total sample, 97.8% of the 2,538 employees are Spanish. A total of 55.4% are females and 44.6% are males. The mean age for the total sample was 33.87 years (34.92 years for men and 33 for females). A total of 76.6% participants work within the public sector and the remaining 23.4% work in the private sector. In terms of the socio-economic level, a total of 86.1% middle-class participants with higher education (43.8%) and single employees (59.9%) prevail.
Regarding the perception of being a victim of workplace harassment, the 9% of respondents reported being a victim, of whom 2% reported more frequent exposure and 7% reported experiencing workplace harassment occasionally. The most common type of mobbing is horizontal harassment inflicted by peers and superiors (4.1%) followed by bossing (3.5%), which is a type of harassment coming in an upward vertical direction. A total of 81.6% of participants stated not having received previous psychological counseling and only the 5.5% stated receiving current psychological support.
Reliability
In the first place, we had to determine the level of reliability and its factors shown by Cronbach’s alpha coefficient in Table 3. Reliability data underline good scores for both full scale (0.91) and psychological distress scale (0.90). Scales for work-related harassment (0.75) and physical intimidation (0.56) are discrete and less accurate. The average variance extracted for these scales were 0.35, 0.35, and 0.37, respectively. Besides, the composite reliability was satisfactory for psychological distress scale (0.93) and work-related harassment (0.74) but less accurate for physical intimidation (0.57).
Table 3. Internal consistency reliability.
Concurrent Validity Among Dimensions of the NAQ-R and BSI
To measure concurrent validity, we took as reference the common criteria used in the literature to assess harassment, reliability, and validity. As shown in Table 4, the NAQ-R and the BSI were positively correlated with all the scales and significantly with psychological harassment and interpersonal sensitivity, depression, anxiety, hostility, and paranoid ideation.
Table 4. Correlations among dimensions of the NAQ-R and BSI.
Concurrent Validity Among Dimensions of the NAQ-R and COPE
The results show a great variety of coping strategies, especially at the workplace and personal harassment. Results in Table 5 suggest that in situations where stressors are more distinguishable (e.g., intimidation behaviors or threats of physical or sexual abuse), coping resources are more discriminant but also tend to passiveness. Hence, correlations for coping resources, seeking instrumental and emotional support, planning, positive reframing, and acceptance are non-significant. However, if the existing behaviors are general or less recognizable by the victim, a wider spectrum is considered; thus, all scores are significant.
Table 5. Correlations among dimensions of the NAQ-R and COPE.
Concurrent Validity Among Dimensions of the NAQ-R and MBI
Following Pearson’s bivariate correlations, the aim is to find correlations between burnout and mobbing indicators with significant results in terms of workplace harassment and emotional exhaustion as shown in Table 6.
Table 6. Correlations among dimensions of the NAQ-R and MBI.
Confirmatory Factor Analysis
The confirmatory factor analysis based on 23 items showed suitable fit indices: root mean square residual (RMR) = 0.04; adjusted goodness of fit index (AGFI) = 0.93; root mean square error of approximation (RMSEA) = 0.05 and Tucker–Lewis fit index (TLI) = 0.90 (Table 7). Based on the Spanish version of the three-dimension model, the factor-structure loadings exceed 0.35 and the variance explained for each item exceeds 0.20. All correlations among the three factors are significant (p < 0.05) and higher scores are associated with personal and work-related harassment (Figure 1).
Table 7. Confirmatory factor analysis: comparison between three models.
Figure 1. Confirmatory factor analysis of the three-factor model (personal harassment, work-related harassment, physical abuse and/or sexual harassment).
Nevertheless, in order to verify the three-factor scale, the model was compared with different versions of the NAQ-R. We tested a one-factor model and a general factor solution that groups together a three-factor model. The three-factor model fits the data best as shown in the following table. Higher scores than 0.90 on the AGFI and TLI indicate valid goodness of fit, whereas scores equal to or lower than 0.05 on the RMR and RMSEA show a good fit for this model (Byrne, 2001). The results show that the three-factor model fits the data better: RMR = 0.04, AGFI = 0.93, RMR = 0.04, RMSEA = 0.05, and TLI = 0.90. Finally, we assessed the measurement invariance across gender (male or female) using the three-factor model (Table 8). Fit indexes were adequate for each subsample (male and females) and the ΔCFI between the models was below the 0.01 cutoff. These results showed that the three-factor model do share equivalence across gender.
Table 8. Measurement invariance for gender.
Discussion
Results suggest that the NAQ-R appears to be a valid instrument with suitable psychometric properties for the measurement of mobbing at the workplace. Although the version presented on this study has one more item related to physical and sexual harassment, the instrument contains internal strong structure where the first factor—related to personal harassment—is the most notable, reliable, and valid to measure harassment in accordance with the other cross-cultural validation studies (Nielsen et al., 2011).
With regard to first hypothesis, the results of the study confirm that the NAQ-R is a suitable instrument for measuring psychological harassment. All factor weights (calculated mean-variance) exceed 0.35 mean-variance as recommended (Gorsuch, 1983) and the same approach is used in further studies (e.g., Safren et al., 1998; Morrison et al., 2000).
Similar results have been found in the NAQ version of Soler et al. (2010) with an explained variance of 32.8%. The S-NAQ of León-Pérez et al. (2019b) shows an explained variance of 35.58%.
Cronbach’s alpha for the total scale (0.91) indicates similar scores compared to the original NAQ-(N = 4.996) indicating high internal stability (Einarsen et al., 2009). Personal harassment (Cronbach’s alpha = 0.90) is the most accurate and homogeneous underlying factor containing high internal consistency and showing discrete scores on the mobbing scale though acceptable (0.74). Physical and/or sexual related scale is less accurate as measured by Cronbach’s alpha was 0.56. As the main limitation, we find a low reliability in the third factor that shows physical and sexual harassment.
Although sexual harassment and mobbing are clearly two well-differentiated phenomena (Gimeno-Lahoz, 2004), item 23 has been included because sexual harassment is common within the process of mobbing itself, especially toward women (Lapierre et al., 2005; Cortina, 2008; Cortina and Berdahl, 2008). In addition, sexual harassment has been a defining factor in the “physical violence” dimension of mobbing (Zapf et al., 1996).
The values resulting from the third factor can be explained in two ways. The first is that victims are more hesitant to report having suffered some form of physical or sexual harm (González-Trijueque, 2007). Another possible explanation is that in countries like Spain, compared to, for example, the Latin American background, violence of a physical nature is less common due to the social concern it raises. Hence, it is not as much associated with psychological harassment at work (Dujo et al., 2019).
While analyzing concurrent validity showing clinical symptoms and burnout, we hypothesized that the scale would show negative correlations with measures on subjective health and well-being, and negative correlations with perceptions of the quality of the psychosocial work environment, including job satisfaction, commitment, and relationships with superiors and colleagues. The NAQ-R should also be moderately associated with raised levels of sick leave in addition to a strong positive association with subjective feelings of victimization (Einarsen et al., 2009).
All the aforementioned agrees with the existing literature underlining the link between harassment and the victim’s health (Leymann and Gustafsson, 1996; Niedl, 1996; Matthiesen and Einarsen, 2001, 2004; Mikkelsen and Einarsen, 2001, 2002; Borrás, 2002; Einarsen and Mikkelsen, 2003; Hogh et al., 2011; El Ghaziri et al., 2020).
Mobbing is one of the main stress factors causing devastating consequences for the employees (Moreno-Jiménez and Muñoz, 2006). The studies showed a correlation between exposure to mobbing and chronic fatigue; physical symptoms, psychosomatic, insomnia, and mental stress reactions (Dofradottir and Høgh, 2002; Einarsen and Mikkelsen, 2003; Zapf et al., 2003; Moayed et al., 2006; El Ghaziri et al., 2020). Furthermore, relevant symptoms such as musculoskeletal complaints, anxiety, irritability, and depression were reported by victims in different European countries (Einarsen and Skogstad, 1996; Niedl, 1996; Zapf et al., 1996; O’Moore et al., 1998). As well, some victims displayed a pattern of symptoms indicative of post-traumatic stress disorder (PTSD) (Björkqvist et al., 1994; Leymann and Gustafsson, 1996; Einarsen, 1999; Mikkelsen and Einarsen, 2002). According to González-Trijueque and Graña (2013), victims of mobbing were found to be more likely to show higher indicators on clinical symptoms. It must be underlined that the increased paranoid ideation rates are matching the state of hypervigilance of the victims withstanding these situations (Piñuel, 2001; Einarsen and Mikkelsen, 2003; González de Rivera and Abuin, 2006; González-Trijueque, 2010).
As for the second hypothesis, the results found in the study are similar to those obtained in the original version (Einarsen et al., 2009), in the Spanish version (González-Trijueque and Graña, 2013), and in the reduced version of Moreno-Jiménez et al. (2007). Negative correlations are observed with variables such as overall worker performance, mental and physical health, degree of health and social well-being, job satisfaction, positive correlations with somatic complaints, and desire to leave the workplace. Significant positive correlations are indicated with clinical symptoms and burnout indicators. Particularly remarkable is the correlation between personal harassment and clinical psychopathology, especially in anxiety, depression, interpersonal sensitivity, and paranoid ideation (Einarsen et al., 2009).
The same results have been found in other measures of harassment commonly used in the Spanish setting, such as the LIPT-60 (González de Rivera and Rodríguez-Abuín, 2005). In this sense, the NAQ-R adequately reflects the association in the current literature between harassment and clinical symptomatology (Matthiesen and Einarsen, 2004; Hogh et al., 2019) and burnout (Einarsen et al., 1998; Moreno-Jiménez et al., 2007).
Special mention should be given to the latest research results focusing on the correlation between mobbing and PTSD. It is generally acknowledged that mobbing does not represent a single traumatizing event but rather a systematic exposure to mainly non-physical aggression over a long-term period. It has been suggested that similar PTSD symptoms found among victims should rather be subsumed under adjustment, depressive, anxiety disorder, or simply distress that is not part of a defined psychiatric disorder category (Nielsen et al., 2015). Although exposure to psychological harassment constitutes a systematic exposure over a prolonged time period, it has been claimed that the distress many of the victims’ experience equalizes the stress associated with traumatic events (Mikkelsen and Einarsen, 2002; Matthiesen and Einarsen, 2004; Tehrani, 2004). A later meta-analysis by Nielsen et al. (2015) showed that an average of 57% of victims of bullying reported symptom scores for PTSD with an established correlation of 0.42 for exposure to harassment behaviors and PTSD symptoms.
Likewise, strong correlations on the NAQ-R were associated with psychological distress, interpersonal conflicts, deficiencies in both supervision and social support as concluded in several studies that underline correlations between the NAQ-R and a high workload pressure, negative organizational climate, negative relationship with colleagues, and low scores on organizational satisfaction (Einarsen et al., 2009).
Personal harassment factor has been found to be closely associated with clinical symptoms and especially with psychopathological scales on paranoid ideation, interpersonal sensitivity, hostility, anxiety, and depression (Table 4) as shown by González-Trijueque and Graña (2013) whereas work-related harassment has been positively associated to burnout prototypical indicator associated with emotional exhaustion. Although both are different psychosocial stressors, the mobbing phenomenon is expected to be correlated with burnout symptoms (Moreno-Jiménez et al., 2007).
As for the third hypothesis, during the early stages of the harassment process, the type of harassment that occurs may be indirect, subtle, and occasional, so that in most cases it is not detected by the victim (Nielsen et al., 2011). As the victimization process becomes more visible and direct, the nature of the harassment becomes more relevant to the victim, who begins to use all kinds of coping strategies to tackle harassment. The lack of results leads the victim to a position of vulnerability and stasis in dealing with harassment (González-Trijueque, 2007).
With regard to the findings on coping resources as stated by González-Trijueque (2007), the more unclear the harassment is, the broader is the spectrum of the employee’s coping resources, which explains the different resources the victims utilize throughout the harassment process in an attempt to stop it. All scores are correlated with both personal and work-related harassment factor. However, when there are intimidation or physical threat behaviors, victims tend to show more specific coping resources avoiding active and acceptance strategies.
It is important to highlight the lack of tolerance and cultural validation of violence in both society and Western organizational culture. While in other countries physical and sexual abuse are normalized, in most developed countries, these behaviors are unusual, which leads to a significant impact on target and results in hindering or a lack of active coping of the victim (González-Trijueque and Graña, 2013).
Finally, it can be concluded that the NAQ-R is a valid and reliable measure of exposure to harassment indicating high internal consistency and good discriminatory power. Yet, a review on the prevalence of mobbing showed that 47% of the included behavioral experience studies employed a variation of this instrument (Nielsen et al., 2010, 2011). Based on the factor structure, the NAQ-R may also be used in its one-dimension model (general/common harassment) as well as in its multi-dimension scale (personal harassment, mobbing, and physical intimidation).
After testing several underlying dimensions of the NAQ-R, findings were consistent with the data obtained (Einarsen et al., 2009). In conclusion, the confirmatory factor analysis conducted on a heterogeneous occupational sample indicates that the fit is satisfactory for the measure of exposure to mobbing on the three underlying factors in the Spanish version of the NAQ-R.
So far, the NAQ-R and other measuring instruments with similar properties have been used in both research and the context of Organizational Psychology (Notelaers and Einarsen, 2013). A needed line of research is the implementation of validity scales so that these can be applied in the forensic field with greater guarantees, taking into account the methodological needs in the field of expert assessment. The NAQ-R complies with the purpose of collecting quantitative or qualitative data that can be useful to conduct a differential diagnosis with an additional psychosocial stressor, but never to support the argument of the existing workplace harassment situation according to its outcomes (González-Trijueque and Delgado, 2011).
Although this type of tests accurately measure harassment, they are easily susceptible to manipulation (simulation) (Vilariño et al., 2020) and therefore cannot be used in the context of forensics in isolation. To meet the strict and technical criteria, they must be integrated into a multi-method and multi-source assessment system (Muñoz, 2013).
Data Availability Statement
The datasets generated for this study are available on request to the corresponding author.
Ethics Statement
The studies involving human participants were reviewed and approved by the Deontological Commission of the Faculty of Psychology at the Complutense University of Madrid. The patients/participants provided their written informed consent to participate in this study.
Author Contributions
VD conducted the statistical analysis and review of the literature, wrote much of the manuscript, and interpreted the findings for this study. DG and JG encoded the data within the research process. JA was involved in the statistical analysis process (Confirmatory Factor Analysis) and monitored the drafting of the text. All authors contributed to the article and approved the submitted version.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
Aragón, N., Bragado, M. C., and Carrasco, I. (2000). Fiabilidad y estructura factorial del Inventario Breve de Síntomas (BSI) en adultos. Psicol. Conductual 8, 77–83.
Barómetro Cisneros (2009). Barómetro CISNEROS XI. Alcalá de Henares: Universidad de Alcalá de Henares.
Björkqvist, K., Österman, K., and Hjelt-Bäck, M. (1994). Aggression among university employees. Aggress. Behav. 20, 173–184. doi: 10.1002/1098-2337(1994)20:3<173::AID-AB2480200304>3.0.CO;2-D
Borrás, L. (2002). El mobbing o acoso moral en el trabajo. Psicopatología Clínica Legal y Forense 2, 113–120.
Byrne, B. M. (2001). Structural Equation Modeling with Amos: Basic Concepts, Applications and Programming. Mahwah, NJ: Erlbaum.
Cakirpaloglu, P., Šmahaj, J., Cakirpaloglu, S. D., and Zielina, M. (2017). Šikana na pracovisti: reliabilita a validita českého překladu revidované verze dotazníku negativních aktů-NAQ-R. Ceskosl. Psychol. 61, 546–558.
Carver, C. S. (1997). You want to measure coping but your protocol’s too long: consider the brief cope. Int. J. Behav. Med. 4:92. doi: 10.1207/s15327558ijbm0401_6
Charilaos, K., Michael, G., Chryssa, B. T., Panagiota, D., George, C. P., and Christina, D. (2015). Validation of the negative acts questionnaire (naq) in a sample of greek teachers. Psychology 6:63. doi: 10.4236/psych.2015.61007
Cortina, L. M. (2008). Unseen injustice: Incivility as modern discrimination in organizations. Acad. Manage. Rev. 33, 55–75. doi: 10.5465/amr.2008.27745097
Cortina, L. M., and Berdahl, J. L. (2008). Sexual harassment in organizations: a decade of research in review. Handb. Organ. Behav. 1, 469–497. doi: 10.4135/9781849200448.n26
Cowie, H., Naylor, P., Rivers, I., Smith, P. K., and Pereira, B. (2002). Measuring workplace bullying. Aggress. Violent Behav. 7, 33–51. doi: 10.1016/s1359-1789(00)00034-3
Crespo, M., and López, J. (2003). Cope Abreviado. En M. Crespo and F.Labrador (Eds.), Estrés. Madrid: Síntesis, 98–99.
Derogatis, L. R. (1993). Brief Symptom Inventory: Administration, scoring and procedures manual, 4th Edn. Minneapolis, MN: CS, Pearson, Inc.
Dofradottir, A., and Høgh, A. (2002). Mobning På Arbejdspladsen. En kritisk gennemgang af dansk og international Forskningslitteratur (Bullying at work. A Critical Review of Danish and International Research) (Rep. No. 10). København: Arbejdsmiljøinstituttet.
Dujo, V., González-Trijueque, D., and García-López, E. (2019). Violencia Sexual, Física y Psicológica en el trabajo. En García-López, E. (Ed.), Psicopatología de la Violencia: Aspectos jurídicos y evaluación criminológica. Ciudad de Mexico: Manual Moderno, 266–309.
Einarsen, S. (1999). The nature and causes of bullying at work. Int. J. Manpow. 20, 16–27. doi: 10.1108/01437729910268588
Einarsen, S., and Hoel, H. (2001). The Negative Acts Questionnaire: Development, validation, and revision of a measure of bullying at work. Paper presented at the Ninth European Congress of Work and Organizational Psychology, Prague, May.
Einarsen, S., and Mikkelsen, E. G. (2003). “Individual effects of exposure to bullying at work,” in Bullying and Emotional Abuse in the Workplace. International Perspectives in Research and Practice, eds S. Einarsen, H. Hoel, D. Zapf, and C. L. Cooper (London: Taylor and Francis), doi: 10.4324/9780203278734
Einarsen, S., and Raknes, B. I. (1997). Harassment in the workplace and the victimization of men. Violence Vict. 12:247. doi: 10.1891/0886-6708.12.3.247
Einarsen, S., and Skogstad, A. (1996). Bullying at work: epidemiological findings in public and private organizations. Eur. J. Work Organ. Psychol. 5, 185–201. doi: 10.1080/13594329608414854
Einarsen, S., Hoel, H., and Notelaers, G. (2009). Measuring exposure to bullying and harassment at work: validity, factor structure and psychometric properties of the negative acts questionnaire-revised. Work Stress 23, 24–44. doi: 10.1080/02678370902815673
Einarsen, S., Hoel, H., Zapf, D., and Cooper, C. L. (2003). Bullying and Emotional Abuse in the Workplace: International Perspectives in Research and Practice. Boca Raton, FL: CRC Press, doi: 10.4324/9780203278734
Einarsen, S., Hoel, H., Zapf, D., and Cooper, C. L. (2011). “The concept of bullying and harassment at work: the european tradition,” in Bullying and Harassment in the Workplace: Developments in Theory, Research, and Practice, 2nd Edn, eds S. Einarsen, H. Hoel, D. Zapf, and C. L. Cooper (Boca Raton, FL: CRC Press), 3–39. doi: 10.1201/ebk1439804896-3
Einarsen, S., Matthiesen, S., and Skogstad, A. (1998). Bullying, burnout and well-being among assistant nurses. J. Occupat. Health Saf. Austr. N. Z. 14, 563–568.
El Ghaziri, M., Simons, S., Lipscomb, J., Storr, C. L., McPhaul, K., London, M., et al. (2020). Understanding the impact of bullying in a unionized US public sector workforce. Workplace Health Saf. 68, 139–153. doi: 10.1177/2165079919883286
Escartín, J., Sora, B., Rodríguez-Muñoz, A., and Rodríguez-Carballeira, Á (2012). Adaptación y validación de la versión española de la escala de conductas negativas en el trabajo realizadas por acosadores: NAQ-perpetrators. Rev. Psicol. Trabajo y de las Organ. 28, 157–170. doi: 10.5093/tr2012a13
EUROFOUND (2015). Violence and Harassment in European Workplaces: Causes, Impacts and Policies. Dublin: Eurofound.
EUROFOUND (2017). Sixth European Working Conditions Survey-Overview report (2017 update). Luxemburg: Publications Oficial of The European Union.
Fidalgo, M., Gallego, Y., Ferrer, R., Nogareda, C., Pérez-Zambrana, G., and García-Maciá, R. (2009). Nota Técnica Preventiva (NTP) 854. Acoso Psicológico en el Trabajo: Definición. Madrid: Instituto Nacional de Seguridad e Higiene en el Trabajo.
Giorgi, G., Arenas, A., and León-Pérez, J. M. (2011). An operative measure of workplace bullying: the negative acts questionnaire across Italian companies. Ind. Health 49, 686–695. doi: 10.2486/indhealth.ms1287
González, de Rivera, J. L., and Abuin, M. R. (2006). Acoso psicológico en el trabajo y psicopatología: Un estudio con el LIPT-60 y el SCL 90-R. Rev. Psicol. Trabajo y de las Organ. 22, 397–412.
González de Rivera, J. L., and Rodríguez-Abuín, M. (2005). LIPT-60. Cuestionario de Estrategias de Acoso Psicológico en el Trabajo. Manual. Madrid: Editorial EOS.
González-Trijueque, D. (2007). El Acoso Psicológico en el lugar de Trabajo: Epidemiología, Variables Psicosociales y Repercusiones Forenses. Tesis Doctoral., Universidad Complutense de Madrid, Madrid.
González-Trijueque, D. (2010). Mobbing: Aproximación al Acoso Psicológico en el Lugar de Trabajo. En E. García-López (Dir.), Fundamentos de la Psicología Jurídica y Forense. México: Oxford University Press, 423–451.
González-Trijueque, D., and Delgado, S. (2011). Propuesta metodológica para la evaluación pericial de la víctima de mobbing. Psicopatol. Clín. Legal y Forense 11, 143–166.
González-Trijueque, D., and Graña, J. L. (2009). El acoso psicológico en el lugar de trabajo: prevalencia y análisis descriptivo en una muestra multiocupacional. Psicothema 21, 288–293.
González-Trijueque, D., and Graña, J. L. (2013). Adaptación psicométrica de una versión española del cuestionario de conductas negativas revisado (NAQ-R). Psicopatol. Clín. Legal y Forense 13, 7–28.
Hogh, A., Clausen, T., Bickmann, L., Hansen, A. M., Conway, P. M., and Baernholdt, M. (2019). “Consequences of workplace bullying for individuals, organizations and society,” in Concepts, Approaches and Methods. Handbooks of Workplace Bullying, Emotional Abuse and Harassment, eds P. D’Cruz, E. Noronha, G. Notelaers, and C. Rayner (Singapore: Springer), doi: 10.1007/978-981-10-6173-8_8-1
Hogh, A., Mikkelsen, E. G., and Hansen, A. M. (2011). Individual consequences of workplace bullying/mobbing. Bully. Harassment Workplace Dev. Theory Res. Pract. 107, 128.
Hutchinson, M., Vickers, M., Jackson, D., and Wilkes, L. (2006). Workplace bullying in nursing: towards a more critical organisational perspective. Nurs. Inq. 13, 118–126. doi: 10.1111/j.1440-1800.2006.00314.x
Kakoulakis, C., Galanakis, M., Bakoula-Tzoumaka, C., Darvyri, P., Chroussos, G., and Darvyri, C. (2015). Validation of the negative acts questionnaire (NAQ) in a sample of greek teachers. Psychology 6, 63–74. doi: 10.4236/psych.2015.61007
Lapierre, L. M., Spector, P. E., and Leck, J. D. (2005). Sexual versus nonsexual workplace aggression and victims’ overall job satisfaction: a meta-analysis. J. Occup. Health Psychol. 10:155. doi: 10.1037/1076-8998.10.2.155
Lee, M., Kim, H., Shin, D., and Lee, S. (2016). Reliability and validity of the workplace harassment questionnaire for Korean finance and service workers. Anna. Occupat. Environ. Med. 28:45. doi: 10.1186/s40557-016-0133-0
León-Pérez, J. M., Escartin, J., and Giorgi, G. (2019a). “The presence of workplace bullying and harassment worldwide,” in Cocepts, Approaches and Methods. Handbppks of Workplace Bullying, Emotional Abuse and Harassment, eds P. D‘Cruz, E. Noronha, G. Notelaers, and C. Rayner (Singapore: Springer).
León-Pérez, J. M., Sánchez-Iglesias, I., Rodríguez-Muñoz, A., and Notelaers, G. (2019b). Cutoff scores for workplace bullying: the spanish short-negative acts questionnaire (S-NAQ). Psicothema 31, 482–490.
Leymann, H. (1990). Manual of the LIPT Questionnaire for Assessing the Risk of Psychological Violence at Work. Stockholm: Violen.
Leymann, H., and Gustafsson, A. (1996). Mobbing at work and the development of post-traumatic stress disorders. Eur. J. Work Organ. Psychol. 5, 251–275. doi: 10.1080/13594329608414858
Lind, K., Glasø, L., Pallesen, S., and Einarsen, S. (2009). Personality profiles among targets and nontargets of workplace bullying. Eur. Psychol. 14, 231–237. doi: 10.1027/1016-9040.14.3.231
Maciel, R. H., and Gonçalves, R. C. (2008). “Pesquisando o assédio moral: a questão do método e a validação do Negative acts questionnary (NAQ) para o Brasil,” in Violência Psicológica e Assédio Moral no Trabalho: Pesquisas Brasileiras, ed. L. A. Pereira Soboll (São Paulo: Casa do Psicológo), 167–185.
Maslach, C., and Jackson, S. E. (1986). Maslach Burnout Inventory, 2nd ed; 1981 1st Edn. Palo Alto, CA: Consulting Psychologists Press.
Maslach, C., and Jackson, S. E. (1997). MBI. Inventario “Burnout” de Maslach. Madrid: TEA Ediciones.
Matthiesen, S. B., and Einarsen, S. (2001). MMPI-2 configurations among victims of bullying at work. Eur. J. Work Organ. Psychol. 10, 467–484. doi: 10.1080/13594320143000753
Matthiesen, S. B., and Einarsen, S. (2004). Psychiatric distress and symptoms of PTSD among victims of bullying at work. Br. J. Guid. Counsell. 32, 335–356. doi: 10.1080/03069880410001723558
Mikkelsen, E. G., and Einarsen, S. (2001). Bullying in Danish work-life: prevalence and health correlates. Eur. J. Work Organ. Psychol. 10, 393–413. doi: 10.1080/13594320143000816
Mikkelsen, E. G., and Einarsen, S. (2002). Basic assumptions and symptoms of post-traumatic stress among victims of bullying at work. Eur. J. Work Organ. Psychol. 11, 87–111. doi: 10.1080/13594320143000861
Millán, A., Diaferia, L., Acosta, M., and D’Aubeterre, M. E. (2016). Comparativo de las propiedades psicométricas del NAQ-R y del LIPT-60 en trabajadores venezolanos. CES Psicol. 9, 40–67. doi: 10.21615/cesp.9.2.4
Moayed, F. A., Daraiseh, N., Shell, R., and Salem, S. (2006). Workplace bullying: a systematic review of risk factors and outcomes. Theor. Issues Ergonom. Sci. 7, 311–327. doi: 10.1080/14639220500090604
Moreno-Jiménez, B., and Muñoz, A. R. (2006). Número monográfico sobre acoso psicológico en el trabajo: una perspectiva general. Rev. Psicol. Trabajo y Organ. 22, 245–249.
Moreno-Jiménez, B. M., Muñoz, A. R., Gamarra, M. M., and Gálvez-Herrer, M. (2007). Assessing workplace bullying: Spanish validation of a reduced version of the Negative Acts Questionnaire. Span. J. Psychol. 10, 449–457. doi: 10.1017/s1138741600006715
Morrison, A. P., Wells, A., and Nothard, S. (2000). Cognitive factors in predisposition to auditory and visual hallucinations. Br. J. Clin. Psychol. 39, 67–78. doi: 10.1348/014466500163112
Muñoz, J. M. (2013). La evaluación psicológica forense del daño psíquico: propuesta de un protocolo de actuación pericial. Anuario Psicol. Jurídica 23, 61–69. doi: 10.5093/aj2013a10
Niedl, K. (1995). Mobbing/bullying am arbeitsplatz. eine empirische analyse zum phänomen sowie zu personalwirtschaftlich relevanten effekten von systematischen feindseligkeiten. J. Res. Hum. Resour. Manage. 9, 297–300.
Niedl, K. (1996). Mobbing and well-being: economic and personnel development implications. Eur. J. Work Organ. Psychol. 5, 239–249. doi: 10.1080/13594329608414857
Nielsen, M. B., Matthiesen, S. B., and Einarsen, S. (2010). The impact of methodological moderators on prevalence rates of workplace bullying. A meta-analysis. J. Occupat. Organ. Psychol. 83, 955–979. doi: 10.1348/096317909x481256
Nielsen, M. B., Notelaers, G., and Einarsen, S. (2011). Measuring exposure to workplace bullying. Bully. Harass. Workplace Dev. Theory Res. Pract. 2, 149–174.
Nielsen, M. B., Skogstad, A., Matthiesen, S. B., Glasø, L., Aasland, M. S., Notelaers, G., et al. (2009). Prevalence of workplace bullying in Norway: comparisons across time and estimation methods. Eur. J. Work Organ. Psychol. 18, 81–101. doi: 10.1080/13594320801969707
Nielsen, M. B., Tangen, T., Idsoe, T., Matthiesen, S. B., and Magerøy, N. (2015). Post-traumatic stress disorder as a consequence of bullying at work and at school. A literature review and meta-analysis. Aggress. Violent Behav. 21, 17–24. doi: 10.1016/j.avb.2015.01.001
Nolfe, G., Triassi, M., Cappuccio, A., Carbone, U., and Nolfe, G. (2012). The naples-questionnaire of work distress (nQ-WD): Bullying at workplace, organizational dysfunctions, and bio-psycho-social effects. Open J. Psychiatry 2, 77–81. doi: 10.4236/ojpsych.2012.21011
Notelaers, G., and Einarsen, S. (2013). The world turns at 33 and 45: defining simple cutoff scores for the Negative Acts Questionnaire-Revised in a representative sample. Eur. J. Work Organ. Psychol. 22, 670–682. doi: 10.1080/1359432X.2012.690558
Notelaers, G., Einarsen, S., De Witte, H., and Vermunt, J. K. (2006). Measuring exposure to bullying at work: the validity and advantages of the latent class cluster approach. Work & Stress 20, 289–302. doi: 10.1080/02678370601071594
O’Moore, M., Seigne, E., McGuire, L., and Smith, M. (1998). Victims of workplace bullying in Ireland. Irish J. Psychol. 19, 345–357. doi: 10.1080/03033910.1998.10558195
Park, H., Bjørkelo, B., and Blenkinsopp, J. (2018). External whistleblower‘s experiences of workplace bullying by superiors and collegues. J. Bus. Ethics 161, 591–601. doi: 10.1007/s10551-018-3936-9
Piñuel, I. (2001). Mobbing: Cómo Sobrevivir al Acoso Psicológico en el Trabajo, Vol. 67. Santander: SAL TERRAE Publishing House.
Rai, A., and Agarwal, U. A. (2017). Exploring nature of workplace bullying and psychometric properties of negative acts questionnaire-revised (NAQ-R) in Indian organizations. J. Indian Bus. Res. 9, 229–247. doi: 10.1108/jibr-12-2016-0145
Rodríguez-Muñoz, A., Antino, M., and Sanz-Vergel, A. I. (2017). Cross-doamin consequences of workplace bullying: a multi-source daily diary study. Work Stress 31, 297–314. doi: 10.1080/02678373.2017.1330782
Sáez, M. C., García-Izquierdo, M., and Llor, B. (2003). Validación de la Escala NAQ de Einarsen y Raknes (1997) Sobre Acoso Psicológico en el Trabajo (mobbing). Torremolinos: VIII Congreso Nacional de Psicología Social.
Safren, S. A., Turk, C. L., and Heimberg, R. G. (1998). Factor structure of the social interaction anxiety scale and the social phobia scale. Behav. Res. Ther. 36, 443–453. doi: 10.1016/s0005-7967(98)00032-1
Salin, D. (2001). Prevalence and forms of bullying among business professionals: a comparison of two different strategies for measuring bullying. Eur. J. Work Organ. Psychol. 10, 425–441. doi: 10.1080/13594320143000771
Silva, I. V., de Aquino, E. M., and de Matos Pinto, I. C. (2017). Características psicométricas do negative acts questionnaire para detecção do assédio moral no trabalho: estudo avaliativo do instrumento com uma amostra de servidores estaduais da saúde. Rev. Brasil. Saúde Ocupacional 42:e2. doi: 10.1590/2317-6369000128715
Soler, M. I., Meseguer, M., García-Izquierdo, M. E., and Hidalgo, M. D. (2010). Validación del cuestionario de conductas de hostigamiento (mobbing) de Einarsen y Raknes. Ansied. Estrés 16, 151–162.
Tambur, M., and Vadi, M. (2009). Bullying at work: research in Estonia using the Negative Acts Questionnaire-Revised (NAQ-R). Rev. Int. Compar. Manage. 10, 791–805
Tehrani, N. (2004). Bullying: a source of chronic post-traumatic stress? Br. J. Guid. Counsell. 32, 357–366. doi: 10.1080/03069880410001727567
Trépanier, S. G., Fernet, C., and Austin, S. (2015). A longitudinal investigation of workplace bullying, basic need satisfaction, and employee functioning. J. Occup. Health Psychol. 20:105. doi: 10.1037/a0037726
Tsuno, K., Kawakami, N., Inoue, A., and Abe, K. (2010). Measuring workplace bullying: reliability and validity of the Japanese version of the negative acts questionnaire. J. Occup. Health 52, 216–226. doi: 10.1539/joh.l10036
Vilariño, M., Amado, B. G., Martin-Peña, J., and Vázquez, M. J. (2020). La simulación del acoso laboral en el LIPT-60: implicaciones para la evaluación psicológica forense. Anuario de Psicol. Juridica 30, 83–91. doi: 10.5093/apj2019a19
Vukelić, M., Čizmić, S., Petrović, I. B., Tenjović, L., and Giorgi, G. (2015). Psychometric properties of the Serbian version of the negative acts questionnaire – Revised. Psihologija 48, 19–33. doi: 10.2298/psi1501019v
Zapf, D., Einarsen, S., Hoel, H., and Vartia, M. (2003). “Empirical findings on bullying in the workplace,” in Bullying and Emotional Abuse in the Workplace: International Perspectives in Research and Practice, eds S.E. Einarsen and H. Hoel., D. Zapf. and C. L. Cooper (London: Taylor and Francis), 103–125.
Keywords: workplace harassment, negative acts questionnaire, assessment, psychometric analysis, psychosocial stressor
Citation: Dujo López V, González Trijueque D, Graña Gómez JL and Andreu Rodríguez JM (2020) A Psychometric Study of a Spanish Version of the Negative Acts Questionnaire-Revised: Confirmatory Factor Analysis. Front. Psychol. 11:1856. doi: 10.3389/fpsyg.2020.01856
Received: 07 December 2019; Accepted: 06 July 2020;
Published: 12 August 2020.
Edited by:
Tiziana Ramaci, Kore University of Enna, ItalyReviewed by:
Antonio Baena Extremera, University of Granada, SpainMassimiliano Barattucci, eCampus University, Italy
Copyright © 2020 Dujo López, González Trijueque, Graña Gómez and Andreu Rodríguez. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Víctor Dujo López, victordujopsf@gmail.com