Design, Validation, and Reliability of an Observational Instrument for Technical and Tactical Actions in Singles Badminton

Abstract

Technical and tactical actions are decisive in terms of badminton player competitive performance. The main objective of this research was to design, validate, and estimate the reliability of an observational instrument for the analysis of the tactical and technical actions in individual badminton. The process was carried out in four different steps: first, there was a review of the scientific literature and a preliminary list of variables was made; second, a qualitative and quantitative assessment was completed by 10 badminton expert judges; in the third step, the content validity was estimated using Aiken’s V coefficient; finally, intra-observer reliability and interobserver reliability were tested by two observers specialized in badminton using the Cohen’s Kappa coefficient and the intraclass correlation coefficient. Strokes were used as the unit of measure by our observational instrument; every time badminton players hit the shuttlecock, 22 variables (eight contextual variables, seven variables related to the result of the match, and seven variables related to the game) are observed. The minimum Aiken’s value was 0.58, and reliability was 0.63. In spite of these values, none of the variables had to be removed, but there were modifications in terms of drafting in some of them. The main findings confirmed the validity and the usefulness of this instrument.

Introduction

Nowadays, the observational methodology has become an essential tool that allows coaches to improve their training programs, athletes to make better technical tactical decisions, sports organizations to manage teams more effectively, and academic researchers to develop a better understanding of sports performance (O’Donoghue, 2014). With the objective of guaranteeing the quality of research, the observational methodology needs to validate reliable procedures with respect to the design of variables and categories (Lago Peñas et al., 2020). This requires the participation of coaches, experts, and observers in the entire validation process (Ortega et al., 2008a; Moreno and Gómez, 2017).

Different methods are used by sports sciences to carry out this type of studies (Figueira et al., 2018). In recent years, in spite of the technological advances (Mateus et al., 2017), the observational methodology (Anguera et al., 2011; Maneiro et al., 2018; Fernández-García et al., 2020) has been used by researchers to extract valuable information about sport actions, since it allows to know different actions that are executed during the game time, as well as the contexts where they occur. Likewise, it is a method that requires rigor at the time of observational instrument design and in the process of observation and data analysis (Gorospe et al., 2005; Valldecabres et al., 2019).

In the sports field, studies about validating a specific observational instrument have been increasing. Some of these have been carried out in physical education (Ortega et al., 2008a,b) and some team sports such as soccer (Fernandes et al., 2019; Ortega-Toro et al., 2019), basketball (Ibáñez et al., 2019), handball (Morillo et al., 2017), rugby (Villarejo et al., 2014), and volleyball (Palao et al., 2015a). Studies of these characteristics have also been carried out in individual sports like judo (Rodríguez et al., 2016) and, in particular, in other racket sports, as well as in tennis (Gorospe et al., 2005; Torres-Luque et al., 2018) or table tennis (Pradas et al., 2012). Depending on each investigation, the procedure is described in different steps: to review the scientific literature; to design the instrument with the system of conducts and categories to be observed; to evaluate the instrument quantitatively and qualitatively; to calculate the content validity of the instrument; to test the reliability.

In badminton, which is characterized by high-speed movements and shot executions (Abdullahi and Coetzee, 2017), observational methodology has been used to obtain information about different game aspects (Abián et al., 2014; Abdullahi and Coetzee, 2017), but the rules and characteristics of this sport make it difficult to observe and analyze the game. In this sense, previous studies carried out in similar disciplines such as squash (Brown and Hughes, 1995) or table tennis (Pradas et al., 2012) have been taken into account, whose observational instruments have been created ad hoc in order to solve this problem.

Therefore, it is important to explain the design and validation process of the instrument that is used to collect this information. Thus, the main goal of this study is to design and validate an observational instrument for researchers and badminton coaches to assess the technical tactical motions in singles badminton with reliability, objectivity, accuracy, and validity.

Materials and Methods

The design, validation, and testing of the reliability of the badminton observational instrument was completed in four stages. The first consisted of the observation instrument design that was a mixed category system and field format (Anguera and Hernández-Mendo, 2015; Anguera et al., 2018); the established categories were exhaustive and mutually exclusive (E/ME). The second consisted of the quantitative and qualitative evaluation of the instrument. The third consisted of the validation and calculation of the content. The fourth consisted of a reliability test (Kinrade et al., 2010).

Preparing a draft list of the conducts to be studied after a scientific literature review, mainly in the Web of Science databases with the keyword “badminton” (Tables 1–3), was the purpose of the first stage. The result showed a first list of variables with their definitions and categories to which they should belong. Three groups of variables were established: (a) contextual variables, including all those that defined the conditions of a match (gender, competition level, type of event round, game mode, court surface, shuttlecock type, and player laterality). The analysis unit was the match; (b) variables related to the result of the match, including all score statistics (match winner or loser, analyzed set, sets in favor, sets against, winner or loser of the analyzed set, game scoring, and analyzed point loser or winner). The unit of analysis was the match; (c) variables related to the game (stroke sequence, point duration time, type of technical and tactical stroke, trajectory, tactical intentionality, hitting area, and stroke effectiveness). The unit of analysis was the point.

Table 2 presented a sample questionnaire that was sent to the 10 badminton expert judges with a variable “stroke effectiveness” as an example.

Table 1 showed a preliminary list of contextual variables, variables related to the result of the match, and variables related to the game and their respective categories with suggested behaviors in the review of scientific literature that make up the observational instrument.

In the second stage, a qualitative and quantitative assessment of the observation instrument was completed by 10 badminton expert judges with the minimum following requirements: (a) Sports Technician certificate on the highest national level; (b) an experience of more than 10 years in teaching badminton; (c) Master in Sport Sciences or Physical Activity. For the assessment, the experts completed a survey (Table 4) with the following questions about the variable: (a) level of interest to include the variable (inclusion); (b) level of adequacy in the variable and categories definition (adequacy); (c) level of drafting of the variable and categories definition (drafting); (d) the quantitative assessment was to score from 1 to 10 the adequacy and drafting sections, while the qualitative part of the assessment consisted of responding to the inclusion section “Yes” or “No” (observation). Therefore, the answers were made individually, including a quantitative and qualitative part. All data were registered, and a descriptive analysis was completed (average, median, and mode of every continuous variable and also relative and absolute frequency in the case of categorical variables).

The third stage aim was to calculate the content validity through Aiken’s V coefficient (Aiken, 1980; Penfield and Giacobbi, 2004). Using the Visual Basic 6.0 software application described by Soto and Segovia (2009), Aiken’s V coefficient (Aiken, 1985) was used to determine the criteria for the modification or elimination of the variables. The obtained data were 0.70 (p = 0.05) and 0.81 (p = 0.01). Then, as a critical level of Aiken’s V was determined to reject the null hypothesis, it was decided to remove the variables whose data were lower than 0.70 and to modify the variables whose data were between 0.70 and 0.81. The variables data higher than 0.81 were accepted. In the same way, a minimum inclusion value of at least 80% “Yes” from the expert judges was accepted for the inclusion section. After those modifications, the next step was to create a new and definitive observation manual with a list of variables and categories that take to the writing of the observation instrument, which included the variables with the grouped categories of each one, their definitions and coding (“Observation instrument for singles badminton,” see Supplementary Annex 1).

In the fourth stage, the observation instrument reliability was tested following other studies (Gamonales et al., 2018; Torres-Luque et al., 2018). According to the studies by Anguera (2003) and Losada-López and Manolov (2015), three observers were trained by the main research supervisor through three sessions of 2 h each with a break of 10 min once they reached 55 from the observation using the fourth stage of the designed observation manual. In this case, to evaluate the reliability, two observers, both of them with masters in Primary Education with a mention in Physical Education and specialized in badminton, carried out the assessment twice within a week, 30 strokes of one badminton match. For the inter-observer and intra-observer reliability of all variables, a Cohen’s Kappa coefficient was used, except for the variable “duration of the point,” in which the intraclass correlation coefficient (ICC) was used.

As a last resort, it is very important and necessary to work out the specific protocol for the correct use of the observational instrument. Firstly, the observers must be in an elevated position behind a baseline of the badminton court, providing a good view of all lines (at least at the height of the players). The observational data collection in relation to the service area, hitting area, and shuttlecock end area was carried out according to the zones described in the observation manual.

The data were collected in an Excel-designed spreadsheet, where each row corresponds to a stroke of a player (each unit of measurement is a stroke by one player). The main reason of this recording is to understand the sequence of strokes in the interaction between players. For the purpose of optimizing the recording time of all variables and their categories, was defined as follows: (a) variables to record every stroke [results (game scoring and loser or winner of the analyzed point) and game development (stroke sequence, kind of technical-tactical stroke, hitting area, trajectory and stroke effectiveness)]; (b) variables to register every point [results (lost and won points on the set)]; (c) variables to register every set [results (analyzed set, lost and won sets, and loser and winner of the analyzed set)]; (d) variables to analyze every match [contextual (gender, event level, type of event, event round, game mode, court surface, type of shuttlecock, and player laterality) and results (loser or winner of the match)].

Results

Table 1 shows the results of the observational instrument design after the scientific literature review. All game variables were determined, thanks to the researchers’ input and previous researches, and they were used as a basis to design the observational instrument. Finishing the first phase, 22 variables formed the observational instrument: eight contextual variables, seven variables related to the result of the match, and seven variables related to the game.

After performing the qualitative and quantitative assessment of the observation instrument by a group of experts (n = 10) and calculating the content validity using the Aiken’s V coefficient (Penfield and Giacobbi, 2004), a total of five modifications were carried out in the defined ones, two related to contextual variables and three related to game variables. All changes were endorsed with a lower Aiken’s V value and also when more than 80% of the expert judges respond positively to be included.

As can be seen in Table 3, there were not many changes after the evaluation, the main changes were found in the following variables: (a) court surface, the experts did not consider it necessary; (b) type of tournament, the experts proposed a change in nomenclature or join this variable with the competition level; (c) stroke sequence, the experts proposed to analyze a determined number of strokes; (d) tactical intentionality, the experts considered important to add more intentions (neutral intent, for example); (e) stroke effectiveness, the experts proposed to redefine the concepts due to their inaccuracy.

Table 3 showed a definitive list of contextual variables, variables related to the result of the match and variables related to the game and their respective categories that make up the observation instrument.

The 22 final variables were eight contextual variables, seven variables related to the result of the match, and seven variables related to the game (Table 3). Then, all variables with a value ≥ 0.81 in the Aiken’s V were considered for the observation instrument (Table 4). One hundred percent of the expert judges responded positively for the inclusion of all cases.

The values of pertinence, definition, and interobserver and intra-observer reliability of definitive variables and categories of the badminton observational instrument are shown in Table 4.

Table 4 showed the results from the fourth phase, which indicated high reliability values in general. As it can be observed, the variable “tactical intentionality” obtained the lowest value in Cohen’s Kappa coefficient, both in the intra-observer test (0.86) and in the interobserver test (0.63). The ICC was used for the variable “point duration time” with values of 1 and 0.87.

Discussion

The present study has been carried out in order to show and explain all the stages for designing, validating, and testing the reliability of the observational instrument that analyzes the technical and tactical behaviors in singles badminton. Therefore, the designed observational instrument is valid and reliable to analyze the technical and tactical actions that take place during a rally in a badminton match. To this effect, the methodological procedures suggested by Anguera and Hernández-Mendo (2013) have been followed, just as other similar studies that have been carried out in different sports (Pradas et al., 2012; Villarejo et al., 2014; Palao et al., 2015a,b; Torres-Luque et al., 2018; Parada and Vargas, 2020). By this way, a valid and reliable tool has been generated for this sport.

A total number of 10 expert judges and two observers have participated in the design and validation of the observational instrument. In this respect, it should be noted that the particularity of the subject matter limits the existence of the experts in this area of knowledge. In spite of this, the number of experts was the same or higher than in other studies carried out in singles sports such as judo (Rodríguez et al., 2016) or table tennis (Pradas et al., 2012) and in other investigations done in collective sports like soccer (Parada and Vargas, 2020) or beach volleyball (Palao et al., 2015b).

The high qualification of the different expert judges, who follow the three criteria of inclusion, master in Physical Activity and Sports Sciences, with a coach diploma, and more than 10 years of training experience, should be noted. This level of qualification has provided the theoretical, together with their badminton experience, giving valuable information to researchers (Escobar-Pérez and Cuervo-Martínez, 2008; Gamonales et al., 2018; Ibáñez et al., 2019). Their qualitative and quantitative input was crucial for the design of the observational instrument and, thanks to them, the tool has been improved because some variables could be modified to clarify the definitions and their relevance to the different categories. The two observers have also been very important throughout the process, helping to define the criteria for the different categories and as a consequence simplifying the registration instrument.

In terms of statistics, the selected variables give an adequate content validity to the observational instrument, being valid to assess the technical and tactical actions in singles badminton, since the Aiken’s V value shows a positive evaluation of the different variables both in pertinence and in definition (Zartha et al., 2018). All values that have been obtained in this study outweigh the critical level proposed by Aiken (1985) or Penfield and Giacobbi (2004), who considered that from 0.50, the validity of the instrument can be accepted. In any case, most of the variables are higher than the critical level of 0.70, as proposed by Charter (2003) or Soto and Segovia (2009). Hence, it can be said that the results obtained show that the design of the variables of the observational instrument has indicators of content validity, since they are above the exact critical level proposed by experts.

The third stage of this research, as well as in the study carried out by Gamonales et al. (2018), consisted of modifying or eliminating those items that did not reach optimal Aiken’s V coefficient values according to the criteria proposed (García Martín et al., 2016). On the one hand, the quantitative assessment carried out by the experts was very fruitful to establish the variables and their categories (Bulger and Housner, 2007; Padilla et al., 2007). On the other hand, the qualitative assessment carried out by the experts was very fruitful to define the variables and their categories. In this study, despite the fact that expert judges had made contributions to improve the drafting of some variables, it had not been necessary to delete any of them.

With respect to reliability, the observation manual and the observers’ training helped them to get the skills for carrying out the observation (Losada-López and Manolov, 2015), increasing the effectiveness of the observation and improving the coding criteria. It should be emphasized that the intra-observer analysis evidences high levels of reliability, minimizing the observation mistakes that may come from the observer himself (Gamonales et al., 2018), but the different interpretations of the behaviors among the observers can cause disagreements (Losada-López and Manolov, 2015). Nevertheless, the interobserver analysis evidences high levels of reliability too, supporting the reliability of the observation (Liu et al., 2013).

The design of this observational instrument has some limitations, as the number of expert judges who have participated or the recording of some data related to the game development or physical components that may be interesting. In accordance with Lebed (2006), behaviors in sports are affected by an undermining number of factors. In badminton, the specificity of the players’ behaviors, together with the high speed, makes the recording difficult, as in the case in other sports such as table tennis (Pradas et al., 2012). Nevertheless, it is complex to use collection information systems for evaluating players’ performance in competition (Villarejo et al., 2014). With the aim of improving, future studies should take into account these aspects when designing observational instruments.

Conclusion

Therefore, the designed observational instrument is valid and reliable to analyze the technical and tactical actions that take place during a rally in a badminton match. Thereby, it is possible to analyze the differences between winners and losers and establish relationships between strokes during the sequence, which can affect the development and result of the point.

References

• 1

  AbdullahiY.CoetzeeB. (2017). Notational singles match analysis of male badminton players who participated in the African Badminton Championships.Int. J. Perform. Anal. Sport171–16. 10.1080/24748668.2017.1303955

  • CrossRef
  • Google Scholar

• 2

  AbiánP.CastanedoA.FengX. Q.SampedroJ.Abian-VicenJ. (2014). Notational comparison of men’s singles badminton matches between Olympic Games in Beijing and London.Int. J. Perform. Anal. Sport1442–53. 10.1080/24748668.2014.11868701

  • CrossRef
  • Google Scholar

• 3

  AikenL. R. (1980). Content validity and reliability of single items or questionnaires.Educ. Psychol. Meas.40955–959. 10.1177/001316448004000419

  • CrossRef
  • Google Scholar

• 4

  AikenL. R. (1985). Three coefficients for analyzing the reliability and validity of ratings.Educ. Psychol. Meas.45131–142. 10.1177/0013164485451012

  • CrossRef
  • Google Scholar

• 5

  AngueraM. T. (2003). Observational methods (general).Encyclopedia Psychol. Assess.2632–637.

  • Google Scholar

• 6

  AngueraM. T.BlancoA.Hernández-MendoA.LosadaJ. L. (2011). Diseños observacionales: ajuste y aplicación en psicología del deporte.Cuad. de Psicol. del Deporte1163–76.

  • Google Scholar

• 7

  AngueraM. T.Hernández-MendoA. (2013). La metodología observacional en el ámbito del deporte.RICYDE. Rev. Int. de Cienc. del Deporte9135–160.

  • Google Scholar

• 8

  AngueraM. T.Hernández-MendoA. (2015). Técnicas de análisis en estudios observacionales en ciencias del deporte.Cuad. de Psicol. del Deporte1513–30. 10.4321/s1578-84232015000100002

  • CrossRef
  • Google Scholar

• 9

  AngueraM. T.PortellM.Chacón-MoscosoS.Sanduvete-ChavesS. (2018). Indirect observation in everyday contexts: concepts and methodological guidelines within a mixed methods framework.Front. Psychol.9:13. 10.3389/fpsyg.2018.00013

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 10

  BrownD.HughesM. (1995). “The effectiveness of quantitative and qualitative feedback on performance in squash,” in Science and Racket Sports, edsReillyT.HughesM.LeesA. (Leeds: E & FN Spon), 232–237.

  • Google Scholar

• 11

  BulgerS. M.HousnerL. D. (2007). Modified Delphi investigation of exercise science in physical education teacher education.J. Teach. Phys. Educ.2657–80. 10.1123/jtpe.26.1.57

  • CrossRef
  • Google Scholar

• 12

  CharterR. A. (2003). A breakdown of reliability coefficients by test type and reliability method, and the clinical implications of low reliability.J. Gen. Psychol.130290–304. 10.1080/00221300309601160

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 13

  Escobar-PérezJ.Cuervo-MartínezÁ (2008). Validez de contenido y juicio de expertos: una aproximación a su utilización.Avances Med.627–36.

  • Google Scholar

• 14

  FernandesT.CamerinoO.GargantaJ.PereiraR.BarreiraD. (2019). Design and validation of an observational instrument for defence in soccer based on the dynamical systems theory.Int. J. Sports Sci. Coach.14138–152. 10.1177/1747954119827283

  • CrossRef
  • Google Scholar

• 15

  Fernández-GarcíaÁIJuan-CamposJ. M.Giménez-EgidoJ. M. (2020). Análisis de las variables técnico-tácticas relacionas con el último golpe del punto en el tenis de alto rendimiento.JUMP248–56. 10.17561/jump.n2.5

  • CrossRef
  • Google Scholar

• 16

  FigueiraB.GonçalvesB.FolgadoH.MasiulisN.Calleja-GonzálezJ.SampaioJ. (2018). Accuracy of a basketball indoor tracking system based on standard bluetooth low energy channels (NBN23^®).Sensors18:1940. 10.3390/s18061940

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 17

  GamonalesJ.León-GuzmánK.Muñoz-JiménezJ.González-EspinosaS.IbáñezS. (2018). Validation of the IOLF5C instrument for the efficacy of shooting on goal in football for the blind.Rev. Int. Med. Cienc. AC18361–381. 10.15366/rimcafd2018.70.010

  • CrossRef
  • Google Scholar

• 18

  García MartínA.Antúnez MedinaA.Ibáñez GodoyS. J. (2016). Análisis del proceso formativo en jugadores expertos: validación de instrumento.Rev. Int. Med. Cienc. AC16157–182. 10.15366/rimcafd2016.61.012

  • CrossRef
  • Google Scholar

• 19

  GorospeG.Hernández-MendoA.AngueraM. T.Martínez de SantosR. (2005). Development and optimization of an observational tool in singles tennis.Psicothema17123–127.

  • Google Scholar

• 20

  IbáñezS. J.Martínez-FernándezS.González-EspinosaS.García-RubioJ.FeuS. (2019). Designing and validating a basketball learning and performance assessment instrument (BALPAI).Front. Psychol.10:1595. 10.3389/fpsyg.2019.01595

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 21

  KinradeN. P.JacksonR. C.AshfordK. J.BishopD. T. (2010). Development and validation of the decision-specific reinvestment scale.J. Sports Sci.281127–1135. 10.1080/02640414.2010.499439

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 22

  Lago PeñasC.Lorenzo-CalvoA.CárdenasD.AlarcónF.UreñaA.Giménez Fuentes-GuerraF.et al (2020). La creación de conocimiento en los deportes de equipo. Sobre el tamaño de la muestra y la generalización de los resultados.JUMP17–8. 10.17561/jump.n1.e

  • CrossRef
  • Google Scholar

• 23

  LebedF. (2006). System approach to games and competitive playing.Eur. J. Sport Sci.633–42. 10.1080/17461390500422820

  • CrossRef
  • Google Scholar

• 24

  LiuH.HopkinsW.GómezA. M.MolinuevoS. J. (2013). Inter-operator reliability of live football match statistics from OPTA sportsdata.Int. J. Perform. Anal. Sport13803–821. 10.1080/24748668.2013.11868690

  • CrossRef
  • Google Scholar

• 25

  Losada-LópezJ.ManolovR. (2015). The process of basic training, applied training, maintaining the performance of an observer. Qual. Quant.49, 339–347. 10.1007/s11135-014-9989-7

  • CrossRef
  • Google Scholar

• 26

  ManeiroR.AmatriaM.Moral-GarcíaJ. E.GarcíaS. (2018). Análisis observacional de las relaciones interlíneas de la Selección Española de Fútbol, mediante coordenadas polares.Cuad. de Psicol. del Deporte1818–32.

  • Google Scholar

• 27

  MateusN.LeiteN.SampaioJ. (2017). Team sports in special groups and the use of technology: a review.Motricidade13221–222.

  • Google Scholar

• 28

  MorenoE.GómezM. Á (2017). Validación herramienta observacional para el análisis de rachas de lanzamiento en baloncesto.Rev. de Psicol. del Deporte260087–0093.

  • Google Scholar

• 29

  MorilloJ. P.ReigalR. E.Hernández-MendoA.MontañaA.Morales-SánchezV. (2017). Decision-making by handball referees: design of an ad hoc observation instrument and polar coordinate analysis.Front. Psychol.8:1842. 10.3389/fpsyg.2017.01842

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 30

  O’DonoghueP. (2014). An Introduction to Performance Analysis of Sport.Nueva York: Routledge.

  • Google Scholar

• 31

  OrtegaE.CalderónA.PalaoJ. M.PuigcerverM. (2008a). Diseño y validación de un cuestionario para evaluar la actitud percibida del profesor en clase y de un cuestionario para evaluar los contenidos actitudinales de los alumnos durante las clases de educación física en secundaria.Retos1422–29.

  • Google Scholar

• 32

  OrtegaE.Giménez-EgidoJ. M.PalaoJ. M.Sainz de BarandaP. (2008b). Diseño y validación de un cuestionario para valorar las preferencias y satisfacciones en jóvenes jugadores de baloncesto.Cuad. de Psicol. del Deporte839–58.

  • Google Scholar

• 33

  Ortega-ToroE.García-AnguloA.Giménez-EgidoJ. M.García-AnguloF. J.PalaoJ. M. (2019). Design, validation, and reliability of an observation instrument for technical and tactical actions of the offense phase in soccer.Front. Psychol.10:22. 10.3389/fpsyg.2019.00022

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 34

  PadillaJ. L.GómezJ.HidalgoM. D.Muñiz FernándezJ. (2007). Esquema conceptual y procedimientos para analizar la validez de las consecuencias del uso de los test.Psicothema19173–178.

  • Google Scholar

• 35

  PalaoJ. M.ManzanaresP.OrtegaE. (2015a). Design and validation of an observation instrument for technical and tactical actions in indoor volleyball.Eur. J. Hum.3475–95.

  • Google Scholar

• 36

  PalaoJ. M.Manzanares LópezP.OrtegaE. (2015b). Design and validation of an observational instrument for technical and tactical actions in beach volleyball.Mot. Rev. de Educ. Fis.21137–147. 10.1590/S1980-65742015000200004

  • CrossRef
  • Google Scholar

• 37

  ParadaS. A. C.VargasM. A. C. (2020). Diseño y validación de un instrumento observacional para la valoración de acciones tácticas ofensivas en fútbol-vatof (Design and validation of an observational instrument for the evaluation of offensive tactical actions in football-vatof).Retos38306–311.

  • Google Scholar

• 38

  PenfieldR. D.GiacobbiP. R.Jr. (2004). Applying a score confidence interval to Aiken’s item content-relevance index.Meas. Phys. Educ. Exerc. Sci.8213–225. 10.1207/s15327841mpee0804_3

  • CrossRef
  • Google Scholar

• 39

  PradasF.FloríaP.González-JuradoJ.CarrascoL.BatallerV. (2012). Desarrollo de una herramienta de observación para el análisis de la modalidad individual del tenis de mesa.J. Sport Health Res.4255–268.

  • Google Scholar

• 40

  RodríguezA. R.RodríguezJ. R.Fuentes-GuerraF. G.RoblesM. A. (2016). Validación de una entrevista para estudiar el proceso formativo de judokas de élite.Rev. Int. Med. Cienc. AC16723–738. 10.15366/rimcafd2016.64.007

  • CrossRef
  • Google Scholar

• 41

  SotoC. M.SegoviaJ. L. (2009). Intervalos de confianza asimétricos para el índice la validez de contenido: un programa Visual Basic para la V de Aiken.An. de Psicol.25169–171.

  • Google Scholar

• 42

  Torres-LuqueG.Fernández-GarcíaÁICabello-ManriqueD.Giménez-EgidoJ. M.Ortega-ToroE. (2018). Design and validation of an observational instrument for the technical-tactical actions in singles Tennis.Front. Psychol.9:2418. 10.3389/fpsyg.2018.02418

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 43

  ValldecabresR.de BenitoA. M.CasalC. A.PablosC. (2019). Diseño y validación de una herramienta observacional para el bádminton (BOT).Rev. Int. Med. Cienc. AC19209–223. 10.15366/rimcafd2019.74.003

  • CrossRef
  • Google Scholar

• 44

  VillarejoD.OrtegaE.GómezM. -ÁPalaoJ.-M. (2014). Design, validation, and reliability of an observational instrument for ball possessions in rugby union.Int. J. Perform. Anal. Sport14955–967. 10.1080/24748668.2014.11868771

  • CrossRef
  • Google Scholar

• 45

  ZarthaJ. W.MontesJ. M.VargasE. E.PalacioJ. C.HernándezR.HoyosJ. L. (2018). Methods and techniques in studies related to the delphi method, innovation strategy, and innovation management models.Int. J. Appl. Eng. Res.139207–9214.

  • Google Scholar