Skip to main content

BRIEF RESEARCH REPORT article

Front. Sports Act. Living, 12 October 2022
Sec. Elite Sports and Performance Enhancement

Shortcomings of applying data science to improve professional football performance: Takeaways from a pilot intervention study

  • 1Institute of Sports and Preventive Medicine, Saarland University, Saarbrücken, Germany
  • 2Deutscher Fußball-Bund, Frankfurt am Main, Germany
  • 3Center for Human Movement Sciences, University Medical Center Groningen (UMCG), University of Groningen, Groningen, Netherlands
  • 4TSG ResearchLab gGmbH, Zuzenhausen, Germany
  • 5D.C. United, Washington, DC, United States

Positional tracking data allows football practitioners to derive features that describe patterns of player behavior and quantify performance. Existing research using tracking data has mostly focused on what occurred on the pitch, such as the determinants of effective passing. There have yet to be studies attempting to use findings from data science to improve performance. Therefore, 24 professional players (mean age = 21.6 years, SD = 5.7) were divided into a control team and an intervention team which competed against each other in a pre-test match. Metrics were gathered via notational analysis (number of passes, penalty box entries, shots on goal), and positional tracking data including pass length, pass velocity, defensive disruption (D-Def), and the number of outplayed opponents (NOO). D-Def and NOO were used to extract video clips from the pre-test that were shown to the intervention team as a teaching tool for 2 weeks prior to the post-test match. The results in the post-test showed no significant improvements from the pre-test between the Intervention Team and the Control Team for D-Def (F = 1.100, p = 0.308, η2 = 0.058) or NOO (F = 0.347, p = 0.563, η2 = 0.019). However, the Intervention Team made greater numerical increases for number of passes, penalty box entries, and shots on goal in the post-test match. Despite a positive tendency from the intervention, results indicate the transfer of knowledge from data science to performance was lacking. Future studies should aim to include coaches' input and use the metrics to design training exercises that encourage the desired behavior.

Introduction

To date, research on data science in football has primarily used observational designs to extract what occurred on the pitch, such as how opposing teams' centroid position is strongly related, especially in a forward and backwards direction (1), or that high risk passes occurring around the edge of the penalty box have the highest reward (2). Some experimental studies using data science have also been conducted that have produced findings applicable to the coaching process. For instance, discovering technical and physical differences between small-sided games (SSGs) and 11v11 match play (3), tactical differences between common playing formations (4) and some drawbacks associated with high-pressing (5). However, other than a few professional teams who publicly utilize positional data for in-house performance analysis, there is a paucity of research attempting to use positional tracking data to improve performance in competitive settings (6). The disconnect between research and practice, especially the lack of approaches using metrics and tools developed from data science was shown by a recent survey (7). In the survey, just 22 percent of 145 professional practitioners reported the use of such approaches in training with 35% of practitioners using KPIs (key performance indicators) for matches and only 19% using them for both training and matches. This leaves considerable room to investigate if and how data science can be applied in the training process to foster player education and development. Therefore, this pilot intervention study using professional football players is the very first attempt to close this gap.

Pilot studies are valuable in that they allow for reduced sample sizes and encourage participation in the applied setting, merging the path of researcher and practitioner (8, 9). Furthermore, pilot studies are more conducive to the rigorous, fast-paced environment within professional sports offering feasibility and a preview of methodological challenges for larger studies (10, 11). In this work, a lengthier intervention would have been desirable, especially considering that viewing tactical video (the nature of our intervention) has shown not to elicit mental fatigue nor impair subsequent physical and technical performance (12). In addition, more subjects and subsequent passes would have served to power the study and improve test-retest reliability. However, difficulty in recruitment and logistical constraints justify the sample size for this pilot study (13). Factoring in the normal team video sessions, players' pre-training routines, post-training individual meetings, weight training, etc., it was determined by the coaching staff that anything more would interfere with the team's objectives.

Earlier studies using positional tracking have mostly involved the examination of passing behavior. This focus is warranted (and feasible) as passing is the most frequent individual tactical action in a game (14) and therefore considered a key skill (15, 16). For instance, a greater number of passes, forward passes, and passes in the opposition's half of the field have shown to discriminate between winning, drawing and losing teams (17, 18). As such, we chose to focus on the improvement of passing effectiveness in this pilot intervention.

Studies using positional tracking data demonstrated effective passes force defenders out of position, creating space that leads to higher probability goal-scoring chances (19, 20). Perhaps this explains why winning teams have been shown to outplay more opponents with passes than losing teams (19, 21). In other words, passes that eliminate a greater number of defensive players increase the attacker's space control in front of the goal and can be ranked as effective (22). These increases in spatial dominance and outplaying defenders with passes had a positive effect on the number of goals scored and the chances of winning a game. Following the presented results, we chose to use the number of outplayed defenders (NOO) as one of the metrics to evaluate passing performance in this study.

Along with passes that outplay opponents in a vertical direction, sideways and backwards passes can force the defense to shift, leaving gaps between defenders. Considering the importance of unbalancing the defense, (23) calculated a defensive disruptiveness score (D-Def: an aggregated variable to quantify passing solely based on tracking data) as an index that represents the change in defensive organization resulting from a pass (24). The D-Def metric could distinguish top, average, and low performance passes by comparing D-Def, pass length, pass angle, and pass velocity in the top 10%, average 80% and bottom 10% passes ranked on D-Def score. Consistent with the findings of Chassy (25) the speed and precision of passes are predictors of success, corresponding to greater D-Def scores. Therefore, in addition to the number of outplayed opponents, D-Def was the second data driven metric used to measure the effectiveness of each pass.

One method utilized by most professional football teams to improve individual and team performance, including passing performance, is video analysis in the match planning and development of players (26, 27). Video analysis offers coaches the opportunity to use pre-selected clips to assess performance and gives players the chance for critical self-appraisal (28). Reflective practice using video feedback has been demonstrated to be a useful tool to improve several cognitive components such as game understanding and decision-making in football (29). In the training of goalkeepers, the addition of video feedback (observing one's own performance) had significant effect on improving performance compared to video modeling (observing an expert perform the skill) alone (30).

Despite being common in practice, research on video analysis in football has mostly covered practitioners' perceptions of video analysis (31) and how it is used in their daily work (26, 32). Therefore, further examination of the role of video feedback on performance outcomes would be a worthwhile purpose for research in football. Moreover, no studies have attempted to combine information gathered via positional tracking data and transform it into an educational tool to demonstrate effects beyond laboratory tasks, in real competitive situations. Therefore, this pilot study aims to examine the effectiveness of video feedback consisting of positive and negative examples of players' passes of two metrics—D-Def and number of outplayed opponents (NOO)—for the performance of individual and team passing performance. It is hypothesized that players on the intervention team will show significantly greater improvement in D-Def and NOO in the post-test match.

Methods

Participants

Twenty four professional football players participated in this study (mean age = 21.6 years, SD = 5.7).

All participants were rostered on a USL Championship team considered the United States 2nd Division in which they practice about 8 to 15 h a week. At the time of the intervention, the team had been playing together for a duration of 6 months. The present research fully complies with the highest standard of ethics and participant protection which followed the guidelines stated in the Declaration of Helsinki (2013) and was approved by the ethics committee of Saarland University (registration number 2573003). All participants gave their written informed consent; parental consent was provided for players younger than 18 years of age.

Procedure

Pre and post-test matches consisting of 11v11 were played with each game lasting two 15 min halves with a 3 min half-time period. Based on position, players were randomly selected to either control team or the experimental team. Both teams were evenly matched by coaches and were instructed to play in a 4-2-3-1 formation.

Following the pre-test match, the experimental team was shown video clips of six examples of passes with a low D-Def score (<mean) and six examples of passes with a high D-Def score (>mean) prior to joining the team for training sessions. The control team did not receive any intervention. During the video intervention session, each of the 12 passes was shown three times and the D-Def score as well as the Number of Outplayed Opponents were visible for players prior to and during each pass (see Figure 1). Thus, the Intervention Team viewed 216 passes in throughout the duration of the intervention with each of the six intervention sessions lasting ~15 min in duration. During the video sessions and throughout the intervention, no coaching or feedback was given other than an initial explanation of how the D-Def metric and NOO metrics work and identifying each pass both orally and visually (Figure 2). Players were neither encouraged nor discouraged from discussing the video and/or their passes amongst themselves. The video played for 10 s prior to the execution of the pass and 10 s after the pass was completed to provide players with adequate game context. This meant players could identify positive and negative behavior based on these numbers and the effect of each pass on their own. Showing both positive and negative examples was the chosen method as individual players respond differently to various forms of feedback (29). At the conclusion of the intervention, the teams competed in an identical re-test and were evaluated again for their performance on the metrics. A placebo video was given consideration but since the professional players on the team involved have daily team video sessions lasting between 10–45 min it was deemed unnecessary.

FIGURE 1
www.frontiersin.org

Figure 1. Example of how players received video feedback for each pass on D-Def and Outplayed Opponents (“Pass Packing”).

FIGURE 2
www.frontiersin.org

Figure 2. A 2-dimensional representation of how D-Def and NOO were determined by a pass. The blue team is attacking toward the right against the defensive team in red. In (A) from the start of the pass (t0) to the time of pass completion, 4 defensive players (circled in red) were eliminated in the longitudinal direction. In (B) the red arrows represent the displacement of the defense from t0 to t+3 s, yielding a D-Def score of 38.33.

Data collection

The pre and post-test matches were monitored and recorded via the camera at Segra Field in Leesburg, VA, provided by Spiideo (https://www.spiideo.com). Segra Field was used as it serves as both the training and match field for the participating team. To evaluate the performance of a team according to the tactical principles and analyse the relationship between tactical performance and match outcome and to assess the success of the chosen intervention (see below), positional tracking data was collected and processed. Players were tracked with a semi-automatic optical tracking system (STAT Sports; STATS LLC, Chicago, IL) that captures the X and Y coordinates of all players at 10 Hz. Every pass was tagged manually in the Spiideo application to the nearest 0.1 of a second for the moment the ball was passed to the moment the ball was received. Both the tracking data and the ball event data were then imported as individual data frames in Python 3.6 and automatically processed on a match-by-match basis.

Metrics

D-Def—computed as the displacement of the average X and Y positions (or centroids) for the full team, and the defensive, midfield, and attacking lines between the moment a pass was given (t0) and 3 s later (t0+3). D-Def is constructed by three components: the disruption in the longitudinal and lateral directions, and disruption of the team surface and spread area [For an in-depth description, see (33)]. This results in a measure from 0 to 150 (with 0 indicating no disruption and 150 indicating a maximum of disruption).

Position data was also used to calculate the number of outplayed opponents (NOO) by determining the difference in opposing players between the ball carrier and target goal from the moment each pass is played to when it was received (19, 20). Therefore, NOO could range between−10 (10 more player between the original position and the goal) to 10 (10 less players between the original position and the goal).

Statistical analysis

Statistics for all passing-related performance metrics of the two teams were compared with one another for both the pre-test and the post-test matches. In the post-test match, four players (40%) from the control team and one player (10%) from the intervention team missed with one player out due to illness, two players got injured during the length of the intervention, and two players were called up to the 1st team. Therefore, after examining various approaches to handle missing data, we utilized a principled method by inputting a weighted nearest neighbors' approach in SPSS statistical software (34, 35). D-Def and NOO are only applicable for completed passes and therefore, the sample comprised of 187 completed passes (95 pre-test and 92 post-test) in the control team and 184 total passes (76 pre-test, 107 post-test) for the intervention team.

Pre and post-test match team comparisons were made for the main dependent variables including D-Def and Number of Outplayed Opponents and descriptive analysis was completed for Number of Passes, Penalty Box Entries, Shots on Goal, Pass Length, and Pass Velocity.

Data for D-Def and Number of Outplayed Opponents were normally distributed for each factor combination based on a Shapiro-Wilk test. A 2 × 2 repeated measures ANOVA (timepoint × team) was used to test for interactions, main effects, and simple main effects for timepoint (pre- vs. post-test matches) and team (Intervention Team vs. Control Team) for D-Def and NOO with an alpha level of.05. Effect sizes were calculated using partial eta squared (η2) with 0.14 or greater representing large effects, 0.06 or greater as medium effects, and 0.01 or more as small effects (36). All statistical tests were carried out with the statistical software IBM SPSS Statistics Version 25. An a priori power analysis was conducted using G*Power version 3.1.9.7 (37) to determine the minimum sample size required to test the study hypothesis. Results indicated the required sample size to achieve 80% power for detecting a medium effect, at a significance criterion of α = 0.05, was N = 96 for a 2 × 2 repeated measures ANOVA. Thus, the obtained sample size of N = 24 players was low in statistical power. However, given the number of observations including 371 completed passes and the contextual and environmental constraints associated with high-performance sport, the sample size for this pilot study can be based on feasibility (38).

Results

A two-way ANOVA revealed that there was not a statistically significant interaction detected between the effects of timepoint (pre-test vs. post-test) and team (Intervention Team vs. Control Team) for D-Def [F(1, 31.73) = 1.100, p = 0.308, η2 = 0.058] or NOO [F(1, 18) = 0.347, p = 0.563, η2 = 0.019]. Similarly, there was neither an overall effect for the factor timepoint [F(1, 10.47) = 0.363, p = 0.554, η2 = 0.02 for D-Def; F(1, 18) = 0.128, p = 0.725, η2 = 0.007 for NOO] nor for the factor team [F(1, 18) = 1.905, p = 0.184, η2 = 0.096 for D-Def; F(1, 18) = 0.254, p = 0.620, η2 = 0.014 for NOO] (Figures 3, 4). As seen in Table 1, mean differences indicate that the Control Team's D-Def score decreased by 2.8, and their NOO score increased by 0.39. For the Intervention Team, their D-Def score increased by 0.76, but their NOO score decreased by an average of 0.09.

FIGURE 3
www.frontiersin.org

Figure 3. Differences in D-Def scores between Pre-and Post-test matches for the Control Team and the Intervention Team.

FIGURE 4
www.frontiersin.org

Figure 4. Differences in Number of Outplayed Opponents (NOO) between Pre-and Post-test matches for the Control Team and the Intervention Team.

TABLE 1
www.frontiersin.org

Table 1. Team averages between pre-test and post-test matches.

As seen in Table 1, the Intervention Team showed greater numerical increases for Number of Passes, Penalty Box Entries, Shots on Goal, and Pass Length. In contrast, the Control Team only made a slight increase in Pass Length.

Discussion

Disrupting the opponent's organization and outplaying opponents are important outcomes of effective passing. In theory, improving players' ability in these areas would increase their team's chances of scoring goals. Based on these assumptions, this study examined the use of a positional tracking, data driven video intervention in an experimental setting (11 vs. 11 football game) to investigate if well-established metrics of observational studies can be used to improve passing effectiveness.

In the present study, there were no significant differences found between the Control Team and the Intervention Team for either of the metrics gathered via positional tracking data: D-Def or Number of Outplayed Opponents. The improvements were only small, insignificant changes for D-Def (+0.76) and a slight decrease in NOO (−0.09) for the Intervention team. Given that the control team's D-Def score decreased without any presumed external influence, the difference can be interpreted as a lower boundary for the reliability of the measurement procedure.

Despite no significant improvements for D-Def or NOO, the Intervention Team made greater numerical increases than the Control Team in more traditional key performance indicators (7), including Number of Passes, Penalty Box Entries, Pass Length, and Shots on Goal. Broadly speaking, the greater numerical increases shown by the Intervention Team supports previous studies that a video intervention can lead to general improvements in performance. These findings are supported by research in other sports showing improved decision making (tennis) and tactical knowledge (volleyball) with the use of video feedback (39, 40).

The Intervention Team's execution of more passes by players more frequently positioned in attacking areas of the field and gain seven extra Penalty Box Entries in the post-test match compared to the pre-test match is in accordance with previous studies finding passes from the midfield into the final third lead to greater penalty box possessions (41, 42). This could be the result of the video intervention as D-Def and NOO show the highest values for these types of passes. Thus, the players of the intervention team might have prioritized these passes based on the information presented in the video clips. These results suggest in future studies it could be of interest to not only measure single passes, but sequences of passes to capture the combined effects of passes of different lengths, velocities, and vectors.

The failure to achieve significant improvement for D-Def and NOO could be due, in part, to low sample size, as well as limitations of transferability from the chosen form of video feedback to on-field performance. One aspect that may have limited the transfer to the field was the speed in which the video was played back. For example, video feedback on kicking performance and temporal patterns in U-10 players discovered only the slow-motion video group elicited significant improvements whilst the video played at normal speed did not (43). Though in this study professional players were used, and the objective was to improve tactical performance more so than technical performance, use of slow-motion replay could have elicited greater improvements. Each pass was shown three times, but at normal playback speed the Intervention Team may have been unable to pick up on enough of the match context to determine what led to a specific pass having a higher or lower score.

Along the lines of decision making in football, one could argue that D-Def is too multifaceted and/or complex for players to consider in the chaos in a game. Although a player may comprehend that longer passes traveling at a greater velocity, in a slightly more forward direction cause the greatest disruption to the defense (24), players must make rapid decisions relative to the match context. For instance, passing decisions are largely influenced by teammates' movement and positioning relative to the ball carrier as well as the organization of the defense; two factors which determine open passing lanes (44). On the other hand, players in the Intervention group performed worse in the post-test match for NOO, a rather simple concept of subtraction. Further, well-known football terminology (and a popular metric called Packing rate) such as breaking defensive lines, and penetrating passes, exist, to illustrate the passing-related principle of play. Therefore, other limitations of the intervention must be considered.

One factor that could have limited transfer was the lacking coaches' involvement in the video education process. Thus, the onus was on the players' ability to reflect and their self-awareness, two prerequisites for learning (45), to understand when they made good passes and/or how they could have made better passes. In this study, the feedback about each pass was quantitative as players were simply shown a number indicating the D-Def and NOO value of each pass. It is possible that a more qualitative assessment, such as a “debate-of-ideas” would have been more likely to pay dividends in performance on the field (46). Albeit the effectiveness of discussion in the video feedback process depends on a high level of trust between athletes and coaches (47), the absence of open forum dialogue in this study could have limited decision making progress.

Besides more qualitative feedback from coaches, this study did not involve any exercises or drills on the field that could have enhanced player understanding and execution of the principles behind D-Def and NOO. Other intervention studies have involved specific training approaches with positive results. For example, a non-linear training approach (manipulating interacting constraints between the learner, task and environment) was found to improve decision making and actions (48) and the integration of differential learning was found to enhance creative and tactical behavior (49). Ultimately, information derived by data science would not be limited to video analysis and ideally, it would stimulate discussions between match/performance analysts and coaches to find ways to improve training and match tactics. It is recommended that prospective research combines findings from data science into training exercises that underscore the perceptual-action relationships of the chosen metric/s. These studies could follow the lead of previous studies where researchers collaborated for multiple weeks with coaches to create the implemented training program (48, 50).

Finally, the length of the intervention process was also short in comparison to other studies. With the team involved being in the middle of their professional season, the intervention was only able to be applied for a total of six sessions due to logistics and the preference of the coaching staff. Previous studies showed the importance of including more than twelve sessions (50, 51) and increased results with more sessions (52). Thus, future work on the integration of data science to performance is advised to give attention to the length of education process.

In conclusion, this pilot intervention study made the first attempt to gain a better understanding about integrating spatiotemporal data to improve football performance. Positive and negative examples of passes based on quantitative measures led to marginal improvements in D-Def but a slight decrease in NOO. While there was no significant improvement in the passing metrics, the intervention team's performance improved based on more traditional key performance indicators. Thus, there was an indirect effect of the intervention, and it can be assumed that football players may benefit from video feedback when attempting to improve passing performance. We think, this first pilot study shows that metrics derived from data science could improve player performance and improve tactical training, if, like in this study, metrics are well-explained to the players and data is processed quickly to facilitate the training. To continue bridging the gap between data science research and football practice, it is recommended future studies consider the length of the intervention, provide qualitative feedback, and include collaborative efforts between coaches and researchers to develop training sessions that reinforce any desired tactical behavior/s.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The studies involving human participants were reviewed and approved by the Ethics Committee of Saarland University (registration number 2573003). Written informed consent to participate in this study was provided by the participants' legal guardian/next of kin.

Author contributions

MH and TM conceived and designed the analysis of this paper. MH and LG organized the study and collected positional data including the use of STATS Sports tracking devices. MK contributed to performing the analysis and integrating algorithms for D-Def and NOO. MH is the primary author with editing contributions from LR, MK, and TM. All authors contributed to the article and approved the submitted version.

Funding

MH was supported by a Science and Health in Football scholarship funded by the Deutscher Fußball-Bund (DFB) and Saarland University.

Conflict of interest

Author LR was employed by TSG ResearchLab gGmbH, Zuzenhausen, Germany. Author LR was employed by D.C. United.

The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

1. Frencken W, Lemmink K, Delleman N, Visscher C. Oscillations of centroid position and surface area of soccer teams in small-sided games. Eur J Sport Sci. (2011) 11:215–23. doi: 10.1080/17461391.2010.499967

CrossRef Full Text | Google Scholar

2. Power P, Ruiz H, Wei X, Lucey P. Not all passes are created equal: objectively measuring the risk and reward of passes in soccer from tracking data. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Halifax, NS: ACM (2017). p. 1605–13.

Google Scholar

3. Dellal A, Owen A, Wong DP, Krustrup P, Van Exsel M, Mallo J. Technical and physical demands of small vs. large sided games in relation to playing position in elite soccer. Hum Mov Sci. (2012) 31:957–69. doi: 10.1016/j.humov.2011.08.013

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Low B, Rein R, Schwab S, Memmert D. Defending in 4-4-2 or 5-3-2 formation? Small differences in footballers' collective tactical behaviours. J Sports Sci. (2022) 40:351–63. doi: 10.1080/02640414.2021.1993655

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Low B, Rein R, Raabe D, Schwab S, Memmert D. The porous high-press? An experimental approach investigating tactical behaviours from two pressing strategies in football. J Sports Sci. (2021) 39:2199–210. doi: 10.1080/02640414.2021.1925424

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Memmert D, Raabe D, Schwab S, Rein R. A tactical comparison of the 4-2-3-1 and 3-5-2 formation in soccer: a theory-oriented, experimental approach based on positional data in an 11 vs. 11 game set-up. PLoS ONE. (2019) 14:e0210191. doi: 10.1371/journal.pone.0210191

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Herold M, Kempe M, Bauer P, Meyer T. Attacking key performance indicators in soccer: current practice and perceptions from the elite to youth academy level. J Sports Sci Med. (2021) 20:158–69. doi: 10.52082/jssm.2021.158

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Malmqvist J, Hellberg K, Möllås G, Rose R, Shevlin M. Conducting the pilot study: a neglected part of the research process? Methodological findings supporting the importance of piloting in qualitative research studies. Int J Qual Methods. (2019) 18:1609406919878341. doi: 10.1177/1609406919878341

CrossRef Full Text | Google Scholar

9. El-Kotob R, Giangregorio LM. Pilot and feasibility studies in exercise, physical activity, or rehabilitation research. Pilot Feasib Stud. (2018) 4:137. doi: 10.1186/s40814-018-0326-0

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Coutts AJ. Working fast and working slow: the benefits of embedding research in high performance sport. Int J Sports Physiol Perform. (2016) 11:1–2. doi: 10.1123/IJSPP.2015-0781

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Thompson CJ, Noon M, Towlson C, Perry J, Coutts AJ, Harper LD, et al. Understanding the presence of mental fatigue in English academy soccer players. J Sports Sci. (2020) 38:1524–30. doi: 10.1080/02640414.2020.1746597

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Ciocca G, Tessitore A, Mandorino M, Tschan H. A video-based tactical task does not elicit mental fatigue and does not impair soccer performance in a subsequent small-sided game. Sports. (2022) 10:31. doi: 10.3390/sports10030031

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Hertzog MA. Considerations in determining sample size for pilot studies. Res Nurs Health. (2008) 31:180–91. doi: 10.1002/nur.20247

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Goes F, Schwarz E, Elferink-Gemser M, Lemmink K, Brink M. A risk-reward assessment of passing decisions: comparison between positional roles using tracking data from professional men's soccer. Sci Med Football. (2021) 6:372–80. doi: 10.1080/24733938.2021.1944660

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Szczepański Ł, Mchale I. Beyond completion rate: evaluating the passing ability of footballers. J R Stat Soc. (2016) 178:513–33. doi: 10.1111/rssa.12115

CrossRef Full Text | Google Scholar

16. Bush M, Barnes C, Archer DT, Hogg B, Bradley PS. Evolution of match performance parameters for various playing positions in the English Premier League. Hum Mov Sci. (2015) 39:1–11. doi: 10.1016/j.humov.2014.10.003

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Harrop K, Nevill A. Performance indicators that predict success in an English professional League One soccer team. Int J Perform Anal Sport. (2014) 14:907–20. doi: 10.1080/24748668.2014.11868767

CrossRef Full Text | Google Scholar

18. Zhou C, Zhang S, Lorenzo Calvo A, Cui Y. Chinese soccer association super league, 2012-2017: key performance indicators in balance games. Int J Perform Anal Sport. (2018) 18:645–56. doi: 10.1080/24748668.2018.1509254

CrossRef Full Text | Google Scholar

19. Rein R, Raabe D, Memmert D. “Which pass is better?” Novel approaches to assess passing effectiveness in elite soccer. Hum Mov Sci. (2017) 55:172–81. doi: 10.1016/j.humov.2017.07.010

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Steiner S, Rauh S, Rumo M, Sonderegger K, Seiler R. Outplaying opponents-a differential perspective on passes using position data. German J Exerc Sport Res. (2019) 49:140–9. doi: 10.1007/s12662-019-00579-0

CrossRef Full Text | Google Scholar

21. Memmert D, Lemmink KA, Sampaio J. Current approaches to tactical performance analyses in soccer using position data. Sports Med. (2017) 47:1–10. doi: 10.1007/s40279-016-0562-5

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Rein R, Memmert D. Big data and tactical analysis in elite soccer: future challenges and opportunities for sports science. Springerplus. (2016) 5:1410. doi: 10.1186/s40064-016-3108-2

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Goes F, Kempe M, Meerhoff R. Lemmink K.A.P.M. Not every pass can be an assist: a data-driven model to measure pass effectiveness in professional soccer matches. Big Data. (2018) 7.

Google Scholar

24. Goes FR, Kempe M, Meerhoff LA, Lemmink K. Not every pass can be an assist: a data-driven model to measure pass effectiveness in professional soccer matches. Big Data. (2019) 7:57–70. doi: 10.1089/big.2018.0067

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Chassy P. Team play in football: how science supports FC Barcelona's training strategy. Psychology. (2013) 4:7. doi: 10.4236/psych.2013.49A2002

CrossRef Full Text | Google Scholar

26. Groom R, Cushion C, Nelson L. The delivery of video-based performance analysis by England youth soccer coaches: towards a grounded theory. J Appl Sport Psychol. (2011) 23:16–32. doi: 10.1080/10413200.2010.511422

CrossRef Full Text | Google Scholar

27. Wright C, Atkins S, Jones B. An analysis of elite coaches' engagement with performance analysis services (match, notational analysis and technique analysis). Int J Perform Anal Sport. (2012) 12:436–51. doi: 10.1080/24748668.2012.11868609

CrossRef Full Text | Google Scholar

28. Brümmer K. Subjectivation by video-ethnographic explorations on practices of video analysis in high-performance youth football. German J Exerc Sport Res. (2018) 48:358–65. doi: 10.1007/s12662-018-0504-5

CrossRef Full Text | Google Scholar

29. Groom R, Cushion C. Using of video based coaching with players: a case study. Int J Perform Anal Sport. (2005) 5:40–6. doi: 10.1080/24748668.2005.11868336

CrossRef Full Text | Google Scholar

30. Capalbo A, Miltenberger RG, Cook JL. Training soccer goalkeeping skills: is video modeling enough? J Appl Behav Anal. (2022) 55:958–70. doi: 10.1002/jaba.937

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Reeves MJ, Roberts SJ. Perceptions of performance analysis in elite youth football. Int J Perform Anal Sport. (2013) 13:200–11. doi: 10.1080/24748668.2013.11868642

CrossRef Full Text | Google Scholar

32. Partington M, Cushion CJ, Cope E, Harvey S. The impact of video feedback on professional youth football coaches' reflection and practice behaviour: a longitudinal investigation of behaviour change. Reflect Pract. (2015) 16:700–16. doi: 10.1080/14623943.2015.1071707

CrossRef Full Text | Google Scholar

33. Forcher L, Kempe M, Altmann S, Forcher L, Woll A. The “Hockey” assist makes the difference-validation of a defensive disruptiveness model to evaluate passing sequences in elite soccer. Entropy. (2021) 23:1607. doi: 10.3390/e23121607

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Faisal S, Tutz G. Multiple imputation using nearest neighbor methods. Inf Sci. (2021) 570:500–16. doi: 10.1016/j.ins.2021.04.009

CrossRef Full Text | Google Scholar

35. Dong Y, Peng CY. Principled missing data methods for researchers. Springerplus. (2013) 2:222. doi: 10.1186/2193-1801-2-222

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Cohen J. Statistical Power Analysis for the Behavioral Sciences. New York, NY: Routledge Academic (1988).

PubMed Abstract | Google Scholar

37. Faul F, Erdfelder E, Lang AG, Buchner A. G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods. (2007) 39:175–91. doi: 10.3758/BF03193146

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Julious SA. Sample size of 12 per group rule of thumb for a pilot study. Pharm Stat J Appl Stat Pharm Industry. (2005) 4:287–91. doi: 10.1002/pst.185

CrossRef Full Text | Google Scholar

39. García-González L, Moreno A, Gil A, Moreno MP, Villar FD. Effects of decision training on decision making and performance in young tennis players: an applied research. J Appl Sport Psychol. (2014) 26:426–40. doi: 10.1080/10413200.2014.917441

CrossRef Full Text | Google Scholar

40. Moreno MP, Moreno A, Garcia-Gonzalez L, Urena A, Hernandez C, Del Villar F. An intervention based on video feedback and questioning to improve tactical knowledge in expert female volleyball players. Percept Mot Skills. (2016) 122:911–32. doi: 10.1177/0031512516650628

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Tenga A, Holme I, Ronglan LT, Bahr R. Effect of playing tactics on achieving score-box possessions in a random series of team possessions from Norwegian professional soccer matches. J Sports Sci. (2010) 28:245–55. doi: 10.1080/02640410903502766

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Lago-Ballesteros J, Lago-Penas C, Rey E. The effect of playing tactics and situational variables on achieving score-box possessions in a professional soccer team. J Sports Sci. (2012) 30:1455–61. doi: 10.1080/02640414.2012.712715

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Quintana M, Aguilera-Castells J, Solana-Tramunt M, Morales J, Nieto A. Effects of video feedback on kicking performance and temporal patterns in u-10 soccer players: 810 Board# 44 May 29 2: 00 PM-3: 30 PM. Med Sci Sports Exerc. (2019) 51:199. doi: 10.1249/01.mss.0000561101.93295.db

CrossRef Full Text | Google Scholar

44. Steiner S. Passing decisions in football: introducing an empirical approach to estimating the effects of perceptual information and associative knowledge. Front Psychol. (2018) 9:361. doi: 10.3389/fpsyg.2018.00361

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Larsen C, Alfermann D, Christensen M. Psychosocial skills in a youth soccer academy: a holistic ecological perspective. Sport Sci Rev. (2012) 21:271–290. doi: 10.2478/v10237-012-0010-x

CrossRef Full Text | Google Scholar

46. Harvey S, Gittins C. Effects of integrating video-based feedback into a Teaching Games for Understanding soccer unit. Agora Para Educación Física Deporte. (2014) 16:271–90. Available online at: http://uvadoc.uva.es/handle/10324/23784

Google Scholar

47. Nelson LJ, Potrac P, Groom R. Receiving video-based feedback in elite ice-hockey: a player's perspective. Sport Educ Soc. (2014) 19:19–40. doi: 10.1080/13573322.2011.613925

CrossRef Full Text | Google Scholar

48. Práxedes A, Del Villar Álvarez F, Moreno A, Gil-Arias A, Davids K. Effects of a nonlinear pedagogy intervention programme on the emergent tactical behaviours of youth footballers. Phys Educ Sport Pedag. (2019) 24:332–43. doi: 10.1080/17408989.2019.1580689

CrossRef Full Text | Google Scholar

49. Santos S, Coutinho D, Gonçalves B, Schöllhorn W, Sampaio J, Leite N. Differential learning as a key training approach to improve creative and tactical behavior in soccer. Res Q Exerc Sport. (2018) 89:11–24. doi: 10.1080/02701367.2017.1412063

PubMed Abstract | CrossRef Full Text | Google Scholar

50. Harvey S, Cushion CJ, Wegis HM, Massa-Gonzalez AN. Teaching games for understanding in American high-school soccer: a quantitative data analysis using the game performance assessment instrument. Phys Educ Sport Pedag. (2010) 15:29–54. doi: 10.1080/17408980902729354

CrossRef Full Text | Google Scholar

51. Pizarro AP, Domínguez AM, Serrano JS, García-González L, Del Villar Álvarez F. The effects of a comprehensive teaching program on dribbling and passing decision-making and execution skills of young footballers. Kinesiology. (2017) 49:74–83. doi: 10.26582/k.49.1.6

CrossRef Full Text | Google Scholar

52. Araújo R, Mesquita I, Hastie P, Pereira C. Students' game performance improvements during a hybrid sport education-step-game-approach volleyball unit. Eur Phys Educ Rev. (2016) 22:185–200. doi: 10.1177/1356336X15597927

CrossRef Full Text | Google Scholar

Keywords: soccer (football), performance analysis, data science, coaching (performance), passing ability, soccer analytics

Citation: Herold M, Kempe M, Ruf L, Guevara L and Meyer T (2022) Shortcomings of applying data science to improve professional football performance: Takeaways from a pilot intervention study. Front. Sports Act. Living 4:1019990. doi: 10.3389/fspor.2022.1019990

Received: 15 August 2022; Accepted: 27 September 2022;
Published: 12 October 2022.

Edited by:

Daniel Castillo, University of Valladolid, Spain

Reviewed by:

Diogo Coutinho, Research Centre in Sports Sciences, Health Sciences and Human Development (CIDESD), Portugal
José María Izquierdo, University of Valladolid, Spain

Copyright © 2022 Herold, Kempe, Ruf, Guevara and Meyer. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Mat Herold, mat.herold@uni-saarland.de

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.