Paulo Gentil
Antonio Arruda
Daniel Souza
Jurgen Giessing
Antonio Paoli
James Fisher
James Steele- 1Faculdade de Educação Física e Dança, Universidade Federal de Goiás, Goiania, Brazil
- 2Laboratório de Pesquisas em Desempenho Humano, Universidade de Pernambuco-Campus Petrolina, Petrolina, Brazil
- 3Departamento de Educação Física, Universidade Federal do Rio Grande do Norte, Natal, Brazil
- 4Institute of Sport Science, University of Koblenz-Landau, Landau, Germany
- 5Department of Biomedical Sciences, University of Padova, Padova, Italy
- 6Sport Science Laboratory, Centre for Health, Exercise and Sport Science, Southampton Solent University, Southampton, UK
Introduction
Designing resistance training (RT) programs is a complex task that involves the manipulation of numerous variables that interact with each other, influencing the program outcomes (Tan, 1999; Paoli, 2012). The attempt to clearly define the combination of variables which would bring optimal adaptations for different outcomes is undermined by the large number of studies involving RT, the conflicting findings reported by many of them and the lack of methodological clarity and consistency in previous studies' protocols. As such, meta-analyses emerge as an attractive approach since they allow the combination of multiple studies in an attempt to estimate the effect size of a single variable, surpassing possible inadequacies of statistical power within individual studies. With this aggregation of information, a more robust estimation of the effects is possible.
However, Field (2015) has noted a pertinent philosophical objection to these types of analyses that might apply to RT studies; in essence we have a replication crisis. Researchers often attempt to perform replications of the findings from earlier studies, yet frequently they do not adequately replicate the conditions of the original study. For example, one study may examine the effects of low or high set volume whilst participants train at a frequency of twice a week using repetition ranges of 8–12 and perform sets to momentary failure. Another may examine the effects of low or high set volume whilst participants train at a frequency of five times a week using 10 repetitions per set and not having participants perform sets to momentary failure. Though the two studies might appear to be examining whether low or high set volumes produce greater adaptations, they are in fact examining these within the context of different manipulations of other RT variables. There is likely a reason for this lack of proper replication, as was noted by Richard Feynman1. Indeed, we would argue that the currently heterogeneous body of literature on the effects of the manipulation of different RT variables is evidence of this replication crisis being alive and well in our field.
In this current opinion article we explain specifically why it might be unwise to conduct meta-analyses with such heterogeneous RT studies noting the effects of different confounding RT variables, and also suggest that it might be irresponsible to make general estimates of RT effects and propose recommendations.
Impact of Resistance Training Variables
The first aspect to consider is the confusion borne from the definition and reporting of training “intensity.” RT studies have previously defined and thus controlled exercise “intensity” as a percentage of the load equivalent to the one repetition maximum (1RM). Nevertheless, previous studies reported that the number of repetitions performed at a given percentage of 1RM largely varies when different individuals are performing the same exercise and when the same individual performs different exercises (Hoeger et al., 1990). Hoeger et al. (1990) reported that, when using 80% of 1RM, resistance trained women were able to perform 22 repetitions in the leg press exercise and only 9 in the knee extension. Therefore, if a study prescribes 12 repetitions at 80% of 1RM for the leg press and another prescribes the same repetitions and load for the knee extension, they would be performing the exercise with a similar intensity of load but different intensity of effort. Additionally, Hoeger et al. (1990) reported the average number of repetitions performed with 80% of 1RM was 22 for trained and 12 for untrained women. As a result, the prescription of the same number of repetitions at the same relative load would result in different intensity of effort. For this reason, several authors have proposed that using 1RM percentages may be inadequate for controlling RT intensity (Fisher and Smith, 2012; Fisher et al., 2013; Steele, 2014) and suggested that controlling effort (i.e., exercising to the point of momentary failure) would be a better strategy for this purpose.
The need for controlling effort is further supported by a previous study reporting that training to failure results in greater gains in muscle strength and more positive changes in body composition than not training to failure (Giessing et al., 2016). Considering this, the use of percentages of 1RM in many of the previous studies might have resulted in unmatched intensities of effort, which likely influenced training outcomes. We acknowledge that this is a contentious issue, and other studies exist suggesting that, where volume matched, equivocal results can be obtained whether training to muscular failure or not (Fisher et al., 2016c). However, other authors have suggested that training to muscular failure is necessary for standardizing RT interventions (Dankel et al., 2016a). With this in mind, we believe that the inadequate control of intensity of effort is a problem in many previous studies, since there is often no clear definition of the set end point used in training which was performed to either volitional fatigue, or a self-determined repetition maximum or to momentary failure.
Supervision ratio might be another aspect to influence the results of RT. In previous studies by Gentil and Bottaro (2010), Mazzetti et al. (2000), and Coutts et al. (2004), untrained men, trained men and young athletes had higher gains in muscle strength and performance when training with a more favorable supervision ratio (e.g., fewer participants to trainers). It is important to note that in these studies all participants performed the same protocol, with the same exercises, number of sets, repetitions, etc. The differences in the results were due to the supervision ratio. It is likely that a more favorable supervision ratio resulted in participants exercising to a greater intensity of effort. More recent studies which have used a one to one (client: trainer) ratio have failed to identify any benefits from performing advanced RT methods (Fisher et al., 2014, 2016a,b) likely because all participants, irrespective of group, exercised to true momentary failure due to the supervision. It is our opinion that whilst, supervision ratio is not usually considered in RT meta-analyses (e.g., Rhea et al., 2003; Peterson et al., 2004; Wernbom et al., 2007; Krieger, 2010; Schoenfeld et al., 2015, 2016a,b) possibly since it is often unreported in RT studies; it is an important factor which needs future consideration in both empirical trials and review articles including meta-analyses.
Other aspects usually forgotten are movement velocity and the type of muscle action predominantly performed. Previous studies suggest that different muscle actions influence the acute responses to exercise. For example, when using the same load, it is possible to perform more repetitions when only eccentric actions are performed in comparison to combined concentric and eccentric, which, in turn, permits greater repetitions than concentric only muscle actions (Flanagan et al., 2014). Moreover, eccentric actions have been shown to induce a higher degree of muscle damage than concentric, even when using the same load and performing the same number of repetitions (Gibala et al., 1995). Consequently, two persons performing the same number of sets and repetitions for the same exercise, at the same relative load may have different physiological responses if using different movement velocities in the concentric or eccentric phase. In addition, previous studies reported differences in anabolic signaling (Burd et al., 2012), fitness (Bottaro et al., 2007) and gains in muscle size and strength (Nogueira et al., 2009) when the same exercise protocol was performed with different velocities. Again, this is often an overlooked variable which we believe is important when considering studies to include in a meta-analysis.
Another possible source of confusion might be considering only specific muscles (e.g., the supposed prime movers) when counting the number of sets performed. This aspect is especially relevant for upper body muscles (i.e., not considering the biceps brachii work during pulldowns), since previous research has shown that upper-body multi joint exercises produce equivalent gains in muscle size and strength as single joint exercises specifically targeted for the elbow flexors (Gentil et al., 2015, 2016). Therefore, one may not disregard the involvement of a muscle in the multi joint movement (i.e., the involvement of triceps during bench press, biceps during pulldowns, etc.) as it will lead to an inadequate estimation of training volume. Moreover, including studies that measured legs and arm muscles in the same analyses could be misleading, Considering that previous data did not present the same trend of greater adaptations with increasing sets per muscle group across both upper- and lower-body muscles (Ostrowski et al., 1997; Paulsen et al., 2003; Ronnestad et al., 2007; Bottaro et al., 2011) we believe that dissociation of these muscle groups, rather than a single recommendation, might be beneficial. With the above in mind we believe that when performing meta-analyses authors can inadvertently misrepresent research studies and might exclude essential details which serves to reduce the validity of their conclusions.
In addition to the above variables which are often left unreported in research publications and uncontrolled in meta-analyses we should also consider the variable of range of motion (ROM). In previous studies, participants whose training differed only in ROM of the exercise performed (e.g., all other variables were controlled) showed between group variation in muscle size, strength, and decreases in skinfold thickness in favor of a larger ROM (Massey et al., 2005; Pinto et al., 2012; Bloomquist et al., 2013; McMahon et al., 2014). Thus, we believe that if ROM is not reported and controlled this may have differed between interventions and depending on the outcome examined may impact any conclusions.
Finally, the tests used to measure outcomes seem to be of vital importance for estimating effect size. When analyzing strength two of the most popular tests are the one-repetition maximum (1RM) and isokinetic or isometric peak torque (PT) (Brown and Weir, 2001). Although the two methods are widely used and accepted by the scientific community, they are not equivalent, as the results obtained show large variations and can be even conflicting (Gentil et al., in press). For example, the effect size of an intervention can be large when measuring its results by 1RM, while the effect size of another intervention can be low when evaluating it by isometric or isokinetic dynamometry. Nevertheless, this may not be reflective of the intervention protocols, but rather of the tests performed. Thus, using studies that utilized different assessment methods in the same analysis may produce inaccurate and misleading results. The same is true for in vitro and in vivo methods of assessing change in hypertrophy as discussed previously (Steele and Fisher, 2014; Fisher et al., 2016d). Furthermore, the use of effect sizes in general has recently been challenged (Dankel et al., 2016b), and since meta-analyses calculate overall results from this value we urge caution in meta-analyses which provide conclusions contradictory to a body of research.
Conclusions
These observations are only a few examples of the complexity involved with RT prescription, discussed to illustrate how isolated variables may influence RT outcomes. As such we question the possibility of making general estimates of RT adaptation without considering such complexity. The question is, if one single variable can influence the results, how can we control the interaction between them or how can we precisely estimate the impact of one of them when the others are not controlled?
A common criticism of meta-analyses is that they usually combine studies that have important methodological differences and, consequently, the summary effect can be largely influenced by these differences across studies (Field, 2015; Fuhr and Hellmich, 2015). Although there are many possible strategies to test for heterogeneity across included studies, and methods to account for such heterogeneity and confounding factors upon effect sizes (e.g., treating meta-analysis as a multi-level model), the power to test for these moderators depends partly on the number of studies available and the sample sizes used across these studies. For this reason, an effort for controlling confounding factors would be fruitless if the analyses involve a low number of heterogeneous studies with small sample sizes, as is the case in almost all RT meta-analyses. It is also important to note that a meta-analysis is only as good as the studies included. Thus an initial flaw in screening and selection can lead to inappropriate inclusion and/or analysis of inadequate studies, leading to the phenomenon: “garbage in garbage out” (Charlton, 1996).
Meta-analyses are highly publishable and have negligible cost and effort when compared to the acquisition of raw data. These might explain the increase in meta-analyses production and publication in many areas (Field, 2015; Fuhr and Hellmich, 2015), including RT. However, it is important to remember that for a meta-analysis to be valid, a large amount of data on homogeneous subgroups under homogenous conditions should accumulate for topics where there is strong consensus about which variables have theoretical importance, and this does not seem to be the case for RT. Therefore, we consider that a greater value can be obtained by designing and conducting studies of larger and homogenous samples that can adequately address the topics considered, or performing more exact replication studies instead of prematurely performing meta-analyses on differing RT variables or trying to estimate the effects of RT combining studies that involve an uncontrollable heterogeneity. If it is desirable to obtain an understanding of the conclusions that can be drawn from the body of existing literature, then it would be better to carefully review and interpret studies whilst considering the role of confounding variables and study designs.
Author Contributions
PG, AA, DS, JG, AP, JF, and JS: Conception, drafting the article, revising it critically, and final approval of the version to be published.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Footnotes
1. ^“…under certain circumstances, X, rats did something, A. She was curious as to whether, if she changed the circumstances to Y, they would still do, A. So her proposal was to do the experiment under circumstances Y and see if they still did A.
I explained to her that it was necessary first to repeat in her laboratory the experiment of the other person—to do it under condition X to see if she could also get result A—and then change to Y and see if A changed. Then she would know that the real difference was the thing she thought she had under control.
She was very delighted with this new idea, and went to her professor. And his reply was, no, you cannot do that, because the experiment has already been done and you would be wasting time. This was in about 1935 or so, and it seems to have been the general policy then to not try to repeat psychological experiments, but only to change the conditions and see what happens.”(http://calteches.library.caltech.edu/51/2/CargoCult.htm)
References
Bloomquist, K., Langberg, H., Karlsen, S., Madsgaard, S., Boesen, M., and Raastad, T. (2013). Effect of range of motion in heavy load squatting on muscle and tendon adaptations. Eur. J. Appl. Physiol. 113, 2133–2142. doi: 10.1007/s00421-013-2642-7
Bottaro, M., Machado, S. N., Nogueira, W., Scales, R., and Veloso, J. (2007). Effect of high versus low-velocity resistance training on muscular fitness and functional performance in older men. Eur. J. Appl. Physiol. 99, 257–264. doi: 10.1007/s00421-006-0343-1
Bottaro, M., Veloso, J., Wagner, D., and Gentil, P. (2011). Resistance training for strength and muscle thickness, Effect of number of sets and muscle group trained. Sci. Sports 26, 259–264. doi: 10.1016/j.scispo.2010.09.009
Brown, L. E., and Weir, J. P. (2001). Procedures recommendation I, accurate assessment of muscular strength and power. J. Exerc. Physiol. 4, 1–21.
Burd, N. A., Andrews, R. J., West, D. W., Little, J. P., Cochran, A. J., Hector, A. J., et al. (2012). Muscle time under tension during resistance exercise stimulates differential muscle protein sub-fractional synthetic responses in men. J. Physiol. 590, 351–362. doi: 10.1113/jphysiol.2011.221200
Coutts, A. J., Murphy, A. J., and Dascombe, B. J. (2004). Effect of direct supervision of a strength coach on measures of muscular strength and power in young rugby league players. J. Strength Cond. Res. 18, 316–323. doi: 10.1519/00124278-200405000-00021
Dankel, S. J., Jessee, M. B., Mattocks, K. T., Mouser, J. G., Counts, B. R., Buckner, S. L., et al. (2016a). Training to fatigue, the answer for standardization when assessing muscle hypertrophy? Sports Med. doi: 10.1007/s40279-016-0633-7. [Epub ahead of print].
Dankel, S. J., Mouser, J. G., Mattocks, K. T., Counts, B. R., Jessee, M. B., Bucker, S. L., et al. (2016b). The widespread misuse of effect sizes. J. Sci. Med. Sport doi: 10.1016/j.jsams.2016.10.003. [Epub ahead of print].
Field, A. P. (2015). Dread returns to mega-silly one. Health Psychol. Rev. 9, 15–20. doi: 10.1080/17437199.2013.879198
Fisher, J. P., Blossom, D., and Steele, J. (2016c). A comparison of volume-equated knee extensions to failure, or not to failure, upon rating of perceived exertion and strength adaptations. Appl. Physiol. Nutr. Metab. 41, 168–174. doi: 10.1139/apnm-2015-0421
Fisher, J. P., Carlson, L., and Steele, J. (2016a). The effects of breakdown set resistance training on muscular performance and body composition in young men and women. J. Strength Cond. Res. 30, 1425–1432. doi: 10.1519/JSC.0000000000001222
Fisher, J. P., Carlson, L., and Steele, J. (2016b). The effects of muscle action, repetition duration, and loading strategies of a whole-body, progressive resistance training programme on muscular performance and body composition in trained males and females. Appl. Physiol. Nutr. Metab. 41, 1064–1070. doi: 10.1139/apnm-2016-0180
Fisher, J. P., Carlson, L., Steele, J., and Smith, D. (2014). The effects of pre-exhaustion, exercise order, and rest intervals in a full-body resistance training intervention. Appl. Physiol. Nutr. Metab. 39, 1265–1270. doi: 10.1139/apnm-2014-0162
Fisher, J., and Smith, D. (2012). Attempting to better define “intensity” for muscular performance, is it all wasted effort? Eur. J. Appl. Physiol. 112, 4183–4185; author reply: 4187–4188. doi: 10.1080/17437199.2013.879198
Fisher, J., Steele, J., and Smith, D. (2013). Evidence-based resistance training recommendations for muscular hypertrophy. Med. Sport. 17, 217–235. doi: 10.5604/17342260.1081302
Fisher, J., Steele, J., and Smith, D. (2016d). High- and low-load resistance training, interpretation and practical application of current research findings. Sports Med. doi: 10.1007/s40279-016-0602-1. [Epub ahead of print].
Flanagan, S. D., Mills, M. D., Sterczala, A. J., Mala, J., Comstock, B. A., Szivak, T. K., et al. (2014). The relationship between muscle action and repetition maximum on the squat and bench press in men and women. J. Strength Cond. Res. 28, 2437–2442. doi: 10.1519/JSC.0000000000000337
Fuhr, U., and Hellmich, M. (2015). Channeling the flood of meta-analyses. Eur. J. Clin. Pharmacol. 71, 645–647. doi: 10.1007/s00228-015-1838-7
Gentil, P., and Bottaro, M. (2010). Influence of supervision ratio on muscle adaptations to resistance training in nontrained subjects. J. Strength Cond. Res. 24, 639–643. doi: 10.1519/JSC.0b013e3181ad3373
Gentil, P., Del Vecchio, F. B., Paoli, A., Schoenfeld, B. J., and Bottaro, M. (in press). Isokinetic dynamometry 1RM tests produce conflicting results for assessing alterations in muscle strength. J. Hum. Kinet.
Gentil, P., Fisher, J., and Steele, J. (2016). A review of the acute effects and long-term adaptations of single- and multi-joint exercises during resistance training. Sports Med. doi: 10.1007/s40279-016-0627-5. [Epub ahead of print].
Gentil, P., Soares, S., and Bottaro, M. (2015). Single vs. multi-joint resistance exercises, effects on muscle strength and hypertrophy. Asian J. Sports Med. 6, e24057. doi: 10.5812/asjsm.24057
Gibala, M. J., MacDougall, J. D., Tarnopolsky, M. A., Stauber, W. T., and Elorriaga, A. (1995). Changes in human skeletal muscle ultrastructure and force production after acute resistance exercise. J. Appl. Physiol. 78, 702–708.
Giessing, J., Fisher, J., Steele, J., Rothe, F., Raubold, K., and Eichmann, B. (2016). The effects of low volume resistance training with and without advanced techniques in trained participants. J. Sports Med. Phys. Fitness. 56, 249–258.
Hoeger, W. W. K., Hopkins, D. R., Barette, S. L., and Hale, D. F. (1990). Relashionship between repetitions and selected percentages of one repetition maximum, a comparison between untrained and trained males and females. J. Strength Cond. Res. 4, 47–54.
Krieger, J. W. (2010). Single vs. multiple sets of resistance exercise for muscle hypertrophy, a meta-analysis. J. Strength Cond. Res. 24, 1150–1159. doi: 10.1519/JSC.0b013e3181d4d436
Massey, C. D., Vincent, J., Maneval, M., and Johnson, J. T. (2005). Influence of range of motion in resistance training in women, early phase adaptations. J. Strength Cond. Res. 19, 409–411. doi: 10.1519/r-14643.1
Mazzetti, S. A., Kraemer, W. J., Volek, J. S., Duncan, N. D., Ratamess, N. A., Gomez, A. L., et al. (2000). The influence of direct supervision of resistance training on strength performance. Med. Sci. Sports Exerc. 32, 1175–1184. doi: 10.1097/00005768-200006000-00023
McMahon, G. E., Morse, C. I., Burden, A., Winwood, K., and Onambele, G. L. (2014). Impact of range of motion during ecologically valid resistance training protocols on muscle size, subcutaneous fat, and strength. J. Strength Cond. Res. 28, 245–255. doi: 10.1519/JSC.0b013e318297143a
Nogueira, W., Gentil, P., Mello, S. N., Oliveira, R. J., Bezerra, A. J., and Bottaro, M. (2009). Effects of power training on muscle thickness of older men. Int. J. Sports Med. 30, 200–204. doi: 10.1055/s-0028-1104584
Ostrowski, K. J., Wilson, G. J., Weatherby, R., Murphy, P. W., and Lyttle, A. D. (1997). The effect of weight training volume on hormonal output and muscular size and function. J. Strength Cond. Res. 11, 148–154. doi: 10.1519/00124278-199708000-00003
Paoli, A. (2012). Resistance training, the multifaceted side of exercise. Am. J. Physiol. Endocrinol. Metab. 302, E387. doi: 10.1152/ajpendo.00541.2011
Paulsen, G., Myklestad, D., and Raastad, T. (2003). The influence of volume of exercise on early adaptations to strength training. J. Strength Cond. Res. 17, 115–120. doi: 10.1519/00124278-200302000-00019
Peterson, M. D., Rhea, M. R., and Alvar, B. A. (2004). Maximizing strength development in athletes, a meta-analysis to determine the dose-response relationship. J. Strength Cond. Res. 18, 377–382. doi: 10.1519/r-12842.1
Pinto, R. S., Gomes, N., Radaelli, R., Botton, C. E., Brown, L. E., and Bottaro, M. (2012). Effect of range of motion on muscle strength and thickness. J. Strength Cond. Res. 26, 2140–2145. doi: 10.1519/JSC.0b013e31823a3b15
Rhea, M. R., Alvar, B. A., Burkett, L. N., and Ball, S. D. (2003). A meta-analysis to determine the dose response for strength development. Med. Sci. Sports Exerc. 35, 456–464. doi: 10.1249/01.MSS.0000053727.63505.D4
Ronnestad, B. R., Egeland, W., Kvamme, N. H., Refsnes, P. E., Kadi, F., and Raastad, T. (2007). Dissimilar effects of one- and three-set strength training on strength and muscle mass gains in upper and lower body in untrained subjects. J. Strength Cond. Res. 21, 157–163. doi: 10.1519/00124278-200702000-00028
Schoenfeld, B. J., Ogborn, D. I., and Krieger, J. W. (2015). Effect of repetition duration during resistance training on muscle hypertrophy, a systematic review and meta-analysis. Sports Med. 45, 577–585. doi: 10.1007/s40279-015-0304-0
Schoenfeld, B. J., Ogborn, D., and Krieger, J. W. (2016a). Dose-response relationship between weekly resistance training volume and increases in muscle mass, A systematic review and meta-analysis. J, Sports Sci. 1–10. doi: 10.1080/02640414.2016.1210197
Schoenfeld, B. J., Ogborn, D., and Krieger, J. W. (2016b). Effects of resistance training frequency on measures of muscle hypertrophy, a systematic review and meta-analysis. Sports Med. doi: 10.1007/s40279-016-0543-8. [Epub ahead of print].
Steele, J. (2014). Intensity, in-ten-si-ty, noun. 1. Often used ambiguously within resistance training. 2. Is it time to drop the term altogether? Br. J. Sports Med. 48, 1586–1588. doi: 10.1136/bjsports-2012-092127
Steele, J., and Fisher, J. (2014). Scientific rigour, a heavy or light load to carry? Sports Med. 44, 141–142. doi: 10.1007/s40279-013-0113-2
Tan, B. (1999). Manipulating resistance training program variables to optimize maximum strength in men, a review. J. Strength Cond. Res. 13, 289–304. doi: 10.1519/00124278-199908000-00019
Keywords: strength training, exercise prescription, strength and conditioning, resistance exercise, muscle hypertrophy, muscle strength
Citation: Gentil P, Arruda A, Souza D, Giessing J, Paoli A, Fisher J and Steele J (2017) Is There Any Practical Application of Meta-Analytical Results in Strength Training?. Front. Physiol. 8:1. doi: 10.3389/fphys.2017.00001
Received: 23 November 2016; Accepted: 03 January 2017;
Published: 19 January 2017.
Edited by:
Brian Keith McFarlin, University of North Texas, USAReviewed by:
Lem W. Taylor, University of Mary Hardin–Baylor, USAJames Krieger, Weightology, LLC, USA
Copyright © 2017 Gentil, Arruda, Souza, Giessing, Paoli, Fisher and Steele. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Paulo Gentil, paulogentil@gmail.com