Alex Castro1*
Renata Garbellini Duft1Ana Carolina de Mattos Zeri2Claudia Regina Cavaglieri1
Mara Patrícia Traina Chacon-Mikahil1*- 1Laboratory of Exercise Physiology, School of Physical Education, University of Campinas, Campinas, Brazil
- 2Brazilian Synchrotron Light Laboratory, Brazilian Center for Research in Energy, Campinas, Brazil
A Commentary on
Metabolomics-Based Studies Assessing Exercise-Induced Alterations of the Human Metabolome: A Systematic Review
by Sakaguchi, C. A., Nieman, D. C., Signini, E. F., Abreu, R. M., and Catai, A. M. (2019). Metabolites 9:164. doi: 10.3390/metabo9080164
We have read with interest the study of Sakaguchi et al. (2019), which proposes a qualitative appraisal of recent metabolomics-based studies (published over the past decade) exploring exercise-induced alterations of the human metabolome. The authors devised a scoring system ranging from zero (poor quality = below 4) to 11 (excellent quality = above nine) to attribute quality levels for each assessed study. The criteria used were based on research design (number of participants and study characteristics), methodology (analytical methods and statistical choices), and novelty (Sakaguchi et al., 2019). Although this systematic review was indeed well-conducted, some concerns need to be addressed, particularly on the validity of the scoring system used.
First, for an appropriate sample size (N) for metabolomics and exercise studies, the authors attributed two points to studies with N > 20 or N > 13 for parallel and crossover designs, respectively, or zero if they presented a smaller sample size (Sakaguchi et al., 2019). However, no calculation of statistical power was presented to support these suggested numbers. To improve the reproducibility of future investigations on this topic, well-established methodological principles should not be overlooked, and sample size should be based on statistical power analysis (Krzywinski and Altman, 2013). Ensuring that sample sizes are large enough to detect the effects of interest is an essential part of study design, especially in “omics” studies, where multiple outcomes are tested, and a large number of true positive results may be missed due to insufficient statistical power (van Iterson et al., 2009; Krzywinski and Altman, 2013).
Secondly, for study characterization, the authors suggest that metabolomics investigations should use a randomized controlled design, along with more than two-timepoint data collection and/or a duration of over 3 weeks (chronic studies only) (Sakaguchi et al., 2019). We do subscribe to the view that studies using randomized controlled trials should be encouraged, since they are the most rigorous way to evaluate the cause-effect relation between treatment and outcome (Sibbald and Roland, 1998; Concato et al., 2000). However, we would like to point out that the number of data collection points and the number of weeks in longitudinal studies (chronic response) is highly dependent on the experimental design and research objectives and should not be used as a criterion for disqualifying a study. For instance, for longitudinal studies with parallel randomized control groups with samples obtained only at rest, two timepoints of data collection (pre- and post-intervention) are sufficient to assess exercise-induced alterations in the basal human metabolome (Huffman et al., 2014; Glynn et al., 2015; Duft et al., 2017; Brennan et al., 2018). For cross-over studies (acute response), we suggest that a control session (no exercise) be included in the experimental design for a clearer interpretation of the effects of exercise compared to those of prolonged fasting (Shrestha et al., 2015; Karimpour et al., 2016; Li-Gao et al., 2019). The inclusion of any additional data collection timepoints after exercise sessions would depend on the research goals.
Thirdly, regarding analytical methods, the authors assigned a different score to the LC-MS/MS, GC-MS, and 1H NMR methods, which suggests a hierarchy of importance between them (Sakaguchi et al., 2019). However, they failed to provide a clear account of the reasoning behind this decision. In our view, it is not appropriate to make a hierarchical quality comparison between metabolomics platforms, as they are complementary, and there is no single technique that is capable of quantifying all the chemical compounds in a given sample at the same time. Therefore, the choice of analytical methods should be supported by the specific objectives of each study. For example, if the objective of the study includes the investigation of metabolites with polar characteristics, NMR may be a sound choice, whereas if the compounds of interest are hydrophobic or are in low concentrations, GC-MS would be a better alternative. The study carried out by Karimpour et al. (2016) has shown an interesting approach to comparing these three platforms in the identification of compounds in human plasma (Karimpour et al., 2016).
Fourthly, regarding statistical support, the authors attribute a gradual increase in the score to the addition of factors in the analysis and the application of multivariate/bioinformatic statistical methods, when compared to traditional univariate statistical analysis (Sakaguchi et al., 2019). Although the use of multivariate statistical methods and bioinformatics has driven new discoveries in metabolomics due to their high capacity to extract relevant information from large data sets (Johnson et al., 2015; Meier et al., 2017), the choice of these tools depends on the experimental design or on the type of research question, and as such, they do not necessarily ensure an improved study quality. Therefore, we suggest that regardless of the statistical approach taken, the reader should question whether the underlying assumptions have been carefully addressed. For example, a partial least squares discriminative analysis (PLS-DA), used for supervised group classification (Worley and Powers, 2013; Ren et al., 2015), requires validation parameters, which is often difficult to achieve due to the small sample size and large number of variables common in human metabolomics studies (Antonelli et al., 2019). In this case, the quality of the study should be linked not only to the mere use of the PLS-DA model but also to whether appropriate validation is presented for it, including cross-validation tests. This would allow for a proper examination of the magnitude of the values of R2 (goodness of model fit) and Q2 (model predictive capacity), as well as the discrepancy between them (model overfitting), permutation tests (statistical significance of the classification model), and the application of corrections for multiple tests in subsequent univariate analyzes, among other relevant parameters, to support the findings of the study (Westerhuis et al., 2008; Triba et al., 2015).
Fifthly, the authors point out as a quality criterion of the publication the addition of new information to the literature (novelty). Such a statement should be preceded by a retrospective analysis of the literature published up to the time of publication of each article included in the review. It is not productive to disqualify a past scientific paper without considering the available scientific base and accumulated knowledge. Acknowledging limitations and advances provided by previous studies has enabled the development of research in this emerging field of metabolomics and exercise.
Other important points not mentioned by Sakaguchi et al. (2019) deserve some comments, as they may also provide direction for future investigations and contribute to achieving comparable metabolomics results between studies.
• Standardization of participant's preparation prior to collection of biological samples at rest and pre-exercise, since postprandial time, diet composition, and time after the previous training session are likely to affect the metabolome (Daskalaki et al., 2015; Shrestha et al., 2015; Karimpour et al., 2016; Giskeødegård et al., 2019). In this sense, we suggest the collection of biological samples at rest after 10–12 h overnight fasting or 90–120 min after a standardized meal previous to an exercise session, which is expected to present reasonable stabilization of postprandial metabolism (Shrestha et al., 2015; Karimpour et al., 2016; Giskeødegård et al., 2019; Li-Gao et al., 2019).
• Presentation of the reliability of measurements (between and/or intra-experiments) for each metabolite so that the reader may evaluate the true magnitude of intervention effects in relation to measurement errors as demonstrated by few recent studies (Berton et al., 2016; Wang et al., 2018; Castro et al., 2019; Giskeødegård et al., 2019; Li-Gao et al., 2019).
• Presentation of the obtained spectra, when possible, accompanied by the identification of the spectral peaks corresponding to each metabolite found, in order to enable the replicability.
• Individualized exercise prescription, based on physiological thresholds whenever possible, to accurately address the individual metabolic characteristics for a more reliable comparison of metabolic adaptations between and within individuals (Wasserman, 1986; Garber et al., 2011; Riebe et al., 2018; Weatherwax et al., 2019).
Finally, we suggest an open debate among experts in the fields of mass spectrometry, NMR, exercise physiology, and statistics to bring us closer to a consensus on standardization guidelines such as has been undertaken by previous initiatives (Lindon et al., 2005; Beckonert et al., 2007; Sansone et al., 2007; Emwas et al., 2015; Spicer et al., 2017). This broader discussion may be more effective in improving the quality and robustness of further experiments in the emerging field of metabolomics and exercise than the limited qualification of studies already conducted using a score built from unconsolidated criteria.
Author Contributions
AC, RD, AZ, CC, and MC-M have fully reviewed and criticized the original article. AC drafted the first version of the commentary. RD, CC, AZ, and MC-M contributed to the revision and editing of the manuscript for important intellectual content. All authors reviewed and approved the final manuscript.
Funding
This study was supported by the University of Campinas, Campinas, Brazil.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
Antonelli, J., Claggett, B. L., Henglin, M., Kim, A., Ovsak, G., Kim, N., et al. (2019). Statistical workflow for feature selection in human metabolomics data. Metabolites 9:143. doi: 10.3390/metabo9070143
Beckonert, O., Keun, H. C., Ebbels, T. M., Bundy, J., Holmes, E., Lindon, J. C., et al. (2007). Metabolic profiling, metabolomic and metabonomic procedures for NMR spectroscopy of urine, plasma, serum and tissue extracts. Nat. Protoc. 2, 2692–2703. doi: 10.1038/nprot.2007.376
Berton, R., Conceição, M. S., Libardi, C. A., Canevarolo, R. R., Gáspari, A. F., Chacon-Mikahil, M. P., et al. (2016). Metabolic time-course response after resistance exercise: a metabolomics approach. J. Sports Sci. 35, 1211–1218. doi: 10.1080/02640414.2016.1218035
Brennan, A. M., Benson, M., Morningstar, J., Herzig, M., Robbins, J., Gerszten, R. E., et al. (2018). Plasma metabolite profiles in response to chronic exercise. Med. Sci. Sports Exerc. 50, 1480–1486. doi: 10.1249/MSS.0000000000001594
Castro, A., Duft, R. G., Ferreira, M. L. V., Andrade, A. L. L., Gáspari, A. F., Silva, L. M., et al. (2019). Association of skeletal muscle and serum metabolites with maximum power output gains in response to continuous endurance or high-intensity interval training programs: the TIMES study - A randomized controlled trial. PLoS ONE 14:e0212115. doi: 10.1371/journal.pone.0212115
Concato, J., Shah, N., and Horwitz, R. (2000). Randomized, controlled trials, observational studies, and the hierarchy of research designs. N. Engl. J. Med. 342, 1887–1892. doi: 10.1056/NEJM200006223422507
Daskalaki, E., Blackburn, G., Kalna, G., Zhang, T., Anthony, N., and Watson, D. G. (2015). A study of the effects of exercise on the urinary metabolome using normalisation to individual metabolic output. Metabolites 5, 119–139. doi: 10.3390/metabo5010119
Duft, R. G., Castro, A., Bonfante, I. L. P., Brunelli, D. T., Chacon-Mikahil, M. P. T., and Cavaglieri, C. R. (2017). Metabolomics approach in the investigation of metabolic changes in obese men after 24 weeks of combined training. J. Proteome Res. 16, 2151–2159. doi: 10.1021/acs.jproteome.6b00967
Emwas, A. H., Luchinat, C., Turano, P., Tenori, L., Roy, R., Salek, R. M., et al. (2015). Standardizing the experimental conditions for using urine in NMR-based metabolomic studies with a particular focus on diagnostic studies: a review. Metabolomics 11, 872–894. doi: 10.1007/s11306-014-0746-7
Garber, C. E., Blissmer, B., Deschenes, M. R., Franklin, B. A., Lamonte, M. J., Lee, I. M., et al. (2011). American College of Sports Medicine position stand. Quantity and quality of exercise for developing and maintaining cardiorespiratory, musculoskeletal, and neuromotor fitness in apparently healthy adults: guidance for prescribing exercise. Med. Sci. Sports Exerc. 43, 1334–1359. doi: 10.1249/MSS.0b013e318213fefb
Giskeødegård, G. F., Andreassen, T., Bertilsson, H., Tessem, M. B., and Bathen, T. F. (2019). The effect of sampling procedures and day-to-day variations in metabolomics studies of biofluids. Anal. Chim. Acta 1081, 93–102. doi: 10.1016/j.aca.2019.07.026
Glynn, E. L., Piner, L. W., Huffman, K. M., Slentz, C. A., Elliot-Penry, L., AbouAssi, H., et al. (2015). Impact of combined resistance and aerobic exercise training on branched-chain amino acid turnover, glycine metabolism and insulin sensitivity in overweight humans. Diabetologia 58, 2324–2335. doi: 10.1007/s00125-015-3705-6
Huffman, K. M., Koves, T. R., Hubal, M. J., Abouassi, H., Beri, N., Bateman, L. A., et al. (2014). Metabolite signatures of exercise training in human skeletal muscle relate to mitochondrial remodelling and cardiometabolic fitness. Diabetologia 57, 2282–2295. doi: 10.1007/s00125-014-3343-4
Johnson, C. H., Ivanisevic, J., Benton, H. P., and Siuzdak, G. (2015). Bioinformatics: the next frontier of metabolomics. Anal. Chem. 87, 147–156. doi: 10.1021/ac5040693
Karimpour, M., Surowiec, I., Wu, J., Gouveia-Figueira, S., Pinto, R., Trygg, J., et al. (2016). Postprandial metabolomics: a pilot mass spectrometry and NMR study of the human plasma metabolome in response to a challenge meal. Anal. Chim. Acta 908, 121–131. doi: 10.1016/j.aca.2015.12.009
Krzywinski, M., and Altman, N. (2013). Points of significance: power and sample size. Nat. Methods 10, 1139–1140. doi: 10.1038/nmeth.2738
Li-Gao, R., Hughes, D. A., le Cessie, S., de Mutsert, R., den Heijer, M., Rosendaal, F. R., et al. (2019). Assessment of reproducibility and biological variability of fasting and postprandial plasma metabolite concentrations using 1H NMR spectroscopy. PLoS ONE 14:e0218549. doi: 10.1371/journal.pone.0218549
Lindon, J. C., Nicholson, J. K., Holmes, E., Keun, H. C., Craig, A., Pearce, J. T., et al. (2005). Summary recommendations for standardization and reporting of metabolic analyses. Nat. Biotechnol. 23, 833–838. doi: 10.1038/nbt0705-833
Meier, R., Ruttkies, C., Treutler, H., and Neumann, S. (2017). Bioinformatics can boost metabolomics research. J. Biotechnol. 261, 137–141. doi: 10.1016/j.jbiotec.2017.05.018
Ren, S., Hinzman, A. A., Kang, E. L., Szczesniak, V., and Lu, L. J. (2015). Computational and statistical analysis of metabolomics data. Metabolomics 11, 1492–1513. doi: 10.1007/s11306-015-0823-6
Riebe, D., Ehrman, J. K., Liguori, G., and Magal, M. (2018). ACSM's Guidelines for Exercise Testing and Prescription. Philadelphia, PA: Wolters Kluwer.
Sakaguchi, C. A., Nieman, D. C., Signini, E. F., Abreu, R. M., and Catai, A. M. (2019). Metabolomics-based studies assessing exercise-induced alterations of the human metabolome: a systematic review. Metabolites 9:164. doi: 10.3390/metabo9080164
Sansone, S. A., Fan, T., Goodacre, R., Griffin, J. L., Hardy, N. W., Kaddurah-Daouk, R., et al. (2007). The metabolomics standards initiative. Nat. Biotechnol. 25, 846–848. doi: 10.1038/nbt0807-846b
Shrestha, A., Müllner, E., Poutanen, K., Mykkänen, H., and Moazzami, A. A. (2015). Metabolic changes in serum metabolome in response to a meal. Eur. J. Nutr. 56, 671–681. doi: 10.1007/s00394-015-1111-y
Sibbald, B., and Roland, M. (1998). Understanding controlled trials. Why are randomised controlled trials important? BMJ 316:201. doi: 10.1136/bmj.316.7126.201
Spicer, R. A., Salek, R., and Steinbeck, C. (2017). A decade after the metabolomics standards initiative it's time for a revision. Sci. Data 4:170138. doi: 10.1038/sdata.2017.138
Triba, M. N., Le Moyec, L., Amathieu, R., Goossens, C., Bouchemal, N., Nahon, P., et al. (2015). PLS/OPLS models in metabolomics: the impact of permutation of dataset rows on the K-fold cross-validation quality parameters. Mol. Biosyst. 11, 13–19. doi: 10.1039/c4mb00414k
van Iterson, M., 't Hoen, P. A., Pedotti, P., Hooiveld, G. J., den Dunnen, J. T., van Ommen, G. J., et al. (2009). Relative power and sample size analysis on gene expression profiling data. BMC Genomics 10:439. doi: 10.1186/1471-2164-10-439
Wang, Y., Carter, B. D., Gapstur, S. M., McCullough, M. L., Gaudet, M. M., and Stevens, V. L. (2018). Reproducibility of non-fasting plasma metabolomics measurements across processing delays. Metabolomics 14:129. doi: 10.1007/s11306-018-1429-6
Wasserman, K. (1986). The anaerobic threshold: definition, physiological significance and identification. Adv. Cardiol, 35, 1–23.
Weatherwax, R. M., Harris, N. K., Kilding, A. E., and Dalleck, L. C. (2019). Incidence of V?O2max responders to personalized versus standardized exercise prescription. Med. Sci. Sports Exerc. 51, 681–691. doi: 10.1249/MSS.0000000000001842
Westerhuis, J., Hoefsloot, H., Smit, S., Vis, D., Smilde, A., van Velzen, E., et al. (2008). Assessment of PLSDA cross validation. Metabolomics 4, 81–89. doi: 10.1007/s11306-007-0099-6
Keywords: metabolism, metabolomics, exercise, sports, experimental design
Citation: Castro A, Duft RG, Zeri ACM, Cavaglieri CR and Chacon-Mikahil MPT (2020) Commentary: Metabolomics-Based Studies Assessing Exercise-Induced Alterations of the Human Metabolome: A Systematic Review. Front. Physiol. 11:353. doi: 10.3389/fphys.2020.00353
Received: 20 January 2020; Accepted: 26 March 2020;
Published: 22 April 2020.
Edited by:
Henner Hanssen, University of Basel, SwitzerlandReviewed by:
Tobias Madl, Medical University of Graz, AustriaCopyright © 2020 Castro, Duft, Zeri, Cavaglieri and Chacon-Mikahil. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Alex Castro, YXguY2FzdHJvJiN4MDAwNDA7eWFob28uY29tLmJy; Mara Patrícia Traina Chacon-Mikahil, bWFyYXBhdHJpY2lhJiN4MDAwNDA7ZmVmLnVuaWNhbXAuYnI=