AUTHOR=Saccenti Edoardo TITLE=What can go wrong when observations are not independently and identically distributed: A cautionary note on calculating correlations on combined data sets from different experiments or conditions JOURNAL=Frontiers in Systems Biology VOLUME=3 YEAR=2023 URL=https://www.frontiersin.org/journals/systems-biology/articles/10.3389/fsysb.2023.1042156 DOI=10.3389/fsysb.2023.1042156 ISSN=2674-0702 ABSTRACT=

In the scientific literature data analysis results are often presented when samples from different experiments or different conditions, technical replicates or times series are merged to increase the sample size before calculating the correlation coefficient. This way of proceeding violates two basic assumptions underlying the use of the correlation coefficient: sampling from one population and independence of the observations (independence of errors). Since correlations are used to measure and infer associations between biological entities, this has tremendous implications on the reliability of scientific results, as the violation of these assumption leads to wrong and biased results. In this technical note, I review some basic properties of the Pearson’s correlation coefficient and illustrate some exemplary problems with simulated and experimental data, taking a didactic approach with the use of supporting graphical examples.