Integrative OMICS Data-Driven Procedure Using a Derivatized Meta-Analysis Approach

The wealth of high-throughput data has opened up new opportunities to analyze and describe biological processes at higher resolution, ultimately leading to a significant acceleration of scientific output using high-throughput data from the different omics layers and the generation of databases to store and report raw datasets. The great variability among the techniques and the heterogeneous methodologies used to produce this data have placed meta-analysis methods as one of the approaches of choice to correlate the resultant large-scale datasets from different research groups. Through multi-study meta-analyses, it is possible to generate results with greater statistical power compared to individual analyses. Gene signatures, biomarkers and pathways that provide new insights of a phenotype of interest have been identified by the analysis of large-scale datasets in several fields of science. However, despite all the efforts, a standardized regulation to report large-scale data and to identify the molecular targets and signaling networks is still lacking. Integrative analyses have also been introduced as complementation and augmentation for meta-analysis methodologies to generate novel hypotheses. Currently, there is no universal method established and the different methods available follow different purposes. Herein we describe a new unifying, scalable and straightforward methodology to meta-analyze different omics outputs, but also to integrate the significant outcomes into novel pathways describing biological processes of interest. The significance of using proper molecular identifiers is highlighted as well as the potential to further correlate molecules from different regulatory levels. To show the methodology’s potential, a set of transcriptomic datasets are meta-analyzed as an example.

1 Introduction

Traditional data analytical approaches focus on hypothesis-driven methods to understand specific and known molecular targets. Alternatively, data-driven approaches are based on high-throughput methodologies that provide un-biased genome-wide analysis of multiple omics variables which mirrors the different layers of biological regulation of a system. Undoubtedly, knowledge generated by traditional approaches through the years is essential to contextualize and properly analyze high-throughput data (McDermott et al., 2013; Guan et al., 2020). Ultimately, data-driven approaches aim to provide a number of potential hypotheses that feed into the traditional approach cycle in order to be validated or refuted (Fernandes and Husi 2019).

Nowadays, the surge of studies based on high-throughput data analysis has led to an expansion of public repositories (i.e., GEO, ArrayExpress) that store and provide access to these data for further analyses (Clough and Barrett 2016; Athar et al., 2019). As a consequence, big data production and availability have provided novel venues/opportunities for data interpretation, data integration, statistical analysis, and therefore new hypotheses that might reveal new inferences and provide a higher molecular resolution of a determined phenotype or disease. Nevertheless, the lack of a unified system to publish the different omics data generated and to report, curate and consolidate all the different identifiers available remains a challenge (Durinck et al., 2005; McGarvey et al., 2019). Unique outcomes generated from the different high-throughput technologies and the lack of standardized approaches to analyze, integrate and interpret these heterogeneous and often incompatible data have led to the emergence of different analytic methodologies that focus on varying ways of data-interpretation.

Meta-analytic methodologies have been commonly followed in data science to collate and identify commonalities across different studies, and to rule out inconsistencies commonly found in published literature (Waldron and Riester 2016; Vennou et al., 2020). The statistical basis of these methodologies provides valuable results and gives strength to the variables that reflect an association and consistency across studies. These methodologies are based on the fact that even amongst heterogeneous studies, associations can be made. Thus, meta-analysis can lead to the identification of robust and quantifiable variables shared across studies published by different groups–despite inherent differences in such cohorts–generated through different platforms and techniques that could have been otherwise overlooked (Care et al., 2015; Cho et al., 2016; Piras et al., 2019; Winter et al., 2019). In the big-data field, the exponential growth of high-throughput data availability has highlighted the advantage to follow meta-analysis methodologies in order to increase the statistical power of the outcomes and make sense out of the great amount of data shared within the scientific community (Xia et al., 2013; Kim et al., 2017; Forero 2019; Jaiswal et al., 2020; Vennou et al., 2020).

The generation and analysis of high-throughput data are commonly focused on a single biological parameter (e.g., transcripts, proteins, or metabolites) and represent only a snapshot of what is happening in a specific molecular process. Due to the high density of available studies, several meta-analytic approaches have been developed and standardized to integrate transcriptomic data. Effect size (t-statistic combination), rank-ratio (fold-change ratio combination), Fisher’s (p-value combination), and vote-counting (VCS–number of reporting studies) are some of the common methods followed to perform a meta-analysis on these samples (Rikke et al., 2015; Goveia et al., 2016; Forero 2019; Shafi et al., 2019; Toro-Domínguez et al., 2020). Among the many promising applications of these approaches two stand out; namely, biomarker discovery and signaling pathway identification. The premise that biomarkers identified with computational approaches from a single high-throughput study exhibit little overlap with other studies indicates that these might represent false positives and cannot be fully trusted. Thus, meta-analyses have been long-performed with the goal to discover novel and robust biomarkers, distinguishable and consistent patterns of disease-associated deregulated genes. Statistically significant deregulated genes have been associated with several cancers and other diseases through the application of different meta-analytic approaches (Fishel et al., 2007; Xu et al., 2009; Huan et al., 2015; Cho et al., 2016; Bell et al., 2017; Piras et al., 2019; Su et al., 2019). Pathway analyses have also dominated the meta-analysis studies aiming to highlight the main deregulated processes to some extent (Kröger et al., 2016; Wang et al., 2017; Badr and Häcker 2019).

Nevertheless, due to the dynamicity of biological systems and the known crosstalk among the multiple layers of biological regulation, the orchestrated analysis of the different omics levels remains essential. Thus, the study of deregulated pathways and the implementation of integrative systems biology approaches seems logical and sought after techniques (Auffray et al., 2010; Norris et al., 2017; Parker et al., 2019; Shafi et al., 2019; Myall et al., 2021). These approaches have been highlighted by their potential to better understand the complex, albeit inevitable, interactions among different omics data. Ultimately, systems analysis aims to elucidate the regulation of pathways that might underpin cause and effect factors and improve the understanding of systems behavior by providing more accurate models of a determined condition of interest.

Although integrative systems biology approaches have been applied to individual studies by performing a variety of high-throughput omics approaches and analyzing multiple layers of gene regulation data (genetic variants, RNA transcripts, DNA methylation profiles, protein concentrations, chromatin marks) (Boeing et al., 2016; Saha et al., 2018; Xicota et al., 2019; Mair et al., 2020), the possibility to sum-up and analyze publicly available data generated by different scientific groups from individual omics approaches through multi-study meta-analyses may not only increase the statistical power of the outcomes but enhance and complement the biological knowledge through the re-analysis and integration of large-scale data; thereby highlighting significant but previously undetectable molecular links.

Various methodologies are available to pursue systems biology analyses, each of which follows different strategies, with associated limitations and outcomes (Table 1) (Xia et al., 2013; Rohart et al., 2017; Argelaguet et al., 2018; Forero 2019; Singh et al., 2019; Winter et al., 2019; Zhou et al., 2019; Pang et al., 2020; Toro-Domínguez et al., 2020; Yang 2020; Zhou et al., 2020). Here we aim to describe the Harmonized Holistic (HH) meta method, a simplistic, flexible, adjustable, and scalable methodology (limited only by the availability of omics data) that can go from single omics to multi-omics analyses (Figure 1). Our methodology is not based on a computational approach, it is a meta-analysis based on case and control comparisons of pre-processed data per study. The basis of the data to perform integrative approaches is of importance, and there is where this meta-analysis approach gears towards allowing heterogeneous omics data integration. It can integrate unmatched mRNA, miRNA, DNA methylation profiles, protein, metabolites information from independent studies that meet the inclusion criteria of a specific research question. By considering the commonalities of the differentially expressed molecules across studies, the HHmeta method circumvents the variable depth of data produced by different measurement technologies (i.e., Microarray, RNAseq), as well as by high and low-throughput studies. This approach provides a ranking system that goes beyond the p-value and log2-Fold Change significance filtering, by defining the molecules with a significant and consistent trend in regulation among the different studies analyzed. Ultimately, this approach leads to the identification of pathways that can be fed and confirmed with the different omics data analyzed, which validates the outcomes and increase the significance of the identified targets (see Graphical Abstract in Supplementary Presentation S1).

TABLE 1

TABLE 1. Comparison of available integrative systems biology methodologies.

FIGURE 1

FIGURE 1. Flowchart comparing conventional (left) vs. our proposed (right) meta-analytic approach. Blue box represents similarities between approaches. Dashed line highlights the main differences between approaches.

We have previously explored our methodology in several iterations and proved its potential in a variety of disease settings (Fernandes and Husi 2016; Cervantes-Gracia and Husi 2018; Fernandes et al., 2018), however the ranking system was not properly established. Here, we 1) consolidate the final optimized pipeline and 2) apply this framework to 6 DLBCL (Diffuse Large B Cell Lymphoma) datasets (DS) from different studies and sources (tumoral tissue vs. b-cells). We aimed to identify the DS that indeed showed a potential correlation to further identify altered pathways coming only from B-cell deregulation (Cervantes-Gracia et al., 2021; Sheppard et al., 2018). The identified pathways represent the common deregulated processes found within the different DS included in the downstream analysis and delimit their significance by the outlined trend of the pathway identified. The outlined pathways can be further fed with different omics data by complementing with the variables that correlate with the outcomes from the different omics levels. This analysis shows the potential of the presented methodology to not only identify potential biomarkers but also deregulated processes with a notable trend providing data-driven hypotheses that have either already been validated or that better yet have not been associated with the disease and need further validation.

2 Materials and Methods

The cornerstone of this methodology is for each group of interest to be compared to their most appropriate controls. Hence, the integration of large-scale DS from a variety of publications relies on keeping the study groups per publication intact. Thus, the basis of the methodology is set on statistically significant molecules and their ratio-metric values (e.g., log-fold change) per comparison, identifiers curation through a unifier database, data-format and structure, outlier detection, as well as group re-stratification. This methodology has been previously performed manually (Cervantes-Gracia and Husi 2018). The aim of this work is to describe and summarize the whole procedure into a formula that statistically ranks and explains the significance of the molecules included in the biomarker list. Here, both the manual approach and the frequency score (FS) index are presented.

The particular molecules under study (e.g., miRs, mRNA, proteins) are individually processed and meta-analyzed before the multi-omics integration and analysis is performed. In this methodology, each molecular type has its own comparison matrix where the large-scale studies are merged. Thus, every individual DS comparison (case vs. control) has the main molecules included in the analysis facing each other. The output of the HHmeta method is divided on biomarker identification and functional analysis. The methodology outline is divided into four main sections: Data collection, Data correlation and structure, Grouping and Biomarker discovery and Data integration and Functional analysis.

2.1 Data Collection

High-throughput DS from publications can be collected from public repositories such as GEO NCBI, ExpressionAtlas and ArrayExpress from EMBL-EBI databases for raw and processed omics data and SRA for raw sequencing data. Specialized databases exist for the different omics data. PRIDE, Peptide Atlas, ProteomicsDB, GPMDB, JPOST repository, MassIVE, PAXDB for proteomics, MetaboLights, MetabolomeExpress, MetabolomicsWorkbench, GNPS for metabolomics and EGA, EVA for genomics are examples of available omics databases (Carroll et al., 2010; Deutsch 2010; Coutant et al., 2012; Wang et al., 2012; Vizcaíno et al., 2013; Fenyö and Beavis 2015; Lappalainen et al., 2015; Kale et al., 2016; Sud et al., 2016; Wang et al., 2016; Wang et al., 2018; Samaras et al., 2020; Watanabe et al., 2021). Platforms like Omics discovery index (OmicsDI) exist, where biological and technical metadata from public omics datasets are stored and standardized through an indexing system to enable access, discovery and broadcasting of omics datasets (Perez-Riverol et al., 2017). In terms of cancer databases TCGA, COSMIC, OCCPR and ICGC are distinguished high-throughput data repositories. Data can also be collected directly from the literature. The DS collected can be derived from entirely unmatched sources (e.g., DNA, RNA, protein), different platforms (e.g., Microarray, RNAseq), and samples (e.g., tissue, blood, urine).

Here, the example shows the analysis of DLBCL and the potential to correlate and find the common and significant molecules and deregulated mechanisms across expression profiles from tumoral vs healthy samples. The following DS (gene expression profiles) were retrieved from GEO (NCBI) database (Clough and Barrett 2016): GSE9327 (tumoral tissue vs healthy tissue; CNIO Human Oncochip), GSE32018 (tumoral tissue vs. healthy tissue; Agilent), GSE56315 (tumoral tissue vs. healthy B-cells; Affymetrix), GSE12195 (tumoral tissue vs. healthy B-cells; Affymetrix), GSE2350 (tumoral B-cells vs. healthy B-cells; Affymetrix), GSE12453 (tumoral B-cells vs. healthy B-cells; Affymetrix).

2.2 Data Correlation and Structure

This module comprises three steps: DS group comparison, Data ID harmonization, and Data Merging within and across DS comparisons.

2.2.1 Datasets Group Comparison

This step represents the first statistical evaluation embedded within this methodology. Here we rely on pre-processed and normalized available DS; raw data can also be considered. Raw samples need to be normalized individually to be further statistically assessed and generate ratio-metric values. Differential expression analysis of the GEO DS collected are performed through GEO2R, a web-based tool that includes GEO Query and Limma Bioconductor packages and performs multiple-testing correction through Benjamini–Hochberg false discovery rate method as a default (Benjamini and Hochberg 1995; Gentleman et al., 2004; Smyth 2004; Sean and Meltzer 2007). Data collected directly from the literature already provides ratio-metric values to integrate into the correlation matrix.

2.2.2 Data ID Harmonization

Given that different experimental platforms (e.g., different microarray technologies, RNAseq) and functional analysis tools usually produce and require unique identifiers, there is a need for standard names for each type of molecule (e.g., transcript, protein) under study. In order to be able to correlate the ratio-metric values of the molecules shared across every DS comparison included, and reduce data redundancy within studies, the DS needs to be mapped to a common identifier (e.g., Uniprot or PADB identifiers). Furthermore, a unifier that consolidates the different accession numbers and identifiers can be of great assistance. The PADB database was established by H. Husi (Husi 2004) as a unifier database for molecular data and it has been the reference database for several of our studies (available by request). PADB has been continuously curated and updated over the last 20 years. It contains old and recent identifiers from multiple databases and platforms that have been assigned to the molecules through time. This database clusters identifiers from a variety of databases and platforms (Ensemble, Genenames, RefSeq, Uniprot, Swissprot, Agilent, Affymetrix, Illumina, and others), and provides a unique unifier ID that maps the molecules to all these reliable identifiers, allowing further data merging and analysis through a variety of tools. Uniprot database and BioMart also offer the option to retrieve alternative identifiers (e.g., Ensemble, Genenames) for molecules of interest or by downloading the complete file to index by any cross-indexing tool (Smedley et al., 2009; Consortium et al., 2021).

To cross-index and further merging of accession numbers, the in-house software AWASH was used. It is a text manipulation software that performs data cleaning and merging by using either a single file or multiple files, the latter based on a parent file as a reference for further indexing on dependent files. To perform the indexing, a Master file (containing the identifiers from the common database chosen and the accession number of the DS in question) and a Child file (different files for each DS comparison containing all accession numbers, statistics, and ratio-metric values) are needed. The input files should be in Tab- Separated Values (TSV) format. After indexing, each Child file accession number will be associated with a common unifier ID and alternative identifiers.

2.2.3 Data Merging Within and Across Datasets Comparisons

Often within large-scale DS, there is more than one probe-set and values for the same molecule. Thus, the significant (e.g., FDR/p-value) and ratio-metric (e.g., Fold change) values from molecules with the same unifier ID can be either merged or one can keep only the probe-sets that have the most significant values, as long as the same method is followed for each DS comparison merging. Every DS comparison should only contain one ID for each of the molecules within it. AWASH software can be used for this purpose based on the common unifier IDs and a Masterfile containing each of the DS comparisons.

Once all cleaned, all the DS comparisons from the same molecular type are merged into a matrix based on a list of unifiers reported among all the DS comparisons. The identifiers from all DS comparisons would follow the same order. Thus, the same molecule would be facing each other across the different DS comparisons, a fitting format for further analysis. In the manual approach we only focused on the molecules below a p-value of 0.05 for all the DS comparisons included independently of their ratio-metric value. However, when calculating the FS index score, since it takes care of the filtering, there is no need of applying cut-off at this step. In case of a statistically poor dataset, where adjusted p-values were greater than 0.05, the unadjusted values should be used.

2.3 Grouping and Biomarker Discovery

Dimensionality reduction facilitates analysis and visualization of high-throughput data. This methodology relies on principal component analysis (PCA) to cluster and interpret large-scale DS comparisons. This step represents the 2nd statistical evaluation within this approach. PCA plots allow the identification of outliers, but most importantly it provides a confirmation of the DS comparisons that group together and can be further integrated to perform further analyses. The latter will reduce bias and act as batch effects removal. In order to avoid gaps in the data-matrix and misleading clustering, this analysis should only include and compare the expression-level differences of the molecules analyzed and shared among all DS comparisons.

The 3rd statistical evaluation is founded on pattern matching and centroid clustering to obtain the biomarker list. In the manual approach, DS statistical pattern recognition is based on correlation analysis to generate the biomarker list. Here, unique thresholds (TH) are applied to each DS comparison (THs might vary across DS) depending on the number of their deregulated molecules (where more than 10% of deregulated molecules can give a hint of something off being compared within a DS). Only molecules with significant p-values and log 2 fold-change (FC) (above 1 or 2 depending on the DS comparison) are included. A master molecule list (MML) is created containing all the significant molecules reported within THs per DS comparison without repetitions. The MML is used to merge all DS as described above to perform cross-correlation analysis and obtain the biomarker list.

To calculate an accurate frequency distribution manually per molecule, the trend in regulation is determined, taking into account the total count per molecule (TPM), to avoid bias. The regulation trend is described as “Up” or “Down”; molecules reported equally “Up” or “Down” regulated (i.e., 50% up and 50% down regulated) among the DS comparisons are removed. TPM represents the number of times a molecule is analyzed across all the DS comparisons included in the data-matrix. The latter highlights the point that every platform might have different molecular depth, thus, if a molecule is not analyzed in one platform it doesn’t mean it is not significant. Consequently, a biomarker list is created and can already be validated. This list is the core of the next functional analysis.

Regarding the FS index, it was developed to generate the former biomarker list from all values across all DS comparisons, without the need of applying individual TH (see below). The FS index is simply based on the log₂FC trend per molecule and whether these are significant or not. The formula is as follows:

$FS=\frac{\left|{\displaystyle \sum \left(up\right)}-{\displaystyle \sum \left(down\right)}\right|}{{\displaystyle \sum \left(up\right)}+{\displaystyle \sum \left(down\right)}} \times \frac{{\displaystyle \sum \left(significant\right)}}{{\displaystyle \sum \left(all\right)}}$

From all the DS comparisons, the absolute value of the sum of DS comparisons with up-regulated values (log₂FC > 1) is subtracted from the number of DS comparisons with down-regulation (log₂FC < -1) and divided by the sum of the number of times a molecule was up and down regulated (log₂FC > 1 and <−1). This value is then multiplied by the value obtained from the sum of the number of DS comparisons that have significant values (adjusted p-value <0.05) divided by all the DS comparisons that have the specific molecule in question analyzed.

Additionally, the FS index includes an adjusted p-value and log2FC calculation. Here, the basis of the approach is centroiding clustering and it applies to all molecules individually. Molecules with p-values and FCs for all the included DS can have significant or non-significant values. To visualize the distribution of the data, molecule sets −log (10) of the p-values and the log (2) of the FCs can be plotted to get a Volcano plot (Figure 2). Here, centroiding clustering brings a logical solution to fuse the data, with the center being the optimal geometric location that minimizes the distance to all datapoints. In an ideal situation the graph (Figure 2A) would have a small group of datapoints close to each other for a given molecule (similar p-values and similar FCs). The center-value will then provide a new p-value and FC value. To obtain the adjusted p-value its easier than the adjusted log₂FC value, since it does not have directionality; in this case an arithmetic mean is calculated from the −log10 p-values to obtain the adjusted p-value, since the non-transformed p-values are too small and here a TH does not apply, therefore significant and non-significant p-values are included and averaging these can introduce bias. Regarding the adjusted log2FC, a common mean calculation might give a biased result due to the possible large values with opposing trends that the different DS comparisons can have (Figure 2B). There are still several options one can follow, such as geometric weighted means, where a specific value is added to each log2FC, e.g., sample size; trimmed means where extreme values (outliers) are left out, and the mean is calculated from the values that remain (Lawson et al., 2012; Miao and Jiang 2014; Li X. et al., 2015). However, in this example and regarding the FS index calculation, only where >50% of the molecules follow the same trend (up or down regulation) with values above or below 0 molecule value were averaged, the rest of the molecules were excluded.

FIGURE 2

FIGURE 2. Theoretical and Real centroiding clustering example visualized in a Volcano plot. (A) A and B represent 2 different molecules. Red and gray circles represent molecule A distribution from the different dataset (DS) comparisons. The majority of molecule A values cluster regarding regulation, log2FC, and p-values (Red circles). Gray circles represent molecule A with non-significant p-values. Green and Red triangles represent molecule B distribution. All molecule B values are significant and cluster regarding regulation, log2FC, and p-values (Red triangles) but two DS comparisons (Green triangles). (B) B1629 and B8816 are real molecules within the DS matrix and represents an example of the distribution of 2 molecules from the biomarker list obtained through the FS index.

These data, plus the calculated FS index value, upgrade the score system and allow us to rank the molecules from the most to the least significant based on: total significance, trend (up/down-regulation), number of times a molecule was analysed and present an either up or down-regulation, adjusted p-value and adjusted log2FC, which sums up into the FS index score. The higher the score, the more significant a molecule is.

2.4 Data Integration and Functional Analysis

Despite the biomarker list potential to lead to new insights about the disease in question, the contextualization of these molecules can be even more informative. In this section of the approach, the integration of the biomarker list through enrichment analysis is performed. Functional analysis through Cytoscape plug-ins ClueGO/CluePedia performs semantic clustering by assigning gene ontologies and/or pathway terms (KEGG, Wikipathways, Reactome) to the biomarker list, integrates them into functional networks and ties-in the molecules associated with each of the terms on the networks generated (Shannon et al., 2003; Bindea et al., 2009; Bindea et al., 2013).

This analysis will highlight the main deregulated processes that will be the center for further analyses. The biomarker list contains molecules with different frequencies and FS index scores, and results from the merging of the different DS comparisons. Several TH are applied to the biomarker list to determine the main deregulated pathways within it. The THs go from the most to the least significant and frequent molecules within the biomarker list. The TH end cut-off goes to a level where the processes identified through the analysis of the most frequent molecules are not lost but enriched and interconnected by the molecules from the different THs applied.

In order to visualize and underlie the main processes previously identified, pathway mapping is performed. It helps unravel the regulation and involvement of the molecules by placing them within their described position in the pathway of interest. This allows the accurate identification of deregulated processes by showing specific trends through the molecular interplay, hence the identification of key players involved in the pathophysiology of a disease. Pathvisio is a pathway-map editor of described and pre-assembled pathway maps (KEGG, Wikipathways, Reactome), it is a fine tool for integrative analysis since it handles gene, protein, and metabolite data and allows cross-mapping and integration through Bridgedb (van Iersel et al., 2010; Kutmon et al., 2015). The pre-assembled pathway maps will function as the sketch to base on to get novel pathway maps reflecting their regulation in the setting of interest. The pathways to be filled-in, edited, and integrated are the ones identified by ClueGO/CluePedia analysis. First, the molecules from the biomarker list are mapped into their specific position within these pathways to help keep the focus. Afterwards, irrespective of their logFC, all the molecules from the first data merging with a significant p-value are mapped as well in order to fill the gaps within the pathway map of interest and be able to identify trends in regulation.

To enrich and complement the processes of interest identified through Pathvisio, interactome analyses are performed on the biomarker list molecules. GeneMANIA (Multiple Association Network Integration Algorithm) generates networks that resemble molecular interactions classified into gene-protein interaction, co-expression, and localization, shared protein domains, and pathways (Warde-Farley et al., 2010). It provides the connections of the biomarker list molecules and predicts molecules associated with the input.

In addition, disease analysis to explore the former outcomes and their accurate association with the specific disease of interest is performed. Through DisGeNET, reported gene-disease associations from the biomarker list are identified (Piñero et al., 2015; Piñero et al., 2020). This step functions as validation by detecting the genes that have already been reported in the disease under study. DisGeNET also provides genes with gene-disease-association (GDA) scores, and the ones with a higher score can be used to enrich the pathway model by identifying their associations with the biomarker list molecules and thus, provide an extra focus on the pathways where these molecules play a role.

De novo pathway contextualization is produced by the integration of all the different results previously obtained. Since transcriptomic studies populate the databases and literature, these are the backbone of the methodology. When analyzing different molecular types, each OMIC layer validate and reinforce the focus on the deregulated mechanisms identified through transcriptomics analysis. miRNAs (miRs) and metabolites do not align with gene/proteins but can also be integrated into the developed model. In this case, cross-mapping can be carried out through “mode of action” by using either their targeted genes as a substitute ID (miR) or how they are produced (metabolites) using the associated enzyme to tie them into other OMICS data. By using the common unifier, it allows their correlation and mapping into the de novo pathway model described. CluePedia and MetaboAnalyst web-tools can serve this purpose by enriching miRs and metabolites respectively (Pang et al., 2020). In this example, only transcriptomics data is included.

3 Results

3.1 DLBCL Dataets Comparisons Correlation and Grouping

A total of 6 DLBCL gene expression profiles from human samples were identified through GEO, correlated, and meta-analyzed through the HHmeta method. From 6 GEO DS we ended up with 10 comparisons: GSE9327–1. DLBCL vs Healthy tissue; GSE32018–2. DLBCL vs. Healthy tissue; GSE56315–3. Plasmablast DLBCL vs. Plasmablast Healthy B-cell, 4. Centroblast DLBCL vs. Centroblast Healthy B-cell, 5. Centrocyte DLBCL vs. Centrocyte Healthy B-cell, 6. DLBCL vs. Healthy B-cells; GSE12195–7. DLBCL vs. Healthy B-cells; GSE2350–8. DLBCL vs. Healthy B-cells; 9. DLBCL CD19 B-cells vs. Healthy B-cells; GSE12453–10. DLBCL B-cells vs. Healthy B-cells. All molecules from the DS comparisons were mapped and indexed to PADB unifier ID. Only molecules/probe-sets with the most significant p-values were kept among the repeats found within each DS comparison. For the manual approach, DS comparisons were filtered by p-value (<0.05), regardless of their logFC value, and merged. When following the HHmeta method, no filtering is needed at this stage.

Dimensionality reduction through PCA clustered 2 groups and identified a potential outlier (Figure 3A). DS 1, 2, 8, 9, and 10 (Group 1) and DS 3, 4, 5, and 6 (Group 2) were clustered together. Group 1 is composed of comparisons across healthy and tumoral tissue (DS 1 and 2), as well as healthy and tumoral B-cells (DS 9 and 10), however DS 8 compares both healthy B cells vs DLBCL tumoral tissue and also groups within this cluster. Group 2 contains 1 solely GEO DS (GSE56315) that is composed mainly by comparisons among specific tumoral tissue DLBCL subtypes and their matching healthy B-cell type, as well as the comparison of all of them together plus some unclassified DLBCLs and the complete population of healthy B-cells. Group 2 samples belong to patients under either CHOP or R-CHOP therapy. The highlighted outlier, DS 7 is composed of DLBCL tissue samples and healthy tonsillar germinal center, naive and memory B cells.

FIGURE 3

FIGURE 3. PCA plot grouping and ClueGO/CluePedia focus of our DLBCL cohorts. (A) Blue dots: Group 1; Orange dots: Group 2; White dots: Outliers. (B) ClueGO/CluePedia network created from the Manual approach biomarker list (66% threshold). (C) ClueGO/CluePedia network created from the FS index Biomarker list (0.75 Absolute FS index threshold).

3.2 Biomarker List and ClueGO/CluePedia Functional Analysis

Once grouped, the following analysis focused only on group 1. For the manual procedure, p-value cut-off (<0.05) from the previous filtering was kept and log2FC cut-offs (>1 and <−1) were applied to each DS comparison. When applying the HHmeta method FS index formula (see above), no threshold is needed. Data merging allowed the comparison and consolidation of molecular regulation based on their frequency distribution. The resultant biomarker list from the manual procedure contains a total of 3,241 significant molecules, and from the FS index calculation, a total of 1,638 significant molecule (Supplementary Table S1). Table 2 represents the top up and down-regulated molecules from both biomarker lists group 1.

TABLE 2

TABLE 2. Top deregulated molecules obtained with the Manual approach and FS Index calculation.

Through DisGENET one can already search for validation of genes associated with the condition in question within the biomarker list generated or target genes obtained from the functional analysis. In this example biomarker list genes with a FS index equal to 1 (439 genes) were input into DisGENET. As shown in Table 3, some have already been reported as related to DLBCL, either as e.g., biomarker, altered expression or genetic variants. DLBCL is a highly heterogeneous disease, thus it is important to bear in mind that in this example we didn’t segregate DLBCL by type (e.g., GCB, ABC), mainly because it was not specified in every dataset included. Therefore, the outcome of this analysis would mirror the core shared mechanisms among the DLBCLs analyzed in each of the different studies included in the meta-analysis of group 1. Also, within the genes found to be associated with DLBCL from the biomarker list, these might have been significantly deregulated in only one dataset because it was the only one analyzing this molecule, however this doesn’t rule out its importance since these can still interact with the main pathways further identified. For instance, genes involved in NF-kappa B pathway and TNF signaling, such as overexpression of BCL2 regulator of mitochondrial apoptotic pathway (Tsuyama et al., 2017), BCL6 proto-oncogene, essential for GC development and FBXO11 a tumor-suppressor gene that stabilizes BCL6, have already been related with DLBCL accelerated development and poor prognosis (Saito et al., 2007; Duan et al., 2012; Zhang et al., 2015). These, plus the rest of molecules covered by DisGENET provide validation of the molecular list we relied on for further functional analysis, and the meta-analysis itself.

TABLE 3

TABLE 3. Top genes associated with DLBCL through DisGENET.

Besides the already described molecules in the DLBCL setting, the biomarker list contains molecules that have not been related with the disease yet. As an example, one of the main deregulated genes with a higher frequency distribution score is TSPYL5, which was found with a downregulation trend in 4 out of the 5 DS comparisons included in group 1. TSPYL5 has been attributed a tumor-suppressive function, and its hypermethylation has been previously linked with several cancers (Kim et al., 2010; Fan et al., 2020; Huang et al., 2020). TSPYL5 suppression has been associated with PTEN overexpression and AKT pathway inhibition (Vachani et al., 2007; Jung et al., 2008; Kim et al., 2010; Fan et al., 2020). Interestingly, TSPYL5 inhibition has been attributed to overexpression of miR-483–5p and miR-629. In prostate cancer it’s been recently proven that miR-483–5p antagonization through the long non-coding RNA LINC00908 lead to an upregulation of TSPYL5, inhibiting prostate cancer progression (Fan et al., 2020). miR-629 overexpression has also shown the ability to promote proliferation, migration and invasion in ovarian cancer by directly inhibiting TSPYL5 (Shao et al., 2017). Although a specific role in DLBCL has not being described yet, these results open a potential novel regulation of carcinogenesis in this setting. ATP10D is also within the genes with a higher FS index score. Although its association with DLBCL hasn’t been described yet, its downregulation has been significantly correlated with poor non-small cell lung cancer survival (Fusco et al., 2018). It belongs to a subfamily of P-type ATPases that play a role in phospholipids translocation, and its being specially associated with sphingolipids and ceramid plasma levels (Hicks et al., 2009). Sphingosine-1-phosphate (S1P) sphingolipids are considered signaling molecules involved in activation of carcinogenesis pathways and have been previously linked to increase lung cancer risk (Furuya et al., 2011; Alberg et al., 2013). These are interesting hypothesis that haven’t been explored yet that by following our unbiased method could be highlighted. Examples like these can already be validated, adding to the main DLBCL pathway mechanisms.

3.3 ClueGO/CluePedia Functional Analysis

To distinguish the association amongst the biomarker list molecules and determine their shared pathways and processes, ClueGO/CluePedia analyses were performed (Figures 3B–C). The main processes showing interconnectivity between the molecules from the biomarker list of both, the manual approach and FS index score were MAPK, PI3K, TNF, Ras and B-cell signaling pathways, cytokine-cytokine receptor interaction and chemokine signaling pathways, among others. These pathways show high interconnectivity and potential involvement of MMP9, STAT1, TNFRSF1A, NFKBIA, EFNA4, CCL5, RAP1B. Networks in Figures 3B,C are similar, even though the HHmeta method does not follow thresholds and has an extra layer of significance raking through the FS index score calculation. However, since the most significant molecules were shared among the biomarkerlists generated through the manual approach and the HHmeta method, the main deregulated processes remain.

All the main pathways highlighted through this analysis are somehow related with pro-survival signaling, and have been previously associated with DLBCL pathology, as well as with the heavy involvement and crucial role of the tumor microenvironment. Pro-survival effects via PI3K-AKT signaling pathway, Ras signaling pathway (Eric Davis et al., 2001; Davis et al., 2010; Miao et al., 2019), partly B-cell receptor signaling pathway and cytokine induction have been long correlated with DLBCL. TNF signaling pathway is known to be indispensable for survival of transformed B-cells. TNF-signaling pathway regulates NF-kappa B pathway and MAPK signaling pathway, which was also determined as significant in DLBCL (Webster and Vucic 2020).

3.4 Pathvisio Pathway Editing and Complementation

The main pathways determined by ClueGo/CluePedia are now involved in the following iteration step, which entails pathway overrepresentation analysis and visualization in Pathvisio. Pathways identified through ClueGO were displayed within the significant pathways determined by Pathvisio. In order to determine consistencies, inconsistencies, interconnected events, and fill the gaps within the signaling pathways visualized, the complete list of molecules with a significant p-value is used as an input. In this case, a total of 5,146 molecules from the FS index were analyzed. For instance, the total amount of molecules obtained from the FS index might differ from the ones of the manual approach. This because for the adjusted log2FC calculation, the FS index only takes molecules determined as up or down regulated for averaging (see section 2.3), leaving out some molecules with mixed values. The manual approach is more bias, where the arithmetic mean is calculated from all molecules with a significant p-value, without prior filtering.

Once mapped, inconsistencies in the trend from sections or complete signaling events were removed from the original pathway maps. The complete pathway can be visualized in the Supplementary Figure S1. The original pathway maps from WikiPathways were redesigned to accurately contextualize the role and interplay of the molecules in DLBCL B-cells. Here, only a section of the assembled pathway is shown in Figure 4. From this signaling map, a prominent up-regulation of most of the elements involved can be seen. Chemokines, cytokines, and interleukin signaling demonstrate their involvement in the NF-KB and JAK-STAT pathway activation and therefore cell survival and proliferation. Several factors either display an opposite regulation or are absent within the biomarker list generated. However, the consistency along the pathway outline reflects an involvement of these processes in this B-cell malignancy. Feedback loops such as the one established by IL6, as well as regulators, such as PIAS, SOCS, and PTPN6 can already be spotted and represent potential hits to focus on further (Figure 5B).

FIGURE 4

FIGURE 4. PathVisio edited pathway of the obtained biomarker list. NFKB and JAK/STAT section of the complete pathway map from Supplementary Figure S1. This section of a pathway contextualizes and represents the up-regulation trend of the molecules included in the map. Molecules with an adjusted p-value <0.05 from the FS index score calculation were included.

FIGURE 5

FIGURE 5. GeneMANIA focus and Pathvisio de novo pathway contextualization. (A) GeneMANIA results for STAT3; interactor molecules can either represent physical interaction (red), co-expression (purple), genetic interaction (green), shared protein domain (yellow). (B) Pathvisio NFKB and JAK/STAT signaling pathway section with added elements from GeneMANIA highlighted in purple; STAT3 analyzed gene highlighted in yellow box, blue boxes represent feedback loops. analyzed gene highlighted in yellow box, blue boxes represent feedback loops.

GeneMANIA analysis can enrich the pathway maps from PathVisio. Several angles can be considered to add to the main hypothesis, for example, the top molecules from the biomarker list, the associated and clustered molecules obtained from ClueGO/CluePedia analysis, or the molecules of interest within the edited PathVisio pathway. Here, STAT3 was taken as an example to complement the pathway of interest, due to its downstream effects and the potential regulation of its activity. Figure 5. A. shows GeneMANIA results. Several molecules that were not included in the pathway map make an appearance. The connected molecules can either represent genomic interaction, shared protein domain, shared pathway, co-expression, co-localization, among other interactions. The additional interactors of STAT3 identified through GeneMANIA, such as NFKBIZ, EGFR, PTK6, and STAP2, complement the previous pathway, and the trend in consistency remains (Figure 5B). Here, one can hypothesize that the tumor microenvironment, such as T-cells, promote the chemokine/cytokine signaling in B-cells and lead to pro-inflammation, cellular proliferation and maintenance to some extent through JAK/STAT and NFKB signaling pathway constant activation. The interconnected and functionally correlated genes identified through ClueGO/CluePedia analysis, and some others integrated into the final edited pathway, have shown to be already associated with DLBCL.

4 Discussion

The decreased costs of high-throughput technologies have made the exploratory studies of complex biological traits, such as cancer, possible. Integrative omics approaches have been under the spotlight due to their potential to elucidate novel pathophysiological insights that better capture the complexity of molecular systems in a trait (Argelaguet et al., 2018; Kim et al., 2018; Zhou et al., 2019). Despite the increase in studies performing this type of analysis, efforts are still needed to better analyse and decipher the origin of complex diseases, for better diagnostics and discovering potential therapeutic targets, reviewed in (Yan et al., 2017; Karczewski and Snyder 2018). As a common characteristic, integrative methodologies rely on the identification of shared features across different large-scale datasets to further perform functional analysis. Nevertheless, one of the main elusive challenges that remains is the contextualization of the deregulated molecules; particularly in cancer where the high variability and intricacy of biomolecules involved can overwhelm meaningful readouts. In this setting, it is complex to identify commonalities among the systems altered by only looking at molecular signatures or protein-protein interactions, even within samples from the same cancer type. Thus, even though novel insights regarding potential correlations have been depicted across multi-omics studies (Zhang et al., 2013; Li J. et al., 2015; Mertins et al., 2016), the contextualization of how a molecule might influence or affect a system is still lacking. Our proposed methodology focuses not only on the identification of shared features, but also on their contextualization through pathway mapping. Approaches such as IPA, also focuses on the contextualization of features into pathway maps, however the lack of identifier curation, track and maintenance can result in poor reproducibility. In high-throughput studies the sample size is also an issue that might affect reproducibility and specificity. Usually, sample size increment correlates with higher reproducibility; it is equally responsible for an increase in false positives (Maleki et al., 2019). Thus, the fusion of integrative approaches, meta-analysis, associative data and enrichment methodologies gives an opportunity to boost the understanding, correlation and contextualization of potential molecules of interest affected in a disease. Moreover, one of the main hallmarks of our methodology is the enhancement of the statistical power of the biomarkers identified not only through the integration of high-throughput studies but also small-scale studies, which provides the focus on the pathway maps further described.

The majority of the available big data approaches rely on computational tools and therefore, the need of certain background to be able to perform these analyses. However, the HHmeta method provides a platform to not only perform an integrative meta-analysis, but also the opportunity for researchers lacking a solid background in bioinformatics to be able to perform an unbiased and straight-forward, but robust meta-analysis on pre-processed big data, to reach a logical and contextualized overview of the molecular interplay of a list of significant molecules related to an specific research question. In the example presented above, besides the identification of a deregulated and correlated set of molecules through out the analysis of different studies (Table 2), this methodology allowed their contextualization to identify potential processes and mechanisms involved in the disease (Figures 3, 4), and clarified targets influencing cell growth, survival and metastasis.

An interesting aspect that is commonly under-rated–but can influence downstream analysis and affect its replication–is the wide range of identifiers. Their constant update, reuse, un-usage, and the lack of unified efforts to both keep track and make mapping between different platforms available for the scientific community. Moreover, in order to merge datasets from different platforms and sources, the harmonization of identifiers is crucial. Thus, one of the solid basis and uniqueness of this methodology is its reliability on the PADB unifier database (see Methods section). Efforts have been previously made by others to address this issue (Gaj et al., 2007; Klimke et al., 2011), through BLASTx approaches (e.g., TargetIdentifier), linking annotations from different databases (e.g., DAVID) and trying to provide as much information as possible about IDs (Gaj et al., 2007), however data curation and constant update its still lacking. It has been noticed in pathway mapping that a great proportion of arrays become useless, mainly because there is no track of older IDs. Herein, PADB adds an extra quality-check to be able to rely fully on the available annotations and support the replication process. It enriches the downstream biological pathway map interpretation by retaining old identifiers for those molecules that currently have no annotation. PADB also allows cross-linking through species by its ortholog IDs (OMAP), enabling the identification of mechanisms that might be conserved across species through the downstream analysis.

Conventional meta-analyses apply several strategies to merge statistical measurements (i.e., p-value), and this is one of the main differences highlighted in the methodology presented here. Methods such as Fisher’s, Stouffer’s Z-test and Rank product are examples of popular statistical approaches to follow when performing meta-analyses to combine p-values of different studies, and their use depends on the meta-analysis goal (Zaykin et al., 2007; Hong and Breitling 2008). The former is based on testing the probability that different null-hypotheses, when combined, are statistically significant (Fisher 1992). However, here the proposed methodology relies on already statistically significant data for the manual approach; the FS index calculation (see section 2.3) relies on the number of times a molecule is significant, and the adjusted significance of a molecule is only one layer of ranking to consider. Therefore, in this setting Fisher’s method would not be the one of choice. In this methodology, the more a molecule is significant across studies the more likely it is that it is significant overall, regardless of the actual p-value, same with log2FCs, threshold values are used to set those boundaries. The significance of the molecules identified through this method is then corroborated by pathway mapping and other further analyses. Nevertheless, the HHmeta method and Fisher’s are similar in the principle of getting a new p-value (in our case also log2FC, plus the FS index) through the fusion of all the studies included. The main difference among conventional meta-analyses and our proposed methodology is that, by keeping the studies intact regarding cases and controls, and correlating the DS comparisons p-values and log2FCs, this methodology adds a layer of confidence regarding the comparisons made, allowing a primary correlation and clustering of studies through PCA plots.

PCA plot analysis have been used for the purpose of modelling the relationship between samples, to detect group differences and identify outliers and batch effects within a single high-throughput study (Ringnér 2008; Conesa et al., 2016; Merino et al., 2016; Todorov et al., 2018). Furthermore, there have been other integrative methodologies that have generalized PCA rationale to identify commonalities across different omics studies (Kim et al., 2017; Argelaguet et al., 2018). In contrast, here we apply PCA plot analysis to individual omics data types. Through this analysis, we were able to identify different groups and outliers from the initial high-throughput studies included in the analysis. This quality-check gives the opportunity to identify commonalities even amongst different samples, such as complete tumoral tissue and B-cells, by only including the molecules analysed in all the studies. It allows us to subtract commonalities across diverse studies, provided that the research question is well established. Even though the meta-analysis performed through this methodology is based on similar data, and therefore group of studies, it allows the comparison and identification of the relation between groups of different conditions (e.g., DLBCL vs. Healthy and DLBCL treated vs. DLBCL non-treated) opening new opportunities to identify specific responses and common enhanced pathways deregulated by the disease itself. Thus, to perform standard meta-analysis will be inadequate.

The major liability of the HHmeta method is that it is based on publicly available data. Thus, it is possible that the specific research question one wants to address hasn’t been covered by many research groups. The less high-throughput data sets available for a certain topic of interest, the less statistical power the data analysis would have. Moreover, if the available data is heterogenous, for example due to differences in the biology of the samples (treatments, stages of a disease, subtypes or sample sources), it makes the correlation even more complex, and the main question to address would need to change into a more general one, where commonalities can be depicted. Another weakness of the whole procedure is that the contextualization of the biomarker list relies on pathways previously described, so there will be gaps, molecules that do not map and unsolved questions. Despite these flaws, this method takes advantage of previous knowledge and uses it in the context of the specific topic of interest.

The substantial amount of data generated throughout the years represent a tool that can be somehow overlooked by the scientific community. For instance, good scientific practice can be enhanced by the screening, review and statistical analysis of previous studies performed in the field of interest to identify the gaps, commonalities and generating a better understanding regarding the behaviour of a system of interest, by feeding a potential model with what has already been proven and enhancing the generation of novel hypothesis to address by the inclusion of high-throughput data. The essence of the proposed methodology is the merging of independent statistical tests in an unbiased way, into a single test. It embraces the availability and basis of statistical analyses used in the big data field and utilizes their outcome to add to the statistical power of the data, resulting in a novel analysis approach. What sets the HHmeta method apart from the already available approaches are the basis of the data considered for merging, thresholding and its subsequent fusion and scoring system. Here, the manual and FS index approach are presented to highlight the main differences of what has been done before with the same ground basis as the FS index approach (FS index) which relies on a formula and adjusted values to produce similar results.

5 Conclusion

Studies in basic science are commonly hypothesis-driven and usually small-sampled. Likewise, and despite their exploratory nature, high-throughput studies tend to be biased to the resulting top deregulated genes. Therefore, novel findings require further validation, and here is where meta-analysis comes in handy. Even though the experimental design of different studies in essence is unique, meta-analysis methodologies have provided the opportunity to integrate the results of diverse and multiple studies addressing the same question, to enhance the statistical power of the results and therefore, the chances of finding true positives. In contrast to the meta-analysis methodologies already implemented in the big data-field, the methodology presented in this manuscript provides a simple, novel, unbiased, integrative and logical approach to not only meta-analyze single omics studies, but to integrate small and big data sets, as well as different omics studies. It includes quality checks to avoid batch effects, relies on a powerful cross-indexing unifier database and goes a step further by including associative data to aid for the identification and understanding of novel pathways and molecules involved in a specific disease. All in all, the current methodology provides novel hypotheses to further validate and a broader view of the system of interest, enhancing the outcomes generated through conventional meta-analysis.

Data Availability Statement

The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding authors.

Author Contributions

HH conceptualized and designed this study. KG performed the data collection and analysis. KG wrote the draft manuscript. RC and HH participated in manuscript revision. All authors contributed to the article and approved the submitted version.

Funding

KG is supported by CONACYT Mexico scholarship (No. 2019-000021-01EXTF-00542). HH is supported by a grant from Highlands & Islands Enterprise. RC is supported by the Biotechnology and Biological Sciences Research Council (BBSRC; BB/N017773/2), the Swiss National Science Foundation (SNSF; CRSK-3_190550), the Rosetrees Trust Fund (M713), and the University of Zürich Research Priority Program (URPP–Translational Cancer Research).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fgene.2022.828786/full#supplementary-material

References

Alberg, A. J., Armeson, K., Pierce, J. S., Bielawski, J., Bielawska, A., Visvanathan, K., et al. (2013). Plasma Sphingolipids and Lung Cancer: A Population-Based, Nested Case-Control Study. Cancer Epidemiol. Biomarkers Prev. 22, 1374–1382. doi:10.1158/1055-9965.EPI-12-1424

PubMed Abstract | CrossRef Full Text | Google Scholar

Argelaguet, R., Velten, B., Arnol, D., Dietrich, S., Zenz, T., Marioni, J. C., et al. (2018). Multi‐Omics Factor Analysis-A Framework for Unsupervised Integration of Multi‐omics Data Sets. Mol. Syst. Biol. 14, e8124. doi:10.15252/msb.20178124

PubMed Abstract | CrossRef Full Text | Google Scholar

Arneson, D., Bhattacharya, A., Shu, L., Mäkinen, V.-P., and Yang, X. (2016). Mergeomics: A Web Server for Identifying Pathological Pathways, Networks, and Key Regulators via Multidimensional Data Integration. BMC Genomics 17, 722. doi:10.1186/s12864-016-3057-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Athar, A., Füllgrabe, A., George, N., Iqbal, H., Huerta, L., Ali, A., et al. (2019). ArrayExpress Update - from Bulk to Single-Cell Expression Data. Nucleic Acids Res. 47, D711–D715. doi:10.1093/nar/gky964

PubMed Abstract | CrossRef Full Text | Google Scholar

Auffray, C., Adcock, I. M., Chung, K. F., Djukanovic, R., Pison, C., and Sterk, P. J. (2010). An Integrative Systems Biology Approach to Understanding Pulmonary Diseases. Chest 137, 1410–1416. doi:10.1378/chest.09-1850

PubMed Abstract | CrossRef Full Text | Google Scholar

Badr, M. T., and Häcker, G. (2019). Gene Expression Profiling Meta-Analysis Reveals Novel Gene Signatures and Pathways Shared between Tuberculosis and Rheumatoid Arthritis. PLoS One 14, e0213470. doi:10.1371/journal.pone.0213470

PubMed Abstract | CrossRef Full Text | Google Scholar

Bell, R., Barraclough, R., and Vasieva, O. (2017). Gene Expression Meta-Analysis of Potential Metastatic Breast Cancer Markers. Cmm 17, 200. doi:10.2174/1566524017666170807144946

PubMed Abstract | CrossRef Full Text | Google Scholar

Benjamini, Y., and Hochberg, Y. (1995). Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing. J. R. Stat. Soc. Ser. B (Methodological) 57, 289–300. doi:10.1111/j.2517-6161.1995.tb02031.x

CrossRef Full Text | Google Scholar

Bindea, G., Galon, J., and Mlecnik, B. (2013). CluePedia Cytoscape Plugin: Pathway Insights Using Integrated Experimental and In Silico Data. Bioinformatics 29, 661–663. doi:10.1093/bioinformatics/btt019

PubMed Abstract | CrossRef Full Text | Google Scholar

Bindea, G., Mlecnik, B., Hackl, H., Charoentong, P., Tosolini, M., Kirilovsky, A., et al. (2009). ClueGO: A Cytoscape Plug-In to Decipher Functionally Grouped Gene Ontology and Pathway Annotation Networks. Bioinformatics 25, 1091–1093. doi:10.1093/bioinformatics/btp101

PubMed Abstract | CrossRef Full Text | Google Scholar

Boeing, S., Williamson, L., Encheva, V., Gori, I., Saunders, R. E., Instrell, R., et al. (2016). Multiomic Analysis of the UV-Induced DNA Damage Response. Cel Rep. 15, 1597–1610. doi:10.1016/j.celrep.2016.04.047

PubMed Abstract | CrossRef Full Text | Google Scholar

Care, M. A., Westhead, D. R., and Tooze, R. M. (2015). Gene Expression Meta-Analysis Reveals Immune Response Convergence on the IFNγ-STAT1-IRF1 axis and Adaptive Immune Resistance Mechanisms in Lymphoma. Genome Med. 7, 96. doi:10.1186/s13073-015-0218-3

PubMed Abstract | CrossRef Full Text | Google Scholar

Carroll, A. J., Badger, M. R., and Harvey Millar, A. (2010). The MetabolomeExpress Project: Enabling Web-Based Processing, Analysis and Transparent Dissemination of GC/MS Metabolomics Datasets. BMC Bioinformatics 11, 1–13. doi:10.1186/1471-2105-11-376

PubMed Abstract | CrossRef Full Text | Google Scholar

Cervantes-Gracia, K., Chahwan, R., and Husi, H. (2021). Of Incongruous Cancer Genomics and Proteomics Datasets. Methods Mol. Biol. 2361, 291–305. doi:10.1007/978-1-0716-1641-3_17

PubMed Abstract | CrossRef Full Text | Google Scholar

Cervantes-Gracia, K., and Husi, H. (2018). Integrative Analysis of Multiple Sclerosis Using a Systems Biology Approach. Sci. Rep. 8, 1–14. doi:10.1038/s41598-018-24032-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Cervantes-Gracia, K., Gramalla-Schmitz, A., Weischedel, J., and Chahwan, R. (2021). APOBECs Orchestrate Genomic and Epigenomic Editing Across Health and Disease. Trends Genet. 37, 1028–1043. doi:10.1016/j.tig.2021.07.003

PubMed Abstract | CrossRef Full Text | Google Scholar

Cho, H., Kim, H., Na, D., Kim, S. Y., Jo, D., and Lee, D. (2016). Meta-analysis Method for Discovering Reliable Biomarkers by Integrating Statistical and Biological Approaches: An Application to Liver Toxicity. Biochem. Biophysical Res. Commun. 471, 274–281. doi:10.1016/j.bbrc.2016.01.082

CrossRef Full Text | Google Scholar

Clough, E., and Barrett, T. (2016). The Gene Expression Omnibus Database. Methods Mol. Biol. 1418, 93–110. doi:10.1007/978-1-4939-3578-9_5

PubMed Abstract | CrossRef Full Text | Google Scholar

Conesa, A., Madrigal, P., Tarazona, S., Gomez-Cabrero, D., Cervera, A., McPherson, A., et al. (2016). A Survey of Best Practices for RNA-Seq Data Analysis. Genome Biol. 17, 1–19. doi:10.1186/s13059-016-0881-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Consortium, T. U., Bateman, A., Martin, M.-J., Orchard, S., Magrane, M., Agivetova, R., et al. (2021). UniProt: the Universal Protein Knowledgebase in 2021. Nucleic Acids Res. 49, D480–D489. doi:10.1093/NAR/GKAA1100

PubMed Abstract | CrossRef Full Text | Google Scholar

Coutant, S., Cabot, C., Lefebvre, A., Léonard, M., Prieur-Gaston, E., Campion, D., et al. (2012). EVA: Exome Variation Analyzer, an Efficient and Versatile Tool for Filtering Strategies in Medical Genomics. BMC Bioinformatics 13, 1–12. doi:10.1186/1471-2105-13-S14-S9

PubMed Abstract | CrossRef Full Text | Google Scholar

Davis, R. E., Brown, K. D., Siebenlist, U., and Staudt, L. M. (2001). Constitutive Nuclear Factor κB Activity Is Required for Survival of Activated B Cell-like Diffuse Large B Cell Lymphoma Cells. J. Exp. Med. 194, 1861–1874. doi:10.1084/jem.194.12.1861

CrossRef Full Text | Google Scholar

Davis, R. E., Ngo, V. N., Lenz, G., Tolar, P., Young, R. M., Romesser, P. B., et al. (2010). Chronic Active B-Cell-Receptor Signalling in Diffuse Large B-Cell Lymphoma. Nature 463, 88–92. doi:10.1038/nature08638

PubMed Abstract | CrossRef Full Text | Google Scholar

Davis, S., and Meltzer, P. S. (2007). GEOquery: A Bridge between the Gene Expression Omnibus (GEO) and BioConductor. Bioinformatics 23, 1846–1847. doi:10.1093/bioinformatics/btm254

PubMed Abstract | CrossRef Full Text | Google Scholar

Deutsch, E. W. (2010). The PeptideAtlas Project. Methods Mol. Biol. 604, 285–296. doi:10.1007/978-1-60761-444-9_19

PubMed Abstract | CrossRef Full Text | Google Scholar

Duan, S., Cermak, L., Pagan, J. K., Martinengo, C., di Celle, P. F., Chapuy, B., et al. (2012). FBXO11 Targets BCL6 for Degradation and Is Inactivated in Diffuse Large B-Cell Lymphomas. Nature 481, 90–93. doi:10.1038/NATURE10688

PubMed Abstract | CrossRef Full Text | Google Scholar

Durinck, S., Moreau, Y., Kasprzyk, A., Davis, S., De Moor, B., Brazma, A., et al. (2005). BioMart and Bioconductor: A Powerful Link between Biological Databases and Microarray Data Analysis. Bioinformatics 21, 3439–3440. doi:10.1093/bioinformatics/bti525

PubMed Abstract | CrossRef Full Text | Google Scholar

Fan, L., Li, H., and Zhang, Y. (2020). LINC00908 Negatively Regulates microRNA-483-5p to Increase TSPYL5 Expression and Inhibit the Development of Prostate Cancer. Cancer Cel Int 20, 10. doi:10.1186/s12935-019-1073-x

PubMed Abstract | CrossRef Full Text | Google Scholar

Fenyö, D., and Beavis, R. C. (2015). The GPMDB REST Interface. Bioinformatics 31, 2056–2058. doi:10.1093/BIOINFORMATICS/BTV107

PubMed Abstract | CrossRef Full Text | Google Scholar

Fernandes, M., and Husi, H. (2016). Integrative Systems Biology Investigation of Fabry Disease. Diseases 4, 35. doi:10.3390/diseases4040035

PubMed Abstract | CrossRef Full Text | Google Scholar

Fernandes, M., and Husi, H. (2019). Integrative Systems Biology Resources and Approaches in Disease Analytics. London, United Kingdom: IntechOpen doi:10.5772/intechopen.84834

CrossRef Full Text

Fernandes, M., Patel, A., and Husi, H. (2018). C/VDdb: A Multi-Omics Expression Profiling Database for a Knowledge-Driven Approach in Cardiovascular Disease (CVD). PLoS One 13, e0207371. doi:10.1371/journal.pone.0207371

PubMed Abstract | CrossRef Full Text | Google Scholar

Fishel, I., Kaufman, A., and Ruppin, E. (2007). Meta-analysis of Gene Expression Data: a Predictor-Based Approach. Bioinformatics 23, 1599–1606. doi:10.1093/bioinformatics/btm149

PubMed Abstract | CrossRef Full Text | Google Scholar

Fisher, R. A. (1992). Statistical Methods for Research Workers. New York, NY: Springer, 66–70. doi:10.1007/978-1-4612-4380-9_6

CrossRef Full Text | Google Scholar

Forero, D. A. (2019). Available Software for Meta-Analyses of Genome-wide Expression Studies. Cg 20, 325–331. doi:10.2174/1389202920666190822113912

PubMed Abstract | CrossRef Full Text | Google Scholar

Furuya, H., Shimizu, Y., and Kawamori, T. (2011). Sphingolipids in Cancer. Cancer Metastasis Rev. 30, 567–576. doi:10.1007/s10555-011-9304-1

PubMed Abstract | CrossRef Full Text | Google Scholar

Fusco, J. P., Pita, G., Pajares, M. J., Andueza, M. P., Patiño‐García, A., de‐Torres, J. P., et al. (2018). Genomic Characterization of Individuals Presenting Extreme Phenotypes of High and Low Risk to Develop Tobacco‐induced Lung Cancer. Cancer Med. 7, 3474–3483. doi:10.1002/cam4.1500

CrossRef Full Text | Google Scholar

Gaj, S., van Erk, A., van Haaften, R. I., and Evelo, C. T. (2007). Linking Microarray Reporters with Protein Functions. BMC Bioinformatics 8, 1–17. doi:10.1186/1471-2105-8-360

PubMed Abstract | CrossRef Full Text | Google Scholar

Gentleman, R. C., Carey, V. J., Bates, D. M., Bolstad, B., Dettling, M., Dudoit, S., et al. (2004). Bioconductor: Open Software Development for Computational Biology and Bioinformatics. Genome Biol. 5, R80. doi:10.1186/gb-2004-5-10-r80

PubMed Abstract | CrossRef Full Text | Google Scholar

Goveia, J., Pircher, A., Conradi, L. C., Kalucka, J., Lagani, V., Dewerchin, M., et al. (2016). Meta‐analysis of Clinical Metabolic Profiling Studies in Cancer: Challenges and Opportunities. EMBO Mol. Med. 8, 1134–1142. doi:10.15252/emmm.201606798

PubMed Abstract | CrossRef Full Text | Google Scholar

Guan, X., Runger, G., and Liu, L. (2020). Dynamic Incorporation of Prior Knowledge from Multiple Domains in Biomarker Discovery. BMC Bioinformatics 21, 77. doi:10.1186/s12859-020-3344-x

PubMed Abstract | CrossRef Full Text | Google Scholar

Hicks, A. A., Pramstaller, P. P., Johansson, A., Vitart, V., Rudan, I., Ugocsai, P., et al. (2009). Genetic Determinants of Circulating Sphingolipid Concentrations in European Populations. Plos Genet. 5, e1000672. doi:10.1371/journal.pgen.1000672

PubMed Abstract | CrossRef Full Text | Google Scholar

Hong, F., and Breitling, R. (2008). A Comparison of Meta-Analysis Methods for Detecting Differentially Expressed Genes in Microarray Experiments. Bioinformatics 24, 374–382. doi:10.1093/BIOINFORMATICS/BTM620

PubMed Abstract | CrossRef Full Text | Google Scholar

Huan, T., Esko, T., Peters, M. J., Pilling, L. C., Schramm, K., Schurmann, C., et al. (2015). A Meta-Analysis of Gene Expression Signatures of Blood Pressure and Hypertension. PLOS Genet. 11, e1005035. doi:10.1371/journal.pgen.1005035

PubMed Abstract | CrossRef Full Text | Google Scholar

Huang, C., He, C., Ruan, P., and Zhou, R. (2020). TSPYL5 Activates Endoplasmic Reticulum Stress to Inhibit Cell Proliferation, Migration and Invasion in Colorectal Cancer. Oncol. Rep. 44, 449–456. doi:10.3892/or.2020.7639

PubMed Abstract | CrossRef Full Text | Google Scholar

Husi, H. (2004). NMDA Receptors, Neural Pathways, and Protein Interaction Databases. Int. Rev. Neurobiol. 61, 49–77. doi:10.1016/S0074-7742(04)61003-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Jaiswal, A., Gautam, P., Pietilä, E. A., Timonen, S., Nordström, N., Sipari, N., et al. (2020). Multi-modal Meta-Analysis of Cancer Cell Line Omics Profiles Identifies ECHDC1 as a Novel Breast Tumor Suppressor. bioRxiv 0131, 929372. doi:10.1101/2020.01.31.929372

CrossRef Full Text | Google Scholar

Jung, Y., Park, J., Bang, Y.-J., and Kim, T.-Y. (2008). Gene Silencing of TSPYL5 Mediated by Aberrant Promoter Methylation in Gastric Cancers. Lab. Invest. 88, 153–160. doi:10.1038/labinvest.3700706

PubMed Abstract | CrossRef Full Text | Google Scholar

Kale, N. S., Haug, K., Conesa, P., Jayseelan, K., Moreno, P., Rocca-Serra, P., et al. (2016). MetaboLights: An Open-Access Database Repository for Metabolomics Data. Curr. Protoc. Bioinformatics 53, 14.13.1. doi:10.1002/0471250953.BI1413S5310.1002/0471250953.bi1413s53

PubMed Abstract | CrossRef Full Text | Google Scholar

Karczewski, K. J., and Snyder, M. P. (2018). Integrative Omics for Health and Disease. Nat. Rev. Genet. 19, 299–310. doi:10.1038/nrg.2018.4

PubMed Abstract | CrossRef Full Text | Google Scholar

Kim, E. J., Lee, S. Y., Kim, T. R., Choi, S. I., Cho, E. W., Kim, K. C., et al. (2010). TSPYL5 Is Involved in Cell Growth and the Resistance to Radiation in A549 Cells via the Regulation of p21WAF1/Cip1 and PTEN/AKT Pathway. Biochem. Biophysical Res. Commun. 392, 448–453. doi:10.1016/j.bbrc.2010.01.045

PubMed Abstract | CrossRef Full Text | Google Scholar

Kim, S., Jhong, J.-H., Lee, J., and Koo, J.-Y. (2017). Meta-analytic Support Vector Machine for Integrating Multiple Omics Data. BioData Mining 10, 1–14. doi:10.1186/s13040-017-0126-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Kim, S., Kang, D., Huo, Z., Park, Y., and Tseng, G. C. (2018). Meta-analytic Principal Component Analysis in Integrative Omics Application. Bioinformatics 34, 1321–1328. doi:10.1093/bioinformatics/btx765

PubMed Abstract | CrossRef Full Text | Google Scholar

Klimke, W., O'Donovan, C., White, O., Brister, J. R., Clark, K., Fedorov, B., et al. (2011). Solving the Problem: Genome Annotation Standards before the Data Deluge. Stand. Genomic Sci. 5, 168–193. doi:10.4056/sigs.2084864

PubMed Abstract | CrossRef Full Text | Google Scholar

Kröger, W., Mapiye, D., Entfellner, J.-B. D., and Tiffin, N. (2016). A Meta-Analysis of Public Microarray Data Identifies Gene Regulatory Pathways Deregulated in Peripheral Blood Mononuclear Cells from Individuals with Systemic Lupus Erythematosus Compared to Those without. BMC Med. Genomics 9, 1–11. doi:10.1186/s12920-016-0227-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Kutmon, M., van Iersel, M. P., Bohler, A., Kelder, T., Nunes, N., Pico, A. R., et al. (2015). PathVisio 3: An Extendable Pathway Analysis Toolbox. Plos Comput. Biol. 11, e1004085. doi:10.1371/journal.pcbi.1004085

PubMed Abstract | CrossRef Full Text | Google Scholar

Lappalainen, I., Almeida-King, J., Kumanduri, V., Senf, A., Spalding, J. D., ur-Rehman, S., et al. (2015). The European Genome-Phenome Archive of Human Data Consented for Biomedical Research. Nat. Genet. 47, 692–695. doi:10.1038/ng.3312

PubMed Abstract | CrossRef Full Text | Google Scholar

Lawson, J., Lee, H., and Lim, Y. (2012). Weighted Geometric Means. Forum Math. 24, 1067–1090. doi:10.1515/FORM.2011.096

CrossRef Full Text | Google Scholar

Li, J., Ma, Z., Shi, M., Malty, R. H., Aoki, H., Minic, Z., et al. (2015). Identification of Human Neuronal Protein Complexes Reveals Biochemical Activities and Convergent Mechanisms of Action in Autism Spectrum Disorders. Cel Syst. 1, 361–374. doi:10.1016/j.cels.2015.11.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, X., Qiu, W., Morrow, J., DeMeo, D. L., Weiss, S. T., Fu, Y., et al. (2015). A Comparative Study of Tests for Homogeneity of Variances with Application to DNA Methylation Data. PLoS One 10, e0145295. doi:10.1371/JOURNAL.PONE.0145295

PubMed Abstract | CrossRef Full Text | Google Scholar

Mair, F., Erickson, J. R., Voillet, V., Simoni, Y., Bi, T., Tyznik, A. J., et al. (2020). A Targeted Multi-Omic Analysis Approach Measures Protein Expression and Low-Abundance Transcripts on the Single-Cell Level. Cel Rep. 31, 107499. doi:10.1016/j.celrep.2020.03.063

PubMed Abstract | CrossRef Full Text | Google Scholar

Maleki, F., Ovens, K., McQuillan, I., and Kusalik, A. J. (2019). Size Matters: How Sample Size Affects the Reproducibility and Specificity of Gene Set Analysis. Hum. Genomics 13, 1–12. doi:10.1186/S40246-019-0226-2

PubMed Abstract | CrossRef Full Text | Google Scholar

McDermott, J. E., Wang, J., Mitchell, H., Webb-Robertson, B.-J., Hafen, R., Ramey, J., et al. (2013). Challenges in Biomarker Discovery: Combining Expert Insights with Statistical Analysis of Complex Omics Data. Expert Opin. Med. Diagn. 7, 37–51. doi:10.1517/17530059.2012.718329

PubMed Abstract | CrossRef Full Text | Google Scholar

McGarvey, P. B., Nightingale, A., Luo, J., Huang, H., Martin, M. J., Wu, C., et al. (2019). UniProt Genomic Mapping for Deciphering Functional Effects of Missense Variants. Hum. Mutat. 40, 694–705. doi:10.1002/humu.23738

PubMed Abstract | CrossRef Full Text | Google Scholar

Merino, G. A., Fresno, C., Netto, F., Netto, E. D., Pratto, L., and Fernández, E. A. (2016). The Impact of Quality Control in RNA-Seq Experiments. J. Phys. Conf. Ser. 705, 012003. Institute of Physics Publishing. doi:10.1088/1742-6596/705/1/012003

CrossRef Full Text | Google Scholar

Mertins, P., Mani, D. R., Mani, D. R., Ruggles, K. V., Gillette, M. A., Clauser, K. R., et al. (2016). Proteogenomics Connects Somatic Mutations to Signalling in Breast Cancer. Nature 534, 55–62. doi:10.1038/nature18003

PubMed Abstract | CrossRef Full Text | Google Scholar

Miao, Y., Medeiros, L. J., Xu-Monette, Z. Y., Li, J., and Young, K. H. (2019). Dysregulation of Cell Survival in Diffuse Large B Cell Lymphoma: Mechanisms and Therapeutic Targets. Front. Oncol. 9, 107. doi:10.3389/fonc.2019.00107

PubMed Abstract | CrossRef Full Text | Google Scholar

Miao, Z., and Jiang, X. (2014). Additive and Exclusive Noise Suppression by Iterative Trimmed and Truncated Mean Algorithm. Signal. Process. 99, 147–158. doi:10.1016/J.SIGPRO.2013.12.002

CrossRef Full Text | Google Scholar

Myall, A. C., Perkins, S., Rushton, D., David, J., Spencer, P., Jones, A. R., et al. (2021). An OMICs-Based Meta-Analysis to Support Infection State Stratification. Bioinformatics 37, 2347–2355. doi:10.1093/bioinformatics/btab089

CrossRef Full Text | Google Scholar

Norris, J. L., Farrow, M. A., Gutierrez, D. B., Palmer, L. D., Muszynski, N., Sherrod, S. D., et al. (2017). Integrated, High-Throughput, Multiomics Platform Enables Data-Driven Construction of Cellular Responses and Reveals Global Drug Mechanisms of Action. J. Proteome Res. 16, 1364–1375. doi:10.1021/acs.jproteome.6b01004

PubMed Abstract | CrossRef Full Text | Google Scholar

Pang, Z., Chong, J., Li, S., and Xia, J. (2020). MetaboAnalystR 3.0: Toward an Optimized Workflow for Global Metabolomics. Metabolites 10, 186. doi:10.3390/metabo10050186

PubMed Abstract | CrossRef Full Text | Google Scholar

Parker, B. L., Calkin, A. C., Seldin, M. M., Keating, M. F., Tarling, E. J., Yang, P., et al. (2019). An Integrative Systems Genetic Analysis of Mammalian Lipid Metabolism. Nature 567, 187–193. doi:10.1038/s41586-019-0984-y

PubMed Abstract | CrossRef Full Text | Google Scholar

Perez-Riverol, Y., Bai, M., Da Veiga Leprevost, F., Squizzato, S., Park, Y. M., Haug, K., et al. (2017). Discovering and Linking Public Omics Data Sets Using the Omics Discovery Index. Nat. Biotechnol. 35, 406–409. doi:10.1038/nbt.3790

PubMed Abstract | CrossRef Full Text | Google Scholar

Pinero, J., Queralt-Rosinach, N., Bravo, A., Deu-Pons, J., Bauer-Mehren, A., Baron, M., et al. (2015). DisGeNET: A Discovery Platform for the Dynamical Exploration of Human Diseases and Their Genes. Database 2015, bav028. doi:10.1093/database/bav028

PubMed Abstract | CrossRef Full Text | Google Scholar

Piñero, J., Ramírez-Anguita, J. M., Saüch-Pitarch, J., Ronzano, F., Centeno, E., Sanz, F., et al. (2020). The DisGeNET Knowledge Platform for Disease Genomics: 2019 Update. Nucleic Acids Res. 48, D845–D855. doi:10.1093/nar/gkz1021

PubMed Abstract | CrossRef Full Text | Google Scholar

Piras, I. S., Manchia, M., Huentelman, M. J., Pinna, F., Zai, C. C., Kennedy, J. L., et al. (2019). Peripheral Biomarkers in Schizophrenia: A Meta-Analysis of Microarray Gene Expression Datasets. Int. J. Neuropsychopharmacol. 22, 186–193. doi:10.1093/ijnp/pyy103

PubMed Abstract | CrossRef Full Text | Google Scholar

Rikke, B. A., Wynes, M. W., Rozeboom, L. M., Barón, A. E., and Hirsch, F. R. (2015). Independent Validation Test of the Vote-Counting Strategy Used to Rank Biomarkers from Published Studies. Biomarkers Med. 9, 751–761. doi:10.2217/BMM.15.39

CrossRef Full Text | Google Scholar

Ringnér, M. (2008). What Is Principal Component Analysis? Nat. Biotechnol. 26, 303–304. doi:10.1038/nbt0308-303

PubMed Abstract | CrossRef Full Text | Google Scholar

Rohart, F., Eslami, A., Matigian, N., Bougeard, S., and Lê Cao, K.-A. (2017). MINT: A Multivariate Integrative Method to Identify Reproducible Molecular Signatures across Independent Experiments and Platforms. BMC Bioinformatics 18, 128. doi:10.1186/s12859-017-1553-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Saha, S., Matthews, D. A., and Bessant, C. (2018). High Throughput Discovery of Protein Variants Using Proteomics Informed by Transcriptomics. Nucleic Acids Res. 46, 4893–4902. doi:10.1093/nar/gky295

PubMed Abstract | CrossRef Full Text | Google Scholar

Saito, M., Gao, J., Basso, K., Kitagawa, Y., Smith, P. M., Bhagat, G., et al. (2007). A Signaling Pathway Mediating Downregulation of BCL6 in Germinal Center B Cells Is Blocked by BCL6 Gene Alterations in B Cell Lymphoma. Cancer Cell 12, 280–292. doi:10.1016/j.ccr.2007.08.011

PubMed Abstract | CrossRef Full Text | Google Scholar

Samaras, P., Schmidt, T., Frejno, M., Gessulat, S., Reinecke, M., Jarzab, A., et al. (2020). ProteomicsDB: a Multi-Omics and Multi-Organism Resource for Life Science Research. Nucleic Acids Res. 48, D1153–D1163. doi:10.1093/NAR/GKZ974

PubMed Abstract | CrossRef Full Text | Google Scholar

Shafi, A., Nguyen, T., Peyvandipour, A., Nguyen, H., and Draghici, S. (2019). A Multi-Cohort and Multi-Omics Meta-Analysis Framework to Identify Network-Based Gene Signatures. Front. Genet. 10, 1–16. doi:10.3389/fgene.2019.00159

PubMed Abstract | CrossRef Full Text | Google Scholar

Shannon, P., Markiel, A., Ozier, O., Baliga, N. S., Wang, J. T., Ramage, D., et al. (2003). Cytoscape: A Software Environment for Integrated Models of Biomolecular Interaction Networks. Genome Res. 13, 2498–2504. doi:10.1101/gr.1239303

PubMed Abstract | CrossRef Full Text | Google Scholar

Shao, L., Shen, Z., Qian, H., Zhou, S., and Chen, Y. (2017). Knockdown of miR-629 Inhibits Ovarian Cancer Malignant Behaviors by Targeting Testis-specific Y-like Protein 5. DNA Cel Biol. 36, 1108–1116. doi:10.1089/dna.2017.3904

PubMed Abstract | CrossRef Full Text | Google Scholar

Sheppard, E. C., Morrish, R. B., Dillon, M. J., Leyland, R., and Chahwan, R. (2018). Epigenomic Modifications Mediating Antibody Maturation. Front. Immunol. 9, 355. doi:10.3389/fimmu.2018.00355

PubMed Abstract | CrossRef Full Text | Google Scholar

Singh, A., Shannon, C. P., Gautier, B., Rohart, F., Vacher, M., Tebbutt, S. J., et al. (2019). DIABLO: an Integrative Approach for Identifying Key Molecular Drivers from Multi-Omics Assays. Bioinformatics 35, 3055–3062. doi:10.1093/bioinformatics/bty1054

PubMed Abstract | CrossRef Full Text | Google Scholar

Smedley, D., Haider, S., Ballester, B., Holland, R., London, D., Thorisson, G., et al. (2009). BioMart - Biological Queries Made Easy. BMC Genomics 10, 1. doi:10.1186/1471-2164-10-22

PubMed Abstract | CrossRef Full Text | Google Scholar

Smyth, G. K. (2004). Linear Models and Empirical Bayes Methods for Assessing Differential Expression in Microarray Experiments. Stat. Appl. Genet. Mol. Biol. 3, 1–25. doi:10.2202/1544-6115.1027

CrossRef Full Text | Google Scholar

Su, L., Chen, S., Zheng, C., Wei, H., and Song, X. (2019). Meta-Analysis of Gene Expression and Identification of Biological Regulatory Mechanisms in Alzheimer's Disease. Front. Neurosci. 13, 633. doi:10.3389/fnins.2019.00633

PubMed Abstract | CrossRef Full Text | Google Scholar

Subramanian, I., Verma, S., Kumar, S., Jere, A., and Anamika, K. (2020). Multi-omics Data Integration, Interpretation, and Its Application. Bioinform. Biol. Insights 14, 1177932219899051. doi:10.1177/1177932219899051

PubMed Abstract | CrossRef Full Text | Google Scholar

Sud, M., Fahy, E., Cotter, D., Azam, K., Vadivelu, I., Burant, C., et al. (2016). Metabolomics Workbench: An International Repository for Metabolomics Data and Metadata, Metabolite Standards, Protocols, Tutorials and Training, and Analysis Tools. Nucleic Acids Res. 44, D463–D470. doi:10.1093/NAR/GKV1042

PubMed Abstract | CrossRef Full Text | Google Scholar

Todorov, H., Fournier, D., and Gerber, S. (2018). Principal Components Analysis: Theory and Application to Gene Expression Data Analysis. Genomics Comput. Biol. 4, 100041. doi:10.18547/gcb.2018.vol4.iss2.e100041

CrossRef Full Text | Google Scholar

Toro-Domínguez, D., Villatoro-García, J. A., Martorell-Marugán, J., Román-Montoya, Y., Alarcón-Riquelme, M. E., and Carmona-Sáez, P. (2020). A Survey of Gene Expression Meta-Analysis: Methods and Applications. Brief. Bioinform 22, 1694–1705. doi:10.1093/bib/bbaa019

CrossRef Full Text | Google Scholar

Tsuyama, N., Sakata, S., Baba, S., Mishima, Y., Nishimura, N., Ueda, K., et al. (2017). BCL2 Expression in DLBCL: Reappraisal of Immunohistochemistry with New Criteria for Therapeutic Biomarker Evaluation. Blood 130, 489–500. doi:10.1182/blood-2016-12-759621

PubMed Abstract | CrossRef Full Text | Google Scholar

Vachani, A., Nebozhyn, M., Singhal, S., Alila, L., Wakeam, E., Muschel, R., et al. (2007). A 10-gene Classifier for Distinguishing Head and Neck Squamous Cell Carcinoma and Lung Squamous Cell Carcinoma. Clin. Cancer Res. 13, 2905–2915. doi:10.1158/1078-0432.CCR-06-1670

PubMed Abstract | CrossRef Full Text | Google Scholar

van Iersel, M. P., Pico, A. R., Kelder, T., Gao, J., Ho, I., Hanspers, K., et al. (2010). The BridgeDb Framework: Standardized Access to Gene, Protein and Metabolite Identifier Mapping Services. BMC Bioinformatics 11, 5. doi:10.1186/1471-2105-11-5

PubMed Abstract | CrossRef Full Text | Google Scholar

Vennou, K. E., Piovani, D., Kontou, P. I., Bonovas, S., and Bagos, P. G. (2020). Methods for Multiple Outcome Meta-Analysis of Gene-Expression Data. MethodsX 7, 100834. doi:10.1016/j.mex.2020.100834

PubMed Abstract | CrossRef Full Text | Google Scholar

Vizcaíno, J. A., Côté, R. G., Csordas, A., Dianes, J. A., Fabregat, A., Foster, J. M., et al. (2013). The Proteomics Identifications (PRIDE) Database and Associated Tools: Status in 2013. Nucleic Acids Res. 41, D1063–D1069. doi:10.1093/NAR/GKS1262

PubMed Abstract | CrossRef Full Text | Google Scholar

Waldron, L., and Riester, M. (2016). Meta-analysis in Gene Expression Studies. Methods Mol. Biol. 1418, 161–176. doi:10.1007/978-1-4939-3578-9_8

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, M., Carver, J. J., Phelan, V. V., Sanchez, L. M., Garg, N., Peng, Y., et al. (2016). Sharing and Community Curation of Mass Spectrometry Data with Global Natural Products Social Molecular Networking. Nat. Biotechnol. 34, 828–837. doi:10.1038/NBT.3597

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, M., Wang, J., Carver, J., Pullman, B. S., Cha, S. W., and Bandeira, N. (2018). Assembling the Community-Scale Discoverable Human Proteome. Cel Syst. 7, 412–421. doi:10.1016/J.CELS.2018.08.004

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, M., Weiss, M., Simonovic, M., Haertinger, G., Schrimpf, S. P., Hengartner, M. O., et al. (2012). PaxDb, a Database of Protein Abundance Averages across All Three Domains of Life. Mol. Cell Proteomics 11, 492–500. doi:10.1074/MCP.O111.014704

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, Q., Li, W.-X., Dai, S.-X., Guo, Y.-C., Han, F.-F., Zheng, J.-J., et al. (2017). Meta-Analysis of Parkinson's Disease and Alzheimer's Disease Revealed Commonly Impaired Pathways and Dysregulation of NRF2-dependent Genes. Jad 56, 1525–1539. doi:10.3233/JAD-161032

PubMed Abstract | CrossRef Full Text | Google Scholar

Warde-Farley, D., Donaldson, S. L., Comes, O., Zuberi, K., Badrawi, R., Chao, P., et al. (2010). The GeneMANIA Prediction Server: Biological Network Integration for Gene Prioritization and Predicting Gene Function. Nucleic Acids Res. 38, W214–W220. Available at: https://academic.oup.com/nar/article/38/suppl_2/W214/1126704 (Accessed September 24, 2020). doi:10.1093/nar/gkq537

PubMed Abstract | CrossRef Full Text | Google Scholar

Watanabe, Y., Yoshizawa, A. C., Ishihama, Y., and Okuda, S. (2021). The jPOST Repository as a Public Data Repository for. Methods Mol. Biol. 2259, 309–322. doi:10.1007/978-1-0716-1178-4_20

PubMed Abstract | CrossRef Full Text | Google Scholar

Webster, J. D., and Vucic, D. (2020). The Balance of TNF Mediated Pathways Regulates Inflammatory Cell Death Signaling in Healthy and Diseased Tissues. Front. Cel Dev. Biol. 8, 365. doi:10.3389/fcell.2020.00365

PubMed Abstract | CrossRef Full Text | Google Scholar

Winter, C., Kosch, R., Ludlow, M., Osterhaus, A. D. M. E., and Jung, K. (2019). Network Meta-Analysis Correlates with Analysis of Merged Independent Transcriptome Expression Data. BMC Bioinformatics 20, 1–10. doi:10.1186/s12859-019-2705-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Xia, J., Fjell, C. D., Mayer, M. L., Pena, O. M., Wishart, D. S., and Hancock, R. E. W. (2013). INMEX-a Web-Based Tool for Integrative Meta-Analysis of Expression Data. Nucleic Acids Res. 41, W63–W70. doi:10.1093/nar/gkt338

PubMed Abstract | CrossRef Full Text | Google Scholar

Xicota, L., Ichou, F., Lejeune, F.-X., Colsch, B., Tenenhaus, A., Leroy, I., et al. (2019). Multi-omics Signature of Brain Amyloid Deposition in Asymptomatic Individuals At-Risk for Alzheimer's Disease: The INSIGHT-preAD Study. EBioMedicine 47, 518–528. doi:10.1016/j.ebiom.2019.08.051

PubMed Abstract | CrossRef Full Text | Google Scholar

Xu, W., Dullaers, M., Oh, S., and Banchereau, J. (2009). Distinct Roles of Dendritic Cells and Macrophages in B Cell Class Switching (39.12). J. Immunol. 182, 39.

Google Scholar

Yan, J., Risacher, S. L., Shen, L., and Saykin, A. J. (2017). Network Approaches to Systems Biology Analysis of Complex Disease: Integrative Methods for Multi-Omics Data. Brief. Bioinform. 19, 1370–1381. doi:10.1093/bib/bbx066

CrossRef Full Text | Google Scholar

Yang, X. (2020). Multitissue Multiomics Systems Biology to Dissect Complex Diseases. Trends Mol. Med. 26, 718–728. doi:10.1016/j.molmed.2020.04.006

PubMed Abstract | CrossRef Full Text | Google Scholar

Zaykin, D. V., Zhivotovsky, L. A., Czika, W., Shao, S., and Wolfinger, R. D. (2007). Combining P -values in Large-Scale Genomics Experiments. Pharmaceut. Statist. 6, 217–226. doi:10.1002/PST.304

CrossRef Full Text | Google Scholar

Zhang, B., Calado, D. P., Wang, Z., Fröhler, S., Köchert, K., Qian, Y., et al. (2015). An Oncogenic Role for Alternative NF-Κb Signaling in DLBCL Revealed upon Deregulated BCL6 Expression. Cel Rep. 11, 715–726. doi:10.1016/j.celrep.2015.03.059

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhang, B., Gaiteri, C., Bodea, L.-G., Wang, Z., McElwee, J., Podtelezhnikov, A. A., et al. (2013). Integrated Systems Approach Identifies Genetic Nodes and Networks in Late-Onset Alzheimer's Disease. Cell 153, 707–720. doi:10.1016/j.cell.2013.03.030

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhou, G., Li, S., and Xia, J. (2020). Network-Based Approaches for Multi-Omics Integration. Methods Mol. Biol. 2104, 469–487. doi:10.1007/978-1-0716-0239-3_23

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhou, G., Soufan, O., Ewald, J., Hancock, R. E. W., Basu, N., and Xia, J. (2019). NetworkAnalyst 3.0: A Visual Analytics Platform for Comprehensive Gene Expression Profiling and Meta-Analysis. Nucleic Acids Res. 47, W234–W241. doi:10.1093/nar/gkz240

PubMed Abstract | CrossRef Full Text | Google Scholar