Skip to main content

ORIGINAL RESEARCH article

Front. Genet., 05 August 2021
Sec. Genomic Assay Technology

Cost-Effective Mapping of Genetic Interactions in Mammalian Cells

  • Department of Molecular and Medical Pharmacology, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, United States

Comprehensive maps of genetic interactions in mammalian cells are daunting to construct because of the large number of potential interactions, ~ 2 × 108 for protein coding genes. We previously used co-inheritance of distant genes from published radiation hybrid (RH) datasets to identify genetic interactions. However, it was necessary to combine six legacy datasets from four species to obtain adequate statistical power. Mapping resolution was also limited by the low density PCR genotyping. Here, we employ shallow sequencing of nascent human RH clones as an economical approach to constructing interaction maps. In this initial study, 15 clones were analyzed, enabling construction of a network with 225 genes and 2,359 interactions (FDR < 0.05). Despite its small size, the network showed significant overlap with the previous RH network and with a protein-protein interaction network. Consumables were ≲$50 per clone, showing that affordable, high quality genetic interaction maps are feasible in mammalian cells.

Introduction

Intelligent intervention in normal and diseased mammalian cells requires a comprehensive map of their biological networks. Protein-protein interactions (PPIs) have been identified using a variety of technologies, including yeast two hybrid assays and immunoprecipitation-mass spectrometry (Yugandhar et al., 2019; Luck et al., 2020). Although these approaches are resource intensive, most human PPIs have been evaluated using large experimental efforts and cataloged in publicly available databases (Bajpai et al., 2020; Luck et al., 2020).

Because of the cost, a survey of all PPIs in various cell types is not feasible. Further, PPIs do not provide information on the cellular consequences of the relevant interactions. For example, proteins may have no physical interaction, even though their genes show strong interactions.

Genetic interactions have been evaluated in a wide variety of organisms, ranging from bacteria to Drosophila (Costanzo et al., 2019). The most thorough catalog is for the yeast Saccharomyces cerevisiae (Costanzo et al., 2016). This network has provided surprising new information on the connections between cellular pathways. Data in other organisms is far less complete. Assuming 20,000 protein coding genes in mammals, the number of potential interactions is ~ 2 × 108. The addition of non-coding genes trebles the number of genes, bringing the number of possible interactions to ~ 1.8 × 109.

Multiple opportunities for therapeutic intervention in cancer will emerge from genetic interaction maps (Mair et al., 2019). In particular, geneticists are beginning to use CRISPR-Cas9 genetic editing technology to study the viability of cancer cells with double loss-of-function mutations in trans. One recent study employed CRISPR interference (CRISPRi) to identify genetic interactions among 222,784 gene pairs in two cancer cell lines (Horlbeck et al., 2018). However, even this effort only evaluated ~ 0.1% of all possible coding gene pairs.

Overexpression alters cell physiology differently to loss-of-function, and is a complementary strategy to understanding cellular networks in both yeast and mammalian cells (Sopko et al., 2006; Prelich, 2012; Khan et al., 2020). One recent approach to obtaining targeted increases in gene expression is CRISPR activation (CRISPRa), but this method causes constitutive and non-physiological overexpression (Gilbert et al., 2014; Kampmann, 2018).

Radiation hybrid (RH) mapping has been widely used to construct genetic maps for the genome projects (Goss and Harris, 1975; Cox et al., 1990; Walter et al., 1994; McCarthy, 1996; McCarthy et al., 2000; Avner et al., 2001; Hudson et al., 2001; Olivier et al., 2001; Kwitek et al., 2004). In this technique, lethal doses of radiation are used to randomly fragment the genome of a human cell line (Figure 1A) (Goss and Harris, 1975). RH clones are then created by transferring a sample of the DNA fragments to living hamster cells using cell fusion. Linked markers are likely to reside on the same fragment, and hence co-inherited in the RH clones. Because of the small size of the DNA fragments, genotyping a panel of RH clones allows high resolution mapping.

FIGURE 1
www.frontiersin.org

Figure 1. Creating RH interaction networks. (A) RH clones are made by lethally irradiating human cells (HEK293). The human cells are fused to living hamster cells (A23) to rescue the DNA fragments, and RH clones selected using TK1. Conventional RH mapping exploits the fact that nearby makers tend to be found on the same DNA fragment and thus co-inherited (green triangles). RH interaction networks seek co-inheritance of distant markers (green and pink triangles). (B) Human DNA copy number, clone 8, Chromosome 8. One of the human fragments encompasses the centromere. (C) Mean retention across 15 clones, showing increased retention at centromeres and retention of 1 at TK1. (D) Mean retention across clones, Chromosome 17.

We previously used publicly available RH data to construct a genetic interaction map for mammalian cells (Lin et al., 2010; Lin and Smith, 2015). We reasoned that significant co-inheritance of marker pairs separated from each other in the human genome would disclose genetic interactions promoting cell survival. Rather than loss-of-function, this interaction network depends on extra gene copies. Moreover, the genes are expressed using their natural promoters instead of constitutively.

We increased the statistical power of the RH network by combining PCR genotyping datasets from six RH panels: three human, one mouse, one rat, and one dog. The network consisted of 18,324 genes linked by 7,248,479 interactions. The overwhelming majority of interactions consisted of higher than expected co-retention of the gene pairs.

Despite its statistical power, the quality of the network suffered because of the need to combine datasets from different species. In addition, the mapping resolution was limited by the legacy PCR genotyping.

In this study, we demonstrate the cost-effectiveness of the RH approach in creating genetic interaction maps for the mammalian genome. We used low pass DNA sequencing to genotype emergent human RH clones, decreasing labor and cell culture costs, while also improving mapping resolution. Expanding this strategy will render construction of whole genome interaction networks feasible.

Results

Human DNA Retention in the RH Clones

We exploited the sensitivity of modern DNA technologies to analyze RH clones upon appearance, avoiding the customary need for additional growth. Our strategy cuts costs and saves time. Fifteen independent RH clones were evaluated using low pass sequencing at a depth of 0.31 ± 0.03 times the human genome (14.5 ± 14.5±1.4 M single reads of 65 bp). Reads were aligned to the human genome and those that also aligned to hamster were discarded. Only human-specific reads remained for subsequent analyses using 1 Mb windows and 10 kb steps (Khan et al., 2020).

The human DNA fragment length was 2.3 ± 0.1 Mb and the retention frequency was 0.25 ± 0.08 (Figures 1B–D, Supplementary Figures 1A–D). Due to the small number of clones, 3% of the human genome had zero retention. Clone 2 had the highest retention (0.97) and harbored a nearly complete copy of the human genome, plus additional fragments (Supplementary Figure 2). The human genome was represented with 3.8 -fold ± 1.3 redundancy in the 15 clones.

Centromeres showed increased retention, since they stabilize the donated human DNA fragments (Wang et al., 2011; Khan et al., 2020) (Figures 1B–D, Supplementary Figure 1E). Fragments containing centromeres were also significantly longer than other fragments, due to the large size of these chromosomal elements (Supplementary Figure 1F). The human TK1 gene was used as the marker to select hybrids, and its copy number was therefore 1.

Mapping Accuracy

Based on the average fragment length, retention frequency and panel size, the expected mapping resolution was 0.3 ± 1.2 Mb. We further estimated mapping resolution by evaluating the distance at which peak −log10P-values for cis linked 1 Mb windows decreased by one (−1log10P-values) (Supplementary Figure 3). The −1log10P-value was 1.0 Mb using −log10P-values plotted against distance and 2.2 Mb using distance against −log10P.

As a surrogate measure of mapping accuracy, we also evaluated the distance between the retention peak of TK1 and its known location (Khan et al., 2020). We did the same for the centromeres. The mapping resolution for TK1 was 33.3 ± 59.5 kb and for the centromeres, −0.5 ± 2.5 Mb (Supplementary Figure 4), neither of which were significantly different from the expected value of zero (P= 0.06 and 0.80, respectively).

Although there were substantial differences between the mapping accuracy estimates for this small RH panel, the resolution is probably of the order of ≲1 Mb.

Human Genetic Interactions

We identified human genetic interactions by seeking co-inheritance of distant genes (>2.4 Mb apart) across the 15 clones (Figure 2). Interactions are hence identified using data from all clones, rather than single clones. For example, if a gene shows a retention pattern of {100110001000000} across the clones and a distant gene shows the same pattern, there is significant co-inheritance. Fisher's exact test was used to assess significance (false discovery rate, FDR < 0.05).

FIGURE 2
www.frontiersin.org

Figure 2. Chromosome plots of human genetic interactions. (A) Co-inheritance of peak window at TRIQK and windows on Chromosome 5, with FBLL1 exceeding significance thresholds. (B) Co-inheritance of FBLL1 and windows on Chromosome 8, with TRIQK exceeding significance thresholds. (C) Co-inheritance of GFRA1 and windows on Chromosome 6, with LCA5 exceeding significance thresholds. (D) Co-inheritance of LCA5 and windows on Chromosome 10, with GFRA1 exceeding significance thresholds. Green horizontal line, P = 0.05, Red horizontal line, FDR = 0.05.

Interacting genes were identified as genes closest to a −log10P peak consisting of a single window pair, with neighboring window pairs showing decreased significance. Because the selection procedure for interaction peaks ignores “plateaus” of −log10P-values, the realized mapping resolution may be better than our empirical estimates. In fact, the resolution may be of the order of the 10 kb steps, close to the estimate using TK1 retention.

We restricted our analysis to coding region genes to facilitate comparison with the legacy RH-PCR network as well as PPI networks. A total of 2,359 interactions connecting 225 genes were found in the RH-Seq network, with a mean degree of 21.0 ± 1.4 (Figures 3A,B, Supplementary Figure 5, Supplementary Table 1).

FIGURE 3
www.frontiersin.org

Figure 3. Human genetic interactions. (A) Location and significance of interactions. (B) Circos plot of interactions. Outer track, location of interacting genes; inner track, histograms of interaction numbers normalized for each chromosome. Location of PCDH7 on Chromosome 4 shown. (C) Number of interactions for each gene. PCDH7 has the most. (D) Subnetwork featuring PCDH7.

All interactions in the RH-Seq network were “attractive,” in which gene co-retention occurred more often than expected by chance. Gene pairs that interact as extra copies thus promote cell growth. The interactions in our original RH-PCR network were also overwhelmingly attractive (Lin et al., 2010). This finding contrasts with loss-of-function alleles in yeast and cancer cells, where some allele combinations promoted, while others inhibited, growth (Costanzo et al., 2016, 2019; Horlbeck et al., 2018).

PCDH7 had the largest number of interactions in the RH-Seq network, 81 (Figures 3B–D). In addition, PCDH7 regulated the expression of the most genes (614) in a mouse RH panel (Park et al., 2008; Ahn et al., 2009). Perhaps genes with many interactions also regulate the expression of many genes.

Clone Numbers and Genetic Interactions

Because the RH-Seq network used only 15 clones, the −log10P plots displayed discrete values (Figure 2). This phenomenon was also shown by the number of interactions for each gene (Figure 3C). The null expectation for the number of clones harboring two distant genes is 0.96±0.04, while the observed number for the significant genes was 3.35±0.01 (Supplementary Table 1). The minimum clone number for significant interactions was 2, corresponding to 104 interactions (4.4%).

There was no obvious relationship between the number of clones harboring interacting genes and the discrete interaction numbers of 24–28 (number of clones, 4.0±0.0) and 54–57 (number of clones, 3 ± 0) (Figure 3C). In particular, PCDH7, which showed the largest number of interactions, had 3.3±0.1 clones harboring the gene and its interacting partners. Thus, genes with many interactions did not appear to be driven by an inordinately small number of clones.

Overlaps With RH-PCR and PPI Networks

We found highly significant FDR corrected overlap between the RH-Seq interaction network and the legacy RH-PCR network (Figures 4A,B). The overlap significance diminishes as threshold increases, due to decreased numbers (maximum overlap, FDR < 2.2 × 10−16, odds ratio = 3.1, 97 common interactions, 32 expected). Considering the limited power of the RH-Seq dataset, the overlap is encouraging.

FIGURE 4
www.frontiersin.org

Figure 4. Overlaps of RH-Seq network. (A) Overlap of RH-Seq and RH-PCR networks, thresholded on RH-PCR −log10P (abscissa). (B) Overlap of RH-Seq and RH-PCR networks, thresholded on RH-Seq −log10P. (C) Overlap of RH-Seq and STRING interactions, thresholded on STRING score. (D) Overlap of RH-Seq and STRING interactions, thresholded on RH-Seq −log10P. Horizontal red lines, FDR = 0.05.

We also found less strong, but still significant, overlap between the RH-Seq interaction network and the STRING v11 PPI database (maximum overlap, FDR = 4.64 × 10−2, odds ratio = 2.23, 25 common interactions, 11 expected) (Figures 4C,D) (Szklarczyk et al., 2019). The decreased overlap may reflect the different data ascertainment methods of RH-Seq and STRING.

The peak overlap significance between RH-Seq and STRING occurred at intermediate thresholds and is likely driven by two competing trends—as the STRING score increases, the quality of interactions improves while the number of potential overlaps decreases. Concerns that the overlap is only detected at specific thresholds is alleviated by the observation that it survives FDR correction.

The overlap between the RH-Seq and RH-PCR networks is not caused by a few genes with many interactions, since the most significant overlap included all significant interactions (Figures 4A,B). Similarly, the RH-Seq genes at the most significant overlap of the RH-Seq network with STRING (Figures 4C,D) showed significantly lower degree (10.2±0.8) than the null (P = 7.4 × 10−11).

We found no overlap of the RH-Seq network with four other PPI datasets, BioGRID, HIPPIE, HINT and a yeast two-hybrid dataset, reflecting the modest size of the RH-Seq network (Das and Yu, 2012; Alanis-Lobato and Schaefer, 2020; Bajpai et al., 2020; Luck et al., 2020; Oughtred et al., 2021).

Nevertheless, the overlap of the RH-Seq and STRING networks suggests that gene products which interact to promote cell growth may also interact physically. A similar overlap was found between loss-of-function genetic interactions using CRISPRi in two cancer cell lines and the STRING database (Horlbeck et al., 2018). There was no overlap between the RH-Seq and the CRISPRi networks, but it is difficult to draw firm conclusions about the similarities and differences of these networks given that each are of limited size.

Overlaps With Disease and Gene Ontology Networks

The original RH-PCR interaction network showed significant overlap with networks constructed using a gene-disease database and using gene ontology (GO) (Lin et al., 2010; Pletscher-Frankild et al., 2015; Gene Ontology Consortium, 2021). We found that the RH-Seq network also overlapped with these networks (Supplementary Figure 6).

Due to diminishing interaction numbers, the overlap significance of the RH-Seq and gene-disease networks decreased as the −log10P threshold increased (Supplementary Figure 6A). Since maximum significance occurred when all interactions were considered, the overlaps were not dominated by a small number of genes with many interactions.

The RH-Seq and GO networks showed maximum overlap at intermediate thresholds, representing the competing trends of improving interaction quality and decreasing overlap numbers (Supplementary Figure 6B). The RH-Seq network genes at the peak overlap had significantly lower degree (5.56±0.6) than the null (P < 2.2 × 10−16), suggesting that the overlap was not due to genes of high degree. The significant overlaps of RH-Seq with the gene-disease and GO datasets suggest that interacting genes may cause similar diseases and have similar functions.

Clustering of the RH-Seq Network

The RH-Seq network appeared to have many mutually interacting genes, or cliques (Figure 3). The clustering coefficient (or transitivity) of a network evaluates its propensity to be divided into clusters (Pavlopoulos et al., 2011). The RH-Seq network had a much higher clustering coefficient (0.82±0.02) than the RH-PCR network (0.13±9.6 × 10−5).

We constructed a subnetwork from the RH-PCR dataset using the same genes as the RH-Seq network. This subnetwork showed a significantly increased clustering coefficient (0.31±1.58 × 10−3.), although not as high as the original RH-PCR network (P < 2.2 × 10−16, all comparisons). Nevertheless, the increased clustering coefficient of the RH-Seq network is likely genuine. Genes with many mutual interactions may be preferentially ascertained in small networks. Larger RH-Seq datasets are likely to have decreased clique sizes and clustering coefficients.

A heatmap of the RH-Seq network demonstrated that it consists of ~ 10–15 cliques (Figure 5, Supplementary Table 2). The five largest clusters comprised 124 genes (55% of the total) and 2,126 interactions (90% of the total), reflecting the high clustering coefficient of the RH-Seq network (Supplementary Table 1). The largest cluster, cluster 1, comprised 56 genes (25%) and 1,534 interactions (65%).

FIGURE 5
www.frontiersin.org

Figure 5. Clustering of the RH-Seq network. The five largest clusters are highlighted, together with the top three GO biological process terms for each cluster. Horizontal gray bars, GO −log10P-values; vertical green lines, P = 0.05 (all FDRs > 0.05). The entire network is shown, but space only allows labeling of ~13rd of the 225 genes.

In each cluster, we evaluated the number of RH clones containing both interacting genes. Of the five cliques, three had increased clone numbers and two had decreased. Cluster 4 had the most clones (5 ± 0) and cluster 5 had the least (2 ± 0). The cliques did not appear to be driven solely by small clone numbers.

We examined the functional enrichment of the five largest clusters using the biological process term of GO (Gene Ontology Consortium, 2021) (Figure 5). The genes in each cluster showed nominally significant enrichment (P < 0.05, but FDR > 0.05). For example, cluster 1 was enriched in genes related to transcription and cell division, cluster 2 in morphogenesis and cluster 4 in transmembrane ion transport. This enrichment suggests that the clusters represent functionally relevant gene groups.

RH-Seq Network and Growth Genes

We recently used selection of pooled RH cells to identify mammalian growth genes (Khan et al., 2020). Consistent with the idea that the RH-Seq interaction network is involved in control of cell proliferation, there was significant overlap between the RH-Seq network and the RH growth genes (Figures 6A,B). In contrast, both the RH-Seq network genes and RH growth genes (Khan et al., 2020) showed significant non-overlap with growth genes identified in CRISPR loss-of-function screens, depending on the cell type (Hart et al., 2015; Wang et al., 2015) (Figures 6C–F). These observations support the idea that over-expression alters cell physiology differently from loss-of-function, and suggests that the two approaches will give complementary interaction networks.

FIGURE 6
www.frontiersin.org

Figure 6. RH-Seq network and growth genes. (A) Overlap of RH-Seq network and RH growth genes, thresholded on RH-Seq network −log10P. Overlap significance diminishes as threshold increases due to decreased numbers. (B) Overlap of RH-Seq network and RH growth genes, thresholded on RH growth gene −log10P. (C) RH-Seq interaction genes (RH+) show lower growth effects when inactivated using CRISPR than non-interaction genes (RH−). Higher −CS values (CRISPR score times −1) mean stronger growth effects of CRISPR null alleles (Wang et al., 2015). P-values shown above comparisons. (D) RH-Seq interaction genes show lower growth effects when inactivated using CRISPR. Higher Bayes factors (BF) means stronger growth effect of CRISPR null alleles (Hart et al., 2015). (E) Significant non-overlap of RH-Seq network genes and CRISPR growth genes, thresholded on −CS score. (F) Non-overlap of RH-Seq network genes and CRISPR growth genes, thresholded on BF score. Horizontal red lines, FDR = 0.05.

RH-Seq Network and Expression

The genes in the RH-Seq network showed decreased expression in a human RH panel (Supplementary Figure 7A), but not in the GTEx dataset (v8) of human tissue expression (Supplementary Figure 7B) (Wang et al., 2011; GTEx Consortium, 2020). Similarly, the RH growth genes showed decreased expression in both the human RH panel and the GTEx dataset (Khan et al., 2020). Genes identified for their interactions and growth effects as a result of an extra copy are likely to be evolutionarily selected for decreased expression.

Functional Enrichment

The interacting genes in the RH-Seq network were highly enriched in cancer terms from a disease database (FDR < 0.05), with the top eight terms being cancer related (Supplementary Figures 8A,B, 9A) (Pletscher-Frankild et al., 2015; Kuleshov et al., 2016). This observation is consistent with a key role for the RH-Seq network in cell proliferation. Examples of cancer related genes in the network included GAS6, MAP3K4, PRKD1, PTPRD, and VEGFA.

The RH-Seq interaction network was also significantly enriched in the catalog of human genome-wide association studies (GWAS) (Kuleshov et al., 2016) and in the NCBI Database of Genotypes and Phenotypes (dbGaP; https://www.ncbi.nlm.nih.gov/gap/) (FDR < 0.05; Supplementary Figures 8C, 9B,C). The same was true for the RH growth genes (Khan et al., 2020). In contrast, growth genes from loss-of-function CRISPR screens showed no such enrichment. The effects of an extra gene copy in the RH cells may be closer to the mild effects of common disease variants than the more severe effects of a knockout.

Gene ontology analysis (GO) of all the genes in the RH-Seq network revealed enrichment in a number of categories related to cell growth (P < 0.05, but FDR > 0.05), including cell proliferation, p38MAPK, growth factor, tyrosine kinase and replication fork (Supplementary Figures 10, 11) (Gene Ontology Consortium, 2021).

Evolutionary Properties of RH-Seq Network Genes

The RH-Seq network genes displayed significantly decreased numbers of duplications (paralogs) (Supplementary Figure 12A). The evolutionary selection against duplication of the RH-Seq network genes is consistent with their effects on cell survival as an extra copy. Similarly, the RH growth genes also showed decreased numbers of paralogs (Khan et al., 2020).

The RH-Seq network genes exhibited increased evolutionary conservation, with decreased tolerance to loss-of-function (LOF) variants (Supplementary Figure 12B) and decreased mouse-human sequence divergence (Supplementary Figure 12C). However, there was no significant increase in the number of species with orthologs of the network genes (“phyletic retention”), another measure of evolutionary conservation (Supplementary Figure 12D). The RH growth genes also displayed increased evolutionary conservation (Khan et al., 2020). Both the RH-Seq network genes and the RH growth genes had increased gene lengths (Supplementary Figures 12E–H).

Discussion

We created a genetic interaction network using 15 RH clones. Gene interactions were identified by seeking unlinked gene pairs that showed significant co-retention. We used low pass sequencing of nascent RH clones to save labor and consumable costs, while obtaining high quality genotyping.

Unlike approaches such as weighted correlation network analysis (WGCNA), which use similarity of gene expression to assign function (Langfelder and Horvath, 2008), the endpoint of the RH approach is cell proliferation. The RH network therefore plays a causative, rather than correlative, role in cell viability.

The RH-Seq network showed highly significant overlap with the original RH-PCR network. Unidentified systematic error is unlikely to the cause of this agreement. The RH-Seq and RH-PCR networks were obtained from separate data sources (our laboratory vs. six different laboratories studying four species), distinct genotyping technologies (low pass genome sequencing vs. PCR) and independent coding and bioinformatics pipelines. The RH-Seq network also showed less strong, but still significant, overlap with the STRING PPI database.

The large number of potential interactions in the networks means that significance can occur even with modest overlaps. Nevertheless, considering the small size of the RH-Seq dataset, the significant overlaps suggest that this strategy is a reproducible and scalable approach to genetic interaction networks.

The high clustering coefficient of the RH-Seq network is likely genuine, since a RH-PCR subnetwork with the same genes also showed significantly increased clustering. We speculate that the high modularity of the RH-Seq network may reflect its derivation from nascent clones. Newly emerging clones may rely heavily on three way and higher order interactions for viability, leading to the apparent increased clustering of the network (Crona et al., 2017; Costanzo et al., 2019). A properly powered analysis of this supposition will require a larger dataset.

The RH-Seq network genes displayed significant overlap with RH growth genes but non-overlap with growth genes identified using CRISPR loss-of-function screens. The extra gene copies used by the RH approach will provide complementary insights into cell physiology compared to loss-of-function networks.

The interacting RH-Seq genes were enriched in terms related to cancer in a gene-disease database, suggesting that the RH network strategy is relevant to cell proliferation and may provide new therapeutic insights into tumorigenesis.

Both the RH-Seq interaction genes and the RH growth genes showed significant enrichment in the GWAS and dbGaP databases, while the CRISPR growth genes did not (Khan et al., 2020). Most variants that contribute to complex traits are in non-coding regions and affect gene expression (Gallagher and Chen-Plotkin, 2018). The significant enrichment of the RH-Seq network genes in the GWAS and dbGaP databases may reflect the milder physiological effects of an extra gene copy driven by its natural promoter, compared to the more severe effects caused by CRISPR loss-of-function alleles or overexpression using CRISPRa.

It has been suggested that cataloging genetic interactions will help illuminate the “missing heritability” in complex traits (Costanzo et al., 2019). The enrichment of the RH-Seq network genes in the GWAS and dbGaP catalogs suggests that the RH genetic interaction networks will be particularly relevant to understanding complex traits.

The cost of RH-Seq for mapping genetic interactions compares favorably to other approaches. Comprehensive coverage of the protein encoding interactome using CRISPR would require ~20,000 separate experiments. The RH-Seq approach offers the cost savings of low pass sequencing and lack of clone propagation. Further, each RH clone harbors ~0.25 times the human genome and therefore evaluates multiple genes in each cell. In contrast, CRISPR strategies evaluate only a single gene in each cell. The additional layer of multiplexing in RH-Seq lends efficiency to the construction of genetic interactions maps. In fact, the size of the RH-Seq network obtained using 15 clones (225 genes) is comparable to a recent large CRISPRi study, which examined genetic interactions for <450 genes in cancer cells (Horlbeck et al., 2018).

The consumable cost per clone is ≲$50 in RH-Seq, making the cost of analyzing 1,000 clones feasible. The labor costs of data acquisition are also far lower than the other strategies. One individual could easily create and analyze 1,000 clones. In addition to high statistical power, such a panel would have mapping resolution of 4 ± 18 kb, sufficient to confidently map individual genes (Lin et al., 2010).

The cost advantages of the RH-Seq strategy will allow it to be applied to wider areas. Analyzing nascent clones identifies the genetic interactions necessary for initial viability. Further culture of the clones will allow the evolution of genetic interactions to be evaluated over time. Expanding the cell fusion reaction to isogenic human cell lines will allow genetic networks to be mapped in the presence or absence of oncogenic mutations. Although these more ambitious experiments will increase costs, using 1,000 RH clones would only be 5 % of the consumable cost of CRISPR approaches.

An additional advantage of the RH-Seq approach is that non-coding genes can be incorporated into the genetic network on an equal footing with coding genes (Khan et al., 2020). This extension will not increase the cost of the RH-Seq network, but would increase the cost of a CRISPR network nine-fold. In addition, the RH-Seq approach can evaluate haploinsufficient genes, which are difficult to assess using loss-of-function methods.

Low pass sequencing of nascent RH clones is a realistic and affordable approach to constructing comprehensive genetic interaction maps of the human genome. The strategy can be scaled in a cost-effective fashion to evaluate genetic networks that contribute to cancer and other complex disorders, providing new therapeutic insights.

Methods

Cells

We used human HEK293 (TK1+) and hamster A23 cells (TK1-), each previously validated by low pass sequencing (Khan et al., 2020). Cell fusion was performed as described (Khan et al., 2020). Before fusion, A23 cells were grown in the presence or absence of bromodeoxyuridine (BrdU, 0.03 mg ml-1). We irradiated the HEK293 cells using 100 (Gray) Gy, with an expected fragment length of 4 Mb, close to the observed. After fusion, cells were plated at a dilution of 1:10 in selective HAT medium (100 μM hypoxanthine, 0.4 μM aminopterin, 16 μM thymidine; Thermo Fisher Scientific®). RH clones (TK1+) were picked at 3 weeks.

Sequencing

DNA was purified from 24 clones (20 BrdU and 4 non-BrdU) using the Illumina Nextera™ DNA Flex Library kit, following manufacturer's instructions. Human DNA quantities as low as 100 ng can be sequenced using this kit. Illumina sequencing employed 65 bp single reads.

We obtained human-specific reads by aligning reads to the GRCh38/hg38 human genome assembly (hg38.fa) at high stringency, allowing only one mismatch (Khan et al., 2020). Reads that also aligned to the Chinese hamster (Cricetulus griseus) genome assembly (RAZU01) (Rupp et al., 2018) were then discarded, leaving human-specific reads. Alignments were quantitated using the number of human-specific reads per 1 Mb window with 10 kb steps (Khan et al., 2020).

A total of 16.0 ± 1.3 M reads were obtained for each of the 24 clones. Based on the similarity of human-specific reads across the genome a total of 9 clones were duplicates, presumably due to cell dispersion before clone picking (R > 0.9). Seven clones were duplicates of clone 1, and two were duplicates of clone 9. The 15 independent clones, 11 from BrdU and 4 from non-BrdU, were used to construct the interaction network.

There was no significant difference in the retention frequency of the BrdU (0.25 ± 0.10) and non-BrdU clones (0.27 ± 0.18, P= 0.90). While there were sufficient BrdU clones to identify significant co-inheritance (P ≥ 2.2 × 10−3), there were insufficient non-BrdU clones by themselves (P ≥ 0.25). In the independent RH clones, there were 589 ± 135 reads in 1 Mb windows containing human fragments and 18 ± 3 in those without.

Evaluating Mapping Accuracy

To measure mapping resolution, we used the significance of cis linkage for windows separated by <20 Mb. Linear models were employed to estimate initial slopes relating the −log10P-values and the distances between the windows and vice versa. The slopes were then employed to quantitate −1log10P-values.

We also used the human DNA retention profiles averaged across the 15 clones to evaluate mapping accuracy. The midpoints of retention peaks for TK1 or the centromeres were taken as the estimated location of each element (Khan et al., 2020). The distance between the estimated and actual midpoint positions was the mapping resolution. Standard errors of the mean were assessed by bootstrapping.

Genetic Interactions

Relative copy numbers in the 1 Mb windows were calculated by normalizing human-specific sequence reads to those at TK1 in each clone. TK1 has a retention frequency of one, since it is the marker used to select RH clones. A window was deemed to harbor a human DNA fragment if log2(relative copy number + 1) > 0.2, corresponding to the upper 28th percentile of values and a relative copy number of 0.15 .

Fisher's exact test was used to identify pairs of windows separated by > 2.4 Mb (upper 49th percentile of fragment lengths) with significant co-inheritance (FDR < 0.05). FDR correction used a sample of P-values from the 4.5 × 105 window pairs, a conservative procedure (Benjamini and Hochberg, 1995).

To ensure uniform sampling of the P-values while preventing systematic bias, the rows of the interaction matrix were sampled with a spacing of 1 in 100, and the columns were sampled pseudorandomly, with a minimum spacing of one window, a maximum of 2.4 × 104 and a mean of 1.2 × 104. FDR values were calculated from the 3.9 × 104 sampled P-values.

A genetic interaction was ascertained if the −log10P peak was a single window pair with FDR < 0.05, and adjacent window pairs had decreased −log10P-values. The genes corresponding to the interaction peak were taken as the nearest protein coding genes using GENCODE v31 (Frankish et al., 2021).

Networks

The gene-disease network was constructed using a literature based database (Pletscher-Frankild et al., 2015). Genes sharing the same disease were linked together, yielding a network with 16,254 genes and 23,983,208 interactions. The GO network was constructed by linking genes sharing the same GO categories containing ≥70 and ≤ 1,000 members (Lin et al., 2010). The network consisted of 16,902 genes and 9,581,750 interactions.

The significance of network overlaps were FDR corrected for the number of thresholded comparisons, as previously described (Ahn et al., 2009).

Public Data

GO analyses used the 2021-01-01 release and the PANTHER Overrepresentation Test, as well as Enrichr (Kuleshov et al., 2016; Gene Ontology Consortium, 2021). The duplicated genes database (DGD) together with Ensembl release 71 was used to identify paralogs (Ouedraogo et al., 2012).

Intolerance of human genes to predicted loss-of-function (pLoF) variants was evaluated using the observed/expected ratio from the Genome Aggregation Database (gnomAD) release 2.1.1. (Karczewski et al., 2020). We assessed the evolutionary divergence of mouse-human homologs using the ratio of non-synonymous to synonymous substitutions (dN/dS) in Ensembl release 97 (Cunningham et al., 2019). The number of species with gene orthologs was evaluated using Homologene release 68 (Sayers et al., 2019). Unless otherwise noted, tests of significance used Welch's Two Sample t-test.

Data Availability Statement

The sequencing data generated in this study can be downloaded from the NCBI BioProject database (https://www.ncbi.nlm.nih.gov/bioproject/) under accession number PRJNA714684. Other data, tables and computer scripts are available from figshare (https://figshare.com/; http://dx.doi.org/10.6084/m9.figshare.14481258).

Author Contributions

AK: acquisition of data, analysis and interpretation of data, and drafting or revising the article. DS: conception and design, analysis and interpretation of data, and drafting or revising the article. Both authors contributed to the article and approved the submitted version.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Acknowledgments

We acknowledge the UCLA Semel Institute Neurosciences Genomics Core for sequencing. This work used computational and storage services associated with the Hoffman2 Shared Cluster provided by the UCLA Institute for Digital Research and Education Research Technology Group.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fgene.2021.703738/full#supplementary-material

References

Ahn, S., Wang, R. T., Park, C. C., Lin, A., Leahy, R. M., Lange, K., et al. (2009). Directed mammalian gene regulatory networks using expression and comparative genomic hybridization microarray data from radiation hybrids. PLoS Comput. Biol. 5:e1000407. doi: 10.1371/journal.pcbi.1000407

PubMed Abstract | CrossRef Full Text | Google Scholar

Alanis-Lobato, G., and Schaefer, M. H. (2020). Generation and interpretation of context-specific human protein-protein interaction networks with hippie. Methods Mol. Biol. 2074, 135–144. doi: 10.1007/978-1-4939-9873-9_11

PubMed Abstract | CrossRef Full Text | Google Scholar

Avner, P., Bruls, T., Poras, I., Eley, L., Gas, S., Ruiz, P., et al. (2001). A radiation hybrid transcript map of the mouse genome. Nat. Genet. 29, 194–200. doi: 10.1038/ng1001-194

PubMed Abstract | CrossRef Full Text | Google Scholar

Bajpai, A. K., Davuluri, S., Tiwary, K., Narayanan, S., Oguru, S., Basavaraju, K., et al. (2020). Systematic comparison of the protein-protein interaction databases from a user's perspective. J. Biomed. Inform. 103:103380. doi: 10.1016/j.jbi.2020.103380

PubMed Abstract | CrossRef Full Text | Google Scholar

Benjamini, Y., and Hochberg, Y. (1995). Controlling the false discovery rate - a practical and powerful approach to multiple testing. J. R. Stat. Soc. Ser. B Stat. Methodol. 57, 289–300. doi: 10.1111/j.2517-6161.1995.tb02031.x

CrossRef Full Text | Google Scholar

Costanzo, M., Kuzmin, E., van Leeuwen, J., Mair, B., Moffat, J., Boone, C., et al. (2019). Global genetic networks and the genotype-to-phenotype relationship. Cell 177, 85–100. doi: 10.1016/j.cell.2019.01.033

PubMed Abstract | CrossRef Full Text | Google Scholar

Costanzo, M., VanderSluis, B., Koch, E. N., Baryshnikova, A., Pons, C., Tan, G., et al. (2016). A global genetic interaction network maps a wiring diagram of cellular function. Science 353:6306. doi: 10.1126/science.aaf1420

PubMed Abstract | CrossRef Full Text | Google Scholar

Cox, D. R., Burmeister, M., Price, E. R., Kim, S., and Myers, R. M. (1990). Radiation hybrid mapping: a somatic cell genetic method for constructing high-resolution maps of mammalian chromosomes. Science 250, 245–250. doi: 10.1126/science.2218528

PubMed Abstract | CrossRef Full Text | Google Scholar

Crona, K., Gavryushkin, A., Greene, D., and Beerenwinkel, N. (2017). Inferring genetic interactions from comparative fitness data. Elife 6:e28629. doi: 10.7554/eLife.28629.018

PubMed Abstract | CrossRef Full Text | Google Scholar

Cunningham, F., Achuthan, P., Akanni, W., Allen, J., Amode, M. R., Armean, I. M., et al. (2019). Ensembl 2019. Nucl. Acids Res. 47, D745–D751. doi: 10.1093/nar/gky1113

CrossRef Full Text | Google Scholar

Das, J., and Yu, H. (2012). Hint: High-quality protein interactomes and their applications in understanding human disease. BMC Syst. Biol. 6:92. doi: 10.1186/1752-0509-6-92

PubMed Abstract | CrossRef Full Text | Google Scholar

Frankish, A., Diekhans, M., Jungreis, I., Lagarde, J., Loveland, J. E., Mudge, J. M., et al. (2021). Gencode 2021. Nucl. Acids Res. 49, D916–D923. doi: 10.1093/nar/gkaa1087

CrossRef Full Text | Google Scholar

Gallagher, M. D., and Chen-Plotkin, A. S. (2018). The post-GWAS era: from association to function. Am. J. Hum. Genet. 102, 717–730. doi: 10.1016/j.ajhg.2018.04.002

CrossRef Full Text | Google Scholar

Gene Ontology Consortium (2021). The gene ontology resource: enriching a gold mine. Nucl. Acids Res. 49, D325–D334. doi: 10.1093/nar/gkaa111

CrossRef Full Text | Google Scholar

Gilbert, L. A., Horlbeck, M. A., Adamson, B., Villalta, J. E., Chen, Y., Whitehead, E. H., et al. (2014). Genome-scale crispr-mediated control of gene repression and activation. Cell 159, 647–661. doi: 10.1016/j.cell.2014.09.029

PubMed Abstract | CrossRef Full Text | Google Scholar

Goss, S. J., and Harris, H. (1975). New method for mapping genes in human chromosomes. Nature 255, 680–684. doi: 10.1038/255680a0

PubMed Abstract | CrossRef Full Text | Google Scholar

GTEx Consortium (2020). The GTEx Consortium atlas of genetic regulatory effects across human tissues. Science 369, 1318–1330. doi: 10.1126/science.aaz1776

CrossRef Full Text | Google Scholar

Hart, T., Chandrashekhar, M., Aregger, M., Steinhart, Z., Brown, K. R., MacLeod, G., et al. (2015). High-resolution CRISPR screens reveal fitness genes and genotype-specific cancer liabilities. Cell 163, 1515–1526. doi: 10.1016/j.cell.2015.11.015

PubMed Abstract | CrossRef Full Text | Google Scholar

Horlbeck, M. A., Xu, A., Wang, M., Bennett, N. K., Park, C. Y., Bogdanoff, D., et al. (2018). Mapping the genetic landscape of human cells. Cell 174, 953–967.e22. doi: 10.1016/j.cell.2018.06.010

PubMed Abstract | CrossRef Full Text | Google Scholar

Hudson, T. J., Church, D. M., Greenaway, S., Nguyen, H., Cook, A., Steen, R. G., et al. (2001). A radiation hybrid map of mouse genes. Nat. Genet. 29, 201–205. doi: 10.1038/ng1001-201

PubMed Abstract | CrossRef Full Text | Google Scholar

Kampmann, M. (2018). Crispri and crispra screens in mammalian cells for precision biology and medicine. ACS Chem. Biol. 13, 406–416. doi: 10.1021/acschembio.7b00657

PubMed Abstract | CrossRef Full Text | Google Scholar

Karczewski, K. J., Francioli, L. C., Tiao, G., Cummings, B. B., Alföldi, J., Wang, Q., et al. (2020). The mutational constraint spectrum quantified from variation in 141,456 humans. Nature 581, 434–443. doi: 10.1038/s41586-020-2308-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Khan, A. H., Lin, A., Wang, R. T., Bloom, J. S., Lange, K., and Smith, D. J. (2020). Pooled analysis of radiation hybrids identifies loci for growth and drug action in mammalian cells. Genome Res. 30, 1458–1467. doi: 10.1101/gr.262204.120

PubMed Abstract | CrossRef Full Text | Google Scholar

Kuleshov, M. V., Jones, M. R., Rouillard, A. D., Fernandez, N. F., Duan, Q., Wang, Z., et al. (2016). EnrichR: a comprehensive gene set enrichment analysis web server 2016 update. Nucl. Acids Res. 44, W90–W97. doi: 10.1093/nar/gkw377

PubMed Abstract | CrossRef Full Text | Google Scholar

Kwitek, A. E., Gullings-Handley, J., Yu, J., Carlos, D. C., Orlebeke, K., Nie, J., et al. (2004). High-density rat radiation hybrid maps containing over 24,000 SSLPs, genes, and ESTs provide a direct link to the rat genome sequence. Genome Res. 14, 750–757. doi: 10.1101/gr.1968704

PubMed Abstract | CrossRef Full Text | Google Scholar

Langfelder, P., and Horvath, S. (2008). WGCNA: an r package for weighted correlation network analysis. BMC Bioinformatics 9:559. doi: 10.1186/1471-2105-9-559

PubMed Abstract | CrossRef Full Text | Google Scholar

Lin, A., and Smith, D. J. (2015). “Copy number networks to guide combinatorial therapy of cancer and proliferative disorders,” in Emerging Trends in Computational Biology, Bioinformatics, and Systems Biology - Algorithms and Software Tools, eds Q. N. Tran and H. Arabnia (Waltham, MA: Elsevier Morgan Kaufmann), 401–419. doi: 10.1016/B978-0-12-802508-6.00021-1

CrossRef Full Text | Google Scholar

Lin, A., Wang, R. T., Ahn, S., Park, C. C., and Smith, D. J. (2010). A genome-wide map of human genetic interactions inferred from radiation hybrid genotypes. Genome Res. 20, 1122–1132. doi: 10.1101/gr.104216.109

PubMed Abstract | CrossRef Full Text | Google Scholar

Luck, K., Kim, D.-K., Lambourne, L., Spirohn, K., Begg, B. E., Bian, W., et al. (2020). A reference map of the human binary protein interactome. Nature 580, 402–408. doi: 10.1038/s41586-020-2188-x

PubMed Abstract | CrossRef Full Text | Google Scholar

Mair, B., Moffat, J., Boone, C., and Andrews, B. J. (2019). Genetic interaction networks in cancer cells. Curr. Opin. Genet. Dev. 54, 64–72. doi: 10.1016/j.gde.2019.03.002

PubMed Abstract | CrossRef Full Text | Google Scholar

McCarthy, L. C. (1996). Whole genome radiation hybrid mapping. Trends Genet. 12, 491–493. doi: 10.1016/S0168-9525(96)30110-8

CrossRef Full Text | Google Scholar

McCarthy, L. C., Bihoreau, M. T., Kiguwa, S. L., Browne, J., Watanabe, T. K., Hishigaki, H., et al. (2000). A whole-genome radiation hybrid panel and framework map of the rat genome. Mamm. Genome 11, 791–795. doi: 10.1007/s003350010132

PubMed Abstract | CrossRef Full Text | Google Scholar

Olivier, M., Aggarwal, A., Allen, J., Almendras, A. A., Bajorek, E. S., Beasley, E. M., et al. (2001). A high-resolution radiation hybrid map of the human genome draft sequence. Science 291, 1298–1302. doi: 10.1126/science.1057437

PubMed Abstract | CrossRef Full Text | Google Scholar

Ouedraogo, M., Bettembourg, C., Bretaudeau, A., Sallou, O., Diot, C., Demeure, O., et al. (2012). The duplicated genes database: identification and functional annotation of co-localised duplicated genes across genomes. PLoS ONE 7:e50653. doi: 10.1371/journal.pone.0050653

PubMed Abstract | CrossRef Full Text | Google Scholar

Oughtred, R., Rust, J., Chang, C., Breitkreutz, B.-J., Stark, C., Willems, A., et al. (2021). The biogrid database: a comprehensive biomedical resource of curated protein, genetic, and chemical interactions. Protein Sci. 30, 187–200. doi: 10.1002/pro.3978

PubMed Abstract | CrossRef Full Text | Google Scholar

Park, C. C., Ahn, S., Bloom, J. S., Lin, A., Wang, R. T., Wu, T., et al. (2008). Fine mapping of regulatory loci for mammalian gene expression using radiation hybrids. Nat. Genet. 40, 421–429. doi: 10.1038/ng.113

PubMed Abstract | CrossRef Full Text | Google Scholar

Pavlopoulos, G. A., Secrier, M., Moschopoulos, C. N., Soldatos, T. G., Kossida, S., Aerts, J., et al. (2011). Using graph theory to analyze biological networks. BioData Min. 4:10. doi: 10.1186/1756-0381-4-10

PubMed Abstract | CrossRef Full Text | Google Scholar

Pletscher-Frankild, S., Pallejá, A., Tsafou, K., Binder, J. X., and Jensen, L. J. (2015). Diseases: text mining and data integration of disease-gene associations. Methods 74, 83–89. doi: 10.1016/j.ymeth.2014.11.020

PubMed Abstract | CrossRef Full Text | Google Scholar

Prelich, G. (2012). Gene overexpression: uses, mechanisms, and interpretation. Genetics 190, 841–854. doi: 10.1534/genetics.111.136911

PubMed Abstract | CrossRef Full Text | Google Scholar

Rupp, O., MacDonald, M. L., Li, S., Dhiman, H., Polson, S., Griep, S., et al. (2018). A reference genome of the Chinese hamster based on a hybrid assembly strategy. Biotechnol. Bioeng. 115, 2087–2100. doi: 10.1002/bit.26722

PubMed Abstract | CrossRef Full Text | Google Scholar

Sayers, E. W., Agarwala, R., Bolton, E. E., Brister, J. R., Canese, K., Clark, K., et al. (2019). Database resources of the National Center for Biotechnology Information. Nucl. Acids Res. 47, D23–D28. doi: 10.1093/nar/gky1069

PubMed Abstract | CrossRef Full Text | Google Scholar

Sopko, R., Huang, D., Preston, N., Chua, G., Papp, B., Kafadar, K., et al. (2006). Mapping pathways and phenotypes by systematic gene overexpression. Mol. Cell 21, 319–330. doi: 10.1016/j.molcel.2005.12.011

PubMed Abstract | CrossRef Full Text | Google Scholar

Szklarczyk, D., Gable, A. L., Lyon, D., Junge, A., Wyder, S., Huerta-Cepas, J., et al. (2019). STRING v11: protein-protein association networks with increased coverage, supporting functional discovery in genome-wide experimental datasets. Nucl. Acids Res. 47, D607–D613. doi: 10.1093/nar/gky1131

PubMed Abstract | CrossRef Full Text | Google Scholar

Walter, M. A., Spillett, D. J., Thomas, P., Weissenbach, J., and Goodfellow, P. N. (1994). A method for constructing radiation hybrid maps of whole genomes. Nat. Genet. 7, 22–28. doi: 10.1038/ng0594-22

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, R. T., Ahn, S., Park, C. C., Khan, A. H., Lange, K., and Smith, D. J. (2011). Effects of genome-wide copy number variation on expression in mammalian cells. BMC Genomics 12:562. doi: 10.1186/1471-2164-12-562

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, T., Birsoy, K., Hughes, N. W., Krupczak, K. M., Post, Y., Wei, J. J., et al. (2015). Identification and characterization of essential genes in the human genome. Science 350, 1096–1101. doi: 10.1126/science.aac7041

PubMed Abstract | CrossRef Full Text | Google Scholar

Yugandhar, K., Gupta, S., and Yu, H. (2019). Inferring protein-protein interaction networks from mass spectrometry-based proteomic approaches: a mini-review. Comput. Struct. Biotechnol. J. 17, 805–811. doi: 10.1016/j.csbj.2019.05.007

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: cancer, cell growth, complex traits, gene interactions, GWAS, radiation hybrid, genetic variants, copy number variants

Citation: Khan AH and Smith DJ (2021) Cost-Effective Mapping of Genetic Interactions in Mammalian Cells. Front. Genet. 12:703738. doi: 10.3389/fgene.2021.703738

Received: 30 April 2021; Accepted: 13 July 2021;
Published: 05 August 2021.

Edited by:

Youri I. Pavlov, University of Nebraska Medical Center, United States

Reviewed by:

Wen Wang, University of Minnesota Twin Cities, United States
Milind B. Ratnaparkhe, ICAR Indian Institute of Soybean Research, India

Copyright © 2021 Khan and Smith. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Desmond J. Smith, ZHNtaXRoJiN4MDAwNDA7bWVkbmV0LnVjbGEuZWR1

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.