- 1Institute of Mathematics, School of Science and Technology, Universidad Metropolitana, San Juan, Puerto Rico
- 2Department of Health Behavior, School of Public Health, University of Alabama at Birmingham, Birmingham, AL, USA
- 3Department of Statistics, Colegio de Postgraduados, Texcoco, México
- 4Division of Epidemiology and Biostatistics, Mel and Enid Zuckerman College of Public Health, University of Arizona, Tucson, AZ, USA
- 5Department of Biostatistics, School of Public Health, University of Alabama at Birmingham, Birmingham, AL, USA
Type 2 Diabetes (T2D) is a chronic disease arising from the development of insulin absence or resistance within the body, and a complex interplay of environmental and genetic factors. The incidence of T2D has increased throughout the last few decades, together with the occurrence of the obesity epidemic. The consideration of variants identified by Genome Wide Association Studies (GWAS) into risk assessment models for T2D could aid in the identification of at-risk patients who could benefit from preventive medicine. In this study, we build several risk assessment models, evaluated with two different classification approaches (Logistic Regression and Neural Networks), to measure the effect of including genetic information in the prediction of T2D. We used data from to the Original and the Offspring cohorts of the Framingham Heart Study, which provides phenotypic and genetic information for 5245 subjects (4306 controls and 939 cases). Models were built by using several covariates: gender, exposure time, cohort, body mass index (BMI), and 65 SNPs associated to T2D. We fitted Logistic Regressions and Bayesian Regularized Neural Networks and then assessed their predictive ability by using a ten-fold cross validation. We found that the inclusion of genetic information into the risk assessment models increased the predictive ability by 2%, when compared to the baseline model. Furthermore, the models that included BMI at the onset of diabetes as a possible effector, gave an improvement of 6% in the area under the curve derived from the ROC analysis. The highest AUC achieved (0.75) belonged to the model that included BMI, and a genetic score based on the 65 established T2D-associated SNPs. Finally, the inclusion of SNPs and BMI raised predictive ability in all models as expected; however, results from the AUC in Neural Networks and Logistic Regression did not differ significantly in their prediction accuracy.
Introduction
Type 2 Diabetes (T2D) is one of the fastest growing diseases in the United States and other developed nations (Nugent, 2008; Hu, 2011). In the last three decades, the number of Americans diagnosed with diabetes has tripled (from 5.6 to 20.9 million), making this a public health concern (CDC (Center for Disease Control), 2013). T2D is a chronic metabolic disease, characterized by high levels of glucose in the blood, and frequently caused by a deficiency of insulin secretion and/or the development of insulin resistance (the inability of cells to respond to the insulin). If not treated properly, it can produce kidney failure, blindness, and circulatory problems. (Manzella, 2007; Buijsse et al., 2011; Hu, 2011; Sanghera and Blackett, 2012). The interplay of environmental (i.e., sedentary life, obesity, lack of exercise, poor diet) and genetic factors (i.e., familial contribution), contribute to the etiology and epidemy of T2D, in addition to an estimated heritability of 26% (Poulsen et al., 1999). Since 2007, Genome Wide Association Studies known as GWAS, have identified and confirmed more than 50 loci associated with the development of T2D (Steinthorsdottir et al., 2007; Lindgren et al., 2009; Shu et al., 2010; Voight et al., 2010; Morris et al., 2012). Several genes identified so far are involved in encoding proteins necessary for insulin secretion, glucose metabolism, and beta-cell function, which are components that enable insulin production and insulin receptor activation in the body (Sladek et al., 2007; Steinthorsdottir et al., 2007; Yasuda et al., 2008).
Previous studies that have included genetic profiling and scores in T2D preventive models, have shown only a slight increase in predictive ability. Generally, the use of genetic variants provides a small contribution in terms of prediction accuracy due to their small effects, especially if compared to the use of age and clinically measured variables, such as BMI, and triglyceride levels and known risk factors for this disease (Saxena et al., 2007; Lyssenko et al., 2008; Voight et al., 2010; Vazquez et al., 2012). As of today, while there is excitement with the possibility of a more personalized medicine, medical professionals do not consider genotypic information as a variable in assessing patients' risk of developing T2D (Katsios, 2010; Lyssenko and Laakso, 2013). In several studies where risk assessment models have been built and tested, a few deficiencies have been noticed that could possibly have influenced their models' predictive ability. Such deficiency may arise due to the use of a model that so far does not capture the complexity of polygenic signals and their interaction with covariates. In addition, an ideal risk assessment model would incorporate the interplay of a substantial number of small-effect genes and several phenotypic variables (e.g., BMI) related to the development of T2D in order to get a more realistic and precise prediction (Lindstrom and Tuomilehto, 2003). However, by incorporating other phenotypes (also heritable) into the risk assessment models, pleiotropic genetic effects shared by both traits could be explained. BMI is an easy to measure phenotype, highly associated to diabetes and obesity and shown to be a strong predictor of diabetes (Lyssenko et al., 2008; Meigs et al., 2008). Nevertheless, it is possible that after accounting for BMI, the inclusion of SNP variants associated to T2D, may not improve prediction accuracy any further. However, this is an unanswered question.
To address these problems, we applied two statistical models (logistic regression, and a neural network) to data from the Framingham Heart Study, and incorporated 65 SNPs that are confirmed to be associated with T2D (Morris et al., 2012) to estimate genetic and non-genetic effects in the prediction of T2D. Since non-genetic factors play a predominant role in whether genetically predisposed individuals progress on to T2D (Poulsen et al., 1999), we considered including BMI information at the onset of T2D, and importantly including genetic by BMI interactions in the predictions of T2D.
Materials and Methods
Data
Our data set (n = 5239) came from the Framingham Heart Study which followed participants over seven decades and collected information from bi-yearly physical and blood examinations. Our sample was composed of 2378 females and 2861 males from the Original and Offspring cohorts; where 4300 are controls and 939 subjects are cases. Diagnosis of T2D for subjects varied by cohort. In the Original cohort, the presence of T2D was diagnosed with a blood glucose level greater than or equal to 200 mg/dL; however, for the offspring cohort, diabetes was diagnosed if fasting glucose levels were equal or greater to 125 mg/dL (NCBI, 2006, 2008).
We also examined 65 SNPs that were found to be associated with T2D as listed in Morris et al. (2012). Since only 20 of the 65 SNPs were genotyped by the Affymetrix 500K chip in our sample, genotype imputation was performed for the missing genotypes of the SNPs by using the IMPUTE2 software (Howie et al., 2011). Missing information per SNP was imputed with a mean accuracy of 0.94. The imputation accuracy for all the imputed SNPs can be seen in Table A in Supplementary Materials.
Models
In this section we will present the response variable, the set of predictors, and the genetic covariates used to build the T2D models. Subsequently, the parametric and non-parametric methods, Logistic Regression (LR) and Neural Network (NN), respectively, will be introduced and finally, we will detail a series of nested models that incorporate BMI and genetic components consisting of the 65 SNPs (Morris et al., 2012).
Set of response and predictor variables
Disease status of the participants was coded with a binary response variable y(yi = 0 for absence and yi = 1 for presence of T2D in the ith subject). A group of covariates was selected based on the association with T2D (P < 0.01) and these were: cohort (ci), a dummy variable indicating whether the subject i belongs to the Original or Offspring cohort; age at last contact (li) 73.91 ± 11.74 (mean ± s.d.), was included to control for different exposure time or observational period; the first two principal components (PC1, PC2) derived from a set of 1000 European ethnicity-informative SNPs (Drineas et al., 2010), and gender (si), also coded with an indicator variable, with this set of co-variables we generated a baseline model that is not influenced by genetic effects. Each one of the risk assessment models was extended by incorporating the body mass index (BMI, bi) at diabetes onset in the case of diabetics and the last observed BMI for non-diabetics, which served as a measure of obesity [bi (mean ± s.d.) = 27.75 ± 5.38]. In some models, the SNPs were incorporated either by directly including the 65 SNPs or indirectly by a genetic score (GS) calculated as the count of risk alleles presents on each subject per SNP . Where xij are the count of risk alleles in the jth SNP for the ith subject. Risk alleles for the inputted SNPs were given by the expected allele count xij being this a continuous number ranging from [0, 2].
Logistic regression
The probability of diabetes peculiar to subject ith was given by a linear predictor with a logit link (Dobson, 2002) in the following form:
where E(yi|·) is the expected value for the diabetes status (yi); pi is the subject-specific probability of developing T2D given a set of covariates for subject i and exp(·) is the exponential function. The linear predictor (ηi) for a model built with only the non-genetic predictor variables is described in equation (2) and obtained as follows:
where α0 is an intercept common to all observations, plus a regression on the “fixed effects”; and α1 to α4 are the corresponding regression coefficients or effects, for each one of the included variables.
Neural network
Bayesian Regularized Neural Network is a machine learning algorithm that is suited for classification problems (Shekhar and Amin, 1992; Neal, 1996; Gianola et al., 2011; Pérez-Rodríguez et al., 2012). The Neural network aims to reduce the errors in the training set, adjust the parameters and to respond properly to novel inputs. One of the simplest neural networks is composed of three layers: the input layer which consists of the input of all the covariates for each one of the subject's xij (i = 1… 5245; j is the quantity of covariates included per model) the hidden layer that contains s neurons; and the output layer. Each input connects to each one of the neurons creating an unknown weight wi for each input. This inner product between the weights and the input vector in each neuron of the hidden layer is given by equation:
where uki in the hidden layer is transformed by applying an activation function. We used the tangent hyperbolic function: , which maps the inputs into the closed interval [−1, 1]. The output from each of the neurons is combined linearly and finally transformed by applying the function , which maps the inputs into an open interval (0, 1), so that the output can be interpreted as a probability, that is yi = h(zi). Since the activation function can be a nonlinear function, it allows the classifier to capture non-linear effects.
Neural network models were fitted using the Bayesian approach (MacKay, 1992) implemented in the Software for Flexible Bayesian Modeling (FBM) written by Neal (1996) which is available freely at www.cs.toronto.edu/~radford/fbm.software.html. For our analyses, a total of 6 neurons were included in the hidden layer to reduce the computational burden, since the results with 9 neurons yielded almost identical results.
Sequence of models
Six models were built, with the aim of evaluating the genetic effects of the 65 variants associated to T2D as risk factors. Our starting point was a Baseline model (BASE), which is composed of only the non-genetic covariates or fixed effects: cohort, age at last contact, gender and principal components. BASEBMI extends model BASE by incorporating BMI in the set of predictors. Since BMI co-varies with T2D, is reasonable to think that pleiotropic effects may exist. Subsequently, we generated clinical models that included genetic information. GEN65 extends BASE by incorporating the 65 SNPs associated to T2D; each SNP contains the count of risk alleles {0, 1, 2}. The GENS extends BASE model by adding the Genetic Risk Score (GS) consisting of the sum of all variants that increase diabetes risk. To test whether there are genetic effects on T2D after accounting for BMI, models GENSBMI and GENBMI are extensions of the model of GENS and GEN65, respectively, including BMI. Finally, GENBMI was also extended accommodating SNPs by BMI interactions, into a model called GENBSNPs × BMI. Table 1, shows the components inside of each one of the models tested.
Estimated effects and confidence intervals
The estimated effects of gene markers and other covariates for the risk of T2D were calculated and displayed in terms of Odds Ratio (OR). The BASE model was used to estimate the effects for all the non-genetic covariates. In addition P-values were used to discriminate SNPs association to T2D and a 95% Confidence Interval of the OR was built to determine the statistical significance of the association between the response and the predictors.
Predictive Ability
To evaluate the risk assessment models, a 10-fold cross-validation was used to compare the accuracy of their respective predictions. Each of the subjects within the data was assigned randomly to the 10 folds. The testing sample consisted of a subset of 1/10th of the data, and training would take the rest of the sample in order to achieve an optimal predictive model. Predictive ability of the models was assessed with the Receiver Operating Characteristic Curve (Fawcett, 2006), using the R package “pROC” (Robin et al., 2013), in order to obtain their Area Under a Curve (AUC), also referred as C-Statistic.
Results
Descriptive Statistics
The characteristics of the 5245 subjects are described and summarized in Table 2. More than half of the sample were females (n = 2864), and only 18% of the overall subjects were diabetic. Within the data set, BMI (mean ± standard deviation) for diabetics was 29.9 ± 6.0, and healthy subjects 27.3 ± 5.1. According to the subjects BMI indexes, 28.2% of the observed subjects demonstrated to be obese (n = 1482) and 67.4% of the sample were overweight, while the rest were classified as normal. The mean observed age at which sample subjects acquired T2D was 63 years old. A reduction in the proportion of incidences of T2D can be seen in the Offspring cohort since the subjects of the Original cohort were observed during a longer time when compared to the Offspring cohort.
Genetic Score
GS is a subject specific count of all the risk alleles in each one of the SNPs reported to be associated with risk of T2D. Table 3 shows a summary of the GS for both control and cases. GS ranged from 52 to 86, which indicates that each individual had at least one risk allele for T2D in almost every SNP. Individuals with a high genetic score presented a greater cumulative incidence of T2D, in comparison to subjects with a low risk score.
Estimated Effects
NN is a classifier that yields multiple estimated effects (depending on the number of neurons), which complicates the interpretation of the results. For that reason, estimates shown in this section are results from the Logistic Regression model.
Table 4 shows the estimated Odds Ratio for the significant covariates in all models. If these covariates are not augmenting T2D risk, we would expect an OR estimate and both limits of the 95% confidence interval to include 1.0. All covariates except the Principal Components were significantly associated to diabetes (P < 0.01). Fixed effects estimates across the models were consistent for each of the covariates (i.e., the inclusion or exclusion of effects in the model produced very little variation of the estimated effects in the remaining effects in the model). Therefore, describing one model (GENSBMI) suffices to understand the effect of the covariates in the prediction of diabetes. For GENSBMI, gender had an OR = 0.60 which implies a much lower risk of developing T2D in women when compared to men. The Cohort's odds ratio (OR = 0.45), implies a lower risk of T2D in Offspring members in comparison to the Original Cohort. Exposure time had an OR of 1.03, resulting in a 3% increase in risk of development for every year of exposure. The OR for the Genetic Score is approximated to 1.1, which implies an increase in risk of developing T2D, with the increase in value of the genetic score. The OR for BMI was 1.13 in the models that included BMI. This value demonstrates there is a 13% increment in risk of T2D when increasing 1 kg/m2 in BMI.
SNP Estimated Effects
Table 5 provides the P-value of the 21 SNPs that gave a statistical association with T2D in our study; we also present the P-value of those SNPs, in association to BMI and WHR as reported in the Giant Consortium (Heid et al., 2010; Speliotes et al., 2010). Only four SNPs found in the genes GLIS3, PTPRD, TCF7L2, and TSPAN8; had an association with a P-value less than 0.001. The SNPs: rs11717195, rs17301514, rs4299828, rs11063069, and rs10842994 have a P-value less than 0.1, therefore suggested as possible risk genetic variants. A total of three SNPs, each pertaining to a different gene, were found to be associated to WHR. These genes were: GCKR (Glucokinase Regulatory Protein), IGF2BP2 (Insulin-Like Growth Factor 2 MRNA Binding Protein 2), and PTPRD (protein tyrosine phosphatase receptor D). In addition, two SNPs strongly associated to BMI, were located in the genes IRS1 (Insulin Receptor Substrate 1) and TCF7L2 (Transcription Factor 7-Like 2).
Table 5. P-value for the evaluated SNPs and their reported P-values for association to WHR and BMI in the giant consortium.
Interaction with BMI
Our results suggest SNP by BMI interaction with five SNPs at a P < 0.05, and 8 genes SNPs with P < 0.1. These results along with the estimated OR are provided in Table 6, for all SNPs. The location of the interacting SNPs are in/near the following genes: the Transcription Factor 7 like 2 (TCFL2), Gastric Inhibitory Polypeptide Receptor (GIPR), Growth Factor Receptor-Bound Protein (GRB14), G1/S-Specific Cyclin D2 (CCND2), Transducin-Like Enhancer of Split 1 (TLE1), Cartilage Intermediate Layer Protein 2 (CILP2) and HNF1 homeobox B (HNF1B). Genes CILP2, HNF1B, and HMGA2, were confirmed to have an association with BMI (P < 0.001). We did not detect any significant interaction in the model where genetic effects were incorporated as a Genetic Score (i.e., GENSBMI).
Predictive Ability
Predictive ability of the models was evaluated with a ten-fold cross validation and measured in terms of AUC. Values of the AUC in cross validation, for all risk assessment models in the Logistic Regression and Neural Networks, are reported in Table 7. In addition, ROC Curves for each risk assessment model tested with the Neural Networks, can be found in Table B the Supplementary Material.
Table 7. Predictive ability of the models evaluated with the area under the receiver operating curve (AUC).
The AUC of the logistic regression in the BASE model was 0.6658 and 0.666, in the LR and NN models respectively. The incorporation of BMI (BASEBMI), increased the AUC to 0.739 and 0.735 for LR and NN, respectively. Also, accounting for genetic markers in GEN65, increased the predictive ability of the models by approximately 2%, when compared to the baseline factors alone. We further analyzed the extent to which the predictive accuracy could be improved by adding BMI to the GEN65 model and achieved a discriminative value of 0.745 and 0.741 (LR and NN, respectively), resulting in an increase of approximately 7%. Previous studies have shown a correlation between the increases in weight and body mass with an increase in probabilities of developing T2D. The incorporation of the genetic score after accounting for BMI further increased AUC to 0.750 (i.e., the GENSBMI model, for both LR and NN). A difference of approximately 8% in predictive ability was observed in the GEN65BMI model, when compared with the baseline model (see Table 7). The inclusion of the interaction of the SNPs with BMI in T2D, gave an AUC of 0.7362 in the GENBSNPxBMI model; with a 0.7% increase when modeled in the Neural Network. Both statistical methods yielded approximately the same AUC. Predictive values show that when strong genetic variants related to T2D are chosen, they substantially improve prediction of risk for T2D.
Discussion
In this paper we investigated the effects of including genetic information in preventive risk assessments for T2D, while using different modeling approaches (LR and NN). The effect of including genetic information was examined by adding 65 candidate SNPs for T2D and computing a genetic score based on these SNPs.
Of the 65 SNPs analyzed, 7 SNPs that are located in 4 genes (GLIS3, TCF7L2, LGR5, and PTPRD), showed a strong association with Type 2 Diabetes. In addition, IGF2BP2 and GCKR have been identified by several meta-analyses (Dupuis et al., 2010; Heid et al., 2010; Speliotes et al., 2010; Morris et al., 2012) as risk genetic variants for Type 2 Diabetes with effects in WHR. The SNPs: rs780094, rs7756992, rs7955901 are in the GCKR, CDKAL1, and LGR5 gene regions; with annotated functions of insulin production, pancreatic cell growth, and glucose homeostasis, respectively. GLIS3 has been listed as a diabetes susceptibility gene due to its role in the generation of pancreatic beta cells; an alteration in the expression of this gene could repress the generation of beta cells, and may be involved in pancreatic dysfunction (Dupuis et al., 2010; Nogueira et al., 2013). TCF7L2 was observed to have a relationship with BMI in both the DIAGRAM and GIANT consortiums (Lindgren et al., 2009; Morris et al., 2012). It has demonstrated to lower insulin secretion by affecting β-cell responsiveness to insulin; it is also found in chromatin regions in islets (Kiessling and Ehrhart-Bornstein, 2006; Sladek et al., 2007; Lyssenko et al., 2008; Mccarthy and Zeggini, 2009). The gene PTPRD (protein tyrosine phosphatase receptor type D) provides a component needed to trigger the reactions for the linkage of the insulin receptor to tissue. However, it was excluded as a risk gene for Type 2 Diabetes by Bektas et al. (2001) since none of the mutations did segregate with diabetes. IRS1 showed an association with BMI through SNP-by-BMI interaction. This genetic variant, with an increased interaction with multiple proteins, has been associated with T2D and obesity, and could lead to the development of insulin resistance (Rung et al., 2009; Caruso et al., 2014).
When analyzing the effects of the inclusion of genetic variants in the prediction of this disease, our results suggest that a vast number of SNPs provide a modest enhancement in the predictive ability of the models. Improvement of these discriminative values, show that the added SNPs capture genetic risk. However, when the interaction of the SNPs by environment (BMI) was included in the model, no further increase was seen. The consistency of AUC throughout the models, with the use of both Neural Network and Logistic Regression, suggests that the use of different statistical approaches neither aided nor reduced the predictive ability of the models. The limitation in predictive accuracy seems to be associated to factors other than the statistical model, such as: the size of the training sample, the number of SNPs included in the model, missing heritability issues and low heritability of the trait. A few concerns about SNPs information, were observed. The first pertains to the imputation uncertainty of the SNPs, since it was not fully taken into account in our analyses. Nevertheless, an alternative methods that consider imputation uncertainty are proposed by Marchini and Howie (2010). Secondly, biases could have been produced in the SNPs estimates due to family structure; nevertheless, since the number of families within our sample is large, it is considered to be of minor importance. In our sample of 5245 subjects, 2073 subjects were aggregated from 495 families, (these families contained subjects with at least one relative in the sample), moreover, the size of these families was 4.19 ± 6.40 (mean ± s.d) members per family.
The most commonly identified covariates used in assessment analyses that provide a high AUC (0.60–0.80) as a clinical baseline model have been: age, high blood pressure, and glucose levels between other covariates (Hu et al., 2001; Lyssenko et al., 2008; Meigs et al., 2008; Cooke et al., 2012). Due to the small effects and marginal change that genotyped data provides in risk prediction, they have been used in only a few models to quantify individual disease risk and thus to facilitate personalized management of T2D risk. The ability and the effects of including genetic information into risk prediction, have been widely studied but are still limited. Previous risk assessments were SNPs associated to T2D were included, slightly improved their predictive ability when compared to baseline clinical covariates (Lyssenko et al., 2008; Meigs et al., 2008; Van Hoek et al., 2008; Katsios, 2010; Bao et al., 2013; Lyssenko and Laakso, 2013; Talmud et al., 2014). In her study, Van Hoek et al. (2008), incorporated 18 SNPs, together with age, sex, and BMI and achieved an AUC of 0.68, yielding only a approximately 2% increase when compared to the baseline model. Furthermore, Lyssenko et al. (2008), evaluated the inclusion of a genetic score built with 16 SNPs; in addition to, multiple clinical covariates and achieved a discriminative value of 0.74. The addition of a modest amount of SNPs into risk prediction was lately studied by Talmud et al. (2014), with the use of 65 SNPs found by the DIAGRAM consortium, which were the same used in this study. A genetic score and clinical covariates such as: BMI, triglyceride levels and fasting glucose, altogether with a large data set, resulted in an AUC of 0.75. This last result is consistent with our results in the model GENSBMI. A limitation of our study is that we did not take into account other clinical variables that have shown some degree of association with diabetes, such as triglyceride levels, high blood pressure, LDL or HDL, which could have enhanced our results. The Framingham Heart Study provides these variables, but there are missing values in many exams and subjects. To avoid reducing sample size, we only included BMI longitudinally (i.e., account for BMI at the first diabetes record), and we found that genetic signal from the SNPs is captured beyond what could be explained by the BMI. BMI estimated effect on diabetes may result biased since we incorporated BMI as the BMI at first diabetes diagnosis for diabetic subjects and last BMI on record for healthy subjects. However, preliminary analysis (not included in the paper) show us that the effect and their significance, for BMI and other covariables in the models, are insensitive to alternative ways to account for BMI, such as, BMI at the first exam, or maximum BMI of the subjects observed period. Despite our limitations, our study can provide important remarks. The effect of genetic information in the improvement of the prediction accuracy, was evaluated in our models by incorporating 65 SNPs both directly and into a genetic score. In addition, we looked at the inclusion of gene-environment (BMI) and gene-gene interaction into risk prediction. Also, a classical logistic regression and a Neural Network (a non-parametric classification algorithm) were explored.
Prevalence of T2D is highest among individuals with a BMI ≥ 40 kg/m2 (Bays et al., 2007). The increase in central adiposity and percent body fat is associated with an increased risk of T2D; however, not all obese or overweight patients develop T2D, and of those who do, just a proportion is genetically predisposed. Our results show, in agreement with the literature, that BMI serves as a prediction enhancer for T2D. Predictive accuracy yielded better estimates in the baseline model that included BMI; and this was further improved when the genetic effect was also incorporated, giving an AUC difference of a approximately 8% when compared to baseline. Interaction between BMI and the genes: CILP2, HNF1B, and HMGA2 in relation to T2D, was found and reported in Table 6. HNF1B is a homodimer in charge of the nephron and pancreas development. Mutations in this gene region could result in the development of diabetes. In addition, HMGA2 has transcriptional regulating factors which play a role in adipogenesis and fat storage, inducing obesity.
In summary, this study confirmed the association of 21 genetic variants with T2D. It was observed that individuals who have a high genetic score may have increased probabilities of developing Type 2 Diabetes. Also, accounting for genetic information, either by including SNPs or a Genetic Score in the regression, led to an improvement in prediction accuracy (AUC) of approximately 2%. However, modeling strategies such as Neural Network or Logistic Regression did not yield differences in terms of prediction. We also showed that the inclusion of BMI into the risk assessment models, improved the predictive accuracy by approximately 8%. Furthermore, the risk assessment model yielded a modest increment in prediction accuracy when including genetic risk score, even after accounting for BMI. This small improvement suggests that there is still genetic signal involved in the development of T2D, yet to be captured, that could produce effects beyond the increase in BMI. In summary, marker information in addition to commonly used baseline covariates such as BMI, could lead to an overall modest improvement of predictive performance.
Author Contributions
All individuals that helped in the writing process of this manuscript are listed as authors and co-authors, and were part of: the formation of the research, recompilation and management of the data, data analysis and interpretation as well as the redaction and edition of this manuscript.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
The Framingham Heart Study is conducted and supported by the National Heart, Lung, and Blood Institute (NHLBI) in collaboration with Boston University (Contract No. N01-HC-25195). This manuscript was not prepared in collaboration with investigators of the Framingham Heart Study and does not necessarily reflect the opinions or views of the Framingham Heart Study, Boston University, or NHLBI. Funding for SHARe Affymetrix genotyping was provided by NHLBI Contract N02-HL-64278. SHARe Illumina genotyping was provided under an agreement between Illumina and Boston University. AIV acknowledge support from NIH, National Institute of Diabetes and Digestive and Kidney, grant 7-R01-DK-062148-10-S1. YCK acknowledges support from NIH grant K01DK095032. PPR received financial support from NIH grants: R01GM099992 and R01GM101219. DLA acknowledges support from the National Science Foundation, grant EPS-1158862 and she is grateful to Dr. Juan Arratia, Principal Investigator and Director of the Student Research Development Center at the Universidad Metropolitana.
Supplementary Material
The Supplementary Material for this article can be found online at: http://www.frontiersin.org/journal/10.3389/fgene.2015.00075/abstract
Abbreviations
T2D, Type 2 Diabetes; AUC, Area Under the receiver operating Curve; GS, Genetic Score; BMI, Body Mass Index; LR, Logistic Regression; NN, Neural Network; OR, Odds Ratio.
References
Bao, W., Hu, F. B., Rong, S., Rong, Y., Bowers, K., Schisterman, E. F., et al. (2013). Predicting risk of type 2 diabetes mellitus with genetic risk models on the basis of established genome-wide association markers: a systematic review. Am. J. Epidemiol. 178, 1197–1207. doi: 10.1093/aje/kwt123
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Bays, H. E., Chapman, R. H., and Grandy, S. (2007). The relationship of body mass index to diabetes mellitus, hypertension and dyslipidaemia: comparison of data from two national surveys. Int. J. Clin. Pract. 61, 737–747. doi: 10.1111/j.1742-1241.2007.01336.x
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Bektas, A., Hughes, J. N., Warram, J. H., Krolewski, A. S., and Doria, A. (2001). Type 2 diabetes locus on 12q15 further mapping and mutation screening of two candidate genes. Diabetes 50, 204–208. doi: 10.2337/diabetes.50.1.204
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Buijsse, B., Simmons, R. K., Griffin, S. J., and Schulze, M. B. (2011). Risk assessment tools for identifying individuals at risk of developing type 2 diabetes. Epidemiol. Rev. 33, 46–62. doi: 10.1093/epirev/mxq019
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Caruso, M., Ma, D., Msallaty, Z., Lewis, M., Seyoum, B., Al-janabi, W., et al. (2014). Increased interaction with insulin receptor substrate 1, a novel abnormality in insulin resistance and type 2 diabetes. Diabetes 63, 1933–1947. doi: 10.2337/db13-1872
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
CDC (Center for Disease Control). (2013). Diabetes Data and Trend. Avaliable online at: www.genetichealth.com/DBTS_Genetics_of_Type_2_Diabetes.shtml.
Cooke, J. N., Ng, M. C. Y., Palmer, N. D., An, S. S., Hester, J. M., Freedman, B. I., et al. (2012). Genetic risk assessment of type 2 diabetes-associated polymorphisms in African Americans. Diabetes Care 35, 287–292. doi: 10.2337/dc11-0957
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Dobson, A. (2002). “Binary variables and logistic regression,” in An Introduction to Generalized Linear Models, 2nd Edn. eds C. Charfield and J. Zidek (Boca Raton, FL: Chapman and Hall/CRC), 120–126.
Drineas, P., Lewis, J., and Paschou, P. (2010). Inferring geographic coordinates of origin for Europeans using small panels of ancestry informative markers. PLoS ONE 5: e11892. doi: 10.1371/journal.pone.0011892
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Dupuis, J., Langenberg, C., Prokopenko, I., Saxena, R., Soranzo, N., Jackson, A. U., et al. (2010). New genetic loci implicated in fasting glucose homeostasis and their impact on type 2 diabetes risk. Nat. Genet. 42, 105–116. doi: 10.1038/ng.520
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Fawcett, T. (2006). An introduction to ROC analysis. Pattern Recognit. Lett. 27, 861–874. doi: 10.1016/j.patrec.2005.10.010
Gianola, D., Okut, H., Weigel, K., and Rosa, G. (2011). Predicting complex quantitative traits with bayesian neural networks: a case study with jersey cows and wheat. BMC Genet. 12:87. doi: 10.1186/1471-2156-12-87
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Heid, I. M., Jackson, A. U., Randall, J. C., Winkler, T. W., Qi, L., Steinthorsdottir, V., et al. (2010). Meta-analysis identifies 13 new loci associated with waist-hip ratio and reveals sexual dimorphism in the genetic basis of fat distribution. Nat. Genet. 42, 949–960. doi: 10.1038/ng.685
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Howie, B., Marchini, J., and Stephens, M. (2011). Genotype imputation with thousands of genomes. G3 (Bethesda) 1, 457–470. doi: 10.1534/g3.111.001198
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Hu, F. B. (2011). Globalization of diabetes: the role of diet, lifestyle, and genes. Diabetes Care 34, 1249–1257. doi: 10.2337/dc11-0442
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Hu, F. B., Manson, J. E., Stampfer, M. J., Colditz, G., Liu, S., Solomon, C. G., et al. (2001). Diet, lifestyle, and the risk of type 2 diabetes mellitus in women. N. Engl. J. Med. 345, 790–797. doi: 10.1056/NEJMoa010492
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Katsios, C. (2010). Individual genomes and personalized medicine: life diversity and complexity editorial. Pers. Med. 7, 347–350. doi: 10.2217/pme.10.30
Kiessling, A, and Ehrhart-Bornstein, M. (2006). Transcription factor 7-like 2 (TCFL2) - a novel factor involved in pathogenesis of type 2 diabetes. Comment on: Grant et al., Nature Genetics 2006, Published online 15 January 2006. Horm. Metab. Res. 38, 137–138. doi: 10.1055/s-2006-925137
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Lindgren, C. M., Heid, I. M., Randall, J. C., Lamina, C., Steinthorsdottir, V., Qi, L., et al. (2009). Genome-wide association scan meta-analysis identifies three loci influencing adiposity and fat distribution. PLoS Genet. 5:e1000508. doi: 10.1371/journal.pgen.1000508
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Lindstrom, J., and Tuomilehto, J. (2003). The diabetes risk score. Diabetes Care 26, 725–731. doi: 10.2337/diacare.26.3.725
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Lyssenko, V., Jonsson, A., Almgren, P., Pulizzi, N., Isomaa, B., Tuomi, T., et al. (2008). Clinical risk factors, DNA variants, and the development of type 2 diabetes. N. Engl. J. Med. 359, 2220–2232. doi: 10.1056/NEJMoa0801869
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Lyssenko, V., and Laakso, M. (2013). Genetic screening for the risk of type 2 diabetes: worthless or valuable? Diabetes Care 36(Suppl. 2), S120–S126. doi: 10.2337/dcS13-2009
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
MacKay, D. J. C. (1992). A practical Bayesian framework for backpropagation networks. Neural Comput. 4, 448–472.
Manzella, D. (2007). “Insulin and Diabetes.” Available online at: About.com. http://diabetes.about.com/od/whatisdiabetes/p/insulin.htm.
Marchini, J., and Howie, B. (2010). Genotype imputation for genome-wide association studies. Nat. Rev. Genet. 11, 499–511. doi: 10.1038/nrg2796
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Mccarthy, M. I., and Zeggini, E. (2009). Genome-wide association studies in type 2 diabetes. Curr. Diab. Rep. 9, 164–171. doi: 10.1007/s11892-009-0027-4
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Meigs, J. B., Shrader, P., Sullivan, L. M., McAteer, J. B., Fox, C. S., Dupuis, J., et al. (2008). Genotype score in addition to common risk factors for prediction of type 2 diabetes. N. Engl. J. Med. 359, 2208–2219. doi: 10.1056/NEJMoa0804742
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Morris, A. P., Voight, B. F., Teslovich, T. M., Ferreira, T., Segrè, A. V., Steinthorsdottir, V., et al. (2012). Large-scale association analysis provides insights into the genetic architecture and pathophysiology of type 2 diabetes. Nat. Genet. 44, 981–990. doi: 10.1038/ng.2383
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
NCBI. (2006). Diabetic Status, Original Cohort Exams 1 - 25: Coding Manual. Available online at: http://www.ncbi.nlm.nih.gov/projects/gap/cgi-bin/variable.cgi?study_id=phs000011.v7.p4&phv=10779&phd=430&pha=&pht=40&phvf=&phdf=&phaf=&phtf=&dssp=1&consent=&temp=1
NCBI. (2008). Diabetic Status, Offspring Cohort Exams 1 - 7: Coding Manual. Available online at: http://www.ncbi.nlm.nih.gov/projects/gap/cgi-bin/document.cgi?study_id=phs000011.v7.p4&phv=10797&phd=431&pha=&pht=41&phvf=&phdf=&phaf=&phtf=&dssp=1&consent=&temp=1#v13
Neal, R. M. (1996). Bayesian Learning for Neural Networks Volumen 118 Lecture Notes in Statistics. New York, NY: Springer. Ilustrated.
Nogueira, T. C., Paula, F. M., Villate, O., Colli, M. L., Moura, R. F., Cunha, D. A., et al. (2013). GLIS3, a susceptibility gene for type 1 and type 2 diabetes, modulates pancreatic beta cell apoptosis via regulation of a splice variant of the BH3-only protein bim. PLoS Genet. 9:e1003532. doi: 10.1371/journal.pgen.1003532
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Nugent, R. (2008). Chronic diseases in developing countries: health and economic burdens. Ann. N.Y. Acad. Sci. 1136, 70–79. doi: 10.1196/annals.1425.027
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Pérez-Rodríguez, P., Gianola, D., González-Camacho, J. M., Crossa, J., Manès, Y., and Dreisigacker, S. (2012). Comparison between linear and non-parametric regression models for genome-enabled prediction in wheat. G3 (Bethesda) 2, 1595–1605. doi: 10.1534/g3.112.003665
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Poulsen, P., Kyvik, K. O., Vaag, A., and Beck-Nielsen, H. (1999). Heritability of type II (non-insulin-dependent) diabetes mellitus and abnormal glucose tolerance–a population-based twin study. Diabetologia 42, 139–145.
Robin, A. X., Turck, N., Hainard, A., Lisacek, F., Sanchez, J., Müller, M., et al. (2013). Package “pROC”. 1–71. Available online at: http://expasy.org/tools/pROC/
Rung, J., Cauchi, S., Albrechtsen, A., Shen, L., Rocheleau, G., Cavalcanti-Proença, C., et al. (2009). Genetic variant near IRS1 is associated with type 2 diabetes, insulin resistance and hyperinsulinemia. Nat. Genet. 41, 1110–1115. doi: 10.1038/ng.443
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Sanghera, D. K., and Blackett, P. R. (2012). Type 2 diabetes genetics: beyond GWAS. J Diabetes Metab. 3:6948. doi: 10.4172/2155-6156.1000198
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Saxena, R., Voight, B. F., Lyssenko, V., Burtt, N. P., de Bakker, P. I., Chen, H., et al. (2007). Genome-wide association analysis identifies loci for type 2 diabetes and triglyceride levels. Science 316, 1331–1336. doi: 10.1126/science.1142358
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Shekhar, S., and Amin, M. B. (1992). Generalization by neural networks. IEEE Trans. Knowl. Data Eng. 4, 177–185. doi: 10.1109/69.134256
Shu, X. O., Long, J., Cai, Q., Qi, L., Xiang, Y.-B., Cho, Y. S., et al. (2010). Identification of new genetic risk variants for type 2 diabetes. PLoS Genet. 6:e1001127. doi: 10.1371/journal.pgen.1001127
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Sladek, R., Rocheleau, G., Rung, J., Dina, C., Shen, L., Serre, D., et al. (2007). A genome-wide association study identifies novel risk loci for type 2 diabetes. Nature 445, 881–885. doi: 10.1038/nature05616
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Speliotes, E. K., Willer, C. J., Berndt, S. I., Monda, K. L., Thorleifsson, G., Jackson, A. U., et al. (2010). Association analyses of 249,796 individuals reveal 18 new loci associated with body mass index. Nat. Genet. 42:937–948. doi: 10.1038/ng.686
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Steinthorsdottir, V., Thorleifsson, G., Reynisdottir, I., Benediktsson, R., Jonsdottir, T., Walters, G. B., et al. (2007). A variant in CDKAL1 influences insulin response and risk of type 2 diabetes. Nat. Genet. 39, 770–775. doi: 10.1038/ng2043
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Talmud, P. J., Cooper, J. A., Morris, R. W., Dudbridge, F., Shah, T., Engmann, J., et al. (2014). Sixty-five common genetic variants and prediction of type 2 diabetes. Diabetes. doi: 10.2337/db14-1504. [Epub ahead of print].
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Van Hoek, M., Dehghan, A., Witteman, J. C. M., van Duijn, C. M., Uitterlinden, A. G., Oostra, B. A., et al. (2008). Predicting type 2 diabetes based on polymorphisms from genome-wide association studies: a population-based study. Diabetes 57, 3122–3128. doi: 10.2337/db08-0425
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Vazquez, A. I., de los Campos, G., Klimentidis, Y. C., Rosa, G. J. M., Gianola, D., Yi, N., et al. (2012). A comprehensive genetic approach for improving prediction of skin cancer risk in humans. Genetics 192, 1493–1502. doi: 10.1534/genetics.112.141705
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Voight, B. F., Scott, L. J., Steinthorsdottir, V., Morris, A. P., Dina, C., Welch, R. P., et al. (2010). Twelve type 2 diabetes susceptibility loci identified through large-scale association analysis. Nat. Genet. 42, 579–589. doi: 10.1038/ng.609
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Yasuda, K., Miyake, K., Horikawa, Y., Hara, K., Osawa, H., Furuta, H., et al. (2008). Variants in KCNQ1 are associated with susceptibility to type 2 diabetes mellitus. Nat. Genet. 40, 1092–1097. doi: 10.1038/ng.207
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Keywords: type 2 diabetes, Logistic Regression, Neural Network, risk assessment, genetic score
Citation: Lebrón-Aldea D, Dhurandhar EJ, Pérez-Rodríguez P, Klimentidis YC, Tiwari HK and Vazquez AI (2015) Integrated genomic and BMI analysis for type 2 diabetes risk assessment. Front. Genet. 6:75. doi: 10.3389/fgene.2015.00075
Received: 31 October 2014; Accepted: 12 February 2015;
Published online: 17 March 2015.
Edited by:
Eduardo Manfredi, Institut National de la Recherche Agronomique, FranceReviewed by:
Li Zhang, University of California, San Francisco, USAAlexandre Bureau, Université Laval, Canada
Copyright © 2015 Lebrón-Aldea, Dhurandhar, Pérez-Rodríguez, Klimentidis, Tiwari and Vazquez. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Ana I. Vazquez, School of Public Health, University of Alabama at Birmingham, Ryals Public Health Building, 1665 University Boulevard, Birmingham, AL 35294-0022, USA e-mail: avazquez@uab.edu