- 1Department of Mathematics and Statistics, Auburn University, Auburn, AL, United States
- 2Division of Cardiovascular Disease, University of Alabama at Birmingham, Birmingham, AL, United States
- 3Research & Development Service, Birmingham Veterans Affairs Health Care System, Birmingham, AL, United States
- 4Department of Electrical and Computer Engineering, Samuel Ginn College of Engineering, Auburn University, Auburn, AL, United States
Background: 2020 American College of Cardiology/American Heart Association (ACC/AHA) Guidelines state that the ideal time for mitral valve surgery in primary mitral regurgitation (PMR) is when the LV approaches but has not yet reached echocardiographic LV ejection fraction (EF) < 60% or LV end-systolic dimension (ESD) > 40 mm. However, it is difficult to know the imminent risk of crossing this threshold when the surgical outcome is less optimal.
Objective: Using machine learning and statistical models, we have shown that cardiac magnetic resonance (CMR) LV sphericity index (SI) and LV mid circumferential strain rate (SRcirc) added to LVEF and LVESD predict LVEF < 50% after mitral valve surgery. Here we test the hypothesis that these CMR features predict LVEF < 60% in asymptomatic PMR patients at 18 months.
Methods: 33 asymptomatic PMR patients with moderate to severe mitral regurgitation had CMR with tissue tagging at baseline and every 6 months for 18 months. Two types of models were employed to predict LVEF < 60% at 18 months: a model using CMR features at a single time point (e.g., baseline) and a model utilizing repeated measurements over time.
Results: CMR LVEF decreased below 60% in 13 patients over 18 months. LVEF varied over time with an inverse relation to mean arterial pressure and mean end-systolic wall stress. Random Forest models utilizing LV SI, LV mid SRcirc, LVESD, and LVEF at a single time point (baseline) had a predictive accuracy of 64%. LV SI, LV mid SRcirc, LVESD and LVEF at baseline, 6, and 12 months achieved a higher predictive accuracy of 79%, improved sensitivity from 57% to 85% than baseline alone and identified a threshold of CMR LVEF 63%–64% signaling LVEF < 60%.
Conclusion: The variability of LVEF due to blood pressure dependence may require a longitudinal study that incorporates LVEF, LVESD, SRcirc at multiple time points to identify the threshold at which LVEF is at risk for decline to less than 60%.
Introduction
It is well recognized that outcomes remain suboptimal in primary mitral regurgitation (PMR) patients (1). Despite guidelines recommending earlier surgical intervention there is a wide disparity in adoption across centers (2). Furthermore parameters for intervention remain crude; for example, guidelines recommend the 60% left ventricular ejection fraction (LVEF) cutoff, in an era where more refined measures of function and geometry are becoming increasingly available. It is imperative to refine models for earlier intervention given the fact that despite pre-operative LVEF > 60%, approximately 20% of PMR patients develop post-operative LV dysfunction and long term outcomes are poor (3–5). In the evaluation of asymptomatic PMR patients with LVEF > 60%, it is difficult to know the imminent risk of LVEF < 60% in the ensuing 6-18 months.
According to 2020 ACC/AHA Guidelines the ideal time for mitral valve surgery is when the LV approaches but has not yet reached echocardiographic LVEF < 60% or LV end-systolic dimension (ESD) > 40 mm. The uncertainty of this threshold has fueled early surgical intervention for asymptomatic PMR patients (2). As a result of these uncertain guidelines, over 75% of 37,000 PMR patients from 2011 to 2016 present with symptoms or LV dysfunction and only 10% are asymptomatic (6), with the additional caveat that preoperative LVEF < 60% is associated with late mortality (7).
In PMR, LV dimensions and geometry-based volumes belie true LV and left atrial (LA) volumes and LV spherical remodeling obtained with geometry independent cardiac magnetic resonance (CMR) imaging (8, 9). The assessment of PMR is further confounded by a spuriously elevated LVEF due to increased adrenergic drive (10) and ejection into a low-pressure LA. We have shown that even in patients with LVEF > 60%, there is severe cardiomyocyte mitochondrial and cytoskeletal damage, excessive oxidative stress, and interstitial collagen loss, resulting in a decrease in the LV mass/volume ratio and a spherically remodeled LV (11–13).
We recently reported that machine learning models using LVEF, mid LV circumferential strain rate (SRcirc), LV end-systolic dimension (LVESD), and LV sphericity (SI) predict LVEF < 50% after mitral valve surgery (14). When applying these markers to asymptomatic PMR LVEF > 60% with moderate to severe PMR, 30% of patients were predicted to have post-surgery LVEF < 50% if they had mitral valve surgery (14). The advantages of machine learning models are their ability to integrate predictors extracted from multiple sources and model both linear and nonlinear interactions amongst them (15). The purpose of this study is to identify LV functional and geometric markers that herald a decrease in LVEF < 60% in asymptomatic PMR patients with moderate to severe PMR over 18 months with CMR exams every six months. Using both statistical and machine learning models, we will explore two types of models that employ CMR LVEF, mid LV mid SRcirc, LVESD, and LV SI features at a single time point (e.g., baseline) and a model utilizing repeated measurements over time.
Materials and methods
Study population
This single-center study includes 33 asymptomatic PMR patients recruited between 2006 and 2010 under NHLBI Specialized Centers of Clinically Oriented Research grant (16). Primary degenerative mitral valve prolapse has echocardiographic evidence of thickened, redundant leaflets with excessive motion and prolapse. Patients were excluded for evidence of: (1) aortic valve > trace aortic regurgitation or mean gradient of > 10 mmHg, (2) mitral stenosis (mean gradient > 5 mmHg, valve area < 1.5 cm2), (3) endocarditis, (4) iatrogenic MR (ergot, radiation induced), (5) hemodialysis, (6) pregnancy, (7) presence of coronary artery disease (stenosis > 50%), (8) positive exercise tolerance test with myocardial perfusion. None of the patients were surgical candidates upon entering this study. All patients were asymptomatic and had no history or evidence of coronary artery disease, ruled out by a maximum exercise tolerance test with nuclear imaging. The Institutional Review Boards of the University of Alabama at Birmingham and Auburn University approved the study protocol. All participants gave written informed consent.
All data from patients’ baseline and return visits were obtained prospectively and recorded in electronic health data records. Asymptomatic PMR patients had Class I status, with moderate/severe PMR by color flow Echo/Doppler, LVEF > 60%, LVESD < 40 mm, leaflet thickening and prolapse, and normal maximal exercise myocardial perfusion imaging (16).
Cardiac magnetic resonance imaging
Magnetic resonance imaging was performed on a 1.5-T MRI scanner (Signa GE, Milwaukee, Wisconsin) optimized for cardiac application. Electrocardiographically gated breath-hold steady-state free precision technique was used to obtain standard (2-, 3-, and 4-chamber short-axis) views using the following parameters: slice thickness of the imaging planes 8 mm, field of view 44 44, scan matrix 256 128, flip angle 45°, repetition/echo times 3.8/1.6 ms. Three-dimensional LV geometric parameters were measured from endocardial and epicardial contours manually traced on cine-MR images acquired near end diastole and end systole. The contours were traced to exclude the papillary muscles. Cubic B-spline surfaces were fit to the endocardial and epicardial contours for each time frame (8–13). The severity of mitral regurgitation (regurgitant volume and regurgitant fraction) was obtained by: Regurgitant volume = LV – RV stroke volume and Regurgitant fraction = LV – RV stroke volume/LV stroke volume.
Tagged magnetic resonance images were acquired with repetition/echo times 8/44 ms, and tag spacing 7 mm (10, 11). Three-dimensional LV strain was measured from tagged images at end systole, which was defined by visual inspection of the image data as the time frame with maximum contraction. Strain computations were conducted using an in-house software package. Two-dimensional strain rates were measured using harmonic phase analysis. Harmonic phase analysis measures the local, 2-dimensional strain of the myocardium based on the local spatial frequency of the tag lines. During myocardial contraction, the tag lines become closer to each other and the tag frequency increases in proportion to that contraction. Strain rates were computed at mid LV segment as defined by Cerqueira et al. (17)
Calculations
Three-dimensional wall thickness was computed at the same segments by measuring the distance from a point on the endocardial surface to the closest point on the endocardial surface along a line perpendicular to the epicardial surface. The radius to wall thickness ratio was computed as the reciprocal of the product of the endocardial circumferential curvature (κ) and wall thickness (T). End-systolic wall stress was computed according to the formula (10):
where P is mean arterial LV blood pressure measured by a cuff measurement at the time of the MR scan. Mean arterial pressure was calculated as: MAP = DP + 1/3(SP – DP) or MAP = DP + 1/3(PP) [systolic blood pressure 2(diastolic pressure)]/3.
Model development in asymptomatic PMR
The objective of this preliminary study is to develop models for predicting LVEF < 60% in the subsequent (6 month) CMR examination. Due to the limited number of patients, the study employed four features selected from our previous study (14): LVEF, LVESD, LV SI, and mid LV SRcirc measured at four time points: baseline, 6, 12, and 18 months. Predictive models were constructed to investigate the following questions: (1) Compared with the model using CMR at a single time point, does the inclusion of features recorded at multiple time points improve the prediction of LVEF < 60%? and (2) What is the optimal number of time points required for accurate prediction in this context?
The final goal of this preliminary study is to develop a predictive model for predicting LVEF < 60% in the subsequent (6 month) CMR examination. Statistical models that model repeated measurements (e.g., mixed-effect model, marginal model) require at least three time points. Thus, we utilized machine learning models to investigate the two questions. After finalizing how many time points to be included in the predictive model, both statistical and machine learning model were fitted for predicting LVEF < 60% at 18 months.
Random Forest for repeated measures
Since Random Forest (RF) showed superior performance in our previous study (14), we utilized RF to construct three predictive models to investigate the inclusion of features measured at multiple time points. RF is a nonparametric and tree-based approach that operates without assuming a specific distribution of the data. It effectively models complex relationships between variables without assuming a specific function form and is less prone to overfitting especially when dealing with high-dimensional data (18). Three RF models were used to predict whether LVEF is less than 60% at 18 month using CMR features from a) baseline only, b) baseline + 6 months, and c) baseline + 6 month + 12 month. For each model, we performed feature selection and hyperparameter tuning, and assessed the model performance via repeated cross-validation. The metrics used for model assessment include accuracy, sensitivity, specificity, and Area under the ROC curve (AUC) values.
Where TP, TN, FP, and FN are short for true positive, true negative, false positive, and false negative.
In addition to assessing the performance of the predictive models, the SHapley Additive exPlanations (SHAP) (14, 19) value was used to investigate the importance of each feature and the directional impact of each feature on predicting the drop in LVEF (i.e., a positive or negative impact on LVEF < 60% at 18 months).
Statistical models
With the four CMR parameters (LVEF, LVESD, LV SI, and mid LV SRcirc) obtained at baseline, 6 month, and 12 month, we also fitted the Generalized Linear Mixed-effect Model (GLMM) (20) and the Generalized Estimating Equations (GEE) (21) model, which is the marginal model, for the prediction and inference at the patient and population level, respectively. Different from RF models, the response variable in the GLMM and GEE is a length 3 vector, with each element indicating whether LVEF > 60% (coded as 0) or < 60% (coded as 1) at 6, 12, and 18 months and the predictors are the four CMR parameters recorded at baseline, 6, and 12 months.
With GLMM, the effect of the longitudinal features on individual patients is assessed (i.e., subject-level inference). To account for repeated measures within each patient, the GLMM is fitted with a random intercept. The model incorporates follow-up time as a discrete variable and interactions between the features and time to estimate the rate of progression for each feature. The determination of significant predictors and interactions are based on likelihood ratio tests, comparing the coefficient of a predictor being zero vs. non-zero.
The GEE is fitted with a similar model structure and the correlation structure being autoregressive lag 1. Different from GLMM, GEE enables group-level inference, investigating the fixed effects of the longitudinal CMR parameters on a broader population of asymptomatic PMR patients. Due to the scale differences among the four parameters, each parameter was standardized. GLMM and GEE models are assessed by the marginal R squared, which describes the proportion of variance explained by the fixed effects, and conditional R squared, which describes the proportion of variance explained by both the fixed and random effects. GLMM is not applicable to cross validation. Thus, only GEE performance was assessed via repeated cross validation and compared with the RF model. The final model was retrained using all the data, allowing for a comprehensive understanding of the model's coefficients.
Statistical methods
Data in Table 1 are presented as number/total (%) in group or median with 25% and 75% interquartile range in parentheses.
Results
Demographics and cardiac magnetic resonance imaging data
Demographics, CMR-derived LV and LA volumes, and LV strains in 33 asymptomatic PMR patients are listed in Table 1.
Importance of mid LV in PMR
The mid LV is an important point of spherical transition as LV diameter increases to a greater extent than LV length decreasing sphericity index and wall thickness/radius producing an increase in LV wall stress. LV biopsies taken at mid LV from our previous studies (10–12) demonstrate this point in our PMR patients, showing a decrease in LV SI and LV wall thickness (Figure 1A) along with a decrease in mid LV endocardial curvature (Figure 1B). The green arrow in Figure 1A at the location of our myocardial biopsies is coincident with myofibril lysis, sarcomere breakdown, and disorganized mitochondria with cristae lysis (Figure 1C). LVEDD and LVESD (Figure 1D) is the sum of 32 radially directed vectors at mid LV that is close to measurement of mid LV SRcirc. It is important to note that the location of the myocardial biopsies from our previous studies of PMR patients is in the same location of the CMR derived LVEDD and LVESD (10–12).
Figure 1. Importance of mid LV remodeling in PMR. (A) CMR images of a normal subject and PMR patient demonstrate LV wall thinning and decrease in sphericity index (green lines length/width). (B) Color-coded LV maps demonstrating decrease in endocardial curvature (bluer) at mid LV (blue dot marks interventricular septum). (C) TEM of endomyocardial biopsies from mid LV lateral wall (green arrow in A) depicting extensive myofibrillar lysis, and breakdown of sarcomere structure with disorganized and damaged mitochondria. (D) CMR LVESD measurement as the sum of 32 radially directed vectors measured at the tips of the papillary muscles in the mid LV near measurement of mid LV circumferential strain rate.
Asymptomatic PMR 18 month time course
The 18-month outcome of 33 PMR patients with CMR baseline LVEF > 60% (n = 21) or baseline LVEF < 60% (n = 12) is presented in Figure 2. Of 21 patients with baseline LVEF > 60%, 6 patients had LVEF < 60% and 15 had LVEF > 60% at 18 months. Of 12 patients with baseline LVEF < 60%, 5 patients had an increase in LVEF > 60% at 18 months and 7 patients were asymptomatic with LVEF < 60% at 18 months. Of the 33 PMR patients, 13 had CMR LVEF < 60% by 18 months despite all presenting with a median baseline CMR-derived LVEF > 60% (Table 1) and Echo-derived LVEF >60%.
Figure 2. LVEF changes over 18 months in asymptomatic patients with moderate to severe PMR with baseline CMR LVEF < 60% and LVEF > 60%. Top panel are individual patients and bottom panel indicates mean and 95% CI (shaded area). Blue lines – LVEF remains > 60% at 18 months. Red lines LVEF < 60% at 18 months.
There is a wide variability of LVEF, LVESD, and mid LV SRcirc at each time point over the 18-month period (Figure 3). These indices of LV shortening are load dependent as demonstrated by the inverse relation of LVEF to mean arterial pressure at the time of imaging and a calculated LV end-systolic wall stress (Figure 4). This demonstrates the inherent physiological variability of LVEF to a changing afterload, militating for repeated measures at the four time points.
Figure 3. Variability of LVESD and mid LV SRcirc over 18 months in PMR patients. Top panel are individual patients and bottom panel indicates mean and 95% CI (shaded area). Blue lines – LVEF remains > 60% at 18 months. Red lines LVEF < 60% at 18 months.
Figure 4. Linear regression of LVEF to mean arterial pressure (MAP) and LVES MAP wall stress. LV end-systolic wall stress provides a more accurate means of defining afterload than MAP, which considers wall thickness and diameter thereby allowing for comparison of different hearts.
Random Forest models single vs. repeated measures
All patients had four scans (baseline, 6 month, 12 month, and 18 month). To predict the LVEF decline at 18 months, we considered using CMR features measured at baseline only (type 1 model) compared to repeated CMR features measured at two or three time points (type 2 model). In the type 2 model, we considered using baseline + 6 month CMR features and baseline + 6 month + 12 month CMR features respectively. The purpose of constructing these two types of models is to address two questions: (1) if including repeated CMR measurements can improve the prediction of the decline in LVEF at 18 months, compared with a model only using baseline measurements; (2) how many repeated measurements are needed to best predict LVEF decline at 18 months, or in other words, is it necessary to have a CMR scan every six months.
Random Forest models were constructed to predict LVEF < 60% at 18 months. The first model incorporated the four CMR features (LVEF, LVESD, LV SI, and mid LV SRcirc) identified from our previous study (14) at a single time point (i.e., baseline). The second model integrated the four features measured at two consecutive time points—baseline and 6 months. The third model encompassed the four features measured at baseline, 6, and 12 months. The RF model utilizing the four features at baseline achieved a low prediction accuracy of 64% and sensitivity of 57%, which slightly improved with the second model (72% and 63% respectively) (Table 2). Incorporating the four features (measured at baseline, 6, and 12 months) in the third model achieved highest prediction accuracy (79%) and sensitivity (85%) (Table 2).
Table 2. Random Forest model performance in predicting LVEF < 60% at 18 months comparing single vs. repeated measures over time.
Random Forest vs. statistical models for the prediction of LVEF < 60% at 18 months
Random Forest model was compared to GLMM and GEE statistical models for prediction of LVEF < 60% at 18 months using the same four features measured at baseline, 6, and 12 months. The coefficients of GEE and GLMM are summarized in Table 3. GEE is a marginal model that focuses on estimating the population level effects; while GLMM is the conditional model that focuses on estimating subject-specific effects. For GLMM, the marginal R squared is 0.673 and the conditional R squared is 0.673, and the variance of the subject effect is close to zero. This implies that fixed effects rather than random effects largely explain the drop in LVEF. The GEE marginal R square and conditional R square are 0.736, implying that the GEE population-averaged correlation structure fits the data better and explains more variation in the data providing a better final statistical model for the prediction of LVEF < 60%. A comparison between GEE and RF model performance (using repeated measures of the four features at baseline, 6 months and 12 months) shows that the RF model has a higher prediction accuracy and sensitivity (Table 4).
Table 4. Comparison of model performance in predicting LVEF < 60% at 18 months using repeated measures (baseline, 6 months, 12 months).
Random Forest captures the non-linear relationship between features and the response variables, and further identifies important features that have a strong impact on the LVEF < 60% in a non-linear way. The GEE model assumes a linear relationship between the features and log odds, while RF captures the interactions and combinations among features. Thus, the GEE linear model may not capture such complex relationships; while the data-driven RF model relies heavily on the patterns and information present in the provided data.
Feature importance in the repeated measures Random Forest model
The RF model computes the importance of each variable using the four CMR features repeatedly measured at baseline, 6, and 12 months (4 features × 3 time points = 12 features) to predict LVEF < 60% at 18 months (Figure 5). The Random Forest model performance used 4 features measured at 3 time points. The RF model utilizing the top 3 features: 12 month LVEF, baseline LVEF, and 12 month mid LV SRcirc gave the best model performance in predicting 18 month LVEF < 60% with 79% accuracy and 85% sensitivity (Table 5).
Figure 5. Ranking of feature importance in the repeated measures RF model. The RF model computes the importance of each variable using the four CMR features at baseline, 6, and 12 months (4 features×3 time points) to predict the LVEF < 60% at 18 months.
Interpretation of Random Forest models
The Shapley Additive exPlanations (SHAP) value (19), inspired by the Shapley value in cooperative game theory, assigns an importance value to each feature in machine learning models to explain the decision made by the model. The SHAP value constructed an overall interpretation of the RF model with the three most important features (12 month LVEF, baseline LVEF, and 12 month mid LV SRcirc) and its directional impact on prediction (a positive or negative impact on probability of LVEF < 60% at 18 months), and how each feature contributes to a prediction in each patient.
The SHAP value calculated for each patient for the top three features (y-axis) is presented in Figure 6. SHAP values quantify the contribution of each feature to model prediction on the x-axis. The sign of the SHAP value represents the directed impact on probability of LVEF < 60% at 18 months. A positive SHAP indicates high probability while a negative value indicates low probability for LVEF < 60% at 18 months. The magnitude of the SHAP value on the x-axis represents the strength of the contribution. Each dot represents an individual patient, and the color of the dot represents the feature value, high (orange) and low (purple). For baseline and 12 month LVEF, the orange-yellow dots (high LVEF) are located on the left side of the 0 SHAP (i.e., negative SHAP), indicating less probability of LVEF < 60% at 18 months. For 12 month mid LV SRcirc, the high value (orange-yellow dots) are located on the right side of the 0 (positive SHAP), therefore, a higher 12 month mid LV SRcirc (i.e., less negative), the higher chance of developing LVEF < 60% at 18 months.
Figure 6. SHAP value for probability for LVEF < 60% at 18 months for the top 3 features in the RF model for asymptomatic PMR. SHAP values quantify the contribution of each feature to model prediction on the x-axis. The sign (+/-) of the SHAP value represents the directed impact on probability of LVEF < 60% at 18 months. A positive SHAP indicates high probability while a negative value indicates low probability for LVEF < 60% at 18 months. The magnitude of the SHAP value on the x-axis represents the strength of the contribution. Each dot represents an individual patient (n = 33), and the color of the dot represents the feature value (color scale), high (orange) and low (purple).
To better visualize the top three features (12 month LVEF, baseline LVEF, and 12 month mid LV SRcirc), the actual value of each feature on the x axis and the likelihood of developing LVEF < 60% (red dot) or LVEF > 60% (blue dot) at 18 months is presented in Figure 7. Our data indicates that a higher absolute baseline CMR derived LVEF (> 63%), the less likely for LVEF < 60% at 18 months (negative SHAP values and mostly blue circles). Mid LV SRcirc is a negative quantity; thus, more negative values represent a greater LV SRcirc and therefore less likely to develop LVEF < 60% at 18 months.
Figure 7. SHAP values for the top 3 features in the RF model for asymptomatic PMR. Manual cutoff values for LVEF (green vertical line) indicate the impact on the likelihood of LVEF < 60% at 18 months. Each dot is an individual patient and colored based on whether the patient has a negative SHAP value indicating lower probability of LVEF < 60% (blue dots) or a positive SHAP value indicating a higher probability of LVEF < 60% (red dots) at 18 months.
Discussion
We have previously reported that a combination of statistical methods and machine learning models show that LV SRcirc, LVESD, LVEF, and LV sphericity index (SI) predict LVEF < 50% after surgery in patients with baseline LVEF > 60% (14). We utilized these same four features to predict the drop in LVEF < 60% over 18 months in 33 asymptomatic patients with moderate to severe PMR with CMR obtained every 6 months. Random Forest models at a single time point (baseline) had a predictive accuracy of 64%. Using repeated measures at baseline, 6, and 12 months achieved a higher predictive accuracy of 79%, improved sensitivity from 57% to 85%, and identified a threshold of CMR LVEF 63%–64% for LVEF < 60%. This pilot longitudinal study in PMR patients provides a stimulus for a longitudinal study that utilizes a more nuanced combination of LV functional parameters that will better inform the clinician of the need for surgery in PMR (including Echo/Doppler derived).
Many studies of PMR have identified predictors of survival or heart failure and death. They include extracellular volume (22–26), regurgitant volume (27), longitudinal strain (28, 29), BNP (30–32), exercise capacity (33), pulmonary artery pressure (34), LA volume (35, 36) and LA emptying fraction (37–39). These studies are largely retrospective, provide just one snapshot in time, and have not addressed the short-term risk for LVEF < 60% in a prospective “watchful waiting approach” (40) thus limiting clinical applicability. In the evaluation of asymptomatic PMR patients with LVEF > 60%, it is difficult to know the imminent danger for progression to LVEF < 60%, because surgery in patients with LVEF < 60% has a less favorable outcome. Given the unreliability of LVEF alone, we questioned whether our previous interactive predictors of LV remodeling (LV SI) and LV shortening (LVEF, LVESD, mid LV SRcirc) features can identify an impending LVEF < 60% in the asymptomatic PMR patient.
The interactive power of machine learning captures the LV spherical remodeling in PMR (8, 9) and its relation to mid LV SRcirc affected by the decrease in LV endocardial curvature and LV wall thickness that increases wall stress at the mid LV (Table 1). This is further compounded by severe myofibril lysis, sarcomere breakdown, and disorganized mitochondria with cristae lysis (Figure 1C) ─ all of which contribute to decreased mid LV SRcirc. In models that determine the effect of LV shape on LVEF, circumferential strain is significantly more important than longitudinal strain in maintaining a normal LVEF in the spherically dilated LV (41). The connection to mid LV SRcirc underscores the decrease in contractile velocity that stems not only from myofibril breakdown but also derangement of calcium-handling proteins despite LVEF > 55% in PMR patients (42–45). We have also demonstrated sarcolipin protein upregulation from LV endo-myocardial biopsies in PMR patients (10). Sarcolipin functions as a regulator of SERCA2a by lowering its Ca2+ affinity and its inhibitory function is independent of phospholamban (46), both of which control extent and rate of sarcomere shortening.
Based on the coefficients of GEE model in Table 3, there is a predictive variability of LVEF, LVESD, mid LV, SRcirc over time. For example, baseline LVEF and 12 month LVEF have a negative while 6 month LVEF has a positive impact. For LVESD, baseline coefficient is positive while 6 and 12 month coefficients are both negative. For mid LV SRcirc, the baseline coefficient is negative while 6 and 12 month coefficients are both positive. The variability in these indices of LV shortening could be due to the variable blood pressures at each imaging session and also to the small number of patients in this pilot study. This may also explain the higher predictability of three vs. one-time point for predicting LVEF < 60%. LVEF negatively correlated with mean arterial pressure and end-systolic wall stress (Figure 4), which more accurately estimates afterload by incorporating LV radius of curvature and wall thickness. In a stepwise discriminate multivariate analysis of PMR surgery patients, Carabello et al. reported LVES stress/ESV index ratio as the only independent predictor of outcome (47). Future longitudinal studies should include LVES stress/ESV index to normalize effects of afterload on LVEF and other indices of shortening (LVESD and LV mid SRcirc).
The SHAP value identified a CMR LVEF threshold of 63%-64% at baseline, 6 and 12 months. The SHAP value provides an overall interpretation of the machine learning models including a directional positive or negative impact on the probability of LVEF < 60% and a local interpretation at the patient level on how each feature contributes to an individual prediction for each patient. This provides cutoff values that in a larger sample size can comprise a risk score. The SHAP cutoff of 63%-64% is consistent with a study of 300 PMR patients with echo at baseline and within 9-12 months’ post-surgery. The occurrence of post-operative LV dysfunction was 9% when LVEF was ≥ 64% and LVESD < 37 mm and 33% with LVEF < 64% and LVESD ≥ 37 mm (48). Taken together, these results militate for a higher LVEF threshold for mitral valve surgery in PMR.
Limitations
The obvious limitation of this study is the small number of patients. In this preliminary study, we utilized the classic RF model instead of the Mixed Effects Random Forest (MERF) to model the longitudinal features. Unfortunately, we do not have blood pressure at all time points. In future studies, adding the blood pressure or end-systolic wall stress may provide additive predictive value in normalizing effects of afterload on LVEF. Compared with the classic RF, MERF considers the correlation structure within repeated measurements by incorporating random effects providing accurate predictions for each patient. However, the computational and model complexity of MERF is higher than that of RF due to the inclusion of random effects, which requires more patients. In this preliminary study with the small sample size (n = 33) classic RF is preferred over MERF.
Conclusions
In this pilot study, we identify key LV shortening indices that are widely variable due to the prevailing blood pressures at the time of imaging, which may in part explain the need for more frequent observations. Future studies with a larger number of patients that include blood pressure and end systolic wall stress may improve the predictability of a single study. Taken together, the uncertainty of knowing when the LV approaches but has not yet reached LVEF < 60% calls for a longitudinal study in a larger patient population to test whether a combination of functional features derived from both CMR and Echo/Doppler provides a better indicator for timing of surgical intervention in PMR.
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics statement
The studies involving humans were approved by University of Alabama at Birmingham and Auburn University IRB. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.
Author contributions
JZ: Conceptualization, Data curation, Formal Analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing. S-wH: Data curation, Formal Analysis, Investigation, Methodology, Software, Writing – original draft, Writing – review & editing. MA: Investigation, Writing – original draft, Writing – review & editing, Conceptualization, Supervision. BP: Conceptualization, Investigation, Supervision, Writing – original draft, Writing – review & editing, Data curation, Methodology, Project administration, Validation. SL: Data curation, Investigation, Methodology, Supervision, Validation, Writing – original draft, Writing – review & editing, Formal Analysis, Resources, Software, Visualization. OS: Data curation, Investigation, Methodology, Software, Writing – original draft, Writing – review & editing. TD: Data curation, Investigation, Methodology, Software, Writing – original draft, Writing – review & editing, Conceptualization, Formal Analysis, Funding acquisition, Resources, Supervision, Validation, Visualization. LD: Conceptualization, Data curation, Formal Analysis, Funding acquisition, Investigation, Methodology, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing, Project administration.
Funding
The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This work was supported by the National Heart, Lung, and Blood Institute and Specialized Centers of Clinically Oriented Research grant [P50HL077100 to L.J.D] in cardiac dysfunction; Department of Veteran Affairs for Merit Review grant [1CX000993-01 to L.J.D]; and National Institutes of Health Grant [P01 HL051952 to L.J.D]. VHA 2021 John Blair Barnwell Award [to LJD]; No relationships to industry.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
1. David TE, David CM, Tsang W, Lafreniere-Roula M, Manlhiot C. Long-term results of mitral valve repair for regurgitation due to leaflet prolapse. J Am Coll Cardiol. (2019) 74:1044–53. doi: 10.1016/j.jacc.2019.06.052
2. Otto CM, Nishimura RA, Bonow RO, Carabello BA, Erwin JP, Gentile F, et al. 2020 ACC/AHA guideline for the management of patients with valvular heart disease: executive summary: a report of the American College of Cardiology/American Heart Association joint committee on clinical practice guidelines. J Am Coll Cardiol. (2021) 77(4):450–500. doi: 10.1016/j.jacc.2020.11.035
3. Miller JD, Suri RM. Left ventricular dysfunction after degenerative mitral valve repair: a question of better molecular targets or better surgical timing? J Thorac Cardiovasc Surg. (2016) 152(4):1071–4. doi: 10.1016/j.jtcvs.2016.07.018
4. Enriquez-Sarano M, Suri RM, Clavel M, Mantovani F, Michelena HI, Pislaru S, et al. Is there an outcome penalty linked to guideline-based indications for valvular surgery? Early and long-term analysis of patients with organic mitral regurgitation. J Thorac Cardiovasc Surg. (2015) 150(1):50–8. doi: 10.1016/j.jtcvs.2015.04.009
5. Quintana E, Suri RM, Thalji NM, Daly RC, Dearani JA, Burkhart HM, et al. Left ventricular dysfunction after mitral valve repair-the fallacy of “normal” preoperative myocardial function. J Thorac Cardiovasc Surg. (2014) 148:2752–62. doi: 10.1016/j.jtcvs.2014.07.029
6. Gammie JS, Chikwe J, Badhwar V, Thibault DP, Vemulapalli S, Thourani VH, et al. Isolated mitral valve surgery: the society of thoracic surgeons adult cardiac surgery database analysis. Ann Thorac Surg. (2018) 106(3):716–27. doi: 10.1016/j.athoracsur.2018.03.086
7. Desai A, Thomas JD, Bonow RO, Kruse J, Andrei AC, Cox JL, et al. Asymptomatic degenerative mitral regurgitation repair: validating guidelines for early intervention. J Thorac Cardiovasc Surg. (2021) 161(3):981–994.e5. doi: 10.1016/j.jtcvs.2020.11.076
8. Schiros CG, Dell'Italia LJ, Gladden JD, Clark D 3rd, Aban I, Gupta H, et al. Magnetic resonance imaging with 3-dimensional analysis reveals important LV remodeling in isolated mitral regurgitation: implications beyond dimensions. Circulation. (2012) 125:2334–42. doi: 10.1161/CIRCULATIONAHA.111.073239
9. Schiros CG, Ahmed MI, Sanagala T, Zha W, McGiffin DC, Bamman MM, et al. Importance of three-dimensional geometric analysis in the assessment of the athlete’s heart. Am J Cardiol. (2013) 111(7):1067–72. doi: 10.1016/j.amjcard.2012.12.027
10. Zheng J, Yancey D, Ahmed M, Chiros CG, Wei CC, Gladden JD, et al. Increased sarcolipin expression and adrenergic drive in patients with chronic isolated mitral regurgitation. Circulation Heart Failure. (2014) 7(1):194–202. doi: 10.1161/CIRCHEARTFAILURE.113.000519
11. Ahmed M, Gladden JD, Litovsky S, McGiffin D, Gupta H, Lloyd S, et al. Myofibrillar degeneration, oxidative stress and post-surgical systolic dysfunction in patients with isolated mitral regurgitation and pre surgical left ventricular ejection fraction >60%. J Am Coll Cardiol. (2009) 55:671–9. doi: 10.1016/j.jacc.2009.08.074
12. Ahmed MI, Guichard JL, Rajasekaran NS, Ahmad S, Mariappan N, Litovsky S, et al. Disruption of desmin-mitochondrial architecture in patients with regurgitant mitral valves and preserved ventricular function. J Thorac Cardiovasc Surg. (2016) 152(4):1059–70. With Accompanying Editorial. doi: 10.1016/j.jtcvs.2016.06.017
13. Ahmed MI, Andrikopoulou E, Zheng J, Ulasova E, Pat B, Kelley EE, et al. Interstitial collagen loss, myocardial remodeling, and function in primary mitral regurgitation. JACC Basic Transl Sci. (2022) 7(10):973–81. doi: 10.1016/j.jacbts.2022.04.014
14. Zheng J, Li Y, Billor N, Ahmed MI, Fang Y-HD, Pat B, et al. Understanding post-surgical decline in left ventricular function in primary mitral regurgitation using regression and machine learning models. Front Cardiovasc Med. (2023) 10:1112797. doi: 10.3389/fcvm.2023.1112797
15. Goldstein BA, Navar AM, Carter RE. Moving beyond regression techniques in cardiovascular risk prediction: applying machine learning to address analytic challenges. Europ Heart J. (2017) 38:1805–14. doi: 10.1093/eurheartj/ehw302
16. Ahmed MI, Aban I, Lloyd SG, Gupta H, Howard G, Inusah S, et al. A randomized controlled phase IIb trial of Beta-1 receptor blockade in isolated degenerative mitral regurgitation. J Am Coll Cardiol. (2012) 60:833–8. doi: 10.1016/j.jacc.2012.04.029
17. Cerqueira MD, Weissman NJ, Dilsizian V, Jacobs AK, Kaul S, Laskey WK, et al. Standardized myocardial segmentation and nomenclature for tomographic imaging of the heart: a statement for healthcare professionals from the cardiac imaging committee of the council on clinical cardiology of the American Heart Association. Circulation. (2002) 105:539–42. doi: 10.1161/hc0402.102975
19. Lundberg SM, Lee S-I. A unified approach to interpreting model predictions. Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS’17) Curran Associates Inc.; Long Beach, CA, USA (2017). p. 4768–77
20. Jiang J, Nguyen T. Linear and Generalized Linear Mixed Models and Their Applications. Vol. 1. New York: Springer (2007).
21. Zeger SL, Liang K-Y, Albert PS. Models for longitudinal data: a generalized estimating equation approach. Biometrics. (1988) 44:1049–60. doi: 10.2307/2531734
22. Kitkungvan D, Yang EY, Tallawi KC, Nagueh SF, Nabi F, Khan MA, et al. Extracellular volume in primary mitral regurgitation. JACC Cardiovasc Imaging. (2021) 14(6):1146–60. doi: 10.1016/j.jcmg.2020.10.010
23. Constant Dit Beaufils AL, Huttin O, Jobbe-Duval A, Senage T, Filippetti L, Piriou N, et al. Replacement myocardial fibrosis in patients with mitral valve prolapse relation to mitral regurgitation, ventricular remodeling, and arrhythmia. Circulation. (2021) 143(18):1763–74. doi: 10.1161/CIRCULATIONAHA.120.050214
24. Kitkungvan D, Nabi F, Kim RJ, Khan MA, Xu J, Little SH, et al. Myocardial fibrosis in patients with primary mitral regurgitation with and without prolapse. J Am Coll Cardiol. (2018) 72(8):823–34. doi: 10.1016/j.jacc.2018.06.048
25. Liu B, Neil DAH, Premchand M, Bhabra M, Patel R, Barker T, et al. Myocardial fbrosis in asymptomatic and symptomatic chronic severe primary mitral regurgitation and relationship to tissue characterisation and left ventricular function on cardiovascular magnetic resonance. J Cardiovasc Magn Reson. (2020) 22(1):86. doi: 10.1186/s12968-020-00674-4
26. Kitkungvan D, Yang EY, El Tallawi KC, Nagueh SF, Nabi F, Khan MA, et al. Prognostic implications of diffuse interstitial fibrosis in asymptomatic primary mitral regurgitation. Circulation. (2019) 140(25):2122–4. doi: 10.1161/CIRCULATIONAHA.119.043250
27. Myerson SG, d'Arcy J, Christiansen JP, Mohiaddin R, Francis JM, Prendergast B, et al. Determination of clinical outcome in mitral regurgitation with cardiovascular magnetic resonance quantification. Circulation. (2016) 133(23):2287–96. doi: 10.1161/CIRCULATIONAHA.115.017888
28. Kislitsina ON, Thomas JD, Crawford E, Michel E, Kruse J, Liu M, et al. Predictors of left ventricular dysfunction after surgery for degenerative mitral regurgitation. Ann Thorac Surg. (2020) 109(3):669–77. doi: 10.1016/j.athoracsur.2019.10.044
29. Alashi A, Mentias A, Patel K, Gillinov AM, Sabik JF, Popović ZB, et al. Synergistic utility of BNP and left ventricular global longitudinal strain in asymptomatic patients with significant primary mitral regurgitation and preserved systolic function undergoing mitral valve surgery. Circ Cardiovasc Imaging. (2016) 5(1):e002561. doi: 10.1161/CIRCIMAGING.115.004451
30. Detaint D, Messika-Zeitoun D, Chen HH, Scott C, Chen H, Burnett JC Jr, et al. B-type natriuretic peptide in organic mitral regurgitation: determinants and impact on outcome. Circulation. (2005) 111:2391–7. doi: 10.1161/01.CIR.0000164269.80908.9D
31. Magne J, Mahjoub H, Pibarot P, Pirlet C, Pierard LA, Lancellotti P. Prognostic importance of brain natriuretic peptide and left ventricular longitudinal function in asymptomatic degenerative mitral regurgitation. Heart. (2012) 98:584–91. doi: 10.1136/heartjnl-2011-301128
32. Pizarro R, Bazzino OO, Oberti PF, Falconi ML, Arias AM, Krauss JG, et al. Prospective validation of the prognostic usefulness of brain natriuretic peptide in asymptomatic patients with chronic severe mitral regurgitation. J Am Coll Cardiol. (2009) 54:1099–106. doi: 10.1016/j.jacc.2009.06.013
33. Naji P, Griffin BP, Barr T, Asfahan F, Gillinov AM, Grimm RA, et al. Importance of exercise capacity in predicting outcomes and determining optimal timing of surgery in significant primary mitral regurgitation. J Am Heart Assoc. (2014) 3(5):e001010. doi: 10.1161/JAHA.114.001010
34. Mentias A, Patel K, Patel H, Gillinov AM, Sabik JF, Mihaljevic T, et al. Effect of pulmonary vascular pressures on long-term outcome in patients with primary mitral regurgitation. J Am Coll Cardiol. (2016) 67(25):2952–61. doi: 10.1016/j.jacc.2016.03.589
35. Le Tourneau T, Messika-Zeitoun D, Russo A, Detaint D, Topilsky Y, Mahoney DW, et al. Impact of left atrial volume on clinical outcome in organic mitral regurgitation. J Am Coll Cardiol. (2010) 56(7):570–8. doi: 10.1016/j.jacc.2010.02.059
36. Rusinaru D, Tribouilloy C, Grigioni F, Avierinos JF, Suri RM, Barbieri A, et al. Mitral regurgitation international DAtabase (MIDA) investigators. Left atrial size is a potent predictor of mortality in mitral regurgitation due to flail leaflets: results from a large international multicenter study. Circ Cardiovasc Imaging. (2011) 4(5):473–81. doi: 10.1161/CIRCIMAGING.110.961011
37. Cameli M, Pastore MC, Righini FM, Mandoli GE, D'Ascenzi F, Lisi M, et al. Prognostic value of left atrial strain in patients with moderate asymptomatic mitral regurgitation. Int J Cardiovasc Imaging. (2019) 35(9):1597–604. doi: 10.1007/s10554-019-01598-6
38. Yang LT, Tsai WC, Luo CY, Li YH, Tsai LM. Role of left atrial reservoir strain rate in left atrial remodeling in severe mitral regurgitation. J Med Ultrasound. (2017) 25(1):16–23. doi: 10.1016/j.jmu.2016.09.003
39. Ring L, Rana BS, Wells FC, Kydd AC, Dutka DP. Atrial function as a guide to timing of intervention in mitral valve prolapse with mitral regurgitation. JACC Cardiovasc Imaging. (2014) 7(3):225–32. doi: 10.1016/j.jcmg.2013.12.009
40. Goldstone AB, Patrick WL, Cohen JE, Aribeana CN, Popat R, Woo YJ. Early surgical intervention or watchful waiting for the management of asymptomatic mitral regurgitation: a systematic review and meta-analysis. Ann Cardiothorac Surg. (2015) 4(3):220–9. doi: 10.3978/j.issn.2225-319X.2015.04.01
41. Stokke TM, Hasselberg NE, Smedsrud MK, Sarvari SI, Haugaa KH, Smiseth OA, et al. Geometry as a confounder when assessing ventricular systolic function. Comparison between ejection fraction and strain. J Am Coll Cardiol. (2017) 70(8):942–54. doi: 10.1016/j.jacc.2017.06.046
42. Mulieri LA, Leavitt BJ, Martin BJ, Haeberle JR, Alpert NR. Myocardial force-frequency defect in mitral regurgitation heart failure is reversed by forskolin. Circulation. (1993) 88:2700–4. doi: 10.1161/01.CIR.88.6.2700
43. Mulieri LA, Tischler MD, Martin BJ, Leavitt BJ, Ittleman FP, Alpert NR, et al. Regional differences in the force-frequency relation of human left ventricular myocardium in mitral regurgitation: implications for ventricular shape. Am J Physiol Heart Circ Physiol. (2005) 288:H2185–91. doi: 10.1152/ajpheart.00905.2003
44. Leszek P, Korewicki J, Klisiewicz A, Biederman A, Browarek A, Charlemagne D, et al. Reduced myocardial expression of calcium handling protein in patients with severe chronic mitral regurgitation. Eur J Cardiothorac Surg. (2006) 30:737–43. doi: 10.1016/j.ejcts.2006.07.008
45. Leszek P, Szperl M, Klisiewicz A, Janas J, Biederman A, Rywik T, et al. Alteration of myocardial sarcoplasmic reticulum Ca2+-ATPase and na+-Ca2 + exchanger expression in human left ventricular volume overload. Eur J Heart Fail. (2007) 9:579–86. doi: 10.1016/j.ejheart.2007.01.011
46. Shaikh S, Sahoo S, Periasamy M. Phospholamban and sarcolipin: are they functionally redundant or distinct regulators of sarco(endo)Plasmic Reticulum calcium ATPase? J Mol Cell Cardiol. (2016) 91:81–91. doi: 10.1016/j.yjmcc.2015.12.030
47. Carabello BA, Nolan SP, McGuire LB. Assessment of preoperative left ventricular function in patients with mitral regurgitation: value of the end-systolic wall stress-end-systolic volume ratio. Circulation. (1981) 64(6):1212–7. doi: 10.1161/01.cir.64.6.1212
48. Tribouilloy C, Rusinaru D, Szymanski C, Mezghani S, Fournier A, Lévy F, et al. Predicting left ventricular dysfunction after valve repair for mitral regurgitation due to leaflet prolapse: additive value of left ventricular end-systolic dimension to ejection fraction. Eur J Echocardiogr. (2011) 12(9):702–10. doi: 10.1093/ejechocard/jer128
Keywords: machine learning, predictive longitudinal modeling, asymptomatic primary mitral regurgitation, cardiac MRI, LVEF decline, LV circumferential strain rate
Citation: Zheng J, Huang S-w, Ahmed MI, Pat B, Lloyd SG, Sharifov OF, Denney TS Jr and Dell’Italia LJ (2024) Imminent risk of LVEF decline in asymptomatic patients with primary mitral regurgitation. Front. Cardiovasc. Med. 11:1410859. doi: 10.3389/fcvm.2024.1410859
Received: 1 April 2024; Accepted: 27 September 2024;
Published: 14 October 2024.
Edited by:
Maxim Avanesov, University Medical Center Hamburg-Eppendorf, GermanyReviewed by:
Lucia La Mura, Federico II University Hospital, ItalySunil Mankad, Mayo Clinic, United States
Andreea Calin, Carol Davila University of Medicine and Pharmacy, Romania
Copyright: © 2024 Zheng, Huang, Ahmed, Pat, Lloyd, Sharifov, Denney and Dell'Italia. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Louis J. Dell'Italia louis.dellitalia@va.gov
†ORCID:
Jingyi Zheng
orcid.org/0000-0002-0393-0997
Shao-wei Huang
orcid.org/0009-0004-1827-1084
Mustafa I. Ahmed
orcid.org/0000-0003-0885-8645
Betty Pat
orcid.org/0000-0003-1280-1457
Steven G. Lloyd
orcid.org/0000-0001-6843-0224
Oleg F. Sharifov
orcid.org/0000-0003-4799-3903
Thomas S. Denney
orcid.org/0000-0002-6695-4777
Louis J. Dell’Italia
orcid.org/0000-0001-6654-0665