- 1Department of Data Analysis and Artificial Intelligence, Synapse Research Institute, Maastricht, Netherlands
- 2Department of Anesthesiology, Ziekenhuis Oost Limburg, Genk, Belgium
- 3Department of Anesthesiology, Fondation Hopale, Berck-sur-Mer, France
- 4Department of Functional Coagulation, Synapse Research Institute, Maastricht, Netherlands
- 5Department of Internal Medicine, Meander Medical Center, Amersfoort, Netherlands
- 6Department of Clinical Chemistry, Meander Medical Center, Amersfoort, Netherlands
Thrombosis is a major clinical complication of COVID-19 infection. COVID-19 patients show changes in coagulation factors that indicate an important role for the coagulation system in the pathogenesis of COVID-19. However, the multifactorial nature of thrombosis complicates the prediction of thrombotic events based on a single hemostatic variable. We developed and validated a neural net for the prediction of COVID-19-related thrombosis. The neural net was developed based on the hemostatic and general (laboratory) variables of 149 confirmed COVID-19 patients from two cohorts: at the time of hospital admission (cohort 1 including 133 patients) and at ICU admission (cohort 2 including 16 patients). Twenty-six patients suffered from thrombosis during their hospital stay: 19 patients in cohort 1 and 7 patients in cohort 2. The neural net predicts COVID-19 related thrombosis based on C-reactive protein (relative importance 14%), sex (10%), thrombin generation (TG) time-to-tail (10%), α2-Macroglobulin (9%), TG curve width (9%), thrombin-α2-Macroglobulin complexes (9%), plasmin generation lag time (8%), serum IgM (8%), TG lag time (7%), TG time-to-peak (7%), thrombin-antithrombin complexes (5%), and age (5%). This neural net can predict COVID-19-thrombosis at the time of hospital admission with a positive predictive value of 98%-100%.
Introduction
In December 2019, Severe Acute Respiratory Syndrome-CoV-2 (SARS-CoV-2) virus emerged and caused a pandemic that led to hospitalization of over one hundred thousand patients worldwide (1). By November 2021, more than 250 million SARS-CoV-2 infections have been reported and the disease caused over 5.1 million deaths (2). The course of the disease differs greatly among patients: some patients have symptoms resembling a mild cold or are even asymptomatic, while others suffer from fulminant pneumonia requiring hospitalization and admission to the intensive care unit (ICU) (3, 4).
An important clinical complication of COVID-19 infection is thrombosis, indicating a role for the coagulation system in the pathogenesis of COVID-19 (5, 6). It was previously reported that severe COVID-19 patients have decreased antithrombin levels and increased levels of fibrinogen, fibrin degradation products and D-dimer (1). The degree of elevation correlates with the severity of the disease. Currently, COVID-19 patients admitted to the ICU are treated with low molecular heparin (LMWH) to prevent the development of thrombi that could lead to thrombo-embolism or stroke.
There have been several attempts to predict and thereby prevent thrombosis in COVID-19 patients. Due to multifactorial nature of thrombosis, one lab result is not sufficient to predict thrombosis (7). Therefore, it is unlikely that the occurrence of thrombosis in COVID-19 patients can be accurately predicted by a single lab test parameter or a combination of two. The neural net is an artificial intelligence tool that focusses on the integration of data to predict a certain outcome, in our case the occurrence of thrombosis during a COVID-19 infection (7). Since the start of the SARS-CoV-2 pandemic, many neural nets have been developed by researchers worldwide (8–17). Most of these neural nets focus on the diagnosis of COVID-19, and the neural net’s input is either an X-ray (9–13) or a computed tomography (CT)-scan of the chest (8) to study the effect of COVID-19 in the lungs. Other neural networks make predictions on a national or international level, by forecasting the COVID-19 spread through a geographical region (14–17). Additionally, researchers from the Wuhan region have shown that a neural net based on C-reactive protein, lactate dehydrogenase and lymphocyte count can predict mortality in Chinese COVID-19 patients (18).
Our goal was to use the neural networking approach to predict the risk of thrombosis during COVID-19 infection based on lab test results obtained at the time of hospital admission. Therefore, we collected blood samples of COVID-19 patients at 2 different hospitals, one population enrolled patients at the time of hospital admission (cohort 1) and one population enrolled patients admitted to the ICU (cohort 2) (19, 20). As input for our thrombosis-prediction neural network we focused on functional coagulation tests, such as the thrombin and plasmin generation, coagulation factor levels and markers of inflammation.
Materials and methods
Patients
COVID-19 patients were included at two centers (Meander Medical center in Amersfoort and Hospital Oost-Limburg in Genk) after approval of the “MEC-U” and the “Comité Medische Ethiek” medical ethics committees, respectively, and in accordance with the declaration of Helsinki. In the first cohort, COVID-19 patients were enrolled in the study at the time of hospital admission, and selected for analysis after COVID-19 infection was confirmed by a positive PCR test (n=133) (19). In the second cohort, intensive care unit (ICU) patients were included if they when tested positive for COVID-19 (n=16) (20). Samples were taken after informed consent of the patient or its legal relative. Blood was taken by venipuncture (cohort 1) or arterial catheter (cohort 2). Plasma was prepared by centrifuging twice for ten minutes at 2630g and stored at - 80°C until further analysis. In both cohorts, thrombosis was defined as pulmonary embolism, deep vein thrombosis as diagnosed by ultrasound, acute coronary syndrome, a cerebral ischemic attack or mesenteric ischemia.
Thrombin generation
TG was measured by Calibrated Automated Thrombinography (CAT) using PPP reagent, calibrator and FluCa from Diagnostica Stago (France). TG was measured in the presence or absence of thrombomodulin (TM; the concentration causing 50% inhibition of the peak height in pooled normal plasma; Synapse Research Institute, the Netherlands) to test the sensitivity of the activated protein C (APC) system. In the cohort of ICU patients, who were all treated with low molecular weight heparin, heparin was neutralized with 0.045 mg/mL polybrene added to the plasma prior to the measurement of TG. In addition to the classical TG parameters ETP, peak height, time-to-peak and lag time, novel time-to-tail and curve width were quantified. The time-to-tail was quantified as the time it takes until the thrombin concentration stays below 1 nM at the end of thrombin generation. The curve width was quantified as the difference between the lag time and time-to-tail, providing a measure for the broadness of the curve.
Thrombin dynamics
Prothrombin conversion curves were quantified form TG curves using the thrombin dynamics method (21). The following parameters were quantified from the prothrombin conversion curves: PCtot (total amount of prothrombin converted during the TG test), PCmax (maximum rate of prothrombin conversion), T-AT (amount of thrombin-antithrombin complexes formed) and T-α2M (amount of thrombin-α2M complexes formed).
Coagulation factor determinations
Plasma antithrombin, fibrinogen, FVIII, protein C and D-dimer levels were measured on the STA-R Max using the STA Stachrom AT III, STA Fibrinogen, STA Deficient FVIII, STA Staclot Protein C, and STA Liatest DDI kits, respectively, and in accordance with the manufacturers recommendations (Diagnostica Stago, France). Functional α2M levels were measured as previously described (Synapse Research Institute, the Netherlands) (21). VWF, active VWF, VWF pro-peptide were measured in house by ELISA as previously reported (22). C-reactive protein (CRP) levels were determined on the Architect C16000 according to the manufacturers specifications (Abbott, USA). Activated partial thromboplastin time (APTT) and cell counts were measured on the Sysmex CS-5100 using Innovin and Actin FSL reagents and Sysmex XN-9000 (Siemens, Germany) respectively. COVID-19 IgM titers were determined on the Afias-6 according to the manufacturers recommendations (Boditech, Republic of Korea).
Plasmin generation assay
Plasmin generation was performed as previously described (23). Plasmin generation lag time, i.e. the time it takes until plasmin in formed, was quantified to serve as an input for the neural network.
Neural network development
Matlab was used to develop and train neural networks using the neural pattern recognition application of the neural network toolbox (Mathworks, the Netherlands). The input of the “thrombosis or no thrombosis” classification network consisted of CRP, IgM titer for COVID-19, α2-Macroglobulin, thrombin-α2-Macroglobulin complexes, thrombin generation parameters (lag time, time-to-peak, time-to-tail and curve width) and plasmin lag time (Table 2). Parameters were selected based on (statistically insignificant) trends that were visible in cohort 1 and 2 and the crude (continuous) values for each parameter were used.
The hospital admissions cohort (cohort 1) was used to train the neural network, perform the initial validation and test the performance. The thrombosis group was much smaller than the non-thrombosis group (114 vs 19 subjects) in cohort 1. Subsequently, the thrombosis group was oversampled by 6-fold to overcome the difference in group size. The analysis was run 10 times and the model performance was quantified as the mean ± standard deviation of the 10 replicate analysis. The positive and negative predictive values (PPV and NPV) were calculated for each neural network to determine its diagnostic accuracy. Finally, the validity of the neural network was tested in the ICU cohort (cohort 2), which was acquired separately at another hospital to ensure the generalizability of the neural network to other patient cohorts.
Statistical analysis
Statistical analyses were performed in GraphPad Prism (version 8, San Diego, USA). The Mann Whitney test was used to compare differences between groups and statistical significance was reported as p-values below 0.05.
Results
In a total of 149 confirmed COVID-19 patients available from two study cohorts (19, 20), we quantified general laboratory parameters, the function of the coagulation system, coagulation factor levels and biomarkers of inflammation (Tables 1, 2). We studied two cohorts of COVID-19 patients (Tables 1, 2). Cohort 1 consisted of 133 COVID-19 patients enrolled in the study when they were admitted to the hospital for suspicion of COVID-19 infection and were tested positive for COVID-19 by PCR testing (Table 1). Cohort 2 consisted of 16 severe COVID-19 patients who were admitted to the intensive care unit (ICU; Table 2). The aim of this study is to create and validate a neural network that predicts thrombosis risk in COVID-19 patients, using the generated data displayed in Tables 1, 2.
Table 1 General characteristics and laboratory tests of the hospital admissions patient (n=133) cohort 1.
Table 2 General characteristics and laboratory tests of the intensive care unit patient (n=16) cohort 2.
In cohort 1 (Table 1), COVID-19 patients with thrombosis were significantly younger than patients without thrombosis, and remarkably, mortality was significantly lower in the thrombosis group. The activated partial thromboplastin time (aPTT) was comparable between the groups, but D-dimer, fibrinogen and CRP were higher in the thrombosis group. α2M was significantly lower in the thrombosis group, and FVIII and VWF were significantly higher. Even though thrombin generation, thrombin dynamics and plasmin generation showed trends towards differences between thrombotic and non-thrombotic patients, these differences were not statistically significant. In the ICU cohort 2 (Table 2), COVID-19 patients with or without thrombosis did not differ significantly in age, but thrombotic COVID-19 patients were significantly less likely to die during their hospital stay. aPTT, D-dimer, fibrinogen, CRP and other coagulation factors were comparable between the groups. Although thrombin generation, thrombin dynamics and plasmin generation showed trends towards differences between thrombotic and non-thrombotic patients, these differences were not statistically significant, except for the PG lag time.
For the neural networking approach, we tested the parameters listed in Tables 1, 2 and selected the most promising predictive parameters to achieve the highest predictive accuracy for COVID-19-related thrombosis. Figure 1 shows in detail the differences of the 10 selected parameters in thrombotic and non-thrombotic COVID-19 patients that contributed significantly to the performance of the neural network. Single thrombin generation parameters could not make a conclusive distinction between thrombosis and non-thrombosis patients, even though a trend is visible toward higher time-dependent variable values in both thrombosis groups, which is borderline significant (Figures 1B, D, H, I). ETP and peak height did not differ between thrombotic and non-thrombotic COVID-19 patients (Table 1). Thrombin dynamics analysis revealed that thrombin-inhibitor complex formation did not differ significantly between the thrombosis and non-thrombosis groups (Figures 1E, J), and comparable amounts of thrombin were formed.
Figure 1 The individual association of coagulation and general (laboratory) parameters used for the development on a neural net for the prediction of thrombosis in COVID-19 patients, arranged from most to least important. Patients without thrombosis are depicted as black circles and patients with thrombosis are depicted as blue circles. (A) C-reactive protein was significantly higher in the thrombosis group of the hospital admission cohort. (B) Anti-SARS-CoV-2 IgM antibody titer did not differ between the groups. (C) α2-macroglobulin was significantly lower in the thrombosis group of the hospital admission cohort. (D-F) The width of the TG curve, lag time and time-to-peak did not significantly different between the groups. (G-I) The time-to-tail, thrombin-antithrombin formation and thrombin-α2-macroglobulin formation did not differ between the groups. (J) The plasmin generation lag time was significantly longer in the thrombosis group of the ICU cohort. The data are represented as mean ± standard deviation. * and ** respectively indicate a p-value smaller than 0.05 and 0.01.
Another important process to maintain the hemostatic balance is the dissolvement of blood clots. A key process in clot lysis is generation of the fibrin cleaving enzyme plasmin. The time until the generation of the first traces of plasmin is significantly longer in thrombosis patients than in COVID-19 patients without thrombosis in the ICU (Figure 1F). In contrast to the significant reduction of α2M levels in thrombosis patients (Figure 1C), inflammatory marker CRP is elevated in COVID-19 patients (Figure 1A). The last input that was selected for the neural network was the IgM titer of COVID-19 antibodies because a trend was visible towards a lower IgM titer in thrombotic COVID-19 patients (Figure 1G).
Although analysis of coagulation functionality and immunology did reveal significant differences between thrombotic and non-thrombotic COVID-19 patients, these differences were not striking enough to be used for risk stratification. To integrate the selected data and in order to develop a prediction model for thrombosis, we applied the artificial intelligence method neural networks. We constructed a neural net that predicts COVID-19 related thrombosis based on laboratory parameters collected at the time of hospital admission. Table 3 summarizes the input variable used for the development of the neural network. The input parameters can be divided into 5 main groups: general characteristics, immunology, thrombin generation, thrombin inhibitors and plasmin generation. General characteristics included age and sex, and general laboratory parameters included IgM titer and CRP levels. Coagulation variables were subdivided in three groups: Thrombin generation parameters (lag time, ttPeak, ttTail, and curve width), thrombin inhibitors variables (α2M, T-α2M and T-AT) and plasmin generation. A neural network with 10 hidden neurons was trained in a randomly selected subset (70%) of the samples of the hospital admission cohort. The remaining 30% of samples were randomly divided between the validation (15%) and testing (15%) dataset. Network development was performed in 10-fold and the average results ( ± SD) are shown in Figure 2. In the non-thrombosis group, on average 112 out of 114 patients were correctly predicted to stay thrombosis-free, whereas in the thrombosis group, 16 out of 19 patients were correctly predicted to suffer from thrombosis during their hospital stay (Figure 2A). In the hospital admission cohort, the positive predictive value (PPV) was 98% (Figure 2C) and the negative predictive value (NPV) was 86%. The overall accuracy of the neural network was 91%.
Figure 2 Prediction of thrombosis in hospitalized COVID-19 patients. A neural network was constructed to predict thrombosis based on the input parameters described in table 2 in the first patient cohort. (A) The confusion matrix shows that on average 112 out of 114 non-thrombosis patients were correctly predicted and 16 out of 19 were correctly predicted to suffer from thrombosis due to COVID-19. (B) Further validation of the network in a second and separate cohort of COVID-19 patients shows the accurate prediction of 9 out of 9 non-thrombosis patients and 2 out of 7 thrombosis patients. (C) The positive predictive value (PPV) was 98% for the hospital admission cohort and 100% for the ICU cohort. (D) The negative predictive value (NPV) was 86% for the hospital admission cohort and 66% for the ICU cohort. (E) The sensitivity was 84% for the hospital admission cohort, and 34% for the ICU cohort. (F) The specificity was 99% and 100%, respectively for the hospital admission and ICU cohorts. (G) The relative importance for each input variable for the accuracy of the outcome of the neural network. Data are represented as mean ± standard deviation of 10 neural net development runs in the confusion matrices in panel A and B, and in the bar charts in (C, D).
We tested the model further in a second, separately acquired COVID-19 patient cohort. In this cohort, 9 out of 9 non-thrombotic COVID-19 patients were correctly predicted and 2 out of 7 thrombotic patients were classified correctly as patients that would suffer from a thrombosis during their hospital stay (Figure 2B). In the ICU cohort, the positive predictive value was 100% (Figure 2C) and the negative predictive value (NPV) was 66%. In Figure 2E we quantified the relative importance of each input parameter to the predictive accuracy of the neural network. CRP levels contribute the most to the predictive accuracy (14%). Both sex and ttTail contribute equally by 10%, followed by 9% contribution each of α2M, curve width and T-α2M. Plasmin generation lag time and serum IgM both contribute 8% and TG lag time and ttPeak contribute 7%. The last 10% is divided between T-AT (5%) and age (5%).
Discussion
COVID-19 patients show very diverse pathogenesis varying from mild flu-like symptoms to hospitalization, ICU admission or even death (4, 24). An important complication in COVID-19 pathogenesis is the development of thrombosis (25, 26). Many research has been conducted to study the disease process aiming to predict its severity (27–29). As COVID-19 can have a very divergent course of disease, it is of interest to predict the risk of COVID-19 severity and the risk of complications on an individual level. In this study we set out to develop a prediction algorithm for thrombosis in COVID-19 patients using the machine learning method neural networks.
We enrolled two populations of confirmed COVID-19 patients. Thrombotic complications were registered in detail for both cohorts (19, 20). Our study revealed that COVID-19 patients that suffer from COVID-19 related thrombosis have a trend towards higher TG, reduced levels of thrombin inhibitor α2M, and an elevated plasmin generation lag time. Although previous reports have shown reduced AT levels in severe COVID-19 patients, we did not observe a difference in AT in patients with or without thrombosis, although there seemed to be a trend toward lower AT levels in patients with thrombosis (1). The observed changes in hemostasis point towards a more prothrombotic phenotype, as more thrombin is formed, thrombin is inhibited less efficiently, and it takes longer until the clot is dissolved. Additionally, we found that CRP was increased, as reported by others (30). Interestingly, the mortality rate in subjects with COVID-19 related thrombosis is lower than the mortality rate in patients without thrombosis. This was proposed to be attributable to differences in age and treatment between the groups (20, 31) as older individuals are known to be at risk for severe COVID-19 complications (32), including thrombosis (33).
Even though we found differences in biomarkers of hemostasis between thrombotic and unaffected patients, the differences in test results were not pronounced enough to use a single biomarkers as an independent predictor of thrombosis in COVID-19 patients. Therefore, we used machine learning to integrate all variables into a neural net that accurately classifies COVID-19 patients with a high risk of future thrombosis at the time of hospital admission. The accuracy of the neural net is very high (91%). Especially the high positive predictive value of 98% and specificity of 99% would be very useful in the risk stratification of patients in order to treat patients with a high thrombosis risk or to avoid profound anticoagulation in COVID-19 patients at low risk for thrombosis. The neural net showed a higher PPV and specificity (both 100%) in cohort 2 that was used for the external validation of our model, indicating that the neural net can also be used for risk stratification in other COVID-19 patient cohorts.
Although many neural networks have been constructed for COVID-19 patients to predict individual risks (8–13) or even forecast the spread of the virus (14–17), this is the first network to our knowledge to accurately identify patients at high risk for COVID-19 related thrombosis. The most important contributors to the neural network to predict thrombosis are CRP, sex, thrombin inhibition by α2M (α2M levels and T-α2M formation), and the time that thrombin is present in clotting plasma (curve width and time-to-tail). The time until the first traces of thrombin and plasmin are formed is important for the accuracy of the model and thrombin-antithrombin complex formation and age are of minor importance. CRP is known to be related to disease severity (34), and sex has been reported to be an important influencer of the course of the disease since the start of the pandemic (35). Another important factor, plasma α2M levels, is both an acute phase reactant and a thrombin inhibitor (36), and to our knowledge has not previously been investigated in COVID-19 patients. Interestingly, age is of less importance than expected to the neural net, even though others have shown that the elderly have an increased risk for severe COVID-19 and COVID-19 related thrombosis. This could potentially be a result of the high overall age of both cohorts, although the cohorts represent a cross section of the population of hospitalized patients.
Additionally, this studies has two limitations, being (1) the limited sample size of the cohorts for the neural networking approach, and (2) that several input parameters for the neural net are not readily available for routine clinical laboratories. However, the developed neural net was not accurate if the thrombin generation and thrombin dynamics parameters were excluded, as the thrombin generation test is a global hemostasis test, and therefore an important predictor of thrombotic risk (37). Moreover, recent advances in the thrombin generation method have led to the development of a fully automated device to measure thrombin generation in the clinical setting (38).
In conclusion, we developed a neural network that predicts future thrombosis in COVID-19 patients at the time of hospital admission with a positive predictive value of respectively 98% and 100% in a general hospital admission and ICU cohort. A combination of general (laboratory) parameters and hemostatic markers can predict future COVID-related thrombosis, whereas the separate variables showed no or slight differences between thrombotic and non-thrombotic patients.
Data availability statement
The original contributions presented in the study are included in the article/supplementary material. Further inquiries can be directed to the corresponding author.
Ethics statement
The studies involving human participants were reviewed and approved by MEC-U” and the “Comité Medische Ethiek” medical ethics committees. The patients/participants provided their written informed consent to participate in this study.
Author contributions
RL-K and BL conceived and designed the study and co-wrote the manuscript. RL-K performed experiments, analyzed the data and performed the neural network analyses. MN performed experimental work and analysis. RJ, RF, AF, and JR performed and supervised the patients sample collection. All authors contributed to the article and approved the submitted version.
Conflict of interest
RL-K, MN, and BL declare no competing interests and are employees of Synapse Research Institute, part of Diagnostica Stago S.A.S.
The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
1. Tang N, Li D, Wang X, Sun Z. Abnormal coagulation parameters are associated with poor prognosis in patients with novel coronavirus pneumonia. J Thromb Haemost (2020) 18:844–7. doi: 10.1111/jth.14768
2. COVID-19 dashboard by the center for systems science and engineering (CSSE) at johns Hopkins university (JHU) (2021). Available at: https://coronavirus.jhu.edu/map.html.
3. Hamid S, Mir MY, Rohela GK. Novel coronavirus disease (COVID-19): a pandemic (epidemiology, pathogenesis and potential therapeutics). New Microbes New Infect (2020) 35:100679. doi: 10.1016/j.nmni.2020.100679
4. Lillicrap D. Disseminated intravascular coagulation in patients with 2019-nCoV pneumonia. J Thromb Haemost (2020) 18:786–7. doi: 10.1111/jth.14781
5. Bowles L, Platton S, Yartey N, Dave M, Lee K, Hart DP, et al. Lupus anticoagulant and abnormal coagulation tests in patients with covid-19. N Engl J Med (2020). doi: 10.1056/NEJMc2013656
6. Helms J, Tacquard C, Severac F, Leonard-Lorant I, Ohana M, Delabranche X, et al. High risk of thrombosis in patients with severe SARS-CoV-2 infection: a multicenter prospective cohort study. Intensive Care Med (2020) 46:1089–98. doi: 10.1007/s00134-020-06062-x
7. Kremers RM, Zuily S, Kelchtermans H, de Groot PG, Peters TC, Bloemen S, et al. . Atlanta, U.S.A. (2017).
8. Ardakani AA, Kanafi AR, Acharya UR, Khadem N, Mohammadi A. Application of deep learning technique to manage COVID-19 in routine clinical practice using CT images: Results of 10 convolutional neural networks. Comput Biol Med (2020) 121:103795. doi: 10.1016/j.compbiomed.2020.103795
9. Albahli S. Efficient GAN-based chest radiographs (CXR) augmentation to diagnose coronavirus disease pneumonia. Int J Med Sci (2020) 17:1439–48. doi: 10.7150/ijms.46684
10. Limongelli G, Crotti L. COVID-19 pandemia and inherited cardiomyopathies and channelopathies: a short term and long term perspective. Orphanet J Rare Dis (2020) 15:157. doi: 10.1186/s13023-020-01444-2
11. Ozturk T, Talo M, Yildirim EA, Baloglu UB, Yildirim O, Rajendra Acharya U. Automated detection of COVID-19 cases using deep neural networks with X-ray images. Comput Biol Med (2020) 121:103792. doi: 10.1016/j.compbiomed.2020.103792
12. Sakagianni A, Feretzakis G, Kalles D, Koufopoulou C, Kaldis V. Setting up an easy-to-Use machine learning pipeline for medical decision support: A case study for COVID-19 diagnosis based on deep learning with CT scans. Stud Health Technol Inform (2020) 272:13–6. doi: 10.3233/SHTI200481
13. Togacar M, Ergen B, Comert Z. COVID-19 detection using deep learning models to exploit social mimic optimization and structured chest X-ray images using fuzzy color and stacking approaches. Comput Biol Med (2020) 121:103805. doi: 10.1016/j.compbiomed.2020.103805
14. Car Z, Baressi Segota S, Andelic N, Lorencin I, Mrzljak V. Modeling the spread of COVID-19 infection using a multilayer perceptron. Comput Math Methods Med (2020) 2020:5714714. doi: 10.1155/2020/5714714
15. Das D, Santosh KC, Pal U. Truncated inception net: COVID-19 outbreak screening using chest X-rays. Phys Eng Sci Med (2020) 43:915–25. doi: 10.1007/s13246-020-00888-x
16. Kirbas I, Sozen A, Tuncer AD, Kazancioglu FS. Comparative analysis and forecasting of COVID-19 cases in various European countries with ARIMA, NARNN and LSTM approaches. Chaos Solitons Fractals (2020) 138:110015. doi: 10.1016/j.chaos.2020.110015
17. Mollalo A, Rivera KM, Vahedi B. Artificial neural network modeling of novel coronavirus (COVID-19) incidence rates across the continental united states. Int J Environ Res Public Health 17 (2020) 17. doi: 10.3390/ijerph17124204
18. Yan L, Zhang H-T, Goncalves J, Xiao Y, Wang M, Guo Y, et al. An interpretable mortality prediction model for COVID-19 patients. Nat Mach Intell (2020) 2:283–8. doi: 10.1038/s42256-020-0180-7
19. de Laat B, Traets MJM, De Laat-Kremers RMW, Verweij SP, Ninivaggi M, Jong E, et al. ¬¬Haemostatic differences between SARS-CoV-2 PCR-positive and negative patients at the time of hospital admission. PloS One Under revision (2022) 17:e0267605. doi: 10.1371/journal.pone.0267605
20. De Jongh R, Ninivaggi M, Mesotten D, Bai C, Marcus B, Huskens D, et al. Vascular activation is a strong predictor of mortality in coronavirus disease 2019 patients on the ICU. Blood Coagul Fibrinolysis (2021) 32:290–3. doi: 10.1097/MBC.0000000000001007
21. Kremers RM, Peters TC, Wagenvoord RJ, Hemker HC. The balance of pro- and anticoagulant processes underlying thrombin generation. J Thromb Haemost (2015) 13:437–47. doi: 10.1111/jth.12798
22. van der Vorm LN, Li L, Huskens D, Chayouâ W, Kelchtermans H, de Groot PG, et al. Analytical characterization and reference interval of an enzyme-linked immunosorbent assay for active von willebrand factor. PloS One (2019) 14:e0211961. doi: 10.1371/journal.pone.0211961
23. Miszta A, Kopec AK, Pant A, Holle LA, Byrnes JR, Lawrence DA, et al. A high-fat diet delays plasmin generation in a thrombomodulin-dependent manner in mice. Blood (2020) 135:1704–17. doi: 10.1182/blood.2019004267
24. Guan WJ, Ni ZY, Hu Y, Liang WH, Ou CQ, He JX, et al. Clinical characteristics of coronavirus disease 2019 in China. N Engl J Med (2020) 382:1708–20. doi: 10.1056/NEJMoa2002032
25. Panigada M, Bottino N, Tagliabue P, Grasselli G, Novembrino C, Chantarangkul V, et al. Hypercoagulability of COVID-19 patients in intensive care unit: A report of thromboelastography findings and other parameters of hemostasis. J Thromb Haemost (2020) 18:1738–42. doi: 10.1111/jth.14850
26. Guzik TJ, Mohiddin SA, Dimarco A, Patel V, Savvatis K, Marelli-Berg FM, et al. COVID-19 and the cardiovascular system: implications for risk assessment, diagnosis, and treatment options. Cardiovasc Res (2020) 116:1666–87. doi: 10.1093/cvr/cvaa106
27. Jain V, Yuan JM. Predictive symptoms and comorbidities for severe COVID-19 and intensive care unit admission: a systematic review and meta-analysis. Int J Public Health (2020) 65:533–46. doi: 10.1007/s00038-020-01390-7
28. Shang W, Dong J, Ren Y, Tian M, Li W, Hu J, et al. The value of clinical parameters in predicting the severity of COVID-19. J Med Virol (2020) 92:2188–92. doi: 10.1002/jmv.26031
29. Henry BM, de Oliveira MHS, Benoit S, Plebani M, Lippi G. Hematologic, biochemical and immune biomarker abnormalities associated with severe illness and mortality in coronavirus disease 2019 (COVID-19): a meta-analysis. Clin Chem Lab Med (2020) 58:1021–8. doi: 10.1515/cclm-2020-0369
30. Levi M, Thachil J, Iba T, Levy JH. Coagulation abnormalities and thrombosis in patients with COVID-19. Lancet Haematol (2020) 7:e438–40. doi: 10.1016/S2352-3026(20)30145-9
31. de Laat B, Traets MJM, De Laat-Kremers RWM, Verweij SP, Ninivaggi M, Jong E, et al. Haemostatic differences between SARS-CoV-2 PCR-positive and negative patients at the time of hospital admission. PloS One (2022) 17:e0267605. doi: 10.1371/journal.pone.0267605
32. Statsenko Y, Al Zahmi F, Habuza T, Almansoori TM, Smetanina D, Simiyu GL, et al. Impact of age and sex on COVID-19 severity assessed from radiologic and clinical findings. Front Cell Infect Microbiol (2021) 11:777070. doi: 10.3389/fcimb.2021.777070
33. Quezada-Feijoo M, Ramos M, Lozano-Montoya I, Sarro M, Cabo Muinos V, Ayala R, et al. Elderly population with COVID-19 and the accuracy of clinical scales and d-dimer for pulmonary embolism: The OCTA-COVID study. J Clin Med (2021) 10. doi: 10.3390/jcm10225433
34. Tian W, Jiang W, Yao J, Nicholson CJ, Li RH, Sigurslid HH, et al. Predictors of mortality in hospitalized COVID-19 patients: A systematic review and meta-analysis. J Med Virol (2020) 92:1875–1883. doi: 10.1002/jmv.26050
35. Strope JD, Chau CH, Figg WD. Are sex discordant outcomes in COVID-19 related to sex hormones? Semin Oncol (2020) 47:335–340. doi: 10.1053/j.seminoncol.2020.06.002
36. Garcia-Ferrer I, Marrero A, Gomis-Rüth FX, Goulas T. α(2)-macroglobulins: Structure and function. Subcell Biochem (2017) 83:149–83. doi: 10.1007/978-3-319-46503-6_6
37. de Laat-Kremers RMW, Yan Q, Ninivaggi M, de Maat M, de Laat B. Deciphering the coagulation profile through the dynamics of thrombin activity. Sci Rep (2020) 10:12544. doi: 10.1038/s41598-020-69415-y
Keywords: thrombin generation, neural network, COVID-19, thrombosis, prediction
Citation: de Laat-Kremers R, De Jongh R, Ninivaggi M, Fiolet A, Fijnheer R, Remijn J and de Laat B (2022) Coagulation parameters predict COVID-19-related thrombosis in a neural network with a positive predictive value of 98%. Front. Immunol. 13:977443. doi: 10.3389/fimmu.2022.977443
Received: 24 June 2022; Accepted: 30 August 2022;
Published: 28 September 2022.
Edited by:
Robert Lindsay Medcalf, Monash University, AustraliaReviewed by:
Ahmet Cagkan Inkaya, Hacettepe University, TurkeyFrancesca Cossarini, Icahn School of Medicine at Mount Sinai, United States
Copyright © 2022 de Laat-Kremers, De Jongh, Ninivaggi, Fiolet, Fijnheer, Remijn and de Laat. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Romy de Laat-Kremers, r.delaat@thrombin.com