1 Introduction
Certain materials, when exposed to sustained loads below their yielding point, and typically over long time scales and/or high temperatures, exhibit permanent deformations—a phenomenon known as creep. Creep occurs in metals under high-temperature conditions, such as those found in turbine blades (McLean, 1966), in ice causing glaciers to flow (Weertman, 1983), or in amorphous materials such as polymers (Brinson and Gates, 1995), metallic glasses (Castellero et al., 2008), or even concrete (Bazant and Wittmann, 1982), the most used man-made material worldwide. While several mechanisms responsible for creep of crystalline solids have been proposed, which include the diffusion of vacancies (Nabarro, 1948; Herring, 2004), dislocation dynamics (Harper and Dorn, 1957), or grain boundary sliding (Bell and Langdon, 1967; Langdon, 2006), all these mechanisms are based on structural defects that break the long-range order of the crystal lattice and therefore can be trivially identified. Analogous knowledge for disordered solids is understandably lacking, as what constitutes as a structural defect in these systems remains an open question. For example, intuitive structural descriptors, such as free volume or bond orientational order, have been shown to be poor predictors of the plasticity of glasses (Richard et al., 2020). Other more successful indicators have also been proposed such as soft-modes (Widmer-Cooper et al., 2008; Tanguy et al., 2010), or rattling amplitude (Larini et al., 2008), but those rely on the dynamics of the system and thus are not strictly structural.
Motivated by this challenge and the tremendous power of machine learning (ML) techniques to find patterns within complex datasets, when human intuition falls short (Bishop and Nasrabadi, 2006), (Cubuk et al., 2015) pioneered the use of ML techniques to identify potentially complex structural signatures that are predictive of the particle dynamics in glassy systems. In this context and given the challenge of collecting experimental data at the needed time and length scales, molecular dynamics (MD) simulations have become indispensable in generating high-quality, comprehensive data sets essential for the successful implementation of ML models. Despite the remarkable advancements made in this field over the past few years (Schoenholz et al., 2016; Wang and Jain, 2019; Bapst et al., 2020; Boattini et al., 2020; Fan et al., 2020; Wang et al., 2020; Liu et al., 2021; Peng et al., 2021; Wang and Zhang, 2021; Xiao et al., 2021; Wu et al., 2023), prior studies have tackled thermally-driven and stress-driven relaxation events independently. Studies focused on understanding structural signatures underlying the glass transition are based on simulations of stress-free glasses near the glass transition temperature. In contrast, those focused on predicting plastic rearrangements in disordered solids under stress rely, almost exclusively, on simulations of the glass under athermal, quasistatic shear conditions. Moreover, to the best of our knowledge, the recent work by Liu et al. (2021) stands alone in its focus on creep. Interestingly, they demonstrated, for shear strains up to approximately 1%, a strong correlation between the macroscopic creep rate and a structural descriptor derived through ML based on the initial undeformed structure of the disordered colloidal gel (Liu et al., 2021). Their simulations, however, were conducted in the quasistatic athermal regime and under oscillatory shear, which is a condition more closely related to fatigue behavior than to creep. Deriving ML structural descriptors that can predict the creep response of disordered solids under sustained loads at finite temperatures remains a largely unexplored area, and it is extremely relevant in the context, for example, of bulk metallic glasses operating at high temperatures (Li et al., 2019).
Here, we employ MD simulations to investigate the creep response of a Kob-Andersen (KA) glass (Kob and Andersen, 1995) under sustained uniaxial compressive stress at finite temperature. We provide a detailed analysis of how the macroscopic creep response of the glass is affected by the level of applied stress and temperature, as well as characterize the statistical evolution during creep of the microscopic deformations, which we characterize by the non-affine squared displacements of individual particles in the glass, . Using ML classification methods based on interpretable structural features describing the particles interstices, we are able to identify a local structural descriptor, dubbed looseness, , that can predict whether a particle in the glass will undergo an imminent plastic rearrangement based on its local interstitial environment alone. We quantify the prediction accuracy of the ML models, and explain it based on the interstitial structural features. We also study the time evolution of looseness averaged over all the particles in the glass, , as well as its spatial and temporal correlations.
2 Materials and methods
2.1 Molecular dynamics simulations
We performed MD simulations using the program LAMMPS (Thompson et al., 2022) to study the creep response of a KA glass under a sustained compressive stress at finite temperature. The KA model is a two-component Lennard-Jones (LJ) system, which has been extensively used to study the dynamics of supercooled liquids and the glass transition, due to being relatively simple and computationally efficient while still being able to capture many of the key behaviors of real glasses (Kob and Andersen, 1995). All the simulated systems here contained 10,000 particles, where 80% and 20% of them were type A and type B, respectively. The parameters of the LJ interactions are: , , , , , , , and the cutoff for the interactions was set to . All the quantities reported in this study are given in reduced Lennard-Jones units, unless specified otherwise. All the simulations were performed with periodic boundary conditions (PBCs) in all dimensions (effectively simulating bulk glasses), and a time step .
We generated initial glass configurations as follows. First, we generated a random configuration of particles in a simulation box at density , which is the equilibrium density of the KA glass. We simulated this system in the NVT ensemble for steps, using a Langevin thermostat at , which is well above the mode-coupling temperature of the KA model, (Ashwin and Sastry, 2003). Once having randomized the positions of the particles, we induced glass formation by cooling down the system to over steps in the NVT ensemble using a Nose-Hoover thermostat. As a final step, we minimized the energy of the system. We generated a total of ten unique, minimized, initial glass configurations following this process.
Starting from each of those ten glass configurations, we performed simulations in the NPT ensemble where the KA glasses were instantaneously placed under a constant uniaxial compressive stress at below and sustained for steps. During the simulations, we outputted optimized configurations, where the energy of the system was minimized under the constraint of the applied stress, every steps for analysis. From each MD simulation, we therefore collect optimized configurations for analysis. We carried out simulations at , , , , and at a stress of , and simulations at stress levels ranging from to in increments of 0.1, at a temperature of . We also performed ten simulations at and . The data from these simulations ( and ), which demonstrably reproduce the primary creep response of the KA glass, were utilized for the ML tasks.
2.2 Analysis of non-affine displacements
We calculated the non-affine squared displacement of particle over a time interval measured from , , using the equations originally proposed by Langer and Falk (Falk and Langer, 1998), which can be written as:
where is the local strain tensor around particle which minimizes the quantity between the curly brackets, is the number of particles within a cutoff distance () of particle , and is the distance between particle and particle in its neighborhood. We select , beyond which the results for showed no sensitivity to variations in this parameter. The quantity corresponds to the inter-particle distances predicted at after the affine deformation. We used our own MATLAB script to compute .
2.3 Machine learning
2.3.1 Problem statement
Our ultimate goal is to train a ML model that can predict whether or not a particle will undergo a plastic rearrangement () over some time interval , using as features only simple structural descriptors of the local neighborhood of that particle. Accordingly, we cast this problem as a supervised binary classification task. We call particles that undergo plastic rearrangements class 1 or loose, and those that do not class 0 or tight.
2.3.2 Dataset
Each particle in each of the configurations outputted during the MD simulations at steps, corresponds to an example in the dataset. The features for each particle are calculated at each and the particles are labeled as loose (class 1) or tight (class 0) depending on (the time interval over which the particle displacements are quantified) and (the threshold defining whether a particle undergoes substantial rearrangement). In this study, we focus only on the 80% of particles identified as type A, but our approach could be readily expanded to type B particles by choosing a different, suitable value for . For the dataset contains: independent MD simulations configurations particles of type A examples. As shown in Supplementary Table S1, our datasets are extremely imbalanced, with class 1, the loose particles, being the minority class as most particles in the glass do not undergo plastic rearrangements during creep.
2.3.3 Feature engineering
Inspired by the work by Wang and Jain (2019), we created features that encompass easily interpretable and straightforward structural quantities that capture the interstitial environments of each particle short- and medium-range length scales. The short-range features (SRFs) are derived from the free distances, areas, and volumes between a given particle and its neighbors. The distances, areas, and volumes, determined by pairs, triplets, and groups of four particles, respectively, are corrected for the spherical particle sizes (proportional to and ), therefore representing the interstitial non-occupied space. The nearest neighbors to any particle are found by identifying the particles associated with Voronoi cells that share a boundary with the cell of the particle in question. The tetrahedral volume is calculated using Quickhull algorithm (Barber et al., 1996). For each metric—distance, area, volume—we compute four features that correspond to the mean, maximum, minimum, and standard deviation of the calculated values for the given particle. Hence, there is a total of 12 SRFs (e.g., ). The summary statistics aim to capture the average as well as potential anisotropy of the local interstitial environment. The medium-range features (MRFs) are computed by calculating the same summary statistics, but now of the SRFs corresponding to the neighbors of the given particle. Consequently, the MRFs consists of 48 features (e.g., , …). As illustrated in Figure 1, each particle is described by a total of 60 features.
2.3.4 Workflow design
All the ML tasks in this paper were executed using Python scripts with the Scikit-Learn (Pedregosa et al., 2011) and Imbalanced-learn (Lemaître et al., 2017) packages. To evaluate and assess the ML models, we utilized balanced accuracy as our evaluation metric, which is the arithmetic mean of sensitivity, , and specificity, , where and stand for true and false, respectively, and and for positive and negative, respectively. This metric gives an equal weight to both classes, ensuring that neither the majority nor the minority class dominates the accuracy score. In this paper, we performed 3 ML tasks: 1) an investigation to select the optimal values for and , 2) implementation of recursive feature elimination (RFE) to remove highly correlated features, reduce the model complexity, and gain insight into the most important features, and 3) training a ML classification model using the optimal values of and , as well as the top ranked features.
To investigate the influence of and on the accuracy of the models, we first created, for each combination of , , or steps and , , , , , or , five balanced bootstrap samples from the overall dataset using random undersampling. In random undersampling, instances of the majority class are randomly eliminated to equalize the number of instances in both the classes. Each of the five balanced samples contained 1,285 examples from each class. We maintained a consistent dataset size across all combinations of and to isolate the effect of these two parameters. For each of the balanced samples, we performed feature standardization to prevent domination by larger-scale features, thereby enabling all features to contribute evenly to model predictions. Next, we used cross-validation CV to identify the optimal regularization hyperparameter, , for a logistic regression model. After determining the optimal , we used 5-fold CV to compute the validation balanced accuracy of the models.
We used RFE, once established and , to remove highly correlated features, reduce the model complexity, and improve interpretability (McLean, 1966). Data from 8 of the 10 MD simulations were used for this task, with the remainder reserved for testing the final model. Using random undersampling, we generated five independent balanced bootstrap samples containing 2,115 instances from each class. After standardizing the features, RFE was then performed using a gradient boost classifier (GBC) as the estimator.
Using and along with the top 10 ranked features identified through RFE, we trained an ML classification model to predict the particle labels. We applied the same training and testing split as in the RFE study and standardized the training and testing dataset features independently to avoid leakage. We used EasyEnsemble as our ML algorithm (Liu et al., 2009), where an ensemble of learners is trained on different balanced bootstrap samples. Random under-sampling was utilized to balance the samples. Our ensemble comprised 10 learners using logistic regression as the base estimator with an optimal regularization parameter (see Supplementary Table S2 for details). The model output, termed as looseness, , represents the probability of a particle being classified as loose or class 1. We decided to use logistic regression due to its simplicity and because it provides a probability for the predictions.
2.4 Fluctuations, space, and time autocorrelation functions
We calculated the space autocorrelation function of looseness, , using:
where is the looseness of particle at time , is the looseness of particle at a distance of particle at time , and is the average looseness of the system at time . The outer angle brackets indicate the average over times and pairs of particles .
To characterize the temporal autocorrelation, we require a fixed reference space frame. To that end, we map each configuration of the glass to a cube of side 1, discretize that space into 15 × 15 × 15 voxels, and map the looseness of individual particles to each voxel in the normalized cube. That transformation allows us to track the time correlations of a looseness field, , in a reference frame that does not depend on the ever changing position of individual particles. The expression of the time autocorrelation function of the looseness field, , is:
Where is the value of the looseness field at time and position , is the value of the looseness field at the same position at time , and is the average looseness of the system at time (). The outer angle brackets indicate the average over time origins, , and spatial locations, .
We quantify the fluctuations of the looseness field as a function of system size, , as follows. At each time , we divide the system into voxels of the same size, each at position , as described above. Then, we calculate the fluctuations in each voxel, , as the standard deviation of the looseness of the particles pertaining to that voxel, , with respect to the average looseness of the system, . Finally, we average the fluctuations across all voxels and all times:
3 Results and discussion
3.1 Macroscopic and microscopic creep response of the KA glass from MD simulations
We use the term macroscopic response, to denote the response at the system level, as our simulations are conducted on bulk glasses. Conversely, microscopic response pertains to the dynamics of individual particles. Figure 2A shows the uniaxial strain evolution of the KA glass under a uniaxial compressive stress of , and at different temperatures below . The responses shown correspond each to the average over ten independent runs starting from different initial configurations of the glass. At the lowest temperature, the creep response is suppressed, at least over the duration of our simulations and the foreseeable future. In contrast, as the temperature nears the glass transition point, the system deforms significantly under the instantaneously applied uniaxial stress, and the strain increases dramatically fast (only a reduced range of strain is shown in Figure 2A). For the intermediate temperatures, the strain clearly shows a logarithmic dependence on time, , where is the creep modulus, and is the initial elastic deformation of the glass under . This response is characteristic of primary creep where the rate of deformation decays inversely proportional to time, . Figure 2B shows the effect of the stress on the creep modulus of the KA glass at . The creep modulus remains approximately constant for stress levels below approximately , suggesting that inertial effects on the macroscopic mechanical response of the glasses resulting from the instantaneous application of the compressive stress are unimportant for . In Figure 2C, we show the evolution of uniaxial strain for and , for each of the ten independent runs starting from different initial glass configurations (shades of blue), as well as the average response (black). The primary creep response of the glass is not only obvious for the average, but also evident in the individual responses, despite the presence of significant fluctuations, which can be attributed to the relatively modest size of the systems simulated.
To characterize the microscopic response of the glasses during creep at and , we calculated the non-affine squared displacements for each particle , over a time interval from to : . Non-affine displacements are particularly useful as they are associated to local plastic rearrangements. As discussed in the Section 2, this analysis is done using only optimized configurations of the glasses, which are outputted every steps during the simulations. In Figure 3A, we show, in the log-log scale, the distributions of non-affine displacements for steps, and taken at different times throughout the simulation, , , , and steps. The distributions incorporate data from all ten simulated systems. First, it is evident that, regardless of , all the distributions display long, power-law tails to the right. These long-tails are strong evidence of the existence of a small number of particles that undergo plastic rearrangements during . The power-law structure of the tails likely emerges from the convolution of the myriad of distinct particle environments in the glass which lead to as many characteristic relaxation timescales. With the progression of time (blue to yellow in Figure 3A), the average non-affine squared displacement trends towards lower values (Figure 3B), and decay of the power-law tail becomes steeper, as shown by the evolution of the scaling exponent, , shown in Figure 3C. Therefore, both the average and extreme non-affine displacements appear to shift towards lower values as creep progresses. Interestingly, the scaling exponent of the power-law tail decreases logarithmically in time, analogous to the creep strain. This suggests that the tail of the distributions of non-affine displacements contain information about the creep response of the glass.
3.2 Understanding the effect of and on accuracy of the ML predictions
Two key parameters, and , determine whether a particle is classified as loose or tight. The choice of these parameters will, therefore, directly impact the quality of the dataset, and subsequently the accuracy of the ML predictions. While the long-tails in the probability distributions of are strong evidence of the existence some particles that undergo plastic rearrangements, it is worth noting that there is no well-defined threshold, , that can be used to unequivocally identify them, given the continuous nature of the distribution. The time interval over which the non-affine displacement in measured, , is also critical, but its effect has not been investigated or discussed in previous studies. In this section, we investigate the effect of and on the accuracy of a classification model aimed at predicting whether or not a particle will undergo a plastic rearrangement () over some time interval .
Figure 4 shows the validation accuracy for each class of classification models trained as described in the Section 2. Both Figures 4A, B show that the model performs slightly better on the majority class, which is expected given a series of factors including information richness and sampling quality. It is worth noting that the datasets used for training and validation, but not testing, were balanced using random undersampling. In Figure 4A, we see that the accuracy of the models increases monotonically with the threshold , but appears to plateau beyond . This can be explained by considering that particles with larger possess structural environments that are highly correlated to plastic rearrangements, while those with lower exhibit environments that may lead to such rearrangements, but with lower probability. Therefore, more selective thresholds lead to datasets with more reliable labels for the minority class, which helps to enhance the accuracy of the model. The plateauing of the accuracy is likely due to a concurrent significant decrease in the instances of the minority class within the dataset (as shown in Supplementary Table S1), which constrains the ability of the model to effectively learn from this class.
Figure 4B shows a logarithmic decay of the model accuracy with increasing . We attribute this drop in accuracy to the changes in the local environment of the particles over time, which, over extended periods, can lead to memory loss of the initial structural conditions. In other words, the structural evolution of the system weakens the correlation between the environment used for feature computation, and the future behavior that the ML model is striving to predict. The logarithmic dependence of the accuracy on can be explained by the fact that the structural evolution becomes increasingly slow during creep (i.e., increasingly longer periods of time are required to achieve a similar magnitude of structural reorganization). We hypothesize that for short enough , the accuracy of the model would also decrease based on the following argument. Given a local structural environment, the time it takes for a particle to undergo a plastic rearrangement will follow a statistical distribution. For example, if the process is activated, the time it takes a particle to undergo a plastic rearrangement would follow a Poisson distribution with a rate given by , where is an attempt frequency, is an activation barrier (presumably conditioned by the particle’s structural environment), and is the thermal energy. If ∆t is so short that it doesn't encompass reasonable extremes of that distribution, then particles will be labeled as tight or class 0, even if the structural environment is correlated to plastic rearrangements over longer, more appropriate time scales. Further investigations will be required to validate this hypothesis. Based on our results, we use steps and to label the particles in the dataset moving forward. As shown in Supplementary Figure S1, other evaluation metrics, including the AUC (Area Under the Curve), which measures the ability of the model to discriminate between classes at various thresholds, and the F1 score, which captures the balance between precision and recall, are consistent with the class-specific accuracy. The consistency across these metrics provides a more robust confirmation of the predictive capability of the model and suggests its generalizability and robustness.
3.3 Feature selection and physical interpretation of the most important features
Before training the final classification ML model used to predict plastic rearrangements, we carry out RFE to identify and select the most important of the 60 features in the dataset. To this end, we use the data from the ten simulations at and , where the examples were labeled using and . We perform RFE following the steps outlined in the Section 2. The testing balanced accuracy as a function of the number of top ranked features is shown in Figure 5A, which shows that the model accuracy peaks around the inclusion of 10 features, after which it experiences a slight gradual decrease in accuracy with the addition of more features. This decrease in accuracy can be attributed to various factors, including linear correlations between the features and the possibility of overfitting that arises from the increased complexity of the model.
In Figure 5B, we show the top 10 ranked features by RFE, which will be used later to train the final model. The distribution between SRFs and MRFs is 4 to 6, suggesting that the medium-range order, which in the context of our work captures the interstitial environments of a particle’s neighbors (as determined by a Voronoi construction), plays a substantial role in determining plastic rearrangements. Interestingly, none of the selected SRFs—, , , and —correspond to average quantities. The features related to the standard deviation encapsulate the variability in the particle’s local structural environment, whereas the minimum-related feature denotes an extreme of this environment. For example, a high standard deviation could suggest a high degree of heterogeneity in the structural environment, while a minimum could signify a limiting factor that precludes a plastic rearrangement. Overall, the selection of these SRFs suggests that the short-range structural heterogeneity and the distance to the closest neighbor play a significant role in the prediction of plastic events in KA glasses. Regarding the MRFs, 4 out of the 6 selected MRFs correspond to averages of SRFs related to non-mean summary statistics. This suggests that across mid-range length scales, beyond the nearest neighbors, the average heterogeneity significantly influences the occurrence of plastic rearrangements. Notably, half of the selected MRFs are associated to the selected SRFs, specifically , , and , further underlining the importance of these structural variables in the predictive process. Overall, the majority of the selected features relate to distances and volumes, with only 2 out of 10 related to areas. The prominence of distances may reflect the influence of local spatial configurations or the connectivity of the glass, when conceptualized as a graph. The significance of volume-based features could be indicative of the importance of local density fluctuations.
3.4 Predicting creep using the ML derived structural indicator looseness
As detailed in the Section 2, we apply the EasyEnsemble algorithm with logistic regression as the estimator, using random under-sampling to balance the dataset, to train a ML model that predicts the probability of a particle to be classified as loose or class 1 within the system. We refer to this prediction metric as looseness, , which, unlike previous machine learning-derived descriptors, such as softness (Cubuk et al., 2015; Cubuk et al., 2017; Liu et al., 2021), is bounded: . The balanced accuracy of the model stands at 71.6% for the (balanced) training set and 70.7% for the (unbalanced) testing set, which is comparable to the accuracy reported in previous studies (Liu et al., 2021). The close values between training and testing accuracies indicate that our model is generalizing well, being able to classify correctly over 70% of previously unseen particles (Figure 5C). Specifically, the model achieved an accuracy of 67.9% for the minority class of loose particles and 73.5% for the majority class of tight particles. Additionally, the AUC for the test set balanced using random undersampling is 0.772. The F1 score, calculated for each label and averaged with weighting based on the number of true instances for each label in the test set, is 0.848.
Figure 6A shows the probability density of particles as a function of the squared non-affine displacements, , and the predicted looseness, . This diagram was created as follows: for each interval in , we calculated the probability density of the looseness of all the particles in the dataset with squared non-affine displacements within that range. It is clear that the loose or tight populations of particles are well discriminated in the plane defined by and , with the loose and tight particles being characterized by high and low values, respectively. Our results demonstrate that the thresholds used to label particles, namely, and , effectively serve to separate and classify the particles as loose or tight (Figure 6A). Figure 6B shows the probability density of looseness for all particles, (blue line), as well as the conditional probability of looseness for just the loose or class 1 particles, (bars). The overall distribution, which captures the underlying unbalanced character of the data set, shows that most of the particles as classified as tight, with the bulk of the looseness predictions being from about to . For , decays close to linearly. The conditional probability reveals that about 71% of particles labeled as loose are assigned by the model, which is, as it should, consistent with the accuracy of the model. The conditional probability of given that a particle has been labeled as loose, , follows an approximately exponential relation with (Figure 6C), which means that it is increasingly unlikely for a particle labeled as loose to be assigned a low by the model. For example, there is a one in a million chance for a particle labeled as loose to receive a looseness assignment of 0.2 from the model. It is worth noting that because is bounded, we expect the exponential relationship to break down for values of near the boundaries.
The time evolution of the average looseness in the glass, , where the angular brackets indicate ensemble average over all the particles in the glass, is shown in Figure 7A. The overall looseness of the system decreases as the glass creeps, which is consistent with the fact that the glass structure becomes less conducive to plastic rearrangements over time. Interestingly, this decrease in looseness approximately follows a logarithmic time dependence, , which is reminiscent of the evolution of the average macroscopic strain (Figure 7B): . Our results suggest that , a machine-learned local descriptor based on simple, interpretable structural quantities, not only serves as an effective tool to predict microscopic plastic rearrangements in the KA glass during creep, but its ensemble-average, , correlates with the macroscopic creep response of the glass.
3.5 Fluctuations, and spatial and temporal autocorrelations of looseness
We characterize the scaling of the fluctuations of the looseness field as a function of system size, , as described in the Section 2. Figure 8A shows that, overall, as the system size increases, the fluctuations become smaller. It is worth noting that for a size equal to the entire simulated system (i.e., ), the fluctuations will become (artifactually) zero, which implies that our analysis is only valid for . It is well established from equilibrium statistical mechanics that the fluctuations on thermodynamics properties scale with system size as . We observe that for , scales in a manner similar to equilibrium fluctuations in relation to system size, which is somewhat unexpected considering the non-equilibrium nature and heterogeneity of the glasses. The space autocorrelation of , , shown in Figure 8B reveals short-range spatial correlations only, with a decay length scale of . Beyond that, spatial correlations are lost, which is consistent with the lack of long-range order in the KA glass.
As described in the Section 2, in order to characterize the temporal autocorrelations, , we discretize space into voxels and map the looseness of individual particles to each voxel. That transformation allows us to track the time correlations of the looseness field, , in a reference frame that does not depend on the ever evolving position of individual particles. The , shown in Figure 9A characterized by a very sharp drop over the first time interval due to the relatively large random fluctuations of looseness between consecutive configurations outputted for analysis. If one subtracts this effect, the decays over steps, after which it becomes slightly negatively correlated, and finally it slowly decorrelates over the timescale of the simulation (i.e., steps). The reason for the negative correlation observed in Figure 9A, can be explained based on the evolution of looseness at the single voxel level (an example is shown in Figure 9B), which does not gradually change over time, but rather undergoes sudden changes in values. A careful look at the time autocorrelation of individual voxels in space, , reveals that the response is highly heterogeneous (Figure 9C), and therefore the average correlation shown in Figure 9A does not reveal the full picture. We observe that some voxels, the decay time scale is almost instantaneous, while for other it lasts over to steps (Figure 9B). We quantify the heterogeneity in the relaxation time scales in Figure 9D, where we plot the probability distribution of times at which the for individual voxels crosses zero, . We observe a clear power-law distribution of correlation time scales, with an exponent close to . We also observe a limit to the power-law behavior at steps, beyond which the probability of observing the looseness of a given voxel decorrelating slower than that quickly becomes null. It is likely that depends on the particular glass model and loading conditions, and .
4 Conclusion
In this study, we used a machine-learning (ML) classification model based on logistic regression trained with data from molecular dynamics (MD) simulations of Kob-Andersen (KA) glasses to derive a local structural descriptor, termed looseness, , which highly correlates with the propensity of particles to undergo plastic rearrangements during creep. Unlike other ML-derived structural descriptors such as softeness (Cubuk et al., 2015; Liu et al., 2021), looseness is based on straightforward, interpretable features and yields a real probability bound between 0 and 1. Our model can predict with an accuracy exceeding 70% whether an unseen particle within a KA glass will undergo a plastic rearrangement within a certain time interval. We showed that the evolution of the average looseness of the glass system, , mirrors the logarithmic time dependence observed in creep strain. This correlation highlights the link our model is able to establish between the microscopic dynamics at the single particle level over short time scales and the long-term macroscopic creep response of the KA glass. Our feature importance analysis revealed that none of the selected Short Range Features (SRFs) correspond to average quantities. Rather, features related to the extremal summary statistics of the interstitial structural environment dominate, emphasizing the critical role of short-range structural heterogeneity in predicting plastic rearrangements in KA glasses. Moreover, over half of the most important features were associated to the medium-range structural order of the glass, which highlights the importance of this length scale in predicting plastic rearrangements. Furthermore, our analysis of the spatial correlations of looseness revealed correlations only up to the medium-range length scale, beyond which the correlations die off–a finding that aligns with the lack of long-range order typical of the KA glass. Our examination of the temporal correlations of looseness unveiled a power-law distribution of relaxation timescales, which is reminiscent of the dynamic heterogeneity often postulated for glassy systems (Flenner and Szamel, 2010).
In conclusion, our research underscores the substantial predictive power of ML-derived structural indicators in systems experiencing concurrent stress and thermal excitations. Nonetheless, future research will be required to untangle the intricate interplay between thermal fluctuations and mechanical activation of structural defects in disordered solids, and how each contributes to the overall mechanical behavior of the system.
Data availability statement
The raw data supporting the conclusion of this article will be made available by the authors, without undue reservation.
Author contributions
MW: Methodology, Software, Visualization, Writing–Original draft. LR: Conceptualization, Methodology, Software, Supervision, Writing–Original draft.
Funding
The author(s) declare that no financial support was received for the research, authorship, and/or publication of this article.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fmats.2023.1272355/full#supplementary-material
References
Ashwin, S. S., and Sastry, S. (2003). Low-temperature behaviour of the kob–andersen binary mixture. J. Phys. 15 (11), S1253–S1258. doi:10.1088/0953-8984/15/11/343
CrossRef Full Text | Google Scholar
Bapst, V., Keck, T., Grabska-Barwińska, A., Donner, C., Cubuk, E. D., Schoenholz, S. S., et al. (2020). Unveiling the predictive power of static structure in glassy systems. Nat. Phys. 16 (4), 448–454. doi:10.1038/s41567-020-0842-8
CrossRef Full Text | Google Scholar
Barber, C. B., Dobkin, D. P., and Huhdanpaa, H. (1996). The Quickhull algorithm for convex hulls. ACM Trans. Math. Softw. 22 (4), 469–483. doi:10.1145/235815.235821
CrossRef Full Text | Google Scholar
Bazant, Z. P., and Wittmann, F. H. (1982). Creep and shrinkage in concrete structures. United States: Wiley.
Google Scholar
Bell, R. L., and Langdon, T. G. (1967). An investigation of grain-boundary sliding during creep. J. Mater. Sci. 2 (4), 313–323. doi:10.1007/BF00572414
CrossRef Full Text | Google Scholar
Bishop, C. M., and Nasrabadi, N. M. (2006). Pattern recognition and machine learning. Berlin, Germany: Springer.
Google Scholar
Boattini, E., Marín-Aguilar, S., Mitra, S., Foffi, G., Smallenburg, F., and Filion, L. (2020). Autonomously revealing hidden local structures in supercooled liquids. Nat. Commun. 11 (1), 5479. doi:10.1038/s41467-020-19286-8
PubMed Abstract | CrossRef Full Text | Google Scholar
Brinson, L. C., and Gates, T. S. (1995). Effects of physical aging on long term creep of polymers and polymer matrix composites. Int. J. Solids Struct. 32 (6–7), 827–846. doi:10.1016/0020-7683(94)00163-q
CrossRef Full Text | Google Scholar
Castellero, A., Moser, B., Uhlenhaut, D., Dalla Torre, F., and Löffler, J. F. (2008). Room-temperature creep and structural relaxation of Mg–Cu–Y metallic glasses. Acta Mater. 56 (15), 3777–3785. doi:10.1016/j.actamat.2008.04.021
CrossRef Full Text | Google Scholar
Cubuk, E. D., Ivancic, R. J. S., Schoenholz, S. S., Strickland, D. J., Basu, A., Davidson, Z. S., et al. (2017). Structure-property relationships from universal signatures of plasticity in disordered solids. Science 358 (6366), 1033–1037. doi:10.1126/science.aai8830
PubMed Abstract | CrossRef Full Text | Google Scholar
Cubuk, E. D., Schoenholz, S. S., Rieser, J. M., Malone, B. D., Rottler, J., Durian, D. J., et al. (2015). Identifying structural flow defects in disordered solids using machine-learning methods. Phys. Rev. Lett. 114 (10), 108001. doi:10.1103/PhysRevLett.114.108001
PubMed Abstract | CrossRef Full Text | Google Scholar
Falk, M. L., and Langer, J. S. (1998). Dynamics of viscoplastic deformation in amorphous solids. Phys. Rev. E 57 (6), 7192–7205. doi:10.1103/PhysRevE.57.7192
CrossRef Full Text | Google Scholar
Fan, Z., Ding, J., and Ma, E. (2020). Machine learning bridges local static structure with multiple properties in metallic glasses. Mater. Today 40, 48–62. doi:10.1016/j.mattod.2020.05.021
CrossRef Full Text | Google Scholar
Flenner, E., and Szamel, G. (2010). Dynamic heterogeneity in a glass forming fluid: susceptibility, structure factor, and correlation length. Phys. Rev. Lett. 105 (21), 217801. doi:10.1103/physrevlett.105.217801
PubMed Abstract | CrossRef Full Text | Google Scholar
Harper, J., and Dorn, J. E. (1957). Viscous creep of aluminum near its melting temperature. Acta Metall. 5 (11), 654–665. doi:10.1016/0001-6160(57)90112-8
CrossRef Full Text | Google Scholar
Kob, W., and Andersen, H. C. (1995). Testing mode-coupling theory for a supercooled binary Lennard-Jones mixture. II. Intermediate scattering function and dynamic susceptibility. Phys. Rev. E 52 (4), 4134–4153. doi:10.1103/PhysRevE.52.4134
PubMed Abstract | CrossRef Full Text | Google Scholar
Langdon, T. G. (2006). Grain boundary sliding revisited: developments in sliding over four decades. J. Mater. Sci. 41, 597–609. doi:10.1007/s10853-006-6476-0
CrossRef Full Text | Google Scholar
Larini, L., Ottochian, A., De Michele, C., and Leporini, D. (2008). Universal scaling between structural relaxation and vibrational dynamics in glass-forming liquids and polymers. Nat. Phys. 4 (1), 42–45. doi:10.1038/nphys788
CrossRef Full Text | Google Scholar
Lemaître, G., Nogueira, F., and Aridas, C. K. (2017). Imbalanced-learn: a Python toolbox to tackle the curse of imbalanced datasets in machine learning. J. Mach. Learn. Res. 18 (1), 559–563.
Google Scholar
Li, M.-X., Zhao, S.-F., Lu, Z., Hirata, A., Wen, P., Bai, H.-Y., et al. (2019). High-temperature bulk metallic glasses developed by combinatorial methods. Nature 569 (7754), 99–103. doi:10.1038/s41586-019-1145-z
PubMed Abstract | CrossRef Full Text | Google Scholar
Liu, H., Xiao, S., Tang, L., Bao, E., Li, E., Yang, C., et al. (2021). Predicting the early-stage creep dynamics of gels from their static structure by machine learning. Acta Mater. 210, 116817. doi:10.1016/j.actamat.2021.116817
CrossRef Full Text | Google Scholar
Liu, X. -Y., Wu, J., and Zhou, Z. -H. (2009). Exploratory undersampling for class-imbalance learning. IEEE Trans. Syst. Man, Cybern. Part B 39 (2), 539–550. doi:10.1109/TSMCB.2008.2007853
PubMed Abstract | CrossRef Full Text | Google Scholar
McLean, D. (1966). The physics of high temperature creep in metals. Rep. Prog. Phys. 29 (1), 1–33. doi:10.1088/0034-4885/29/1/301
CrossRef Full Text | Google Scholar
Nabarro, F. (1948). Deformation of crystals by the motion of single lonsin report of a conference on the strength of solids (bristol, UK). Phys. Soc. 75, 75–90.
Google Scholar
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., et al. (2011). Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12 (85), 2825–2830.
Google Scholar
Peng, Z.-H., Yang, Z.-Y., and Wang, Y.-J. (2021). Machine learning atomic-scale stiffness in metallic glass. Extreme Mech. Lett. 48, 101446. doi:10.1016/j.eml.2021.101446
CrossRef Full Text | Google Scholar
Richard, D., Ozawa, M., Patinet, S., Stanifer, E., Shang, B., Ridout, S. A., et al. (2020). Predicting plasticity in disordered solids from structural indicators. Phys. Rev. Mater. 4 (11), 113609. doi:10.1103/PhysRevMaterials.4.113609
CrossRef Full Text | Google Scholar
Schoenholz, S. S., Cubuk, E. D., Sussman, D. M., Kaxiras, E., and Liu, A. J. (2016). A structural approach to relaxation in glassy liquids. Nat. Phys. 12 (5), 469–471. doi:10.1038/nphys3644
CrossRef Full Text | Google Scholar
Tanguy, A., Mantisi, B., and Tsamados, M. (2010). Vibrational modes as a predictor for plasticity in a model glass. Europhys. Lett. 90 (1), 16004. doi:10.1209/0295-5075/90/16004
CrossRef Full Text | Google Scholar
Thompson, A. P., Aktulga, H. M., Berger, R., Bolintineanu, D. S., Brown, W. M., Crozier, P. S., et al. (2022). Lammps - a flexible simulation tool for particle-based materials modeling at the atomic, meso, and continuum scales. Comput. Phys. Commun. 271, 108171. doi:10.1016/j.cpc.2021.108171
CrossRef Full Text | Google Scholar
Wang, Q., Ding, J., Zhang, L., Podryabinkin, E., Shapeev, A., and Ma, E. (2020). Predicting the propensity for thermally activated β events in metallic glasses via interpretable machine learning. NPJ Comput. Mater. 6 (1), 194. doi:10.1038/s41524-020-00467-4
CrossRef Full Text | Google Scholar
Wang, Q., and Jain, A. (2019). A transferable machine-learning framework linking interstice distribution and plastic heterogeneity in metallic glasses. Nat. Commun. 10 (1), 5537. doi:10.1038/s41467-019-13511-9
PubMed Abstract | CrossRef Full Text | Google Scholar
Wang, Q., and Zhang, L. (2021). Inverse design of glass structure with deep graph neural networks. Nat. Commun. 12 (1), 5359. doi:10.1038/s41467-021-25490-x
CrossRef Full Text | Google Scholar
Weertman, J. (1983). Creep deformation of ice. Annu. Rev. Earth Planet. Sci. 11 (1), 215–240. doi:10.1146/annurev.ea.11.050183.001243
CrossRef Full Text | Google Scholar
Widmer-Cooper, A., Perry, H., Harrowell, P., and Reichman, D. R. (2008). Irreversible reorganization in a supercooled liquid originates from localized soft modes. Nat. Phys. 4 (9), 711–715. doi:10.1038/nphys1025
CrossRef Full Text | Google Scholar
Wu, Y., Xu, B., Zhang, X., and Guan, P. (2023). Machine-learning inspired density-fluctuation model of local structural instability in metallic glasses. Acta Mater. 247, 118741. doi:10.1016/j.actamat.2023.118741
CrossRef Full Text | Google Scholar
Xiao, S., Liu, H., Bao, E., Li, E., Yang, C., Tang, Y., et al. (2021). Finding defects in disorder: strain-dependent structural fingerprint of plasticity in granular materials. Appl. Phys. Lett. 119 (24), 241904. doi:10.1063/5.0068508
CrossRef Full Text | Google Scholar