Significance
We show that material plasticity can be precisely and efficiently predicted by deep-learning methods. This approach is fundamentally different from the century-old theory of continuum plasticity because it is not iteratively tracing the yield surface, neither does it require the notion of effective strain or stress at the macroscopic level. Instead, we use representative computer simulations of materials, including microstructure and constituents, load them along different deformation paths, and then learn the reversible, irreversible, and history-dependent phenomena directly from data. We demonstrate that complex phenomena such as distortional hardening can be predicted within 0.5% error. The generality of the methodology and widespread importance of plasticity in designing structures and materials make it useful to a myriad of fields.
Keywords: deep learning, data-driven modeling, recurrent neural network, plasticity
Abstract
Plasticity theory aims at describing the yield loci and work hardening of a material under general deformation states. Most of its complexity arises from the nontrivial dependence of the yield loci on the complete strain history of a material and its microstructure. This motivated 3 ingenious simplifications that underpinned a century of developments in this field: 1) yield criteria describing yield loci location; 2) associative or nonassociative flow rules defining the direction of plastic flow; and 3) effective stress–strain laws consistent with the plastic work equivalence principle. However, 2 key complications arise from these simplifications. First, finding equations that describe these 3 assumptions for materials with complex microstructures is not trivial. Second, yield surface evolution needs to be traced iteratively, i.e., through a return mapping algorithm. Here, we show that these assumptions are not needed in the context of sequence learning when using recurrent neural networks, diverting the above-mentioned complications. This work offers an alternative to currently established plasticity formulations by providing the foundations for finding history- and microstructure-dependent constitutive models through deep learning.
History-dependent phenomena are common in natural and social systems (1). For example, the process of writing a new text starts by choosing the first word from all possible words, but then the words that follow depend on the past choices of words and their sequence. Plastic deformation of materials also depends on the history or path of deformation. If a bar is plastically deformed, the permanent strains that arise affect the subsequent deformation because the local stiffness changes. Therefore, predicting plastic behavior is nontrivial. We propose to address this challenge by using deep learning to find history- and microstructure-dependent plasticity models when abundant data of material behavior is available. This inverts the logic of continuum plasticity modeling where the goal is to predict inelastic deformation using minimal data from experimental testing. Deep-learning plasticity laws are shown to be computationally efficient and accurate, even when describing complex phenomena such as distortional hardening.
The remarkable success of continuum plasticity stems from reducing complex 3-dimensional (3D) inelastic phenomena to phenomenological laws defined by 1) a yield criterion, 2) a plastic flow normal to a plastic potential, and 3) an effective stress–strain law often defined from simple experiments (e.g., uniaxial tension). This achievement of describing plasticity for general stress states based on information from a limited amount of experiments should not be understated. The archetypal example is the von Mises model (2) with isotropic hardening, where metal plasticity is fully characterized (both yield surface and hardening) by a single uniaxial tensile test of the material. However, complexity of computational plasticity models tends to substantially grow as material behavior and plastic effects become more intricate when addressing phenomena such as the Bauschinger effect (3, 4), ratcheting (5, 6), anisotropy (7, 8), viscoplasticity (9), permanent softening (10, 11), and distortional hardening (12–14). These and other phenomena continue to be intensely investigated. For example, the past decade has introduced a shift from solutions based on the Armstrong–Frederick-type hardening (3) to models based on multiple yield surfaces (11) and distortional hardening (14). Still, the fundamental principle of reducing hardening of all 6 stress components to effective laws remains a central tenet to minimizing experimental testing, and the computational expense of finding iterative solutions for the plasticity equations remains an issue.
Modeling plasticity via machine learning requires a different perspective. Similarly to other fields where, for example, machine learning is helping to design new materials (15, 16) and to predict protein behavior (17), the key to learning constitutive models of materials is to generate data about material behavior. This has been achieved for nonlinear elastic constitutive laws where data are created by finite element analysis (FEA) of representative volume elements (RVEs) (18, 19) and, more recently, to determine property maps obtained from plasticity and fracture simulations of RVEs (19). As detailed in ref. 19, finding material models by machine learning is possible if the computational analyses of RVEs have high fidelity and sufficient efficiency to generate “enough” data for the supervised learning tasks. The required amount of data are problem-dependent, and generally more data are needed as the functional relation between the quantities of interest and the variables becomes more complex. Nevertheless, learning-plasticity behavior requires going one step further by considering sequence learning, a branch of deep learning, to incorporate history dependence and efficiently merge high-dimensional “temporal” strain paths and nontemporal geometry descriptors. Note that “temporal” strain paths here refer to snapshots of deformation, not rate dependency. We elaborate on this later.
Theoretical Approach
Finding plasticity models can then follow the recently proposed 3-module data-driven framework (19) that integrates: 1) design of experiments to sample the input space; 2) computational analyses to create a database of outputs corresponding to each input configuration; and 3) machine learning to find the constitutive law that links inputs and outputs. As mentioned, here we focus on considering sequence learning for the third component, specifically recurrent neural networks (RNNs). Appropriate methodologies for design of experiments and computational analyses are also briefly described.
In general, finding constitutive laws by analyzing RVEs requires the definition of an input space with 3 types of variables: microstructural descriptors (e.g., volume fraction, inclusion geometries, etc.), material properties for each microstructural phase (e.g., elastic moduli, yield behavior, etc.), and loading conditions (e.g., average deformation, temperature, etc.). Past investigations and references therein (19) have shown that these temporally-fixed features are effectively sampled by Sobol sequence or Latin hypercube sampling when no prior knowledge is assumed (20). Sampling temporally varying features such as deformation path is more intricate as it involves generating a sequence of points (rather than a single point) for each sample path (Fig. 1A). To address this issue, we assume that any dynamic feature evolves to its end state in steps of size . From these steps, we then choose equally spaced ones as control points and assign them random deformations which are uniformly drawn from the feature’s range. Finally, we realize a deformation path by connecting the strain component values of these control points via an interpolator (2 different examples in Fig. 1B). We have considered 2 different interpolators: Gaussian process (GP) and polynomial regression, see Fig. 1B. For multidimensional features such as strain, we generate paths along each dimension independently.
Following design of experiments, we analyze the resulting input database by implicit static FEA of heterogeneous RVEs under periodic boundary conditions (Materials and Methods). Therefore, finding the constitutive behavior of a heterogeneous material is possible by converting the average deformation applied to the RVE into a periodic boundary value problem and subsequently homogenizing the quantities of interest of that RVE (stresses and plastic energy) to save them in a database (19). Once the input space is sampled and the corresponding output database is created, an RNN is fitted to learn the plasticity-constitutive law by relating stresses and plastic energy to microstructure descriptors and loading conditions. RNNs describe plasticity as a map including the dependence on the sequence of deformation steps:
[1] |
where and describe the microstructure descriptors and the properties of the phases, respectively, is the history of spatially averaged strains applied to the RVEs from the first to the current () deformation increment, and is the spatially averaged stress at the current deformation increment. Note that could also represent “time” instead of “deformation” increments, i.e., it is a label for different snapshots. If we were interested in viscoplasticity, for example, then would represent “time steps” or “frequency steps.”
RNNs are an extension of neural networks designed to handle sequential data, i.e., they can learn events happening along different time sequences (or deformation sequences, in this case) that can be captured with a different number of snapshots. RNNs use history-dependent hidden states to compute the outputs . This enables them to carry information from previous inputs onto future predictions, where is the input feature at increment . This unique feature of RNNs combined with the flexibility of their model architecture has proven to be greatly beneficial on tasks such as machine translation, natural language processing, and voice recognition, among others (21). Early formulations of RNNs suffer from a phenomenon known as vanishing/exploding gradients, first noticed in ref. 22, which hinders the backpropagation-based training process of the networks for long sequences. Long Short-Term Memory (LSTM) (23) was proposed to avoid vanishing gradients by using multiple data-gate mechanisms that control the flow of storing or forgetting information in hidden states and outputs. Gated Recurrent Unit (GRU) (24) uses a similar concept as LSTM while using a simplified formulation. Although LSTMs and GRUs have shown to have close performance in many cases (25), GRU’s formulation is less prone to overfitting and allows faster training due to the smaller number of trainable parameters.
A major challenge in predicting plasticity-constitutive laws for material systems is that the model should effectively correlate history-dependent (“temporal”) loading inputs with nontemporal RVE design features (e.g., volume fraction, fiber radius, or elastic moduli). Three variations of RNN architecture are considered to address this challenge, as depicted in Fig. 2 A–C. SI Appendix contains a comparative analysis between the 3 RNN architectures considered, where we demonstrate why we recommend the one shown in Fig. 2C for learning plasticity-constitutive models. In this architecture, a GRU formulation with a secondary hidden state is proposed to carry nontemporal inputs through the GRU cells, allowing nonlinear correlations between temporal and nontemporal input features while providing each GRU cell direct access to temporal inputs, nontemporal inputs, and history-dependent hidden states (Fig. 2C). Using this variation of GRU-formulation nontemporal features are protected from corruption by , the reset gate. Although this approach adds additional weights and biases to the GRU, increasing model complexity and training time, it enables GRU cells to capture intricate interactions between input features throughout the entire temporal states. The altered formulation of a GRU unit (24) used in this work to combine temporal and nontemporal feature is as follows:
[2] |
[3] |
[4] |
[5] |
where is the sigmoid function. The reset gate () determines the combination of inputs (), previous hidden states (), and the secondary hidden state () to build a candidate hidden state (). The update gate () controls the influence of the candidate hidden state to the unit output (), which is also used as the new hidden state (). Stacking multiple RNN units enables the model to predict higher-level nonlinearities and interactions between features.
Based on the architecture shown in Fig. 2C, we consider 2 examples to illustrate the capabilities of sequence learning in finding plasticity-constitutive laws. The first example focuses on a single RVE where there is significant distortional hardening. The second example considers a class of RVEs with different microstructures undergoing plasticity, demonstrating that our approach systematically incorporates microstructural information in plasticity-constitutive laws.
Results
Case 1: RVE with Distortional Hardening.
An illustrative example is devised by considering a periodic microstructure of a material composed of distorted elliptical fillers as shown in Fig. 3A. Without loss of generality, consider the matrix material to be an aluminum alloy (AA6061) described by a von Mises isotropic-hardening model, and the rubber fillers described by an Arruda–Boyce hyperelastic constitutive model (26). The material properties of the models and details of FEA are included in SI Appendix, Table S3. The combination of a ductile matrix and a hyperelastic filler with nonsymmetric geometry results in a compound elastoplastic behavior where the matrix deforms plastically while the fillers can store a significant amount of elastic energy. Although the constituents are isotropic, the filler geometry induces significant anisotropic behavior and distorts the yield surface obtained for the macroscopic heterogeneous material as it undergoes different deformation paths. The macroscopic constitutive behavior of the heterogeneous material results from relating the applied average strain components , , and at deformation step to the average stresses , , and and plastic energy . Note that each stress state of the RVE depends on the deformation path.
Once the RVE in Fig. 3A is simulated via FEA under 15,000 different deformation paths, a database with the average stresses and plastic energy for each deformation path is generated (100 deformation states per deformation path). Using this dataset (created in 2 wk using 48 cores), we train an RNN with an architecture illustrated in Fig. 2C whose parameters are trained on 80% of the database. We assess the predictive power and data sufficiency by the unseen 20% portion of data. We use a scaled mean absolute error (SMAE) metric to evaluate the results of the model and a second metric for the plastic energy, called scaled mean plastic energy decrease (SMPED), to quantify a possible decrease in plastic energy (the second law of thermodynamics does not permit a decrease). The designed model consists of 3 stacked layers of 500 RNN units followed by a single time-distributed dense layer, which corresponds to around 3 million trainable parameters. Finally, a leaky rectified linear unit (27) activation function is used to impose nonlinearity into the RNN. We trained the model for 200 epochs, which resulted in an SMAE of 0.00281 and 0.00355 for the training and test sets, respectively, and an SMPED of 0.000181 and 0.000186.
Fig. 4 presents results for 2 different validation deformation paths: one deformation path of the test set that was not used in training (Fig. 4 A–C); and a linear unidirectional loading and unloading deformation path for validation purposes that is not present in either the test or training sets (Fig. 4 D–F). As observed in Fig. 4 B and C, the RNN is predictive along deformation paths of the test set (unseen data) for both quantities of interest. Fig. 3D shows an unseen linear unidirectional strain path that stretches the RVE in the direction to 0.1 engineering strain and then in the opposite direction to engineering strain, while and are kept at zero. Note that the training set does not include any linear strain path because it is constructed via Gaussian process regression of fluctuating paths, but Fig. 4 E and F demonstrates that our RNN model is still able to predict these average stress states and plastic energy. Fig. 4E also demonstrates that the RNN model predicts the Poisson effect (), even though we did not impose this constraint in the strain paths because a valid material constitutive law needs to predict stresses for any given combination of the 3 strain components. SI Appendix provides details on the RNN architecture analysis (SI Appendix, Figs. S3, S4, and S5) with the corresponding error metrics used to assess the predictions.
We further explore the predictive capabilities of our model by evaluating the yield-surface evolution as the RVE experiences different loading conditions. Fig. 5 shows the yield surface at the onset of plasticity in purple, and the yield surface obtained at the end of 3 deformation paths. We define plastic deformation to start when the plastic energy increases by the threshold of 1 mJ. Alternatively, the average equivalent plastic strain of the matrix could be used. We construct the yield surface by loading the RVE from its current stress state to 40 deformation paths in different directions (SI Appendix, Fig. S6). The principal stresses of the RVE are calculated when the RVE is plastically deformed above the mentioned threshold and the stress state is stored in order to reconstruct the yield surface (details in SI Appendix). Each of the 4 yield surfaces shown in Fig. 5 includes the result obtained directly from FEA in dotted lines, the prediction from RNN in solid lines, and the applied deformation before yield surface construction with respective colors. The yield surface at the onset of plasticity (purple) resembles the elliptical shape of the von Mises yield surface, which is in-line with the matrix behavior. However, as seen at the end of the 3 deformation paths, the yield surface is distorted, shrinks/expands, and rotates for different deformation histories. Remarkably, the RNN can track the complete yielding behavior accurately, including the anisotropic and distortional yield behavior. Therefore, using sequence learning for finding plasticity laws of general RVEs is demonstrated to be possible, laying the foundations for a modeling route for plasticity that learns the compound correlation of yield surface and hardening laws without any explicit guide or definition of classical plasticity terms, such as effective plastic strain and effective stress.
Case 2: Learning Plasticity for a Class of Composite RVEs.
A second case where a class of materials with periodic microstructure composed of different distributions of circular fibers is considered (Fig. 6), where each sample in the database varies in terms of their fiber volume (area) fraction , fiber radius , and distance between fibers . We consider an epoxy matrix with combined isotropic and kinematic hardening, and carbon fibers with elastic behavior. Details of material properties are provided in SI Appendix, Table S4. We considered deformation paths with maximum strain of in this case to explore the flexibility of the framework. These design choices give us a compound elastoplastic behavior for the RVE as the matrix deforms plastically while fibers can store a significant amount of elastic energy, whereas the behavior of the first case was mostly dominated by plastic deformation.
The inputs to the RNN model are the nontemporal microstructure descriptors, as well as the temporal deformation paths, and the outputs are temporal stresses and plastic energy over 100 increments for each RVE. Similar to the previous case, 2 validation tests are presented, and neither of which is used in the training process. A database with 8,000 samples is used in this case, 80% of which used for training. A model with architecture shown in Fig. 2C and similar configuration as the previous case is trained for 500 epochs resulting in 0.00132 and 0.00194 SMAE on the training set and test set correspondingly, while the model errors for the SMPED metric are 0.00179 and 0.00184, respectively. Fig. 7 A–C demonstrate the comparison of our model prediction with the ground truth FEA for a polynomial deformation path outside of the training samples. The results indicate that the model can accurately predict both stress and energy responses of the RVE. The results of linear unidirectional loading test (depicted in Fig. 7 D–F) show that the model is accurately predictive for stress and most regions of plastic energy. The small noise in the plastic-energy prediction is caused by the sharp change in deformation path. This was not observed when the deformation paths were sampled with GP regression due to its smoothness.
Discussion
Recent progress in high-performance computing and reduced-order modeling are enabling fast and accurate predictions of the behavior of heterogeneous materials. This creates an ever-increasing number of large databases of material behavior that are suitable for analysis with machine learning. Here, we show that deep learning, and in particular sequence learning, becomes essential when dealing with history-dependent properties and constitutive behavior. We show that finding plasticity-constitutive laws of general materials and material classes is possible with unprecedented accuracy and efficiency. Our results indicate that the trained model can comfortably reach under 0.5% SMAE error, while being fast to evaluate (a fraction of a second, as discussed in SI Appendix) because there is no need for iterative-solution schemes such as Newton–Raphson, typical in classical plasticity. However, we note that deep learning strongly depends on the quality and quantity of the training data. For example, training data may be insufficient if the RVEs are computationally expensive or the RVEs may not accurately predict the behavior of real materials due to inaccurate local constitutive laws (19) and different sources of uncertainty (28). In such cases, the value of this approach deteriorates. Also note that data could be experimental, instead of computational. In that case, high-throughput experiments or open datasets that collect data from different sources should be considered, in order to have enough data.
We strongly believe that this is just the beginning of an exciting field in computational plasticity, as well as other fields in applied physics and engineering. Here, we focused on opening avenues for multiscale simulations where the macroscopic constitutive behavior reflects location-dependent heterogeneity of the microstructure. Yet, the approach is general and applicable to different time-dependent and history-dependent data. Future developments in reduced-order models enabling high-fidelity and high-throughput computational predictions of material behavior, together with the growing field of deep learning, will certainly create unprecedented conditions for discovering new materials and designing new structures undergoing extreme performance well beyond elastic limits.
Materials and Methods
Design of (Computational) Experiments.
We build an RVE database using a variant of the descriptor-based approach (29) as it establishes physically interpretable links between microstructural descriptors and material properties. First, we identify key microstructural descriptors that characterize the RVE and conduct design of experiments (DOE) on them. Then, we reconstruct the RVEs corresponding to the DOE points. Finally, we postprocess the generated RVEs to extract more microstructural descriptors that are not used in stage one. Since the material system in the second example is a fibrous composite where the fibers of an RVE are equally sized and randomly dispersed within the matrix, we choose the following 3 descriptors to characterize the morphology: fiber volume (or area) fraction (), fiber radius (), and minimum-allowable center-to-center distance between any 2 fibers (). The first 2 descriptors are known to affect the material properties in fiber composites (19). The third descriptor is used to set a minimum distance between any 2 fibers to avoid overlaps, facilitate FEA, and partially control the spatial distribution of fibers within the matrix. Given the 3D input space of , we generate a DOE of size where the range of each parameter is selected sufficiently large (SI Appendix, Table S1). For details about the reconstruction of a wide range of RVEs (case 2), see SI Appendix.
Computational Analyses.
We simulate the behavior of the constructed RVEs under complex loading conditions using high-fidelity FEA. A MATLAB code developed by Bessa et al. (19) creates the scripts that interact with the finite element software ABAQUS to preprocess, execute, and postprocess all of the RVE simulations automatically using an implicit static solver. The analysis begins with generating the material and boundary condition files. The MATLAB script parses the geometry descriptors for each RVE in the database and generates python scripts, which create the geometry, mesh it with a predetermined mesh size (m), and assign materials. The periodic boundary value problem follows by converting the applied average-strain components , , and to displacement boundary conditions on edges of the RVEs. Next, the MATLAB script generates simulation files and executes ABAQUS to create the output simulations. Then, a final script executes the homogenization of the quantities of interest assuming separation of length scales (19), obtaining the average RVE stresses , , and as well as plastic energy . Note that the entire procedure is automatic and without human intervention.
RNNs.
The proposed neural networks model based on the architecture demonstrated in Fig. 2C is developed using the Keras library (30). The model includes RNN cells to detect history-dependent features and combines with one or more time-distributed dense layers (30) to transform high-dimensional outputs of RNN cells into the desired 4 outputs (3 engineering stresses and plastic energy) of the RVEs over deformation increments. A cost function of the mean absolute error between the output values in the developed database and the predictions are defined and the training process is performed using Adam optimization method (31). The inputs (i.e., microstructure descriptors and deformation paths) and outputs (i.e., stresses and energies) of the database are normalized to a range between 0 and 1 to expedite the training process by reducing narrow valleys in trainable parameter space.
We use the SMAE metric to evaluate the results of the model, which is a fair error measure with the same dimensions as the original outputs. Although the plastic energy should not decrease over time according to the second law of thermodynamics, small decreases in the plastic energy can be seen even in the FEA results. To quantify if the plastic energy is predicted with an acceptable range of error, we define a second metric as the accumulated plastic-energy deviation averaged over test-set samples, which is named as SMPED. The developed model is trained on 80% of the database, while the rest is used as test set for validation. The train set SMAE decreases consistently as we increase the number of RNN layers, RNN units, or time-distributed layers due to the computational complexity of the models. However, using excessively complex configurations or adding extra time-distributed layers can adversely affect the accuracy of the model due to overfitting. SI Appendix contains further details.
Supplementary Material
Acknowledgments
We acknowledge support by US National Science Foundation Grant CPS/CMMI-1646592, Air Force Office of Scientific Research Grant FA9550-18-1-0381, Department of Commerce National Institute of Standards and Technology as part of the Center for Hierarchical Materials Design Grant 70NANB19H005, and Department of Defense Vannevar Bush Faculty Fellowship N00014-19-1-2642.
Footnotes
The authors declare no competing interest.
This article is a PNAS Direct Submission.
Data deposition: The data reported in this paper have been deposited in GitHub, https://github.com/mabessa/F3DAM.
This article contains supporting information online at https://www.pnas.org/lookup/suppl/doi:10.1073/pnas.1911815116/-/DCSupplemental.
References
- 1.Corominas-Murtra B., Hanel R., Thurner S., Understanding scaling through history-dependent processes with collapsing sample space. Proc. Natl. Acad. Sci. U.S.A. 112, 5348–5353 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Mises R. V., Mechanik der festen Körper im plastisch-deformablen Zustand [in German]. Nachr. Ges. Wiss. Göttingen, Math.-Phys. Klasse 1913, 582–592 (1913). [Google Scholar]
- 3.Armstrong P. J., Frederick C. O., A Mathematical Representation of the Multiaxial Bauschinger Effect (Tech. Rep. RD/B/N731, Central Electricity Generating Board [and] Berkeley Nuclear Laboratories, Research & Development Department, 1966), vol. 731. [Google Scholar]
- 4.Leem D., et al. , Improving the accuracy of double-sided incremental forming simulations by considering kinematic hardening and machine compliance. Procedia Manuf. 29, 88–95 (2019). [Google Scholar]
- 5.Chaboche J. L., On some modifications of kinematic hardening to improve the description of ratchetting effects. Int. J. Plast. 7, 661–678 (1991). [Google Scholar]
- 6.Ohno N., Wang J.-D., Kinematic hardening rules with critical state of dynamic recovery, part i: Formulation and basic features for ratchetting behavior. Int. J. Plast. 9, 375–390 (1993). [Google Scholar]
- 7.Hill R., Constitutive modelling of orthotropic plasticity in sheet metals. J. Mech. Phys. Solids 38, 405–417 (1990). [Google Scholar]
- 8.Barlat F., Lege D. J., Brem J. C., A six-component yield function for anisotropic materials. Int. J. Plast. 7, 693–712 (1991). [Google Scholar]
- 9.Chaboche J. L., Constitutive equations for cyclic plasticity and cyclic viscoplasticity. Int. J. Plast. 5, 247–302 (1989). [Google Scholar]
- 10.Geng L., Wagoner R. H., Role of plastic anisotropy and its evolution on springback. Int. J. Mech. Sci. 44, 123–148 (2002). [Google Scholar]
- 11.Lee M.-G., et al. A practical two-surface plasticity model and its application to spring-back prediction. Int. J. Plast. 23, 1189–1212 (2007). [Google Scholar]
- 12.François M., A plasticity model with yield surface distortion for non proportional loading. Int. J. Plast. 17, 703–717 (2001). [Google Scholar]
- 13.Feigenbaum H. P., Dafalias Y. F., Directional distortional hardening in metal plasticity within thermodynamics. Int. J. Solids Struct. 44, 7526–7542 (2007). [Google Scholar]
- 14.Barlat F., Gracio J. J., Lee M.-G., Rauch E. F., Vincze G., An alternative to kinematic hardening in classical plasticity. Int. J. Plast. 27, 1309–1327 (2011). [Google Scholar]
- 15.Curtarolo S., et al. , The high-throughput highway to computational materials design. Nat. Mater. 12, 191–201 (2013). [DOI] [PubMed] [Google Scholar]
- 16.Shi Z., et al. , Deep elastic strain engineering of bandgap through machine learning. Proc. Natl. Acad. Sci. U.S.A. 116, 4117–4122 (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Kozuch D. J., Stillinger F. H., Debenedetti P. G., Combined molecular dynamics and neural network method for predicting protein antifreeze activity. Proc. Natl. Acad. Sci. U.S.A. 115, 13252–13257 (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Yvonnet J., Gonzalez D., He Q.-C., Numerically explicit potentials for the homogenization of nonlinear elastic heterogeneous materials. Comput. Methods Appl. Mech. Eng. 198, 2723–2737 (2009). [Google Scholar]
- 19.Bessa M. A., et al. , A framework for data-driven analysis of materials under uncertainty: Countering the curse of dimensionality. Comput. Methods Appl. Mech. Eng. 320, 633–667 (2017). [Google Scholar]
- 20.Acar P., Sundararaghavan V., A Markov random field approach for modeling spatio-temporal evolution of microstructures. Model. Simul. Mater. Sci. Eng. 24, 075005 (2016). [Google Scholar]
- 21.Young T., Hazarika D., Poria S., Cambria E., Recent trends in deep learning based natural language processing [review article]. IEEE Comput. Intell. Mag. 13, 55–75 (2018). [Google Scholar]
- 22.Hochreiter S., “Untersuchungen zu dynamischen neuronalen Netzen [in German],” Master’s thesis, Institut für Informatik, Technische Universität München, Munich, Germany (1991). [Google Scholar]
- 23.Hochreiter S., Schmidhuber J., Long short-term memory. Neural Comput. 9, 1735–1780 (1997). [DOI] [PubMed] [Google Scholar]
- 24.Cho K., et al. , “Learning phrase representations using RNN encoder-decoder for statistical machine translation” in EMNLP 2014: Conference on Empirical Methods in Natural Language Processing (Association for Computational Linguistics, 2014). [Google Scholar]
- 25.Chung J., Gulcehre C., Cho K., Bengio Y., “Empirical evaluation of gated recurrent neural networks on sequence modeling” in NIPS 2014 Workshop on Deep Learning, December 2014 (Neural Information Processing Systems, 2014). [Google Scholar]
- 26.Arruda E. M., Boyce M. C., A three-dimensional constitutive model for the large stretch behavior of rubber elastic materials. J. Mech. Phys. Solids 41, 389–412 (1993). [Google Scholar]
- 27.Xu B., Wang N., Chen T., Li M., Empirical evaluation of rectified activations in convolutional network. arXiv:1505.00853 (27 November 2015).
- 28.Bessa M. A., Pellegrino S., Design of ultra-thin shell structures in the stochastic post-buckling range using bayesian machine learning and optimization. Int. J. Solids Struct. 139-140, 174–188 (2018). [Google Scholar]
- 29.Xu H., Li Y., Brinson C., Chen W., A descriptor-based design methodology for developing heterogeneous microstructural materials system. J. Mech. Des. 136, 051007 (2014). [Google Scholar]
- 30.Chollet F., et al. Keras Version: 2.2.4 (2015). https://keras.io. Accessed 5 December 2019.
- 31.Kingma D. P., Ba J., “Adam: A method for stochastic optimization” in 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, May 7–9, 2015, Conference Track Proceedings, arXiv:1412.6980 (30 January 2017).
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.