Abstract
The contradiction between the importance of materials to modern society and their slow development process has led to the development of multiple methods to accelerate materials discovery. The recently emerged concept of intelligent laboratories integrates the developments in fields of high-throughput experimentation, automation, theoretical computing, and artificial intelligence to form a system that can autonomously carry out designed experiments and make scientific discoveries. We present the basic concepts and the foundations of this new research paradigm, demonstrate its typical application scenarios through case studies, and envision a collaborative human-machine meta laboratory in the future.
Graphical Abstract
Keywords: Machine learning, Artificial intelligence, Intelligent laboratory, Autonomous, Materials discovery
Introduction
From clean energy to human welfare and even national security, advanced materials are critical to the development of society. However, the fact is that the materials development process is very long. A new material needs to go through many steps from discovery to deployment, often taking decades.1 For example, Li-ion batteries have been studied on a large scale since the early 1960s and were not commercialized until the 1990s.2 On the other hand, the complexity of the materials is increasing with the continuous exploration of improved materials.3 The combination of just a few parameters can lead to a huge search space, which is impossible to be fully explored by traditional manual experiments.
A variety of technologies have been applied to accelerate materials development, which encompasses the four paradigms of scientific research (Figure 1). High-throughput experimental techniques have led to continuous improvements in the scale and efficiency of experiments. Theoretical calculation methods with databases storing the calculation results allow screening to be performed rapidly on computers.4 Data science-related technologies, especially machine learning, have led to data-driven discoveries in materials science.5 In this context, the concept of a self-driving laboratory or autonomous experimentation system has been proposed. It is an integration of the advances previously mentioned, and has already shown strong potential in fields such as drug discovery,6–8 solar-energy materials,9–11 organic synthesis,7,12 etc.
Here, we reinterpret these efforts into a more general concept of “intelligent laboratories.” In using this term, we are not focusing on a specific experimental method or facility, but on a system that combines all aspects of materials research to provide a systematic solution to the materials development process (Figure 1). True intelligence should be born out of the collaboration of humans and robots. A future intelligent laboratory involves not only the replacement of human hands with robotic arms, but, more importantly, the enhancement of the human brain with efficient algorithms and computing power. The experiments are designed and executed in a closed-loop, autonomous manner, with the human effort focusing on initializing the system and analyzing the final results. This separation of labor allows researchers to devote more effort to the aspects that really require innovation and insight.
There are a variety of apparent benefits of an intelligent laboratory. It allows for uninterrupted, high-throughput parallel experiments that are far more efficient than those performed by humans. It also minimizes operational faults and errors, which can generate standardized, high-quality data. Considering a robot can use different vision and motion systems than a human, it is also more flexible for handling particular substances such as photosensitive materials and hazardous chemicals.11 In addition, researchers can be physically separated from the experimental equipment and conduct experiments in a remote, shared manner, making “cloud chemistry”13 or even “meta laboratories” possible, which is particularly relevant in the post-pandemic era.
This article aims to present the concept of future intelligent laboratories and to explain what an intelligent laboratory is and why it is important. We will demonstrate the current application scenarios, advantages, and limitations of intelligent laboratories with several case studies, with an outlook on how they can further advance materials design and manufacturing.
Fundamentals of an intelligent laboratory
In 2009, a robot scientist named Adam was proposed to discover functional genes in Saccharomyces cerevisiae.14 It uses automated hardware combined with a software system to iteratively formulate hypotheses, design experiments, and interpret results without human intervention. A mobile robotic chemist developed in 2020 takes a more advanced approach, using Bayesian optimization to guide a dexterous roaming robot through the laboratory to autonomously find improved photocatalysts for hydrogen production from water.11 Both cases follow the workflow described in Figure 2. First, the researcher searches for the area of interest and builds the required hardware and software environment. Then, for the task to be studied, the researcher defines the parameters and objectives to be optimized and selects a proper optimization framework. The system is also provided with initial data or other a priori knowledge. After these initializations, the entire system begins to operate automatically. A model is used to infer the results of each test, and a planning algorithm incorporates the model to determine how the next experiment should be performed and then drives the automated device to perform the test. The results obtained are passed back to the computer to update the model and determine the next experiment. After hours or days, the iterations are completed, and all the experimental data are aggregated into a conclusion. In another case, the initialization step can also be done by an AI model automatically reading and generalizing the existing human knowledge.15
The emergence of this research paradigm was not happening overnight, but was gradually transformed. Specifically, an intelligent laboratory often integrates the following components that will be discussed next:
Automated, modular hardware facilities. It may be a set of modified commercial instruments, an in situ characterization system, and/or a robotic arm;
A computational core (brain) of the intelligent laboratory for analyzing experimental results and planning the next experiments;
A software system to serve as an interface between the researcher, the computational tools, and the hardware facilities; and
Other strategies to assist experiments, such as introducing the results of theoretical calculations to make predictions physics-informed.
High-throughput experiment with experiment planning
Advanced experimental methods are the cornerstone of research, and intelligent laboratories are dedicated to how to do experiments smarter. Early research for materials design was often Edison-like. Researchers relied on personal experience and intuition to discover new materials by trial and error, which was often a time-consuming and unpredictable process. Starting in the 1990s, the combinatorial method emerged in the field of materials science,16 drawing on the idea of large-scale synthesis and characterization in biological research.17 The combined experiments mean to increase the speed of materials synthesis and testing through miniaturized and parallel synthesis methods and high-throughput characterization methods. A library containing a large number of materials with their properties is created, based on which one could select the best material or explore the relationship between structure and properties. This advancement has substantially increased the speed of discovery and deployment of new materials. However, if we rely only on blind and random testing with a large number of experiments, much of the experimental information obtained will be redundant and is still insignificant in the face of the vast possibility space. To improve the value of each test, some planning strategy should be used to explicitly choose the next experiment to be performed.
Statistical design of experiment (DOE) is an early method applied to experimental planning, which analyzes the interrelationships between multiple independent variables and their effects on the dependent variable by systematic sampling and testing. It is a powerful method when the number of independent variables is small and the relationships between them are relatively simple.18 Subsequently, early artificial intelligence (AI) methods and advanced optimization algorithms began to be applied to materials science for more complex problems. For example, the global single-objective optimization algorithm SNOBFIT19 can perform optimization without a theoretical model and has been used in the optimization of chemical reactions.12 Some multi-objective optimization methods, such as TSEMO20 and MOAL,21 have also been developed for the tradeoff between conflicting objectives. With the development of artificial intelligence, active learning22,23 and reinforcement learning24 techniques have started to be used in materials research. Bayesian optimization is a popular black-box optimization method in recent times, which uses a surrogate function to approximate an unknown experimental response surface and an acquisition function to select the parameter for the next measurement. The selection of parameters takes into account the most promising regions and the regions with high uncertainty (i.e., the optimal solution is found while gradually improving the accuracy of the surrogate function). Several studies23,25,26 have demonstrated the effectiveness of these advanced planning methods. By using them, the number of experiments and time consumed were reduced significantly (by several to tens of times) compared to the traditional grid-based approach or random search.
Theoretical calculation
The theoretical calculation can be considered as a further expansion of experimental throughput, and was highlighted in some national-level materials acceleration initiatives such as the Materials Genome Initiative (MGI).1 With high-throughput calculations,27 researchers can explore a larger range of chemical spaces without conducting experiments and perform virtual screening directly on the computer.28 Unlike the predictions given by data-driven machine learning models, the results of theoretical calculations are derived directly from fundamental physical principles and are considered to be more reliable and physically explainable, but also take longer to compute. Therefore, large computational materials databases29–31 have been created to store the results of theoretical calculations and reduce repetitive calculations. Machine learning methods are used by introducing surrogate models trained on the fly to speed up the search process carried out by theoretical calculations.32–34 In our previous work, theoretical calculations can also be added directly to the active learning loops to enable self-improving materials discovery.35
Also, the theoretical calculation can be combined with other techniques to develop new research methods, such as using the results of theoretical calculations as pretraining data for machine learning prediction models,29 or combing it with high-throughput screening to take advantage of both of their advantages.36
AI for intelligent laboratories
Artificial intelligence techniques can assist materials science in many ways, including property prediction, molecular design, theoretical calculations acceleration, and more, which have been fully discussed in previous reviews.5,37,38 In addition, some advanced AI techniques can also be applied to materials discovery. Active learning and data augmentation can be used to cope with data scarcity and imbalance, and transfer learning enables fast and resource-saving learning on similar tasks, as we demonstrated respectively in the design of strain sensors and metal–organic framework-based membranes.39,40 The biggest contribution of AI for intelligent laboratories lies in AI planning, which exists as the “computational brain” of the system to guide the next experiment (as described in the section “High-throughput experiment with experiment planning”).
Considering that the deep learning (DL) method, another important part of AI, often involves building and training data-intensive models that do not seem to match the goal of “more efficient experimentation,” it is difficult to directly apply it in intelligent laboratories.41 But it can still play a role in various aspects. For example, we used machine vision to analyze scanning probe microscopy images, which can improve the speed and accuracy of chiral molecule detection and classification, allowing more characterization tools to be added to automated closed-loop experiments.42 Another example is machine reading for information sorting from literature. It allows integration of existing knowledge and suggests more promising hypotheses for experiments.15,43
Automated experimental hardware
Automation technology is the bridge between physical instruments and the computational core, and it determines the scope of tasks to which we can apply the closed-loop autonomous research paradigm. It can be stressed that automation and digitization make a lot of sense: standardized operation and comprehensive data recording. Materials are complex and small changes in synthesis conditions or some factors that may be overlooked during manual experimentation (e.g., laboratory temperature and humidity, sample purity) may have a large impact on the experiment. On the other hand, although only the most successful experimental results are reported in publications, failed experiments often contain chemical intuition, and the collection and use of this information can also aid in materials discovery.44,45 Therefore, the future laboratory needs to digitally record and integrate all information from experiments.
Although the robot operating system (ROS)46 has reached a mature level in the early years and automated platforms have been broadly applied in areas such as drug discovery, its full application to other fields is still limited by diverse methodology and costs. Sokol et al.46 evaluated the difficulty of automating commonly used materials synthesis and characterization techniques for solar fuel production. More easily parallelized materials synthesis processes and more in-line characterization instruments still deserve to be developed.47 On the other hand, software packages such as ChemOs,48 ESCALATE,49 etc., have been developed to facilitate the deployment and operation of an intelligent laboratory for a wider range of people.
Application scenarios of an intelligent laboratory
Exploration of materials formulations and synthesis conditions
A classical application scenario for intelligent laboratories can be concluded as achieving the best property by optimizing the formulations or synthesis conditions of materials, whether they are carbon nanotubes,50 gold nanoparticles,51,52 quantum dots,53 thin-film materials,9 or metastable materials.22 The synthesis-characterization cycle of materials is often fixed and can be done on a single robotic platform or even a single instrument. The difficulty lies in the large number of processing parameters available with insufficient knowledge about their relationships, which can be explored more efficiently using an automated experimentation platform driven by AI.
In 2016, Nikolaev et al.50 reported the first Autonomous Research System (ARES) for controlling the growth rate of carbon nanotubes (CNTs). CNTs were synthesized using a chemical vapor deposition process on small pillars of silicon and were characterized by in situ Raman spectroscopy for the growth rate. Synthesis conditions, including temperature, pressure, and gas composition, were optimized by the suggestion from a random forest model. It was observed that the predicted and experiment growth rate got closer as the number of completed experiments increased, and a target growth rate was achieved after 600 experiments without human intervention.
A platform such as this not only allows for faster completion of specific experimental tasks, but its independence from a priori knowledge also allows for full exploration of previously unexplored design space, which may lead to more generalized results. For example, in the design of battery electrolytes, it has been shown that mixing salts may have a positive impact on performance, but the huge design space brings difficulty to the experiment, and there is still no guarantee of fidelity of calculations from first principles. Dave et al.54 then applied the research framework of autonomous experiments, using pumping devices and electrochemical tools to form a simple and inexpensive platform for testing electrochemical performance. After 140 experiments with three- and four-salt aqueous electrolytes, an electrolyte that was contrary to the usual design principles was obtained. In another example, because crystal structure characterization using x-ray diffraction (XRD) is very expensive, Ament et al.22 used AI agents and an active learning strategy to establish a synthesis phase diagram of a Bi-O system with as few experiments as possible, thus discovering the conditions for stabilizing δ-Bi2O3 at room temperature.
Intelligent laboratories for organic synthesis
The research paradigm of intelligent laboratories can also be applied to organic synthesis. For each reaction, a large number of repetitive experiments are required to find the optimal reaction conditions in order to obtain the maximum yield and minimize the byproducts. Angello et al.55 devised a closed-loop optimization process for general reaction conditions of the heteroaryl Suzuki-Miyaura coupling reaction. Substrates were first selected by data mining techniques, and then a combination of uncertainty-minimizing ML and robotic experimentation was used to perform iterative tests to optimize the reaction conditions. Reaction conditions that doubled the average yield of the currently widely used conditions were found, and the generality also showed statistically significant increases compared to the previously reported conditions. This workflow improves the efficiency of reaction optimization, whereas organic synthesis processes often involve different types of reactions, and the optimization of different reactions requires reconfigurability of the system. A plug-and-play, continuous-flow chemical synthesis system was developed by Bédard et al.12 This system is highly integrated, allowing the selection and configuration of different modular unit operations and analytical methods as needed in a simple way. Optimization of reaction conditions was performed automatically and a user-friendly interface was provided to reach high usability. The system's capabilities have been demonstrated in several widely used single- and two-step reactions.
Another important task is the synthesis of organic compounds on demand. Coley et al.7 first integrated advances in the computer-aided synthesis planning (CASP) and automated synthesis platforms to construct an automatic flow synthesis platform. Information from millions of published synthetic routes was extracted by data mining and machine learning methods to generate recommended synthetic routes. A self-configurable system using a robotic arm for on-demand assembly of unit operations and reagent lines is used to perform the experiments. Fifteen small molecules that vary greatly in structure and synthetic complexity were synthesized automatically. It should be noted that the training of models in this system is still a one-time process that relies on historical data, whereas some specific reaction conditions need to be defined manually due to the lack of data. These limitations can hopefully be solved by the introduction of the previously mentioned closed-loop optimization process, which will enable a step further toward the automation of all aspects of organic synthesis.
Fully autonomous laboratory for catalyst design
Although building an autonomous experimentation platform for a specific task is not that challenging, the range of applications is limited. Several efforts aim to build a fully autonomous laboratory that can perform multiple research tasks. Building such a platform is certainly time-consuming, but once such a laboratory is fully operational, the benefits can still be significant.
Burger et al.11 presented a landmark work named mobile robotic chemist. A mobile robotic platform with a robotic arm was used to mimic human behavior. With the help of laser scanning combined with touch feedback for fine positioning, the platform can move freely in the laboratory like a human, grasp and transfer sample vials, and operate commercial instruments with no physical hardware modifications. The complete experimental process was performed by eight workstations. By using a batch Bayesian algorithm to optimize the catalyst formulations, a photocatalyst mixture with six times higher activity than the initial formulations was identified after 688 experiments.
In 2022, Zhu et al.15 developed AI-Chemist, an AI chemistry laboratory that implements the whole process of scientific research autonomously. For an exploration task, a large number of papers were first read and summarized by AI, and scientific hypotheses were generated. A computational module for performing theoretical calculations was used to provide physics-based data for the prediction model. A Bayesian algorithm was used to guide the search space. Experiments were carried out by a mobile robot that shuttled between 14 modified workstations, including synthesis, characterization, and performance tests. The effectiveness of the platform was demonstrated in the design of a non-noble metal oxygen evolution reaction electrocatalyst. AI-Chemist explored in a search space with 553,401 options and found a composition ratio that was far from the best samples of trial-and-error experiments but performed better.
Future directions of intelligent laboratories
Scientific research is always about the data obtained from the experiments, not the physical samples themselves. Thus researchers can be physically separated from their experimental instruments and samples. The COVID-19 pandemic has impacted scientific research globally, and the need to digitalize laboratory operations in an era of social distance has become more urgent. The concept of intelligent laboratories offers the prospect that we can redefine scientific research using digital technologies such as cloud computing, the Internet of Things, and blockchain, building “meta laboratories” that fully map physical laboratories. Future experimental research can be conducted in large, well-resourced “virtual institutes” accessible to anyone without leaving home. The sharing of experiment resources and data will expand the use of experimental instruments and chemicals, making science more democratized, as in the astronomy and high-energy physics communities.41
As a preliminary stage, some commercial cloud laboratories have been built, such as Strateos (https://strateos.com/), dedicated to drug discovery and synthetic biology, and Emerald Cloud Lab (https://www.emeraldcloudlab.com/), which can perform various in vitro biology or chemistry experiments. Researchers can control multiple devices through a software interface or web browser without purchasing their own instruments. It makes biological and chemical experiments more like computational experiments, with each step of the experimental operation being translated into explicit and detailed code and carried out in an invariable environment, which provides for reproducibility. Unlike contract research organizations (CROs), which provide research outsourcing in the biomedical field, how experiments are performed in this research mode is still user-defined. Although the founder of the Emerald Cloud Lab admits that access to its equipment is not cheap, he believes that it can be a money-saving option compared to the cost of purchasing the equipment.56 However, a research model in which robots are merely used to replace some operation processes is not the ultimate goal. Humans are good at causal analysis and reasoning, whereas robots are good at cognition and execution. In a future laboratory, humans and robots should collaborate to get the most out of each other.57 Such a promising research paradigm would be applied more often in future materials development to provide solutions to current thorny problems.
Acknowledgments
This work has been supported by the Scientific and Technological Innovation 2030 - “New Generation Artificial Intelligence” Major Project (2022AAA010062) by the Ministry of Science and Technology in China.
Biographies
Xiting Peng
is a doctoral candidate in the Department of Chemical Engineering at Tsinghua University, China. She received her bachelor’s degree in bioengineering from Tianjin University, China, in 2022. Her research focuses on artificial intelligence methods for materials laboratories. Peng can be reached by email at pxt22@mails.tsinghua.edu.cn.
Xiaonan Wang
is an associate professor in the Department of Chemical Engineering at Tsinghua University, China. She received her BEng degree from Tsinghua University in 2011, and PhD degree from the University of California, Davis, in 2015. After working as a postdoctoral research associate at Imperial College London, Wang joined the National University of Singapore (NUS) as an assistant professor in 2017, and later became an adjunct associate professor. She is leading a Smart Systems Engineering research group at NUS and Tsinghua and is also the deputy director of the Accelerated Materials Development Programme. Her awards include the 2023 ACS Sustainable Chemistry & Engineering Lectureship Award, World’s Top 2% Scientists and the American Institute of Chemical Engineers-Singapore Local Section (AIChE-SLS) Outstanding Young Principal Investigator. Wang can be reached by email at wangxiaonan@tsinghua.edu.cn.
Data availability
Not applicable.
Code availability
Not applicable.
Conflict of interest
On behalf of all authors, the corresponding author states that there is no conflict of interest.
Footnotes
This article was updated to correct errors introduced to the author list after the authors had reviewed the proofs. Springer Nature apologizes for the errors.
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Change history
3/13/2023
A Correction to this paper has been published: 10.1557/s43577-023-00506-7
Contributor Information
Xiting Peng, Email: pxt22@mails.tsinghua.edu.cn.
Xiaonan Wang, Email: wangxiaonan@tsinghua.edu.cn.
References
- 1.Jain A, Ong SP, Hautier G, Chen W, Richards WD, Dacek S, Cholia S, Gunter D, Skinner D, Ceder G, Persson KA. APL Mater. 2013;1(1):011002. doi: 10.1063/1.4812323. [DOI] [Google Scholar]
- 2.Winter M, Barnett B, Xu K. Chem. Rev. 2018;118(23):11433. doi: 10.1021/acs.chemrev.8b00422. [DOI] [PubMed] [Google Scholar]
- 3.Rao Z, Tung P-Y, Xie R, Wei Y, Zhang H, Ferrari A, Klaver TPC, Körmann F, Sukumar PT, Kwiatkowski da Silva A, Chen Y, Li Z, Ponge D, Neugebauer J, Gutfleisch O, Bauer S, Raabe D. Science. 2022;376(6615):78. doi: 10.1126/science.abo4940. [DOI] [PubMed] [Google Scholar]
- 4.Curtarolo S, Setyawan W, Hart GLW, Jahnatek M, Chepulskii RV, Taylor RH, Wang S, Xue J, Yang K, Levy O, Mehl MJ, Stokes HT, Demchenko DO, Morgan D. Comput. Mater. Sci. 2012;58:218. doi: 10.1016/j.commatsci.2012.02.005. [DOI] [Google Scholar]
- 5.Butler KT, Davies DW, Cartwright H, Isayev O, Walsh A. Nature. 2018;559:547. doi: 10.1038/s41586-018-0337-2. [DOI] [PubMed] [Google Scholar]
- 6.Schneider G. Nat. Rev. Drug Discov. 2018;17:97. doi: 10.1038/nrd.2017.232. [DOI] [PubMed] [Google Scholar]
- 7.Coley CW, Thomas DA, III, Lummiss JAM, Jaworski JN, Breen CP, Schultz V, Hart T, Fishman JS, Rogers L, Gao H, Hicklin RW, Plehiers PP, Byington J, Piotti JS, Green WH, Hart AJ, Jamison TF, Jensen KF. Science. 2019;365(6453):eaax1566. doi: 10.1126/science.aax1566. [DOI] [PubMed] [Google Scholar]
- 8.Desai B, Dixon K, Farrant E, Feng Q, Gibson KR, van Hoorn WP, Mills J, Morgan T, Parry DM, Ramjee MK, Selway CN, Tarver GJ, Whitlock G, Wright AG. J. Med. Chem. 2013;56(7):3033. doi: 10.1021/jm400099d. [DOI] [PubMed] [Google Scholar]
- 9.MacLeod BP, Parlane FGL, Morrissey TD, Häse F, Roch LM, Dettelbach KE, Moreira R, Yunker LPE, Rooney MB, Deeth JR, Lai V, Ng GJ, Situ H, Zhang RH, Elliott MS, Haley TH, Dvorak DJ, Aspuru-Guzik A, Hein JE, Berlinguette CP. Sci. Adv. 2020;6(20):aaz8867. doi: 10.1126/sciadv.aaz8867. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.MacLeod BP, Parlane FGL, Rupnow CC, Dettelbach KE, Elliott MS, Morrissey TD, Haley TH, Proskurin O, Rooney MB, Taherimakhsousi N, Dvorak DJ, Chiu HN, Waizenegger CEB, Ocean K, Mokhtari M, Berlinguette CP. Nat. Commun. 2022;13:995. doi: 10.1038/s41467-022-28580-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Burger B, Maffettone PM, Gusev VV, Aitchison CM, Bai Y, Wang X, Li X, Alston BM, Li B, Clowes R, Rankin N, Harris B, Sprick RS, Cooper AI. Nature. 2020;583:237. doi: 10.1038/s41586-020-2442-2. [DOI] [PubMed] [Google Scholar]
- 12.Bédard A-C, Adamo A, Aroh KC, Russell MG, Bedermann AA, Torosian J, Yue B, Jensen KF, Jamison TF. Science. 2018;361(6408):1220. doi: 10.1126/science.aat0650. [DOI] [PubMed] [Google Scholar]
- 13.Skilton RA, Bourne RA, Amara Z, Horvath R, Jin J, Scully MJ, Streng E, Tang SLY, Summers PA, Wang J, Pérez E, Asfaw N, Aydos GLP, Dupont J, Comak G, George MW, Poliakoff M. Nat. Chem. 2015;7:1. doi: 10.1038/nchem.2143. [DOI] [PubMed] [Google Scholar]
- 14.King RD, Rowland J, Oliver SG, Young M, Aubrey W, Byrne E, Liakata M, Markham M, Pir P, Soldatova LN, Sparkes A, Whelan KE, Clare A. Science. 2009;324(5923):85. doi: 10.1126/science.1165620. [DOI] [PubMed] [Google Scholar]
- 15.Zhu Q, Zhang F, Huang Y, Xiao H, Zhao L, Zhang X, Song T, Tang X, Li X, He G, Chong B, Zhou J, Zhang Y, Zhang B, Cao J, Luo M, Wang S, Ye G, Zhang W, Chen X, Cong S, Zhou D, Li H, Li J, Zou G, Shang W, Jiang J, Luo Y. Natl. Sci. Rev. 2022;9(10):nwac190. doi: 10.1093/nsr/nwac190. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Xiang X-D, Sun X, Briceño G, Lou Y, Wang K-A, Chang H, Wallace-Freedman WG, Chen S-W, Schultz PG. Science. 1995;268(5218):1738. doi: 10.1126/science.268.5218.1738. [DOI] [PubMed] [Google Scholar]
- 17.Pollack SJ, Jacobs JW, Schultz PG. Science. 1986;234(4783):1570. doi: 10.1126/science.3787262. [DOI] [PubMed] [Google Scholar]
- 18.Harmon L. J. Mater. Sci. 2003;38:4479. doi: 10.1023/a:1027325400459. [DOI] [Google Scholar]
- 19.Huyer W, Neumaier A. ACM Trans. Math. Softw. 2008;35(2):9. doi: 10.1145/1377612.1377613. [DOI] [Google Scholar]
- 20.Bradford E, Schweidtmann AM, Lapkin A. J. Glob. Optim. 2018;71:407. doi: 10.1007/s10898-018-0609-2. [DOI] [Google Scholar]
- 21.Peremezhney N, Hines E, Lapkin A, Connaughton C. Eng. Optim. 2014;46(11):1593. doi: 10.1080/0305215X.2014.881997. [DOI] [Google Scholar]
- 22.Ament S, Amsler M, Sutherland DR, Chang M-C, Guevarra D, Connolly AB, Gregoire JM, Thompson MO, Gomes CP, van Dover RB. Sci. Adv. 2021;7(51):abg4930. doi: 10.1126/sciadv.abg4930. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Kusne AG, Yu H, Wu C, Zhang H, Hattrick-Simpers J, DeCost B, Sarker S, Oses C, Toher C, Curtarolo S, Davydov AV, Agarwal R, Bendersky LA, Li M, Mehta A, Takeuchi I. Nat. Commun. 2020;11:5966. doi: 10.1038/s41467-020-19597-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Li J, Li J, Liu R, Tu Y, Li Y, Cheng J, He T, Zhu X. Nat. Commun. 2020 doi: 10.1038/s41467-020-15728-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Dave A, Mitchell J, Burke S, Lin H, Whitacre J, Viswanathan V. Nat. Commun. 2022;13(10):5454. doi: 10.1038/s41467-022-32938-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Gongora AE, Xu B, Perry W, Okoye C, Riley P, Reyes KG, Morgan EF, Brown KA. Sci. Adv. 2020;6(15):aaz1708. doi: 10.1126/sciadv.aaz1708. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Curtarolo S, Hart GLW, Nardelli MB, Mingo N, Sanvito S, Levy O. Nat. Mater. 2013;12:191. doi: 10.1038/nmat3568. [DOI] [PubMed] [Google Scholar]
- 28.Pyzer-Knapp EO, Suh C, Gómez-Bombarelli R, Aguilera-Iparraguirre J, Aspuru-Guzik A. Annu. Rev. Mater. Sci. 2015;45:195. doi: 10.1146/annurev-matsci-070214-020823. [DOI] [Google Scholar]
- 29.Saal JE, Kirklin S, Aykol M, Meredig B, Wolverton C. JOM. 2013;65:1501. doi: 10.1007/s11837-013-0755-4. [DOI] [Google Scholar]
- 30.Jain A, Ong SP, Hautier G, Chen W, Richards WD, Dacek S, Cholia S, Gunter D, Skinner D, Ceder G, Persson KA. APL Mater. 2013;1(1):011002. doi: 10.1063/1.4812323. [DOI] [Google Scholar]
- 31.Curtarolo S, Setyawan W, Wang S, Xue J, Yang K, Taylor RH, Nelson LJ, Hart GL, Sanvito S, Buongiorno-Nardelli M, Mingo N, Levy O. Comput. Mater. Sci. 2012;58:227. doi: 10.1016/j.commatsci.2012.02.002. [DOI] [Google Scholar]
- 32.Jacobsen TL, Jørgensen MS, Hammer B. Phys. Rev. Lett. 2018;120:026102. doi: 10.1103/PhysRevLett.120.026102. [DOI] [PubMed] [Google Scholar]
- 33.Ulissi ZW, Medford AJ, Bligaard T, Nørskov JK. Nat. Commun. 2017;8:14621. doi: 10.1038/ncomms14621. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.A.A. Peterson, J. Chem. Phys.145(7), 074106 (2016). 10.1063/1.4960708 [DOI] [PubMed]
- 35.Xu S, Li J, Cai P, Liu X, Liu B, Wang X. J. Am. Chem. Soc. 2021;143(47):19769. doi: 10.1021/jacs.1c08211. [DOI] [PubMed] [Google Scholar]
- 36.Ferreira RS, Simeonov A, Jadhav A, Eidam O, Mott BT, Keiser MJ, McKerrow JH, Maloney DJ, Irwin JJ, Shoichet BK. J. Med. Chem. 2010;53(13):4891. doi: 10.1021/jm100488w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Yao Z, Lum Y, Johnston A, Mejia-Mendoza LM, Zhou X, Wen Y, Aspuru-Guzik A, Sargent EH, Seh ZW. Nat. Rev. Mater. 2022 doi: 10.1038/s41578-022-00490-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Li J, Lim K, Yang H, Ren Z, Raghavan S, Chen P-Y, Buonassisi T, Wang X. Matter. 2020 doi: 10.1016/j.matt.2020.06.011. [DOI] [Google Scholar]
- 39.Yang H, Li J, Lim KZ, Pan C, Van Truong T, Wang Q, Li K, Li S, Xiao X, Ding M, Chen T, Liu X, Xie Q, Alvarado PVY, Wang X, Chen P-Y. Nat. Mach. Intell. 2022;4:84. doi: 10.1038/s42256-021-00434-8. [DOI] [Google Scholar]
- 40.Guan J, Huang T, Liu W, Feng F, Japip S, Li J, Wu J, Wang X, Zhang S. Cell Rep. Phys. Sci. 2022;3(5):100864. doi: 10.1016/j.xcrp.2022.100864. [DOI] [Google Scholar]
- 41.Stach E, DeCost B, Kusne AG, Hattrick-Simpers J, Brown KA, Reyes KG, Schrier J, Billinge S, Buonassisi T, Foster I, Gomes CP, Gregoire JM, Mehta A, Montoya J, Olivetti E, Park C, Rotenberg E, Saikin SK, Smullin S, Stanev V, Maruyama B. Matter. 2021;4(9):2702. doi: 10.1016/j.matt.2021.06.036. [DOI] [Google Scholar]
- 42.Li J, Telychko M, Yin J, Zhu Y, Li G, Song S, Yang H, Li J, Wu J, Lu J, Wang X. J. Am. Chem. Soc. 2021;143(27):10177. doi: 10.1021/jacs.1c03091. [DOI] [PubMed] [Google Scholar]
- 43.Mehr SHM, Craven M, Leonov AI, Keenan G, Cronin L. Science. 2020;370(6512):101. doi: 10.1126/science.abc2986. [DOI] [PubMed] [Google Scholar]
- 44.Raccuglia P, Elbert KC, Adler PDF, Falk C, Wenny MB, Mollo A, Zeller M, Friedler SA, Schrier J, Norquist AJ. Nature. 2016;533:73. doi: 10.1038/nature17439. [DOI] [PubMed] [Google Scholar]
- 45.Moosavi SM, Chidambaram A, Talirz L, Haranczyk M, Stylianou KC, Smit B. Nat. Commun. 2019;10:539. doi: 10.1038/s41467-019-08483-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Sokol KP, Andrei V. Nat. Rev. Mater. 2022;7:251. doi: 10.1038/s41578-022-00432-1. [DOI] [Google Scholar]
- 47.Xu H, Lin J, Liu Q, Chen Y, Zhang J, Yang Y, Young MC, Xu Y, Zhang D, Mo F. Chem. 2022;8(12):3202. doi: 10.1016/j.chempr.2022.08.008. [DOI] [Google Scholar]
- 48.Roch LM, Häse F, Kreisbeck C, Tamayo-Mendoza T, Yunker LPE, Hein JE, Aspuru-Guzik A. PLoS One. 2020;15(4):e0229862. doi: 10.1371/journal.pone.0229862. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Pendleton IM, Cattabriga G, Li Z, Najeeb MA, Friedler SA, Norquist AJ, Chan EM, Schrier J. MRS Commun. 2019;9:846. doi: 10.1557/mrc.2019.72. [DOI] [Google Scholar]
- 50.Nikolaev P, Hooper D, Webber F, Rao R, Decker K, Krein M, Poleski J, Barto R, Maruyama B. NPJ Comput. Mater. 2016;2:16031. doi: 10.1038/npjcompumats.2016.31. [DOI] [Google Scholar]
- 51.Jiang Y, Salley D, Sharma A, Keenan G, Mullin M, Cronin L. Sci. Adv. 2022;8(40):abo2626. doi: 10.1126/sciadv.abo2626. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Salley D, Keenan G, Grizou J, Sharma A, Martín S, Cronin L. Nat. Commun. 2020;11:2771. doi: 10.1038/s41467-020-16501-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Epps RW, Bowen MS, Volk AA, Abdel-Latif K, Han S, Reyes KG, Amassian A, Abolhasani M. Adv. Mater. 2020;32(30):2001626. doi: 10.1002/adma.202001626. [DOI] [PubMed] [Google Scholar]
- 54.Dave A, Mitchell J, Kandasamy K, Wang H, Burke S, Paria B, Póczos B, Whitacre J, Viswanathan V. Cell Rep. Phys. Sci. 2020;1(12):100264. doi: 10.1016/j.xcrp.2020.100264. [DOI] [Google Scholar]
- 55.Angello NH, Rathore V, Beker W, Wołos A, Jira ER, Roszak R, Wu TC, Schroeder CM, Aspuru-Guzik A, Grzybowski BA, Burke MD. Science. 2022;378(6618):399. doi: 10.1126/science.adc8743. [DOI] [PubMed] [Google Scholar]
- 56.Arnold C. Nature. 2022;606:612. doi: 10.1038/d41586-022-01618-x. [DOI] [PubMed] [Google Scholar]
- 57.Nicolaou CA, Humblet C, Hu H, Martin EM, Dorsey FC, Castle TM, Burton KI, Hu H, Hendle J, Hickey MJ, Duerksen J, Wang J, Erickson JA. Acs Med. Chem. Lett. 2019;10(3):278. doi: 10.1021/acsmedchemlett.8b00488. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Not applicable.
Not applicable.