Anthropogenic biases in chemical reaction data hinder exploratory inorganic synthesis

被引:134
作者
Jia, Xiwen [1 ]
Lynch, Allyson [1 ]
Huang, Yuheng [1 ]
Danielson, Matthew [1 ]
Lang'at, Immaculate [1 ]
Milder, Alexander [1 ]
Ruby, Aaron E. [1 ]
Wang, Hao [1 ]
Friedler, Sorelle A. [2 ]
Norquist, Alexander J. [1 ]
Schrier, Joshua [1 ,3 ]
机构
[1] Haverford Coll, Dept Chem, Haverford, PA 19041 USA
[2] Haverford Coll, Dept Comp Sci, Haverford, PA 19041 USA
[3] Fordham Univ, Dept Chem, Bronx, NY 10458 USA
基金
美国国家科学基金会;
关键词
MACHINE; STRATEGIES; DISCOVERY;
D O I
10.1038/s41586-019-1540-5
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Most chemical experiments are planned by human scientists and therefore are subject to a variety of human cognitive biases(1), heuristics(2) and social influences(3). These anthropogenic chemical reaction data are widely used to train machine-learning models(4) that are used to predict organic(5) and inorganic(6,7) syntheses. However, it is known that societal biases are encoded in datasets and are perpetuated in machine-learning models(8). Here we identify as-yet-unacknowledged anthropogenic biases in both the reagent choices and reaction conditions of chemical reaction datasets using a combination of data mining and experiments. We find that the amine choices in the reported crystal structures of hydrothermal synthesis of amine-templated metal oxides(9) follow a power-law distribution in which 17% of amine reactants occur in 79% of reported compounds, consistent with distributions in social influence models(10-12). An analysis of unpublished historical laboratory notebook records shows similarly biased distributions of reaction condition choices. By performing 548 randomly generated experiments, we demonstrate that the popularity of reactants or the choices of reaction conditions are uncorrelated to the success of the reaction. We show that randomly generated experiments better illustrate the range of parameter choices that are compatible with crystal formation. Machine-learning models that we train on a smaller randomized reaction dataset outperform models trained on larger human-selected reaction datasets, demonstrating the importance of identifying and addressing anthropogenic biases in scientific data.
引用
收藏
页码:251 / +
页数:16
相关论文
共 43 条
[1]   Auditing black-box models for indirect influence [J].
Adler, Philip ;
Falk, Casey ;
Friedler, Sorelle A. ;
Nix, Tionney ;
Rybeck, Gabriel ;
Scheidegger, Carlos ;
Smith, Brandon ;
Venkatasubramanian, Suresh .
KNOWLEDGE AND INFORMATION SYSTEMS, 2018, 54 (01) :95-122
[2]   The Beneficial Role of Random Strategies in Social and Financial Systems [J].
Biondo, Alessio Emanuele ;
Pluchino, Alessandro ;
Rapisarda, Andrea .
JOURNAL OF STATISTICAL PHYSICS, 2013, 151 (3-4) :607-622
[3]   Can human experts predict solubility better than computers? [J].
Boobier, Samuel ;
Osbourn, Anne ;
Mitchell, John B. O. .
JOURNAL OF CHEMINFORMATICS, 2017, 9
[4]   Analysis of Past and Present Synthetic Methodologies on Medicinal Chemistry: Where Have All the New Reactions Gone? [J].
Brow, Dean G. ;
Bostrom, Jonas .
JOURNAL OF MEDICINAL CHEMISTRY, 2016, 59 (10) :4443-4458
[5]   Understanding Our Love Affair with p-Chlorophenyl: Present Day Implications from Historical Biases of Reagent Selection [J].
Brown, Dean G. ;
Gagnon, Moriah M. ;
Bostrom, Jonas .
JOURNAL OF MEDICINAL CHEMISTRY, 2015, 58 (05) :2390-2405
[6]   Semantics derived automatically from language corpora contain human-like biases [J].
Caliskan, Aylin ;
Bryson, Joanna J. ;
Narayanan, Arvind .
SCIENCE, 2017, 356 (6334) :183-186
[7]   The universal decay of collective memory and attention [J].
Candia, Cristian ;
Jara-Figueroa, C. ;
Rodriguez-Sickert, Carlos ;
Barabasi, Albert-Laszlo ;
Hidalgo, Cesar A. .
NATURE HUMAN BEHAVIOUR, 2019, 3 (01) :82-91
[8]   How To Optimize Materials and Devices via Design of Experiments and Machine Learning: Demonstration Using Organic Photovoltaics [J].
Cao, Bing ;
Adutwum, Lawrence A. ;
Oliynyk, Anton O. ;
Luber, Erik J. ;
Olsen, Brian C. ;
Mar, Arthur ;
Buriak, Jillian M. .
ACS NANO, 2018, 12 (08) :7434-7444
[9]   The perceived feasibility of methods to reduce publication bias [J].
Carroll, Harriet A. ;
Toumpakari, Zoi ;
Johnson, Laura ;
Betts, James A. .
PLOS ONE, 2017, 12 (10)
[10]  
Cheetham AK, 1999, ANGEW CHEM INT EDIT, V38, P3268, DOI 10.1002/(SICI)1521-3773(19991115)38:22<3268::AID-ANIE3268>3.0.CO