A theory of learning from different domains

被引:52
作者
Shai Ben-David
John Blitzer
Koby Crammer
Alex Kulesza
Fernando Pereira
Jennifer Wortman Vaughan
机构
[1] University of Waterloo,David R. Cheriton School of Computer Science
[2] UC Berkeley,Department of Computer Science
[3] The Technion,Department of Electrical Engineering
[4] University of Pennsylvania,Department of Computer and Information Science
[5] Google Research,School of Engineering and Applied Sciences
[6] Harvard University,undefined
来源
Machine Learning | 2010年 / 79卷
关键词
Domain adaptation; Transfer learning; Learning theory; Sample-selection bias;
D O I
暂无
中图分类号
学科分类号
摘要
Discriminative learning methods for classification perform well when training and test data are drawn from the same distribution. Often, however, we have plentiful labeled training data from a source domain but wish to learn a classifier which performs well on a target domain with a different distribution and little or no labeled training data. In this work we investigate two questions. First, under what conditions can a classifier trained from source data be expected to perform well on target data? Second, given a small amount of labeled target data, how should we combine it during training with the large amount of labeled source data to achieve the lowest target error at test time?
引用
收藏
页码:151 / 175
页数:24
相关论文
共 18 条
[1]  
Ando R.(2005)A framework for learning predictive structures from multiple tasks and unlabeled data Journal of Machine Learning Research 6 1817-1853
[2]  
Zhang T.(2002)Rademacher and Gaussian complexities: risk bounds and structural results Journal of Machine Learning Research 3 463-482
[3]  
Bartlett P.(2000)A model of inductive bias learning Journal of Artificial Intelligence Research 12 149-198
[4]  
Mendelson S.(2003)On the difficulty of approximately maximizing agreements Journal of Computer and System Sciences 66 496-514
[5]  
Baxter J.(2008)Learning from multiple sources Journal of Machine Learning Research 9 1757-1774
[6]  
Ben-David S.(1979)Sample selection bias as a specification error Econometrica 47 153-161
[7]  
Eiron N.(2008)Direct importance estimation for covariate shift adaptation Annals of the Institute of Statistical Mathematics 60 699-746
[8]  
Long P.(undefined)undefined undefined undefined undefined-undefined
[9]  
Crammer K.(undefined)undefined undefined undefined undefined-undefined
[10]  
Kearns M.(undefined)undefined undefined undefined undefined-undefined