RANDOMLY FALLIBLE TEACHERS - LEARNING MONOTONE DNF WITH AN INCOMPLETE MEMBERSHIP ORACLE

被引:32
作者
ANGLUIN, D [1 ]
SLONIM, DK [1 ]
机构
[1] MIT, COMP SCI LAB, CAMBRIDGE, MA 02139 USA
关键词
CONCEPT LEARNING; IMPERFECT TEACHERS; MONOTONE DNF FORMULAS; EQUIVALENCE QUERIES; MEMBERSHIP QUERIES WITH MISSING INFORMATION; PERSISTENT ERRORS IN QUERIES;
D O I
10.1007/BF00993160
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We introduce a new fault-tolerant model of algorithmic learning using an equivalence oracle and an incomplete membership oracle, in which the answers to a random subset of the learner's membership queries may be missing. We demonstrate that, with high probability, it is still possible to learn monotone DNF formulas in polynomial time, provided that the fraction of missing answers is bounded by some constant less than one. Even when half the membership queries are expected to yield no information, our algorithm will exactly identify m-term, n-variable monotone DNF formulas with an expected O(mn2) queries. The same task has been shown to require exponential time using equivalence queries alone. We extend the algorithm to handle some one-sided errors, and discuss several other possible error models. It is hoped that this work may lead to a better understanding of the power of membership queries and the effects of faulty teachers on query models of concept learning.
引用
收藏
页码:7 / 26
页数:20
相关论文
共 27 条
[1]  
ANGLUIN D, 1990, MACH LEARN, V5, P121, DOI 10.1023/A:1022692615781
[2]  
ANGLUIN D, 1992, MACH LEARN, V9, P147, DOI 10.1007/BF00992675
[3]   LEARNING READ-ONCE FORMULAS WITH QUERIES [J].
ANGLUIN, D ;
HELLERSTEIN, L ;
KARPINSKI, M .
JOURNAL OF THE ACM, 1993, 40 (01) :185-210
[4]  
Angluin D., 1988, Machine Learning, V2, P343, DOI 10.1007/BF00116829
[5]  
Angluin D., 1988, Machine Learning, V2, P319, DOI 10.1023/A:1022821128753
[6]   LEARNING REGULAR SETS FROM QUERIES AND COUNTEREXAMPLES [J].
ANGLUIN, D .
INFORMATION AND COMPUTATION, 1987, 75 (02) :87-106
[7]  
ANGLUIN D, 1991, 23RD P ANN ACM S THE, P444
[8]  
ANGLUIN D, 1991, 4TH P ANN WORKSH COM, P139
[9]  
GOLDMAN SA, 1990, ANN IEEE SYMP FOUND, P193
[10]  
HANCOCK TR, 1990, 3RD P ANN WORKSH COM, P23