ON LEARNING RING-SUM-EXPANSIONS

被引:28
作者
FISCHER, P
SIMON, HU
机构
[1] Univ Dortmund, Dortmund
关键词
PAC-LEARNING; BOOLEAN FUNCTIONS; VAPNIK-CHERVONENKIS-DIMENSION; WORST CASE MISTAKE BOUNDS;
D O I
10.1137/0221014
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The problem of learning ring-sum-expansions from examples is studied. Ring-sum-expansions (RSE) are representations of Boolean functions over the base {AND, +, 1}, which reflect arithmetic operations in GF(2). k-RSE is the class of ring-sum-expansions containing only monomials of length at most k. k-term-RSE is the class of ring-sum-expansions having at most k monomials. It is shown that k-RSE, k greater-than-or-equal-to 1, is learnable while k-term-RSE, k greater-than-or-equal-to 2, is not learnable if RP not-equal NP. Without using a complexity-theoretical hypothesis, it is proven that k-RSE, k greater-than-or-equal-to 1, and k-term-RSE, k greater-than-or-equal-to 2 cannot be learned from positive (negative) examples alone. However, if the restriction that the hypothesis which is output by the learning algorithm is also a k-RSE is suspended, then k-RSE is learnable from positive (negative) examples only. Moreover, it is proved that 2-term-RSE is learnable by a conjunction of a 2-CNF and a 1-DNF. Finally the paper presents learning (on-line prediction) algorithms for k-RSE that are optimal with respect to the sample size (worst case mistake bound).
引用
收藏
页码:181 / 192
页数:12
相关论文
共 12 条
[1]  
[Anonymous], 1987, COMPLEXITY BOOLEAN F
[2]  
BLUM A, 1990, 3RD P WORKSH COMP LE, P144
[3]   OCCAM RAZOR [J].
BLUMER, A ;
EHRENFEUCHT, A ;
HAUSSLER, D ;
WARMUTH, MK .
INFORMATION PROCESSING LETTERS, 1987, 24 (06) :377-380
[4]   A GENERAL LOWER BOUND ON THE NUMBER OF EXAMPLES NEEDED FOR LEARNING [J].
EHRENFEUCHT, A ;
HAUSSLER, D ;
KEARNS, M ;
VALIANT, L .
INFORMATION AND COMPUTATION, 1989, 82 (03) :247-261
[5]  
FISCHER P, 1990, 3RD P ANN WORKSH COM, P130
[6]  
Garey M.R., 1979, COMPUTERS INTRACTABI, V174
[7]  
HELMBOLD D, 1990, 3RD P ANN WORKSH COM, P288
[8]  
KEARNS M, 1987, 4TH P INT WORKSH MAC, P337
[9]  
KEARNS M, 1987, 19TH P ACM S THEOR C, P285
[10]  
Littlestone N., 1987, 28th Annual Symposium on Foundations of Computer Science (Cat. No.87CH2471-1), P68, DOI 10.1109/SFCS.1987.37