LEARNING INTEGER LATTICES

被引:48
作者
HELMBOLD, D [1 ]
SLOAN, R [1 ]
WARMUTH, MK [1 ]
机构
[1] UNIV ILLINOIS, DEPT ELECT ENGN & COMP SCI, CHICAGO, IL 60680 USA
关键词
LATTICES; CONCEPT LEARNING; MISTAKE BOUNDS;
D O I
10.1137/0221019
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The problem of learning an integer lattice of Z(k) in an on-line fashion is considered. That is, the learning algorithm is given a sequence of k-tuples of integers and predicts for each tuple in the sequence whether it lies in a hidden target lattice of Z(k). The goal of the algorithm is to minimize the number of prediction mistakes. An efficient learning algorithm with an absolute mistake bound of k + right perpendicular k log(n square-root k) left perpendicular is given, where n is the maximum component of any tuple seen. It is shown that this bound is approximately a log log n factor larger than the lower bound on the worst case number of mistakes given by the VC dimension of lattices that are restricted to {-n, ...,0,...,n}k. This algorithm is used to learn rational lattices, cosets of lattices, an on-line word problem for abelian groups, and a subclass of the commutative regular languages. Furthermore, by adapting the results of [D. Helmbold, R. Sloan, and M. K. Warmuth, Machine Learning, 5(1990), pp. 165 196], one can efficiently learn nested differences of each of the above classes (e.g., concepts of the form c1 - (c2 - (c3 - (c4 - c5))), where each c(i) is the coset of a lattice).
引用
收藏
页码:240 / 266
页数:27
相关论文
共 24 条
[1]  
Abe N., 1991, New Generation Computing, V8, P319, DOI 10.1007/BF03037090
[2]  
ABE N, 1989, 2ND WORKSH COMP LEAR, P24
[3]  
Angluin D., 1988, Machine Learning, V2, P319, DOI 10.1023/A:1022821128753
[4]   INFERENCE OF REVERSIBLE LANGUAGES [J].
ANGLUIN, D .
JOURNAL OF THE ACM, 1982, 29 (03) :741-765
[5]  
[Anonymous], 2004, COMBINATORIAL GROUP
[6]  
Barzdin J. M., 1972, SOV MATH DOKL, V13, P1224
[7]  
BOUCHERON S, 1988, LEARNABILITY POSITIV
[8]  
Cassels J.W.S., 1959, INTRO GEOMETRY NUMBE, P20
[9]  
DUDLEY RM, 1984, LECTURE NOTES MATH, V1097
[10]   PLANNING AND LEARNING IN PERMUTATION-GROUPS [J].
FIAT, A ;
MOSES, S ;
SHAMIR, A ;
SHIMSHONI, I ;
TARDOS, G .
30TH ANNUAL SYMPOSIUM ON FOUNDATIONS OF COMPUTER SCIENCE, 1989, :274-279