LEARNING INTEGER LATTICES

被引:48
作者
HELMBOLD, D [1 ]
SLOAN, R [1 ]
WARMUTH, MK [1 ]
机构
[1] UNIV ILLINOIS, DEPT ELECT ENGN & COMP SCI, CHICAGO, IL 60680 USA
关键词
LATTICES; CONCEPT LEARNING; MISTAKE BOUNDS;
D O I
10.1137/0221019
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The problem of learning an integer lattice of Z(k) in an on-line fashion is considered. That is, the learning algorithm is given a sequence of k-tuples of integers and predicts for each tuple in the sequence whether it lies in a hidden target lattice of Z(k). The goal of the algorithm is to minimize the number of prediction mistakes. An efficient learning algorithm with an absolute mistake bound of k + right perpendicular k log(n square-root k) left perpendicular is given, where n is the maximum component of any tuple seen. It is shown that this bound is approximately a log log n factor larger than the lower bound on the worst case number of mistakes given by the VC dimension of lattices that are restricted to {-n, ...,0,...,n}k. This algorithm is used to learn rational lattices, cosets of lattices, an on-line word problem for abelian groups, and a subclass of the commutative regular languages. Furthermore, by adapting the results of [D. Helmbold, R. Sloan, and M. K. Warmuth, Machine Learning, 5(1990), pp. 165 196], one can efficiently learn nested differences of each of the above classes (e.g., concepts of the form c1 - (c2 - (c3 - (c4 - c5))), where each c(i) is the coset of a lattice).
引用
收藏
页码:240 / 266
页数:27
相关论文
共 24 条
[21]  
PITT L, IN PRESS J ASS COMPU
[22]  
SHVAYTSER H, 1988, UNPUB LINEAR MANIFOL
[23]   UNIFORM CONVERGENCE OF RELATIVE FREQUENCIES OF EVENTS TO THEIR PROBABILITIES [J].
VAPNIK, VN ;
CHERVONENKIS, AY .
THEORY OF PROBILITY AND ITS APPLICATIONS,USSR, 1971, 16 (02) :264-+
[24]  
WU T, 1982, SIAM J COMPUT, V11, P687