Approximations of functions by a multilayer perceptron: a new approach

We provide a radically elementary proof of the universal approximation property of the one-hidden layer perceptron based on the Taylor expansion and the Vandermonde determinant. It works for both L-q and uniform approximation on compact sets. This approach naturally yields some bounds for the design of the hidden layer and convergence results (including some rates) for the derivatives. A partial answer to Hornik's conjecture on the universality of the bias is proposed. An extension to vector valued functions is also carried out. (C) 1997 Elsevier Science Ltd.