The performance of square norm adaptive filters degrades in the presence of impulsive noise. The sign algorithm overcomes this problem, at the cost of a slower convergence. Presented is an adaptive combination of two independent filters, using the absolute and quadratic error criteria, respectively, so that the resulting scheme achieves a fast convergence and remains robust to impulsive noise.