Adaptive estimation with soft thresholding penalties

We show that various robust nonparametric regression estimators, such as the least absolute deviations estimator, can be made adaptive (up to logarithmic factors), by adding a soft thresholding type penalty to the loss function. As an example, we consider the situation where the roughness of the regression function is described by a single parameter p. The theory is complemented with a simulation study.