The discrete symmetry group of Narain orbifolds is specified for general abelian orbifolds, including asymmetric ones. This symmetry group is modular, that it is realized as a group of transformations in the moduli space of orbifold compactifications. As an application, duality transformations are discussed in models with discrete backgrounds.