Large-amplitude holographic surface relief gratings are optically induced by resonant visible exposure in azobenzene dye-containing polymers. We propose a simple diffusion model accounting for the essential features of surface relief formation. It accounts for intensity, grating-pitch and polarization dependencies. Understanding of this process appears essential for realtime holography applications. It opens new perspectives associated with optically controlled anisotropic diffusion.