Four FD-TD extensions for the modeling of pulse propagation in Debye or Lorentz dispersive media are analyzed through studying the stability and phase error properties of the coupled difference equations corresponding to Maxwell's equations and to the equations for the dispersion. For good overall accuracy we show that all schemes should be run at their Courant stability limit, and that the timestep should finely resolve the medium timescales. Particularly, for Debye schemes it should be at least DELTAt = 10-3 tau, while for Lorentz schemes it should be DELTAt = 10-2 tau, where tau is a typical medium relaxation tim A numerical experiment with a Debye medium confirms this. We have determined that two of the discretizations for Debye media are totally equivalent. In the Lorentz medium case we establish that the method that uses the polarization differential equation to model dispersion is stable for all wavenumbers, and that the method using the local-in-time constitutive relation is weakly unstable for modes with wavenumber k such that kDELTAx > pi/2.