Research methods and types of evidence for research in educational technology

Recent concern about lack of scientific rigor in educational research has led to a reexamination of educational research methods. Methodology requires particular attention when researchers study learning in complex learning environments such as classrooms or computer-driven environments that simulate complex processes. This article reaffirms the importance of experimental research for answering some research questions. It argues that nonexperimental methods, such as design experiments and methods applied to the study of large-scale educational programs, such as randomized field trials, are useful for answering other kinds of research questions about learning in complex settings. This article discusses the validity of evidence gathered using these nonexperimental methods. Finally, it suggests that the study of the dynamics of learning can help integrate data from experiments that reveal details about learning and data from nonexperimental research that reveal how learning occurs in complex settings.