Experiments in surveys: Linking mass class questionnaires to introductory research methods

The advantages of using an in-class social survey as an innovative teaching technique in large introductory sociology courses have been well documented. In this paper we report our extension of this technique to experiments in surveys. Using two forms of the in-class questionnaire, we implemented experiments in response framework, response order, and question order in surveys conducted in spring and fall, 1993 and 1994. The results of the experiments were presented in simplified form to the mass introductory classes and in greater detail to junior-level research methods classes in spring 1995. The goal in presenting this material to research methods students is to encourage critical thinking and informed skepticism about questionnaire design specifically, and data-generating procedures more generally In this paper we include some examples of experiments and describe how they were introduced and discussed in, research methods classes.