Test item development: Validity evidence from quality assurance procedures

Validity of high-stakes examination scores involves collecting and organizing evidence to support a specific test score interpretation or use in some specific context. A primary type of validity evidence derives from the item development process and item responses. An ideal process is identified that documents how items are developed and how responses to the items are studied to ensure that the basic building blocks of tests, test items, are sound. This ideal process includes both qualitative and quantitative forms of evidence. A checklist is provided to help high-stakes examination developers assess the types and quality of item-level validity evidence required in validation.