Print this Page

Resources

Validity Threats: Detection and Control Practices for State and Local Education Officials

Author(s)Prepared by the Internal Validity working group chaired by Robin Taylor, Delaware Department of Education and consultants JP Beaudoin, Pete Goldschmidt, and Bill Auty
Publication dateJanuary 2006
publication pdfValidity Threats: Detection and Control Practices for State and Local Education Officials
KeywordsIndicators-State Education; Standards, Assessments, and Accountability; Data Systems

Validity Threats: Detection and Control Practices for State and Local Education Officials (CCSSO, 2006) is designed to assist states with developing accountability systems.

In light of increasing resource demands, all state education agencies (SEAs) have operational structures necessary to collect and process information. Many of these data are collected from the district and school level and are the foundation used in the production of both assessment and accountability results. Having moved past the point of simple No Child Left Behind compliance, state accountability systems have evolved to the point that it is necessary to develop more standardized techniques to improve the quality of accountability results. The improvement process typically follows six generic steps:

  1. examining current practices,
  2. identifying priorities,
  3. developing intervention plans,
  4. monitoring implementation,
  5. evaluating impact, and
  6. revising procedures.

Each step is dependent on the one before. This document examines, in depth, the first two steps through the lenses of quality assurance, data integrity, end-user feedback, and credibility to the system and the SEA. Further, it provides examples from state practices, and suggests questions for state and local educational agencies to consider when constructing documentation and practices to fight validity threats to accountability systems.

Contact:Kimberly  Rhodeskimberlyr@ccsso.org202-312-6865