Validity Threats: Detection and Control Practices for State and Local Education Officials
|Author(s)||Prepared by the Internal Validity working group chaired by Robin Taylor, Delaware Department of Education and consultants JP Beaudoin, Pete Goldschmidt, and Bill Auty|
|Publication date||January 2006|
|publication pdf||Validity Threats: Detection and Control Practices for State and Local Education Officials|
|Keywords||Indicators-State Education; Standards, Assessments, and Accountability; Data Systems|
Validity Threats: Detection and Control Practices for State and Local Education Officials (CCSSO, 2006) is designed to assist states with developing accountability systems.
In light of increasing resource demands, all state education agencies (SEAs) have operational structures necessary to collect and process information. Many of these data are collected from the district and school level and are the foundation used in the production of both assessment and accountability results. Having moved past the point of simple No Child Left Behind compliance, state accountability systems have evolved to the point that it is necessary to develop more standardized techniques to improve the quality of accountability results. The improvement process typically follows six generic steps:
1. examining current practices,
2. identifying priorities,
3. developing intervention plans,
4. monitoring implementation,
5. evaluating impact, and
6. revising procedures.
Each step is dependent on the one before. This document examines, in depth, the first two steps through the lenses of quality assurance, data integrity, end-user feedback, and credibility to the system and the SEA. Further, it provides examples from state practices, and suggests questions for state and local educational agencies to consider when constructing documentation and practices to fight validity threats to accountability systems.
- PublicationDoes Teacher Professional Development Have Effects on Teaching and Learning? Analysis of Evaluation Findings from Programs for Mathematics and Science Teachers in 14 States
- PublicationAlignment and the States: Three Approaches to Aligning the National Assessment of Educational Progress with State Assessments, Other Assessments, and Standards
- PublicationKey State Education Policies on PK-12 Education: 2008
- PublicationEffects of Teacher Professional Development Gains in Student Achievement: How Meta Analysis Provides Evidence Useful to Education Leaders
- PublicationGuide to United States Department of Education Growth Model Pilot Program 2005-2008
- PublicationTRANSFORMING EDUCATION: Delivering on Our Promise to Every Child
- PublicationState Education Indicators with a Focus on Title I 2001-2002
- PublicationMathematics & Science Education Task Force Executive Summary, 2006
- PublicationMathematics & Science Education Task Force Recommendations, 2006
- PublicationClosing the Gap in Science Achievement: Using NAEP Science Assessment Scores to Analyze State Trends