DID Resource Kit for States, Districts and Schools

Overview: What Is a Comprehensive Data System?

Comprehensive data systems include measures, data and indicators on students, student achievement, organizational quality, personnel, resources and social services. A data system is comprehensive when it collects and shares information at the each level of the system (school, district and state), for appropriate purposes, using appropriate measures.

Data are primarily used in two ways: to make accountability or “summative” decisions, or to make continuous improvement or “formative” decisions related to system improvement and student achievement. Both types of data are necessary to simultaneously hold the system accountable while leaders strive for improvements. State longitudinal data systems are important to organize data and combine it with other data to answer complex policy and improvement questions – which can be done at all levels of the system.

School leaders use data to assess student progress, monitor school improvement, assess the effectiveness of programs and instructional strategies and target resources, including teachers’ professional learning.The NCLB requirement of schools meeting adequate yearly progress (AYP) helps focus the attention of school leaders to ensure all students meet high academic standards and to ensure all teachers are highly qualified. Data are also used to assess leader and teacher effectiveness in supporting student achievement.School leaders may also take advantage of periodic benchmark assessments to monitor student progress and ensure the school curriculum is aligned to standards. Schools may also use diagnostic or placement tests, teacher-made tests, walk-throughs or analyzing student work to assess student learning – and adjust instruction to ensure all students meet high standards.

1. Essential Elements

Comprehensive data systems at the school level include:

  • Student assessment results on state academic standards reported by subgroups
  • Accountability reports of schools meeting AYP
  • School report cards (NCLB requirement)
  • Student promotion, graduation and drop-out rates
  • Measures to assess progress on district goals
  • School accreditation results
  • Results on district administered interim or benchmark assessments
  • Results of teacher made tests
  • Results of student classroom performances
  • Assessments of leader effectiveness

Optional Data Elements:


  • Results of high school exit examinations and or/end-of-course examinations (for high schools)

  • Implementation and progress on a school balanced scorecard (i.e., Delaware)

  • Results on college readiness measures such as the ACT (sometimes embedded in state assessments)

  • Results on college admission/placement tests

  • Results on predictive college readiness measures such as PSAT and EPAS

  • Results on school improvement indicators\Other district administered assessments such as practice tests for state graduation exams or student diagnostic and placement assessments

  • Student portfolios

  • Other school-based assessments

  • Parent engagement

  • Community satisfaction surveys

  • Family social service information


2.  Promising Practices

Morris Brandon Elementary School in Atlanta, a high-achieving school, set out to help more of their students not just meet the state academic standards but to exceed the standards. They also wanted to raise the achievement of students with limited English proviciency.


Brandon Elementary School used a number of data sources. One was the Georgia Criterion Reference Competency Test (CRCT) which assesses student progress in mathematics. English/Language Arts, science and social studies. Each test has “content domains” or subtests.  The district provided benchmark tests that are aligned to state and district standards in reading/language arts and mathematics twice a year. The state provided released items from the CRCT which provides teachers with information on how content domains are tested. In addition, Brandon used a commercially available test in reading and mathematics aligned to their school instructional program. These tests were administered three to five times each year in each subject. These three series of tests (administered by the state, district and school) provide teachers and school leaders at Brandon with significant, timely data to gauge student progress and make immediate interventions in student learning.


  • Adding flexible groupings to help students missing important concepts catch up.
  • Using the school’s three early intervention teachers to pull out students for additional instruction as soon as they fall behind.
  • Focusing teachers’ professional development in instructional areas where students are not mastering the standards.
  • Revising (or adopting) curricula and instrucitonal strategies to improve instruction in areas where test data suggest students are having difficulty (such as vocabulary, spelling and reading comprehension).
  • Using paraprofessionals in the early grades for small group learning.
  • Increasing the time the principal spent as an instructional leader by delegating more managerial tasks to teachers and the assistant principal.
  • Providing teachers more planning time to work together in vertical teams and grade level teams to align the curriculum based on student achievement data
  • Requiring weekly reports from teams related to their proposed improvement strategies from their common planning time.
  • Looking at student work to identify common expectations of quality work.

A year later, the school lhad met its performance targets and since then, teachers are constantly aware of where students are in meeting expected performance levels. Data are always used to guide instructional improvement and individual student learning needs.



3. Critical Questions

  • Does your school receive the results of the state assessment in time to adjust instruction for students?

  • Are results of the state assessment used to revise/align curriculum?  Inform teachers’ professional learning?  Allocate resources?

  • Does your state provide a guide that helps school leaders and teachers understand disaggregated data and AYP?

  • Does your school administer interim or benchmark assessments aligned to district and state standards?  How is this information used to group students and adjust instruction?

  • Does your school use a research-based school improvement planning process that uses data for continuous improvement?

  • Does the school use performance assessments such as portfolios or performance exhibitions?

  • Are diagnostic or placement tests adopted and used by schools? Are predictive measures being administered to identify how well students are progressing to be college or work ready?

  • Do teachers have web-based access to student records?

  • Are data being used to identify and share best practices that raise student achievement?

  • Are teacher and leader evaluations used to support their professional learning and to hold them accountable for results?


4. School Resources

Annotated bibliography courtesy of the Assessment and Accountability Comprehensive Library.

American Association of School Administrators. (2002). Using data to improve schools: What's working. Arlington, VA: KSA-Plus Communications. Summary:This is an easy-to-read guide to using data to drive school improvement. Education leaders and their staff can use this tool to build a districtwide culture of data-driven inquiry, and learn strategies to engage their communities in data-driven decision-making. 

Barnes, F. D. (2004). Inquiry and Action: Making School Improvement Part of Daily Practice. Annenberg Institute for School Reform, Brown UniversitySummary:A comprehensive school-improvement guide with supplemental worksheet templates, this resource provides an overview of school improvement and a framework for using a cycle of inquiry and action, as well as descriptions of how schools have put a self-study cycle into practice by collecting, analyzing, and acting on information. 

Bernhardt, V.L. (2002). School Portfolio Toolkit: Planning, Implementation, & Evaluation for Continuous School Improvement. Larchmonth, NY: Eye on Education.  Summary: Provides tools, strategies, templates, and examples for use in building school portfolios and for planning, implementing, and evaluating continuous school improvement. The Toolkit was written to support school personnel with the mechanics of putting together a school portfolio, as well as to offer processes and strategies to move whole school staffs into and through continuous improvement.

Boudett, K.P., City, E.A., & Murnane, R.J. (eds.). (2005). Data wise: A step-by-step guide to using assessment results to improve teaching and learning. Cambridge, MA: Harvard Education Publishing Group. 1-891792-67-9. Summary: This book provides several useful ideas and tools to assist school leaders in utilizing data to improve instruction and student achievement. It includes information and resources on the following topics: Collaborative work, assessment literacy, data analysis, examination of instruction and student progress, and action plan development and implementation.

Boudett, Kathryn P. and Jennifer L. Steele (eds.) (2007). Data wise in Action: Stories of schools using data to improve teaching and learning. Harvard University Press. Summary: This book tells the stories of eight very different schools following the Data Wise process of using assessment results to improve teaching and learning. Data Wise in Action highlights the leadership challenges schools face in each phase of the eight-step Data Wise cycle and illustrates how staff members use creativity and collaboration to overcome those challenges.

Datnow, A., Park, V., & Wohlstetter, P. (2007). Achieving with data: How high-performing school systems use data to improve instruction for elementary students. Center on Educational Governance, Rossier School of Education, University of Southern California.Summary: This study captures the details of data-driven instructional decision-making at the classroom, school, and system levels in two urban school districts and two nonprofit charter management organizations. The researchers document effective performance-driven practices, identify salient themes regarding the structure and culture of the systems, examine needs for improvement, and make recommendations for policy and practice.

Garmston, R.J. (2005). Group wise: Create a culture of inquiry and develop productive groups. JSD, 26(2). Summary: This article outlines three factors that are key to creating a culture of inquiry and developing productive groups: engaged leaders who continuously communicate and participate in practices; leaders who provide time and space for teacher collaboration; and the occurrence of continuing self-reflection following professional development. These collaborative efforts are focused on improving instruction, raising student achievement, and enhancing the professional community. 

Halverson, R., Grigg, J., Prichett, R., & Thomas, C. (2005). The new instructional leadership: Creating data-driven instructional systems in schools. WCER Working Paper 2005-9, Wisconsin Center for Education Research, University of Wisconsin-Madison. Summary:This paper considers how school leaders develop data-driven instructional systems (DDIS) to facilitate the flow of information throughout their organizations. 

Heritage, M., & Chen, E. (2005, May). Why data skills matter in school improvement. Phi Delta Kappan, 86(9), 707. (ERIC Document Reproduction Service No. EJ712939)
Summary:The authors describe a CRESST initiative that helps educators develop the skills to collect, analyze, and use data to make informed decisions about student learning.

 

Stringfield, S., Wayman, J.C., & Yakimowski, M. (2005). Scaling up data use in classrooms, schools and districts. In Dede, C., Honan, J., & Peters, L. (Eds.), Scaling up success: Lessons learned from technology-based educational innovation. San Francisco: Jossey-Bass. Summary: This text is a hands-on resource that clearly describes different models for "scaling up" success. It is filled with illustrative examples of best practices that are grounded in realo-life case studies of technology-based educational innovation.