Overview: Standards for Data Use
Just as the education system is now driven by student standards -- what students should know and be able to do – there are also important education leadership standards -- what principals should know and be able to do to lead a successful school building. Leadership standard have come in several forms over the past few years, including, but not limited to, the Interstate School Leaders Licensure Consortium (ISLLC) leadership standards, and the Education Leaders Constituents Council (ELCC) standards for advanced programs in educational leadership. These standards are a documented set of skills that the field has deemed necessary to be a high quality education leader. With respect to data-informed decision-making, there are specific standards that relate to the skills and behaviors needed by leaders to effectively use data in their school.
District-Level Data Standards
District policies and practices set the tone and standards for how effective schools are at using data. Districts need to be clear on their standards and expectations for data use and thus communicate this information clearly to all district employees and schools. Some policies and practices that districts should ensure are: assisting schools with creating benchmark assessments, providing district-level data to schools in a timely way, providing support and evaluations of school leaders in how they use data and in how they support schools in making changes based on data and reviewing written policies about expectations for data use in school buildings. Districts also need to provide professional development opportunities for principals and teachers to help them meet the standards of using data.
The role of the district in ensuring that leaders meet high standards for data use is to recruit, hire and train school leaders who understand how to use data for school improvement and raise student achievement. District professional development opportunities should be aligned to the state leadership standards – including the use of data to inform instructional decisions. Districts may form partnerships with higher education institutions to ensure leaders graduate with a strong understanding of data use. Tools that assess leaders’ effectiveness are other continuous improvement measures that will ensure school leaders the ability to use data to inform all aspects of their school.
District offices that use data model high standards of data use for school leaders. In high-performing districts, the superintendent and school board members know how to lead and support data use. Data is used to gauge progress on district and school goals. High-performing districts have long-term professional development strategies to help all district personnel use data for decisionmaking. The district fosters a culture of support, trust and continuous improvement around data use, with constant communication about the expectations and standards for data use in the district.
1. Essential Elements
The
current set of accepted leadership standards suggest that the ability
to collect, understand, analyze and use data to inform all decisions is
a very important leadership skill needed to increase student
achievement. Standards on data use fit into a larger set of leadership
standards.
For example, the Interstate School Leaders Licensure Consortium (ISLLC) includes these standards related to data use:
- Understand information sources, data collection and data-analysis strategies
- Understand curriculum design, implementation, evaluation and refinement
- Understand measurement, evaluation and assessment strategies
- Understand the change process for systems, organization and individuals
- Understand current technologies that support management functions.
Mid-Continent Research for Education and Learning (McREL), in its report Balanced Leadership, has found that the following data use skills have a statistically significant effect on school improvement:
- Leaders are directly involved in the design and implementation of curriculum, instruction and assessment practices
- Leaders establish clear goals and keeps those goals in the forefront of the school's attention
- Leaders monitor and evaluate the effectiveness of school practices and their impact on student learning
- Leaders are change agents who are willing to and actively challenge the status quo
- Leaders provide contingent rewards that recognize and reward individual accomplishments.
2. Promising Practices
San Diego, California has developed a benchmark assessment system tied to key standards that allows schools to set their own pacing, depending on the needs of their students, but that still holds everyone accountable for measuring and comparing results. The district has instituted a Professional Learning Series for Principals to provide them with specific skills and tools for working with professional learning communities at their schools to use data from multiple sources to adjust instruction on a regular basis.
In addition to this specific example above, detailed effective practices for data use come from the redesigned ISLLC Standards and eight dimensions on effective leadership. Best practices of district central offices and leaders are described below:
- Ensure that a variety of sources of data that illuminate student learning are used in the forging of vision and goals. Data sources include assessment data related to student learning, demographic data pertaining to students and the community, and information on patterns of opportunity to learn.
- Be diligent about providing feedback on performance to colleagues on a consistent basis and in a timely manner. This can include using personal knowledge developed through numerous classroom observations, both informal and formal, and employing a variety of supervisory and evaluation strategies.
- Personally promote a serious attitude about data-based decisionmaking among colleagues.
- Ensure that assessment systems are comprehensive. Assessments address both classroom and school-based activity and a wide variety of monitoring and data collection strategies should be used.
- Ensure that student learning is measured using an assortment of techniques. For example, comprehensive designs often include teacher record keeping systems, end-of-level or end-of-unit reports, student work products, criterion-referenced tests, and standardized measures of student performance.
- Disaggregate information on the important conditions and outcomes of schooling (e.g., program placement of students, test results) by relevant bio-social characteristics of students (e.g., gender, race, class).
- Assist schools in constructing assessment systems in ways that foster the triangulation of data from multiple sources in arriving at judgments about the effectiveness of curricular and instructional programs and organizational operations.
- Ensure that assessment data is at the heart of (a) mission development, (b) instructional planning, (c) the evaluation of the curricular program, (d) the identification of and the design of services for special needs students, (e) monitoring progress on school goals and improvement efforts, and (f) the evaluation of school staff.
- Provide teachers and parents with assessment results on a regular basis.
- Ensure
that professional development opportunities and experiences flow from
data on student achievement, link carefully with district and school
goals, are integrated into the culture of the school, and focus on
student learning.
- Assess leaders' ability to use data for school improvement.
3. Critical Questions
- Does your state have specific education leadership standards? And do those standards include a component for data use? Are district standards aligned to these state standards?
- Has the district defined specifically the data analysis skills required of a high-quality school and district leader? Are those skills embedded in the standards?
- How are school leaders measured against those standards? How are they evaluated on the data use component?
- How are school leaders supported in achieving the standards related to data use? What activities, tools and professional development opportunities are available to school leaders?
- How do district central office staff work with principals to diagnose student achievement in the buildings and develop improvement plans based on that?
- Do districts have access to data in a user-friendly and timely matter to meet the data standards?
4. Resources
Darling-Hammond, Linda, M. LaPointe, D. Myserson, and M. Orr. (2007) Preparing School Leaders for a Changing World: Lessons from Exemplary Leadership Development Programs. Stanford, CA: Stanford University, Stanford Educational Leadership Institute. Summary: The study examines eight exemplary pre- and in-service principal development programs. The study highlights key findings and provides implications for policy and practice and policymakers.
National Center for Education Statistics, U.S. Department of Education. (2004) Forum Guide to Building a Culture of Data Quality: A School & District Resource. Summary: The authors introduce the concept of a "culture of quality data" - "the belief that good data are an integral part of teaching, learning, and managing the school enterprise" - and suggest steps schools and districts can take towards developing that culture, through policies and regulations, standards and guidelines, training and professional development, timelines and calendars, technology systems and a specific data entry environment. One-page tip sheets on the respective roles of principals, teachers, office staff, school board members, superintendents, data coordinators and technology support personnel also are provided.
Celio, M. B., & Harvey, J. (2005). Buried treasure: Developing a management guide from mountains of school data. Seattle, WA: Center on Reinventing Public Education.
Summary: This report attempts to define a model of school management to help school personnel make sense of and use data.
Englert, K., Fries, D., Goodwin, B., & Martin-Glenn, M. (2003). Understanding how superintendents use data in a new environment of accountability. Aurora, CO: Mid-continent Research for Education and Learning. Summary: This article provides findings from a study that examined superintendents' use of assessment and accountability systems. The study aimed to better understand the assessment and accountability practices and policies superintendents are implementing and to examine whether the policies simply comply with the No Child Left Behind Act or are also effective in furthering school and student improvement.
Knapp, M. S., Swinnerton, J. A., Copland, M. A., et. al. (2006). Data-informed leadership in education. Center for the Study of Teaching and Policy, University of Washington.Summary: This article synthesizes and interprets ideas, frameworks, beliefs, and activities regarding the use of data in educational decision making. The concept of data-informed leadership relates to the availability, quality and use of data among school leaders in order to improve teaching and learning. The broader focus on leadership, rather than just data-based decision making, captures a wide range of purposes data can serve for leaders. This article reviews common practices and emerging strategies that support leaders’ use of data on the state, district, and school levels.
Wayman, J. C., Cho, V., & Johnston, M. T. (2007). The data-informed district: A district-wide evaluation of data use in the Natrona County School District. Austin: The University of Texas. Summary: This report summarizes findings from a district-wide evaluation of data use and data practices. Drawing on interview and survey data, the study examines the culture, expectations, and use of data at every level of the Natrona County School District. The report highlights key findings on data use, opinions, and technological resources. Based on their findings, the researchers provide a set of recommendations to assist the school district in establishing a plan for useful, effective data use. The report also includes an appendix written by district personnel which captures their reactions, current efforts, and future plans 90 days after receiving the report.