Meetings
Resources and Publications
Technical Issues in Large-Scale Assessment (TILSA) is part of the State Collaborative on Assessment and Student Standards (SCASS) project whose mission is to provide leadership, advocacy, and service by focusing on critical research in the design, development, and implementation of standards-based assessment systems that measure the achievement of all students.
TILSA addresses state needs for technical information about large-scale assessment by
- providing structured opportunities for members to share expertise, learn from each other, and network on technical issues related to valid, reliable, and fair assessment
- designing and carrying out research that reflects common needs across states
- arranging presentations by experts in the field of educational measurement on current issues affecting the implementation and development of state programs
- developing handbooks and guidelines for implementing various aspects of standards-based assessment systems
This long-standing partnership has conducted a wide variety of research over the years into critical issues affecting the technically-sound administration of K-12 assessments, including research on equating, setting cut-scores, consequential validity, generalizability theory, use of multiple measures, alignment of assessments to standards, accommodations, assessing English language learners, and the reliability of aggregate data. In addition, TILSA has provided professional development in critical topics in measurement for its members. The partnership has developed technical reports on each topic it researched. In addition, TILSA has produced guidelines for developing state assessment programs. Funding is currently provided from $17,000 annual state participation fees.
Participating States for 2007-2008
|
Arizona |
Florida |
Louisiana |
South Carolina |
|
| California |
Georgia |
Michigan |
Tennessee |
|
| Connecticut |
Hawaii |
Minnesota |
West Virginia |
|
| Delaware |
Kansas |
Missouri |
Wisconsin |
|
| DoDEA |
Kentucky |
Pennsylvania |
|
|
Project Leadership
Doug Rindone, co-Coordinator, 413.626.9114, drin47[at]aol.com
Duncan MacQuarrie, co-Coordinator, 360.753.0739, duncanm[at]consultant.ccsso.org
TILSA Leadership Team
| Fen Chou, Louisiana |
Scott Norton, Louisiana |
| Laura Kraner, North Carolina |
Ellen Hedlund, Rhode Island |
| Michael Muenks, Missouri |
|
Major Accomplishments in 2006-2007
In 2006-2007, TILSA members received professional development on the validity of state assessment systems and state-supported interim assessments and discussed current issues in Title I assessment and accountability requirements with representatives of the USED. During the year, the consortium finalized three projects:
- Computer-Based Testing – TILSA developed the content and structure of a decision making tool to assist states and districts in implementing computer-based assessments. The tool is available to states at http://www.ccsso-cbtool.com.
- Reporting Subscore Information from Large-Scale Assessments – TILSA conducted research to evaluate the results of two augmentation methods for reporting student subscores from K-12 achievement tests. As part of this project, the consortium developed a computer program that will create subscores using either method. The research report and computer program will be available in spring 2007.
- Vertical Scaling and Growth Models – TILSA developed a paper that discusses vertical scaling techniques and options for various purposes, including for use in accountability models that incorporate growth over time.The paper will be posted on the TILSA website in spring, 2007.
The consortium also worked with leading researchers in the field of educational measurement, focusing on four new topics:
- Comparability of Test Variations – With North Carolina serving as the lead state, TILSA is participating in a study of developing and evaluating variations of state assessments that are designed to measure the same achievement standards as the general assessment (translations, computer-delivered, plain language, and alternative formats such as portfolios. The research project is scheduled to continue through summer, 2009.
- Equating – TILSA is developing a handbook on equating topics and addressing common issues, designed for state assessment staff and policymakers involved in developing and administering standards-based assessments.A draft of sections of the handbook will be discussed in June, 2007.
- Interim Assessments – TILSA is producing a paper on the evaluation and use of interim assessments as part of comprehensive assessment systems, which will include recommendations for selecting or developing interim assessments and case studies of districts using such assessments. The detailed plan for this research will be finalized in June, 2007.
- Validity of State Assessments – The consortium will develop a research-based paper on examining the validity of selected components of state assessment systems. An outline of the paper will be finalized in June 2007.
Anticipated Needs Fulfilled in 2007-2008
In 2007-2008, the consortium will continue work on the four topics described above and address additional topics through research and professional development, based on member needs.
Chiefline
