Print this Page


Technical Issues in Large Scale Assessment (TILSA)

The Technical Issues in Large Scale Assessment (TILSA) State Collaborative on Assessment and Student Standards (SCASS) is comprised primarily of state assessment directors, data analysts, and psychometricians. The group of approximately 32 states and 15 partners works on a variety of technical topics states are facing with their summative assessments. Expert speakers are invited to present on current and future topics such as scoring technology-enhanced items and moving toward automated item generation. As technical issues intersect with federal policy, we also discuss the local assessment option in the Every Student Succeeds Act (ESSA) and the peer review submissions. The group shares resources and discusses successes and challenges.

During 2016-2017 school year, the TILSA SCASS pursued the following topics:

Goals for the 2017-2018 school year include:

  • Exploring possibilities of using telemetry to detect cheating, determine patterns of response, and perhaps provide additional data to determine student ability
  • Partnering with the Science SCASS to develop innovative item types specific to multi-dimensional science standards
  • Exploring how advances in gaming might be applied to state summative or interim assessments
  • Staying up-to-date on the latest research in developing, scoring, and interpreting assessments of writing, speaking, and listening
  • Examining how tools used in mathematics assessment might be improved to make the student assessment experience more natural

Advisor: Juan D'Brot

Juan D'Brot is a Senior Associate at the Center for Assessment. He has led and contributed to work on developing ESSA-aligned accountability systems, growth models, exploring graduation options for students based on local legislation, peer review submissions, and revising readiness assessments for educational organizations and numerous states and jurisdictions. His work interests include assessment and accountability technical and policy issues, assessment and accountability design and implementation, measures of student growth, standard setting, educator accountability systems, and impact evaluation of policy and programs. Juan is especially interested in helping states and educational entities solve intricate problems in assessment and accountability design and implementation that often result from an intersection of policy, technical, and practical issues while navigating complex relationships between agencies.

Prior to joining the Center, Juan was the Senior Director of Research at Data Recognition Corporation, where he provided leadership and assessment vision as the liaison between DRC Research and other departments to develop and disseminate strategic and technology-based solutions aligned to DRC's assessment programs. He was also responsible for designing, computing, and evaluating all traditional and IRT statistical analyses, including defining, managing, and monitoring all psychometric analyses. Previously, he served as the Director of Strategic Research Solutions for CTB and as the Executive Director of Assessment, Accountability, Research, and Evaluation for the state of West Virginia. 

Contact:Adam Petermannadam.petermann@ccsso.org202-336-7076