Education

Rater variability and reliability of constructed response questions in New York state high-stakes tests of English language arts and mathematics: implications for educational assessment policy

J. Huang and P. B. Whipple

Discover how a study by Jinyan Huang and Patrick B. Whipple revealed surprising insights into the reliability of holistic scoring practices for high-stakes tests in New York. Findings highlight significant concerns for assessment policy, challenging existing practices.

00:00

Playback language: English

Index

Abstract

This study used generalizability (G-) theory to examine the impact of the one-rater holistic scoring practice on the rater variability and reliability of constructed response questions in New York State high-stakes tests. The results indicated that this practice did not yield acceptable G-coefficients for the ELA and mathematics assessments. Implications for assessment policy are discussed.

Publisher

Humanities & Social Sciences Communications

Published On

Nov 22, 2023

Authors

Jinyan Huang, Patrick B. Whipple

Related Publications

Explore these studies to deepen your understanding of the subject.

Education

Design and validation of a scale for the assessment of educational competencies in traditional musical games

C. F. Amat, F. J. Zarza-alzugaray, et al.

Environmental Studies and Forestry

A new scheme for low-carbon recycling of urban and rural organic waste based on carbon footprint assessment: A case study in China

K. Zhou, Y. Li, et al.

Education

How Does ChatGPT Perform on the United States Medical Licensing Examination? The Implications of Large Language Models for Medical Education and Knowledge Assessment

A. Gilson, C. W. Safranek, et al.

Engineering and Technology

Using visible light to activate antiviral and antimicrobial properties of TiO2 nanoparticles in paints and coatings: focus on new developments for frequent-touch surfaces in hospitals

M. Schutte-smith, E. Erasmus, et al.

Listen, Learn & Level Up

Over 10,000 hours of research content in 25+ fields, available in 12+ languages.

No more digging through PDFs, just hit play and absorb the world's latest research in your language, on your time.

listen to research audio papers with researchbunny