Education

Evaluating the role of ChatGPT in enhancing EFL writing assessments in classroom settings: A preliminary investigation

J. Li, J. Huang, et al.

This exciting study explores how ChatGPT can enhance English-as-a-foreign-language writing assessments. By analyzing holistic scores and qualitative feedback from ChatGPT versions 3.5 and 4 alongside college teachers, researchers found that both AI tools provide more relevant feedback on language, content, and organization. Conducted by authors Junfei Li, Jinyan Huang, Wenyan Wu, and Patrick B. Whipple, this research may redefine how we approach EFL writing evaluations.

00:00

Playback language: English

Index

Abstract

This study evaluated ChatGPT's role in enhancing English-as-a-foreign-language (EFL) writing assessments using generalizability (G-) theory and qualitative feedback analysis. The reliability of holistic scores assigned by ChatGPT versions 3.5 and 4, compared to college English teachers, and the relevance of their qualitative feedback were assessed. Analysis of 30 CET-4 essays revealed that ChatGPT 3.5 had lower reliability than teachers, while ChatGPT 4 showed higher reliability. Both ChatGPT versions provided more relevant feedback than teachers, focusing equally on language, content, and organization, unlike teachers who prioritized language. ChatGPT versions 3.5 and 4 are suggested as useful AI tools for enhancing EFL writing assessments.

Publisher

Humanities and Social Sciences Communications

Published On

Sep 27, 2024

Authors

Junfei Li, Jinyan Huang, Wenyan Wu, Patrick B. Whipple

Related Publications

Explore these studies to deepen your understanding of the subject.

Education

The role of teacher patience in the implementation of assessment for learning (AfL): Vignettes from a writing classroom

X. Zhang

Education

Enhancing pre-service teachers' classroom management competency in a large class context: the role of fully immersive virtual reality

L. Li, Y. Hu, et al.

Business

Bridging the financial divide: a bibliometric analysis on the role of digital financial services within FinTech in enhancing financial inclusion and economic development

M. Afjal

Social Work

The role of leisure activities in enhancing well-being in Saudi's retired community: a mixed methods study

H. M. N. Alanazi

Listen, Learn & Level Up

Over 10,000 hours of research content in 25+ fields, available in 12+ languages.

No more digging through PDFs, just hit play and absorb the world's latest research in your language, on your time.

listen to research audio papers with researchbunny