Computer ScienceFindings of the Association for Computational Linguistics: ACL 2025

BESSTIE: A Benchmark for Sentiment and Sarcasm Classification for Varieties of English

D. Srirag, A. Joshi, et al.

BESSTIE introduces the first labelled benchmark for sentiment and sarcasm across three English varieties (en-AU, en-IN, en-UK), built from Google Places reviews and Reddit comments with manual and automatic validation. Nine large language models were fine-tuned and evaluated, revealing consistent advantages on inner-circle varieties (en-AU, en-UK) and challenges in cross-variety generalisation—especially for sarcasm. Research conducted by Dipankar Srirag, Aditya Joshi, Jordan Painter, and Diptesh Kanojia. Dataset available on Hugging Face.... show more

Related Publications

Explore these studies to deepen your understanding

Adjacent work that informs or extends this paper's methodology and findings.

Linguistics and Languages

The effectiveness of ChatGPT as a lexical tool for English, compared with a bilingual dictionary and a monolingual learner's dictionary

R. Lew, B. Ptasznik, et al.

Political Science

The national security law for Hong Kong: a corpus-driven comparative study of media representations between China's and Anglo-American English-language press

Z. Hou and Q. Peng

Medicine and Health

Fostering a healthy public for men and HIV: a case study of the Movement for Change and Social Justice (MCSJ)

C. J. Colvin, M. V. Pinxteren, et al.

Biology

Neuroimaging the effects of smartphone (over-)use on brain function and structure-a review on the current state of MRI-based findings and a roadmap for future research

C. Montag and B. Becker

Listen, Learn & Level Up

Over 10,000 hours of research content in 25+ fields, available in 22+ languages.

No more digging through PDFs, just hit play and absorb the world's latest research in your language, on your time.

listen to research audio papers with researchbunny