logo
Loading...
SemEval-2024 Task 6: SHROOM, a Shared-task on Hallucinations and Related Observable Overgeneration Mistakes
Computer ScienceProceedings of the 18th International Workshop on Semantic Evaluation (SemEval-2024)

SemEval-2024 Task 6: SHROOM, a Shared-task on Hallucinations and Related Observable Overgeneration Mistakes

T. Mickus, E. Zosa, et al.

SHROOM presents a shared task on detecting hallucinations—fluent but inaccurate NLG outputs—using a newly constructed dataset of 4,000 model outputs labeled by five annotators across machine translation, paraphrase generation, and definition modeling. The research was conducted by Timothee Mickus, Elaine Zosa, Raúl Vázquez, Teemu Vahtola, Jörg Tiedemann, Vincent Segonne, Alessandro Raganato, and Marianna Apidianaki.... show more
GeneralSummaryMetrics
Introduction
Literature Review
Methodology
Key Findings
Discussion
Conclusion
Limitations
Related Publications

Explore these studies to deepen your understanding

Adjacent work that informs or extends this paper's methodology and findings.

Why and when does multitasking impair flow and subjective performance? A daily diary study on the role of task appraisals and work engagement
Business

Why and when does multitasking impair flow and subjective performance? A daily diary study on the role of task appraisals and work engagement

H. Pluut, M. Darouei, et al.

Auditory Discrimination-A Missing Piece of Speech and Language Development: A Study on 6-9-Year-Old Children with Auditory Processing Disorder
Medicine and Health

Auditory Discrimination-A Missing Piece of Speech and Language Development: A Study on 6-9-Year-Old Children with Auditory Processing Disorder

A. Guzek and K. Iwanicka-pronicka

Designing for Passengers' Information Needs on Fellow Travelers: A Comparison of Day and Night Rides in Shared Automated Vehicles
Transportation

Designing for Passengers' Information Needs on Fellow Travelers: A Comparison of Day and Night Rides in Shared Automated Vehicles

L. A. Flohr, M. Schuß, et al.

Shared motivations, goals and values in the practice of personal science: a community perspective on self-tracking for empirical knowledge
Health and Fitness

Shared motivations, goals and values in the practice of personal science: a community perspective on self-tracking for empirical knowledge

E. S. Hidalgo, M. P. Ball, et al.

Listen, Learn & Level Up
Over 10,000 hours of research content in 25+ fields, available in 22+ languages.
No more digging through PDFs, just hit play and absorb the world's latest research in your language, on your time.
listen to research audio papers with researchbunny