Medicine and Health

Reliability and accuracy of artificial intelligence ChatGPT in providing information on ophthalmic diseases and management to patients

F. Cappellani, K. R. Card, et al.

This study evaluated the accuracy of ophthalmic information provided by ChatGPT version 3.5, revealing a mix of promising insights and potential dangers. Researchers Francesco Cappellani, Kevin R. Card, Carol L. Shields, Jose S. Pulido, and Julia A. Haller discovered that while 77.5% of responses were acceptable, a significant portion provided incomplete or harmful information, emphasizing the critical need for human oversight in medical contexts.

00:00

Playback language: English

Index

Abstract

This study assessed the accuracy of ophthalmic information provided by ChatGPT version 3.5. Five diseases from eight ophthalmology subspecialties were evaluated using three questions per disease (definition, diagnosis, treatment). Responses were graded (-3 to 2) against American Academy of Ophthalmology (AAO) guidelines. 77.5% of the 120 questions scored ≥1, but 22.5% scored ≤-1, with 7.5% scoring -3 (potentially harmful). While ChatGPT showed promise, it provided incomplete, incorrect, and potentially dangerous information, highlighting the need for human medical supervision.

Publisher

Eye

Published On

Authors

Francesco Cappellani, Kevin R. Card, Carol L. Shields, Jose S. Pulido, Julia A. Haller

Related Publications

Explore these studies to deepen your understanding of the subject.

Medicine and Health

Pulmonary expansion manoeuvres compared to usual care on ventilatory mechanics, oxygenation, length of mechanical ventilation and hospital stay, extubation, atelectasis, and mortality of patients in mechanical ventilation: A randomized clinical trial

K. D. Silva, C. Cristino, et al.

Economics

Economic and legal approaches to the humanization of FinTech in the economy of artificial intelligence through the integration of blockchain into ESG Finance

O. P. Kazachenok, G. V. Stankevich, et al.

Medicine and Health

An Emerging Health Crisis in Turkey and Syria after the Earthquake Disaster on 6 February 2023: Risk Factors, Prevention and Management of Infectious Diseases

M. M, M. S, et al.

Computer Science

Navigating the perils of artificial intelligence: a focused review on ChatGPT and responsible research and innovation

A. Polyportis and N. Pahos

Listen, Learn & Level Up

Over 10,000 hours of research content in 25+ fields, available in 12+ languages.

No more digging through PDFs, just hit play and absorb the world's latest research in your language, on your time.

listen to research audio papers with researchbunny