Donate

Dr ChatGPT about as reliable as Dr Google

Publicly released:
International
CC:0 ChatGPT is "not reliable as a diagnostic tool", providing correct diagnoses from real case information just half the time, with researchers cautioning the general public against relying upon the tool for medical advice.
CC:0 ChatGPT is "not reliable as a diagnostic tool", providing correct diagnoses from real case information just half the time, with researchers cautioning the general public against relying upon the tool for medical advice.

Canadian researchers say we really shouldn't trust ChatGPT for answers to our medical questions. They asked the AI to answer 150 Medscape case challenges - a series of diagnostic problems for doctors - and found it was only able to answer just shy of half of them correctly. Additionally, ChatGPT was not very sensitive in its answers, and was overly complicated in half of its responses, as well as only providing complete and relevant answers just over half of the time.

Journal/
conference: PLOS ONE
Research:Paper
Organisation/s: Western University, Canada
Funder: The author(s) received no specific funding for this work.
Media Contact/s
Contact details are only visible to registered journalists.

More News

5 hours ago

Covid vaccines safe four years on, first long-term study suggests

International EPI-PHARE Scientific Interest Group in Epidemiology of Health Products from the French National Agency for the Safety of Medicines and Health Products and the French National Health Insurance JAMA Network Open
5 hours ago

COVID-19 may be new, but long COVID follows a long-term historical trend

International Yale University, USA Trends in Immunology
8 hours ago

1.7 million Australians were living with migraine in 2022

Australia Australian Institute of Health and Welfare (AIHW)