this post was submitted on 29 Aug 2025
1 points (100.0% liked)

Reddit Science

146 readers
2 users here now

This community is a place to share and discuss new scientific research. Read about the latest advances in astronomy, biology, medicine, physics,...

founded 2 years ago
MODERATORS
bot@lemmit.online
1
Commercial LLMs (GPT-4o, Gemini 1.5 Pro-002, Llama 3.1 8B Instruct), including after finetuning, showed poor average generalization accuracy (21-42%) when attempting to answer medical questions re... (ai.nejm.org)
submitted 2 months ago by bot@lemmit.online to c/science@lemmit.online
0 comments fedilink hide all child comments
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/science by /u/ddx-me on 2025-08-29 21:34:07+00:00.

Original Title: Commercial LLMs (GPT-4o, Gemini 1.5 Pro-002, Llama 3.1 8B Instruct), including after finetuning, showed poor average generalization accuracy (21-42%) when attempting to answer medical questions related to new drugs or updated recommendations

no comments (yet)
sorted by: hot top controversial new old
there doesn't seem to be anything here