note, I think models used for finding cures to diseases and other sciences are a good thing. I'm referring to the general populace LLM hype
The good news: These models are never LLMs, because LLMs can never be anything else than bullshit generators.
The bad news: The first studies of actual performance seem to indicate a similar pattern in hospitals to what is seen with the AI hype all the time: While people often perceive themselves to be more efficient, actual efficiency might in fact drop. It turns out that four Polish hospitals that started using machine learning models to detect cancer actually found fewer instances of cancer as a result, not more. It might of course improve as the technology gets better, and it could supplement instead of replace human expertise. But the story "AI is amazing for detecting cancer" is sadly not as clear-cut as we have been lead to believe.
Edit: read comments below!