this post was submitted on 17 Nov 2025
22 points (92.3% liked)
Linux and Tech News
2440 readers
58 users here now
This is where all the News about Linux and Linux adjacent things goes. We'll use some of the articles here for the show! You can watch or listen at:
You can also get involved at our forum here on Lemmy:
Or just get the most recent episode of the show here:
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
That's assuming the AI won't look at the results and still make shit up. I've used AI-assisted search and i know that it's not reliable.
Ok how would that work:
find me some good recipes for hibachi style ginger butterAI model returns 10 links, 4 of which don't actually exist (because it hallucinated them)? No. If they didn't exist, it wouldn't have returned them because it wouldn't have been able to load those URLs.
It's possible that it could get it wrong because of some new kind of LLM scamming method but that's not "making shit up" it's malicious URLs.
And yet I've had Bing's Copilot/ChatGPT (with plugins like Consensus), Gemini, and Perplexity do exactly that, but worse. Sometimes they'll cite sources that don't mention anything related to the answer they've provided because the information they're giving is based on some other training data they can't source. They were asked to provide a source, but won't necessarily give you the source. Hell, sometimes they'll answer an adjacent just to spit out an answer--any answer--to fulfill the request.
LLMs are simply not the appropriate tool for the job. This is most obvious when you need the specificity and accuracy.
Yeah... The big commercial models have system prompts that fuck it all up. That's my hypothesis, anyway.
You have to try it with an open source model. You tell it to turn the titles, URLs, and nothing else. That seems to work fantastic 👍
I'm doing it with Open WebUI and ollama cloud which is open source models that you could run locally—if you have like $5,000 worth of hardware.
Interesting. I have a couple automations in mind, I'll have to try it out, then.