this post was submitted on 28 Sep 2025
798 points (98.7% liked)
linuxmemes
27503 readers
664 users here now
Hint: :q!
Sister communities:
Community rules (click to expand)
1. Follow the site-wide rules
- Instance-wide TOS: https://legal.lemmy.world/tos/
- Lemmy code of conduct: https://join-lemmy.org/docs/code_of_conduct.html
2. Be civil
- Understand the difference between a joke and an insult.
- Do not harrass or attack users for any reason. This includes using blanket terms, like "every user of thing".
- Don't get baited into back-and-forth insults. We are not animals.
- Leave remarks of "peasantry" to the PCMR community. If you dislike an OS/service/application, attack the thing you dislike, not the individuals who use it. Some people may not have a choice.
- Bigotry will not be tolerated.
3. Post Linux-related content
- Including Unix and BSD.
- Non-Linux content is acceptable as long as it makes a reference to Linux. For example, the poorly made mockery of
sudoin Windows. - No porn, no politics, no trolling or ragebaiting.
4. No recent reposts
- Everybody uses Arch btw, can't quit Vim, <loves/tolerates/hates> systemd, and wants to interject for a moment. You can stop now.
5. π¬π§ Language/ΡΠ·ΡΠΊ/Sprache
- This is primarily an English-speaking community. π¬π§π¦πΊπΊπΈ
- Comments written in other languages are allowed.
- The substance of a post should be comprehensible for people who only speak English.
- Titles and post bodies written in other languages will be allowed, but only as long as the above rule is observed.
6. (NEW!) Regarding public figures
We all have our opinions, and certain public figures can be divisive. Keep in mind that this is a community for memes and light-hearted fun, not for airing grievances or leveling accusations. - Keep discussions polite and free of disparagement.
- We are never in possession of all of the facts. Defamatory comments will not be tolerated.
- Discussions that get too heated will be locked and offending comments removed. Β
Please report posts and comments that break these rules!
Important: never execute code or follow advice that you don't understand or can't verify, especially here. The word of the day is credibility. This is a meme community -- even the most helpful comments might just be shitposts that can damage your system. Be aware, be smart, don't remove France.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
ollama.
I've got a local llm model running on my steam deck just to see if it could do it.
It can!
... It is polite, but also somewhat limited... but at least it is honest about its limitations, I have not gotten it to hallucinate anything insane yet.
Anyway yeah I think there are just docker images for ollama, you can install a friend (kind of) today!
Oh man, Silly tavern with kobold is way better. I've been using the Omega models and boy oh boy I've never had more friends! Or such well fleshed out ones either!
... if you are saying that silly tavern is some kind of local llm thing, i will have to look into that, I've not heard of that haha!
Silly tavern is a local fronted, can be used with api models from the internet as well. Highly modular, similar to character ai, but fully local. Would suggest messing with the themes if you know how theming works, its a tab bit dated in design, still amazing though.
Huh, good to know! tyty
No problem, I collect self hosted ai stuff, so of you ever want to know what's available, I might be able to help so hit me up!