this post was submitted on 01 Jun 2024
396 points (98.3% liked)
Technology
69247 readers
3761 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Have a look at self hosted alternatives like Ollama in combination with Open-webui. It can be a hassle to set up, or even excruciatingly painful if you never touched a computer before, but it could be worth a try. I use it daily and like it much more than chatgpt to be honest.
You can literally run large language models with a single exe download: https://github.com/Mozilla-Ocho/llamafile
It doesn't get much simpler than that.
is the perfect description
Thanks!
I wish I did. What local model and version of ChatGPT did you compare?
For my purposes, ChatGPT 4 was leagues ahead of the largest model I could run on a 1060.
I like the gemma models bc of the phrasing they use and that they give sources sometimes. The best results though come from llama3 I think. Also openhermes and openchat, which perform well enough for my purposes.
In the beginning i had used microsoft phi, that wasn't that good though.
I will have to give it another shot because I don't recognize any of those models meaning I probably didn't try them.