109
Llama 2 is about as factually accurate as GPT-4 for summaries and is 30X cheaper.
(www.anyscale.com)
this post was submitted on 27 Aug 2023
109 points (96.6% liked)
Futurology
1814 readers
29 users here now
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Reddit r/LocalLLaMA is the best place to start. AI communities on lemmy are too small
I'm still avoiding reddit out of principle, might check on that eventually but I'll make at least a token effort to find the answers elsewhere first.
If you are comfortable with python, check huggingface.
To see how to set up a gui, check https://github.com/camenduru/text-generation-webui-colab to test models on colab.
You can copy the commands there and adapt to have it locally