Futurology

1814 readers

29 users here now

founded 1 year ago

MODERATORS

109

submitted 1 year ago by Lugh to c/futurology

14 comments fedilink hide all child comments

Its interesting to see so much investor money chase AI unicorns at the moment. Something tells me many of them might be making the wrong bets.

you are viewing a single comment's thread
view the rest of the comments

[–] ForgetPrimacy@lemmygrad.ml 2 points 1 year ago (3 children)

I'd like to set up Llama 2 on my system, is there an LLM community on Lemmy yet or do I just need to dive in deep and dark?

[–] Zeth0s@lemmy.world 3 points 1 year ago (1 children)

Reddit r/LocalLLaMA is the best place to start. AI communities on lemmy are too small

[–] ForgetPrimacy@lemmygrad.ml 1 points 1 year ago (1 children)

I'm still avoiding reddit out of principle, might check on that eventually but I'll make at least a token effort to find the answers elsewhere first.

[–] Zeth0s@lemmy.world 2 points 1 year ago

If you are comfortable with python, check huggingface.

To see how to set up a gui, check https://github.com/camenduru/text-generation-webui-colab to test models on colab.

You can copy the commands there and adapt to have it locally

[–] HellAwaits@lemm.ee 2 points 1 year ago

Dive deep and dark with blindfolds.

[–] the_artic_one@programming.dev 2 points 1 year ago (1 children)

!localllama@sh.itjust.works

[–] ForgetPrimacy@lemmygrad.ml 1 points 1 year ago

Perfect! Exactly the resource I was hoping for!

My dinosaur machines might barely be able to cope with the smallest model... maybe... it'll be fine.