Nice! Good sublemmy to follow! (Is sublemmy the right word)
Thanks for the tips! I just started playing around with ollama so I think the self hosting route is next.
Nice! Good sublemmy to follow! (Is sublemmy the right word)
Thanks for the tips! I just started playing around with ollama so I think the self hosting route is next.
I was kinda doing it wrong. When I download the model it was very slow. But now that I’m using the model my inquires are done at an ok speed (10-30sec depending on what I ask)
Interesting that you need stronger GPU instead of CPU? Can you tell I know next to nothing about tech ….
I just started messing around with ollama. I must be doing something wrong because it’s sooooo slow. I still need to trouble shot it a lil bit before it becomes my main AI.
Sheesh, that sounds like a Black Mirror episode. I know a majority of my info/data now is most likely compromised, but moving forward I can make a difference. Also, I can prep these tools for the young ones in my family who aren’t on the internet yet.
I definitely need some advice for self hosting! I literally have no idea what I’m doing. I have a raspberry pi and another user said that may be enough to get started.
Could you share some videos or links or blogs that explain how to get started?
That does slightly concern me that ddg is linked to Microsoft. If I’m going thru all this trouble to make my life more private then I believe I need to cut out the major companies as well.
Perfect, I’ll check that out!
Most likely. I just heard of it from this post.
Your like the 4th person to recommend libreoffice. That’s at the top of my list now.
I’ll prolly go with libre then since they have the best options that are private. And i have a PC so those Mac options won’t work for me.
Oh bet. I didn’t see that. That’s basically free in my book. Have you used that one before, and if so do you like it compared to the OGs (google maps, Apple Maps)
Gotta be honest, idk what half of the words you just said mean. Core count, vram… still have some learning to do.
My plan is to run ollama on my rig kinda like a server I guess. And then Use my phone to tap into that whenever I need it. From what I researched that seems doable, but will take some set up.