Selfhosted

51273 readers

692 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
No spam posting.
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
No trolling.

Resources:

selfh.st Newsletter and index of selfhosted software and apps
awesome-selfhosted software
awesome-sysadmin resources
Self-Hosted Podcast from Jupiter Broadcasting

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 2 years ago

MODERATORS

HybridSarcasm@lemmy.world

HybridSarcasm@lemmy.hybridsarcasm.xyz

210

1U mini PC for AI? (startrek.website)

submitted 1 week ago by nagaram@startrek.website to c/selfhosted@lemmy.world

67 comments fedilink hide all child comments

My rack is finished for now (because I'm out of money).

Last time I posted I had some jank cables going through the rack and now we're using patch panels with color coordinated cables!

But as is tradition, I'm thinking about upgrades and I'm looking at that 1U filler panel. A mini PC with a 5060ti 16gb or maybe a 5070 12gb would be pretty sick to move my AI slop generating into my tiny rack.

I'm also thinking about the PI cluster at the top. Currently that's running a Kubernetes cluster that I'm trying to learn on. They're all PI4 4GB, so I was going to start replacing them with PI5 8/16GB. Would those be better price/performance for mostly coding tasks? Or maybe a discord bot for shitposting.

Thoughts? MiniPC recs? Wanna bully me for using AI? Please do!

(page 2) 18 comments

sorted by: hot top controversial new old

[–] muppeth@scribe.disroot.org 1 points 1 week ago (1 children)

Wow! very cool rack you got there. I too started using mini pcs for local test servers or general home servers. But unlike yours mine are just dumped behind the screen on my desk (3 in total). For LLM stuff atm I use 16GB radeon but thats connected to my desktop. In the future I would love to build a proper rack like yours and perhaps move the GPU to a dedicated minipc.

As for the upgrades, like what others stated already, I would just go for more pc's rather then rpi.

[–] nagaram@startrek.website 1 points 1 week ago (4 children)

The PIs were honestly because I had them.

I think I'd rather use them for something else like robotics or a Birdnet pi.

But the pi rack was like $20 and hilarious.

The objectively correct answer for more compute is more mini PCs though. And I'm really thinking about the Mac Mini option for AI.

load more comments (4 replies)

[–] Melvin_Ferd@lemmy.world 1 points 1 week ago (3 children)

The AI hate is overwhelming at times. This is great. What kind of things are you doing with it?

load more comments (3 replies)

[–] Flax_vert@feddit.uk 1 points 1 week ago* (last edited 1 week ago) (1 children)

A single raspberry pi 5 can host an entire website

[–] nagaram@startrek.website 2 points 1 week ago (1 children)

True, but I have an addiction and that's buying stuff to cope with all the drawbacks of late stage capitalism.

I am but a consumer who must be given reasons to consume.

[–] Flax_vert@feddit.uk 1 points 1 week ago

Scatter them about the place. Make appliances smart. Would be more interesting than a cluster.

load more comments