this post was submitted on 05 Sep 2025
648 points (99.4% liked)

Technology

74900 readers
1924 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] Treczoks@lemmy.world 20 points 3 days ago (1 children)

The point is that this is all happening in a cloud. One that is probably located in the US. Not a good thing for a non-US government to send potentially confidential or even secret data to.

[–] sugar_in_your_tea@sh.itjust.works 3 points 3 days ago (2 children)

It doesn't have to, you can run LLMs locally. We do at my org, and we only have a few dozen people using it, and it's running on relatively modest hardware (Mac Mini for smaller models, Mac Studio for larger models).

[–] squaresinger@lemmy.world 5 points 2 days ago (1 children)

Yeah, shitty toy ones. This here is about productivity, not about a hobby. And not even real state-of-the-art models were able to actually give a productivity advantage.

Our self-hosted ones are quite good and get the job done. We use them a lot for research, and it seems to do a better job than most search engines. We also link it to internal docs and it works pretty well for that too.

If you run a smaller model at home because you have limited RAM, yeah, you'll have less effective models. We can't run the top models on our hardware, but we can run much larger models than most hobbyists. We've compared against the larger commercial models, and they work well, if little slowly.

[–] themurphy@lemmy.ml 4 points 3 days ago (1 children)

Yeah.. You do it, but do you think the UK government does?

My point is they could if they were concerned about data leaks.