Technology

59641 readers

2671 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago

MODERATORS

530

Rabbit was once an NFT company that it wants you to forget about (www.xda-developers.com)

submitted 6 months ago by FlyingSquid@lemmy.world to c/technology@lemmy.world

87 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] Knock_Knock_Lemmy_In@lemmy.world 2 points 6 months ago (1 children)

I think there may be a market for an LMM that is executed locally and privately incorporates personal data.

[–] cley_faye@lemmy.world 2 points 6 months ago

Yes, there is. And yes, it would be huge. I know a lot of people that are staying away from all this as long as the privacy issues are not resolved (there are other issues, but at this point, the cat is out of the bag).

But running large models locally requires a ton of resource. It may become a reality in the future, but in the meantime allowing more, smaller provider to provide a service (and a self-hosted option, for corporation/enthusiasts) is way better in term of resources usage. And it's already a thing; what needs work now is improving UI and integrations.

In fact, very far from the "impressive" world of generated text and pictures, using LLM and integrations (or whatever it is called) to create a sort of documentation index that you can query with natural language is a very interesting tool that can be useful for a lot of people, both individual and in corporate environment. And some projects are already looking that way.

I'm not holding my breath for portable, good, customized large models (if only for the economics of energy consumption) but moving away from "everything goes to a third party service provider" is a great goal.