this post was submitted on 08 Jan 2025
91 points (91.0% liked)

Technology

60342 readers
5176 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 2 years ago
MODERATORS
L3s@lemmy.world
enu@lemmy.world
technopagan@lemmy.world
91
Orbit by Mozilla (orbitbymozilla.com)
submitted 1 day ago* (last edited 1 day ago) by umami_wasbi@lemmy.ml to c/technology@lemmy.world
23 comments fedilink hide all child comments
 

New Mozilla AI project. Put "trust" and "privacy" in the title and subtile but doesn't support locally hosted model.

Exists as an add-on today. Model is Mistral 7B hosted by Mozilla in GCP. Claims won't save data long term. Promises won't use personal information to train models and not share queries with Mistral or any other services.

Am I going to use it? No. Not without local model supported.

Note: the mobile version of the page is broken (lack of many content). Best to view the desktop version for complete details.

you are viewing a single comment's thread
view the rest of the comments
[โ€“] masterofn001@lemmy.ca 23 points 1 day ago* (last edited 1 day ago) (1 children)

Edit: added a couple things to enable it on desktop (Linux)

Go to: about:config

Set
browser.ml.enable true
browser.ml.chat.enabled true
browser.ml.chat.hideLocalhost false

Then go to: about:inference

You can set the endpoint to your localhost or any server.

Open sidebar and select AI chatbot. Select localhost option and follow prompts

Note: I will never use this, I just wanted to know. Anyway, here are the docs

https://firefox-source-docs.mozilla.org/toolkit/components/ml/index.html

https://firefox-source-docs.mozilla.org/toolkit/components/ml/api.html

screenshots This is on nightly on mobile

[โ€“] simple@lemm.ee 3 points 1 day ago

Awesome, thank you