this post was submitted on 03 Feb 2025
1 points (100.0% liked)

Technology

38083 readers
429 users here now

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:


This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 3 years ago
MODERATORS
 

Want to find out if the text you’re reading online was written by an real human or spat out by a large language model (LLM) trying to sound like one? Mozilla’s Fakespot Deepfake Detector Firefox add-on may can help give you an indication. Similar to online AI detector tools, the add-on can analyse text (of 32 words or more) to identify patterns, traits, and tells common in AI generated or manipulated text. It uses Mozilla’s proprietary ApolloDFT engine and a set of open-source detection models.

top 15 comments
sorted by: hot top controversial new old
[–] FaceDeer@fedia.io 3 points 2 weeks ago

Similar to online AI detector tools

Ah, so it's useless then.

[–] InstallGentoo@lemmy.zip 2 points 2 weeks ago

Wow, Mozilla making more useless garbage nobody asked for.

[–] Excel@beehaw.org 2 points 2 weeks ago* (last edited 2 weeks ago)

Made by people that either:

  • don’t understand how reinforcement learning works, or
  • are lying for publicity

Because there is not now, nor will there ever be, nor CAN there ever be, an effective AI detection tool.

[–] FiskFisk33@startrek.website 1 points 2 weeks ago* (last edited 2 weeks ago)

That would be great, but AI detection doesn't work reliably at all.

Here's a study https://edintegrity.biomedcentral.com/articles/10.1007/s40979-023-00146-z#Sec19

[–] Ebby@lemmy.ssba.com 1 points 2 weeks ago

Sounds like a great idea, but a significant portion of 1-star reviews point out massive data collection issues.

More information necessary before I install this on my system.

[–] kbal@fedia.io 1 points 2 weeks ago

I'd rather have a tool to detect intelligence in general, weeding out the stupidity regardless of who it comes from.

[–] dicksteele@lemm.ee 1 points 2 weeks ago

Quick review:

‘tis shite

[–] GenderNeutralBro@lemmy.sdf.org 0 points 2 weeks ago (1 children)

I don't see any mention of whether this uses local models or cloud models. I'm not interested in sending anything I care about it into the cloud.

[–] thingsiplay@beehaw.org 1 points 2 weeks ago

I think that I can decide better than an Ai tool if a text is written by an Ai. Not a fan of this. I find it weird to use an Ai tool, to detect Ai text. Also I wonder if those Ai fake tools can utilize Fakespot detection to improve the actual fakeness. They can train their Ai until Fakespot does not detect anymore.

They talk about their proprietary model, plus several other tools. Highlight any text online and request an analysis. Nowhere in the article, the download page and their Fakespot website is once mentioned if this is local and offline. So, I'm 99% sure the data is sent to their server for analyzing the highlighted text.

[–] perishthethought@lemm.ee 0 points 2 weeks ago (1 children)

Oh man - right after I posted this, I got the DM others have reported from the Polish tech chick from Toronto, with links to her cool videos. I passed her message to this extension but it says it looks like Human text. Oh well.

[–] burgersc12@mander.xyz 1 points 2 weeks ago (2 children)

AI detector can't detect AI. Is anyone surprised by this anymore?

[–] NuXCOM_90Percent@lemmy.zip 1 points 2 weeks ago (1 children)

Like others said: That is probably just "normal" spam

But also? This is the same logic as "AI can't draw hands" and all the other gotchas. We are in an arms race and have been for decades. Captchas have always been about "bots" and have increasingly been defeated by various forms of computer vision which are the basis for how a lot of "AI" works. And we are in the same place now.

[–] burgersc12@mander.xyz 0 points 2 weeks ago (1 children)

I just think its almost impossible to detect AI, same way you are talking about how it is almost impossible to build a captcha that is both useful and bot proof.

[–] Catoblepas@lemmy.blahaj.zone 1 points 2 weeks ago

The internet version of “the intelligence of the dumbest humans and the smartest bears overlaps significantly” trash can problem?

[–] TehPers@beehaw.org 1 points 2 weeks ago

There's an entire category of machine learning dedicated to having two AIs "fight" against each other. One generates something while the other classifies it as either AI generated or genuine.

Anyway, this is a complete tangent. Just thought it was interesting. AI detector tools for LLMs aren't usually very accurate, unfortunately.