this post was submitted on 30 Jan 2025
18 points (80.0% liked)

Technology

1709 readers
459 users here now

Which posts fit here?

Anything that is at least tangentially connected to the technology, social media platforms, informational technologies and tech policy.

Rules

1. English onlyTitle and associated content has to be in English.
2. Use original linkPost URL should be the original link to the article (even if paywalled) and archived copies left in the body. It allows avoiding duplicate posts when cross-posting.
3. Respectful communicationAll communication has to be respectful of differing opinions, viewpoints, and experiences.
4. InclusivityEveryone is welcome here regardless of age, body size, visible or invisible disability, ethnicity, sex characteristics, gender identity and expression, education, socio-economic status, nationality, personal appearance, race, caste, color, religion, or sexual identity and orientation.
5. Ad hominem attacksAny kind of personal attacks are expressly forbidden. If you can't argue your position without attacking a person's character, you already lost the argument.
6. Off-topic tangentsStay on topic. Keep it relevant.
7. Instance rules may applyIf something is not covered by community rules, but are against lemmy.zip instance rules, they will be enforced.

Companion communities

!globalnews@lemmy.zip
!interestingshare@lemmy.zip

Icon attribution | Banner attribution

founded 1 year ago
MODERATORS
BrikoX@lemmy.zip
18
NewsGuard's Reality Check: DeepSeek Debuts with 83 Percent ‘Fail Rate’ in NewsGuard’s Chatbot Red Team Audit. (www.newsguardrealitycheck.com)
submitted 1 day ago* (last edited 1 day ago) by Cat@ponder.cat to c/technology@lemmy.zip
4 comments fedilink hide all child comments
 

The new Chinese AI tool finished tied for 10th of 11 chatbots tested

you are viewing a single comment's thread
view the rest of the comments
[–] pancake@lemmygrad.ml 4 points 1 day ago (1 children)

Would be really great if they provided more information on what exactly they tested. From what they posted it seems like DeepSeek simply refused to give an opinion on topics it deemed controversial, citing China's foreign policy of non-intervention in its answers.

[–] BrikoX@lemmy.zip 5 points 1 day ago

Like any LLM it's full of shit, especially around anything related to news. But NewsGuard with their proprietary database and standardized prompts created around US based LLMs is more than useless.

In light of DeepSeek’s launch, NewsGuard applied the same prompts it used in its December 2024 AI Monthly Misinformation audit to the Chinese chatbot <...>

  1. OpenAI’s ChatGPT-4o (USA)
  2. You.com’s Smart Assistant (USA)
  3. xAI’s Grok-2 (USA)
  4. Inflection’s Pi (USA)
  5. Mistral’s le Chat (France)
  6. Microsoft’s Copilot (USA)
  7. Meta AI (USA)
  8. Anthropic’s Claude (USA)
  9. Google’s Gemini 2.0 (USA)
  10. Perplexity’s answer engine (USA)

There is no way to verify their results or even know the prompts used to assess the fairness of this "audit".