this post was submitted on 10 Jul 2025
46 points (96.0% liked)

Asklemmy

49373 readers
620 users here now

A loosely moderated place to ask open-ended questions

Search asklemmy ๐Ÿ”

If your post meets the following criteria, it's welcome here!

  1. Open-ended question
  2. Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
  3. Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
  4. Not ad nauseam inducing: please make sure it is a question that would be new to most members
  5. An actual topic of discussion

Looking for support?

Looking for a community?

~Icon~ ~by~ ~@Double_A@discuss.tchncs.de~

founded 6 years ago
MODERATORS
 

Almost every website and services are getting scraped at alarming rate, are Lemmy servers facing this issue?

Please share mitigations you've seen applied to this.

you are viewing a single comment's thread
view the rest of the comments
[โ€“] safesyrup@feddit.org 28 points 2 days ago (7 children)

I think lemmy content is scraped too, just how the whole web is beeing scraped. I do not have any proof for it though.

I have seen a user add a like anti-commercial AI license as a footer for every comment he writes lol

[โ€“] potatoguy@potato-guy.space 13 points 2 days ago (2 children)

It is, I saw claudebot and gptbot scraping my instance, made a post about it on fuckai, but i have blocked all these bots now and my instance is a lot faster.

[โ€“] Forester@pawb.social 7 points 2 days ago (1 children)

Out of curiosity, I am not familiar with the stack that runs the behind the scenes at all for lemmy. Are you blocking IP ranges or something else?

I use this nginx extension, it has a lot of rules, they mix IP, user agent, etc, to block a response it seems. Like adblocking rules, but for bots.

load more comments (4 replies)