How to protect my website from ai scraping, hitting etc
-
Hello!
I recently read about WordPress websites being scraped by meta. Also, some people have reported issues with meta agents hitting their websites hundreds of times per minute.What can we do about this?
I'm currently finalizing my website, so any suggestions would be greatly appreciated. Thank you for your help! -
short answer:
you can use this plugin:
https://wordpress.org/plugins/ai-deny/hey!!
mmh i mean, the whole internet got distilled into LLMs, books and more, no one allowed them to do that :DDin your robots.txt file you can add:
User-agent: meta-externalagent
Disallow: /this asks the bots to ignore the site. but they are free to decide if they follow your rule or not.
you can use this plugin:
https://wordpress.org/plugins/ai-deny/it will do the above and do it for more bots too.
to be 100% sure, somehow your host would need to setup a firewall and block all IP's of the AI companies. thats sth i cant do
Hello! It looks like you're interested in this conversation, but you don't have an account yet.
Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.
With your input, this post could be even better 💗
Register Login