$ cat /var/log/thoughts/guides

Guides: Cloudflare + DevOps + Security

Broader reference material for tools and workflows.

Showing page 1 of 1 (1 total posts)

How to Block AI Crawlers From Destroying Your Site

AI crawlers from OpenAI, Meta, and Anthropic are hammering sites with millions of requests per month. robots.txt alone does not stop them. Here are the 4 layers that actually work.

GuidesSecurityDevOpsWeb DevNginxCloudflare1 min read · Apr 11, 2026