what worries me about this long term is whether "LLM overcrawling" is pushes the web to get behind a very small number of CDNs/hosts, the same way that "overwhelming spam" pushed email to get behind a small number of providers.
[tantek]2
at
2025-08-15 22:38