Another large language model scraper blocked. This graph is from a site which runs a tool generating answers for people doing important research work. The AI scraper sent hundreds of thousands of lookup requests evading rate limits by using about a thousand IPs and pinned multiple webservers at 100% CPU (graph from one attached). This is a massive waste of electricity to train a hallucination machine.
@alyx we have lots that only have IPv6 address on the server itself, but use NAT64 to get out to IPv4 only instances, and a https proxy inbound so v4 only instances can federate with us. We salute your purism!
A hosting service for friends that went wrong, now six data centres in three countries with hundreds of gigabits.status: status.mythic-beasts.net.uksupport: support@mythic-beasts.com