Open-source infrastructure is being strained by increasingly aggressive AI scraping, according to the supplied report, which says the problem is now causing outages and user-visible slowdowns across multiple FOSS projects.
The article begins with complaints from SourceHut founder Drew DeVault, who said LLM crawlers were ignoring robots.txt and hitting expensive endpoints such as git blame, complete logs and every commit in a repository. The excerpt says that behavior has delayed high-priority work for weeks or months, occasionally affected users and caused outages on SourceHut itself.
The report then says KDE GitLab was overwhelmed by another crawler, with IPs apparently from an Alibaba range, temporarily making the service inaccessible to KDE developers. It also notes that GNOME had already been dealing with the issue for months and eventually adopted Anubis, a proof-of-work challenge designed to slow automated traffic. That move helped, but the excerpt says it has introduced friction for real users too.
That tradeoff is the important operational lesson. Open-source projects depend on public access, public collaboration and low-friction contribution. Aggressive scraping turns those strengths into liabilities by forcing maintainers to choose between keeping the service open and keeping the service usable. The excerpt says some users have faced minute-long or two-minute delays when links from chatrooms or Hacker News created bursts of traffic.
The report also argues that the problem is widespread. It says LWN has warned readers that its site may be sluggish because of DDoS-like crawling, Fedora has resorted to subnet blocks and even a temporary Brazil-wide ban, and Inkscape has described attacks from companies spoofing browser information. The result is a landscape in which project maintainers are building block lists and sharing them as a survival tactic.
The supplied evidence does not identify every company involved in every incident, and it should not be read as a definitive attribution list. But it does make one thing clear: open-source infrastructure is now spending real time and money defending itself against bots that do not respect server cost. That is a shift from annoyance to structural burden.
The report’s broader point is that AI scraping is no longer just a publisher issue. It is becoming an infrastructure problem for the software communities that keep much of the internet running. The blunt tools now in use show how desperate the situation has become, even if they also reveal how awkward the fixes are.
For now, the evidence supports a simple conclusion: FOSS projects are under active pressure from automated crawlers, and their defenses are hurting legitimate users along with the bots.
