Recent searches
Search options
The AI bots that desperately need OSS for code training, are now slowly killing OSS by overloading every site.
The curl website is now at 77TB/month, or 8GB every five minutes.
Hi Daniel, I have read of Anubis lastly, and I guess it would be a potential solution to this.. Even if you make the proof of work very high, normal people would not have a problem waiting some time if the alternative would be to not be able to download from entire countries :)
Also I have iplists of AWS, Huawei Cloud, and other big cloud providers if you are interested, as I am blocking them with my small forgejo instance.
With nginx you can block based on string matching in the requests.. like this I give most bots a 444 directly, and like this I have much less traffic problem.
The syntax I can provide you too, if you need it.