To be honest bandwidth isn’t a problem because it’s text files. The problem is to optimize network stack for multiple connections because they’re hitting from whole subnets without any delay so literally ddos and cache those html files because at some point CPU becomes bottleneck.

Thank you for answer. I think I do this one instead https://academictorrents.com/details/30dee5f0406da7a353aff6a8caa2d54fd01f2ca1 Looks like it’s divided by year-month.

How long it takes to download this 3TB torrent ?

I have around 10-20GB github / gitlab mirror. I am constantly under attack from crawlers from top US technology corporations and LLM startups. Whenever I ban one IP range they switch to other - I don’t know if those fuckers have tickets in their systems to do it manually or they just deploy this shit all over the planet. From what I observe during attacks that I mitigate the best way to poison them is to just create gitea instance with poisoned code repository and couple hundred revisions. It’s because what they are most interested in is html representation of diff between two git revisions.

Now please ban all computers because of sexual preferences of Alan Turing.

It’s pretty fucked up but awesome quest about our future.

yeah cartoon from “The Hunt” quest
https://www.youtube.com/watch?v=cibafW6XFLA

Ah yes the 50 000 EUR grants compared to 5 Billion EUR bonds bought from google last year.