A lot of that was scraping. A huge amount. Just take everything possible. Hopefully that will slow down, or as I did, I allow requests and reponses, but scraping gets kicked.

But it is getting hard and harder to self host. Large websites and hosts (gitlab, self labs) get slammed and even DOS. Its been rough.

There are huge network upgrades in the works to try and deal with this 3.2T are being looked at already. But of course electricity is going to hit a hard ceiling both for the data center and the network center. Hence the costs you are talking about.

I am more concerned with the fact that if everyone is asking AI, who is going to put the answers somewhere to get them? Who is going to self host and publish like I do today? It already is rare to see people running their own websites anymore. Lemmy is pretty amazing for that, but it too has gotta be having a huge amount of traffic at each instance.

I guess I am saying I am aware of your concerns and I have mine too.