get_flat_ccs_offset() reads the base of the flat CCS storage from the
hardware, scales it by the number of enabled L3 nodes, and rounds the
result up to 128K. Everything below that offset is then ...
They are not magic. You are still using electricity, and for the same amount of work that cloud providers do you will consume the same amount. If every one of the billions of people using chatgpt or whatever buys rtx 5090 and makes it churn 24/7 for their “local” ai then nothing will change for the environment.
It will still run necessary calculations much slower than a gpu, so you will need to run it much longer for the same result, which is not only inconvenient but will likely use more power in the end anyway.
Hey, Mr. Self-righteous. Tell us about how you live in a small efficient urban dwelling served nearly entirely by renewable energy, that you don’t own a car, don’t eat meat, and never take longer than a 5 minute shower.
And if even one of those things isn’t true, I demand a full explanation for why you hate the planet and want it to die.
Especially if you own a car. If you own a car and you’re shaming people for the environmental impact of AI, you owe it to us all to sell that thing today and prove your superiority to the rest of us.
EDIT: Nevermind, just reviewed your comment history to see that you are an enthusiastic spectator of the Russia/Ukraine war. Given that war is the single most ecologically destructive force on the planet, it is clear that you are completely irredeemable, and should keep your snide comments to yourself.
So you don’t care about environment, huh?
use Local LLMS ;)
They are not magic. You are still using electricity, and for the same amount of work that cloud providers do you will consume the same amount. If every one of the billions of people using chatgpt or whatever buys rtx 5090 and makes it churn 24/7 for their “local” ai then nothing will change for the environment.
But isn’t it as bad as running a graphically intensive AAA game on your computer
That’s still just moving the impact from data centers to end users’ machines.
Gamers (especially those that own 5090) are a tiny minority compared to llm users.
CPU?
This will just waste even more energy since cpus are less efficient at this kind of task.
LLMs require insane amounts of compute, period. The hardware to do that needs energy and emits heat, there is no way around.
What if it the CPU was energy efficient?
It will still run necessary calculations much slower than a gpu, so you will need to run it much longer for the same result, which is not only inconvenient but will likely use more power in the end anyway.
Hey, Mr. Self-righteous. Tell us about how you live in a small efficient urban dwelling served nearly entirely by renewable energy, that you don’t own a car, don’t eat meat, and never take longer than a 5 minute shower.
And if even one of those things isn’t true, I demand a full explanation for why you hate the planet and want it to die.
Especially if you own a car. If you own a car and you’re shaming people for the environmental impact of AI, you owe it to us all to sell that thing today and prove your superiority to the rest of us.
EDIT: Nevermind, just reviewed your comment history to see that you are an enthusiastic spectator of the Russia/Ukraine war. Given that war is the single most ecologically destructive force on the planet, it is clear that you are completely irredeemable, and should keep your snide comments to yourself.
It’s really easy to not use ai. It’s not a necessity and not even a part of any “lifestyle” that some people would miss.