We tend to think that markets reflect consumer choice. But the artificial-intelligence boom has been powered by the investment decisions of concentrated capital rather than by consumer demand.
From go to woah (including the compute), total project cost is about $1400 USD / ~$2K AUD. I realise I have the privilege of claiming that’s not a lot, but for a hobby spend that makes me happy / does useful stuff (see TV example above), it’s not a lot.
Self-hosted LLMs are neat and private, if you (already) have the hardware/budget and some cheap (solar PV) surplus juice to drive it.
Do you know anyone doing all of that? Running a local model on off-grid power?
What would you like to know about it?
I glossed over it the other day here -
https://aussie.zone/comment/24336560
From go to woah (including the compute), total project cost is about $1400 USD / ~$2K AUD. I realise I have the privilege of claiming that’s not a lot, but for a hobby spend that makes me happy / does useful stuff (see TV example above), it’s not a lot.