We tend to think that markets reflect consumer choice. But the artificial-intelligence boom has been powered by the investment decisions of concentrated capital rather than by consumer demand.
It just sounded like the kind of thing that makes good sense on paper but I’m wondering if it actually works out well. Sounds like you are in the process of getting ready to try it.
Self-hosted LLMs are neat and private, if you (already) have the hardware/budget and some cheap (solar PV) surplus juice to drive it.
Do you know anyone doing all of that? Running a local model on off-grid power?
deleted by creator
It just sounded like the kind of thing that makes good sense on paper but I’m wondering if it actually works out well. Sounds like you are in the process of getting ready to try it.