I wouldn’t mind having an AI or “superintelligent” assistant under my own control … but when I do I don’t think it’s any company’s business what I do with it.
So, yeah, as in the old Microsoft days, let me buy one, perhaps even a pre-build box, at a reasonable price … but once it’s in my house the company loses all say or feedback over it and what I do with it.
Heck if there’s to be newer full x.0 versions out it seems reasonable to be paying for those again as well so the AI companies get a steady enough income…
I wouldn’t mind having an AI or “superintelligent” assistant under my own control … but when I do I don’t think it’s any company’s business what I do with it.
So, yeah, as in the old Microsoft days, let me buy one, perhaps even a pre-build box, at a reasonable price … but once it’s in my house the company loses all say or feedback over it and what I do with it.
Heck if there’s to be newer full x.0 versions out it seems reasonable to be paying for those again as well so the AI companies get a steady enough income…
I mean, you can have that today, in some form or other, since that’s just how local AI works.
Totally. It’s a bit pricey for anything like a genuine personal assistant right now though. $15k or so to get the basics.
Atm the meta for local inference is unified memory and “routed” local agents (multiple smaller role-specific agents in a trench coat)
The former is standout for cost efficiency (e.g., 4x RDMA 48gb Minis for a 192gb cluster @ $43/gb vs a $45k b200 alone)
The latter is standout for many things, including resource efficiency on smaller machines