OpenAI CEO Sam Altman said in a podcast interview that "it's quite terrible" for people to have RAM in their own PCs when it could go into AI data centers.
Maybe, maybe not. Phones are getting more optimized for AI and have decent RAM, so the on device models may not be great at agentic problem solving, but they’ll probably meet most people’s AI needs
Plus, any reasonable gaming computer or MacBook can run models… Maybe a bit slowly and maybe just the compressed 8gb models, but they can pretty much all do it to some degree
So I think we’ll be in a place where there’s little or no upfront cost after a couple more key advancements
Something that has a fixed up front cost to run*
Otherwise, YES!
Depending on your rig there will still be recurring cost (electricity)
Well, yeah… i was just pointing out that “free” wasn’t exactly accurate
I know, I was adding another thing that made it not free.
Maybe, maybe not. Phones are getting more optimized for AI and have decent RAM, so the on device models may not be great at agentic problem solving, but they’ll probably meet most people’s AI needs
Plus, any reasonable gaming computer or MacBook can run models… Maybe a bit slowly and maybe just the compressed 8gb models, but they can pretty much all do it to some degree
So I think we’ll be in a place where there’s little or no upfront cost after a couple more key advancements