Yes, but like I said in another comment models do keep getting better and better, and good models are getting cheaper and cheaper. As time goes on the price will continue to drop and capabilities will continue to grow. Frontier models will always be expensive, but a budget model that can do the same thing will come out 3 months after.
It’ll get cheaper bro, we just need more data, please bro, then we can use it to solve climate change, we just need more electricity, please bro, think of the capabilities bro…
If there is a future for LLMs, it will come after the bubble bursts and the small, specialized, locally hosted models take over, yes. I don’t expect them to be able to get good enough at coding to replace humans any time soon, though. You need logical reasoning and problem solving skills to produce code that’s of any value, and we aren’t getting there by text prediction.
Yes, but like I said in another comment models do keep getting better and better, and good models are getting cheaper and cheaper. As time goes on the price will continue to drop and capabilities will continue to grow. Frontier models will always be expensive, but a budget model that can do the same thing will come out 3 months after.
It’ll get cheaper bro, we just need more data, please bro, then we can use it to solve climate change, we just need more electricity, please bro, think of the capabilities bro…
Just 75 more gas turbines killing local residents and I swear grok will be good!
Now you’re getting it
If there is a future for LLMs, it will come after the bubble bursts and the small, specialized, locally hosted models take over, yes. I don’t expect them to be able to get good enough at coding to replace humans any time soon, though. You need logical reasoning and problem solving skills to produce code that’s of any value, and we aren’t getting there by text prediction.
I generally agree! Local self hosted models with smart and competent users capable of properly using them would be the ideal future.