I currently run the top 8 or so per day from r/LocalLLama through my RSS reader. Actually going to reddit is eww, so I want it to be worthwhile. I usually get enough to keep roughly up to date just with title and text / graphs and only go if it looks really interesting.
With the upcoming demise of reddit RSS, I’m wondering if people have recommended (hopefully RSS friendly) places roughly equivalent. I guess I could filter HN which may be useful for many tech interests, but I don’t know what I don’t know, so I thought I’d pose the question to the crowd.
Actually…
And I really don’t mean to be pedantic. But Unsloth has enshittified some.
Some of their GGUFs target their own vibecoded PRs first, not necessarily mainline llama.cpp.
And, more frequently as of recent times, they’re bugged just to get them out the door first, and get the hype.
The quantization loss is higher than some other quanters now, again, due to the rush.
There are also some much stronger quantization schemes outside mainline GGUFs now, like ik llama.cpp or exl3.
Unsloth isn’t bad, I’m just saying be careful using them as the defacto quantization source.
I used to love them. But I haven’t downloaded an Unsloth model in some time, and TBH I am not really inclined to…
Llama.cpp themself is slow, lot of model lose their popularity.
Yeah, hence the slew of forks.
Not that I blame llama.cpp. They have a huge job for so little dev manpower, and it’s trying to be a jack of all trades rather than something specialized like other frameworks.