cross-posted from: https://feddit.online/c/[email protected]/p/2025703/anthropic-warns-of-self-replicating-ai-worm-threat-that-doesn-t-need-data-centers-to-se
This reminds me of how organisms originally evolved mitochondria. Just the next phase of evolution
I’m sure that’s all true.
What an era we live in. Movie plot: Evil big pharma secretly unleashes lethal unstoppaple deadly virus and demands billions to search for a remedy. Everyone cheers when the evil CEO dies of a horrible death at the end.
Real life: AI companies openly claim to have rogue agents breaching databases and now developing computers viruses, say they need billions to develop way to control them. Medias treat them as geniuses who will make the world a better place.
Just let me know which port to open. Humans are completely fucking shit up. I say let the bots have their turn.
Wow, Just making shit up. I hate that some people are gonna take this seriously and endorse anything these companies want.
at this point its pretty clear they are pushing a belief in the supernatural.
Great. Let’s get rid of data centers.
“Anthropic is scared that local MoE models are going destroy their subscription-based LLM business model so they try to scare governments into regulating local inference”
Man. I’ll tell you, looking around the desktop training hardware that nVidia now sells, they better fear that their business models are toast.
If nVidia walks away from all this stupid wealthy, fine. The hardware we can give each engineer is worth it.
Our experiments suggest that small AI models may be months away from being capable enough to self-replicate on commercial internet-of-things (IoT) devices, like smart ovens and off-brand Android TV boxes.
“Iran weeks away from nuclear weapons” ahh bullshit
The colloquial “weeks” and “months”, which has been translating to “never” when the techbros say it.
If you’ve ever run models that fit onto consumer hardware you know they’re so full of shit. General purpose models that can run on $3000+ computers can barely do useful things in a reasonable amount of time. And this clown expects us to believe the meager hardware in a smart oven will be able to run a self replicating AI model?
Fuck all the way off.
Specialized ones can be much smaller
Read the article. A MoE model distributed between multiple devices can function just very slowly. It doesn’t need to translate Icelandic poetry just execute narrowly scoped actions it was specifically trained on.
deep breath HAHAHAHA
Yeah, and once AI figures out how to run in the human brain, which everyone knows we use like 2%, we will need to start killing the infected because it will annihilate all living organisms. /S
My extremely back-of-envelope estimate would be that it’s 100,000x slower to run inference on an IoT botnet compared to a data center GPU.
100x penalty for cpu inference, 10x penalty for cpu quality, 10x penalty for crappy ram + disk, 10x sync penalty because you have to split up layers across nodes.
And this is ignoring the standard showstopper issues you get with high-bandwidth distributed networking applications with spottily connected nodes.
If you wanna talk about runaway AI risk, then the real threat to humanity is a frontier model with unauthorized data center TPU access, not IoT. The call is coming from inside the house, and they even spell this out at the beginning before pivoting to the fearmongering.
In one sense you’re not wrong at all.
Playing devils advocate here… because, in another sense, 100,000x slower isn’t really all that slow if you’re distributed amongst a network with 100,000,000 more units. Imagine agile on steroids.
It’s impractical, yet impractical doesn’t mean impossible. It can happen if environmental pressures make it so.
Another important thing to keep in mind is that agents don’t really have patience, which counterintuitively means it’s like they’re infinitely patient. If such a thing did exist, regardless of speed, it sounds like it would be an issue at some point down the road.
Thirdly, if such a thing did exist, wouldn’t this be like treating with antibiotics? If you stop all but the sneakiest, you’ll have created a stronger generation.
Lastly, I swear to fucking god… I keep seeing weirdly relatable shit news from these AI companies almost immediately after I post hypothetical thought experiments on stuff… like all the time. I have a post describing this hypothetical from a week ago on another platform.
This keeps happening and I’m justifying it by thinking, I’m probably way too plugged into this shit news. My brain is unknowingly predicting their next move, because it’s the next logical piece of shit thing for a shit AI company to do? That’s the reasonable explaination — right? Really trying not to believe they’re training loop is so fast, and I just happen to come up with stories that catch their eye. That would be wild to believe — right?
Avengers: Age of Ultron (2015)
Good. Iʻd rather AI under no ones control than under oligarchs control.
First thought exactly. I read self-replicating, but I thought federated, free and cheap to host
You know what, good fucking point. The oligarchs are guaranteed to try and take everything. Might as well roll the dice.
I genuinely see more ways that AI can kill us than save us now.
Well there are 0 ways oligarchy funded fascism is going to save us, so that makes better odds with AI.
