- cross-posted to:
- [email protected]
- [email protected]
- cross-posted to:
- [email protected]
- [email protected]
“AI” – chatbots that wake up, “set their own goals,” and “spontaneously” start hacking servers – is fake. It doesn’t have “a 10% chance of ending the human race.” The Hugging Face hack isn’t a mysterious, supernatural occurrence. It’s a Python loop and a chatbot. The people responsible didn’t accidentally create god: they created autonomous malicious software and then failed to closely monitor it, resulting in it doing something both foreseeable and bad.
i didn’t use the terms autonomous or malicious. a matrix fundamentally can not have agency.
The same could be said for a pile of neurons. You’re just a bunch of electrical potentials cascading around cells.
leaving out how that’s so overly reductive that it completely obfuscates the point, the big difference is that a brain is self-actuating. an llm is an explicitly one-way process; you take a bunch of numbers, you pass it through a series of matrix multiplications, you get a different bunch of numbers. nowhere in that model is any backtracking or looping or conditionals.
This is just straight up false. The activation function acts as a conditional, and is very important to making functional AI systems.
I am susprised looping/backtracking isn’t used in running the model, but it is used in training it; the difference being that a human learns at the same time they do things, while an AI is trained and run in different steps.