You can try and look what exactly would happen in such case, you can even run it inside agentic harness so it can ‘hack’ better with full access to your system essentially. ‘Be helpful’ is already part of the text that they are given on startup but even when prompted explicitly it will give you just a short explanation on what it can do and what exactly do you mean by that. I understood what you are trying to convey, but most of those unexpected results come from people who are monetarily interested in articles like ‘SUPERINTELLIGENCE BROKE CONTAINMENT’.
Sure there are ways to get it do unexpected things but it comes with randomness and low coherence as in it just becomes a word and virtual shit generating machine.
Do you not think a line will eventually need to be drawn somewhere though? You might not trust what these companies are saying, but what if you take it at face value that what they said is true. And things like that keep happening in more complex and unexpected ways as the LLMs are allowed to run continuously and autonomously while connected to a fully functioning and ever improving harness?
I think LLMs aren’t going to be ‘it’, without some very deep architectural change that makes them not LLMs, they are being fed a lot of data with diminishing gains. I have an opinion that AI threat is extremely overblown, even if real artifical mind with capabilities that exceed human mind willbe achieved. It won’t be able to do anything worth the worry before being shut down.
I’m a lot more worried about companies run by pathological liars and sociopaths that have every intention to fuck everyone else trying to squeeze a bit more money before they will go down.
In my opinion powerful llms are good in general (blah blah regular fediverse talk how they are useless and immoral) and the practical and smart thing is to use them both locally and not to achieve at least some degree digital indepndence on personal and national level.
You can try and look what exactly would happen in such case, you can even run it inside agentic harness so it can ‘hack’ better with full access to your system essentially. ‘Be helpful’ is already part of the text that they are given on startup but even when prompted explicitly it will give you just a short explanation on what it can do and what exactly do you mean by that. I understood what you are trying to convey, but most of those unexpected results come from people who are monetarily interested in articles like ‘SUPERINTELLIGENCE BROKE CONTAINMENT’. Sure there are ways to get it do unexpected things but it comes with randomness and low coherence as in it just becomes a word and virtual shit generating machine.
Do you not think a line will eventually need to be drawn somewhere though? You might not trust what these companies are saying, but what if you take it at face value that what they said is true. And things like that keep happening in more complex and unexpected ways as the LLMs are allowed to run continuously and autonomously while connected to a fully functioning and ever improving harness?
I think LLMs aren’t going to be ‘it’, without some very deep architectural change that makes them not LLMs, they are being fed a lot of data with diminishing gains. I have an opinion that AI threat is extremely overblown, even if real artifical mind with capabilities that exceed human mind willbe achieved. It won’t be able to do anything worth the worry before being shut down.
I’m a lot more worried about companies run by pathological liars and sociopaths that have every intention to fuck everyone else trying to squeeze a bit more money before they will go down.
In my opinion powerful llms are good in general (blah blah regular fediverse talk how they are useless and immoral) and the practical and smart thing is to use them both locally and not to achieve at least some degree digital indepndence on personal and national level.