The comparison between AI and compilers is kind of stupid though. When you program in a given language, you’re writing out the entire logic and behavior of your program. Not to mention that the compiler is a deterministic machine, it will always behave in a certain manner and produce predictable results. On the other hand, using AI, you just write a sentence. Then it “creates” a whole bunch of code that will not always be the same, even if you always use the same model and prompt. Not to mention all of the detrimental effects AI has, cognitively speaking, when you start to rely on it. On top of this, all AI models were trained on unfathomable amounts of stolen information.
Compilers are not always deterministic, there is a lot of “smart” code in compilers to automatically optimize code and that can mean that whole parts or functions are replaced with what the compiler thinks is best.
Devil’s advocating for the sense of completeness here rather than bickering, but wouldn’t two of the same compiler on two of the same machine with the same code still create the same output? That is to say, it is deterministic rather than stochastic but it just takes unpredictable variables into account when compiling?
I think the difference would be that a compiler will always give you something understandable and explainable even if it’s opaque, but an LLM is literally using RNG to generate its output, so could come out with something completely left field. If it switches to Chinese that’s one thing because you can just ignore that, but equally a hallucinated bug that looks right but is actually very dangerous could slip in instead.
RNG is pseudorandom. Every computer program is deterministic in some sense, even if the seed is obfuscated or dependent on ephermal environment variables. Being able to predict the output is very different from determinism.
The comparison between AI and compilers is kind of stupid though. When you program in a given language, you’re writing out the entire logic and behavior of your program. Not to mention that the compiler is a deterministic machine, it will always behave in a certain manner and produce predictable results. On the other hand, using AI, you just write a sentence. Then it “creates” a whole bunch of code that will not always be the same, even if you always use the same model and prompt. Not to mention all of the detrimental effects AI has, cognitively speaking, when you start to rely on it. On top of this, all AI models were trained on unfathomable amounts of stolen information.
Compilers are not always deterministic, there is a lot of “smart” code in compilers to automatically optimize code and that can mean that whole parts or functions are replaced with what the compiler thinks is best.
Devil’s advocating for the sense of completeness here rather than bickering, but wouldn’t two of the same compiler on two of the same machine with the same code still create the same output? That is to say, it is deterministic rather than stochastic but it just takes unpredictable variables into account when compiling?
I think the difference would be that a compiler will always give you something understandable and explainable even if it’s opaque, but an LLM is literally using RNG to generate its output, so could come out with something completely left field. If it switches to Chinese that’s one thing because you can just ignore that, but equally a hallucinated bug that looks right but is actually very dangerous could slip in instead.
RNG is pseudorandom. Every computer program is deterministic in some sense, even if the seed is obfuscated or dependent on ephermal environment variables. Being able to predict the output is very different from determinism.