• robert@piefed.ca
    link
    fedilink
    English
    arrow-up
    0
    ·
    edit-2
    2 days ago

    But if you actually believe that these mathematical construct have intelligence, do you also believe that every time you close a llama.cpp process you kill a sentient being?

    Intelligence without a sense of self would be very strange, no? What we call intelligence is mostly thought of being able to think genuine thoughts

    You are conflating intelligence with other concepts, like phenomenal consciousness, sentience or self awareness.

    ChatGPT even fails to imagine a Othello Board and valid moves

    There are many different models of ChatGTP and most people do not typically have access to the cutting edge ones used to make these discoveries.

    • Wildmimic@anarchist.nexus
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 day ago

      Intelligence needs something to anchor it in the real world, or it becomes useless. In the biological world, that is a world model, based on previous experiences - and this experience needs at least a modicum of sentience to become useful as we can see all around us. Animals more aware of their own existence are also those who are a lot better at intelligent behavior.

      The “intelligent” output we get from LLMs are NOT a sign of intelligence, it is a statistic. This is useful, no doubt about it - having computers that are able to output the average answer one would get if asking someone who knows their shit is a very good thing, as is being able to walk across a large amount of different (pre-existing) approaches. But conflating it with actual intelligence which would be able to correct hallucinations before they are uttered (because the hallucination isn’t logical at all in most cases) and which would be resistant against breaking them by asking them to do irrational things is not the way to go.

      There is no representation of the huge amount of rejections to answer a question or do a task that many people are not qualified to work on at all. An actually intelligent being realizes when it reaches the limits of it’s knowledge (or it’s training data). Intelligent beings can then try to extrapolate from existing knowledge, but they know that they actually do not know, and often communicate that (putting social things aside for the moment).

      This is the point where LLMs break down with 100% chance if pushed - they do not say: “i do not know”, or “i do not have enough data for that”, or “that doesn’t make sense”. An output is obligatory, regardless of how much an intelligent being would say “oh well, what you want from me doesn’t make sense at all”.

      And it’s as easy as asking an LLM to modify their way of communicating: If you tell it to use a symbol/word again after that same symbol/word, and continue to ask it to do this every time it fails to do so (under the guise of having reading or hearing issues) will break these things every time, sending them spiraling. An intelligent being would say “You know what, fuck you, you are messing with me”.

      This is actual proof of a complete lack of anything resembling real intelligence - intelligence would allow analysis of the situation and detection of unreasonable requests.

      Edit: they trained a model they called “Othello-GPT” with championship datasets, containing only valid moves, and tried to make the point that these things have an internal world model by providing it with game states and asking it for a valid move. It still messed up 5% of the time with real world data, meaning there is no consistent reasoning going on here.

      • robert@piefed.ca
        link
        fedilink
        English
        arrow-up
        0
        ·
        22 hours ago

        What are you are basically saying here, is that LLMs are functionally equivalent to intelligent systems but are not themselves intelligent. Most people will not find this satisfying because intelligence is defined in functional terms. Is something is flexible enough to solve a wide range of problems with human or above-human level accuracy then it is intelligent. Whether or not the system is a program, a human or an animal or some slime mold, or a bunch of statistics that system fits the functional criterion of an intelligent system.

        That said, you don’t need to go so far as to ascribe nonfunctional mental characteristics to these systems. These are mental characteristics that cannot be described in functional terms, like eg pain or emotions; you can mimic pain or emotions (which is a functional behaviour) without actually feeling them (the intrinsic, nonfunctional part).

        All I’m saying here is that LLMs fit the functional criterion of an intelligent system, which is the only criterion of intelligence we actually have.

        Does that make sense?