• Boost@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    3 days ago

    I use Claude every day for actual production software used in a real product and I can say with confidence that even the most advanced publicly available models totally lack the higher order thinking required to build good software. They’re pretty good at writing code, when directed well. They are not good at architectural or design decisions and they’re even worse at actually following decisions made outside of their context. Those are the actually challenging parts of software engineering and you have to beat them into the model every step of the way or your software quickly becomes an unmaintainable mess.

    • redballooon@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      2 days ago

      Use Spec driven development and a good verification loop to overcome the “beat it into the model at every step”.

      • Boost@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        2 days ago

        Then someone has write the spec and develop the verification. Which is, again, the hard part. If you’ve ever worked when a business or requirements team, you’ll also know that the spec and verification are constantly moving targets. With a lot of time and attention, you can create a whole ecosystem of agents that will output somewhat acceptable code at scale (or so I’ve heard from people I trust), but that just moves the human effort required to develop and maintain the software over to developing and maintaining the automation. Then if anything breaks catastrophically in a way AI can’t fix, your team’s actual software skills have totally stagnated.

    • red_tomato@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      2 days ago

      Most human programmers are bad at architecture. They’re making lots of mistakes too. Perfection is not a criterion for intelligence. In that case no human is intelligent.

      • Boost@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        2 days ago

        Yeah, that’s why software engineering is a valuable skill that demands significant compensation. Even many of the people who do it for a living aren’t that great at it. I don’t even consider myself to be an especially skilled software engineer. There is a lot more to the job than simply writing code and it takes several years to become truly competent, with lots of mistakes along the way.

        Go ahead and read my comment again and let me know where I demand perfection or even talk about the criteria for intelligence. Defining intelligence is (imo) more of a philosophical question than a practical one so I don’t find a lot of practical value in speculating on whether or not LLMs posses some kind of intelligence. It’s not really relevant to what I’m talking about.

        My point is that, as it stands right now, I use these models on a daily basis to complete actual work and they cannot be trusted to competently make the kinds of decisions required to build good, maintainable software. Sometimes, if you’re working on a well known common design structure or a common problem, an LLM can pantomime good design decisions (because it’s well represented in the data set) but as soon as you step into a situation that requires actual creativity or must account for non-obvious pitfalls in the codebase, it’s a crapshoot. Far worse than an inexperienced software engineer. I believe this is an inherent limitation of transformer based models because they seem to lack any kind of mechanism for this type of higher order thinking.

        • red_tomato@lemmy.world
          link
          fedilink
          English
          arrow-up
          0
          ·
          2 days ago

          My comment was: AI in 2018 is intelligent in a very different way from AI in 2026.

          The common thread I see is: well AI can do these things well, but fail at these other things. Therefore, it cannot be intelligent.

          Even if the things it fails at are things humans would normally fail at. Any test for intelligence in AI must also apply for humans!

          I want to have a clear cut answer: why isn’t AI of 2026 considered intelligent. No one in this entire thread has given a clear answer - besides gut feelings because they feel uncomfortable with the idea that AI is intelligent.