• ZDL@lazysoci.al
    link
    fedilink
    arrow-up
    0
    ·
    1 day ago

    The worst part about it all is that when (not if) the AI sphere crashes, the memory they hoarded won’t be of any use to regular people. It’s a different kind of format that isn’t useful in PCs or phones or the like.

    • Malyca@lemmy.zip
      link
      fedilink
      arrow-up
      0
      ·
      16 hours ago

      Everybody gets their own media server and we collectively tell Netflix to shove it?

    • lichtmetzger@discuss.tchncs.de
      link
      fedilink
      arrow-up
      0
      ·
      1 day ago

      HBM memory can technically be used by consumer GPUs. In 2015, AMD released the Radeon R9 Fury X which used HBM. When the bubble pops and there’s an extreme oversupply of HBM sitting in warehouses, we will get those types of GPUs back.

      And even if the big players decide not to do it, crazy people in China will build their own products and adapters, they will even desolder HBM from worthless datacentre GPUs.

      Either way, it’s gonna be glorious for us all. Let’s just hold on for a while longer, until all of the dominos have fallen.

    • Riskable@programming.dev
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 day ago

      Nah. If there really is a crash and a sudden glut of AI GPUs and related hardware, it’ll drop the prices of everything PC-related real fast.

      The hardware will absolutely, 100% continue to be used for AI stuff. Nobody is going to buy that stuff in bulk just to start desoldering chips. That would be stupid, because…

      The demand for AI is just too damned high! If anyone can bid on OpenAI’s bankruptcy hardware sale, either one BIG player is going to take it all (read: Microsoft… Which was the plan all along I swear!) or it’ll be sold in batches and loads of small AI companies (including startups) will get it cheap.

      Small companies are already reselling tokens on their tiny little hardware farms using open models like GLM and Qwen. Anyone with the hardware can do so, and there’s loads of money to be made doing it. So why would businesses bother trying to use that memory for anything else? They wouldn’t.

      However, a huge sale will create a glut regardless, which will almost immediately drop prices by some huge amount. The demand will slowly go back up—because AI demand is still growing—but we’ll all get relief for probably six months to a year.

      Listen to me: If that happens, that is when you want to buy a new GPU/PC! Wait like 2-3 months after OpenAI’s bankruptcy announcement (save that money), then spend it on the best hardware you can get. Because the demand for AI isn’t going anywhere. It’s just going to drop back down into reality: Where they only build data centers where it makes sense. As in, where there’s actually plenty of power available (or they can just install a zillion solar panels).

      • lichtmetzger@discuss.tchncs.de
        link
        fedilink
        arrow-up
        0
        ·
        1 day ago

        because AI demand is still growing

        Is it, though? Most of OpenAIs customers are free users and outside of the coding sphere there isn’t a major usecase for LLMs. When the bubble pops and people will have to pay a lot more for their token usage, a lot of them will just turn away. The free users will never convert to a paid model as well.

        Nobody is going to buy that stuff in bulk just to start desoldering chips.

        Don’t underestimate Chinese vendors doing absolutely everything to turn a profit.

        • Riskable@programming.dev
          link
          fedilink
          English
          arrow-up
          0
          ·
          8 hours ago

          It’s the code generation and automation uses that are growing. I don’t know about casual use or using AI for office tasks.

          AI providers that offer API access don’t have enough hardware to support the demand. They keep increasing prices (the roundabout way by slowing down requests, reducing the amount of included tokens in tiers, and replacing models with new ones that use more tokens) and that’s still not enough to reduce demand.

          Using AI to code and automate stuff is probably its most effective use. But most people don’t see it. Is all business/enterprise stuff happening behind the scenes.

    • DillDough@lemmy.zip
      link
      fedilink
      arrow-up
      0
      ·
      1 day ago

      It’s here to stay, the US is literally using it for pre crime policing. It’s permanent and a far bigger deal than anybody realizes.

      • ZDL@lazysoci.al
        link
        fedilink
        arrow-up
        0
        ·
        1 day ago

        It is absolutely not here to stay. You sound like the bitcoin dweebs of a while ago. “THIS WILL CHANGE THE WORLD! GET IN NOW OR YOU’LL BE LEFT BEHIND AS THE WORLD SWITCHES TO DEFI! LINE GO UP! TO THE MOON!”

        Where is bitcoin and its paired nonsense now? Oh, right. Something only dweebs use.

        • DillDough@lemmy.zip
          link
          fedilink
          arrow-up
          0
          ·
          11 hours ago

          Get some reading comprehension, I’m not hyping this shit up. It does not matter how high the rate of wrong info, hallucinations, or wrongful arrests, the corps and governments will never give that power up. The world HAS changed. This is nothing like crypto and it is already applied.

          • ZDL@lazysoci.al
            link
            fedilink
            arrow-up
            0
            ·
            10 hours ago

            Learn to read a fucking balance sheet before you start telling other people about reading comprehension, Sparky.

            • DillDough@lemmy.zip
              link
              fedilink
              arrow-up
              0
              ·
              9 hours ago

              Not an electrician and I can read balance sheets…you got a relevant one you wish to share on the subject or are you just being an ignorant dipshit?

      • dumnezero@piefed.social
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 day ago

        The detection models used for surveillance use less energy, and centralization means “one big customer”. It won’t play out so neatly for the fascists. Of course, the tech bro capital wants to be part of the MIC where they get corporate welfare (socialism for the rich.)