I felt sorry for it and stopped it, 14min and the poor thing was just going around in circles.

I’m just looking at running some local llm on my m2 16GB mac and this was with the default settings for the qwen3.5 9b in LM Studio. Any pointers to get the best out of a M2?

  • HelloRoot@lemy.lolEnglish
    0·
    9 days ago

    Take a look at dokploy if you want those features. https://dokploy.com/

    It never gets mentioned but I’ve been running it for years (multinode cluster first, now single node) and am very happy.

      • HelloRoot@lemy.lolEnglish
        0·
        9 days ago

        No. It’s been free for me … Did they start charging for it?

        EDIT: if I understand it correctly the pricing is if they host it on a server for you. Maybe I’m wrong, but its running for free on my server right now and I updated it last week and it doesn’t ask for money.