I felt sorry for it and stopped it, 14min and the poor thing was just going around in circles.

I’m just looking at running some local llm on my m2 16GB mac and this was with the default settings for the qwen3.5 9b in LM Studio. Any pointers to get the best out of a M2?

  • Matty_r@programming.devEnglish
    0·
    9 days ago

    Quick question, running a 9070xt here, what’s the quickest/easiest way to get started running this locally? What’s the most privacy respecting/trusted/safe way to run this stuff? Not after a fully blown agent I guess, something to help with my coding mostly as a search engine. I’m pretty ignorant on how this all comes together sorry. Do I even bother?

    • BlueÆther@no.lastname.nzOPEnglish
      0·
      9 days ago

      That is my current journey - trying to figure it out.

      I want this from a local LLM:

      • Coding assistant, mostly for projects for my self and general self hosting problems
      • General chatboy, chatGPT style for quick responses
      • A LLM to help my daughters learn ‘AI’, both home schooled
      • A LLM to encourage the younger one to push writing ideas

      I started with Automatic1111 ~2 years ago for generative image AI but uninstalled it at some time. In the last weekend I’ve installed LM Studio and Bionic and have been recomended Hermes as an agent.