I felt sorry for it and stopped it, 14min and the poor thing was just going around in circles.

I’m just looking at running some local llm on my m2 16GB mac and this was with the default settings for the qwen3.5 9b in LM Studio. Any pointers to get the best out of a M2?

  • BlueÆther@no.lastname.nzOPEnglish
    0·
    9 days ago

    That is my current journey - trying to figure it out.

    I want this from a local LLM:

    • Coding assistant, mostly for projects for my self and general self hosting problems
    • General chatboy, chatGPT style for quick responses
    • A LLM to help my daughters learn ‘AI’, both home schooled
    • A LLM to encourage the younger one to push writing ideas

    I started with Automatic1111 ~2 years ago for generative image AI but uninstalled it at some time. In the last weekend I’ve installed LM Studio and Bionic and have been recomended Hermes as an agent.