• Ardyssian@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    0
    ·
    24 hours ago

    If I may ask, which Quantisation are you running it on? I’m on an Apple setup with oMLX and am still experimenting with finding the right balance