BeatTakeshi@lemmy.world to LocalLLaMA@sh.itjust.worksEnglish · edit-21 day agoI have a RTX A1000 (8GB) with 64GB DRR5, what would you recommend for a newbie?message-squaremessage-square26linkfedilinkarrow-up11arrow-down10file-text
arrow-up11arrow-down1message-squareI have a RTX A1000 (8GB) with 64GB DRR5, what would you recommend for a newbie?BeatTakeshi@lemmy.world to LocalLLaMA@sh.itjust.worksEnglish · edit-21 day agomessage-square26linkfedilinkfile-text
I’m new to local llms, i’m running Debian on this machine. Where should I start and what model(s) could I get testing on it?
minus-squarehendrik@palaver.p3x.delinkfedilinkEnglisharrow-up0·2 days agoYou could try KoboldCpp with the All-in-one Starter Pack V2. Or go through their newbie-templates.
minus-squareBeatTakeshi@lemmy.worldOPlinkfedilinkEnglisharrow-up0·20 hours agoMany thanks, these all in one solutions really interest me, I don’t think I’d have the time to learn how to deploy and connected all individual elements of a full stack myself
You could try KoboldCpp with the All-in-one Starter Pack V2. Or go through their newbie-templates.
Many thanks, these all in one solutions really interest me, I don’t think I’d have the time to learn how to deploy and connected all individual elements of a full stack myself