panos@catodon.rocks to Technology@lemmy.worldEnglish · 2 days agoAnthropic logged net loss of over $80 billion in first half of 2026www.reuters.comexternal-linkmessage-square286linkfedilinkarrow-up11arrow-down10cross-posted to: [email protected]
arrow-up11arrow-down1external-linkAnthropic logged net loss of over $80 billion in first half of 2026www.reuters.companos@catodon.rocks to Technology@lemmy.worldEnglish · 2 days agomessage-square286linkfedilinkcross-posted to: [email protected]
minus-squareMwa@thelemmy.clublinkfedilinkEnglisharrow-up0·2 days agoi would not recommend using the SSD to run local LLMS,its slow best: VRAM only good: VRAM + RAM bad: Swapping
minus-squareelfin8er@lemmy.worldlinkfedilinkEnglisharrow-up0·2 days agoI don’t think they’re insinuating running inferences from the SSD. But you need somewhere to store the weights for the GPU to load.
minus-squareMwa@thelemmy.clublinkfedilinkEnglisharrow-up0·2 days agoi am trying to say: you need the SSD to store it but not swap to it due to its slowness
i would not recommend using the SSD to run local LLMS,its slow
best: VRAM only
good: VRAM + RAM
bad: Swapping
I don’t think they’re insinuating running inferences from the SSD. But you need somewhere to store the weights for the GPU to load.
i am trying to say: you need the SSD to store it but not swap to it due to its slowness