Otter Raft@lemmy.ca to Selfhosted@lemmy.worldEnglish · 4 months agoGPU prices are coming to earth just as RAM costs shoot into the stratosphere - Ars Technicaarstechnica.comexternal-linkmessage-square57fedilinkarrow-up1324arrow-down15cross-posted to: bapcsalescanada@lemmy.cahardware@lemmy.world
arrow-up1319arrow-down1external-linkGPU prices are coming to earth just as RAM costs shoot into the stratosphere - Ars Technicaarstechnica.comOtter Raft@lemmy.ca to Selfhosted@lemmy.worldEnglish · 4 months agomessage-square57fedilinkcross-posted to: bapcsalescanada@lemmy.cahardware@lemmy.world
minus-squarekrooklochurm@lemmy.calinkfedilinkEnglisharrow-up11·4 months agoSo… the models are all trained up and now they need to run them is what I’m reading. You need lots of vram to train a model. An llm once trained can be run in much less vram and a lot of ram
So… the models are all trained up and now they need to run them is what I’m reading.
You need lots of vram to train a model.
An llm once trained can be run in much less vram and a lot of ram