daggermoon@lemmy.world to No Stupid Questions@lemmy.world · 1 month agoWhat can I actually do with 64 GB or RAM?message-squaremessage-square101fedilinkarrow-up185arrow-down15file-text
arrow-up180arrow-down1message-squareWhat can I actually do with 64 GB or RAM?daggermoon@lemmy.world to No Stupid Questions@lemmy.world · 1 month agomessage-square101fedilinkfile-text
minus-squarezkfcfbzr@lemmy.worldlinkfedilinkEnglisharrow-up20·1 month agoI have 16 GB of RAM and recently tried running local LLM models. Turns out my RAM is a bigger limiting factor than my GPU. And, yeah, docker’s always taking up 3-4 GB.
minus-squarenutsack@lemmy.dbzer0.comlinkfedilinkEnglisharrow-up9·1 month agovram would help even more i think
I have 16 GB of RAM and recently tried running local LLM models. Turns out my RAM is a bigger limiting factor than my GPU.
And, yeah, docker’s always taking up 3-4 GB.
vram would help even more i think