themachinestops@lemmy.dbzer0.com to Technology@lemmy.worldEnglish · 1 month agoScientist says RAM pricing has risen to normalized 2007 levels, AI shortage undid 20 years of progress in a matter of months — memory prices had been falling exponentially for decadeswww.tomshardware.comexternal-linkmessage-square104linkfedilinkarrow-up190arrow-down10
arrow-up190arrow-down1external-linkScientist says RAM pricing has risen to normalized 2007 levels, AI shortage undid 20 years of progress in a matter of months — memory prices had been falling exponentially for decadeswww.tomshardware.comthemachinestops@lemmy.dbzer0.com to Technology@lemmy.worldEnglish · 1 month agomessage-square104linkfedilink
minus-squarevala@lemmy.dbzer0.comlinkfedilinkEnglisharrow-up1·1 month agoDeepseek v4 Flash is insanely good and basically free. Especially the latest model which I think is only available from China right now.
minus-squarebrucethemoose@lemmy.worldlinkfedilinkEnglisharrow-up1·edit-21 month ago which I think is only available from China right now. Nah, 0731 weights were released. I’m running it locally right this second. I don’t know about Deepseek API specifically, but there are tons of places to get it.
minus-squarejaschen306@sh.itjust.workslinkfedilinkEnglisharrow-up0·1 month agoYou are Mr. moneybags or you’re running 2 or 4bit quantized.
minus-squarebrucethemoose@lemmy.worldlinkfedilinkEnglisharrow-up0·edit-21 month agoI have a 3090, 7800, and 128GB ram from pre-rampocalypse. It’s not nothing, but there are definitely crazier home labs. Deepseek V4 is native 4 bit. I am running this quant, but the quantization loss is measurably low: https://huggingface.co/Downtown-Case/DeepSeek-V4-Flash-0731-128GB-RAM-IK-GGUF The native MXFP4 is only a bit bigger.
minus-squareboonhet@sopuli.xyzlinkfedilinkEnglisharrow-up0arrow-down2·1 month agoA used 3090 alone is like what, 4-5k now? Your setup isn’t really achievable for most now.
minus-squareblackberry28@sh.itjust.workslinkfedilinkEnglisharrow-up1·1 month agoLol what? I just checked, on eBay I can find a lot of offers between 800 Euros and 1300 Euros for a used RTX 3090. 4-5k would get you a brand new RTX 5090.
Deepseek v4 Flash is insanely good and basically free. Especially the latest model which I think is only available from China right now.
Nah, 0731 weights were released. I’m running it locally right this second.
I don’t know about Deepseek API specifically, but there are tons of places to get it.
You are Mr. moneybags or you’re running 2 or 4bit quantized.
I have a 3090, 7800, and 128GB ram from pre-rampocalypse. It’s not nothing, but there are definitely crazier home labs.
Deepseek V4 is native 4 bit.
I am running this quant, but the quantization loss is measurably low: https://huggingface.co/Downtown-Case/DeepSeek-V4-Flash-0731-128GB-RAM-IK-GGUF
The native MXFP4 is only a bit bigger.
A used 3090 alone is like what, 4-5k now?
Your setup isn’t really achievable for most now.
Lol what? I just checked, on eBay I can find a lot of offers between 800 Euros and 1300 Euros for a used RTX 3090. 4-5k would get you a brand new RTX 5090.