silence7@slrpnk.net to Technology@lemmy.worldEnglish · 7 days agoAI’s Memorization Crisis | Large language models don’t “learn”—they copy. And that could change everything for the tech industry.www.theatlantic.comexternal-linkmessage-square8linkfedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkAI’s Memorization Crisis | Large language models don’t “learn”—they copy. And that could change everything for the tech industry.www.theatlantic.comsilence7@slrpnk.net to Technology@lemmy.worldEnglish · 7 days agomessage-square8linkfedilink
minus-squareTechnus@lemmy.ziplinkfedilinkEnglisharrow-up1·7 days agoIt’s glorified autocorrect (/predictive text). People fight me on this every time I say it but it’s literally doing the same thing just with much further lookbehind. In fact, there’s probably a paper to be written about how LLMs are just lossily compressed Markov chains.
It’s glorified autocorrect (/predictive text).
People fight me on this every time I say it but it’s literally doing the same thing just with much further lookbehind.
In fact, there’s probably a paper to be written about how LLMs are just lossily compressed Markov chains.