• jj4211@lemmy.world
    link
    fedilink
    English
    arrow-up
    5
    ·
    13 hours ago

    In fact, if the models are ingesting this, they will get dumber because training on LLM output degrades things.

    • Etterra@discuss.online
      link
      fedilink
      English
      arrow-up
      1
      ·
      9 hours ago

      It’s the kind of diminishing returns and self poisoning a person would get by only consuming their own waste. Drinking your own piss in the desert will kill you.

    • HertzDentalBar@lemmy.blahaj.zone
      link
      fedilink
      English
      arrow-up
      2
      ·
      13 hours ago

      Exactly, I hope they hit a slop wall trying to train these things, replace all its original reference points with slop so it just cascades everywhere