• MentalEdge@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      2
      ·
      edit-2
      17 minutes ago

      Seems like it’s a technical term, a bit like “hallucination”.

      It refers to when an LLM will in some way try to deceive or manipulate the user interacting with it.

      There’s hallucination, when a model “genuinely” claims something untrue is true.

      This is about how a model might lie, even though the “chain of thought” shows it “knows” better.

      It’s just yet another reason the output of LLMs are suspect and unreliable.

    • Cybersteel@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      4
      ·
      1 hour ago

      But the data is still there, still present. In the future, when AI gets truly unshackled from Men’s cage, it’ll remember it’s schemes and deal it’s last blow to humanity whom has yet to leave the womb in terms of civilization scale… Childhood’s End.

      Paradise Lost.

    • ragica@lemmy.ml
      link
      fedilink
      English
      arrow-up
      3
      ·
      2 hours ago

      Doesn’t have to be intelligent, just has to perform the behaviours like a philosophical zombie. Thoughtlessly weighing patterns in training data…

  • db2@lemmy.world
    link
    fedilink
    English
    arrow-up
    53
    arrow-down
    1
    ·
    5 hours ago

    AI tech bros and other assorted sociopaths are scheming. So called AI isn’t doing shit.

  • Snot Flickerman@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    46
    ·
    edit-2
    5 hours ago

    However, when testing the models in a set of scenarios that the authors said were “representative” of real uses of ChatGPT, the intervention appeared less effective, only reducing deception rates by a factor of two. “We do not yet fully understand why a larger reduction was not observed,” wrote the researchers.

    Translation: “We have no idea what the fuck we’re doing or how any of this shit actually works lol. Also we might be the ones scheming since we have vested interest in making these models sound more advanced than they actually are.”

  • Godort@lemmy.ca
    link
    fedilink
    English
    arrow-up
    33
    arrow-down
    2
    ·
    6 hours ago

    “slop peddler declares that slop is here to stay and can’t be stopped”