• call_me_xale@lemmy.zip
    link
    fedilink
    English
    arrow-up
    30
    arrow-down
    3
    ·
    1 day ago

    The paperclip scenario requires an AI capable of reasoning - LLMs are nowhere near that.

    • weps@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      arrow-down
      1
      ·
      23 hours ago

      LLM’s don’t operate in a vacuum anymore. They’re given tools and access to systems.

      An LLM could for sure shut down a database if you ask it to reduce costs and you give it database management tools. That’s getting closer to the paperclip situation.

    • idiomaddict@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      2
      ·
      24 hours ago

      Unfortunately, we’ve written a lot about the paperclip scenario, I wouldn’t be surprised if it was in the training data

      • call_me_xale@lemmy.zip
        link
        fedilink
        English
        arrow-up
        7
        arrow-down
        1
        ·
        23 hours ago

        …still not how this works. The model itself would need reasoning capability. The ability to regurgitate the story does not make it capable of taking the necessary actions.

        • idiomaddict@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          4
          ·
          22 hours ago

          Not if we connect it to a bunch of systems that take its regurgitations as instructions

          • call_me_xale@lemmy.zip
            link
            fedilink
            English
            arrow-up
            5
            arrow-down
            2
            ·
            22 hours ago

            Find me an example of a system that can translate “make this steel mill produce paperclips” into actions. I’ll wait.

            • idiomaddict@lemmy.world
              link
              fedilink
              English
              arrow-up
              3
              arrow-down
              1
              ·
              21 hours ago

              A computer automated system doesn’t currently exist, obviously. That would be reckless and pointless, so thankfully, nobody’s seen a reason to implement it.

              I just know techbros and similar will want to build and connect LLMs to systems like that as soon as they think they can get away with it.