• TehWorld@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 day ago

    I’ve been wanting to do this, even as a testbed. I just want computers to do cool shit, and am getting tired of being a Linux sysadmin in my free time. How large of a model do you have assigned to this?

    • percent@infosec.pub
      link
      fedilink
      arrow-up
      2
      ·
      edit-2
      22 hours ago

      Just Qwen3.8-27B. That little model is surprisingly smart.

      NixOS also gives you the ability to roll back to previous config versions. I have not needed to do that (yet), but it reduces some risk.

      • TehWorld@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        7 hours ago

        “Just” and a 27B model don’t exactly belong in the same sentence if you ask my wallet. 💸