• TehWorld@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    1 day ago

    “Just” and a 27B model don’t exactly belong in the same sentence if you ask my wallet. 💸

    • percent@infosec.pub
      link
      fedilink
      arrow-up
      2
      ·
      1 day ago

      Yeahhh sorry 😕

      I was fortunate to have bought my graphics card almost a year ago, and for a nice discount (a Black Friday sale, IIRC). I’d love to buy another, but they now cost >2x the price I paid.

      FWIW, you can probably run it on CPU if you have enough RAM. I assume it will be really slow though.

      Might also be worth trying Qwen3.6 35B-A3B. It’s not as “smart” as Qwen3.8 27B, but can be much faster on limited resources.