• elucubra@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    4
    arrow-down
    1
    ·
    edit-2
    2 months ago

    Only if LLMs are the only option. A paradigm change is coming. It’s like what happened when European and Japanese performance cars started to take on American muscle cars or SpaceX (yeah I hate the Nazitard too) started recovering rockets and reusing them, or PCs started replacing mainframe workstations…

    • eleitl@lemmy.zip
      link
      fedilink
      English
      arrow-up
      3
      ·
      2 months ago

      Look at the enormous processing resources of biological brains. Human brain is 2% of body mass but 20% of baseline metabolism – this is very expensive evolutionary. Neural hardware used for LLMs or just any scientific numerics accelerator is just a bad reinvention. Your argument reminds me of Minsky’s “5 MIPS is enough for AI”. Nope. You have to track a lot of state, its relationships and refresh it all very quickly. Computation is expensive.

      • elucubra@sopuli.xyz
        link
        fedilink
        English
        arrow-up
        1
        ·
        2 months ago

        Really? Where could I find information about that? If the rockets (first stage) weren’t reused, there is no way that SpaceX could charge the Kg to orbit prices they charge.