• 0 Posts
  • 8 Comments
Joined 3 years ago
cake
Cake day: June 2nd, 2023

help-circle


  • The blog article you link I think implies you do not have your own VM. LLMs are stateless, the previous conversation is fed in as part of the prompt.

    You send your message, which is E2E encrypted. The LLM runs in an environment where it can decrypt your message and run in through the LLM, then send a response to you. Then it gets the next user’s message and replies to them.

    The key part is that the LLM is running inside an encrypted environment not accessible to the host system, so no one can watch as it decrypts your message.

    That’s what I get from reading your links.




  • Linux’s problem is that it’s not an OS, and so suggesting people use Linux doesn’t give them much advice.

    The next problem is that linux based OSs are generally open source, which means it can be forked any number of times at any point in time.

    There’s this super awesome and super confusing think in open software where you don’t have to use the thing you are given. Want to use facebook? Must use their app. Want to use reddit? Pretty much must use their app, etc.

    But if you want to use Lemmy or Piefed, there are a dozen good choices, none are the wrong answer. Want to use Jellyfin? Well I connect with Kodi on my TV, Swiftfin on my mother’s, the Android Jellyfin app on my in-laws’ TV, Findroid (movies/TV) or Finamp (music) on my phone, etc. You don’t like an app you can still use the service just try another app or make your own. This is awesome, but super confusing to non-technical people.

    Linux distros are the same. There are dozens of popular ones, many of which are based on others, the variety of choices is awesome but for non-technical people they have no idea where to start.



  • Do you have a plan? I have a Home Assistant Voice Preview Edition and it’s great but I don’t think it can do unit conversions without connecting it to an LLM. Timers work locally.

    I guess if it’s an equation you could add automation to pick up on the phrase and reply with the conversion, but that would need each unit to be manually done and wouldn’t work for things like currency conversion that needs live data.

    Also arbitrary things would be challenging, like converting tablespoons of butter into grams or grams of rice into cups.