SnausagesinaBlanket@lemmy.world to Ask Lemmy@lemmy.world · 5 days agoIs there a currently an accurate way to say how much power per prompt LLMs use?message-squaremessage-square23linkfedilinkarrow-up147arrow-down15
arrow-up142arrow-down1message-squareIs there a currently an accurate way to say how much power per prompt LLMs use?SnausagesinaBlanket@lemmy.world to Ask Lemmy@lemmy.world · 5 days agomessage-square23linkfedilink
minus-squarechicken@lemmy.dbzer0.comlinkfedilinkarrow-up2arrow-down1·edit-23 days agoI have a LLM server on my computer, so I can tell how much electricity it is using this way. It’s not somewhere else is how
minus-squareSnausagesinaBlanket@lemmy.worldOPlinkfedilinkarrow-up2arrow-down5·3 days agodeleted by creator
minus-squarechicken@lemmy.dbzer0.comlinkfedilinkarrow-up4·3 days agoYou asked if there’s a way to tell how much power LLMs use, you didn’t specify LLMs on a server you don’t have physical access to.
minus-squareSnausagesinaBlanket@lemmy.worldOPlinkfedilinkarrow-up2arrow-down3·3 days agodeleted by creator
I have a LLM server on my computer, so I can tell how much electricity it is using this way. It’s not somewhere else is how
deleted by creator
You asked if there’s a way to tell how much power LLMs use, you didn’t specify LLMs on a server you don’t have physical access to.
deleted by creator