• 133 Posts
  • 420 Comments
Joined 3 years ago
cake
Cake day: June 7th, 2023

help-circle


  • I started using Linux for science. I was using a Raspberry Pi for a study and got to learn some basic stuff as part of that. Then I started to deploy my own Pis at home for self-hosting different apps I like, like Pihole. I also have an ancient desktop I bought on clearance that was running terribly, so I put Ubuntu on it and that solved a lot of performance issues! I host some stuff on there too.

















  • I expect that many companies will realize that an LLM is a tool that can help with certain tasks, but cannot fully replace most workers because there is a ton of context in people’s jobs that cannot be condensed into language. Similarly, many companies are now realizing with token-based pricing that frontier LLMs are not cost effective in many applications. You shouldn’t have a natural gas fired data center in Tennessee running a model to proofread your emails. You can have a local model do so MUCH more cheaply. This will leave the speculative data center companies holding the bag on a lot of hardware and capacity that is not actually needed.