

Only if you’re facelesss
Structural Biologist interested in Protein Design. I also write code.


Only if you’re facelesss


If police can do this to normal citizens, normal citizens should be allowed to do this to the police. If they have nothing to hide, why would it be a problem?


Sure, but they’re not hiring Open AI to do custom work. They’re hiring some third party who well might use their own servers. Even if they are hiring Open AI there will be a thousand competitors in no time. There’s no meaningful cost barrier to set up a local AI. Sure scaling costs a little, but really not much. It’s a foolish investment that only works if people are incompetent… okay so might work a little, but it’s still stupid.


Their investors better hope that’s not their plan. It’s a terrible business plan, local open AIs will crush any attempt at profit. Local open AIs would already be crushing profits if business were run sensibly. You don’t have to train a whole model from scratch. You can just give a pre-trained model your toolset and prompts (things you’d’ve had to make anyway) and call it a day.
The main issue with Open / Local LLMs is the lack of broad support. It’s not hard for me to run Local LLMs, but apparently a decade of informal python experience and using linux mint is intimidating to some people. Apparently people want to click button and talk to phone god? Mostly speaks of a failing education system if you ask me.
I’m not even that good with AI, I just lurked a bit on !LocalLLaMA@sh.itjust.works and got mine running at like 30 tokens/second on my laptop.
Surveillance is Terrorism as far as I’m concerned.