The local models thing is the real threat. For what 90% of the world who actually cares and wants AI, a local model is probably already “good enough”. Or would be if they could get the hardware, or maybe they don’t know how to set one up.
Got a 27b model running on my gaming GPU. Its a bit slow but good enough to look someing up, causual coding, and stupid questions.
China is really kicking ass with the open source models.
The local models thing is the real threat. For what 90% of the world who actually cares and wants AI, a local model is probably already “good enough”. Or would be if they could get the hardware, or maybe they don’t know how to set one up.
Got a 27b model running on my gaming GPU. Its a bit slow but good enough to look someing up, causual coding, and stupid questions. China is really kicking ass with the open source models.