Stm32 has made micro controllers with neural processors for years now and you don’t need LLMs to do a lot of useful stuff for a spyware company. A small model can run even in really constrained hardware if you train it specifically for it. Afaik the STM32 ones are for machine vision processing on limited hardware where power is a concern. I’m sure you can do a lot more with a TV with constant power.
That’s exactly the distinction I was making. The person I was replying to said “Imagine believing that they need “AI” to record us.” I was clarifying that this isn’t the AI we hear so much about that requires huge datacenters; it’s the kind of simple, embedded, “edge” AI that you can do with whatever microcontroller you have lying around.
Stm32 has made micro controllers with neural processors for years now and you don’t need LLMs to do a lot of useful stuff for a spyware company. A small model can run even in really constrained hardware if you train it specifically for it. Afaik the STM32 ones are for machine vision processing on limited hardware where power is a concern. I’m sure you can do a lot more with a TV with constant power.
That’s exactly the distinction I was making. The person I was replying to said “Imagine believing that they need “AI” to record us.” I was clarifying that this isn’t the AI we hear so much about that requires huge datacenters; it’s the kind of simple, embedded, “edge” AI that you can do with whatever microcontroller you have lying around.
Yeah I know I was agreeing with you
Ah, sorry. Sometimes I can’t tell because of the threading here.
Its ok, text is also really ambiguous so I don’t blame you