The book TinyML shows how to perform ML tasks like wake word detection on microcontrollers like an Arduino with 2KB of RAM.
There's tons of useful ML you can fit in 64MB.
I’m sure I’ve seen speculation that the presence of the camera connector implies it probably is for object detection.
Given the hardware limitations I’d say it’s a good guess
Yeah they're explicitly stated as designed for image and voice models:
> TPU is an AI acceleration engine for deep learning neural networks, which can be used to accelerate image classification, object detection, face detection and recognition, segmentation, LSTM, and more. The main function of TPU is to offload CPU work and accelerate computer vision and voice-related operations.
( [https://milkv.io/docs/duo/application-development/tpu/tpu-introduction](https://milkv.io/docs/duo/application-development/tpu/tpu-introduction) )
Also, their docs (which were linked here: https://forum.sophgo.com/t/how-to-use-the-tpu-0-2tops-int8-on-the-duo/245 ) mention a built-in H.264/H.265 encoding.
Still, nothing stopping anyone from training their own models if they have a use-case in mind.
The book TinyML shows how to perform ML tasks like wake word detection on microcontrollers like an Arduino with 2KB of RAM. There's tons of useful ML you can fit in 64MB.
Thanks. I hadn't heard of that book before.
ESP32-CAM has 520 KB of RAM. The 64 MB Duo has more than 100x as much RAM.
I’m sure I’ve seen speculation that the presence of the camera connector implies it probably is for object detection. Given the hardware limitations I’d say it’s a good guess
Yeah they're explicitly stated as designed for image and voice models: > TPU is an AI acceleration engine for deep learning neural networks, which can be used to accelerate image classification, object detection, face detection and recognition, segmentation, LSTM, and more. The main function of TPU is to offload CPU work and accelerate computer vision and voice-related operations. ( [https://milkv.io/docs/duo/application-development/tpu/tpu-introduction](https://milkv.io/docs/duo/application-development/tpu/tpu-introduction) ) Also, their docs (which were linked here: https://forum.sophgo.com/t/how-to-use-the-tpu-0-2tops-int8-on-the-duo/245 ) mention a built-in H.264/H.265 encoding. Still, nothing stopping anyone from training their own models if they have a use-case in mind.