Client storyEdge AI

From Raspberry Pi to ESP32-S3: Same AI Accuracy at a Fraction of the Cost, Proven With Benchmarks

A client ran a small vision model on a Raspberry Pi and the unit cost was killing the business case. I moved it to an ESP32-S3 and convinced them with side-by-side benchmarks on real data.

~1%accuracy difference
~70%lower compute cost per unit
~10×lower power draw
Client
Smart device maker (under NDA)
Before
Raspberry Pi + camera
After
ESP32-S3 + camera module
Model
Small image classification and detection

The problem

The client's product used a Raspberry Pi to run a small vision model. It worked well in the prototype, but at production volume the Pi, its power supply and its SD card made the product too expensive, and too power-hungry for the enclosure they wanted.

When I suggested an ESP32-S3, the reaction was what you would expect: a microcontroller can't run our AI model. The only way to answer that was with data.

How I proved it

  1. Define success

    We agreed on the metrics up front: accuracy on their own test images, time per inference, and power.

  2. Shrink the model

    I retrained a smaller architecture with the same classes and quantised it to 8-bit using Espressif's ESP-DL tooling, which uses the ESP32-S3's vector instructions.

  3. Benchmark side by side

    Both devices ran the same test set. I published a short report with accuracy, latency and power for each.

  4. Test on the real camera

    Calibration and validation used frames from the product's actual camera, not internet images.

Benchmark summary on the client's test set (approximate)
MetricRaspberry PiESP32-S3
Accuracy~96%~95%
Inference time~40 ms~180 ms (well inside the 500 ms need)
Typical power~3 W~0.3 W
Compute cost per unitBaseline~70% lower

What the client got

Results

  • The same practical accuracy at a much lower unit cost.
  • A battery-friendly design that fits the smaller enclosure.
  • A benchmark report they used to convince their own investors.
  • A model training and quantisation pipeline they can rerun as data grows.
Related guideCan an ESP32-S3 Run Your AI Model? How to Benchmark Before You Buy a Raspberry Pi
Nikhil Robinson

Embedded systems consultant at TechProgeny, Bengaluru. 7+ years and 29+ shipped products across firmware, embedded Linux, edge AI, apps and IoT servers.