Client storyEdge AI

Edge AI Delivered in 36 Hours: Rescuing a Project When the Developer Backed Out

A client had a demo deadline and their developer walked away at the last minute. I built the full on-device AI pipeline on an NPU-based Linux board in 36 hours.

36 hfrom handover to working demo
~25 fpsreal-time detection
100%on-device, no cloud
Client
Product start-up (under NDA)
Platform
NPU-based Linux single-board computer
Deadline
Customer demo in 36 hours
Delivered
Camera → NPU detection → app output

The problem

The client had a customer demo booked. The product needed a camera, real-time object detection on an NPU, and results sent to their application. Two days before the demo, their developer backed out. What remained was a board, a trained model and an empty repository.

Give me the board, the model and the demo script. We will plan the next 36 hours around what the customer needs to see.
First message to the client

How I planned 36 hours

With no time for exploration, I cut scope to what the demo needed and did the riskiest work first.

  1. Hours 0–4: prove the NPU path

    Converted the model with the vendor toolkit, quantised it with sample frames and confirmed it ran on the NPU with correct outputs. Everything else depended on this.

  2. Hours 4–12: camera pipeline

    Brought up the camera with hardware-accelerated capture and resize, so frames reached the NPU without wasting CPU.

  3. Hours 12–24: application

    Built the inference loop, post-processing, tracking and a lightweight interface that sends results to the client's app.

  4. Hours 24–32: harden

    Auto-start on boot, recovery if the camera disconnects, logging, and a long soak test.

  5. Hours 32–36: rehearse

    Ran the full demo script with the client twice and fixed the last rough edges.

What the client got

Results

  • A working edge AI demo, delivered on time.
  • Real-time detection at about 25 frames per second, fully on the device.
  • Clean, documented code they could continue to build on after the demo.
  • A follow-up plan to turn the demo into a production build.
Related guideChoosing an Edge AI SoC: RV1106 vs RK3566 vs RK3588 vs i.MX 8M Plus vs Jetson Orin Nano
Nikhil Robinson

Embedded systems consultant at TechProgeny, Bengaluru. 7+ years and 29+ shipped products across firmware, embedded Linux, edge AI, apps and IoT servers.