Skip to content
Devendra Jangiddevendra.pro
Voice AI & edge hardwareGoogle Cloud + on-premise deviceOngoing build

Personal engineering build

A voice assistant that runs on hardware I own

A working voice assistant with no cloud speech bill and no audio leaving my control. A Raspberry Pi with a microphone and speaker talks to an automation hub on a cloud VM, which does the listening, thinking and speaking entirely with open-source models.

₹0
Per-minute speech API cost
On-premise
Audio never leaves the network
One VM
Fixed, predictable running cost
Extensible
New devices added without server changes
The situation

What was broken

  • Commercial voice assistants send every recording to somebody else's servers
  • Cloud speech APIs bill per minute, so cost grows exactly as usage grows
  • Off-the-shelf smart speakers cannot be extended to do real work
  • The heavy models will not run on a small device, but the microphone has to be in the room
Whisper (STT)Piper (TTS)Local LLMRaspberry PiGoogle Cloud VMDocker
The work

What was actually done

  1. 01

    Split the work between device and server

    The Raspberry Pi does only what has to happen in the room — capture audio, play audio. Everything expensive runs on the cloud VM. That keeps the device cheap enough to put in several rooms.

  2. 02

    Open-source models, end to end

    Whisper for speech recognition, Piper for speech synthesis, and a local language model for the reasoning. No paid API anywhere in the chain, so running cost is a fixed monthly VM rather than a usage meter.

  3. 03

    A documented protocol between the parts

    Device and server talk over a standard open protocol rather than something bespoke, which means new devices can be added later without touching the server.

  4. 04

    Containerised deployment

    The whole hub runs from a single container definition, so it can be rebuilt from scratch on a new machine in minutes and updated remotely.

CallWhatsAppEnquire