2h ago

Developer Builds Voice Agent From Scratch Using Claude Code And AssemblyAI API

0
Original post

Step-by-step video to build a voice agent from scratch. I'm doing this using Claude Code, because writing code by hand in 2026 is yucky. I'm using @AssemblyAI's new Voice Agent API, which is all you need to get this done, instead of stitching together 12 different components.

8:10 AM · May 21, 2026 View on X

The Voice Agent API is a complete STT → LLM → TTS pipeline.

Everything happens through a single connection to a single API. You don't need a separate LLM, an STT API, a TTS API, etc.

The API handles interruptions, lets you call tools, and gives you access to a bunch of different voices.

I built something like this about a year ago, and it took quite a bit of time and 4 different API Keys to different services.

You can now do it all with a single pipeline.

Here is the link to the playground if you want to give this a try: https://www.assemblyai.com/dashboard/playground/voice-agent

Thanks to the @AssemblyAI team for partnering with me on this post.

SantiagoSantiago@svpino

Step-by-step video to build a voice agent from scratch. I'm doing this using Claude Code, because writing code by hand in 2026 is yucky. I'm using @AssemblyAI's new Voice Agent API, which is all you need to get this done, instead of stitching together 12 different components.

3:10 PM · May 21, 2026 · 5.7K Views
3:10 PM · May 21, 2026 · 2.4K Views

Here is the YouTube link to the video: https://youtu.be/z-sqQeVmSf8

SantiagoSantiago@svpino

The Voice Agent API is a complete STT → LLM → TTS pipeline. Everything happens through a single connection to a single API. You don't need a separate LLM, an STT API, a TTS API, etc. The API handles interruptions, lets you call tools, and gives you access to a bunch of different voices. I built something like this about a year ago, and it took quite a bit of time and 4 different API Keys to different services. You can now do it all with a single pipeline. Here is the link to the playground if you want to give this a try: https://www.assemblyai.com/dashboard/playground/voice-agent Thanks to the @AssemblyAI team for partnering with me on this post.

3:10 PM · May 21, 2026 · 2.4K Views
3:10 PM · May 21, 2026 · 3.6K Views
Developer Builds Voice Agent From Scratch Using Claude Code And AssemblyAI API · Digg