Building voice agents for a while now, and the section I always wanted someone else to write is the one on streaming TTS: single-shot vs output-streaming vs dual-streaming, mid-stream cancellation, buffer draining on barge-in, and how much of the “TTFB” number vendors quote is actually front-end latency vs model latency. So I wrote it into an awesome-list. The whole list is organized around one split: real-time TTS (for agents) vs offline TTS (for media). Every provider, model, and benchmark carries that lean. The four sections most useful for agent builders: Streaming and low-latency (taxonomy, cancellation, honest benchmarking) Open-source models filtered by license — several of the top ones can’t be shipped commercially Audio codecs (this decides latency and quality floor for codec-LM TTS) Evaluation — how to measure TTFB on your own traffic instead of trusting vendor benchmarks Deliberately scoped to TTS only. STT, VAD, turn detection, and telephony are pipeline concerns and belong elsewhere. MIT license. Feedback welcome, especially on the streaming taxonomy and cancellation subsection since I’m not sure I’ve captured every edge case. submitted by /u/mahimairaja
Originally posted by u/mahimairaja on r/ArtificialInteligence