AssemblyAI ships multi-region streaming and dynamic prompts (Full Transcript)

November updates: US East multi-region redundancy, optional EU endpoint, improved self-hosted streaming, dynamic key term updates, language detection, and Gemini 3 Pro on LLM Gateway.
Download Transcript (DOCX)
Speakers
add Add new speaker

[00:00:00] Speaker 1: This month at Assembly AI, we made streaming audio transcription faster, smarter, and accessible everywhere. Here's our full monthly recap for everything we shipped in November. So first up, we released multi-region streaming. We now have our models hosted in US East, which provides regional redundancy and expanded compute capacity for production workload. The infrastructure update reduces single-region dependency, which maintains your service continuity in the event of any regional incident. Your traffic is already being routed automatically based on latency and capacity, so there's nothing you need to do. If you want instead to use EU streaming, you can replace this base URL with our EU1 in your connection configuration right here. We've also released updates and improvements to our self-hosted streaming offering. If you're looking to self-host Assembly AI's streaming model, please get in touch with our team. We've also updated Key Term Prompting to support Dynamic Key Terms Prompt. So you can send an update configuration message with your new key terms, and that way the model will start to buy us for your terms mid-session. We've also added language detection to our streaming utterances, so you'll notice a language code being returned with your terms in our term response. And next, we also released Gemini 3 Pro on LLM Gateway, which is a great addition for any agentic workflows that you're building on your transcriptions. So that was all we had this month. Any relevant links to what we mentioned today are in the description. And I hope to see you again next month. Bye.

ai AI Insights
Arow Summary
AssemblyAI’s November product recap highlights faster, more resilient, and more flexible streaming transcription. Key launches include multi-region streaming with automatic latency/capacity-based routing and US East hosting for redundancy, an optional EU streaming base URL, enhancements to self-hosted streaming for customers who want to run the model themselves, Dynamic Key Terms Prompting that allows updating key terms mid-session via configuration messages, and language detection in streaming utterances (returning a language code alongside terms). The company also added Gemini 3 Pro to its LLM Gateway to support agentic workflows built on top of transcripts.
Arow Title
AssemblyAI November Recap: Multi-Region Streaming & Dynamic Key Terms
Arow Keywords
AssemblyAI Remove
streaming transcription Remove
multi-region streaming Remove
US East Remove
EU streaming Remove
regional redundancy Remove
self-hosted streaming Remove
Key Term Prompting Remove
Dynamic Key Terms Remove
mid-session updates Remove
language detection Remove
streaming utterances Remove
LLM Gateway Remove
Gemini 3 Pro Remove
agentic workflows Remove
Arow Key Takeaways
  • Multi-region streaming is now available with models hosted in US East for redundancy and added capacity.
  • Traffic is auto-routed by latency and capacity; no customer action required for default routing.
  • EU streaming can be used by switching the base URL to the EU1 endpoint.
  • Self-hosted streaming received updates; interested users should contact AssemblyAI.
  • Dynamic Key Terms Prompting lets you update key terms mid-session via a config message.
  • Streaming utterances now include language detection, returning a language code.
  • Gemini 3 Pro was added to LLM Gateway to support agentic workflows on transcripts.
Arow Sentiments
Positive: The speaker emphasizes improvements, new releases, and expanded capabilities (redundancy, faster streaming, new prompting features, added model support), conveying an upbeat product-update tone.
Arow Enter your query
{{ secondsToHumanTime(time) }}
Back
Forward
{{ Math.round(speed * 100) / 100 }}x
{{ secondsToHumanTime(duration) }}
close
New speaker
Add speaker
close
Edit speaker
Save changes
close
Share Transcript