AssemblyAI Universal 3.5 Pro Lands in Vapi (Full Transcript)

[00:00:00] Speaker 1: Hey, my name is David Lang with Assembly AI and we're really excited to announce that Universal 3.5 Pro is available in VAPI. Let's log into the dashboard and check it out. When you're in the VAPI dashboard, you can go to assistance, open one of your active assistants here, and then click on this transcriber card. When you get into the settings, you can see Assembly AI is a provider, you can select Universal 3.5 Pro from the drop-down, and now you're able to configure the parameters relevant to the model, some of those being keywords. You can boost up to a hundred key terms for custom vocabulary, names, jargon, product terms to help steer transcription towards those terms. To click on advanced, we now expose a mode parameter, so instead of having to worry about which parameters to tweak for better accuracy or better latency, you can now select from one of these modes. We have our prompt feature, so this is a promptable model. You can prompt it with domain, topic, scenario, context to give it additional information to help steer transcription on what's being said. You have language codes which allow you to pass in the specific language codes that the model supports. This helps steer transcription towards those specific languages. This can also be helpful with code switching if you know the specific languages that people will be speaking. Now let's talk to the agent and see it in action.

[00:01:29] Speaker 2: Hi, I'm your guide to Assembly AI, Universal 3.5 Pro, and building voice agents with VAPI. What are you working on?

[00:01:37] Speaker 1: Hey, I'm just building out a voice agent with VAPI using Assembly AI's Universal 3.5 Pro model.

[00:01:44] Speaker 2: That's awesome. Universal 3.5 Pro supports prompt and key terms, agent context, 18 languages, and mode selection for real-time transcription. What kind of use case are you targeting with your voice agent?

[00:01:57] Speaker 1: Yeah, I'm thinking of building a receptionist agent.

[00:02:02] Speaker 2: Great idea. Universal 3.5 Pro can help your receptionist agent by using agent context for more personalized conversations and prompt slash key terms to improve accuracy for specific tasks. Are you planning to support multiple languages or focus on English only?

[00:02:18] Speaker 1: I think just English for now.

[00:02:21] Speaker 2: Perfect. Universal 3.5 Pro excels in English and can handle real-time transcription with context and prompt slash key terms for receptionist tasks.

[00:02:30] Speaker 1: Do you have any specific...? What about some of the other languages that are supported?

[00:02:35] Speaker 2: Universal 3.5 Pro supports 18 languages, so you can easily expand your receptionist agent to handle calls in languages like Spanish, French, German, Italian, and more. Are you considering adding multilingual support in the future?

[00:02:51] Speaker 1: Yeah, I think so, and I really appreciate your help. Thank you. So there you have it. Now in VAPI, you can select Assembly AI's Universal 3.5 Pro model, and we can't wait to see the different voice agents that people stand up with it.