New Dictation API Delivers Clean, Fast Voice Input (Full Transcript)

[00:00:00] Speaker 1: You've probably seen that little microphone icon at this point on every app you use. That's dictation showing up everywhere right now. And everyone building it hits the same wall which is transcription models are verbatim. They are trained to capture every sound that comes out of your mouth that's okay for a transcript but not okay for dictation. So that's why we built our first dictation API. You send audio you get back text that you'll actually use in 19 languages and shape the way your product needs it. Let's take a look. Um so so I think for the retry logic we should we should back off exponentially and cap it to like 30 seconds. Here's what I said and here's what my app gets. The dictation API gives you the original as well as the cleaned up results and you decide which one your product shows. And the number on the corner right here is not a marketing figure. It's actually how long it took to give you the response. Now let me take a few more takes on different domains on purpose. Can you make our one-on-one move it to Thursday afternoon? Anything after two words. Note for the ticket um the crash only happens after cold starts. So just fix it only for the iOS. Remind me to send Priya the updated pricing deck right before Friday. We need almond milk, coffee filter, and um good bread if they have it. There are two things. The first is speed. The whole point of dictation is to type 3x faster than a keyboard. Second is consistency. The user needs to have the same speed as the keyboard. Okay, so fix is in Lipsodium. Can you can you ping Anjali on the SDK team? A key part of dictation is capturing words accurately. So this runs on our flagship Universal 3.5 Pro model. The same one behind our async and real-time APIs. So let's take a look at the code. So the first thing I'm going to do is I'm going to show you how to do the dictation. The same one behind our async and real-time APIs. This also means the dictation API supports more than just English. And it holds up on how people actually speak. Remind me to ask about my offer letter right before my 4 o'clock. And that's because we want it to work no matter where you are. On a noisy street or in an office. Um, so 45 year old guy, lower back pain, um, going down the left leg. It's been about two weeks. We're gonna put him on a physio twice a week and see him in a month. Out of the box, it cleans up the mess. Out of the box, it cleans up the mess. But if you want something different, you can customize the instructions as well. So the instruction cleans up the output you receive. But prompting shapes how the model hears it. Dictation runs on Universal 3.5 Pro. So the prompt runs the same way like anywhere else on our API. You can pass context about the conversation or the key terms you expect. And the recognition improves before the cleanup ever runs. With the right prompt, you can see the right terms and entities captured correctly. So that's it. With one call, you can quickly build dictation to any product. Fast, customizable, and reliable. Our dictation API is available today. And we can't wait to see what you build with it.