Success Metrics for Outbound Financial Voice Agents (Full Transcript)

Aviary AI’s CEO explains how to evaluate voice agents: prioritize task completion, voice quality, and latency, and iterate as metrics evolve.
Download Transcript (DOCX)
Speakers
add Add new speaker

[00:00:00] Speaker 1: Evening, everyone. I'm from Chicago, by the way, so I brought the snow and I'm not bringing the cold yet. I'm gonna go back to the cold tomorrow, but great to meet you guys. Great to be here. I'm the CEO and co-founder of Aviary AI. What we do is we provide voice agents for the financial services space, so credit unions, banks, and life insurance companies. We're specifically focused in on outbound right now. We have not gotten into inbound. It's really important to set the baseline of like, what do you guys define as success? What is the adherence of what you consider poor? There's really two things that I think our customers really care about from a voice perspective is voice quality and latency. It's easy to over-index on the idea that like, you have it perfect. Ultimately for every single call, whether it's inbound or outbound, did you complete the task that you were meant to go do is the ultimate side of it, right? Like, I think that's one thing too to just remember as you guys are building this piece out is we all want perfection. That's what we all strive for, but level setting the expectation that, you know, again, did it accomplish what you intended it to do? Yeah, maybe there was some redundancy in the conversation. That's okay, but like it accomplished what you needed it to do. So it is a moving target. I can just tell you that we're still playing around with it on a constant basis.

ai AI Insights
Arow Summary
The CEO and co-founder of Aviary AI describes building outbound voice agents for financial services (credit unions, banks, life insurers). He emphasizes defining success criteria and what counts as poor adherence, noting that customers care most about voice quality and latency. He advises not to over-optimize for perfection; the key measure is whether each call accomplishes its intended task, even if the conversation has some redundancy. Success metrics are a moving target and require ongoing iteration.
Arow Title
Aviary AI on Success Metrics for Financial Voice Agents
Arow Keywords
Aviary AI Remove
voice agents Remove
financial services Remove
outbound calls Remove
banks Remove
credit unions Remove
life insurance Remove
success metrics Remove
voice quality Remove
latency Remove
task completion Remove
adherence Remove
conversation design Remove
iteration Remove
Arow Key Takeaways
  • Define clear success metrics and what constitutes poor adherence before deploying voice agents.
  • In financial services voice applications, voice quality and low latency are top customer priorities.
  • Don’t over-index on perfection; task completion is the primary measure of success per call.
  • Some conversational redundancy can be acceptable if the agent achieves the intended outcome.
  • Voice agent performance targets evolve; expect ongoing tuning and iteration.
Arow Sentiments
Positive: The tone is upbeat and pragmatic, focusing on meeting people, sharing lessons learned, and encouraging realistic success criteria over perfectionism.
Arow Enter your query
{{ secondsToHumanTime(time) }}
Back
Forward
{{ Math.round(speed * 100) / 100 }}x
{{ secondsToHumanTime(duration) }}
close
New speaker
Add speaker
close
Edit speaker
Save changes
close
Share Transcript