How to Prove Outbound Call Quality With Clear Metrics (Full Transcript)

Define success, focus on reputational risk, measure technical issues, and track “natural goodbyes” to demonstrate human-like, high-quality outbound calls.
Download Transcript (DOCX)
Speakers
add Add new speaker

[00:00:00] Speaker 1: It's really important to set the baseline of like, what do you guys define as success? What is the adherence of what you consider poor? Like for us, we try to tell them, like if you think a poor call is because it didn't sound the way that you wanted it to sound, it shouldn't be considered a poor call. A poor call is, is this a reputational risk for your business or not? Like having those definitions matters so that you can set the expectations with them, especially if they've never done these before. I'm not even talking about AI calls, just outbound calls in general. That's one part of it, right? A lot of the qualitative stuff that we started to do now is, or I'm sorry, the quantitative stuff that we've actually started to do now has been measuring out how many technical issues are we dealing with on-call. Now, my dev team, including Julian, who's in the back, wants to kill me because of that, but like we want to measure it so that we can see of all of our connected calls, how many of these are things that we can actually address versus not address so that we can go in and say, for every single dev cycle that we do, here's how we're gonna attack this because quality matters now, right? More than ever. It's still sexy. There's a lot of space where people still don't know enough about this, but focusing in on how many of these are actually quality calls, the other big measure that we have internally, and we share these with clients and they love this, is how many of these calls are ending in a natural goodbye. So regardless of if there was a double thought, if there was a long delay from a perspective, what you can go out and show them is, hey, this call ended in a natural goodbye, like a human being had that same conversation. So really from a quality perspective, and so we've been measuring that and that's been a big, big sticking point to prove that these calls are actually going well.

ai AI Insights
Arow Summary
The speaker argues that successful outbound/AI calling programs require clear, shared definitions of success and “poor” calls, focusing on reputational risk rather than subjective style preferences. They describe adding quantitative quality metrics, including tracking technical issues during connected calls to prioritize fixes in development cycles. A key client-facing indicator of call quality is the share of conversations that end with a natural goodbye, suggesting the interaction felt human even if there were delays or imperfections.
Arow Title
Defining and Measuring Quality in Outbound/AI Calls
Arow Keywords
baseline definitions Remove
success criteria Remove
poor call definition Remove
reputational risk Remove
outbound calling Remove
AI calls Remove
quality metrics Remove
technical issues Remove
connected calls Remove
development cycle Remove
natural goodbye Remove
client reporting Remove
Arow Key Takeaways
  • Align with stakeholders on what “success” and “poor” mean; avoid judging calls by subjective sound/style.
  • Define “poor call” primarily as reputational risk rather than minor conversational imperfections.
  • Instrument operations to quantify on-call technical issues across connected calls to guide engineering priorities.
  • Use per-dev-cycle reporting to show which issues are addressable and the plan to fix them.
  • Track the percentage of calls ending in a natural goodbye as a strong proxy for human-like, successful interactions.
  • Share these quality metrics with clients to build trust and demonstrate performance.
Arow Sentiments
Positive: The tone is pragmatic and optimistic, emphasizing measurable improvements, client satisfaction with reporting, and confidence that quality-focused metrics can demonstrate calls are going well despite some imperfections.
Arow Enter your query
{{ secondsToHumanTime(time) }}
Back
Forward
{{ Math.round(speed * 100) / 100 }}x
{{ secondsToHumanTime(duration) }}
close
New speaker
Add speaker
close
Edit speaker
Save changes
close
Share Transcript