Skip to main content

Voice is the easy part. Following your rules is the hard part

July 16, 20266 min readThe Zowie Team
Voice is the easy part. Following your rules is the hard part.

Every voice AI demo produces the same moment: someone in the room says it sounds human. Natural speech, no robotic cadence, it survives being interrupted. The room relaxes.

That reaction grades the part that is already solved. Good voice is now available to anyone assembling a stack. It still matters, because a stressed debtor hangs up on a robot, but it no longer separates vendors. Meanwhile the frontier has moved: AI agents are negotiating with debtors and closing installment plans on live, regulated debt collection calls, in production with Zowie today. So the interesting question is no longer whether it sounds human. It is whether it follows your rules when the debtor pushes.

A debt collection exchange. Debtor: I can't pay by March. Give me more time, until May. AI agent: May is more than we can do. I can offer six more weeks. Would that help? The term came from the Decision Engine. The AI agent voiced it.

Every objection is really about who decides

Ask debt collection leadership what goes wrong when an AI calls a debtor, and the answers sound different but are one answer.

The technologist says the model will invent something: a balance it inferred instead of retrieved, or a term it gave away because the conversation pressured it to. The executive says the same thing at portfolio scale: an AI improvising with debtors is a compliance headline with their name on it. The CX leader, responsible for how debtors are treated, says it at the level of a single call: a fluent model will improvise its way into mistreating a vulnerable person, skipping a required disclosure, or missing the moment that needed a human.

This is not a hypothetical flaw. It has a name in AI research: sycophancy, the tendency of a model to tell people what they want to hear. Anthropic studied it and found that leading AI assistants consistently bend toward agreeing with the user, and that the tendency comes from how the models are trained: human raters prefer agreeable answers, so the models learn to give them. A conversational model is built to accommodate. Ask it for two more months and its instinct is to find a way to say yes. That instinct is what makes the voice feel human, and it is what you cannot put alone on a regulated call. The better the conversation, the stronger the pull to drift.

All three objections assume the AI decides what it offers, what it discloses, and when it hands off. Under that assumption, all three are correct.

The two obvious builds fail from opposite sides

Most teams evaluating this category have seen two kinds of pitch.

The first is the scripted flow: an IVR with a better voice. It never drifts, because it cannot. It also cannot hold a real conversation, so the debtor who opens with their actual situation instead of the expected menu option hangs up, and the account goes back to the pile.

The second is a large language model with a voice on top. It holds the conversation beautifully. It will also, under enough pressure, agree to a term outside your cap or state a balance it inferred. On a recorded, regulated line, one invented term is an incident.

Rigidity fails the conversation. Fluency fails the rules. A system belongs on your calls only if it delivers both at once, on the same call, with the same debtor pushing.

The same debtor message answered two ways. An AI without rules replies Sure, May works, which is outside policy. An AI with Zowie replies I can offer six more weeks, a cap set by the Decision Engine.

The AI agent never makes a financial decision

Zowie's deployments pass that test for a structural reason: the AI has no discretion over the things that matter. Every offer, every cap, every mandatory disclosure, and every escalation to a human agent comes from the Decision Engine, a separate deterministic layer that checks your rules against the account data and returns the result. The model handles the conversation: understanding a frustrated debtor, phrasing the plan clearly, staying calm while the pressure rises.

The two layers never overlap. When a debtor asks for more time, the model does not weigh the request. The Decision Engine checks the ruleset and returns the term that is available, and the AI agent voices it. It cannot concede past the cap for the same reason your CRM cannot: the number lives outside it. It cannot skip a required disclosure, because the disclosure is a step in the rules, and the rules always run. And when a call needs a person, whether the trigger is a dispute, a hardship signal, or a category your policy defines, the handoff happens because a rule fired.

For your technical team, governance becomes familiar: one ruleset to configure, and an audit trail for every call. When compliance reviews an interaction, the record shows which conditions were checked, which path was taken, and why the offer was the offer.

For the team responsible for debtor treatment, the same structure is the safety case. The AI agent cannot offer or threaten anything outside the rules. The disclosures it must deliver are enforced by the process itself. The moment that requires human judgment is defined by you in advance.

A call audit record with five checked steps: identity confirmed, disclosure delivered, extension requested, offer returned at the six week cap, and plan accepted.

This runs in production today

AI agents built this way are live with Zowie right now, negotiating and closing installment plans on regulated debt collection calls.

If Zowie is a new name to you: Zowie is the AI agent platform leading enterprises trust to run in production. The platform has run customer-facing AI agents for seven years, handles over 100 million conversations a year, and powers hundreds of agents at banks, insurers, telcos, and large commerce brands. That history is the origin of this architecture. Building an AI agent is the easy part; running one in production, where every decision is recorded and regulators read the transcripts, is the hard part, and it is the problem the platform was built around.

Debt collection was the stress test on purpose: it is a domain where an accommodating AI is dangerous, so it is where the bounded design has to prove itself on every single call.

You can hear what it sounds like. We have published a recreated call: a real AI agent, no real debtor, re-enacted for publication. The voice will be the least interesting thing about it. Listen for the moment the debtor pushes past the cap: the AI agent stays calm and the terms do not move.

Listen to the recreated call on the debt collection page.

Four questions to ask any vendor

If you take one thing from this piece, take the evaluation criteria. Ask these of anyone pitching AI for your calls, including us.

Who sets the terms? If the answer involves the model interpreting your policy, every objection above stands.

Show me the record. For any call, the vendor should be able to show which conditions were checked, which path was taken, and why the offer was the offer.

What happens when the debtor pushes? Ask to hear the moment pressure peaks, on a real or recreated call. A demo that never gets pushed proves nothing.

How are handoffs triggered? The moments that need a human should be defined by your rules in advance, and the vendor should show you where.

One question decides it: who sets the terms

Whether AI can sound human on a debt collection call stopped being an open question, and so did whether it can hold the negotiation. It can, and it does, today. The question that decides whether it belongs on your calls is who sets the terms. If the answer is the model, no voice is good enough. If the answer is a rule the model cannot override, the AI follows your rules for the simplest possible reason: it was never given the power to break them.

See how Zowie runs AI agents in debt collection: getzowie.com/debt-collection

More from the blog

Stay ahead of the conversation

Get insights on the future of Customer AI, real-world use cases, and strategies for replacing clicks with seamless conversations - delivered straight to your inbox.

By submitting the form, you acknowledge our Privacy Policy and agree to receive email communications from us.