← All articles

Operations3 min read

When Your Voice Agent Doesn't Know, It Should Ask You

Human in the loop lets an AI receptionist text or call your manager during the call and relay the answer, so callers stop hearing "we'll get back to you."

Mark Tomlet

November 14, 2025

Watch: Your Voice Agent Needs Human in the Loop (Poku Labs + Retell AI)

Somebody calls and asks something only a human knows right now. "Do you have this part in stock?" "Can you seat 100 people tonight?" Most voice agents say "we'll get back to you," because they don't have real time info and can't handle the edge cases. In that moment the agent is useless. Sorry, I had to say it.

What if it said "sure, let me text my manager for you, hold on a sec" instead? That's human in the loop, and it's one of the most useful things you can add to a voice agent.

What it sounds like on a real call

In my demo, the agent answers the phone for an auto repair shop. A caller asks for an update on their vehicle. The agent asks to put them on a brief hold, texts the manager on WhatsApp, the manager replies, and the agent comes back with: I've checked with our team and your vehicle will be ready tomorrow.

The caller never sees the text thread behind it. They just get a real answer on the first call.

I built this with Poku Labs connected to Retell AI. Behind the scenes it's a small tool hookup plus instructions telling the agent when to reach out, like whenever someone asks about repair progress or when their vehicle will be ready. Those triggers get tuned to your business. Poku even has a free tier of 20 interactions a month, so it's cheap to try.

A text for routine questions, a phone call for urgent ones

You're not limited to one person or one channel. Sales questions can go to one number, accounting to another, emergencies to a third. You could have five different people each getting the questions meant for them.

For urgent stuff, the agent can call the human instead of texting. People tend to respond faster to a phone call. In my demo a caller says they need a tow right now. The agent calls the owner and explains a customer has an emergency and needs towing. The owner says to tell them he'll call in 10 minutes. The agent hangs up with the owner and relays that straight back to the caller.

What if nobody answers?

You set a time limit, say 60 seconds. If the manager doesn't respond in time, the agent tells the caller the manager isn't available right now and someone will get back to them. So the worst case is the same answer you'd get without it.

Poku also released a newer feature that keeps the conversation open much longer. If the manager answers an hour later, long after the caller hung up, the caller can still get a text from the agent with the manager's answer.

It works for almost any business

This isn't just for auto shops. Real estate, legal, financial services, property management, Airbnb, plumbing, roofing, education, travel and hospitality. Even if you don't deal with time sensitive questions like what's in stock, it works as a safety net. Whenever the agent gets asked something outside its knowledge, it has a way to get the real answer instead of guessing.

My favorite use case: getting email addresses right. Anyone who has tried having a caller spell an email out loud to an AI knows how messy that gets. With this, the agent asks if they'd rather text it. The caller texts it in, and the agent reads back exactly what came through. 100% accurate.

If the thing holding you back from a voice agent is all the questions only you or your manager can answer, this is how I'd handle it. The agent doesn't have to know everything. It has to know who to ask.

Want an agent like this for your business?

Book a free 30 minute call. We'll look at how your calls are handled today and tell you straight whether an agent is worth it.

Book a free call

Keep reading