There is a version of the AI conversation in which any human involvement is a temporary compromise: a stage to pass through on the way to full automation. We do not see it that way. In operational systems, defined points of human control are a design feature, and usually a permanent one.
Control points are how systems earn trust
Every mature operational system has them. Payments above a threshold need a second approver. Changes to production go through review. A refund outside policy needs a manager. Nobody describes those as limitations of the payment system.
AI does not change the principle. It changes where the control points need to be, because the system can now initiate actions and conversations that previously only people could.
Where the gates matter most
Not every action needs a person. Confirming an appointment does not. The gates matter where the consequences of a wrong action are hard to reverse or have regulatory weight:
- Changing records that other decisions depend on.
- Sending communications that commit the business to something.
- Collecting money or altering what a customer pays.
- Influencing a regulated decision, such as suitability or eligibility.
In those places, the AI's job is to prepare the action and the evidence. A person's job is to decide.
Designing the gate well
A badly designed gate is worse than none: it becomes a rubber stamp that nobody reads, and the control it was meant to provide evaporates. Good gates share a few characteristics.
- The person sees the context and the proposed action together, not a raw transcript.
- The decision is quick to make and quick to record.
- Exceptions are routed to the right person, not to a general queue.
- The system learns from the decision, so the same case does not come back.
The escalation path is part of the product
When we design an agent workflow, the handoff to a person gets as much attention as the happy path. Where does the conversation land? What travels with it? How fast is it picked up? If those answers are vague, the workflow is not finished.
Regulated environments make this explicit
In financial services, legal services and similar sectors, the requirement for a person to own certain decisions is not optional. Systems that are designed with that in mind from the start are easier to deploy there, easier to audit and easier to explain to a regulator.
Systems that were designed for full automation and had controls added afterwards tend to show it.
A better framing
Rather than asking how much of a process can be automated, we ask which decisions should stay with a person and design the automation to serve those decisions. The result is usually more automation, not less, because the people involved trust it enough to let it run.
- AI
- Human-in-the-loop
- Governance
- Regulated environments