AGENT RELIABILITY GUIDE · 01

AGENT FALSE
COMPLETION.

An AI agent can finish a run, call a tool, and say “done” while the real-world job remains incomplete. That gap is false completion.

This guide explains how to define an agent outcome, verify it against a system of record, and measure the difference between reported success and verified completion.

DEFINITION

What is agent false completion?

Agent false completion occurs when an AI agent reports that a task is complete, but the required state in the external system has not been reached. The agent may have followed a plausible sequence, yet the intended business result is missing, incorrect, or only partially complete.

REPORTED SUCCESS

“The workflow ran.”

VERIFIED COMPLETION

“The required outcome exists.”

WHY IT HAPPENS

Why a successful run is not enough

  • Tool success is local.

    An API can accept a request while a downstream action later fails, is queued, or is rejected by a business rule.

  • One step can hide another.

    A multi-system workflow can complete one write while silently omitting the required follow-up task, permission, or notification.

  • Language is not evidence.

    A final agent message is an interpretation. It is not an independent check of the system of record.

  • Retries can introduce harm.

    Blind retrying may duplicate an email, refund, ticket update, or external write rather than repair the missing outcome.

EXAMPLES

Common false-completion patterns

01

CRM lead qualification

The agent calls a CRM update tool and reports success. The contact exists, but the lifecycle stage was never changed because the required company-domain field was missing.

02

Support refund

The agent sends a customer a confirmation message. The message was sent, but the payment-provider refund was rejected and no money was returned.

03

Employee onboarding

An agent creates an account and posts a welcome message. It did not add the employee to the required access group, so the person cannot do the job.

MEASUREMENT

How to measure verified completion

  1. 1. Write the outcome condition.

    Describe the state that must exist after the workflow, such as “contact is qualified and a follow-up task exists.”

  2. 2. Identify the system of record.

    Use the CRM, payment provider, database, ticketing system, or access directory that holds the relevant external fact.

  3. 3. Check independently after the agent runs.

    Verify the outcome through an API, database query, browser check, file check, or other independent verifier.

  4. 4. Classify the gap.

    Separate verified completion, partial completion, false completion, duplicate action, recoverable failure, and human escalation.

THE PRACTICAL START

AUDIT ONE
REAL WORKFLOW.

Do not start with a generic success-rate metric. Compare one production agent workflow against its actual systems of record, then make the false-completion rate visible.

REQUEST A DIAGNOSIS