Ultra PatternsAI interface patterns with receiptsULTRA project

Pattern 06 · Chat or assistant, Dashboard with AI insights · Interaction pattern

View

Low-confidence hand-off to a person

Seen in a case Built for a real case and observed with its users, or built for a case whose user test is still to come. No controlled comparison yet.

Practice view. What to build, the words on screen and how to measure it. Switch to Research for why it should work, the framework properties and the references.Research view. The research side is shown below the card: why it should work, the properties it targets and the references. Switch to Practice to hide it.

When confidence for a field drops below a threshold, the item is routed to a person with a short note: what the AI could not determine and what it needs. The person fills the gap; the rest stays automated.

WhyA wrong guess that looks confident is an expensive error in triage, because nobody checks it. A visible hand-off keeps the efficiency gain for the easy cases and keeps people in charge of the hard ones.
WhenPipelines with many easy items and a few hard ones, where a person is available to decide.
Not whenWhen the hand-off happens so often that people end up reading everything anyway; then fix the model or the threshold first.

The right amount of trustThe user stays in chargeCase: CNEXT Mail2Flow (company approval pending)

Done right, done wrong

Schematic screens, not real products. Click a screen to enlarge it.
Right. Needs your input: project unknown. One question, one pick list, done.
Wrong. A silently guessed project with a 34% confidence hidden in a tooltip.

In practice

The question behind this card: when the system says “AI needs your help, low confidence in project identification”, does that raise or lower trust? The working hypothesis in the case was that the human-in-the-loop moment feels like extra work and people end up reading the full e-mail anyway. The answer decides the threshold, and it is still open.

The July test did not exercise the hand-off itself, but it said two things about it. The escalation to a person was on screen as a button called Consult partner, and participants did not understand what it meant: a hand-off has to say what the AI could not do and what the person is asked to do, in plain words. And the post-interviews drew the line the threshold should follow: four of seven would let the AI assign tasks inside the team on its own, nobody would let it send anything to a client. The hand-off can be rare for internal routing and must be the rule for anything that leaves the firm.

Words on screen

"The AI needs your help: it could not find the project for this e-mail.""Pick the project""Not a project e-mail"

Obligations to keep in mind (AI Act, GDPR)

  • Human oversight where the system is unsure; make the request small and specific. (O2, IUI 2026, Table 1)
  • Say what the AI could not do, not only that it failed. (O1, IUI 2026, Table 1)

Design considerations, not legal advice or a conformity assessment. What O1 to O5 mean.

Build it

Illustrative signatures, not a published library: the names below are suggestions to adapt to your stack. Thresholds are examples to tune on your own data.

States: automated, needs-human, resolved, dismissed

Component: <HandOff reason="project" options={projects} onPick={fn} onDismiss={fn} />

Prompt snippet: When the best match scores below the threshold, return needs_human with the field name and the top three candidates instead of a guess.

Output schema: { "status": "ok | needs_human", "field": "string", "candidates": ["string"] }

Measure it

How often users follow the AI · from logsUsers feel in control · 8 minPlan your testTen minutes per participant is the usual budget: pick the two or three cards that fit.

Same idea, other names

Try it

Open the demo

Research side · why it should work

Why it should work

The mechanism, notes and references for this card are written together with the science editor at KU Leuven Augment. Until then this side lists the properties the pattern targets and the contexts in which it was seen.

Properties targeted

Reliance · Controllability · Trust · Vocabulary bridge

Across contexts

ContextUsersStateResult
CNEXT Mail2Flow, Kairos prototypeaccountants, desktopSeen in a casethe hand-off itself was not exercised in the July tasks; the escalation button 'Consult partner' was unclear to participants; four of seven would let the AI assign internal tasks without asking
Your contextBring your case

Editors

Practice: Abasin Abdul Khalil · Science: to be assigned by KU Leuven Augment · card v1.0 · 2026-09-08