Metric · Controllability
Users feel in control
What it tells you
Whether people feel they can steer, correct and undo what the AI does. The KU Leuven framework names four forms of that control: reversing actions, correcting the system, filtering or zooming the explanation, and asking questions.
How, in 8 minutes
Three questionnaire items after the task, plus two log counts: how often people override or edit an AI proposal, and how often they undo.
Benchmark
No benchmark yet. Run the kit and send us yours.
Plan your test explains how to choose metrics and how many participants you need.
Questionnaire items
- I could change what the AI proposed whenever I wanted.
- I felt in charge of the result.
- I knew how to correct the AI when it was wrong.
Answer on a 1 to 7 scale from strongly disagree to strongly agree unless the item states its own scale. The ULTRA team wrote or adapted these items for the kits and has not checked their reliability, so report them as ULTRA kit items and name any questionnaire they were adapted from.
Log events
proposal_edited {pattern, field}proposal_overridden {pattern, field}undo {pattern}Pairs with
Research side · the property behind this metric
Property
References
- Donoso-Guzmán et al. 2025, Table 9: controllability as reversing actions, correcting the system, filtering or asking questions.