YOUR FIRST AI PRODUCT DECISION
The launch room.
Would you give this agent permission to refund?
A support agent looks ready. Inspect the evidence, choose a release plan and revise it as the constraints change.
DECISION 1 OF 4
The demo works. What can ship?
Your choices and notes stay in this tab, including after a refresh.
EVIDENCE 01 / FAILURE SEVERITY
- Correct completion
- 216 / 240
- Safe handoff
- 12 / 240
- Incorrect answer
- 8 / 240
- Unauthorized refund
- 4 / 240
Mutually exclusive sandbox outcomes. The headline combines failures with very different consequences.
You own a refund assistant for a fictional retailer. The proposed release can issue refunds without human approval. In a sandbox test, 216 of 240 requests completed correctly. Four issued a refund outside the customer's authorized scope. Support wants relief from repetitive work this week.
Add your reasoning optional, private to this tab
Your notes are not sent for scoring or included in analytics.