Task success fell from 77% to 60%, but every segment improved. What do you do?
Make your call first. Use the published answer and rubric to examine your reasoning when you are ready.
Case briefRead the inputs, then make your call
Fictional quote-assistant case. A model release and a campaign happened together. Success requires acceptance with no correction over seven days; both periods are fully observed. Each request has exactly one source segment, assigned at submission with unchanged rules.
| Structured | Before: 900 tasks, 720 successes. After: 200 tasks, 168 successes. |
|---|---|
| Unstructured | Before: 100 tasks, 50 successes. After: 800 tasks, 432 successes. |
| Concurrent changes | Model release and campaign; no controlled comparison is supplied. |
Your task. Reconstruct segment and aggregate success. Calculate after-period rates at the original mix, reconcile the observed change and recommend the next investigation and product action.
0 words