← Metrics & Unit Economics / 32
hardNewSpotifyMicrosoft

Task success fell from 77% to 60%, but every segment improved. What do you do?

Try it in the practice workspaceDraft your answer before comparing it with the rubric.

A model release and a campaign happened together. Reconstruct the success rate, explain the mix shift and decide what evidence should drive the next change.

Updated Nov 2026 · Original practice questions with worked answers and teaching rubrics. Our editorial policy explains the sources, review process and limits.

Case briefRead the inputs, then make your call

Fictional quote-assistant case. A model release and a campaign happened together. Success requires acceptance with no correction over seven days; both periods are fully observed. Each request has exactly one source segment, assigned at submission with unchanged rules.

Scenario inputs
StructuredBefore: 900 tasks, 720 successes. After: 200 tasks, 168 successes.
UnstructuredBefore: 100 tasks, 50 successes. After: 800 tasks, 432 successes.
Concurrent changesModel release and campaign; no controlled comparison is supplied.

Your task. Reconstruct segment and aggregate success. Calculate after-period rates at the original mix, reconcile the observed change and recommend the next investigation and product action.

A model release and a campaign happened together. Reconstruct the success rate, explain the mix shift and decide what evidence should drive the next change.

This reference answer is in Premium. Free signup opens other answers.

9 answers per topic instead of 5, and your progress kept · no cardor unlock all 420 remaining answers
UP NEXT ON YOUR JOURNEY
NOTES & DISCUSSION · 0

No comments yet. How would you have answered?