← Evals & Launch Decisions / 20
mediumNewLinkedInMetaGoogle

How would you A/B test an AI reply-suggestion feature before rolling it out to everyone?

Try it in the practice workspaceDraft your answer before comparing it with the rubric.

A classic experiment-design question with AI-specific traps: novelty that fades, quality that differs by segment, and a cost line that classic A/B tests never had.

Updated Nov 2026 · Original practice questions with worked answers and teaching rubrics. Our editorial policy explains the sources, review process and limits.

A classic experiment-design question with AI-specific traps: novelty that fades, quality that differs by segment, and a cost line that classic A/B tests never had.

This reference answer is in Premium. Free signup opens other answers.

9 answers per topic instead of 5, and your progress kept · no cardor unlock all 420 remaining answers
UP NEXT ON YOUR JOURNEY
NOTES & DISCUSSION · 0

No comments yet. How would you have answered?