The new model wins the A/B test on thumbs-up rate, but reviewers say it agrees with users too easily. Do you ship it?

Users rate flattering answers higher, so the launch metric points the wrong way. Build the measurement that catches it and decide what blocks a launch.

Updated Nov 2026 · Original practice questions with worked answers and teaching rubrics. Our editorial policy explains the sources, review process and limits.