mediumNewCursorReplitMicrosoft

How would you build the golden eval set for an AI coding assistant?

Try it in the practice workspaceDraft your answer before comparing it with the rubric.

Everyone says 'build a golden set'. The interviewer wants to know what goes in it, where it comes from, who maintains it and how you stop it from rotting.

Updated Nov 2026 · Original practice questions with worked answers and teaching rubrics. Our editorial policy explains the sources, review process and limits.

Everyone says 'build a golden set'. The interviewer wants to know what goes in it, where it comes from, who maintains it and how you stop it from rotting.

free accounts read more answers per topic · no card

UP NEXT ON YOUR JOURNEY

Next in this trackOffline Eval Up, Online Metrics Flat Next in this trackEval Sample Size for a 3-Point Change Next in this trackSwitching Models After a Leaderboard Jump

NOTES & DISCUSSION · 0

No comments yet. How would you have answered?