What is model distillation, and when would you, as a PM, ask the team to do it?

Distillation is how teams get large-model quality at small-model cost on a specific job. The interviewer wants to know when that trade is worth the engineering, and what can go wrong.

Updated Oct 2026 · Original practice questions with worked answers and teaching rubrics. Our editorial policy explains the sources, review process and limits.