model optimisation

Distillation is how teams get large-model quality at small-model cost on a specific job. The interviewer wants to know when that trade is worth the engineering, and what can go wrong.

Quantization offers large savings with small average quality loss, and the averages hide where the loss lands. The interviewer wants evaluation on real workloads, by segment, before any cost win is claimed.