← AI System Design / 12
easyNewDatabricksAtlassianUber

What should we log and trace for an LLM feature in production, and why?

Try it in the practice workspaceDraft your answer before comparing it with the rubric.

Without traces, every quality complaint is a guess. The interviewer wants the fields that make debugging, evaluation and cost control possible, and an awareness of what should not be stored.

Updated Nov 2026 · Original practice questions with worked answers and teaching rubrics. Our editorial policy explains the sources, review process and limits.

Without traces, every quality complaint is a guess. The interviewer wants the fields that make debugging, evaluation and cost control possible, and an awareness of what should not be stored.

This reference answer is in Premium. Free signup opens other answers.

9 answers per topic instead of 5, and your progress kept · no cardor unlock all 420 remaining answers
UP NEXT ON YOUR JOURNEY
NOTES & DISCUSSION · 0

No comments yet. How would you have answered?