12What should we log and trace for an LLM feature in production, and why?▼easyNewDatabricksAtlassianUber◆ premiumWithout traces, every quality complaint is a guess. The interviewer wants the fields that make debugging, evaluation and cost control possible, and an awareness of what should not be stored.Practise this question →Read answer →
20An audit finds customers' phone numbers, card numbers and health details in our LLM prompt logs. What do you do?▼mediumNewRevolutPhonePeStripe◆ premiumUsers type sensitive data into chat boxes whatever the instructions say, and debug logs keep it forever. The interviewer wants immediate containment, a redaction design, and a balance between privacy and the ability to debug.Practise this question →Read answer →