29Our agent score rose from 72% to 90% after a runner upgrade. Can we announce the improvement?▼expertNewAnthropicCursor◆ premiumThe model stayed the same, some runs disappeared and the grader changed. Reconcile the report before deciding what the result supports.Practise this question →Read answer →
23A clinical scribe saves doctors time but makes occasional factual errors. What must be true before you launch?▼expertNewMicrosoftGoogleAmazon◆ premiumAccount for errors that survive clinician review, the full sensitive-data path and the time spent correcting notes.Practise this question →Read answer →
04Tell me about a time you disagreed with engineering or research about whether an AI feature was ready to launch.▼hard★ EssentialNewAnthropicGoogleMicrosoftunlockedA behavioural question with a technical core: how you turned a readiness argument into agreed criteria and shared evidence, what you were wrong about, and whether the relationship survived.Practise this question →Read answer →
08Tell me about a time you pushed back on pressure to launch because of a safety, quality or ethical concern.▼hardNewAnthropicOpenAIGoogle○ sign inA values question at AI labs and regulated companies. Panels want judgment about real risk, a constructive path forward, and courage without self-righteousness.Practise this question →Read answer →
28Tell me about a time your evals said a change was better but expert reviewers or users said it was worse. Which signal did you trust?▼hardNewOpenAIAnthropic◆ premiumPanels want to hear that you did not average two signals. Show how you found out which one was measuring the wrong thing, and what you added to the launch gate afterwards.Practise this question →Read answer →