11Our coding agent now opens 200 pull requests a week, but only 40% get merged and reviewers are drowning. What do you change?▼hardNewCursorReplitMicrosoft◆ premiumAgent output is cheap; human review is not. This question tests whether you measure the agent by what it costs the team to accept its work, not by how much work it produces.Practise this question →Read answer →
09Leadership rolled out an AI assistant to 5,000 employees and wants to know the ROI. How do you measure it?▼mediumNewJPMorgan ChaseMicrosoftServiceNow○ sign inSurvey says everyone saves five hours a week. Finance does not believe it, and they are right not to. The answer is to measure a few workflows properly instead of the whole company vaguely.Practise this question →Read answer →
26Meeting attendance fell after we launched AI summaries. Is the feature succeeding or damaging collaboration?▼hardNewMetaMicrosoftGoogle◆ premiumSeparate saved meeting time from lost participation, and test outcomes at the team level when the feature changes shared behavior.Practise this question →Read answer →
34Our support assistant raised resolutions per hour 15% on average, but our best agents got slightly worse. Do we keep it on for everyone?▼hardNewIntercom◆ premiumThe landmark study of AI in a call centre found the same pattern: big gains for new agents, small speed gains and small quality losses for the best. Report by skill tier and give experts a lighter mode.Practise this question →Read answer →