AI UX & Human-in-the-Loop Interview Questions

The central AI UX question. The interviewer wants patterns that make errors cheap to spot and cheap to fix, sized to what an error costs.

A shared vocabulary for one of the biggest decisions in AI product design: how much the AI does on its own. The interviewer wants the levels, and the rule for choosing among them.

Accuracy and trust are different things. The feature saves no time if people double-check everything, and the fix starts with finding out why experts are cautious.

Citations are the main trust device in AI answers, and published audits of shipped search engines find many that do not support the sentence they sit on. The interviewer wants citations at the right granularity, checkable in seconds, and honest about what they support.

Users let an assistant act when they can see what it did and take it back. The interviewer wants an activity log, real undo, and clear handling of actions that cannot be undone.

A deceptively simple design question. Numbers feel transparent, but most users cannot act on them, and the numbers are often less meaningful than they look.

Users either expect too much from AI features and churn after the first failure, or too little and never try the useful parts. Onboarding sets the mental model that decides which happens.

Approval screens fail in a predictable way: people click 'approve all'. The interviewer wants a design that focuses attention on the changes that matter and makes careful review fast.

Trust that outruns accuracy is as dangerous as distrust. The interviewer wants design that keeps experts engaged where it matters, without making the tool tedious.

Explicit ratings are rare, biased and vague. The strongest feedback signals are things users already do. The interviewer wants a design that captures them and turns a few explicit reports into labelled examples.

How an assistant fails shapes trust as much as how it succeeds. The interviewer wants different responses for different reasons, each giving users a way forward.

'Creepy' means the system knows more than users expected; 'random' means they cannot see the logic. Both are fixed with honest explanations and real controls, not marketing copy.

Health assistants are useful exactly where they are risky. The interviewer wants clear tiers of what the assistant answers, how it handles emergencies and personal medical advice, and an experience that stays helpful instead of hiding behind disclaimers.

Most AI writing value comes after the first draft. The interviewer wants a design that makes partial acceptance, targeted rewrites and comparison easy, and keeps the user in control of their document.

Trust is easy to survey and hard to measure. The interviewer wants a composite built from behaviour, interpreted carefully, and validated against outcomes the business cares about.

Streaming is the cheapest latency improvement in AI products. The interviewer wants the reason, the trade-offs, and the cases where showing partial output is a mistake.

Translation is the smallest part of multilingual AI UX. The interviewer wants script choice, code-mixing, voice, cultural norms, and honest handling of languages where quality is weaker.

Personality can make an assistant pleasant or manipulative, memorable or annoying. The interviewer wants a personality that serves users' goals, stays honest about being an AI, and adapts when the moment is serious.

Licences are not adoption. The interviewer wants the real reasons people don't use the tool, and a plan that embeds AI into specific workflows with champions, measurement and honest pruning.

Delegation is the highest autonomy level and the hardest to design. Principal answers cover the brief, budgets and boundaries, checkpoints, reporting, and what happens when the agent hits something it should not decide.

A principal-level question about recovering from failure in public. Apologies are necessary and not sufficient; users come back when the product visibly changes and the company keeps its promises.

Inconsistent AI behaviour across products confuses users about what to trust. Principal answers create shared patterns and principles that teams adopt because they are useful, with room for product-specific needs.

Faster speech can make a conversation take longer. Diagnose premature turns, design recovery after interruption and protect actions when a caller changes their mind.

Design an interruption policy from urgency and consequence, then measure useful action and attention cost beyond clicks.

An empty box asks users to guess what the AI can do. Start from the job they opened the product for, and measure whether suggestions lead to tasks that succeed.

Memory helps until it surprises people. Make what the assistant remembers visible, editable and scoped, and treat sensitive categories differently by default.

Streaming text, unlabelled buttons and moving focus break screen readers in ways sighted testing never shows. Fix announcements, structure and controls, then test with disabled users.

Users rate flattering answers higher, so the launch metric points the wrong way. Build the measurement that catches it and decide what blocks a launch.

Benchmark gains do not cover what users built around the old model. Measure the behaviour that changed, give people a bridge and decide in advance when the old model goes.

One label for everything punishes honest creators and barely moves belief. Separate how something was made from whether it could mislead, and measure the label's errors.

A pre-ticked box gets more data and a regulator's attention. Decide the default, what applies retroactively, what withdrawal really means and who is never included.

At a low base rate even a good classifier mostly flags teens who are fine. Decide what triggers an alert, who reviews it, what the parent sees and what the teen is told.

Search visits with an AI summary produced 40% fewer outbound clicks in one large study. Decide which questions deserve a complete answer, which deserve a doorway and how you will measure the difference.

Hiding the bot is off the table in many markets and was never a good bet. Disclose on the first turn, then win back the lost sales by testing how you disclose and what the assistant does next.

Reasoning traces often leave out what drove the answer, and explanations make people accept wrong answers more. Show progress and evidence, and decide who gets the full trace.

Models sometimes describe actions they never took. Let the system decide what is done from checks it runs itself, and show users the evidence.

The pricing changes that caused backlash were mostly communication failures. Say who is affected, show a meter in units people understand and never cut off work mid-task.

At a 0.05% base rate, a classifier that is right 99% of the time on safe messages still flags about twenty people who are fine for every one in danger. Build a ladder of responses that each fit their error rate.

The law requires the option; a Dutch court required that the choice stick. Build a non-profiled feed people would actually use, explain ranking in plain words and size the engagement cost without inventing an uptake rate.

Visible AI badges on every sentence make people use the feature less and judge each other harshly; hidden provenance backfires when it surfaces later. Put accountability on the person, provenance in history and disclosure where the context demands it.