33Every AI team put its eval pass rate in its OKRs. Six months later every score is up and nothing users see has changed. What went wrong?▼hardNewMetaAnthropicOpenAI◆ premiumWhen a measure becomes a target, teams tune to it. Take eval scores out of targets, keep a sealed holdout teams cannot tune against, separate capability from regression evals, and tie OKRs to user outcomes.Practise this question →Read answer →
28Write the quarterly OKRs for a team shipping its first AI feature. What would you refuse to put in them?▼mediumNewAtlassianSalesforceShopify◆ premiumFirst AI features have unknown quality and cost. Write OKRs that reward learning and a measured launch, and keep out key results the team cannot honestly commit to.Practise this question →Read answer →