expertNewOpenAIAnthropicGoogle DeepMind

Two weeks before launch, evals put our next model at the High cybersecurity threshold in our framework. What is your launch plan?

Try it in the practice workspaceDraft your answer before comparing it with the rubric.

The framework already says what a High finding requires. The PM's job is to turn that into a release scope with evidence the safeguards hold, a path for defenders who need the capability, and criteria for widening access, without breaking commitments made before the result came in.

Updated Nov 2026 · Original practice questions with worked answers and teaching rubrics. Our editorial policy explains the sources, review process and limits.

Case briefFacts and constraints for your answer

All figures are illustrative. You are a PM at a model lab. Two weeks before a planned launch, pre-release evaluations place the new model at the High threshold for cybersecurity under the lab's published framework.

Scenario inputs
SafeguardsA misuse classifier, account monitoring and rate limits; a red team stopped 470 of 500 extraction attempts.
Legitimate usersOn 1,000 benign security tasks, refusals rose from 1% on the previous model to 4%.
Commercial pressureThree enterprise customers have been promised the launch date.

Your task. Set out the launch plan: what the framework requires, what evidence you need, the release scope, disclosure, and what you tell security customers.

Follow-up roundsAnswer first, then revise for each changed constraint
  1. Round 2. A second red team, with more time, bypasses the classifier in 40 of 500 attempts.
  2. Round 3. After launch, a large security vendor says the 4% refusal rate on legitimate work makes the model unusable for them, and threatens to move to a competitor.
PREMIUM / REFERENCE ANSWER

Compare your call with a worked answer.

YOUR PRACTICE GOAL

Set out the launch plan: what the framework requires, what evidence you need, the release scope, disclosure, and what you tell security customers.

  1. 01

    The reasoning

    A worked response, with assumptions and the conditions that change the call.

  2. 02

    The follow-ups

    Questions that challenge the answer, with reference responses to compare.

  3. 03

    The rubric

    Weak, Hire and Strong Hire signals for reviewing your own attempt.

View Premium access

All 441 answers beyond your current access, including this reference.

Try the free launch case first

One membership, the full preparation library.Every published course, answer, concept and PDF guide.

One payment · No auto-renewal · Downloaded PDFs are yours to keep

UP NEXT ON YOUR JOURNEY
NOTES & DISCUSSION · 0

No comments yet. How would you have answered?