PRACTICE WORKSPACEexpertPremium answer

Two weeks before launch, evals put our next model at the High cybersecurity threshold in our framework. What is your launch plan?

Make your call first. Use the published answer and rubric to examine your reasoning when you are ready.

Case briefFacts and constraints for your answer

All figures are illustrative. You are a PM at a model lab. Two weeks before a planned launch, pre-release evaluations place the new model at the High threshold for cybersecurity under the lab's published framework.

Scenario inputs
SafeguardsA misuse classifier, account monitoring and rate limits; a red team stopped 470 of 500 extraction attempts.
Legitimate usersOn 1,000 benign security tasks, refusals rose from 1% on the previous model to 4%.
Commercial pressureThree enterprise customers have been promised the launch date.

Your task. Set out the launch plan: what the framework requires, what evidence you need, the release scope, disclosure, and what you tell security customers.

Elapsed time00:00
Think it through
0 words