hardNewAnthropicCursorReplit

A competitor's agent runs on the same model as ours but completes 71% of tasks to our 48%. Where do you invest?

Try it in the practice workspaceDraft your answer before comparing it with the rubric.

When the model is identical, the gap is in the harness. Read the failures, size each category, change one component at a time, and judge the result by cost per successful task, not success rate alone.

Updated Nov 2026 · Original practice questions with worked answers and teaching rubrics. Our editorial policy explains the sources, review process and limits.

Case briefFacts and constraints for your answer

All figures are illustrative. On your 200-task internal set, your agent passes 96 tasks (48%) and a competitor's agent passes 142 (71%). Both run the same public model at default settings.

Scenario inputs
Your failures104 failed runs, each labelled by the first thing that went wrong.
Failure labelsLost earlier context 38; declared done without verifying 30; tool errors with no retry 21; beyond the model 15.
Current cost$0.40 per task.

Your task. Decide where to invest, how you would test changes, and how you would judge whether an improvement is worth its cost.

Follow-up roundsAnswer first, then revise for each changed constraint
  1. Round 2. The verifier lifts success to 61%, but cost per task rises from $0.40 to $0.95.
  2. Round 3. A new model version ships. With our improved harness it passes 74%. With the old, simple harness it passes 72%.
PREMIUM / REFERENCE ANSWER

Compare your call with a worked answer.

YOUR PRACTICE GOAL

Decide where to invest, how you would test changes, and how you would judge whether an improvement is worth its cost.

  1. 01

    The reasoning

    A worked response, with assumptions and the conditions that change the call.

  2. 02

    The follow-ups

    Questions that challenge the answer, with reference responses to compare.

  3. 03

    The rubric

    Weak, Hire and Strong Hire signals for reviewing your own attempt.

View Premium access

All 441 answers beyond your current access, including this reference.

Try the free launch case first

One membership, the full preparation library.Every published course, answer, concept and PDF guide.

One payment · No auto-renewal · Downloaded PDFs are yours to keep

UP NEXT ON YOUR JOURNEY
NOTES & DISCUSSION · 0

No comments yet. How would you have answered?