DECISION TOOL / 01
AI cost calculator
Cost per call, per successful task and per month, with caching, routing and human fallback.
C_task = C_call × calls × (1 + retries) ÷ successTry the tool 6 DECISION TOOLS · ALWAYS FREE
Build intuition. Move the numbers.
See what happens when your assumptions change. Work out the cost of a successful task, test how much an eval score tells you, or find the slowest step in your product.
DECISION TOOL / 02
Launch readiness simulator
Turn a pass rate into a ship, assist or hold call, with the interval and the cost of silent failures.
autonomous if low(CI) ≥ baseline, error cost ≤ today, and reversibleTry the tool DECISION TOOL / 03
Eval confidence calculator
The interval on your pass rate, and the cases you need to tell two models apart.
± 1.96 × √(p(1 − p) ÷ n)Try the tool DECISION TOOL / 04
Agent reliability calculator
Ten steps at 95% each finish together only 60% of the time. See what retries can and cannot fix.
P(task) = p^kTry the tool DECISION TOOL / 05
RAG vs fine-tuning decision tool
Diagnose what is failing, then choose retrieval, prompting, fine-tuning or neither.
knowledge → retrieve · behaviour → tuneTry the tool DECISION TOOL / 06
Latency budget builder
Lay out the waterfall to first token, compare it with your p95 target, and find the bar worth fixing.
E2E = retrieval + TTFT + tokens ÷ TPS + toolsTry the tool Use the tools alongside interview practice. State your assumptions first, do the calculation, then explain what would change your decision.