system design
AI PM interview questions tagged system design, across every topic.
10 of 10 questions · 3 answers available
Concepts behind "system design"
Lessons that explain the ideas these questions test.
Core
Latency BudgetsE2E = queue + retrieval + TTFT + tokens/TPS + tools + render. Budget at p95, cut the biggest bar.🏗️ AI Architecture PatternsSign in
Core
Prompt and Prefix CachingStable prefixes, hit rates, write versus read pricing and TTLs, with the arithmetic.🏗️ AI Architecture PatternsSign in
Advanced
Fallbacks and DegradationTimeouts, circuit breakers, secondary models, classic paths and queues, decided per feature.🏗️ AI Architecture Patterns🔒 Premium