inference
AI PM interview questions tagged inference, across every topic.
2 of 2 questions · 0 answers available
Concepts behind "inference"
Lessons that explain the ideas these questions test.
Foundational
How LLMs GenerateWhy outputs vary, why the first word is slow, and what each stage means for product design.🧠 How LLMs Work, for PMs
Foundational
Attention and Model WeightsTrace a token through attention, then separate training from what happens during a request.🧠 How LLMs Work, for PMs
Core
GPU Economics for PMsConnect parallel arithmetic, memory and utilization to the cost of a successful product task.⚙️ Models & PlatformsSign in