tokens

The first vocabulary word of AI product management. Tokens are the unit of cost, speed and memory, and a PM who can't reason in them can't price, budget or design an AI feature.

Sending the whole video with every question costs about a quarter of a million tokens. Index it once, retrieve the right minutes and keep the whole-video pass for one-off questions.

A vocabulary question with a sharp edge. The cheapest model per token is regularly the most expensive per finished job.

Turn a registered-user count into active usage, model calls and billable tokens. Compare an uncached baseline with a stated caching scenario without inventing a vendor quote.