capacity planning

Launches fail on rate limits more often than on model quality. This question checks whether you can turn expected usage into tokens per minute, compare it with limits, and plan headroom.

A resource allocation question with no painless answer. The interviewer wants a transparent framework, efficiency gains before rationing, and decisions leadership can stand behind.

Regional capacity is fragmented capacity, and four providers charge about 10% for it. Price it, define exactly what you promise, and tell customers which models arrive late in their region.