Design LLM-based reranking for a marketplace's product search without breaking latency or cost.

Putting a large model in the search path can improve relevance and blow the latency budget. Use a cascade, rerank only where it helps, cache, and measure on judged queries and live tests.

Updated Oct 2026 · Original practice questions with worked answers and teaching rubrics. Our editorial policy explains the sources, review process and limits.