data retention

Two well-run teams published opposite defaults. Decide by repository size, how fast code changes, latency and whether customers will let you store embeddings of their code.

Server-side state simplifies integration and can improve caching, but it means storing data and it does not make old tokens free. Offer it as an option with short retention and give zero-retention customers an equal stateless path.