Infrastructure proposes serving our model in 4-bit precision to cut costs by more than half. How do you decide?

Make your call first. Use the published answer and rubric to examine your reasoning when you are ready.