A new model wins 64% of preference tests but expert users prefer the old one. Would you replace it?

Make your call first. Use the published answer and rubric to examine your reasoning when you are ready.