Your assistant follows the format but gives polished, unhelpful answers. Would SFT, RLHF or DPO help?
Make your call first. Use the published answer and rubric to examine your reasoning when you are ready.
Case briefRead the inputs, then make your call
A support-drafting assistant follows the requested format but gives unhelpful answers. The review buckets and collection quotes are fictional.
| 200 failures | 100 omit required procedure despite having evidence; 60 lack account context; 40 are unnecessarily long after completing the task. |
|---|---|
| Demonstration pilot | 400 attempts at $12 each; 320 accepted. |
| Preference pilot | 500 comparisons at $2 each; 450 accepted. |
| Additional budget | Training, rater calibration and independent evaluation costs are not included in those quotes. |
Your task. Choose the next intervention and feedback objective. Compare accepted-data costs, explain what training will not fix and define protected outcomes.
0 words