Separate new-user and new-item problems, design a useful first session, and test whether early relevance survives beyond onboarding.
Updated Oct 2026 · Original practice questions with worked answers and teaching rubrics. Our editorial policy explains the sources, review process and limits.
A learning app needs useful recommendations for new users and newly published lessons. The randomized pilot is fictional.
| Assignment | 500 new users per arm; keep original assignments for 14-day measurement. |
|---|---|
| First useful lesson | Baseline: 120 users. Candidate: 170 users. |
| Return and useful completion within 14 days | Baseline: 90 users. Candidate: 80 users. |
| Constraints | Little interaction history; onboarding preferences are optional. |
Your task. Design the recommendation and exploration approach. Interpret both outcomes and choose the next rollout decision.
Separate new-user and new-item problems, design a useful first session, and test whether early relevance survives beyond onboarding.
This reference answer is in Premium. Free signup opens other answers.
9 answers per topic instead of 5, and your progress kept · no cardor unlock all 420 remaining answersNo comments yet. How would you have answered?