Prompt
A product team says activation improved after a new onboarding flow, but paid conversion has not moved. The PM wants to ship the flow to every user. What metric view do you build first, and what do you recommend?
Answer shape
- Start with the decision: ship, hold, narrow to a segment, or investigate before rollout.
- Define activation and paid conversion at the right grain before comparing cohorts.
- Cut by acquisition source, user intent, company size, first successful action, and time to value.
- Check whether the flow creates lower-quality activation, delayed conversion, or a segment-specific lift.
- End with one recommendation, one risk, and one metric that would change the call.
What a senior answer should avoid
- Do not treat a single improved metric as proof that the product change worked.
- Do not skip the paid-conversion denominator, timing window, or eligibility rules.
- Do not recommend a rollout without naming the segment where the effect is strongest.
- Do not bury the decision under a long list of charts.
Need worked answers and follow-ups?
The Product Analytics packet includes senior case prompts, worked answers, follow-up challenges, and scoring rubrics for this answer style.