Metrics questions
- Set feature/ company goals
- Pick North star metric and KPIs
- GAME framework
- Step 1: Clarify - state your assumptions
- Step 2: Goals - product vision and what does this specific product do
- Step 3: Actions - build a list of actions you want to see users take
- Step 4: Metrics
- Common product metrics include: Daily Active Users (DAU), Click-Through Rate (CTR), Time Spent
- Common key results include: Acquired users in specific markets, DAU growth for a product, Churn reduction
- Common business metrics include: Revenue, Net profit margin, Customer lifetime value
- Common quality metrics include: The size of a bug backlog, Mean time to resolution (MTTR), Page load time
- Common leading indicators include: User signups, Button clicks
- Common counter metrics include: Churn rate, Customer satisfaction scores (when used in conjunction with product metrics).
- Step 5: Evaluate - describe the tradeoffs
A/B testing questions
- Hypothesis
- Methodology
- Metrics - Eg.
- Impression count
- CTR on other buttons on the page
- Button hover time
- Time spent on page
- Bounce rate on the button’s clickthrough link (assuming the button leads to a new webpage)
- Impact
- Trafeoffs
- Estimation questions
- Execution questions