Metrics questions

1. Set feature/ company goals
2. Pick North star metric and KPIs
3. GAME framework
   • Step 1: Clarify - state your assumptions
   • Step 2: Goals - product vision and what does this specific product do
   • Step 3: Actions - build a list of actions you want to see users take
   • Step 4: Metrics
     • Common product metrics include: Daily Active Users (DAU), Click-Through Rate (CTR), Time Spent
     • Common key results include: Acquired users in specific markets, DAU growth for a product, Churn reduction
     • Common business metrics include: Revenue, Net profit margin, Customer lifetime value
     • Common quality metrics include: The size of a bug backlog, Mean time to resolution (MTTR), Page load time
     • Common leading indicators include: User signups, Button clicks
     • Common counter metrics include: Churn rate, Customer satisfaction scores (when used in conjunction with product metrics).
   • Step 5: Evaluate - describe the tradeoffs

A/B testing questions

1. Hypothesis
2. Methodology
3. Metrics - Eg.
   • Impression count
   • CTR on other buttons on the page
   • Button hover time
   • Time spent on page
   • Bounce rate on the button’s clickthrough link (assuming the button leads to a new webpage)
4. Impact
5. Trafeoffs

• Estimation questions
• Execution questions