78
4th Feb 2012 @STUECCLES LEAN STARTUP METRICS

Lean startup metrics

Embed Size (px)

DESCRIPTION

My presentation on Lean Startup Metrics given at Lean Startup Machine on the 4th Feb and Startup Weekend on the 25h Jan.

Citation preview

Page 1: Lean startup metrics

4th Feb 2012

@STUECCLES

LEAN STARTUP METRICS

Page 2: Lean startup metrics

I NEVER FELT LIKE I WAS LEARNING

ANYTHING IMPORTANT

Page 3: Lean startup metrics

“An actionable metric is one that ties specific and

repeatable actions to observed results.”

ASH MAURYA http://www.ashmaurya.com/

Page 4: Lean startup metrics

EVENT BASED TRACKING

Page 5: Lean startup metrics
Page 6: Lean startup metrics
Page 7: Lean startup metrics

FUNNELS

Page 8: Lean startup metrics

SIMPLE SIGN-UP FUNNEL

Page 9: Lean startup metrics

EXTENDED SIGN-UP FUNNEL

Page 10: Lean startup metrics

A/BTESTING

Page 11: Lean startup metrics

+152%

Page 12: Lean startup metrics

A/B TESTING USER MAP ON HOMEPAGE

Page 13: Lean startup metrics
Page 14: Lean startup metrics
Page 15: Lean startup metrics

GOOGLE BING

Page 16: Lean startup metrics

“THAT BLUE WAS WORTH $80M AT LEAST”

PAUL RAY - PRODUCT MANAGER BING

Page 17: Lean startup metrics

LOCALMAXIMA

AN INTUITIVE LEAP

PROPS @BOKARDO FOR LAST FEW SLIDES

Page 18: Lean startup metrics

@37SIGNALS

Page 19: Lean startup metrics

WHAT TO A/B TESTShort Answer: Everything

Longer Answer: That you have enough traffic to see significant results that are not trival optimisations (HINT you are not Bing/Google)

Page 20: Lean startup metrics

WHAT TO A/B TESTEvery new feature should go into A/B testing.

If has negative or no real effect, pull it.

Optimise existing features/copy/design (80% existing 20% new)

Page 21: Lean startup metrics

FRAMEWORK

Page 22: Lean startup metrics

ACQUISITION

ACTIVATION

RETENTION

REFERRAL

REVENUE

Dave McClure http://500hats.typepad.com/

Page 23: Lean startup metrics

DON’T TRY TO MEASURE TOO MUCH

Page 24: Lean startup metrics

EXAMPLES

Page 25: Lean startup metrics

SAY HELLO TO OUR 3 FICTIONAL STARTUPS

Page 26: Lean startup metrics

Social Network for Dog Lovers.

Makes money through advertising and affiliate sales of lush dog collars.

DOGGIECOLR

Page 27: Lean startup metrics

Key business drivers are:

Advertising and affiliates need large traffic/page views so growth and retention are key

DOGGIECOLR

Page 28: Lean startup metrics

SIGN-UP

COMMENT

VISIT

INVITE FRIENDS

POST PICTURES

BUY COLLAR

CREATE PROFILE

SHARE PICTURES

ACQUISITION

ACQUISITION

ACTIVATION

ACTIVATION

REFERRAL

REVENUE

Page 29: Lean startup metrics

Project management tool for Agile startups.

Makes money through monthly subscriptions. Has a free trial period.

AGILESAMBA

Page 30: Lean startup metrics

Key business drivers are:

Conversion to paid usage and cancelation rates

AGILESAMBA

Page 31: Lean startup metrics

SIGN-UP

VISIT

CREATES PROJECT

UPGRADES PAID

ACQUISITION

ACQUISITION

ACTIVATION

REVENUE

CANCELS ACCOUNT

REVENUE

Page 32: Lean startup metrics

Marketplace to rent/buy drills from your neighbour (AirBnB for drills)

Takes a small percentage of the transaction between two parties

RENTMYDRILL

Page 33: Lean startup metrics

RENTMYDRILL

Key business drivers are:

Two sided business model means acquisition of both lenders and borrowers and transactions per user

Page 34: Lean startup metrics

LENDER SIGN-UP

VISIT

SEARCHES BORROWERS

BORROW DRILL

ACQUISITION

ACQUISITION

ACTIVATION

REVENUE

BORROWER SIGN-UP

SEARCHES LENDERS

Page 35: Lean startup metrics

ONE KEY METRICThere is generally only one key metric you need to concentrate on at a time. Such as referral or sign-up conversion or cancellation rate.

Page 36: Lean startup metrics

ACQUISITION

Page 37: Lean startup metrics

TRACKING MARKETING CHANNELSGoogle AdwordsBannersSocial MediaPartnershipsPRBloggingAnything that links to your site!

Page 38: Lean startup metrics

TRACKING MARKETING CHANNELSUse unique urls (tracking parameters) on every url you create/give-out/pay for

Use bit.ly

Use HTTP referrers to group PR

Page 39: Lean startup metrics

MEASURING COST OF VISITSCost per click (site visit)

Cost of campaign / traffic generated

(Social media) Cost of effort / traffic generated

Page 40: Lean startup metrics

MEASURING COST OF ACQUISITIONCost of one visit / conversion rate = Cost of an acquisition

Acquisition could be paid for acquisition or free sign-up

Unfortunately not that simple

Page 41: Lean startup metrics

DIFFERENT CHANNELS CAN HAVE DIFFERENT CONVERSION RATES

Page 42: Lean startup metrics

MARKETING CHANNELSPer channel track:

Scale CostConversion

Optimise and scale channels with best Cost of Acquisition (CoA) and potential to Scale

Page 43: Lean startup metrics

ACQUISITIONCost of Acquisition < Customer Lifetime Profit

Then scale acquisition at a similar or lower rate

A/B test acquisition channels to optimise

Page 44: Lean startup metrics

ACQUISITION INCLUDING REFERRALIf it costs £3 to acquire a customer through advertising

But that customer brought in 2 other customers through referral

The COA of that channel is £1

Page 45: Lean startup metrics

ACTIVATION

Page 46: Lean startup metrics

SURE THEY SIGNED-UP BUT DID THEY LIKE IT?

Page 47: Lean startup metrics

ACTIVATION AT FACEBOOK(i) which data points predict whether a user will stay?

(ii) if they stay, which data points predict how active they’ll be after three months?

Page 48: Lean startup metrics

ACTIVATION AT FACEBOOK(i) having more than one session as a new user, and entering basic profile information.

(ii) how often a user was reached out to by others, frequency of third party application use, and how forthcoming a user was on the site.

Page 49: Lean startup metrics

ACTIVATION METRICS OFTEN DRIVE OTHER METRICS IN REFERRAL,

RETENTION, REVENUE

Page 50: Lean startup metrics

RETENTION

Page 51: Lean startup metrics

RETURNING USERSTracking unregistered users that return often (useful for content sites with advertising)

Tracking registered users that return and take some sort of action.

Page 52: Lean startup metrics

COHORT METRICS - CREATED PROJECT

Page 53: Lean startup metrics

COHORT METRICS - CAME BACK

Page 54: Lean startup metrics

REFERRAL

Page 55: Lean startup metrics

REFFERAL MECHANISMSSocial Media Sharing

Invite a friend type mechanics

App Reviews

Word of mouth

Page 56: Lean startup metrics

VIRAL COEFFICIENTThe average number of customers each customer refers

Page 57: Lean startup metrics

VIRAL COEFFICIENT - EXAMPLEEach Doggiecollr customer invites 5 other customers by email

20 % click on that email link

50 % of those users convert into customers

Page 58: Lean startup metrics

VIRAL COEFFICIENT - EXAMPLEViral coefficient =

Refferals x click through x conversion

5 x 0.2 x 0.5 = 0.5

Page 59: Lean startup metrics

VIRAL COEFFICIENTA viral co-effiecient greater than 1 means that every customer gets more than one other customer on average

Therefore your product will grow virally

Page 60: Lean startup metrics

VIRAL COEFFICIENTMeasure automatically for all your in built referral mechanisms.

Give customers unique invite URLs and track conversions

Page 61: Lean startup metrics

VIRAL CYCLE TIMEThe average time taken for a referral to turn into a customer

With the viral coeffiecent and viral cycle time you can determine your viral growth

Page 62: Lean startup metrics

NET PROMOTER SCORE

Number of people who would recommend your product to a friend.

A single question survey

Page 63: Lean startup metrics

NET PROMOTER SCOREHow likely is it you would recommend AgileSamba to a friend or colleague?

1 2 3 4 5 6 7 8 9 100

NPS = % Promoters - % Detractors

Page 64: Lean startup metrics

NET PROMOTER SCORE

Survey a small percentage of your customers by email weekly

Record who you sent to so you don’t repeat the same people every week

Page 65: Lean startup metrics

NET PROMOTER SCORE

NPS is not a direct measurement that translates to key metrics

Can act as a leading indicator of other metrics

Page 66: Lean startup metrics

REVENUE

Page 67: Lean startup metrics

MAKING MONEY

Key for any business is to find out how much profit they make for every customer and scaling the number of customers

Page 68: Lean startup metrics

LIFETIME CUSTOMER VALUE

How much money you make for every customer you acquire

For some this is a single transaction

For subscription businesses it depends on retention

Page 69: Lean startup metrics

CANCELLATION RATE

Is the percentage number of customers who cancel in any given month compared to total (paying) customers

[Cancellation rate] = [product utility] + [service quality] + [acceptable price]

Page 70: Lean startup metrics

LIFETIME CUSTOMER VALUE (LTV)

LTV = monthly revenue x no months in lifetime

No months = 1 / cancellation rate

LTV = monthly revenue / cancellation rate

Page 71: Lean startup metrics

LIFETIME CUSTOMER VALUE (LTV)

For example:

If £20 a month and cancelation rate is 10% a month

LTV = £200

Page 72: Lean startup metrics

LIFETIME CUSTOMER VALUE (LTV)

Often not that simple. Short term cancellation rates are much higher than long term

Use Cohort Analysis to determine

Page 73: Lean startup metrics

LIFETIME CUSTOMER VALUE (LTV)

r = short-term cancellation rate (e.g. 0.15)p = long-term cancellation rate (e.g. 0.03)s = number of months in the “short-term” age group (e.g. 3)

(1-r)^s × (s + 1/p) = expected months

Page 74: Lean startup metrics

TIPS

Page 75: Lean startup metrics

TIPSConcentrate on macro metrics

Everything you do should be an attempt to change a metric

Measure if it did

Try to use as few tools as possible

Page 76: Lean startup metrics

TIPSAutomate it and put it in a dashboard

If it can’t be automated make a simple spreadsheet and an easy way to update it

Page 77: Lean startup metrics

TIPSDon’t forget to measure marketing

Make metrics a habit

Page 78: Lean startup metrics

THANKS