127
Growth Hacking Startup analytics and figuring out your engine for growth

Startup Analytics and Figuring out Your Engine for Growth

Embed Size (px)

DESCRIPTION

More at learn.growhack.com

Citation preview

Page 1: Startup Analytics and Figuring out Your Engine for Growth

Growth Hacking Startup analytics and figuringout your engine for growth

Page 2: Startup Analytics and Figuring out Your Engine for Growth

Because here’s what usually happens..

Page 3: Startup Analytics and Figuring out Your Engine for Growth

You spend months and months building a great product.

Page 4: Startup Analytics and Figuring out Your Engine for Growth

Anticipate a huge launch..

Page 5: Startup Analytics and Figuring out Your Engine for Growth

But, when you actually do, nothing happens.

Page 6: Startup Analytics and Figuring out Your Engine for Growth

Let’s say you end up with a feature in TechCrunch.

Page 7: Startup Analytics and Figuring out Your Engine for Growth

Which gets you 10,000 new signups.

day 1 day 25 users

10,000users

Page 8: Startup Analytics and Figuring out Your Engine for Growth

Awesome right?

Page 9: Startup Analytics and Figuring out Your Engine for Growth

Not if no one comes back..

day 1 day 25 users

day 30

10users

10,000users

Page 10: Startup Analytics and Figuring out Your Engine for Growth

What happened?

Page 11: Startup Analytics and Figuring out Your Engine for Growth

I’m Conrad Wadowski, a Partner at GrowHack which works with venture backed companies.

I also run an online school which brings together leading practitioners and resources to teach your team user growth.

Some background

Page 12: Startup Analytics and Figuring out Your Engine for Growth

So, what the heck is

GROWTH HACKING?

Page 13: Startup Analytics and Figuring out Your Engine for Growth

A “growth hack” is a meaningful spike to a metric.

day 1 day 2

5 users

10,000users

Page 14: Startup Analytics and Figuring out Your Engine for Growth

50,000users

What really matters is making it repeatable.

day 1 day 2 day 30

5 users

10,000users

Page 15: Startup Analytics and Figuring out Your Engine for Growth

Growth hacking is the tactics and best practices for growth.

Page 16: Startup Analytics and Figuring out Your Engine for Growth

Think of it like you’re assembling an engine.

Page 17: Startup Analytics and Figuring out Your Engine for Growth

..but you’re missing the instruction manual.

?the manual

Page 18: Startup Analytics and Figuring out Your Engine for Growth

How do you put together the pieces?

Email Marketing

UX

SEO

Behavioral Psychology

PPC

PR

Page 19: Startup Analytics and Figuring out Your Engine for Growth

Try a bunch of stuff?

Page 20: Startup Analytics and Figuring out Your Engine for Growth

Try a bunch of stuff?Ask other people?!

Page 21: Startup Analytics and Figuring out Your Engine for Growth

Try a bunch of stuff?Ask other people?!The interwebs?!?

Page 22: Startup Analytics and Figuring out Your Engine for Growth

Try a bunch of stuff?Ask other people?!The interwebs?!?Build more features?!?!

Page 23: Startup Analytics and Figuring out Your Engine for Growth

All places to find ideas but..

Page 24: Startup Analytics and Figuring out Your Engine for Growth

SEO

Behavioral Psychology

Email Marketing PPC

UX Analytics

Analytics brings things together

PR

Page 25: Startup Analytics and Figuring out Your Engine for Growth

It’s a skillset many companies don’t start with.

Page 26: Startup Analytics and Figuring out Your Engine for Growth

And helps you be systematic about learning what’s happening.

Page 27: Startup Analytics and Figuring out Your Engine for Growth

There are actually are a few engines to build and tune.

#1Product Engine #2 Growth Engine

+

Page 28: Startup Analytics and Figuring out Your Engine for Growth

Without a “product engine” to create value, it’s hard to grow.

Page 29: Startup Analytics and Figuring out Your Engine for Growth

For more here see Eric Reis, Steve Blank and Lean Startup Machine.

#1Product Engine

Page 30: Startup Analytics and Figuring out Your Engine for Growth

Let’s take HubSpot as an example

#1Product Engine #2 Growth Engine

+

Marketing Automation Tools Inbound Marketing and Sales

Page 31: Startup Analytics and Figuring out Your Engine for Growth

Sometimes you build within a distribution channel

#1Product Engine #2 Growth Engine

iOS App Apple App Store

=

Page 32: Startup Analytics and Figuring out Your Engine for Growth

Each approach carries its own risks and rewards.

Page 33: Startup Analytics and Figuring out Your Engine for Growth

A practical frameworkfor growth.

(adapted from Dave McClure’s AARRR metrics)

Page 34: Startup Analytics and Figuring out Your Engine for Growth

Pick one of these areas to focus on at a time.

Page 35: Startup Analytics and Figuring out Your Engine for Growth

Acquisitionsource person comes from Search, Social, WOM, Viral

Page 36: Startup Analytics and Figuring out Your Engine for Growth

Acquisitionsource person comes from

Search, Social, WOM, Viral

Activationgetting someone quickly to a “must have experience” Your happy event

Page 37: Startup Analytics and Figuring out Your Engine for Growth

Acquisitionsource person comes from

Search, Social, WOM, Viral

Activationgetting someone to a “must have experience”

Your happy event

RetentionGetting someone back to the experience

Email, push notifs, messaging, user generating content

Page 38: Startup Analytics and Figuring out Your Engine for Growth

Discover your one point of highest leverage.

Page 39: Startup Analytics and Figuring out Your Engine for Growth

It looks like this..

Page 40: Startup Analytics and Figuring out Your Engine for Growth

Free channels

Acquisitionsource a person

comes from

Let’s say one of your friends told you absolutely had to download SnapChat.

Acquisition Source: Word of Mouth

Page 41: Startup Analytics and Figuring out Your Engine for Growth

Free channels

Activation getting someone to

an “must have experience”

After you downloaded SnapChat you got to see the stupid video they sent you.

Activation Event: Watching a video

Page 42: Startup Analytics and Figuring out Your Engine for Growth

Free channels

RetentionGetting someone back to the core experience

You then get a SnapChat push notification and the cycles continues.

Retention Event: Push Notification

Page 43: Startup Analytics and Figuring out Your Engine for Growth

Retention is important

otherwise you’ll get

Page 44: Startup Analytics and Figuring out Your Engine for Growth

A growth engine without a product engine is hard to sustain.

Page 45: Startup Analytics and Figuring out Your Engine for Growth

Other user states to consider are revenue and referral.

Page 46: Startup Analytics and Figuring out Your Engine for Growth

Free channels

Referralgetting one of

your users to refer another user

After you’ve starting using SnapChat you then feel comfortable inviting a friend.

Referral Event: Messaging a friend

Page 47: Startup Analytics and Figuring out Your Engine for Growth

Free channels

Revenuemonetizing people

SnapChat currently doesn’t make money. They’re optimizing for user growth, which a monetization step would slow down. If SnapChat started sending disappearing ads, advertisers would pay.

Revenue Event: N/A

Page 48: Startup Analytics and Figuring out Your Engine for Growth

Say your product was a simple quiz website.

Page 49: Startup Analytics and Figuring out Your Engine for Growth

But only 1 out of 118 completed it.

Page 50: Startup Analytics and Figuring out Your Engine for Growth

One approach could be to acquire more users.

Page 51: Startup Analytics and Figuring out Your Engine for Growth

You’d probably have to bring in another 118 to get only 1 more user to activate.

Page 52: Startup Analytics and Figuring out Your Engine for Growth

That’s really hard.

Page 53: Startup Analytics and Figuring out Your Engine for Growth

More likely your bottleneck is a landing page.

image credit: iacquire

Clear headline

Short copy, graphic or visual

Call to action

Page 54: Startup Analytics and Figuring out Your Engine for Growth

And can lead to a much better result if you focused there..

Page 55: Startup Analytics and Figuring out Your Engine for Growth

In this case your bottleneck was activation.

Page 56: Startup Analytics and Figuring out Your Engine for Growth

InsightTo build your engine, focus on your point of highest leverage.

Page 57: Startup Analytics and Figuring out Your Engine for Growth

Choosing a metric you’d like to move may be the hardest thing. It’s changes and is tough to prescribe.

Page 58: Startup Analytics and Figuring out Your Engine for Growth

Metrics are merely a reflection of the product strategy that you already have in place and are limited because they’re based on what you’ve already built, which is based on your current audience and how your current product behaves.

Andrew Chen

Page 59: Startup Analytics and Figuring out Your Engine for Growth

It helps you prioritize, which may be the hardest thing to do.

Text

Page 60: Startup Analytics and Figuring out Your Engine for Growth

Start with an in depth

study of your users.

Page 61: Startup Analytics and Figuring out Your Engine for Growth

Be them.

Page 62: Startup Analytics and Figuring out Your Engine for Growth

Talk to them.

Page 63: Startup Analytics and Figuring out Your Engine for Growth

Where do your most engaged users come from or hang out?

Page 64: Startup Analytics and Figuring out Your Engine for Growth

I say, take as many angles as you can to figure this out.

Page 65: Startup Analytics and Figuring out Your Engine for Growth

In person interviews

Page 66: Startup Analytics and Figuring out Your Engine for Growth

Craiglist to find people in your target market

Page 67: Startup Analytics and Figuring out Your Engine for Growth

Meetups

Page 68: Startup Analytics and Figuring out Your Engine for Growth

Surveys

Page 69: Startup Analytics and Figuring out Your Engine for Growth

Usertesting.com

Page 70: Startup Analytics and Figuring out Your Engine for Growth

“If you were to recommend [product name] to a friend, how would you

convince them to use it?”

Great question after someone’s first tried your product

Page 71: Startup Analytics and Figuring out Your Engine for Growth

Net Promoter Score

Page 72: Startup Analytics and Figuring out Your Engine for Growth

“I ask existing users of a product how they would feel if they could no longer use the product. In my experience, achieving product/market fit requires at least 40% of users saying they would be “very disappointed” without your product.” - Sean Ellis

Question to assess Product/Market Fit

Page 73: Startup Analytics and Figuring out Your Engine for Growth

Challenges: Bias and Speed

Page 74: Startup Analytics and Figuring out Your Engine for Growth

SolutionMeasure what they

actually do.

Page 75: Startup Analytics and Figuring out Your Engine for Growth

Measure from Day One

Philosophy.

Page 76: Startup Analytics and Figuring out Your Engine for Growth

Get users into groups.

Page 77: Startup Analytics and Figuring out Your Engine for Growth

Predict how your people react to changes you make.

Page 78: Startup Analytics and Figuring out Your Engine for Growth

Being savvy with analytics applies to

large and smaller user bases.

Page 79: Startup Analytics and Figuring out Your Engine for Growth

For larger sets of users it’s helpful to segment people and

find patterns.

Page 80: Startup Analytics and Figuring out Your Engine for Growth

For smaller sets, you’ll get to see patterns develop.

Page 81: Startup Analytics and Figuring out Your Engine for Growth

Even without much data, you’re getting

into the habit of learning.

Page 82: Startup Analytics and Figuring out Your Engine for Growth

Are people doing what you expect? Who and why are they behaving

that way?

Page 83: Startup Analytics and Figuring out Your Engine for Growth

Some characteristics of good metricsAnswer an important question in your user lifecycle.Are actionable.

Page 84: Startup Analytics and Figuring out Your Engine for Growth

How well are we retaining users?

We look into the % of first time users who login the next day.

If we weren’t retaining users, maybe they think our product isn’t valuable. Easy and quick to measure.

Page 85: Startup Analytics and Figuring out Your Engine for Growth

What’s the most efficient use of marketing resources?To answer this question, we could look into sources of traffic, and analyze what % of users from a particular source ended up converting into being engaged with our product or paying, and how much would it cost to acquire this particular user.

Helps you focus your resources on the channel with the most impact.

Page 86: Startup Analytics and Figuring out Your Engine for Growth

An easy way to make your metrics more actionable would be to try to make it a %.

Divide an important number you have over a period of time to give you a growth rate, or over an earlier step in your funnel to give you a conversion rate.

Page 87: Startup Analytics and Figuring out Your Engine for Growth

What’s not actionable?Anything topline - like pageviews, revenue or users. We want to increase your total users, but this number will go up no matter what you do.

Time on Site - can help measure engagement, but maybe your users are just confused?

Page 88: Startup Analytics and Figuring out Your Engine for Growth

Benchmarking isn’t exact but can be a place to start if you’re having trouble identifying a weak metric.

Page 89: Startup Analytics and Figuring out Your Engine for Growth

Is your sign up rate way below 8 to 30%?

Page 90: Startup Analytics and Figuring out Your Engine for Growth

Is your email open rate way below 30% or click through consistently below 3%?

Email marketing benchmarks 2013 - Mailchimp

Page 91: Startup Analytics and Figuring out Your Engine for Growth

Drawing board

Weak Average Okay Strong

<12% 12-16% 20% 25% 50%+

Day One (D1) Mobile Gaming Retention Benchmarks

Credit: Nabeel Hyatt

Page 92: Startup Analytics and Figuring out Your Engine for Growth

More Mobile Retention

Benchmarks

App engagement benchmarks 2012 - Flurry

Page 93: Startup Analytics and Figuring out Your Engine for Growth

Ideally you can find a leading indicator to tell you when activation happens.

Page 94: Startup Analytics and Figuring out Your Engine for Growth

How do you know users reached the “aha moment?”

Page 95: Startup Analytics and Figuring out Your Engine for Growth

A user is engaged if they reach 7 friends in 10 days.

-Chamath Palihapitiya

Page 96: Startup Analytics and Figuring out Your Engine for Growth

An active user has visited 7 times in the last month.

-Josh Elman

Page 97: Startup Analytics and Figuring out Your Engine for Growth

If someone came back the day after they signed up for a game, they were

likely to become an engaged user.-Nabeel Hyatt

Page 98: Startup Analytics and Figuring out Your Engine for Growth

Once you feel comfortable with

focusing on a metric.

Page 99: Startup Analytics and Figuring out Your Engine for Growth

Hypothesize improvement

to that metric.

Page 100: Startup Analytics and Figuring out Your Engine for Growth

Make valid, quick tests to improve

it.

Page 101: Startup Analytics and Figuring out Your Engine for Growth

Without your left brain, you wouldn’t know which of your

ideas are good.

Page 102: Startup Analytics and Figuring out Your Engine for Growth

Without your right brain, you wouldn’t have

any good ideas.

Page 103: Startup Analytics and Figuring out Your Engine for Growth

Some places to find good ideas about a bottleneck include

other great products.

Page 104: Startup Analytics and Figuring out Your Engine for Growth

Lot’s of tools available to identify your bottleneck

Page 105: Startup Analytics and Figuring out Your Engine for Growth

Help you figure out who your valuable users are and why others are getting stuck.

Page 106: Startup Analytics and Figuring out Your Engine for Growth

MixPanel

Page 107: Startup Analytics and Figuring out Your Engine for Growth

CautionFirst chose what question you’d like to answer, then focus on measuring it.

Page 108: Startup Analytics and Figuring out Your Engine for Growth

More information isn’t necessarily better.

Page 109: Startup Analytics and Figuring out Your Engine for Growth

Retention Report

Create a definition for retention, such as those who sign up and log back in.

Page 110: Startup Analytics and Figuring out Your Engine for Growth

Weekly Cohorts

Page 111: Startup Analytics and Figuring out Your Engine for Growth

Define Properties

Answer more specific questions comparing groups such as returning vs. new visitors or those acquired through facebook vs. twitter.

Page 112: Startup Analytics and Figuring out Your Engine for Growth

You can do the same in the funnel and revenue reports

Page 113: Startup Analytics and Figuring out Your Engine for Growth

Learn about valuable users

Page 114: Startup Analytics and Figuring out Your Engine for Growth

Message based on activity

Page 115: Startup Analytics and Figuring out Your Engine for Growth

Segment.io

Page 116: Startup Analytics and Figuring out Your Engine for Growth

Easily switch between services

Page 117: Startup Analytics and Figuring out Your Engine for Growth

Optimizely.com

Page 118: Startup Analytics and Figuring out Your Engine for Growth

Easy a/b testing

Page 119: Startup Analytics and Figuring out Your Engine for Growth

Intercom.io

Page 120: Startup Analytics and Figuring out Your Engine for Growth

Targeted messaging

Bill Murray

Kid Rock

Brittany Spears

Brad Pitt

Aaron Arnold

Juliana James

John Johnson

Bobby Boulder

Nick Newman

Sandy Sue

Carly Charleston

Paul Porter

350k

1M

78

253k 87

27.2M 93

344

25

576

333

-

988

3

1,345

30

24

31

51

44

-

-

0

Page 121: Startup Analytics and Figuring out Your Engine for Growth

Targeted messaging

Bill Murray

Kid Rock

Brittany Spears

Brad Pitt

Aaron Arnold

Juliana James

John Johnson

Bobby Boulder

Nick Newman

Sandy Sue

Carly Charleston

Paul Porter

350k

1M

78

253k 87

27.2M 93

344

25

576

333

-

988

3

1,345

30

24

31

51

44

-

-

0

You might want to say hello

Page 122: Startup Analytics and Figuring out Your Engine for Growth

Google Analytics

Page 123: Startup Analytics and Figuring out Your Engine for Growth

Database + SQL + Excel

Collect Data Query Analyze

Page 124: Startup Analytics and Figuring out Your Engine for Growth

OKR FrameworkStands for “Objectives” and “Key Results” and used by a lot of folks like Google and Zynga.

Page 125: Startup Analytics and Figuring out Your Engine for Growth

Objective: Improve Engagement

Key Result: Get 30% of students to post weekly progress updates by the end of the week.

Experiment(s) this week:Set up class segments in intercom.io and email students on with link to Lecture.Create a Facebook group for the class.

OKR Framework

Page 126: Startup Analytics and Figuring out Your Engine for Growth

What’s your metric?