29
Analytics why, when, what, where, how & gotchas @niallroche [email protected] Get in touch Niall Roche

UCL M.Sc. Technology Entrepreneurship 2015 - Analytics

Embed Size (px)

Citation preview

Page 1: UCL M.Sc. Technology Entrepreneurship 2015 -  Analytics

DECIDE

Analyticswhy, when, what, where, how & gotchas

@[email protected] in touch

Niall Roche

Page 2: UCL M.Sc. Technology Entrepreneurship 2015 -  Analytics
Page 3: UCL M.Sc. Technology Entrepreneurship 2015 -  Analytics

DECIDE

why use analytics?find out who users are

find out how they are using your product (or not)

find out what they are/are not interested in

saves wasted effort or can try differently

either way you have learned something!

can help with innovation accounting

can help improve product with A/B testing

Page 4: UCL M.Sc. Technology Entrepreneurship 2015 -  Analytics

DECIDE

provable learnings

compare the data to measure effectiveness new features

cohort analysis

identify new ideas from what people want to do, but can't

pretty dashboards and spreadsheets

Page 5: UCL M.Sc. Technology Entrepreneurship 2015 -  Analytics

DECIDE

know your userswhere geographically (may not be accurate)

how did they get there (referrals & campaigns)

gender & age (may be implied)

what devices

if from mobile, how does the website look on those devices

what languages are they using

when are they using it (any interesting trends?)

Page 6: UCL M.Sc. Technology Entrepreneurship 2015 -  Analytics

DECIDE

creates lots of data creates data points for further analysis

a data point to make predictions against

can dangerous!

can apply Machine Learning

can be a source of value and revenue

could be used for targeted advertising

Page 7: UCL M.Sc. Technology Entrepreneurship 2015 -  Analytics

DECIDE

without analytics

no idea how users are using your site/app/device

hard to prove to investors and prove metrics

how to measure against KPIs?

how to know if something new or different is working

Page 8: UCL M.Sc. Technology Entrepreneurship 2015 -  Analytics

DECIDE

when?start tracking as early as possible (no really!)

missed data can be lost value

especially when it shows something is wrong

learnings as important as the technical aspect

maybe more!

figures don't lie (ish)

figures are not everything (converse with users!)

Page 9: UCL M.Sc. Technology Entrepreneurship 2015 -  Analytics

DECIDE

what?decide what to track

and how to interpret

what are the user journeys to focus on

what goal performance to measure

look crash reports exceptions and bad things

don't forget about some feedback!

Page 10: UCL M.Sc. Technology Entrepreneurship 2015 -  Analytics

DECIDE

Industry Baselinescompare with other apps in same category

user baselines sourced from the industry

• app annie

• visionmobile

• Flurry

• apptopia

Page 11: UCL M.Sc. Technology Entrepreneurship 2015 -  Analytics

DECIDE

Examine Sessionslook at session length

compare length with journeys

is page wait time an issue?

where do users get bored move on?

user behaviour may be in and out vs linger

supermarket vs convenience store

use at bus stop vs bus

compare behaviour of different types of user groups

Page 12: UCL M.Sc. Technology Entrepreneurship 2015 -  Analytics

Examine Funnels

Page 13: UCL M.Sc. Technology Entrepreneurship 2015 -  Analytics

DECIDE

where?

identify milestones along a journey

different decision points for user

all major events

should be mapped to KPIs and metrics

if in doubt - track as much as possible!

Page 14: UCL M.Sc. Technology Entrepreneurship 2015 -  Analytics

DECIDE

Metrics• Acquisition

• Activation

• Retention

• Referral

• Revenue

• many many more…..

Page 15: UCL M.Sc. Technology Entrepreneurship 2015 -  Analytics

DECIDE

cohorts• cohort analysis

• match campaigns to cohorts

• ignore vanity metrics!

• no of page impressions + signups not as important as engaged users

• can always buy users to visit your site

• what campaigns convert into paying customers for lowest acquisition cost

• useful when calculating lifetime value of customers

Page 16: UCL M.Sc. Technology Entrepreneurship 2015 -  Analytics
Page 17: UCL M.Sc. Technology Entrepreneurship 2015 -  Analytics
Page 18: UCL M.Sc. Technology Entrepreneurship 2015 -  Analytics

DECIDE

how? weblogs

limited but useful

event trackers

javascript event tracking

cookies to track repeat visitors

session capture & replay with heatmaps

Page 19: UCL M.Sc. Technology Entrepreneurship 2015 -  Analytics

DECIDE

toolsGoogle Analytics

MixPanel

Liquid

Flurry

Crashlytics

AppSee

UXCam

AppAnalytics

UsabilityTools

Localytics

Segment

Kissmetrics

customer.io

mparticle

many more

Page 20: UCL M.Sc. Technology Entrepreneurship 2015 -  Analytics

DECIDE

A/B Testingimplementation options

AB Tasty

Convert

Optimizely

Unbounce

many analytics tools have simple implementations built in too with reports on variance

Page 21: UCL M.Sc. Technology Entrepreneurship 2015 -  Analytics

DECIDE

potential pitfalls

Page 22: UCL M.Sc. Technology Entrepreneurship 2015 -  Analytics

DECIDE

App pitfalls

Page 23: UCL M.Sc. Technology Entrepreneurship 2015 -  Analytics

DECIDE

app launch eventsapp icon

spotlight

push notification

from other app / device

url scheme

intent (Android)

Document Handler

proximity trigger

geofence

beacon/iBeacon/eddistone/NFC

system event (low battery)

background mode may bypass initial start logic

Page 24: UCL M.Sc. Technology Entrepreneurship 2015 -  Analytics

DECIDE

multiple pathsA -> B -> C is not always straightforward

may be multiple routes to same point in app/site

how did the user get there?

Tab / Swipe / Press / Gesture

from Hamburger menu, context and other menus

tracking context of how an event was reached

Page 25: UCL M.Sc. Technology Entrepreneurship 2015 -  Analytics

DECIDE

• tracking signed in web users mush easier than using cookies as they may not span different devices

• identify hits from bots / screen scrapers / web search tools / developers & testers / uptime checkers

• page load time measurement (especially in areas where there are slow connections such as emerging markets, and poor connections)

• look for different behaviours and trends

• compare session length vs onboarding

• trying to determine reasons for dropoff

Page 26: UCL M.Sc. Technology Entrepreneurship 2015 -  Analytics

ga('send', {  hitType: 'event',  eventCategory: 'Video',  eventAction: 'play',  eventLabel: 'cats.mp4'});

//for Single Page Appsga('send', 'pageview', '/new-page');

Category -> Action -> Label + extra if needed

Page 27: UCL M.Sc. Technology Entrepreneurship 2015 -  Analytics

DECIDE

technical problems• some technical issues for websites

• leaving page on form submit

• careful with placement of code

• missing images, load events may not fire

• add timeouts for error handling

Page 28: UCL M.Sc. Technology Entrepreneurship 2015 -  Analytics

DECIDE

actioning with dataplatforms like Liquid (onliquid.com) can adapt an app experience based on data

identify variables to change inside the app

trigger an actions on a funnel of users (e.g push notification)

set rules to automatically intervene based on trends

personalised experiences

Page 29: UCL M.Sc. Technology Entrepreneurship 2015 -  Analytics

DECIDE

Analyticswhy, when, what, where, how & gotchas

@[email protected] in touch

Niall Roche