CONJOINT - Insight Innovationinsightinnovation.org/wp-content/uploads/2017/06/NA/Lev.pdfABOUT USING...

Preview:

Citation preview

powered by aytm.com Lev Mazin

CONJOINT REIMAGINED!

powered by aytm.com Lev Mazin

EVERYTHING THAT CAN BE AUTOMATED SHOULD BE AUTOMATED

EVERYTHING THAT SHOULD BE AUTOMATED WILL BE AUTOMATED

EVERYTHING ELSE IS ART

CASE STUDY ABOUT AUTOMATION

Mar

k / c

orp.

rese

arch

er

powered by aytm.com Lev Mazin

THIS IS A CASE STUDY ABOUT USING UI/UX PRINCIPLES TO DRIVE AUTOMATION OF A PROVEN, ROBUST METHODOLOGY SUCH AS CHOICE BASED CONJOINT (CBC)

CASE STUDY ABOUT AUTOMATION

Ashl

ey /

mar

kete

r

powered by aytm.com Lev Mazin

BUSINESS OBJECTIVE WE NEEDED TO ADDRESS:

FULLY AUTOMATE CBCTO MAKE IT FAST, EASY AND RELIABLE FOR OUR FAST-PACED CLIENTS

CASE STUDY ABOUT AUTOMATION

Step

hani

e / i

nves

tor

powered by aytm.com Lev Mazin

CONJOINT?WHAT COMES TO MIND when you hear the word

powered by aytm.com Lev Mazin

EXPENSIVE

BIG PROJECT

MANUAL COMPLICATED5-10 WEEKS

CALL STATISTICIANS

MOBILE-UNFRIENDLY

LONG LOI

TAKES A VILLAGE…

LONGHIGH QUALITYSOPHISTICATED

HIERARCHICAL BAYESIAN

powered by aytm.com Lev Mazin

WHAT ELSE COMES TO MIND?

INDUSTRY GOLD STANDARD

BY RESEARCHERS FOR RESEARCHERS

TRUSTEDHIGHLY REPUTABLEBRILLIANT TEAM

powered by aytm.com Lev Mazin

WHAT ELSE COMES TO MIND?

NEW WAVE

EXPERIMENTAL

BRILLIANT TEAMS

BY DEVELOPERS FOR RESEARCHERSAND EVERYONE ELSE

powered by aytm.com Lev Mazin

WHAT IS IT ANYWAY?

powered by aytm.com Lev Mazin

WHAT IS IT ANYWAY?

powered by aytm.com Lev Mazin

WHAT IS IT ANYWAY?

powered by aytm.com Lev Mazin

WHAT IS IT ANYWAY?

powered by aytm.com Lev Mazin

WHAT IS IT ANYWAY?

powered by aytm.com Lev Mazin

WHAT IS IT ANYWAY?

powered by aytm.com Lev Mazin

OBJECTIVES:

FULLY AUTOMATECONJOINT TESTSWHILE STAYING TRUE TO OUR COREBRAND PROMISES

CONTRADICTORY OBJECTIVES

FAST ACCURATE

powered by aytm.com Lev Mazin

PRIORITIES:

MAKE IT EASY FORCLIENTS AND RESPONDENTS

REAL-TIME DATA ANALYSIS

EASY TO INTERPRETVISUALIZATION

LESS IS MORE

powered by aytm.com Lev Mazin

TECH INSIDE:

MULTINOMIAL LOGISTIC REGRESSION

LESS IS MORE

Sir D

avid

Rox

bee

Cox

powered by aytm.com Lev Mazin

LESS IS MORE

Drag and dropMAKE IT EASY FORCLIENTS AND RESPONDENTS

REAL-TIME DATA ANALYSIS

EASY TO INTERPRETVISUALIZATION

powered by aytm.com Lev Mazin

LESS IS MORE

COPY& PASTE ATTRIBUTESAND OPTIONS

powered by aytm.com Lev Mazin

LESS IS MORE

ADJUST EXPERIENCE

powered by aytm.com Lev Mazin

MAKE IT EASY FORCLIENTS AND RESPONDENTS

REAL-TIME DATA ANALYSIS

EASY TO INTERPRETVISUALIZATION

LESS IS MORE

ONLY 3-5 SCREENS

powered by aytm.com Lev Mazin

LESS IS MORE

MAKE IT EASY FORCLIENTS AND RESPONDENTS

REAL-TIME DATA ANALYSIS

EASY TO INTERPRETVISUALIZATION

powered by aytm.com Lev Mazin

LESS IS MORE

MAKE IT EASY FORCLIENTS AND RESPONDENTS

REAL-TIME DATA ANALYSIS

EASY TO INTERPRETVISUALIZATION

powered by aytm.com Lev Mazin

MAKE IT EASY FORCLIENTS AND RESPONDENTS

REAL-TIME DATA ANALYSIS

EASY TO INTERPRETVISUALIZATION

VISUALIZATION

powered by aytm.com Lev Mazin

MAKE IT EASY FORCLIENTS AND RESPONDENTS

REAL-TIME DATA ANALYSIS

EASY TO INTERPRETVISUALIZATION

VISUALIZATION

powered by aytm.com Lev Mazin

PROs:FAST:MINUTES TO SET UP AND ANSWER

EASY:ANYONE CAN USEAND ANALYZE IN REAL-TIME

EXPRESS: PROS

powered by aytm.com Lev Mazin

CONs:AGGREGATEDRESULTS

APPROXIMATION

INHERITEDFOCUS ON ONEBEST COMBINATION

EXPRESS: CONS

powered by aytm.com Lev Mazin

PRIORITIES:

HIGHEST ACCURACY

OPTIMIZEDATA CRUNCHINGCYCLES

EXPANDING THE METHODOLOGY

GOING FURTHER

powered by aytm.com Lev Mazin

EXPRESS VS. SEGMENTATIONPARIS AS VACATION PACKAGE DESTINATION

PRIORITIES:

HIGHEST ACCURACY

OPTIMIZEDATA CRUNCHINGCYCLES

EXPANDING THE METHODOLOGY

powered by aytm.com Lev Mazin

EXPRESS VS. SEGMENTATIONPARIS AS VACATION PACKAGE DESTINATION

PRIORITIES:

HIGHEST ACCURACY

OPTIMIZEDATA CRUNCHINGCYCLES

EXPANDING THE METHODOLOGY

powered by aytm.com Lev Mazin

EXPRESS VS. SEGMENTATIONPARIS AS VACATION PACKAGE DESTINATION

PRIORITIES:

HIGHEST ACCURACY

OPTIMIZEDATA CRUNCHINGCYCLES

EXPANDING THE METHODOLOGY

powered by aytm.com Lev Mazin

GOING FURTHER

BAYESIANHIERARCHICAL

Thom

as B

ayes

MODEL

powered by aytm.com Lev Mazin

TECH INSIDE:

HIERARCHICAL BAYESIAN MODELMULTINOMIAL LOGISTIC REGRESSION

GOING FURTHER

+ CLUSTERING

FINITE GAUSSIAN MIXTURE MODEL VIA EXPECTATION-MAXIMIZATION ALGORITHM, WITH BAYESIAN INFORMATION CRITERION FOR MODEL SELECTION.

MULTIPLE BI-VARIATE FISHER'S EXACT TESTS FOR CATEGORICAL VARIABLES, AND WELCH'S T-TEST FOR NUMERICAL VARIABLES

Rona

ld F

ishe

r

powered by aytm.com Lev Mazin

PRIORITIES:

HIGHEST ACCURACY

OPTIMIZEDATA CRUNCHINGCYCLES

EXPANDING THE METHODOLOGY

GOING FURTHER

7-10 SCREENS

powered by aytm.com Lev Mazin

OPTIMIZATION:

9 HOURS >5-15 MINUTES CRUNCH TIMETIM

EGOING FURTHER

powered by aytm.com Lev Mazin

PRIORITIES:

HIGHEST ACCURACY

OPTIMIZEDATA CRUNCHINGCYCLES

EXPANDING THE METHODOLOGY

GOING FURTHER

powered by aytm.com Lev Mazin

GOING FURTHER

Mal

colm

Gla

dwel

lH

owar

d M

osko

witz

powered by aytm.com Lev Mazin

PRIORITIES:

HIGHEST ACCURACY

OPTIMIZEDATA CRUNCHINGCYCLES

EXPANDING THE METHODOLOGY

SEG

MEN

TATI

ON

LAYE

RGOING FURTHER

powered by aytm.com Lev Mazin

SEG

MEN

TATI

ON

LAYE

R

powered by aytm.com Lev MazinN= 321/1,123powered by aytm.com Page # 40

PLEASE CHOOSE THE VACATION PACKAGE YOU PREFER Jan 17 2017prepared by Lev Mazin

Importance of attributes

1 Destinations Expand 38.7%

2 Vacation duration Expand

11.6%

3 Flight included Expand 16.0%

4 Entertainment Expand 11.7%

5 Included food and drinks Expand

14.6%

Conjoint Segmentation. Persona 1. 578 respondents in this cluster

Joel

Joel showed specific preference for Paris, France

over other options of Destinations.

Prevalent traits:Gender: MalesAge Range: 35+Ethnicity / Race: White American

Favorite answers:Q1Q2A6Q11SQ1

powered by aytm.com Lev MazinN= 321/1,123powered by aytm.com Page # 41

PLEASE CHOOSE THE VACATION PACKAGE YOU PREFER Jan 17 2017prepared by Lev Mazin

Importance of attributes

1 Destinations Expand 38.7%

2 Vacation duration Expand

11.6%

3 Flight included Expand 16.0%

4 Entertainment Expand 11.7%

5 Included food and drinks Expand

14.6%

Joel

Joel showed specific preference for Paris, France

over other options of Destinations.

Prevalent traits:Gender: MalesAge Range: 35+Ethnicity / Race: White American

Favorite answers:Q1Q2A6Q11SQ1

Market share view

Destination Vacation duration Flight included Entertainment Food & drinks Internet service Score

1 Sydney, Australia 10 days Non-stop flight All museums pass Unlimited High speed 86.9%

2 Sydney, Australia 10 days Non-stop flight Spa packages Unlimited High speed 86.6%

3 Sydney, Australia 3 weeks Non-stop flight All museums pass Unlimited High speed 85.8%

4 Sydney, Australia 2 weeks Non-stop flight All museums pass Unlimited High speed 85.5%

5 Sydney, Australia 10 days Non-stop flight All museums pass Unlimited High speed 85.5%

6 Sydney, Australia 3 weeks Non-stop flight Spa packages Unlimited High speed 85.4%

7 Sydney, Australia 10 days Non-stop flight All museums pass Unlimited High speed 85.3%

8 Sydney, Australia 2 weeks Non-stop flight Spa packages Unlimited High speed 85.2%

9 Sydney, Australia 7 days Non-stop flight All museums pass Unlimited High speed 85.1%

10 Sydney, Australia 10 days Non-stop flight Night club pass Unlimited High speed 84.8%

Top ten packages. Conjoint Segmentation. Persona 1. 578 respondents in this cluster

powered by aytm.com Lev Mazin

TESTING AND OPTIMIZINGNEW TECH

powered by aytm.com Lev Mazin

TESTS:

OPTIMAL N

VALIDATION

N/A OPTION

EXPRESS VS HB

MINIMAL N

powered by aytm.com Lev Mazin

TESTS:

OPTIMAL N

VALIDATION

N/A OPTION

EXPRESS VS HB

IMPACT OF THE N/A OPTIONVACATION PACKAGE DESTINATION AND DURATION MEANS (33 variables)

powered by aytm.com Lev Mazin

TESTS:

OPTIMAL N

VALIDATION

N/A OPTION

EXPRESS VS HB

EXPRESS VS. HBVACATION DURATION IMPORTANCE

powered by aytm.com Lev Mazin

TESTS:

OPTIMAL N

VALIDATION

N/A OPTION

EXPRESS VS HB

EXPRESS VS. HB RESPONDENTS’ SURVEY-TAKING EXPERIENCE RATING

4 screens

7 screens

powered by aytm.com Lev Mazin

WE’VE PROVEN THAT IT’S POSSIBLE

OBJECTIVE:

FULLY AUTOMATEC.B. CONJOINT TESTS WHILE STAYING TRUE TO OUR COREBRAND PROMISES

GOALS:

MAKE IT EASY FORCLIENTS AND RESPONDENTS

ANALYZE DATA IN REAL TIME

CREATE ONLINESIMULATOR THAT A NON-RESEARCHER COULD USE

GOALS:

ACHIEVE THE HIGHEST POSSIBLE ACCURACY

OPTIMIZE DATA-CRUNCHING TIME

EXPAND THE METHODOLOGY ONE STEP FURTHER

powered by aytm.com Lev Mazin

+1 (415) 364-8601 support@aytm.comaytm.com

Live demo today at 3:30 at the Board RoomStop by the AYTM booth to experience it firsthand