Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to...

Preview:

Citation preview

Please tweet! @ESRAsurvey @LoveStats

Please tweet! @LoveStats #ESRAsurvey

Call Me Maybe: Effects of asking for telephone numbers on survey honesty

Presented by Annie PettitChief Research Officer at Peanut Labs

Please tweet! @ESRAsurvey @LoveStats

Research Questions

Should you ask at the beginning or the end of the survey?

When To Ask

Will people endorse more socially desirable, charitable behaviours?

Will people endorse fewer illegal, unethical, and embarrassing behaviours?

Social Desirability Illegal BehavioursCBA

Please tweet! @ESRAsurvey @LoveStats

MethodGroup 1•Beginning•Phone number request was first question•N=500

Group 2•End•Phone number request was last question•N=500

Non-probability, incentivized research panelSampled and weighted to US census targets

Please tweet! @ESRAsurvey @LoveStats

Question Categories

Compliment employee

Bought someone

coffee

Kind Charitable

Pee in shower

Embarrassing

Called in sick

Unethical

Listen to music

Neutral

Impaired driving

Illegal

Please tweet! @ESRAsurvey @LoveStats

RESULTSBEGINNING VS END

Please tweet! @ESRAsurvey @LoveStats

Neutral% of People Endorsing Neutral Behaviours

Please tweet! @ESRAsurvey @LoveStats

NeutralIt doesn’t matter if you were asked at the beginning or the end, endorsement rates for neutral behaviours were the same.

Average Endorsement

Standard Deviation

Please tweet! @ESRAsurvey @LoveStats

CharitableEndorsement of charitable behaviours didn’t change if you were asked at the beginning or the end.

Please tweet! @ESRAsurvey @LoveStats

Embarrassing Endorsement of embarrassing behaviours didn’t change if you were asked at the beginning or the end.

Please tweet! @ESRAsurvey @LoveStats

IllegalThough there was more variability, endorsement of illegal behaviours didn’t change if you were asked at the beginning or the end.

Please tweet! @ESRAsurvey @LoveStats

ormakes no Beginning

differenceend

CONC

LUSI

ON

Please tweet! @ESRAsurvey @LoveStats

RESULTSAGREE VS DECLINE

Please tweet! @ESRAsurvey @LoveStats

Method

Group 1•Yes, here’s my phone number•555-5555

Group 2•No! You can’t have my phone number•BUG-OFFF

Please tweet! @ESRAsurvey @LoveStats

IllegalPeople who agree endorse more illegal behaviours

Please tweet! @ESRAsurvey @LoveStats

EmbarrassingPeople who agree endorse more embarrassing behaviours

Please tweet! @ESRAsurvey @LoveStats

CharitablePeople who agree endorse more charitable behaviours

Please tweet! @ESRAsurvey @LoveStats

NeutralPeople who agree endorse more neutral behaviours

Please tweet! @ESRAsurvey @LoveStats

ormakes aAgreeing

differencedisagreeing

CONC

LUSI

ON

Please tweet! @ESRAsurvey @LoveStats

RESULTSINTERACTIONS

Please tweet! @ESRAsurvey @LoveStats

MethodGroup 1

BeginningDecline

Group 2EndDecline

Group 3Beginning

Agree

Group 4End Agree

Please tweet! @ESRAsurvey @LoveStats

Neutral QuestionsEndorsement Rates Not Affected

Please tweet! @ESRAsurvey @LoveStats

Agreers Are Confessors

Illegal Unethical Embarrass Kind Charitable Neutral Average

Please tweet! @ESRAsurvey @LoveStats

theandlisten

If

agreersbeginning

youwanthonestyaskattoCO

NCLU

SION

Please tweet! @ESRAsurvey @LoveStats

Many new questions• Type of PII: What if we asked for email or physical address instead?

• Position of Ask: What if we ask half-way through? After an embarrassing question?

• Survey Style: What if the entire survey is embarrassing?

• Screen Outs: What if everyone was told there would be no screen-outs?

Please tweet! @ESRAsurvey @LoveStats

Thank you!Annie Pettit

Chief Research Officerannie@peanutlabs.com

ca.linkedin.com/in/AnniePettit/facebook.com/AnniePettit

twitter.com/LoveStats

Jonathan CheriffDirector of Sales & Marketingjonathan.cheriff@peanutlabs.com

Find PeanutLabs on LinkedIn Facebook Twitter YouTube

DIY SURVEY PROGRAMMING DIY POLLINGDIY SAMPLE

Recommended