Embed Size (px)
DESCRIPTION
(watch the presentation video here: http://leanuxnyc.co/nyc/is-bad-research-better-than-no-research-w-deidre-kolarick/) One of the core principles of Lean UX is to do research often with the entire team’s involvement. Collaboration is essential, but doing effective research is a skill that takes practice and training. More importantly, doing research badly can lead to misleading conclusions, false confidence, and a missed opportunity for insight. In this talk, I’ll discuss how to balance the benefits of getting everyone involved in research with the need for sound methodology when conducting UX research. Deidre Kolarick Deidre is Director of Research & Insights at Catalyst Group in New York City, where she is actively involved in developing new methods for conducting user research. She holds a PhD. in cognitive psychology from Yale University. She is also an adjunct professor of psychology at New York University, a tennis addict, and triathlete.
Citation preview
345 Seventh Avenue 11th Floor New York, NY
Is bad research better than no research? Deidre Kolarick Director of Research & Insights Catalyst Group
January 14, 2014
Lean Research
• Why GOOB is awesome
• Why GOOB is sometimes not that awesome
• The perils of bad research and lean-specific issues
So is bad research better than no research?
1. Don’t test your own designs.
16
The case for someone else doing it
• IRBs and conflicts of interest
(Turner & Spilich, 2006)
Smoking improves cognitive function
16
The case for someone else doing it
• Confirmation bias
• Biases are automatic and unconscious
• The role of emotion • Awareness isn’t enough (Dasgupta, 2009)
17
2. Make a plan - and stick to it.
• Sample size and procedures
• Write out a script • Monitor and share results in real-time
• Review, discuss, rinse, repeat
18
3. Observe and be observed.
• Easier to recognize bias in others
• De-stigmatize bias – talk about it
• Listen to each other and give feedback (and accept it!)
19
4. Treat research as a skill to be developed.
• Study the craft
• Think about the questions you’re asking
• Dunning-Kruger effect
• Consider hiring a pro
Things to watch out for
• Explaining intent / correcting users
• Question types • Do you like it? • What if I changed ________? • Would you…. (share it, come back, etc.)?
• Don’t ask – let them tell you
• If you can – GOOW!
37
Thank you!
Catalyst Group
345 7th Avenue (11th Floor), New York, NY 10001 (212) 243 7777 [email protected] Link to materials used in this workshop
