Upload
others
View
0
Download
0
Embed Size (px)
Citation preview
It’s All Qualitative: Why
and How to Conduct
Focus Groups
L2L Presentation, July 2011
Research Business Confidential
The How and Why of Focus Groups SUMMER 2011
Professor: Catherine “Kit” Harris Phone: 703-575-5654
Course Objectives
Course Requirements
Homework Assignments
Class Participation
Grading Scheme
U of ASCD
Today’s Objectives
1. Introduce the basics of research data gathering and usage
2. Focus in on qualitative research
3. As a group, go through a research activity
Objective 1. Basics of research data gathering/usage
Systematic gathering, recording, and analyzing
of actionable information concerning your:
To help make better decisions!
Customers/members/attendees
Operating environment
Products/Services/Events
Research Data Gathering Overview
1. Carefully focus on what you need to know to make the decisions you need to make
2. Think about how you can collect the information and from whom
3. Collect the information
4. Work to analyze/interpret it/present it
Objective 2. Data Collection Method: Focus Groups
• WWII, audience reaction to radio programs.
• Useful in understanding how or why people hold certain
beliefs
• Exploratory in nature
• Methods include focus groups, triads, dyads, in-depth interviews, observation, etc.
• More than discussion; need a lot of planning
Interacting individuals with a common interest or characteristics brought together by a moderator, who uses the group’s
interaction to gain information about a specific issue
• Typically 7-10 people, unfamiliar w/each other
• Moderator creates permissive environment; encourages different points of view
• No pressure to vote/reach consensus
• Discussion is conducted several times with similar participants to identify trends
• Careful analysis of the discussions provide insights
When to use Qualitative versus Quantitative
• Research projects are led neither by quantitative nor qualitative; they work together like peanut butter and jelly
• Focus Groups should be used for exploration and in-depth understanding, but never to make final decisions.
• Can be used before, at the same time, or after a quantitative study
Advantages
• Facial expression/language • Naturally interact/influenced by others (high face
validity) • Quick and a lower cost than IDI; assembled quickly • Interact directly with respondents; non-verbal
responses supplement verbal • Own words, deeper levels of meaning, connections,
subtle nuances • Flexible, wide range of individuals and settings • Results easy to understand/accessible to lay
audiences • Insights on the way to talk about products, services
Disadvantages
• Less control over group; information obtained • Relatively chaotic data • Small numbers/convenience sampling limit ability to
generalize • Trained moderator knowledgeable about group dynamics.
Moderator can bias results unknowingly • Uncertainty about accuracy. Results may be biased by
dominant member; reserved members may hesitate to talk.
What Focus Groups Can Tell You
• How people think or feel • Greater insight into ‘why’ • Improve planning /design • Evaluate existing programs • Understand why consumers react to a product • Guidance to development process • Form hypothesis when none exist • Understand the story, the ‘why’ behind the numbers • Input about issues that will be measured using
quantitative
What Focus Groups Can’t Tell You
• Valid information about individuals - idea is to take advantage of group interactions
• Valid ‘before and after’ information
• Information you can apply generally to other people
• How much progress a client has made toward his own goals
• For making go/no go decisions
• Profiling and sizing target markets
• Measuring marketing effectiveness, awareness, or usage
Common Uses of FG
• New product development studies • Positioning studies • Habits and usage studies • Packaging and assessments • Attitude studies • Advertising/copy evaluation • Promotion evaluation • Idea generation • Employee attitude/motivation studies
Brainstorm
How to Conduct a Focus Group
1. Conceptualization/Planning
2. Interview
3. Analysis/reporting
1. Conceptualization/Planning
• Determine the purpose
• Determine whom to study
• Estimate procedure, time line, costs
• Develop a screener to recruit the participants
• Arrange for room rental (with or without mirror), recruitment, gratuity
• Arrange for viewers
Screening Questionnaire • Introduction – basic
background questions
• Security and participation questions
• Series of attitude and behavior questions
• Demographic summary
• Articulation Question
• Invitation – if they pass above criteria
Recruiting Process
• Homogeneity important – similar experience with product or practice under discussion
• Depending on topic – can divide age groups, can divide genders
• Reminders sent
• Re-screen day of to ensure you are getting who you recruited
• Recruit more than you need to offset no-shows
2. Interview
• Develop the topic guide/questions
• Moderator Preparation
• Participants
• Record the discussion
• Begin the discussion
Discussion Guide
• Facilitates discussion between the client/moderator • Directs the flow of conversation • Predetermines the structure of report • Written in brief outline form • Sections:
o Introduction of moderator o General purpose of group o Administrative details o Introduction of participants to group o Easy ice-breaker discussion/technique o Some do written materials here o Discussion
Stimuli
• Written product/service concept descriptions
• Product or packaging examples
• Ads/storyboard
• Website/Internet
• Written exercises
The Moderator
• Gender, ethnicity of moderator
• Basic rules of good moderating
• Create inviting, friendly, relaxed atmosphere
• Open with small talk
• Avoid a teacher student environment
• Avoid ‘voting’
Moderator Fundamentals
• Establish rules o only one person talks at a
time
o Speak loudly
o Food and drink
o Beepers and cell phones
• Table name cards for first names only
• Use ‘write down’ exercises if some don’t seem to be having their say
Qualitative Techniques
• Pause and probe
• No head nodding/yes’s/uh huhs
• Quiet Group - Observe body language - if someone is nodding in agreement, she probably has something to share
• Open with a free association exercise by asking how they feel about ___
• Ask them to bring in an example of their favorite item in the category (say magazines)
• Storytelling – in the intro have people talk about their perfect ____, priming them for the discussion to come.
Qualitative Techniques
• Projective techniques – such as mind mapping
• Advice to __ (the president of the organization)
• Exercise that polarizes the group
• Listen carefully
• Probe with ‘take that deeper’… ‘meaning what?’... ‘Because…?’
• Position-profiling exercises
• Energizing exercises
The Four Question Sequence
Used to dig beyond top-of-mind responses
(explore, discover, expand)
1. Main Question
2. Follow-Up Questions
3. Probing Questions
4. Prompts
Poll Question
Don’t forget: You can copy-
paste this slide into other
presentations, and move or
resize the poll.
Laddering
Used to understand product or service benefits, moving from importance of features to
emotional benefit
1. Which feature do you like best?
2. What does that feature do? (functional benefit)
3. What does that (functional benefit) do for you? (higher benefit)
4. What does that (benefit) do for you? (emotional benefit)
Projective Techniques
Explore associations with products, services – project their feeling/beliefs, revealing their own
1. Metaphors, Analogies and Similes
2. Third Party Projections
3. Role Playing
4. Associations (word, image)
5. Personification
The Back Room
• Pre-group briefing: avoid been seen by respondents
• Meet with moderator beforehand
• Plan visits from the moderator to the back room
• Bring an open mind
• Listen to what ALL participants have to say
• Big picture in mind
• Post-group briefing
3. Analyzing and Reporting
• Taking notes
• Debriefing/field notes
• Working with transcripts
• Writing report:
o Create sections based on objectives or questions
o Work with transcripts, move the highlighted relevant comments into the appropriate section
o Write a paragraph or two that analyses each question based on comments
o Select a sample of 1 - 4 representative comments
o Draw overall conclusions and or recommendations.
o Report should include topic guide and screener as an appendix; transcripts available upon request
Common Qualitative Mistakes
• Lack of clear objectives • Wrong participants are recruited • Groups that are not homogeneous enough • Not enough time/topic guide • Not enough time/adequate stimuli • Not objective moderator • Disruptive communication between the moderator/back
room • Inexperienced moderator • Analysis
Up and Coming Techniques
Online Qualitative Research
• Quantitative research is going beyond focus groups
o Bulletin boards Real time chats o Research blogs Research communities o Social networking monitoring Video journals o Webcam focus groups web Web intercept/chats
• Has made qualitative research faster, better and in some cases
cheaper
• Advantages: o Geography o Candor o Convenient time access o Longitudinal capabilities
Objective 3. Focus Group Activity – Mind Mapping
Top mentions in “Mind Map” Top mentions in “Mind Map”
Prepared for the Future
Supported
Individual Attention
Character Development
What parents said Whole Child Education means to them
Parents idea of a Whole Child Education matches fairly close with the actual components of the Whole Child Initiative definition.
Notably, however, parents do not volunteer safety or health.
Respect for self and others
Well-rounded
Real World
Personalized
One-on-one
Community involvement