Embed Size (px)
Citation preview
Startup R&D ToolkitNOEW 2016
Darshil Vora Yakaira Nunez
Sr. Product Designer Principal User Researcher
@darshilv @DigEthno
Forward-Looking Statements
Statement under the Private Securities Litigation Reform Act of 1995:
This presentation may contain forward-looking statements that involve risks, uncertainties, and assumptions. If any such uncertainties materialize or if any
of the assumptions proves incorrect, the results of salesforce.com, inc. could differ materially from the results expressed or implied by the forward-looking
statements we make. All statements other than statements of historical fact could be deemed forward-looking, including any projections of product or
service availability, subscriber growth, earnings, revenues, or other financial items and any statements regarding strategies or plans of management for
future operations, statements of belief, any statements concerning new, planned, or upgraded services or technology developments and customer contracts
or use of our services.
The risks and uncertainties referred to above include – but are not limited to – risks associated with developing and delivering new functionality for our
service, new products and services, our new business model, our past operating losses, possible fluctuations in our operating results and rate of growth,
interruptions or delays in our Web hosting, breach of our security measures, the outcome of any litigation, risks associated with completed and any possible
mergers and acquisitions, the immature market in which we operate, our relatively limited operating history, our ability to expand, retain, and motivate our
employees and manage our growth, new releases of our service and successful customer deployment, our limited history reselling non-salesforce.com
products, and utilization and selling to larger enterprise customers. Further information on potential factors that could affect the financial results of
salesforce.com, inc. is included in our annual report on Form 10-K for the most recent fiscal year and in our quarterly report on Form 10-Q for the most
recent fiscal quarter. These documents and others containing important disclosures are available on the SEC Filings section of the Investor Information
section of our Web site.
Any unreleased services or features referenced in this or other presentations, press releases or public statements are not currently available and may not
be delivered on time or at all. Customers who purchase our services should make the purchase decisions based upon features that are currently available.
Salesforce.com, inc. assumes no obligation and does not intend to update these forward-looking statements.
We are not going to
• Sell anything
• Learn how to do research!
• Learn to Design!
• Provide deep explanation of tools and methods used for research and design.
Basic ProcessWe have 30 minutes let’s dive right into it!
VALIDATEDoes it work the way we want it to?
Does it need improvement?
PROBLEM FRAMING
What do customers do/want/need?
BRAINSTORMING
SOLUTIONSHow might we enable that?
BUILDING EXPERIMENTSWhich tactics are working?
Product Phases
All products generally go through 5 phases, startups usually need these 4.
Let’s find out how to leverage Research and Design in each one!
VALIDATIONBUILDING EXPERIMENTSBRAINSTORMING SOLUTIONSPROBLEM FRAMING
ME
TH
OD
SD
ELIV
ER
AB
LE
S
What do our customers need
(or want)?
How should we think about the
competitive landscape?
What problem should we solve?
Pull reports on cases
Pull reports on feature usage
Subject matter expert interviews
Competitive analysis
Review Forrester trends
Secondary research
Behavioral models
User Mental Models
UX success metrics
Design briefs
Trends Reports
Customer Segmentations
How might we differentiate from
competitors?
What new features might we
offer?
What would we do if resources
weren’t a constraint?
Customer Feedback
UI comparisons
Modes/motivation matrices
Co-Creation exercises
Design Studio/Workshops
Sketchy concepts
Storyboards
Concept systems
Are we on the right track?
Which approaches are
working
Does preference vary by
customer segment? Why?
Customer Feedback
Preference Tests
UI Pattern Alignment
Heuristic Review
Tree Tests
Accessibility Reviews
RITE Usability Tests
Invision prototypes
Keynote animations
HTML clickable protos
QU
ES
TIO
NS
Process Summary (Research and
Design)(It’s cyclical and not perfectly linear, but you get the idea)
Did we move the needle?
Are there usability issues
we can further assuage
through non-structural
changes?
Usage Metrics
AppStore Reviews
Customer Feedback
Eye tracking
Unmoderated click tests
Videos to “prove it” to
stakeholders.
Identification of
outstanding issues
Recommendations
for changes
Heuristic triage
Problem Framing
What is 5+5?
What two numbers add up to 10?
7 + 3
-10 + 20
Sqrt(100) + 0
Sqrt(2) + 8.6
Concept Board – online white boarding, collaboration, project management etc.
QUESTIONS METHODS DELIVERABLES
Pull reports on cases
Pull reports on feature usage
Subject matter expert
interviews
Competitive analysis
Review Forrester trends
Secondary research
Behavioral models
User Mental Models
UX success metrics
Design briefs
Trends Reports
Customer Segmentations
What do our customers need
(or want)?
How should we think about
the competitive landscape?
What should we build?
Different techniques to help with problem framing
VALIDATIONBUILDING EXPERIMENTSBRAINSTORMING SOLUTIONSPROBLEM FRAMING
Brainstorming Solutions
Brainstorming Solutions
Tip 1: Establish a Common Language
Tip 2: Save Judgment for later
Tip 3: Quantity over Quality
Some Exercises
Circles!
The Love Letter and Break-Up letter
Reverse Brainstorming
“how do we achieve this result?” flip and ask “how do we not want to achieve this result?”
Association Game
Build on each others ideas, can be performed as a written exercise as well
QUESTIONS METHODS DELIVERABLES
Customer Feedback
UI comparisons
Modes/motivation matrices
Co-Creation exercises
Design Studio/Workshops
Sketchy concepts
Storyboards
Concept systems
How might we differentiate
from competitors?
What new features might we
offer?
VALIDATIONBUILDING EXPERIMENTSBRAINSTORMING SOLUTIONSPROBLEM FRAMING
• A-Z Ideation tools
• OpenIdeo Ideation Tools
• Innovators Toolkit
• Hyper Island Toolbox
Resources
Experimentation
Tip 1: Quick, Cheap and Easy!
Tip 2: Make your friends go through the flow
Tip 3: Repeat!
Advanced Tools
Pros
• Desktop and Mobile
• Click throughs
• Collaboration
• Organization
Cons
• Advanced interactions not
handled well
Advanced Tools
Pros
• Easy to learn and use
Cons
• Only mobile prototypes
• No collaboration
HTML, CSS, JS Prototypes
Pros
• Very close to the real product
• Easy to test with users
Cons
• Longer times depending on
existing resources
• Skilled resources
QUESTIONS METHODS DELIVERABLES
Customer Feedback
Preference Tests
UI Pattern Alignment
Heuristic Review
Tree Tests
Accessibility Reviews
RITE Usability Tests
Invision prototypes
Keynote animations
HTML clickable prototypes
Flinto mobile prototypes
Are we on the right track?
Which approaches are working
best?
Does preference vary by
customer segment? Why?
VALIDATIONBUILDING EXPERIMENTSBRAINSTORMING SOLUTIONSPROBLEM FRAMING
A really good book on building prototypes by Dan Roam
VALIDATION
In Person
Online: VerifyApp
Pros
• Preference Tests
• Cheaper in comparison
Cons
• Advanced interactions not
handled well
Other Online Tools
Pros
• Can work with any experiment
design
• Provides recruiting options
Cons
• Expensive! $$$
• Learning curve is high
QUESTIONS METHODS DELIVERABLES
Eye tracking
Unmoderated click tests
Instrumentation usage data
CogTool
AppStore Reviews
Customer Feedback
Heuristic triage
Efficiency assessments
Identification of outstanding
issues
Recommendations for changes
Are there pain-points we can
assuage?
Did we move the needle?
Did our changes have impact?
VALIDATIONBUILDING EXPERIMENTSBRAINSTORMING SOLUTIONSPROBLEM FRAMING
Just Enough Research by Erika Hall is wonderful short book with direct
applicable guidance on how to get Research going in startups.
thank y u
