Interaction Design primer - Carnegie Mellon School of ... · Community-Centered Design Service...

Preview:

Citation preview

2/8/2016

1

Interaction Design primer

Spring 2016

<Reid Simmons>

Illah Nourbakhsh

Design

What is design?

Herb Simon:

activity that seeks to Change Existing Situations Into Preferred Ones

2/8/2016

2

Hot Topics in Design

Human-Centered Design

Community-Centered Design

Service Design

Interaction Design

2/8/2016

3

Pentad Activity

• Pick one research question, brainstorm a

specific experiment

• Fill out all 5 Pentad categories

• [5 minutes]

2/8/2016

4

The Cycle of Engagement

Allocation of Involvement

Face engagement

Acquaintanceship

Engagements among unacquainted

Communication boundaries

Regulation of mutual involvement

Uncontained participation

Situational Proprieties

Tightness and Looseness

Tang, Approaching and Leave-Taking

John Tang, Approaching and Leave-Taking: Negotiating Contact in Computer-Mediated Communication

Openings consist of:

contact initiation: mutually recognizing an attempt to initiate contact

greetings: establishing each person’s identity and that a conversation has started

topic initiation: introducing the first topic

Closings consist of:

topic termination: mutually recognizing that the topic discussion has ended

leave-taking: reaffirming each other’s acquaintance before breaking contact

contact termination: ending the connection that was enabling the conversation

2/8/2016

5

Tang, Attention Commitment

Grey: attention commitment onset

Engagement Design Activity

• Pick another research question, imagine a

specific experiment

• Fill out every engagement phase with at

least one vignette

• [5 minutes]

2/8/2016

6

DiSalvo, Buchanan and design

Carl DiSalvo:

The special role of Architecture and robotics�

DiSalvo: formalizing Product

Four dimensions:

Materiality

Expression

Function

Form

2/8/2016

7

DiSalvo: formalizing Product

Materiality

DiSalvo: formalizing Product

Expression – Tatsuya Matsui

2/8/2016

8

DiSalvo: formalizing Product

Expression

DiSalvo: formalizing Product

Expression

"Today, we are using technology to further an agenda of destruction

and violence, which is why—more than ever—we need to rethink its

role in our society and make sure that it is only used to better

humanity. By creating Posy, I hope to unleash a weapon of peace—a

reminder that one small robot's step is a giant leap toward a peaceful

and equitable future for all."

—Tatsuya Matsui

2/8/2016

9

DiSalvo: formalizing Product

Function

DiSalvo: formalizing Product

Form as organization of all other dimensions

2/8/2016

10

Illah Nourbakhsh | CMU

Robotics Institute | PHRI

An Analytical Cross of InteractionProf. Dick Buchanan, from Burke, Barnlund, etc.

Material (product)

[reductive/geometric]

Topic (product &

designer) [familial]

Interaction (product & user)

[entitative/directional]

Gaia: product &

cosmos [dialectic,

metaphysical]

Cross Activity

• Pick your third research question.

Imagine a robot and experiment.

• Fill out all four cross categories.

• [5 minutes]

2/8/2016

11

IDEO Create process

Frameworks and Brainstorming

• P. 12 P. 15

2/8/2016

12

Brainstorming Practice

• Pick your favorite research question.

• Choose a framework, draw your context

(3 minutes)

• Spend 5 minutes brainstorming at least 20

totally different experiments.

Storyboarding / Sketching -Robot250

2/8/2016

13

Storyboarding Practice

• Pick one of your ideas

• Using the Robot250 Storyboard template

questions, fill out all four columns with

pictures only.

• [5 minutes]

Design Patterns – Kahn et al.

“Light on two sides of every room.”

2/8/2016

14

Alexander Design Patterns

1 Patterns should be at the ideal level of abstraction

Alexander Design Patterns

2 Patterns as part of a pattern language (compositional modularity)

2/8/2016

15

Alexander Design Patterns

3 Hierarchical nature of patterns

Alexander Design Patterns

4 Patterns are abstraction representations of human physical,

morphological interaction with the world.

2/8/2016

16

Alexander Design PatternsHRI versions…

The Initial Introduction: convention, acknowledgment

Didactic Communication: minimal responsiveness option

In Motion Together: physical synchrony

Personal Interests and History: from didactic to substantive relational

Recovering from Mistakes: maintain social affiliation

Reciprocal Turn-Taking: timing, awareness of fairness

Physical Intimacy: “will you give me a hug?”

Claiming Unfair Treatment or Wrongful Harms: “that’s not fair”

Systems Engineering

• Needs Gathering

• Requirements Definition

• Risk Identification

• Risk Retirement

2/8/2016

17

Warning: The ‘Wicked Problem’*

Problem Identification

Every solution exposes new aspects of the problem.

Satisficing

There is no clear stopping criterion nor right or wrong.

Uniqueness

Each problem is embedded in a distinct physical and social context making its solution totally novel.

*Horst Rittel

PER design: a case study

2/8/2016

18

Our Robot Design Approach

• Establish explicit, quantitative goals

• Recruit a multi-disciplinary team

• Create parallel feedback cycles

Our Robot Design Approach

• Establish explicit, quantitative goals

– Front-end user research to establish needs

– Clearly defined criteria [+ feed forward ; -

feature creep]

– Caveat: Allow for opportunistic changes to

goals

• Recruit a multi-disciplinary team

• Create parallel feedback cycles

2/8/2016

19

Our Robot Design Approach

• Establish explicit, quantitative goals

• Recruit a multi-disciplinary team

– Robotic interaction deserves a systems

science approach

– Expertise beyond robotics: HCI, design,

education

• Create parallel feedback cycles

Our Robot Design Approach

• Establish explicit, quantitative goals

• Recruit a multi-disciplinary team

• Create parallel feedback cycles

– Multiple {design; implement; evaluate;

refine} cycles

– Feed forward results across design, EE,

HW and firmware efforts

2/8/2016

20

MER Landings, January 2004

• Educational goals:

• - Rovers as tools for performing science exploration

• - The role of rover autonomy during science missions

Establish Explicit, Quantitative

Goals

• Design for robustness– 10 hours battery endurance under constant use

– Unmediated usability by novice users

– Constant naïve use without degradation

– In-museum repairability, MTBF > 1 week, MTTR < 1 hour

• Interaction design for museum setting – Less than 3 minutes Time on Task

– Completed immersion in narrative (subject to 3 min. constraint)

– Panoramic image-centered science mission

• Measurable education outcomes:– Role of Autonomy; Role of Rovers in Mission Science

– (Level of comprehension ; comparison of mediated and unmediated exhibits)

2/8/2016

21

Multidisciplinary Team

• Robotics firmware and software– Carnegie Mellon Robotics

• Interaction design and testing– Carnegie Mellon Robotics

• Embedded electronics– Intel Corporation, Botrics Inc.

• Robot hardware realization– Gogoco LLC

• Screen and exhibit graphic design– LotterShelly LLC

• Educational evaluation– Univ. of Pittsburgh Learning Research & Development Center

Project Timeline (8 months)

• May 2003: PER project kickoff

• June: Establish design goals and parameters

• July: Prototype firmware development

• August: Prototype interaction design & test

• September: Interface, firmware programming

• October: Kickoff museum deployments

• November: Software QA

• December: Rover hardware QA

• Jan 04, 2004: MER Spirit lands, exhibits launch!

2/8/2016

22

Parallel Design EffortsDesign

Goals

Interaction

Design

Robot H/W FirmwareElectronics

Parallel Design EffortsDesign

Goals

Interaction

Design

Robot H/W FirmwareElectronics

2/8/2016

23

Personal Exploration Rover

(PER)Deploy PER’s in major national museums

Visitors and outreach engagement

The search for life using organofluorescence

Panoramic image acquisition

Science target selection

Map correspondence, orientation

Plan synthesis

Plan sequencing and monitoring

Autonomous target approach and measurement

Report generation

Parallel Design EffortsDesign

Goals

Interaction

Design

Electronics Robot H/W Firmware

2/8/2016

24

Electronics Overview

• Intel Stargate

• Cerebellum PIC board

• Sharp 2Y0A2 rangefinder

• Single switching regulator buses

• 30V unified NiMH power pack

Power BoardCerebellum Board

Stayton Board Wireless Card

Batteries

UV

Light

Switch

LED

Webcam

IR Sensor

Motors

Steering

Servos

Pan and Tilt

ServosMotor 16V

Servos 5V

Stayton 5V

Cerebellum &

Parallel Design EffortsDesign

Goals

Interaction

Design

Electronics Robot H/W Firmware

2/8/2016

25

Hardware and Firmware

• Kinematically correct 4-steer simplified chassis

for flat-floor evaluation

Parallel Design EffortsDesign

Goals

Interaction

Design

Electronics Robot H/W Firmware

2/8/2016

26

Interaction Design Iterations

• User evaluation using kinematically similar prototype

• Iterative refinement of interface

• 3 minute time on task is hard: key map focus

Interaction Design Iterations

• Exploit mechanical error to demonstrate autonomy

• Compensate for robot/human limitation with human/robot

guidance

• Establish translation between panoramic, orthographic and

physical yard imagery

2/8/2016

27

Parallel Design EffortsDesign

Goals

Interaction

Design

Electronics Robot H/W Firmware

Mechanical Summary• MER reminiscent look

• Camera-centered morphology

• Directional gaze design

• UV light, IR sensors

• COTS life-limited parts

• Simplified rocker-bogie

2/8/2016

28

Mechanical Summary

• MER reminiscent look

• Camera-centered morphology

• Directional gaze design

• UV light, IR sensors

• COTS life-limited parts

• Simplified rocker-bogie

Mechanical Summary

• MER reminiscent look

• Camera-centered morphology

• Directional gaze design

• UV light, IR sensors

• COTS life-limited parts

• Simplified rocker-bogie

2/8/2016

29

Mechanical Summary

• MER reminiscent look

• Camera-centered morphology

• Directional gaze design

• UV light, IR sensors

• COTS life-limited parts

• Simplified rocker-bogie

Parallel Design EffortsDesign

Goals

Interaction

Design

Electronics Robot H/W Firmware

2/8/2016

30

2/8/2016

31

In-situ Rover Behavior

2/8/2016

32

National Air & Space Museum

• 15 million visitors per year

• Mars yards built as middle school outreach project

• Topography based on Pathfinder landing site

• Strong collaboration with educational evaluators

National Air & Space Museum

2/8/2016

33

National Air & Space Museum

San Francisco Exploratorium

• Together with NASM, the Big Two

• Joint exhibit, NASM and Explo, is unprecedented

• Twin PER yards separated by full-scale MER model

• Special January “open house” for us

2/8/2016

34

San Francisco Exploratorium

San Francisco Exploratorium

2/8/2016

35

San Francisco Exploratorium

San Francisco Exploratorium

2/8/2016

36

NASA/Ames Mars Center

Japan World Expo 2005

(Aichi)

2/8/2016

37

Japan 2005 World Expo

PER Performance Results

• Month 1: 670 rover-hrs; 13 rover-miles; 12,000

approaches

• Full-day power endurance in all locations

• As of 20 April 2004: 50,000+ approaches complete

• Cerebellum, Stargate, camera, ranger perfect record

• Failures: exclusively replaceable servos

• Museum ownership and repair

2/8/2016

38

PER: Exhibit Use Statistics

• - Bimodal child/parent age distribution

• Average child’s age: 6.75 ; adult: 35.4

• - Girls will actuate the interface significantly

• Child driver penetration: 61% boys; 71% girls

• Adult: 26% male; 14% female

• - All visitors complete a full cycle of interaction

• Mission command proportion: 98%

• Mission failure retry proportion: 98.1%

• Mission length: 2.87 minutes unimodal (sigma 1.05)

• - Interface countdown is effectively triggering turn-taking

• Number of missions: 1.6 (sigma 0.94)

• - Primary use pattern is team-based collaboration

• Mean group size: 3.06 (1.22)

• Gestural and verbal communication frequent

Project Outcome

• 7 operational rover exhibits over 1 year

• > 5000 rover-hrs, > 100 rover-miles

• More than 100,000 interactions to date

• Cerebellum / Stayton failures: 1

• Full-day battery endurance

• Exploratorium validation of local repair

• Interface statistics

– Penetration: 98%

– Mission success: 52%/43%

– Length: 2.87 m (sig 1.05)

– Frequency: 1.6 (sig 0.94)

Recommended