A Mobile Execution Tool for the Exploration of Planetary Surfaces

AU G U S T 2 , 2 010 / F I N A L P R E S E N TAT I O N

A Mobile Execution Tool for the Exploration of Planetary Surfaces

Katy LinnChristine WuJesse VenticinqueJennifer LuNoah Levin{

August 2nd, 2010 Final PresentationCarnegie Mellon Human-Computer Interaction Institute :: Master’s Capstone Project::

Katy LinnProject Coordinator

Christine WuTechnical Lead

Jesse VenticinqueDesign Lead

Jennifer LuUser Research

Noah LevinWeb / Documentation

2

MEET THE TEAM


HCI GroupNASA Ames Research Center

3

MEET THE CLIENT

BACKGROUND

DESIGN

PROCESS

CONCLUSION

:: August 2nd, 2010 Final PresentationCarnegie Mellon Human-Computer Interaction Institute :: Master’s Capstone Project

DEMO

4

::

B A C K G R O U N D D ES I GN P ROC E S S CONC LUS I ON

August 2nd, 2010 Final PresentationCarnegie Mellon Human-Computer Interaction Institute :: Master’s Capstone Project

D EMO

CLIENT’S CHARGE

To design an efficient plan interface for real-time execution of human space missions

5

::



D EMO

6

Astronaut’s day is planned down to the minute

::



D EMO

7


Accomplish the maximum amount of work during these hours

::



D EMO


Accomplish the maximum amount of work during these hours

The plan undergoes a lengthy creation and review process, bearing scrutiny from many roles

8

::



D EMO

9

SCHEDULEJ A N U A R Y F E B R U A R Y M A R C H A P R I L M AY

Spring Break

KICK-OFF / SCOPE

RESEARCH PLAN

CONTEXTUAL INQUIRIES

RESEARCH SYNTHESIS

LITERATURE REVIEW

COMPETITIVE ANALYSIS

RESEARCH

INTERVIEWS

REPORT WRITING

RECOMMENDATIONS

RESEARCH

DESIG

N

M AY J U N E J U LY A U G

USER AND EXPERT EVALUATION METHODS

DEVELOPMENT

PROTOTYPING

ITERATION 1

DESIGN

OPERATIONAL READINESS TEST (ORT)

DEVELOPMENT

EVALUATION

ITERATION 2

ITERATION 3

ITERATION 4

Move to Moffett

Present Research

Final Presentation

TODAY!

::



D EMO

10

J A N U A R Y F E B R U A R Y M A R C H A P R I L M AY

Spring Break

KICK-OFF / SCOPE

RESEARCH PLAN


RESEARCH SYNTHESIS

LITERATURE REVIEW


INTERVIEWS

REPORT WRITING

RECOMMENDATIONS

RESEARCH

::



D EMO

10

J A N U A R Y F E B R U A R Y M A R C H A P R I L M AY

Spring Break

KICK-OFF / SCOPE

RESEARCH PLAN


RESEARCH SYNTHESIS

LITERATURE REVIEW


INTERVIEWS

REPORT WRITING

RECOMMENDATIONS

RESEARCH

::



D EMO

11

20 Papers

Background knowledge to prepare for ethnographic research

J A N U A R Y F E B R U A R Y M A R C H A

Spring Break

KICK-OFF / SCOPE

RESEARCH PLAN


RESEAR

LITERATURE REVIEW


INTERVIEWS

RESEARCH

LITERATURE REVIEW

::



D EMO

12


Spring Break

KICK-OFF / SCOPE

RESEARCH PLAN


RESEAR

LITERATURE REVIEW


INTERVIEWS

RESEARCH


6 Planning and Execution Tools

Understand current practices

::



D EMO

13


Spring Break

KICK-OFF / SCOPE

RESEARCH PLAN


RESEAR

LITERATURE REVIEW


INTERVIEWS

RESEARCH


6 Contextual Inquiries (25 People)

Discover what is actually happening at work

::



D EMO

14


Spring Break

KICK-OFF / SCOPE

RESEARCH PLAN


RESEAR

LITERATURE REVIEW


INTERVIEWS

RESEARCH

INTERVIEWS

3 Interviews

Reveal retrospective accounts of the workflow

::



D EMO

15


Spring Break

KICK-OFF / SCOPE

RESEARCH PLAN


RESEAR

LITERATURE REVIEW


INTERVIEWS

RESEARCH

INTERVIEWS


Talked to 28 People Total

ASTRONAUT

::



D EMO

16

PLANNER

ASTRONAUTPLANNER

::



D EMO

17

::



D EMO

18

Mission Planning is complex: resource, physical and sequential constraints

PLANNER

::



D EMO

19


Changing the plan is stressful & difficult, and requires multiple roles

PLANNER

::



D EMO

20


Changing the plan is stressful & difficult, and requires multiple roles

Want the plan to be followed accurately

PLANNER

ASTRONAUTPLANNER

::



D EMO

::



D EMO

22

Astronauts cannot follow the plan exactly

ASTRONAUT

::



D EMO

23

Astronauts cannot follow the plan exactly

They need a subset of information from the plan

ASTRONAUT

::



D EMO

24

::



D EMO

25

“The plan is just a suggestion...” Former astronaut (3/1/2010)

ASTRONAUT

::



D EMO

26

THE PLANNERS PLAN

::



D EMO

27

THE ASTRONAUTS PLAN

::



D EMO

28

20 Literature Reviews6 Competitive Analyses6 Contextual Inquiries3 Interviews } ~300 Findings

::



D EMO

29

Inflexible Plans fail to capture the variable nature of execution!

Any single representation of the plan fails to accommodate the varying needs and responsibilities across roles utilizing the plan

!

::



D EMO

30



!

::



D EMO

31

Astronauts execute the plan out of order

! Inflexible Plans

::



D EMO

32

Astronauts execute the plan out of order

Discrepancies arise between the plan and actual execution

! Inflexible Plans

::



D EMO

33


!


::



D EMO

34

Planners and Astronauts need different kinds of information from the same plan

! Single Representation of the Plan

::



D EMO

35


!


::



D EMO

36


!


::



D EMO

37

Timeline optimized for execution! Single Representation of the Plan

Delta between plan and execution! Inflexible Plans

::



D EMO

38


::



D EMO

39

Autonomy when appropriate! Inflexible Plans



::



D EMO

40

Glanceable and unobtrusive ! Single Representation of the Plan




::



D EMO

41





::

BACKGROUND

DESIGN


PROCESS

CONCLUSION

DEMO

42

MISSION CONTROL

TOOLS

PERSONNEL

INTERNATIONAL SPACE STATION

PLANETARY SURFACE


BACKGROUND D E S I G N P ROC E S S CONC LUS I OND EMO

43

ECOSYSTEM

MISSION CONTROL

TOOLS

PERSONNEL


PLANETARY SURFACE



44

ECOSYSTEM



45

BACKGROUND: 38-year-old Astronaut (Geologist)

EXPERIENCE: Has extensive training and experience

RESPONSIBILITY: Explore planetary surfaces from vehicle

GOALS: Help make new science discoveries

MEET TIM



46

MISSION DAY OVERVIEW

DAILY PLANNING CONFERENCE

1 WATER SITE BASECAMP

42 CRATER

BOULDER

X3 RILLE



47

Traverse to different stations



48


Egress at each site to perform EVA



49



Complete scheduled activities



50




Ingress after EVA



51




Ingress after EVA Traverse to next station



52





Collaborate to replan as needed



53





Collaborate to replan as needed

Return to basecamp on time



54

THE PLAN



55

APOLLO MISSION PLAN



56



57



INFORMATION HIERARCHY

58

Activity List

Header

Procedure Viewer



59







60

Timeline optimized for execution



61


Segmentation of day’s plan



62

Integrated workflow


Segmentation of day’s plan



63

Delta between plan and execution



64


Marcus Bains Notch



65

Time Left:Mission & Station


Marcus Bains Notch



66

Autonomy when appropriate



67


Not time constrained



68

Prioritization

Backup Activities


Not time constrained



69

Glanceable and unobtrusive



70


Large Text, High Contrast



71

Large Text, High Contrast

No unnecessary interactions


::

BACKGROUND

DESIGN


PROCESS

CONCLUSION

DEMO

72


BACKGROUND DES I GN P ROC E S S CONC LUS I OND E M O

73


BACKGROUND DES I GN P ROC E S S CONC LUS I OND E M O

74

DAILY PLANNING CONFERENCE

1 WATER SITE BASECAMP

42 CRATER

BOULDER

X3 RILLE

MISSION DAY 5

Tim: Geologist AstronautGoal: Investigate water site

::

BACKGROUND

DESIGN


PROCESS

CONCLUSION

DEMO

75


BACKGROUND DES I GN P R O C E S S CONC LUS I OND EMO

76

ITERATIVE DESIGN CYCLES



76

ITERATIVE DESIGN CYCLES



77

EXPLORE, THEN REFINE

EXPL O

RE

R E F I N E



77


RESEARCH

EXPL O

RE

R E F I N E



77


DESIGN & PROTOTYPINGRESEARCH

EXPL O

RE

R E F I N E



77


DESIGN & PROTOTYPINGRESEARCH EVALUATION

EXPL O

RE

R E F I N E



77


DESIGN & PROTOTYPINGRESEARCH DEVELOPMENTEVALUATION

EXPL O

RE

R E F I N E



77





78

Research, Design & Prototyping

FIRST ITERATION SECOND ITERATION THIRD ITERATION FINAL ITERATION

EXPLORE, THEN REFINE (RINSE & REPEAT)


Development & Evaluation

EARLY SUMMER LATE SUMMER



79

EXPLORATION METHODS

Domain Research

Metaphors

Brainstorm

Bodystorm

Lo-Fi Sketches

E X P L OR E

DESIGN & PROTOTYPING




RESEARCH

Desert RATS, Paper & Electronic Cuff Checklist



80

DOMAIN RESEARCH RESEARCH



81

METAPHORS

Explore planning and execution parallels:Robbing a bank, Football play, Third date


Interface, Input/Output, Physical Form



82

BRAINSTORM DESIGN & PROTOTYPING



83

BODYSTORM

Experienced physical constraints:Motorcycle safety gear




84

DESIGN & PROTOTYPINGLO-FI SKETCHES

Non-Interactive, Used for Speed Dating:Split View, Station Centric, Bar Chart, Paper Towel



85

REFINEMENT METHODS

Speed DatingMid-Fi WireframesThink AloudsHi-Fi PrototypesORT

E X P L O R E R E F I N E DEVELOPMENT

EVALUATION

EVALUATION


Operational Readiness Test

EVALUATION

SPEED DATING



86

Needs validation:4-5 minutes on each concept, wearable prototype

EVALUATION



87

DESIGN & PROTOTYPINGMID-FI WIREFRAMES

Interactive, Used for shared understandingHelped for quick and simple Think Alouds



88

THINK ALOUDS

Interaction exploration:Asked participants to externalize thoughts while completing a task

EVALUATION



89

HTML + Javascript Android Application

Interactive, Used for Operational Readiness Tests

HI-FI PROTOTYPES DEVELOPMENT



90

HI-FI PROTOTYPES

Push buttonsArduino microcontroller, BlueSmirf bluetooth module

DEVELOPMENT



91

HI-FI PROTOTYPES

Foam enclosure, cuff-mounted

DEVELOPMENT



92

ORT: Operational Readiness Test

30 minute mock planetary exploration mission

EVALUATION



93

ORT: Operational Readiness Test

Mission briefing & device training

EVALUATION



94

Traverse from station to station

ORT: Operational Readiness Test EVALUATION



95

Perform activitiesObservations, sample collection, maintenance




96

Mission debrief & user feedback




97

SUMMARY OF METHODS

Exploration

• Domain Research

• Metaphors

• Brainstorm

• Bodystorm

• Lo-Fi Sketches

Refinement

• Speed Dating

• Mid-Fi Wireframes

• Think Alouds

• Hi-Fi Prototypes

• ORT

E X P L O R E R E F I N E



98

EVOLUTION OF KEY FEATURES





EVOLUTION OF KEY FEATURES

99



VISUAL DESIGN

100

Glanceable

It sure is bright out here



VISUAL DESIGN

101



Glanceable



VISUAL DESIGN

102

soft subtle colors

boldhigh contrast



Glanceable



VISUAL DESIGN

103

FIRST ITERATION

The colors are really pale and non-contrast.”

- Peer feedback

“

Glanceable



VISUAL DESIGN

104

SECOND ITERATION

The orange is hard to see. The text could be bigger, too.”- ORT Participant

“

Glanceable



VISUAL DESIGN

105

THIRD ITERATION

I like how the text is big and easy to see.”- ORT Participant

“

Glanceable

VISUAL DESIGN Glanceable



106

FINAL ITERATION

I can walk and read this at the same time.”- ORT Participant

“



TIME

107

Time, served three ways

Glanceable Delta



TIME

108

FIRST ITERATION

SECOND ITERATION

THIRD ITERATION

FINAL ITERATION


Glanceable Delta



TIME

109

GMTStation time left

Mission time leftStation time left

Marcus Bains Notch

FIRST ITERATION

SECOND ITERATION

THIRD ITERATION

FINAL ITERATION


Glanceable Delta



TIME

110

FIRST ITERATION

45 minutes out of what?”- Peer feedback

“

Glanceable Delta



TIME

111

SECOND ITERATION

Is 0:05 minutes or seconds?”- ORT Participant

“ I never used the current time for GMT”- ORT Participant

“

Glanceable Delta



TIME

112

THIRD ITERATION

Glanceable Delta

I thought it was weird to see something counting up and another counting down. And I never used Time Elapsed.”- ORT Participant

“ Is 0:04 seconds or minutes.”- ORT Participant

“



TIME

113

FINAL ITERATION

Glanceable Delta

When I was ahead, I used the Mission Time Left.When I was behind, I used Station Time Left.”- ORT Participant

“

If the text is red, I know, ‘oh, I’m Late!’”- ORT Participant

“



ACTIVITY LIST

114

The story of Goldilocks

Timeline optimized AutonomyGlanceable



ACTIVITY LIST

115

FIRST ITERATION

SECOND ITERATION

THIRD ITERATION

FINAL ITERATION





ACTIVITY LIST

116

Beveled renderingAmbiguous &

extraneous information

Flat renderingObvious & relevant

information

FIRST ITERATION

SECOND ITERATION

THIRD ITERATION

FINAL ITERATION





ACTIVITY LIST

117

FIRST ITERATION

How important is it that I do things in order?”- Peer Feedback

“




ACTIVITY LIST

118

SECOND ITERATION

It’s not very obvious what the star means.”- ORT Participant

“ I pretty much just did things in order.”- ORT Participant

“




ACTIVITY LIST

119

THIRD ITERATION


It wastes a lot of time when I have to go back for the tools.”- ORT Participant

“ I can’t help but want to touch the blue bar!”- ORT Participant

“



ACTIVITY LIST

120

FINAL ITERATION

I never once touched the screen.”- ORT Participant

“ I did backup activities first because I can do them while walking towards the formation.- Repeat ORT Participant

“




PROCEDURE VIEW

121

Help is but one button away

Timeline optimizedGlanceable



PROCEDURE VIEW

122


FIRST ITERATION

SECOND ITERATION

THIRD ITERATION

FINAL ITERATION

Not applicable




PROCEDURE VIEW

123

FIRST ITERATION

SECOND ITERATION

THIRD ITERATION

FINAL ITERATION

Document viewBlue highlight

Inline viewPurple highlight


Not applicable




PROCEDURE VIEW

124

SECOND ITERATION


I don’t know which procedure steps have notes”- ORT Participant

“ I can’t see the procedure steps when I’m looking at notes.”- ORT Participant

“



PROCEDURE VIEW

125

THIRD ITERATION


Sometimes I get confused about whether I’m looking at the Activity List or Procedure View.”- ORT Participant

“



PROCEDURE VIEW

126

FINAL ITERATION


I really like what you guys did with the Activity View”- Repeat ORT Participant

“



127

Status is already in the astronaut’s headUnnecessary externalization means mental load

COMPLETION STATUS?


BACKGROUND

DESIGN

PROCESS

CONCLUSION

DEMO

128


BACKGROUND DES I GN P ROC E S S C O N C L U S I O ND EMO

129

FINAL ORT RESULTS

All participants returned minutes ahead of schedulePerformed scheduled and backup activities



130

No wasted time over forgotten equipmentReviewed activities during egress and ingress

FINAL ORT RESULTS



131

I can see this being useful in a long mission where you might forget things or when things might change.” NASA Scientist (6/22/2010)

“

FINAL ORT RESULTS



132

FINAL ORT RESULTS

At this point, it’s just my personal taste, not the overall usability. I think it’s pretty great already.” Repeat ORT Participant (6/22/2010)

“



133

DESERT RATS FEEDBACK

WOW! What you guys have here represents exactly how I think.” Desert RATS Geologist (6/22/2010)

“



134


LuMo is a great proof of concept for a digital cuff-mounted checklist.” Desert RATS Geologist (6/22/2010)

“



135


This looks interesting and novel. Would be interesting to see it developed further.” Desert RATS Engineer (6/18/2010)

“

MISSION CONTROL

TOOLS

PERSONNEL


PLANETARY SURFACE



FUTURE WORK

136

MISSION CONTROL

TOOLS

PERSONNEL


PLANETARY SURFACE



137

FUTURE WORK

LuMo



138

Robustness under extreme conditionsCollaboration between team members or teams

LUMO

MISSION CONTROL

TOOLS

PERSONNEL


PLANETARY SURFACE



139

FUTURE WORK

Onboard Plan Viewer



140

LuMo+: Map View, Plan History, Partner’s Schedule

ONBOARD PLAN VIEWER

MISSION CONTROL

TOOLS

PERSONNEL


PLANETARY SURFACE



141

FUTURE WORK

ISS Extravehicular Activities



142

Optimize for ISS extravehicular activities:activities, procedures, and tools

ISS EVA ACTIVITIES

MISSION CONTROL

TOOLS

PERSONNEL


PLANETARY SURFACE



143

FUTURE WORK

Plan Making Tools



144

PLAN MAKING TOOLS

Create procedures and execution notes using a formPush plan updates in real-time



145


Questions?

teamlumina2010.com [email protected]

THANK YOU!

146

mailto:[email protected]

mailto:[email protected]

Data & Analytics

A Mobile Execution Tool for the Exploration of Planetary Surfaces