User System Ergonomic ResearchIBM Almaden Research Center,

Stanford University

Physical,Graphical,

& Cognitive

Human Computer Interface

MITMedia Lab

Context Aware Group1999 - 2008

ALUReg

D

M

TLB

CMU Silicon Valley

Buisness mentoring

The Generator Fund

TED SELKER

Context Aware Computing

Using Sensors and Virtual sensorsTo understand andrespect human intention

:Industrial Design Intelligence:Engineering and evaluation a perspective

•Sept 12 :TrackPoint; the makings of an ergonomic product and articleSept 14 :Famous Industrial Design examples; Design of the 20th CenturySept 19 :Discussion of product design projects

• Sept 21 :Thinkpad stories of design challenges and solutionsSept 26 :Prototyping stories, deconstruct product

• Sept 28 :Invention and evaluation of graphical interfacesOct 3 :Physical model makingOct 5 :Discuss project description proposals and paperOct 10 :Columbus dayOct 12 :Discuss project description proposals, discuss ID magazineOct 17 :The Idea of Design: perspectives from the design worldOct 19 :Project mock-ups presented, and discuss Charles EamesOct 24 :Discuss Design for the real world, and Raymond LoewyOct 26 :Discuss project evaluation and Richard SapperNov 7 :Sensation and Perception and deconstruct productNov 9 :Memory and LearningNov 14 :Writing a paperNov 16 :Motor controlNov 21 :Project evaluation discussionNov 23 :ThanksgivingNov 28 :Discuss drafts of papersNov 30 :Product lifecycleDec 5 :Psychology of everyday thingsDec 7 :Presenting projectsDec 12 :Project reviews

http://cac.media.mit.edu/weblogs/idi04/assignments

Industrial Design Intelligence:Courses and workshops

The movement of product design from a style-baseddiscipline to a cognitive science and engineering-supported, aesthetics-based discipline. We striveto expose technology gracefully in products. Acourse in mechatronics is a small beginning for aproduct designer to understand the vast array ofmaterials, how to design new materials, and how tounderstand the psychological and behavioralrealities of humans. Multidisciplinary teams canhelp, but it is difficult for people to continuallyargue from different perspectives. We must educateourselves to span evaluation engineering andaesthetics to move product design into a futurewhere things look and act in a natural way.

• We live in “virtual” and “real” worlds

• We must evaluate to contribute

With new,

Intelligent,

Technology

Exposing function through design -Scenario, human connection, technology, evaluation

Product Design?

• Art: creating ideas to create an emotional reaction

• Science: creating ideas that other people cite

• Design: is creating things of value

What does a designer do?

• Plan to create something?• Limits to planning

– Practice helps (chess)

• Empathy does it exist?– I know what the designer will do– I know what the engineer will need– I know how this will be used

• Assign a designer?– Domain and technology matter

• Grocery shopping aint rocket science

Necessity: mother of invention?

Kitchen technology born with people

190,000 years of cooking,

Plumbing 1500 BC

Namche Bazzar today

Kitchen design created people…

Kitchen gadget 1500 BC 2004 AD

Make rather than store dishes?

• Personalized dishes

• When you need them

Smart useful things• Materials Chameleon mug

– Look like a mug when coffee– Look like a tumber when ice tea

• Electronics Leftover timer– Count days in fridge

• Smarts … Talking Trivet…– Needs re-warming– Hot and ready to eat– Cooked and ready to take out– Fire!

Creating Thinkpads?

Finger Control Everywhere!In Keyboard

Pointing

Remote Controls

Air Traffic Control

Surgical Instruments

Sightless Pointing

Prosthetics pointing

Steering

Two Handed

Industrial

Controllers

Arcade Games

In Mouse Scrolled

TrackPoint

Towards a Behavioral Motor Match• Placement

• Eye Tracking

• Wiggly Fingers

• Going Fast

• Movement Feedback

• Gripiness

• Mouse Lockout

Select and Type

Mouse WheelMouse JSMouse 2hand

-3

-2

-1

0

1

2

3great

very good

good

OK

poor

very poor

terrible

Scrolling....Does another input help?

Petina

On you, private?

Privately on you?

Forms and their implicationsKeyboard size and implicationsHinge and implications

• Keyboard size and implications• Hinge implications• Durability, maintainability• look

$100 Laptop studies

Hildegard Schmaltz <schhi@leatherman.com>

08/13/2001 06:38 PM

To: "Ted Selker (E-mail)" <selker@media.mit.edu>

cc:

Subject: WAVE IS DANGEROUS

Dear Mr. Selker,

We are very sorry to hear of your accident with the Wave. Your email was

the first time that we have heard of this type of accident with this tool.

In consulting with our engineering department, they wonder if the tool may

have a damaged component. We would like to get the tool back to the factory

for inspection and repair or replacement as soon as possible.

For your convenience, we can have your tool picked up by UPS Call Tag

Artifacts and Evaluation

User System Ergonomic ResearchIBM Almaden Research Center

San Jose CaliforniaPhysical,

Graphical,

& Cognitive

Human Computer Interface

Creating …

Integrated

Augmented Kitchen

Chandelier video projector

Chandelier Video Projector

A Spoon that teaches cooking

• Better food

• Teaching cooking

T1 T2 T3 T4

Day 1

0

2.5

5

7.5

10

12.5

15

17.5

20

Sec.Graphical interface mappings

-20 -40 -60 -80 -1000

2

4

6

8

10

12

14

16

FreeRestrained

0

2

4

6

8

10

12

14

16

No Mask

Unmasked

Masked

Selction Performance: Masked (top) and Unmasked

Invention is a performance -Personal credo

• Inventing is like an action movie– Grab for a branch, it breaks, land in the water and swim…– The way it doesn’t work moves you forward

• Audition stories and roles– Think of many possible ways out

• keep thinking about it

• All the world is a stage.– Slowly replace pantomime for real sets and actors

• Have things/ideas compete, not people• Pretend things are the way you want them• Create it from anything

– All tools are made of other tools– Prototype here and now

ContextAwarePlatformsDemonstrations and designtools for recognizing andrespecting intention acrossdomains and scenarios

Ted SelkerSelker@media.mit.edu

1. Annotated smart kitchen Recognizing and coaching activity in kitchen2. Alzheimer's Living Center Adaptive interface to support communication for people with dementia3. Attention vending machine Socially interpreted interactive media in a vending machine4. Audio interface tool Tool for exploring audio interface for voting and telephones5. Attention meter Camera input for interactive6. Bike alert Auto system for telling bike car door might open7. Car coach Feedback to improve driving8. Climbing interface Platform for museum interactive9. Context builder Context aware application engine10. Considerate thing Sensor/ electronics platform for making considerate things11. Chameleon tables Computer interactive tables with height control and sensing12. Digital cigarette Motivation and relationship building demonstration13. Disruption manager Semantic based system to mediate desktop interactions14. Driftcatcher Socially aware email annotation interactive15. Dishmaker Recycling kitchen manufacturing16. e-Bed Eye gesture based GUI17. e-Clay 24 degree of freedom design input tool18. e-Floor Socially aware floor interactive19. e-Helmet Wearable for mediating communication for bicyclist20. e-Threshold Context aware receptionist21. EyeaRe Glasses that can tell interest alertness22. Exercar Pedaling accelerator improves acuity and reduces fatigue23. Face Interface Caricature teaching of facial gesture interface affordances24. Gesture music ball Instrument builds itself for you25. Haptic tuner Adaptive feedback to coordinate and improve peoples musical collaboration26. Interruption Manager GUI mediation for any platform27. Kitchen phone System to control and enhance grocery experiences28. Invision Eye gesture based preference system29. Low Error Voting Interface New approach to ballot design for improved access and accuracy30. Media jukebox Model and feedback smart interactive for selection of media31. Media windshield Augmented reality car32. Minerva Viewing food to suggest recipes33. Mobile essence Meeting collaboration support system34. MrWeb, Collaborative web tools35. PlaceMap Location aware engine36. Power bra Power harvesting system collects 1 watt from breathing37. Secure Architecture For Voting Electronically New approach to reliability/security38. SMS mediator No cell phone software meeting mediator39. Smart dice Progressive math teaching interactive40. Smart spoon Sensors for teaching cooking41. Smart sink Sensing use of sink for ease and safety42. Smart refrigerator Energy reducing, food improving preservation43. Smart utensils Sensing to teach and coach food preparation44. Talking Trivet, e-sleeve, shoulder pet One sensor systems that react to intention45. Thought for food Systems to use common sense and feedback to interact with food and recipes46. USPS concept truck Annotation, location awareness support for commercial delivery, (8 demos)47. Voyager Location aware system for interactive campus, grocery store, etc.48. Wireless dashboard Harvested power for sensing and control