The Frontiers of HCI

Haptics, Smell and Brain Interaction

Learning Outcomes

• Describe how haptics are used on– Mobile devices– Medical devices– Research tools

• Describe the exploration of – Olfactory detection and production– Brain wave detection

The Human Perceptual System

• Physical Aspects of Perception– Touch (tactile/cutaneous)• Located in the skin, enables us to feel – Texture – Heat– Pain

– Movement (kinesthetic/proprioceptive)• The location of your body and its appendages• The direction and speed of your movements

1-3

Physical Aspects of Perception

• Movement (kinesthetic/proprioceptive)– We use the angles of our joints to determine the

position of our limbs– We determine movement by the rate of change in

the position of those joints

1-4

Mobile devices

• Phone output– Vibrate – silent alert. • These can be used like earcons – different signals for

different events• Does your phone have different alerts?

– Can you tell the difference?

1-5

Mobile devices

• Phone input– Touch screens

• See previous lecture

– Accelerometer - shaking actions • Inconsistent interactions, high error rates

– Passive input• Gps• Altimeter • Temperature • Humidity

1-6

Using Haptics in Interaction Design

• ImmersiveTouch™

1-7

Using Haptics in Interaction Design

• Medical Uses– surgeon controls ‘robot’ – Surgeon’s view zoomed– Small device reduces invasiveness– ~~$2mill

1-8

Using Haptics in Interaction Design

• The GuideCane (Ulrich and Borenstein, 2001)

1-9

Using Haptics in Interaction Design

• The ActiveBelt (Tsukada and Yasumrua, 2004)

1-10

Device architecture of ActiveBelt

GPS, global positioning system; LED, light-emitting diode.

Using Haptics in Interaction Design

• Motor Disabilities– HAL-5 (Hybrid Assistive Limb), CYBERDYNE Inc.

www.cyberdyne.jp

1-11

Force Feedback Displays

– Manipulator Gloves

1-12

CyberForc

e

CyberGraspCyberGlove

II

Technical Issues Concerning Haptics

• Desktop Devices– SensAble PHANTOM haptic devices

1-13

PHANTOM Premium

McSig – our work with visually

impairedhttp://dl.acm.org.ezproxy.auckland.ac.nz/citation.cfm?

id=1993060.1993067&coll=DL&dl=ACM&CFID=333467105&CFTOKEN=52399920

Technical Issues Concerning Haptics

• Desktop Devices– Space Interface Device for Artificial Reality (SPIDAR)

(Sato, 2002)

1-14

SPIDAR-8. Finger attachments.SPIDAR-8. Rubik’s CubePHANTOM Premium 1.5 & 1.5 high-force haptic

device

Olfactory - Odour/ Smell

• Smell is essentially our ability to detect specific chemical particles in the air

• We can detect about 4000 different smells• And the can be combined in millions different

ways • Smell is very deep

in our animal brain

1-15

Technology of Odour

• Input – Detecting particular chemicals is possible • Drug/ explosive sniffers

– Detecting the range of smells in anything like human terms and extremely difficult task

• Output– Manufacturing particular smells possible ‘fresh

cookies’– Active generation of range of smells very difficult

– too many chemicals and too supple differences

1-16

Smell – current research

• Not sure how many different smells can begenerated.

• Check out the video

• Yongsoon Choi, Rahul Parsani, Xavier Roman, Anshul Vikram Pandey, and Adrian David Cheok. 2012. Sound perfume: building positive impression during face-to-face communication. In SIGGRAPH Asia 2012 Emerging Technologies (SA '12). ACM, New York, NY, USA, , Article 22 , 3 pages. DOI=10.1145/2407707.2407729 http://doi.acm.org.ezproxy.auckland.ac.nz/10.1145/2407707.2407729

1-17

Brain Computer Interact

• Detecting the brain waves and interpreting• Inside the skull – accurate but invasive http://www.youtube.com/watch?v=ogBX18maUiM

• From outside the skull – not very accurate

1-18

Summary • Describe how haptics are used on

– Mobile devices • Output – vibrate• Input accelerometers & gps

– Medical devices• Keyhole surgery with remote tool guidance

– Research tools• Haptic pen input and output devices – move in full 3D space

• Describe the exploration of – Olfactory detection and production

• Detection of specific chemicals possible • Production of a limited range of scents

– Brain wave detection• Many new devices to gather brain activity from cap sensors, • still fairly limited interaction