Leveraging Natural User Interface Technologies to Deliver Improved User Experience Tim Huckaby...
If you can't read please download the document
Leveraging Natural User Interface Technologies to Deliver Improved User Experience Tim Huckaby InterKnowlogy Chairman/Founder Actus Interactive Software
Leveraging Natural User Interface Technologies to Deliver
Improved User Experience Tim Huckaby InterKnowlogy Chairman/Founder
Actus Interactive Software Founder & CEO Microsoft RD & MVP
AAP205
Slide 2
NUI: The Natural User Interface Common Gestures of Touch
Physical Object Interaction Virtual Object Interaction Multi-Touch
Capable Motion Based Interface Tracking of full-body movement,
facial expression, and voice with precision Gesture Capable
Multi-array Microphone Uniquely Distinguish Audio & Voices
Voice Capable Conscious and non-conscience interfaces Non Invasive
Neural Capable
Slide 3
Slide 4
Slide 5
demo Tim Huckaby Founder / Chairman, InterKnowlogy Founder /
CEO, Actus Software Microsoft RD & MVP The Heart
Slide 6
video Tim Huckaby Founder / Chairman, InterKnowlogy Founder /
CEO, Actus Software Microsoft RD & MVP Grey's Anatomy
Slide 7
video Tim Huckaby Founder / Chairman, InterKnowlogy Founder /
CEO, Actus Software Microsoft RD & MVP Gesture Heart
Slide 8
A little bit about me and why I am here
Slide 9
InterKnowlogy (www.InterKnowlogy.com) Tim Huckaby,
Founder/Chairman ([email protected]) 13+ year old services
firm Custom Application Development focused on building NUI
solutions Web, mobile, and desktop windows 7/8, Surface, Windows
phone 7, azure, Kinect, Largest Client: Microsoft Actus Interactive
Software (www.Actus-Software.com) Tim Huckaby, Founder/CEO
([email protected]) Software Product Company Interactive
Kiosk and Active Digital Signage Multi-Touch, Gesture, and Voice
Driven Solutions
Slide 10
The Green-Screen
Slide 11
Image courtesy of Computer History Museum
Slide 12
PastFuture (Now)Present 1972: PLATO IV Touch Screen Terminal
The Samsung SUR40 for Microsoft Surface Windows 8 - Metro Apple
iPad
Slide 13
Inexpensive Touch Capable, Non Proprietary Hardware A Windows
OS designed for Multi-Touch A Consistent Multi-Touch API for.NET
across all Windows Hardware/Software Platforms Developer
Productivity in Touch Capable Apps The Forecast of Multi-Touch
Hardware Capability in Every New Computing Device in the Short
Term
Slide 14
HP TouchSmart TM2 Rates in Windows as 5.0 Price in
October-2010: Starting from: $1499.99* Price in March-2011:
Starting from: $799.99* Price Today (HP TouchSmart 320m ): $579.99
About the Windows 7 Computer I am Using Today
Slide 15
HTML 5 Touch Events Spec, Version 2 W3C Editor's Draft 14,
November 2011 Defines a set of low-level events that represent one
or more points of contact with a touch-sensitive surface Changes of
those points with respect to the surface and any DOM elements
displayed upon it (e.g. for touch screens) or associated with it
(e.g. for drawing tablets without displays). Addresses pen-tablet
devices, such as drawing tablets, with consideration toward stylus
capabilities. Source:
https://dvcs.w3.org/hg/webevents/raw-file/tip/touchevents.html
Slide 16
demo Tim Huckaby Founder / Chairman, InterKnowlogy Founder /
CEO, Actus Software Microsoft RD & MVP HTML5 Touch
Slide 17
The Microsoft Surface is expensive because it has 5 cameras
looking up that do Object Recognition Based on a byte tag (not a QR
code) Object Recognition in Windows The Use Cases are
limitless
Slide 18
video Tim Huckaby Founder / Chairman, InterKnowlogy Founder /
CEO, Actus Software Microsoft RD & MVP Surface Craps
Slide 19
NUI: Games as a Tool for Learning Learning made Fun /
Entertaining Proven as a learning tool beyond just Children
Computer based Games are a significant part of popular culture
Educational Video Game Curriculums MIT, UC Irvine, Minnesota, Mich
State, etc.
Slide 20
demo Tim Huckaby Founder / Chairman, InterKnowlogy Founder /
CEO, Actus Software Microsoft RD & MVP NASA: Mars Bound
Slide 21
Slide 22
Slide 23
demo Tim Huckaby Founder / Chairman, InterKnowlogy Founder /
CEO, Actus Software Microsoft RD & MVP Windows 8: Semantic Zoom
Actus Interactive Kiosk Metro
Slide 24
Slide 25
demo Tim Huckaby Founder / Chairman, InterKnowlogy Founder /
CEO, Actus Software Microsoft RD & MVP Actus Interactive Kiosk
Touch-less OR IK PT
Slide 26
The Good News: The Kinect SDK for Windows The Not So Good News:
Windows Only Device; K4W does not work on your Xbox; you cannot
build apps for 18 million Xbox Kinect owners with it.
Slide 27
Slide 28
High fidelity EG acquisition device No conductive gel, etc.
Non-invasive Use Case Examples: Conscious: mind manipulation of
objects Conscious: Steering a wheel chair with your mind
Non-Conscious: Ranking music First target market: gaming
$300!!!
Slide 29
video Tim Huckaby Founder / Chairman, InterKnowlogy Founder /
CEO, Actus Software Microsoft RD & MVP Emotiv
Slide 30
Slide 31
Slide 32
Summary
Slide 33
video Tim Huckaby Founder / Chairman, InterKnowlogy Founder /
CEO, Actus Software Microsoft RD & MVP HoloDesk - Direct 3D
Interactions with a Situated See-Through Display
Slide 34
Find Me Later At *Tool Bench Chalk Talk area at DEV track
booth. Monday, June 11, between 6:00pm and 7:00pm.
play, fun, entertainment notebook, learning mouselearn,
ideasfile, papershare, concepts share, speech bubble thought bubble
search, learning coffee, work, office computer monitor luggage,
travel badge, registration global, locationthe cloudairplane,
travel this way, look here twitterdecorative arrowthis way,
arrowBirds of a feather finance, calculator this way, arrowhands-on
labsthis way, connect
Slide 39
play, fun, entertainment notebook, learning mouselearn,
ideasfile, papershare, concepts share, speech bubble thought bubble
search, learning coffee, work, office computer monitor luggage,
travel badge, registration global, locationthe cloudairplane,
travel twitterdecorative arrowthis way, arrowBirds of a feather
finance, calculator this way, arrowhands-on labsthis way, connect
this way, look here
Slide 40
Slide 41
Slide for Showing Developers Software Code Use this layout to
show software code The font is Consolas, a monospace font The slide
doesnt use bullets but levels can be indented using the Increase
List Level icon on the Home menu
Slide 42
demo Name Title Group Demo Title
Slide 43
video Video Title
Slide 44
partner Name Title Company Partner Title
Slide 45
customer Name Title Company Customer Title
Slide 46
announcing Announcement Title
Slide 47
title Title
Slide 48
Breakout Sessions (session codes and titles) Hands-on Labs
(session codes and titles) Product Demo Stations (demo station
title and location) Related Certification Exam Find Me Later At
Required Slide *delete this box when your slide is finalized
Speakers, please list the Breakout Sessions, Labs, Demo Stations
and Certification Exams that relate to your session. Also indicate
when they can find you staffing in the TLC.
Slide 49
Resource 1 Resource 2 Resource 3 Resource 4 Required Slide
*delete this box when your slide is finalized Track PMs will supply
the content for this slide, which will be inserted during the final
scrub.
Slide 50
Connect. Share. Discuss. http://northamerica.msteched.com
Learning Microsoft Certification & Training Resources
www.microsoft.com/learning TechNet Resources for IT Professionals
http://microsoft.com/technet Resources for Developers
http://microsoft.com/msdn
Slide 51
Required Slide Complete an evaluation on CommNet and enter to
win!
Slide 52
Scan the Tag to evaluate this session now on myTechEd Mobile
Required Slide *delete this box when your slide is finalized Your
MS Tag will be inserted here during the final scrub.