Communitydays2015

DEV09 – LA BATTAGLIA DEL TOUCHLESSMatteo Valoriani

@MatteoValoriani

Clemente Giorio

@Tinux80

#CDays15 – Milano 24, 25 e 26 Marzo 2015

Grazie a

PlatinumSponsor

http://www.aspitalia.com/

http://www.aspitalia.com/

http://www.domusdotnet.org/

http://www.domusdotnet.org/

http://www.dotdotnet.org/

http://www.dotdotnet.org/

http://www.dotnetliguria.net/

http://www.dotnetliguria.net/

http://www.dotnetside.org/

http://www.dotnetside.org/

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

Who we are…

Matteo ValorianiMicrosoft MVP Kinect for WindowsIntel Software InnovatorPhD on HCI @Politecnico di MilanoCEO of Fifth IngeniumConsultant

Clemente GiorioMicrosoft MVP Kinect for WindowsSenior Developer at Crionet srlInstructor at OvernetAuthor at Packt PublishingConsultant


Agenda

• HCI evolution

• Microsoft Kinect

• Intel Real Sense

• Myo

• Leap Motion

• …..

• Duo3D

• Kinetics

• … ….. Eye… eeg


CLI


GUI interface


Touch Interface


Natura User Interface


You have to be a magician…

or at least a good illusionist

https://www.youtube.com/watch?v=u_diRgwPCS8

https://www.youtube.com/watch?v=u_diRgwPCS8



Xbox One - Kinect 2

http://youtu.be/Hi5kMNfgDS4

http://youtu.be/Hi5kMNfgDS4


Kinect 2 - Specs

3D DEPTH SENSOR

RGB CAMERA

MULTI-ARRAY MIC

Hardware:

Depth resolution:512×424

RGB resolution:1920×1080 (16:9)

FrameRate:60 FPS

Latency:60 ms


Kinect 2 vs Kinect 1Version 1 Version 2

Depth range 0.4m → 4.0m 0.4m → 4.5m

Color stream 640×480 1920×1080

Depth stream 320×240 512×424

Infrared stream None 512×424

Audio stream 4-mic array 16 kHz 4-mic array 48 kHz

USB 2.0 3.0

Hand Traking External tools Yes

Face Traking Yes Yes+Expressions

FOV 57° H 43° V 70° H 60° V

Tilt Motorized Manual


demoTitolo demo

Cons:The device is large

A dedicated power cord is required

The amount of data generated by the sensor also tends to saturate a USB controller

Kinect cannot easily distinguish individual fingers on a hand

Most of the features listed above require the Microsoft SDK, which is only supported for desktop applications on Windows 7 and 8.

Pros Vs. Cons

Pros:• Skeletal tracking

• Face tracking

• Multiple sensors:

• Raw data

• Voice control

Best for:Kiosks, installations, and digital signage projects where the user will be standing fairly far away from the display.


Pros Vs. Cons


Understands 4 basic types of input

19Intel® RealSense™ Hands-On Lab - Milan

Categories of Input Capabilities Features

Hands • Hand and Finger Tracking • Gesture Recognition

• 22-point Hand and Finger Tracking• 9 static and dynamic mid-air gestures

Face • Face Detection and Tracking

• Multiple Face Detection and tracking• 78-point Landmark Detection (facial features)• Emotion Recognition (7 emotions, coming post-Beta)• Pulse Estimation• Face Recognition (Coming post-beta)

Speech • Speech Recognition • Command and Control• Dictation• Text to Speech

Environment • Segmentation• 3D Scanning• Augmented Reality

• Background Removal• 3D Object / Face / Room Scanning (Coming post-beta)• 2D/3D Object Tracking• Scene Perception (coming post-beta)

Understands Hardware Limits



demoTitolo demo

Cons:Getting some of the deeper features (like age and gender detection) to work is a bit tricky.

Device and software are in beta.

Due to the close range of the tracking system, hand gestures must be designed such that a user’s hand doesn’t occlude their own view of the display.

Pros Vs. Cons

Pros:

Smaller and less expensive

Close-range tracking

Hand posture/gesture recognition

Facial analysis

Speech (built-in support for speech synthesis powered by Nuance).

Raw data

Framework support: Processing, Unity and OpenFrameworks

Best for:Desktop/laptop applications where the user will be seated in front of the PC.Close range applications where features, apart from hand tracking and recognition, are necessary without too much precision or accuracy.



demoTitolo demo


Pros Vs. Cons



demoTitolo demohttps://www.youtube.com/watch?v=gby6hGZb3ww&t=27

Cons:Sensing range is fairly limited.

Only fingers are tracked.

There is no skeleton or face tracking.

No access to the raw sensor data.

Pros Vs. Cons

Pros:

Finger tracking is fast and accurate.

Smaller and less expensive

Framework support: .NET, Processing, Cinder, etc.

Compatible: Mac OS and Windows

Best for:Controlled kiosk environments with a pointing-based UI.Generally best for general audience desktop apps which can be distributed in the Airspace store.


Recap

• Devices

• NUI

• Usability

Leap, RealSense, Kinect


2,5 cm 60 cm 2 m 4 m


Q&A

Tutto il materiale di questa sessione suhttp://www.communitydays.it/

Lascia subito il feedback su questa sessione,potrai essere estratto per i nostri premi!

Seguici suTwitter @CommunityDaysITFacebook http://facebook.com/cdaysit#CDays15

http://www.communitydays.it/

Technology

Communitydays2015