1

TEAM KINECT

Final presentation31-8-2012

2

What is Kinect?

31-8-2012

Microsoft gaming console accesoire for Xbox 360 Human interface device with gestures For Xbox 360 since September 2010 For Windows since February 2012

3

Motivation

31-8-2012

Interest in HCI and alternative input devices Expand functionality of (consumer) hardware “Trendy” topic Versatile application areas

Entertainment Education Security Medicine

4

Existing Projects

31-8-2012

Application specific projects : MIT: Google Chrome KinEmote: Controlling home theater software Use in sterile environment like a hospital

5

Technical background

31-8-2012

3 important components: Infrared laser projector RGB Camera Depth sensor (monochrome camera with IR-pass-

through filter)

Not used (by us): Microphone array

6

IR Grid

31-8-2012

7

Name: Kinect using shortCuts

Application independent Kinect control

Using Java and OpenNI and PrimeSense

Java Robot-Class

Our project – “KinectCut”

31-8-2012

8

Approach

31-8-2012

Stock gesture recognition isn’t appropriate enough for our approach

Measuring the angles and length of the arms Velocity and position of several body parts

9

Interaction Model

31-8-2012

Problem to differ between gestures and actions

Solution: mode arm & action arm Mode arm (left): switch

between states Action arm (right): propose

the action while in state

10

From Body to Command

Discretizing angles to recognize gestures

Smoothing filter for mouse coordinates to screen mapping

31-8-2012

11

Mapping for Mouse Control

31-8-2012

12

Architecture

31-8-2012

OpenNI&

PrimeSense

BodyParser

(discretization)

1110100001

Gestures/Skeleton

StateMachine

Body (Skeleton)/Raw Data

Robot

Actions

Control

13

Feedback

31-8-2012

No tengible feedback provided by Kinect

Different Types of feedback: Mode displayed Calibration state Hand-recognition state History of actions and state

changes Wireframe model

14

Demo Video

31-8-2012

15

Experience on project

31-8-2012

Working in an interdisciplinary, multicultural and multilanguage team

Finding ideas that can be completed in the given time with the given team

16

Experience on Summer Camp

31-8-2012

océ is not only doing paper printing :-) Real-life experience on project work

New Environment New Task New Team

Excellent organization of SummerCamp Social Events Accommodation Supervision

17

In the end, it was FUN!

31-8-2012

Thankyouocé!