Upload
tsukasa-sugiura
View
5.960
Download
5
Embed Size (px)
DESCRIPTION
2014/10/04 第25回コンピュータビジョン勉強会@関東 http://connpass.com/event/8082/
Citation preview
Introduction to Kinect v2
Tsukasa Sugiura
@UnaNancyOwen
Self-Introduction
Tsukasa SugiuraMicrosoft MVP for Kinect for Windows
@UnaNancyOwen
http://UnaNancyOwen.com
(July 2014 - June 2015)
ワタシハキネクトチョットデキルI can develop Kinect App a little
Agenda
What is Kinect v2
Specifications
New Features
Demo
Disclaimer
“This is preliminary software and/or hardware and APIs
are preliminary and subject to change.”(Kinect for Windows v2は暫定的なものであり、ソフトウェア、ハードウェア、およびAPIは製品版で変更される可能性があります。)
Kinect for Windows v1 Sensor
MULTI-ARRAY MIC MOTORIZED TILT
3D DEPTH SENSORS
RGB CAMERA
Kinect for Windows v2 Sensor
MULTI-ARRAY MIC
3D DEPTH SENSOR
( IR Camera + IR Emitters )
RGB CAMERA
Kinect for Windows v2 Sensor
Image by iFixit
IR EMITTERS
IR CAMERA
Specifications
Kinect for Windows v1 Kinect for Windows v2
Color 640×480 @ 30fps 1920×1080 @ 30fps
Depth 320×240 @ 30fps 512×424 @ 30fps
Sensor Structured Light(PrimeSense Light Coding)
Time of Flight(ToF)
Range 0.8~4.0 m 0.5~4.5 m
Angle of ViewHorizontal / Vertical
57 / 43 degree 70 / 60 degree
Microphone Array ◯ ◯
Specifications
Kinect for Windows v1 Kinect for Windows v2
BodyIndex 6 people 6 people
Body 2 people 6 people
Joint 20 joint/people 25 joint/people
Hand State Open / Closed Open / Closed / Lasso
Gesture ☓ ◯
Face ◯
Speech / Beamforming ◯ ◯
System / Software Requirements
OS * Windows 8, 8.1, Embedded 8, Embedded 8.1 (x64)
CPU Intel Core i7 3.1GHz (or higher)
RAM 4GB (or more)
GPU * DirectX 11 supported
USB * USB 3.0 (Intel or Renesas Host Controller)
Compiler * Visual Studio 2012, 2013 (Supported Express)
Language Native (C++), Managed (C#,VB.NET), WinRT (C#,HTML)
Other Unity Pro (Add-in), Cinder, openFrameworks (wrapper)
System
Kinect for Windows v1 Kinect for Windows v2
PCPC
System
Kinect
Driver
Kinect SDK
Application
Kinect
Driver
Kinect SDK
Application
Kinect
Service
Kinect SDK
Application
Kinect SDK
Application
Kinect for Windows v1 Kinect for Windows v2
New Features
Joint
Tip (指先), Thumb (親指), Neck (首)の追加 解剖学的に正しいJointの構成
New Features
Gesture
機械学習によるジェスチャー認識 (Discrete, Continuous)
識別器を学習するツール”Visual Gesture Builder”
Video by http://youtu.be/-XYoblrnDpg
New Features
Face
Bounding Box (囲枠), Rotation (方向), Points (目、鼻、口角)の取得 Activity (動作), Appearance (外観), Expression (表情)の認識
Activity … 目の開閉, 口の開閉, Sensorに正対 Appearance … メガネの有無 Expression … 笑顔
New Features
HDFace
顔の3Dモデルを作成するためのデータ 詳細なPoints (1347点), HairColor (髪色), SkinColor (肌色)の取得 モデルのフィッティング
Other
Drawing the Point Cloud retrieved from
Kinect v2 using Point Cloud Library
Kinect v2から取得したPoint CloudをPCLを使って描画 PCL All-in-one installerはBlogで配布
Reference
Sample Program
Kinect2Sample | GitHubhttps://github.com/UnaNancyOwen/Kinect2Sample
Article Series
Kinect for Windows v2 | Build Insider http://www.buildinsider.net/small/kinectv2cpp
Blog
Kinect | Summary?Bloghttp://unanancyowen.com/?cat=3