17
A Vision Based Anthropometric Scanner Project Management and Software Development Final Presentation Ahmed El-Gazzar Supervisor : Benjamin Busam

A Vision Based Anthropometric Scanner - TUMcampar.in.tum.de/files/busam/2016SS_PMSD/...FinalPresentation.pdf · 17-Apr-2016 27-Apr-2016 7-May-2016 17-May-2016 27-May-2016 6-Jun-2016

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: A Vision Based Anthropometric Scanner - TUMcampar.in.tum.de/files/busam/2016SS_PMSD/...FinalPresentation.pdf · 17-Apr-2016 27-Apr-2016 7-May-2016 17-May-2016 27-May-2016 6-Jun-2016

A Vision Based Anthropometric

Scanner

Project Management and Software Development

Final Presentation

Ahmed El-Gazzar

Supervisor : Benjamin Busam

Page 2: A Vision Based Anthropometric Scanner - TUMcampar.in.tum.de/files/busam/2016SS_PMSD/...FinalPresentation.pdf · 17-Apr-2016 27-Apr-2016 7-May-2016 17-May-2016 27-May-2016 6-Jun-2016

Problem Statement

July 13, 2016A vision based anthropometric Scanner Slide 2

Buying a bicycle

It’s not that simple!

http://www.wikihow.com/Buy-a-Bicycle

Page 3: A Vision Based Anthropometric Scanner - TUMcampar.in.tum.de/files/busam/2016SS_PMSD/...FinalPresentation.pdf · 17-Apr-2016 27-Apr-2016 7-May-2016 17-May-2016 27-May-2016 6-Jun-2016

Problem Statement

July 13, 2016A vision based anthropometric Scanner Slide 3

An optimum bicycle provides:

Comfort

Safety

Injury prevention

Peak performance

http://www.twowheelsgood.co.uk/fit-services.php

Page 4: A Vision Based Anthropometric Scanner - TUMcampar.in.tum.de/files/busam/2016SS_PMSD/...FinalPresentation.pdf · 17-Apr-2016 27-Apr-2016 7-May-2016 17-May-2016 27-May-2016 6-Jun-2016

Our Approach

July 13, 2016A vision based anthropometric Scanner Slide 4

Fitting a bike to the costumer based on pose estimation

Page 5: A Vision Based Anthropometric Scanner - TUMcampar.in.tum.de/files/busam/2016SS_PMSD/...FinalPresentation.pdf · 17-Apr-2016 27-Apr-2016 7-May-2016 17-May-2016 27-May-2016 6-Jun-2016

Overview

July 13, 2016A vision based anthropometric Scanner Slide 5

B

A

K

S

Page 6: A Vision Based Anthropometric Scanner - TUMcampar.in.tum.de/files/busam/2016SS_PMSD/...FinalPresentation.pdf · 17-Apr-2016 27-Apr-2016 7-May-2016 17-May-2016 27-May-2016 6-Jun-2016

Procedure breakdown

July 13, 2016A vision based anthropometric Scanner Slide 6

Page 7: A Vision Based Anthropometric Scanner - TUMcampar.in.tum.de/files/busam/2016SS_PMSD/...FinalPresentation.pdf · 17-Apr-2016 27-Apr-2016 7-May-2016 17-May-2016 27-May-2016 6-Jun-2016

July 13, 2016A vision based anthropometric Scanner Slide 7

• Implemented in Matlab using MatConvNet.

• Convolutional Neural Network.

• Trained using the Leeds Sports Pose Dataset.

Network Training

Page 8: A Vision Based Anthropometric Scanner - TUMcampar.in.tum.de/files/busam/2016SS_PMSD/...FinalPresentation.pdf · 17-Apr-2016 27-Apr-2016 7-May-2016 17-May-2016 27-May-2016 6-Jun-2016

Camera Calibration

July 13, 2016A vision based anthropometric Scanner Slide 8

Tens of images with checkerboard and Bicycle

Intrinsic Camera Parameters calculated and stored

Page 9: A Vision Based Anthropometric Scanner - TUMcampar.in.tum.de/files/busam/2016SS_PMSD/...FinalPresentation.pdf · 17-Apr-2016 27-Apr-2016 7-May-2016 17-May-2016 27-May-2016 6-Jun-2016

Pose Estimation

July 13, 2016A vision based anthropometric Scanner Slide 9

Pose estimation

Human region is cropped

CNN validation

14*2 outputs extracted and drawn

Page 10: A Vision Based Anthropometric Scanner - TUMcampar.in.tum.de/files/busam/2016SS_PMSD/...FinalPresentation.pdf · 17-Apr-2016 27-Apr-2016 7-May-2016 17-May-2016 27-May-2016 6-Jun-2016

Image to World

July 13, 2016A vision based anthropometric Scanner Slide 10

Real pose estimation

Bicycle images collected

Tires detected.

Tires radiuses and centers distance calculated

Page 11: A Vision Based Anthropometric Scanner - TUMcampar.in.tum.de/files/busam/2016SS_PMSD/...FinalPresentation.pdf · 17-Apr-2016 27-Apr-2016 7-May-2016 17-May-2016 27-May-2016 6-Jun-2016

Bicycle parameters

July 13, 2016 Slide 11A vision based anthropometric Scanner

Human body parameters extracted

Bicycle parameters calculated

Formulas

Tables

B

A

K

R

S

OR

KL

SHRH

Page 12: A Vision Based Anthropometric Scanner - TUMcampar.in.tum.de/files/busam/2016SS_PMSD/...FinalPresentation.pdf · 17-Apr-2016 27-Apr-2016 7-May-2016 17-May-2016 27-May-2016 6-Jun-2016

Bicycle parameters

July 13, 2016 Slide 12A vision based anthropometric Scanner

B

A

K

R

S

OR

KL

SHRH

𝑆𝐻 = 𝑅 ∗ 0.885 𝑂𝑅 = 𝑅 + 𝐴 ∗ 𝐻 − 𝐴

Roadbike.de magazine, 10, 2012

Page 13: A Vision Based Anthropometric Scanner - TUMcampar.in.tum.de/files/busam/2016SS_PMSD/...FinalPresentation.pdf · 17-Apr-2016 27-Apr-2016 7-May-2016 17-May-2016 27-May-2016 6-Jun-2016

Dynamic fitting

July 13, 2016 Slide 13A vision based anthropometric Scanner

Pose on the bicycle

Video Capturing

Results were not satisfactory

Page 14: A Vision Based Anthropometric Scanner - TUMcampar.in.tum.de/files/busam/2016SS_PMSD/...FinalPresentation.pdf · 17-Apr-2016 27-Apr-2016 7-May-2016 17-May-2016 27-May-2016 6-Jun-2016

July 13, 2016A vision based anthropometric Scanner Slide 14

17-Apr-2016 27-Apr-2016 7-May-2016 17-May-2016 27-May-2016 6-Jun-2016 16-Jun-2016 26-Jun-2016 6-Jul-2016 16-Jul-2016

Reading Papers

Understanding Previous Codes

Camera Calibration

Training & Testing the oldalgorithm

Videos Data Collection

Training & Testing the newalgorithm

Updating the GUI

Visualisation

Dynamic fitting

Final Report

Gantt Chart

Created with Microsoft Excel

Page 15: A Vision Based Anthropometric Scanner - TUMcampar.in.tum.de/files/busam/2016SS_PMSD/...FinalPresentation.pdf · 17-Apr-2016 27-Apr-2016 7-May-2016 17-May-2016 27-May-2016 6-Jun-2016

Project Outlook

July 13, 2016A vision based anthropometric Scanner Slide 15

Create a customized dataset

Retrain network

Optical flow

Page 16: A Vision Based Anthropometric Scanner - TUMcampar.in.tum.de/files/busam/2016SS_PMSD/...FinalPresentation.pdf · 17-Apr-2016 27-Apr-2016 7-May-2016 17-May-2016 27-May-2016 6-Jun-2016

Lessons Learned

July 13, 2016A vision based anthropometric Scanner Slide 16

Deep Learning in action

Connecting different parts

Time management

Work presentation

Page 17: A Vision Based Anthropometric Scanner - TUMcampar.in.tum.de/files/busam/2016SS_PMSD/...FinalPresentation.pdf · 17-Apr-2016 27-Apr-2016 7-May-2016 17-May-2016 27-May-2016 6-Jun-2016

July 13, 2016A vision based anthropometric Scanner Slide 17

Thank you for your attention!