7/28/2019 Gait Recognition - Motion Analysis

1/5

3URFHHGLQJVRI WKH)RXUWK,QWHUQDWLRQDO&RQIHUHQFHRQ0DFKLQH/HDUQLQJDQG&\EHUQHWLFV*XDQJ]KRX$XJXVW

+80$1*$,75(&2*1,7,21%$6('21027,21$1$/

7/28/2019 Gait Recognition - Motion Analysis

2/5

3URFHHGLQJVRI WKH)RXUWK,QWHUQDWLRQDO&RQIHUHQFHRQ0DFKLQH/HDUQLQJDQG&\EHUQHWLFV*XDQJ]KRX$XJXVW

RIVLOKRXHWWHH[WUDFWLRQ

)LJXUH2YHUYLHZRI0HWKRG

D2ULJLQDOLPDJH

E%DFNJURXQG

FWKHQRQDPHQGHGVLOKRXHWWHV GWKHDPHQGHGRQHV

)LJXUH $QH[DPSOHRIVLOKRXHWWHH[WUDFWLRQ

*DLW)HDWXUH5HSUHVHQWDWLRQDQG([WUDFWLRQ

7RFODVVLI\WKHGLIIHUHQWSHUVRQE\WKHLUJDLWHDVLO\ZHQHHG VRPH HIIHFWLYH IHDWXUHV *RRG IHDWXUHV VKRXOGPD[LPL]H LQWHUFODVV YDULDQFH DQG PLQLPL]H ZLWKLQFODVVYDULDQFH+HUHERWKVKDSHDQGG\QDPLFIHDWXUHKDYHEHHQH[WUDFWHG:HQRUPDOL]HGWKHVDPHVWDUWIRUHDFKVHTXHQFH

*DLWF\FOHGHWHFWLRQ)HDWXUH)HDWXUH$QDO\VLV

([WUDFWLRQ

'&76LOKRXHWWH

([WUDFWLRQ0XUUDU\ >@ VXJJHVWHG WKDW KXPDQ JDLW LV D IRUP RI

SHULRGLF PRWLRQ >@ KDV JLYHQ VRPH UHODWLYH GHILQLWLRQ RIJDLWF\FOH2XUSUHYLRXVZRUNKDVIRXQGWKDWWKHZLGWKDQGKHLJKWRISHUVRQERG\IOXFWXDWHDVZDONLQJ7KHIOXFWXDWLQJRIVLOKRXHWWHLVHTXDOWRWKDWRIERG\7KHQZHFRQVLGHUJDLW

F\FOHDVDIXQFWLRQRIWKHVLOKRXHWWHZLGWKDQGKHLJKWRYHUWLPH+HUHZHGHILQHWKHERXQGLQJER[IRUHDFKREVHUYHG

ERG\ 7KH KHLJKW DQG ZLGWK RI ER[ DOWHU DORQJ ZLWK WKHIOXFWXDWLQJRIVLOKRXHWWH*DLWF\FOHLVWKHWLPHEHWZHHQWKHVXFFHVVLYHSHDNYDOXHVRIWKHZLGWKKHLJKW*DLWF\FOHLVRQHRIIHDWXUHVIRUWKHODWWHUUHFRJQLWLRQ)LJXUHVKRZVWKH

SHULRGLFJDLWVLJQDOV

9HFWRUV )HDWXUH

'DWDEDVH

7UDLQLQJ

)HDWXUH9HFWRUV

7HVWLQJ

)HDWXUH

6LOKRXHWWH

([WUDFWLRQ

690

&ODVVLILHU'&7)HDWXUH([WUDFWLRQ

9HFWRUV

5HVXOWV

)LJXUH 7KHSHULRGLFJDLWVLJQDOV

:LGWKDQDO\VLV

7KHYDULDQFHRIZLGWKLVWKHLPSRUWDQWLQIRUPDWLRQIRUJDLW DQDO\VLV EDVHG RQ VLOKRXHWWH 7KH ZLGWK FRQWDLQVVWUXFWXUDO DV ZHOO DV G\QDPLFDO LQIRUPDWLRQ RI JDLW'LIIHUHQW IURP >@ WKH ZLGWK SDUDPHWHUV LQ RXU DSSURDFKDUHQRWPHUHO\WKHERXQGLQJER[ZLGWK7KURXJKREVHUYLQJ

WKH JDLW RI WKH VDPH DQG GLIIHUHQW SHUVRQV ZH IRXQG WKDWPRVW FKDQJHV RFFXU GXULQJ WKH VZLQJ RI DUPV DQG WKHRVFLOODWLRQRIOHJV:HVXEGLYLGHWKHELQDU\VLOKRXHWWHLQWRWKUHH KRUL]RQWDO VHJPHQWV $V VKRZQ LQ )LJXUH WKHVLOKRXHWWH LV GLYLGHG LQWR WKUHH FRQWLJXRXV KRUL]RQWDOVHJPHQWV DFFRUGLQJ WKH DQDWRPLFDO OLWHUDWXUH $QG ZH

GHQRWH WKH WKUHH KRUL]RQWDO VHJPHQWV DV 5 5 DQG 5UHVSHFWLYHO\

)LJXUH 7KUHHFRQWLJXRXVVXEERXQGLQJER[HV

5Z DQG DUHWKH ZLGWKRI DERYH VHJPHQWV

(YHU\ VHJPHQW KDVRQH VXEERXQGLQJ ER[&RUUHVSRQGLQJWR WKH WKUHH VXEERXQGLQJ ER[HV WKH WLPH VHULHV RI WKH

5Z

5Z

7/28/2019 Gait Recognition - Motion Analysis

3/5

3URFHHGLQJVRI WKH)RXUWK,QWHUQDWLRQDO&RQIHUHQFHRQ0DFKLQH/HDUQLQJDQG&\EHUQHWLFV*XDQJ]KRX$XJXVW

ZLGWK LQ D SHULRG DUH GHQRWHG

DQG UHVSHFWLYHO\

5: W

5: W

5: W

W

5: W

: = 5 5PD[ : : W W GHQRWHVWKH

ZLGWKRIWKHHQWLUHSHUVRQVERXQGLQJER[)URP DQDO\]LQJ WKH WKUHH VXEERXQGLQJ ER[HV ZH

DWWDLQVRPHDSSDUHQWIHDWXUHVLQFOXGLQJVWULGHOHQJWKKHLJKWDQG JDLW F\FOH 6WULGH OHQJWK LV HVWLPDWHG E\ WUDFNLQJ WKH

SHUVRQ HVWLPDWLQJ WKHLU GLVWDQFH ZDONHG RYHU D SHULRG RI

WLPH DQG WKHQ FRXQWLQJ WKH QXPEHU RI VWHSV +HLJKWYDULDQFHLVDQDO\]LQJLQVHFWLRQ

'\QDPLFIHDWXUHDQDO\VLV

7KH .LQHPDWLF LQIRUPDWLRQ RI JDLW LV XVXDOO\UHSUHVHQWHG E\ WKH MRLQW DQJOHV RI OLPEV 7KH DQJOHV RI

ERG\ DUH XVHIXO DQG LPSRUWDQW LQIRUPDWLRQ IRU LPSURYLQJWKHUHFRJQLWLRQUDWH7RH[WUDFWWKHDQJOHLQIRUPDWLRQWKHUHDUH PDQ\ PHWKRGV LQ SUHYLRXV ZRUNV >@ UHSUHVHQWHGKXPDQERG\PRGHOE\D'VWLFNILJXUHFRQILJXUDWLRQ>@

PRGHOHG WKH KXPDQ OHJV DVWZR SHQGXOD MRLQHG /:DQJH[WUDFWHGDQJOHVIURPDPRGHOFRPSRVHGRIULJLGERG\

SDUWV 'LIIHUHQW IURP WKHVH PHWKRGV ZH DWWDLQ WKH MRLQWDQJOH E\ DQDO\]LQJ WKH ZLGWK RI VXEERXQGLQJ ER[ QRWPRGHOLQJ WKH ZKROHERG\ ,WLV NQRZQWKDWWKH VZLQJRI

WKHOLPEVDQGRWKHUGHWDLOVRIWKHERG\DUHUHWDLQHGLQWKHZLGWK YHFWRU $QG ZH DWWDLQ WKH XVHIXO IHDWXUHV ZLWK ORZFRVWRIFRPSXWDWLRQ

7KHMRLQWDQJOHVDUHH[WUDFWHGLQWKHVXEERXQGLQJER[7KH XSSHU OLPEV KDYH WKH VHYHUH VHOIRFFOXVLRQ WKH MRLQWDQJOHV DUHYHU\ GLIILFXOW WR WUDFN DQG PHDVXUH 7KHUHIRUHZH FKRRVH WKUHH MRLQW DQJOHV RI ORZHU OLPEV DV WKH JDLWIHDWXUHV 7KH VLOKRXHWWH LV GLYLGHG LQWR WKUHH FRQWLJXRXVKRUL]RQWDOVHJPHQWVEDVHG RQWKH DQDWRPLFDOOLWHUDWXUH7R

H[WUDFW WKH MRLQW DQJOHV ZH VKRXOG ILUVWO\ ORFDWH WKHSRVLWLRQVRIMRLQWV$QGKHUHZHGLVFXVVWKHMRLQWVRIORZHU

SDUWRIERG\ 7KH ILUVW MRLQW LV SHOYLV 7KH SRVLWLRQ RI WKLV MRLQW LV

FDOFXODWHGEDVHGRQWKH:DSSURDFK7KHSHOYLVORFDWLRQZLWKLQ 5 LV GHWHUPLQHG IURP WKH PHDQ [YDOXH DQG WKHPHDQ\YDOXHRIWKHVLOKRXHWWHSL[HOVLQWKHSHOYLVUHJLRQ7KH SRVLWLRQV RI NQHHV DQG DQNOHV DUH GHWHUPLQHG E\ WKH

NQRZ SURSHUWLHV RI ERG\ VHJPHQWV DQG WKH GLUHFWLRQ RIWKLJK DQG VKLQ 7KH URXJK SRVLWLRQ RI WKH IURQW NQHH LV

HVWLPDWHGE\WKHPLQLPXPGLVWDQFHIURPWKH OHIWERXQGDU\RI57KHYHUWLFDORISRVLWLRQRIWKHUHDUNQHHLVHTXDOWRRUKLJKHUWKDWWKHYHUWLFDOSRVLWLRQRIWKHIURQWNQHH:HORFDWHWKHSRVLWLRQRIWKHUHDUNQHHLQ5DQGWKHSRVLWLRQRIWKHIURQWNQHHDURXQGWKHERUGHURI57KHSRVLWLRQRINQHHLVFDOFXODWHGE\

O O UN N N N [ [ [ [= +

UN

ON N\ \ \= = N N N=

ZKHUH DQG GHQRWH WKH WZR NQHH SRVLWLRQV

)RU WKH IURQW NQHH

N N

ON[ GHQRWHV WKH KRUL]RQWDO SRVLWLRQ RI

WKH ILUVWSL[HORI WKH OHIW ERUGHU RI 5U

N[ UHSUHVHQWV WKH

VHFRQGSL[HORQRQHOHJ)RUWKHUHDUNQHHUN

[ GHQRWHVWKH

KRUL]RQWDOSRVLWLRQRIWKHULJKWERUGHURI57KHZLGWKRI

5 LV WKH GLVWDQFH EHWZHHQON

DQGUN

7KH NQHH

SRVLWLRQ LV WKH FURVVLQJEHWZHHQWKLJK DQG VKLQ 8VLQJWKHVDPHPHWKRGWKHSRVLWLRQVRIDQNOHVDUHFDOFXODWHGDQGZH

GHQRWH OHIW DQNOHORFDWLRQDQG ULJKWDQNOH ORFDWLRQ DV

DQG UHVSHFWLYHO\

D

D $WORZFRVWDOOSRVLWLRQVRIMRLQWVDUHORFDWHG)LJXUH

DVKRZVWKHSRVLWLRQVRIWKHDQJOHV

7KHUHDUHILYHMRLQWZHDWWDLQHGLQSUHYLRXVVHFWLRQ$V

IROORZV S S [ \ N N [ \ N N [ \ D D \ DQG

D

D[ \ 7KHWKLJKOLQHVDUHJHQHUDWHGE\FRQQHFWLQJWKH

SHOYLV SRVLWLRQ S S

[ \

N

WR WKH NQHH SRVLWLRQV 7KH VKLQ

OLQHVDUHJHQHUDWHGE\FRQQHFWLQJSRVLWLRQVEHWZHHQNQHHVDQG DQNOHV -RLQW DQJOHV DUH JHQHUDWHG EHWZHHQ WKH

QHLJKERXULQJOLQHV)LJXUHEVKRZVWKHMRLQWDQJOHVZHGHILQHGDWHDFKIUDPHRIDQLPDJHVHTXHQFH$OOWKHDQJOHVDUH PHDVXUHG UHODWLYH WR WKH KRUL]RQWDO D[LV :H GHQRWH

WKH DQJOHV DV DQG DQG

DUHDQJOHVVHULHVLQRQHJDLWF\FOH

W N 7 W . W

. W

7KHWKLJKDQJOHV DQGWKHNQHHDQJOHV KDYHWKH

UHODWLRQVKLS

W

= +

N

N O

W

7KH DQJOH LQIRUPDWLRQ H[WUDFWHG E\ DQDO\]LQJ WKH

YDULDWLRQRIVLOKRXHWWHZLGWKLVHTXDOWRWKDWH[WUDFWHGIURPG\QDPLF PRGHO ZLWK D ORZ FRVW RI FRPSXWDWLRQ

7/28/2019 Gait Recognition - Motion Analysis

4/5

3URFHHGLQJVRI WKH)RXUWK,QWHUQDWLRQDO&RQIHUHQFHRQ0DFKLQH/HDUQLQJDQG&\EHUQHWLFV*XDQJ]KRX$XJXVW

D SRVLWLRQVRIWKHDQJOHVEMRLQWDQJOHVRIORZHUOLPE

)LJXUH 7KHSRVLWLRQVRIWKHDQJOHVDQGWKHDQJOHVRIORZHUOLPE

*DLWIHDWXUHVDQDO\VLV

,QWKLVVHFWLRQZHDQDO\]HGLIIHUHQWIHDWXUHVWRH[SORLWUHGXQGDQF\LQWKHJDLWGDWDIRUUHGXFWLRQ

7KH WLPH VHULHV ZH DWWDLQ LQ VHFWLRQ

LQFOXGLQJ :

DQG DUHDOO'YHFWRUV7KHWLPHVHULHVDUH

FRQVLGHUHG WR EH SHULRGLF GHQRWHVDVHTXHQFHRISHULRGLFDOVLJQDOLQRQHJDLWF\FOH,QWKLV SDSHU ZH DGRSW 'LVFUHWH &RVLQH DQDO\VLV WR GHVFULEHWKH SHULRGLFDO VHTXHQFHV 'LVFUHWH &RVLQH DQDO\VLV LV

SHUIRUPHGRQ XVLQJWKH'LVFUHWH&RVLQH7UDQVIRUP

$QG'&7LVYHU\DSSURSULDWHWRDQDO\]LQJRXUVLJQDOVWKDQ

RWKHUWUDQVIRUPV,WVKRXOGEHQRWHGWKDWWKHGDWDQHHGVWR

EH QRUPDOL]HG DQG QHHGV WR EH V\PPHWULFDOEHIRUH

EHLQJ WUDQVIRUPHG 7R LQVXUH LV V\PPHWULFDO ZH

H[WHQG WR EH WKH QHZ VHULHV

LVHYHQIXQFWLRQ

5: W

.

[P

[P

Q 1

5: W

W

[P

\Q

5W

[P

[P

: W

P

7 W

\Q

. W

0=

=

7KH QXPEHU RI LV WZLFH RI EXW LW GRHV

QRW DIIHFW WKH IHDWXUHV ZH QHHG $QG WKH QXPEHU RI

GHVFULSWRUVRI DIWHUGLVFUHWHFRVLQHDQDO\VLVLVHTXDO

WRWKDWRI)RXULHUGHVFULSWRUVRI 7KH'&7LVFORVHO\

WR./WUDQVIRUPZKLFKFRPSUHVVLRQUDWLRLVKLJK

\Q [P

\Q

[P

+HUH GLVFUHWH FRVLQH DQDO\VLV LV SURSLWLRXV WR RXU

VLJQDOV 7KH WLPH VHULHV FDQ EH UHSUHVHQWHG E\ WKH

GLVFUHWHFRVLQHVHULHV

\Q

\Q FRV

1

N

N

Q NI I1 11

=

+= +

Q 1=

$QGWKHVH'&FRHIILFLHQWVFDQEHFDOFXODWHGE\ '&7

)UHTXHQF\ VSHFWUXP LV

ZKHUH

^ `

L 1) I I I I I

=

LILV IUHTXHQF\VSHFWUXPDWIUHTXHQF\ \Q L

\Q

1

Q

I1

=

=

FRV

1

L

Q

Q NI \ Q

1 1

=

+=

N 1=

7KH H[WUDFWHG GLVFUHWH FRVLQH IUHTXHQF\ VSHFWUXP RI

LV VKRZQ DV )LJXUH :H VHOHFW WKH UHVXOWLQJ

PDJQLWXGH VSHFWUXP RI 'LVFUHWH &RVLQH IUHTXHQF\ DV WKH

JDLW IHDWXUH EHFDXVH WKH SKDVH VSHFWUXP LQFOXGHV OHVVLQIRUPDWLRQ 7KH DQDO\VLV UHVXOWV VWLOO FRQWDLQ D ORW RIGHVFULSWRUV%XWZHFDQVHHWKDWORWVRIIUHTXHQF\SDUWVDUHFHQWUDOL]HG DW WKH ORZ IUHTXHQF\ SRVLWLRQ 0RVW RI WKH

YLVXDOO\ VLJQLILFDQW LQIRUPDWLRQ DERXW LV

FRQFHQWUDWHG LQ MXVW D IHZ FRHIILFLHQWV RI WKH '&7 7KH

JHQHUDOIHDWXUHVZKLFKKDYHWKHKLJKHVWLQWHUFODVVYDULDQFHDUHIRXQGLQWKHORZIUHTXHQF\ 7KHQZHGLVFDUGWKHKLJK

IUHTXHQF\DQGXVHWKHORZRUGHUGHVFULSWRUVWREHWKHJDLWIHDWXUHV8VLQJWKHVHJDLWIHDWXUHVQRWRQO\KROGWKHSULPDU\LQIRUPDWLRQEXWUHGXFHWKHGLPHQVLRQVRIGDWDDVZHOO

5: W

\Q

)LJXUH 7KHPDJQLWXGHVSHFWUXPGLVFDUGHGWKHKLJK

IUHTXHQF\RI 5

: W

&ODVVLILHU

:H DSSO\ WKH JDLW DSSHDUDQFH IHDWXUHV DQG NLQHWLFIHDWXUHV WR LGHQWLI\ WKH KXPDQ :H WUDLQHG DQG WHVWHG

VXSSRUWYHFWRUPDFKLQHVRQRXUJDLWIHDWXUHV7KLV690LVDPXOWLFODVVVXSSRUWYHFWRUPDFKLQH 3

>@37KHNHUQHOIXQFWLRQ

7/28/2019 Gait Recognition - Motion Analysis

5/5

3URFHHGLQJVRI WKH)RXUWK,QWHUQDWLRQDO&RQIHUHQFHRQ0DFKLQH/HDUQLQJDQG&\EHUQHWLFV*XDQJ]KRX$XJXVW

RIRXUFODVVLILHULV*DXVVLDQNHUQHO

_ _ H[S

LL

[ [. [ [

=

7KHDOJRULWKPRIFODVVLI\LV

DUJ PD[^ ` N

N

/ [ I [ N Q= =

DV

M M

N

N N N M

M

NI [ \ D . [ [=

=

N

E+ ZKHUH LV WKH

JDLW IHDWXUHV GDWD

[

I [ LV WKH N WK IXQFWLRQ IRU

FODVVLI\LQJ

([SHULPHQWDO5HVXOWV

:HXVHOHDYHRQHRXWFURVVYDOLGDWLRQWHFKQLTXH)LUVWZHHYDOXDWHRXUDSSURDFKIRUWKHGDWDVHWRI/LWWOHDQG%R\G7KHGDWDVHWFRQVLVWRILPDJHVHTXHQFHVDQGGLIIHUHQWVXEMHFWV 7KHQZH WUDLQDQGWHVWRQ WKH &080R%RGDWDVHW7KHGDWDVHWFRQWDLQVLPXOWDQHRXVPRWLRQVHTXHQFHVRIVXEMHFWVZDONLQJRQDWUHDGPLOO,PDJHUHVROXWLRQLV (DFK VXEMHFW LV UHFRUGHG SHUIRUPLQJ IRXU

GLIIHUHQW W\SHV RI ZDONLQJ VORZZDON IDVW ZDON LQFOLQHG

ZDONDQGVORZZDONKROGLQJDEDOO:HWHVWRXUPHWKRGRQWKHVORZZDON:HDOVRHYDOXDWHWKHPHWKRGRQ 1/35JDLWGDWDEDVH ,W LQFOXGHV VHTXHQFHV IURP VXEMHFWV DQGIRXU VHTXHQFHV SHU VXEMHFW 7KH RULJLQDO UHVROXWLRQ LV 7KHUHFRJQLWLRQUDWHVDUHOLVWHGLQ7DEOH

7DEOH5HFRJQLWLRQ5HVXOWV2I0XOWL&ODVV6XSSRUW9HFWRU0DFKLQHV

'DWDEDVH

&&5

/LWWOHDQG%R\G

&08VORZZDON

1/35

7DEOHVKRZVH[FHOOHQWSHUIRUPDQFHRIRXUDSSURDFK

&RQOXVLRQV

:H SUHVHQW DQ DXWRPDWHG PDUNHUOHVV DSSURDFK IRUKXPDQLGHQWLILFDWLRQIURPORZUHVROXWLRQYLGHRIXVLQJVWDWLFDQGG\QDPLFSDUDPHWHUVRIZDONLQJJDLW7KHZLGWKLVFKRVH

DVWKHEDVLFJDLWIHDWXUH7KHJDLWFKDUDFWHULVWLFFRQVLVWWKHIHDWXUHV EDVHG RQ DSSHDUDQFH RI JDLW DQG RQHV EDVHG RQNLQHPDWLFV:HH[WUDFWWKHDQJOHVIHDWXUHVZLWKRXWQHHGLQJWRPRGHOWKHKXPDQERG\DQGDQDO\]HWKHPRWLRQVLJQDWXUHV

E\ 'LVFUHWH &RVLQH DQDO\VLV 7KH 690 LV HPSOR\HG WRFODVVLI\WKHJDLWIHDWXUHV([SHULPHQWDOUHVXOWVGHPRQVWUDWH

WKH IHDVLELOLW\RI RXU DSSURDFK ,QWKH IXWXUH ZH ZLOO SD\PRUH DWWHQWLRQ WR WKH IHDWXUH VSDFH IRU GHVFULELQJ DQGUHFRJQL]LQJ WKH KXPDQ JDLW RQ WKH ODUJHU GDWDEDVH RIVXEMHFWV

5HIHUHQFHV

>@ 03 0XUDU\$%'URXJKW DQG 5&.RU\ :DONLQJ

3DWWHUQ RI0RYHPHQW $PHULFDQ -RXUQDO 0HGLFLQH

9RO1RSS-DQ

>@ / /HH DQG : *ULPVRQ *DLW $QDO\VLV IRU

5HFRJQLWLRQ DQG &ODVVLILFDWLRQ 3URFHHGLQJV RI WKH

)LIWK ,((( ,QWHUQDWLRQDO &RQIHUHQFH RQ $XWRPDWLF

)DFHDQG*HVWXUH5HFRJQLWLRQSS0D\>@ 5 &ROOLQV 5 *URVV DQG - 6KL 6LOKRXHWWHEDVHG

+XPDQ ,GHQWLILFDWLRQ IURP %RG\ 6KDSH DQG *DLW

3URFRI,QWO&RQI 2Q$XWRPDWLF)DFHDQG*HVWXUH

5HFRJQLWLRQSS2FW

>@ / :DQJ 7 1 7DQ : 0 +X DQG + = 1LQJ

$XWRPDWLF *DLW 5HFRJQLWLRQ %DVHG RQ 6WDWLVWLFDO

6KDSH $QDO\VLV ,((( 7,3 9RO 1R SS

6HS

>@ '&XQDGR061L[RQDQG-1&DUWHU$XWRPDWLF

([WUDFWLRQDQG'HVFULSWLRQRI+XPDQ*DLW0RGHOVIRU

5HFRJQLWLRQ 3XUSRVHV &RPSXWHU9LVLRQ DQG ,PDJH

8QGHUVWDQGLQJ9RO1RSS$SULO>@