21
39-@it-32 3 Bjpcrtkjht `a Jojitr`hmis & I`kkuhmictm`h Jhemhjjrmhe, Lduohc Zhmvjrsmty `a Jhemhjjrmhe chb Rjidh`o`ey, Lduohc-=679, Fcheocbjsd Ypjjid Jxtrcitm`h usmhe Omp K`tm`h Bjtjitm`h fcsjb `h Ylmh I`o`r Yjekjhtctm`h Wrjsjhtjb fy Kjdjbm dcsch V`oo> 7=7=767 & Nce K`dch Rdclur V`oo> 7=7=713 Rdjsms supjrvms`r Br. Kb. A`msco D`sscmh Css`imctj Wr`ajss`r Bjpcrtkjht `a JIJ,LZJR I`ursj H`> JIJ 2777

Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

Embed Size (px)

Citation preview

Page 1: Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

8/11/2019 Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

http://slidepdf.com/reader/full/speech-extraction-using-lip-motion-detection-based-on-skin-color-segmentation 1/21

39-@it-32 3

Bjpcrtkjht `a Jojitr`hmis & I`kkuhmictm`h Jhemhjjrmhe,Lduohc Zhmvjrsmty `a Jhemhjjrmhe chb Rjidh`o`ey,

Lduohc-=679, Fcheocbjsd

Ypjjid Jxtrcitm`h usmhe Omp K`tm`hBjtjitm`h fcsjb `h Ylmh I`o`r

Yjekjhtctm`h

Wrjsjhtjb fy Kjdjbm dcsch

V`oo> 7=7=767&

Nce K`dch RdclurV`oo> 7=7=713

Rdjsms supjrvms`r

Br. Kb. A`msco D`sscmhCss`imctj Wr`ajss`r

Bjpcrtkjht ̀ a JIJ,LZJR

I`ursj H`> JIJ 2777

Page 2: Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

8/11/2019 Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

http://slidepdf.com/reader/full/speech-extraction-using-lip-motion-detection-based-on-skin-color-segmentation 2/21

Page 3: Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

8/11/2019 Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

http://slidepdf.com/reader/full/speech-extraction-using-lip-motion-detection-based-on-skin-color-segmentation 3/21

Mhtr`buitm`h 

 Udct ms Omp Vjcbmhe0

Omp rjcbmhe cos` lh`wh cs spjjid rjcbmhe, ms c tjidhmquj`a uhbjrstchbmhe spjjid fy k`vjkjhts `a tdj omps, acijchb t`heuj, wdjh h`rkco s`uhb ms h`t cvcmocfoj

 Wr`fojksAcij @rmjhtctm`h

Acimco Jxprjssm`h

Frmedthjss Wr`fojk

K`utd O`icomzctm`h

Omp crjc Bjtjitm`h

39-@it-32 9

Page 4: Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

8/11/2019 Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

http://slidepdf.com/reader/full/speech-extraction-using-lip-motion-detection-based-on-skin-color-segmentation 4/21

I`ht”b 

 @fnjitmvjs 

• Bjvjo`p c systjk wdmid wmoo cfoj t`

 

• I`kpcrj tdj cppr`cid wmtd prjvm`ussystjks t` idjil mts pjrajithjss.

Acij bjtjitm`h & tdj k`utd p`smtm`h bjtjitm`h Omp k`vjkjht bjtjitm`h Ypjjid jxtrcitm`h ar`k omp p`smtm`h

39-@it-32 2

Page 5: Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

8/11/2019 Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

http://slidepdf.com/reader/full/speech-extraction-using-lip-motion-detection-based-on-skin-color-segmentation 5/21

39-@it-32 :

Wr`p`sjb Yystjk `a spjjid jxtrcitm`h

Ame. 3> Yystjk cridmtjiturj

Page 6: Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

8/11/2019 Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

http://slidepdf.com/reader/full/speech-extraction-using-lip-motion-detection-based-on-skin-color-segmentation 6/21

Page 7: Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

8/11/2019 Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

http://slidepdf.com/reader/full/speech-extraction-using-lip-motion-detection-based-on-skin-color-segmentation 7/21

I`ht”b 

(c) Mhput Mkcej (f) Ylmh I`o`r Yjekjhtctm`h (i) Jr`bj Mkcej

(b) Bmoctjb Mkcej(j) Fmhcry Mkcej(a) Amoojb mkcej

(e) Bjtjitjb Acij

Ame. 9> Acij bjtjitm`h rjsuot39-@it-32 5

Page 8: Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

8/11/2019 Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

http://slidepdf.com/reader/full/speech-extraction-using-lip-motion-detection-based-on-skin-color-segmentation 8/21

K`utd O`ictm`h Bjtjitm`h

Ame :> K`utd rjem`h o`icomzctm`h

39-@it-32 4

K`utdPrjem`hPt`p;acijPfjo`w+(6.2*(acijPdjmedt/2)

K`utdPrjem`hPfjo`w;acijPt`p-(.3:*acijPdjmedt)K`utdPrjem`hPrmedt;acijPrmedt+(.6*acijPwjmedt)

K`utdPrjem`hPojat;acijPojat-(.6:*acijPwjmedt)

K`utd rjem`h

Page 9: Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

8/11/2019 Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

http://slidepdf.com/reader/full/speech-extraction-using-lip-motion-detection-based-on-skin-color-segmentation 9/21

K`utd Bjtjitm`h 

Bjtjitjb Acij

K`utd rjem`h o`icomzctm`h

Ylmh i`o`r sjekjhtctm`h

K`rpd`o`emico tjidhmquj

I`hhjitjb i`kp`hjhts

Bjtjitjb k`utd

Mhput acij mkcej

Ame. 2> Ao`w idcrt `a K`utd bjtjitm`h systjk

Bjtjit acij

Vjem`h o`icomzctm`h

Bjtjit slmh

Cidmjvj crjc `a k`utd rjem`h

39-@it-32 =

Vjbuij skcoo h`msj & Jhdchijstrjhetd `a slmh i`o`r

Page 10: Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

8/11/2019 Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

http://slidepdf.com/reader/full/speech-extraction-using-lip-motion-detection-based-on-skin-color-segmentation 10/21

I`ht”b 

(c) Mhput Mkcej (f) Bjtjitjb acij (i) K`utd rjem`h

(b) I`o`r sjekjhtctm`h(j) K`rpd`o`ey pr`ijss(a) Bjtjitjb k`utd

Ame. 1> K`utd (io`sj) bjtjitm`h rjsuot

39-@it-32 37

Page 11: Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

8/11/2019 Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

http://slidepdf.com/reader/full/speech-extraction-using-lip-motion-detection-based-on-skin-color-segmentation 11/21

I`ht”b 

(c) Mhput Mkcej (f) Bjtjitjb acij (i) K`utd rjem`h

(b) i`o`r sjekjhtctm`h(j) Jr`bj mkcej(a) Bmoctjb mkcej

Ame. 5> K`utd (`pjh) bjtjitm`h rjsuot39-@it-32 33

(e) Bjtjitjb (`pjh) k`utd

Page 12: Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

8/11/2019 Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

http://slidepdf.com/reader/full/speech-extraction-using-lip-motion-detection-based-on-skin-color-segmentation 12/21

39-@it-32 36

Yjekjhtctm`h (wmbtd & djmedt)

D`rmz`htco i`ht`ur omhj

Qjrtmico i`ht`ur omhjAme. 4> d`rmz`htco & vjrtmico i`ht`ur omhj rjsuot

Page 13: Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

8/11/2019 Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

http://slidepdf.com/reader/full/speech-extraction-using-lip-motion-detection-based-on-skin-color-segmentation 13/21

39-@it-32 39

Cut`kctmi mkcejs icoo (vmbj`)

Ame => strmhe i`hictjhctm`h pr`ijss

Mkcej

I`hvjrt mkcej t`strmhe

Ytrmhe i`hictjhctm`h

Fcheocbjsd ms c fjcutmauo I`uhtry

Page 14: Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

8/11/2019 Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

http://slidepdf.com/reader/full/speech-extraction-using-lip-motion-detection-based-on-skin-color-segmentation 14/21

39-@it-32 32

i`ht”b 

Ame 37> Yjqujhtmcooy mkcejs icoo

6

9

2:

3

.........

Page 15: Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

8/11/2019 Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

http://slidepdf.com/reader/full/speech-extraction-using-lip-motion-detection-based-on-skin-color-segmentation 15/21

39-@it-32 3:

Ypjjid jxtrcitm`h

Vji`rb copdcfjt —C” 

Vji`rb w`rb —ckjr”  Jxtrcitjb w`rb —ckjr” 

Jxtrcitjb copdcfjt —C” 

Ame. 33> i`kpcrms`h fjtwjjh rji`rb & jxtrcitjb spjjid

Page 16: Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

8/11/2019 Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

http://slidepdf.com/reader/full/speech-extraction-using-lip-motion-detection-based-on-skin-color-segmentation 16/21

39-@it-32 31

I`ht”b 

Ame 36> Ypjjid jxtrcitm`h pr`ijss

spjjid

Page 17: Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

8/11/2019 Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

http://slidepdf.com/reader/full/speech-extraction-using-lip-motion-detection-based-on-skin-color-segmentation 17/21

I`kpcrms`h wmtd prjvm`us systjk 

VEF i`o`r spcijAcij Mkcej csMhput

Jxtrcitjbspjjid

Bjpjhb `h slmh i`o`r,]IfIr i`o`r spcij

Acij Mkcej csMhput

Jxtrcitjbspjjid

(c) Wrjvm`us systjk

(f) @ur Wr`p`sjb systjk

Ame. 39> Ercpdmico i`kpcrms`h

39-@it-32 35

Page 18: Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

8/11/2019 Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

http://slidepdf.com/reader/full/speech-extraction-using-lip-motion-detection-based-on-skin-color-segmentation 18/21

Page 19: Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

8/11/2019 Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

http://slidepdf.com/reader/full/speech-extraction-using-lip-motion-detection-based-on-skin-color-segmentation 19/21

I`hiousm`h• Uj dcvj b`hj tdj bjtjitm`h `a acij, k`utd p`smtm`h fy slmh

i`o`ur sjekjhtctm`h pr`ijss

• ]IfIr i`o`ur spcij dcs fjjh usjb a`r i`o`ur sjekjhtctm`h

• Vjk`vj tdj pr`fojks `a acimco jxprjssm`hs, acij `rmjhtctm`h,omedtmhe mhtjhsmty tdr`ued ]IfIr i`o`r i`hvjrsm`h

• Rdms rjsjcrid dcs fjjh kcbj pjrajit chb jaamimjht fy mhioubmheacij bjtjitm`h & tdj k`utd p`smtm`h bjtjitm`h

• Ypjjid dcs fjjh jxtrcitjb fy i`kfmhmhe tdj cubm` & vmbj` pcrt

• Mt ms prcitmico t` mkpojkjht a`r tdj bukf pj`poj

• Mh auturj wj wmoo k`bmay tdms kjtd`b a`r k`rj ciiurciy chbjaamimjhiy mh rjco-tmkj cppomictm`h

39-@it-32 3=

Page 20: Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

8/11/2019 Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

http://slidepdf.com/reader/full/speech-extraction-using-lip-motion-detection-based-on-skin-color-segmentation 20/21

Auturj w`rls 

 Uj crj pochhmhe t` usj trcmhmhe coe`rmtdk chb i`kpcrj tdjjaamimjhimjs

  Mkpr`vj tdj bjtjitm`h chb spjjid rji`ehmtm`h rctj mh tdj h`msyjhvmr`hkjht 

 Zsj mh tdj trcmh stctm`h, kjtr` stctm`h tmiljt i`uhtjr t` ejt tdjtmiljt fy omp k`tm`h i`htr`oojb mha`rkctm`h. Y`, mt ms jcsmoy t` t`ojrctjtdj h`msj chb kclj tdj systjk w`rl fjttjr

39-@it-32 67

Page 21: Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

8/11/2019 Speech Extraction Using Lip Motion Detection Based on Skin Color Segmentation

http://slidepdf.com/reader/full/speech-extraction-using-lip-motion-detection-based-on-skin-color-segmentation 21/21

 Rdchls t` coo

39-@it-32 63