Effects of Phoneme Characteristics on TEO Feature-Based Automatic Stress Detection in Speech

8/17/2019 Effects of Phoneme Characteristics on TEO Feature-Based Automatic Stress Detection in Speech

1/22

Efects o PhonemeCharacteristics on TEO Feature-Based Automatic Stress

Detection in SpeechBY –

VE!ATES" S"A#A D$%&

#AC"'T (AC"A)*A# D$+%

#,S"AB" BA#B"AYA D$+


2/22


3/22

Continued

#e/ia7/e speech processin4 not possi7/e 8compounded 7. the 1ariouscharacteristics o the speech samp/es used in reco4nition scheme

Vo3e/s used as to5en in such reco4nition s.stems

)DC9)in4uistics Data Consortium: phonemes 0

Consists ;$ diferent t.pes o 1o3e/s each ha1in4 diferent 4enera/characteristics


4/22

The Scheme

Since the duration8 scope and 7readth o detecta7/e t.pes o thespo5en 1o3e/s 1ar.6

These 1ariations can de4rade stress detection perormance

'n addition to this phoneme durations can 1ar. dependin4 upon thet.pe o speech 9'so/ated 3ord8 Spontaneous8 #ead:

"ence to ana/.The ans3er to that =uestion is ?no@


5/22

Cont.

eutra/ to Stress conditions 0

The mean heart rate increased 7. %6;

S.sto/ic 7/ood pressure increased 7. %%6$8

Diasto/ic 7/ood pressure increased 7. ;;6

*e decide the condition 9i6e6 stressed or not stressed:8 o the spea5er7. emp/o.in4 a 3ei4hted maorit. decision ru/e

This ru/e is 7ased upon the decisions o each 1o3e/ 3ithin the sentence The decisions are 3ei4hted 7. the a7so/ute diference 7et3een t3o"idden (ar5o1 (ode/ 9"((: scores6


6/22

Teager Energy Operator

(ost approaches to speech mode/in4 ha1e ta5en a /inear p/ane 3a1epoint-o-1ie36

Tea4er did etensi1e research on the non-/inear speech mode//in4

This 3as done 7. de1isin4 a simp/e non-/inear ener4. trac5in4 operato

The operator mode/s the airGo3 throu4h the 1oca/ tract8 sho3n ordiscrete-time si4na/s as o//o3s0

*here is the Tea4er Ener4. Operator 9TEO:


7/22


8/22

The Tea4er Ener4. Operator8 Critica/ Band8 Autocorre/ation En1e/ope9TEO-CB-Auto-En1: parameteri


9/22

The TEO-CB-Auto-En1 eature used in this stud. is etracted throu4h aprocess sho3n in the Go3 dia4ram and i//ustrated mathematica//. usin4critica/ 7andpass I/ters 9BPF: as


10/22

Study addresses two issues

Efecti1e stress c/assiIcation is possi7/e usin4 1oiced speech data rom1o3e/s 3ith the TEO-CB-AutoEn1 3here critica/ 7ands are 3ei4hted7ased on neutra/Jstress detection perormance rom a de1e/opment tesset6

Since the TEO-CB-AutoEn1 emp/o.s an autocorre/ation en1e/ope

ana/.sis on the input speech8 it shou/d 7e /ess sensiti1e to phonemespectra/ diferences in stress detection than spectra/ eatures such as(FCCs

Further ana/.sis done on/. on one phoneme JO*J


11/22

Etraction and Processin4

&5"< Di4ita/ data rom SO(

;; samp/es

"idden (ar5o1 (ode/ 9"((: used or etraction

(anua/ processin4 – ront and 7ac5 end

Croppin4 and remo1in4 JJ rom >no

(anua//. chec5in4 or JO*J


12/22

PDF o JO*J to5en


13/22

Truncation

The samp/es o K$$ are truncated to &$8 +$8 $ and ;$

TEO is etracted rame 7. rame6

Output o TEO is e=ua//. truncated6

Band 3ei4hin4 scheme is not used in this test6


14/22

Testin4

K$$ 1o3e/s 3hich 3ere used to train in "(( are used in round ro7intestin46

o + 1o3e/s to5en rom a// users are ta5en and used to train "((mode/s

eutra/ to5en in eutra/ and Stress trained "((s@


15/22


16/22

Error #eduction

K$$ samp/e rame

$ duration – %;J;K+ didnLt ha1e enou4h inormation6

;$ duration – K$J;K+

; samp/e rame

$ duration – A// to5ens made throu4h ;$ duration – K+J;K+ didnMt ha1e enou4h inormation

On/. N6 samp/es 3erenLt used


17/22

Efect on diferent 1o3e/s

'so/ate the 1o3e/

$ms duration


18/22


19/22

o1e/ scheme or impro1in4 stressdetection across 1o3e/ t.pes 3ithdecreased durations

Ep/oitation o mu/tip/e 1o3e/ t.pes per spea5er utterance is seen anda c/assiIcation is made upon a maorit. ru/e o1er indi1idua/ decisionson each 1o3e/6

The 7/oc5 dia4ram or the a7o1e procedure is sho3n in the net s/ide6

The test resu/ts usin4 the "(( trainin4 scheme emp/o.ed in the

pre1ious section8 3ith an o1era// decision 7ased on the composite3ei4hted maorit. decision ru/e scheme resu/ts in si4niIcantperormance 4ains6

The ta7/e or the a1era4e error rate is sho3n ahead6


20/22


21/22

Conc/usion

'n this paper8 the efects o phoneme duration and t.pe on automatic Tea4er Ener4.Operator eature-7ased stress detection perormance is seen6

't 3as sho3n that 7oth phoneme duration and t.pe mismatch afect the stress detectionperormance6

'n the case o 1o3e/ duration8 shortenin4 the 1o3e/ duration 3as sho3n to ad1erse/.afect stress detection perormance i the 1o3e/ duration is /ess than a thresho/d o a7out

$ o the ori4ina/ duration in the case o the 1o3e/ JO*J8 or at a7out &-K;& ms6 *hen a spea5er@s utterance contains mu/tip/e 1o3e/ t.pes8 usin4 a composite decision

process 7. app/.in4 a 3ei4hted maorit. decision ru/e to the indi1idua/ decisions 3ithe=ua/ 9i6e6 7ase/ine: 7and-3ei4htin4 pro1ides re/ati1e error rate reductions o ; and% in the neutra/ and stress conditions8 respecti1e/.6

The Ina/ composite stress detection scheme achie1es o1era// a1era4e error rates oapproimate/. ;N or neutra/Jstress detection8 3here the 1o3e/ durations are $ ms6


22/22

The error rates presented ma. 7e urther impro1ed 7.emp/o.in4 a sot decision ru/e a/4orithm8 7ased upon a criteriaassociated 3ith the characteristics o speciIc 1o3e/s8 such as3ei4htin4 decisions made on /on4er duration 1o3e/s morehea1i/. than those rom shorter duration 1o3e/s

Documents

Effects of Phoneme Characteristics on TEO Feature-Based Automatic Stress Detection in Speech