69
Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

Embed Size (px)

Citation preview

Page 1: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

Phonetics

Janice Fon

Graduate Institute of Linguistics

National Taiwan University

Page 2: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

2

Overview

Speech sounds and phonetic transcription

Articulatory phonetics

Phonological categories and pronunciation variation

Acoustic phonetics and signals

Phonetic resources

Advanced: articulatory and gestural phonology

Page 3: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

3

Speech sounds and phonetic transcription (1)

PhoneticsThe study of speech sounds used in the languages of the world

PhoneA speech sound Represented with phonetic symbolsTwo types:

ConsonantsVowels

Page 4: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

4

Speech sounds and phonetic transcription (2)

Phonetic alphabetsIPA

Standard developed by International Phonetic Association

Alphabet + principles of transcription

ARPAbetDesigned for American English in ASCII symbols

Computer-friendly

Page 5: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

5

Speech sounds and phonetic transcription (3)

[ɹ]

Page 6: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

6

Speech sounds and phonetic transcription (4)

Page 7: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

7

Articulatory phonetics (1)

Definition:The study of how phones are produced

The vocal organ

Page 8: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

8

Articulatory phonetics (2)

Sounds are formed by the motion of air through the mouth

Consonants:Made by restricting or blocking the airflow in some way

May be voiced or voiceless

Vowels:Made with less obstruction

Usually voiced

Generally louder and longer than consonants

Page 9: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

9

Articulatory phonetics (3)

Consonants are defined by Place of articulation

The point of maximum constriction

Manner of articulationHow the restriction of airflow is made

Voicing State of the glottis

Page 10: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

10

Articulatory phonetics (4)

Place of articulation

coronal

Page 11: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

11

Articulatory phonetics (5)

LabialSounds whose main restriction is formed at the lips

Two subtypes:Bilabial: two lips

Labiodental: upper teeth + lower lip

Examples [國 ]: [p] 爸 , [pʰ] 怕 , [m] 媽 , [f] 法[閩 ]: [b] 肉 , [p] 爸 , [pʰ] 打 , [m] 媽[E]: [p] spy, [pʰ] pie, [m] my, [f] four, [v] very

Page 12: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

12

Articulatory phonetics (6)

DentalSounds made by placing the tongue against the teeth

Two subtypes:Dental: behind the teeth

Interdental: between the teeth

Examples [國 ]: [t ̪] 大 , [t ̪ʰ] 踏 , [s ̪] 撒 , [t ̪s ̪] 資 , [t ̪s ̪ʰ] 刺 , [n ̪] 那 , [l ̪] 辣 [閩 ]: [t ̪] 大 , [t ̪ʰ] 拖 , [s ̪] 沙 , [z ̪] 熱 , [t ̪s ̪] 十 , [t ̪s ̪ʰ] 柴 , [n ̪] 藍 , [l ̪] 賴 , [ɾ̪] 賊仔[E]: [θ] thing, [ð] the

Page 13: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

13

Articulatory phonetics (7)

AlveolarSounds made by placing the tongue against the alveolar ridge

Two subtypes:Alveolar: b/t teeth and alveolar ridge

Postalveolar/palato-alveolar: after the alveolar ridge

Examples [E]: [t] ten, [d] duck, [n] new, [s] sing, [z] zoo, [l] love, [ɹ] red, [ɾ] butter, [ʃ] she, [ʒ] garage, [tʃ] China, [dʒ] joy

Page 14: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

14

Articulatory phonetics (8)

Page 15: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

15

Articulatory phonetics (9)

PalatalSounds made by placing the tongue against the (hard) palate

Two subtypes:Prepalatal/alveolopalatal: the arc towards the roof of the mouth

Palatal: the roof of the mouth

Examples [國 ]: [ɕ] 削 , [tɕ] 交 , [tɕʰ] 敲 , [j] 妖[閩 ]: [ɕ] 是 , [tɕ] 摺 , [tɕʰ] 試 , [ʑ] 皺 , [j] 妖[E]: [j] yes

Page 16: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

16

Articulatory phonetics (10)

Velar Sounds made by placing the tongue against the velum/soft palate

Examples [國 ]: [k] 該 , [kʰ] 開 , [x] 害 , [ŋ] 忙[閩 ]: [k] 該 , [kʰ] 開 , [g] 牛 , [ŋ] 黃[E]: [k] ski, [kʰ] key, [g] good, [ŋ] sing

Page 17: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

17

Articulatory phonetics (11)

Glottal Sounds made at the glottis

Examples [國 ]: [ʔ] 唉[閩 ]: [h] 海 , [ʔ] 食[E]: [h] high, [ʔ] uh-oh

Page 18: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

18

Articulatory phonetics (12)

Retroflex Sounds made with the tongue tip curled back

Examples [國 ]: [ʂ] 扇 , [tʂ] 詹 , [tʂʰ] 蟬 , [ʐ] 然

Page 19: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

19

Articulatory phonetics (13)

Manner of articulationStop

Nasal

Fricative

Affricates

Approximant

Flap/tap

Page 20: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

20

Articulatory phonetics (14)

Stop = plosive Two phases:

Closure: airflow is completely blocked for a short timeRelease: an explosive sound as the air is released

Three types:Aspirated: closure + release + big puff of airUnaspirated: closure + release + small puff of airUnreleased stops: closure

Examples [國 ]: [p] 爸 , [pʰ] 怕 , [t ̪] 打 , [t ̪ʰ] 踏 , [k] 乾 , [kʰ] 看[閩 ]: [p] 爸 , [pʰ] 打 , [b] 肉 , [t ̪] 踏 , [t ̪ʰ] 桃 , [k] 菇 , [kʰ] 苦 , [g] 牛 , [p ̚] 十 , [t ̚] 結 , [k ̚] 角[E]: [p] spy, [pʰ] pie, [b] buy, [t] story, [tʰ] tie, [d] die, [k] sky, [kʰ] key, [g] guy

Page 21: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

21

Articulatory phonetics (15)

voiceless

voiced

spy pie

buy

鼻 皮

narrow glottal opening wide glottal opening

to buy

Page 22: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

22

Articulatory phonetics (16)

Nasal

Made by lowering the velum and allowing air to pass into the nasal cavity

Examples [國 ]: [m] 媽 , [n ̪] 拿 , [ŋ] 紅[閩 ]: [m] 媽 , [n ̪] 貓 , [ŋ] 紅[E]: [m] my, [n] new, [ŋ] sing

Page 23: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

23

Articulatory phonetics (17)

Fricatives Process

Airflow is constricted but not cutoff completely

Turbulence is created

Two types

Sibilants: fricatives with high-pitched hissing noise

Nonsibilants: fricatives without high-pitched hissing noise

Examples

[國 ]: [f] 法 , [s ̪] 素 , [ʂ] 刪 , [ʐ] 然 , [ɕ] 先 , [x] 何[閩 ]: [s ̪] 素 , [z ̪] 熱 , [ɕ] 先 , [ʑ] 任 , [h] 何[E]: [f] few, [v] view, [θ] they, [ð] the, [s] sing, [z] zoo, [ʃ] she, [ʒ] garage, [h] high

Page 24: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

24

Articulatory phonetics (18)

Affricates

Homorganic stop + fricative

Examples [國 ]: [t ̪s̪] 租 , [t ̪s̪ʰ] 粗 , [tʂ] 朱 , [tʂʰ] 出 , [tɕ] 家 , [tɕʰ] 恰[閩 ]: [t ̪s̪] 租 , [t ̪s̪ʰ] 粗 , [tɕ] 一 , [tɕʰ] 七[E]: [f] few, [v] view, [θ] they, [ð] the, [s] sing, [z] zoo, [tʃ] choice, [dʒ] job

Page 25: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

25

Articulatory phonetics (19)

ApproximantTwo articulators are close together but not close enough to cause turbulent airflow

Two types:Approximant: air flows from the center of the tongue outward

Lateral approximant: air flows from the side(s) of the tongue outward

Examples [國 ]: [j] 牙 , [w] 娃 , [ɥ] 圓 , [l ̪] 來[閩 ]: [j] 厭 , [w] 歪 , [l ̪] 來[E]: [j] yes, [w] we, [l] like, [ɹ] read

Page 26: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

26

Articulatory phonetics (20)

Tap/flapA quick motion of the tongue against a hard surface

Examples [閩 ]: [ɾ̪] 賊仔 [E]: [ɾ] butter

Page 27: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

27

Articulatory phonetics (21)

Page 28: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

28

Articulatory phonetics (22)

Vowels are defined byTongue height

Tongue frontness/backness

Roundedness

Page 29: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

29

Articulatory phonetics (23)

意 欲 思 屋

矮 黑可

辦 棒

about

it

bet

bat

but bought

Page 30: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

30

Articulatory phonetics (24)

Three types of vowelsMonophthongs

A vowel in which the tongue position does not change

Diphthongs A vowel in which the tongue position changes once

= VG/GV

(ex) [國 ]: [aɪ] 埃 , [eɪ] 黑 , [aʊ] 好 , [oʊ] 候 , [ja] 牙 , [wa] 娃 , [ɥɛ] 約(ex) [閩 ]: [ju] 油(ex) [E]: [ɔɪ] boy

Triphthongs A vowel in which the tongue position changes twice

= GVG

(ex) [國 ]: [jaʊ] 妖 , [jaɪ] 崖 , [waɪ] 歪

Page 31: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

31

Articulatory phonetics (25)

SyllableConsonants and vowels combine to make a syllable

Page 32: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

32

Articulatory phonetics (26)

PhonotacticsConstraints on which phones can follow each other in a language

[國 ] CCVC: 片[閩 ] CCVC: 接 [E] CCCVCCC: strengths

[E] CCVCCCC: twelfths

Page 33: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

33

Articulatory phonetics (27)

Lexical stressA prominent syllable in a word that is determined by the lexicon

(ex) [國 ] 東西 [ˈtoŋɕi] vs. [ˈtoŋˈɕi]

Three levelsPrimary stress: dictionary

Secondary stress: dictionary

Unstressed: dictionary

In unstressed syllables, vowels can be Reduced: about [ə]

Unreduced: carry

Page 34: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

34

Articulatory phonetics (28)

Sentence stress= pitch accent

A prominent syllable in an utterance that is determined by pragmatics

(ex) 連站都站不好! 連戰都站不好!

Page 35: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

35

Phonological categories and pronunciation variation (1)

Pronunciations vary!

Page 36: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

36

Phonological categories and pronunciation variation (2)

Phoneme allophone/t/ [t, tʰ, ʔ, ʔt, ɾ, t ̚, t]̪

Page 37: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

37

Phonological categories and pronunciation variation (3)

(assimilation)

The degree of variation increases with more natural and colloquial speech

Page 38: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

38

Phonological categories and pronunciation variation (4)

Coarticulation The movement of articulators to anticipate the next sound or persevering movement from the last sound

(ex) nasalization, palatalization, voicing, etc.

Page 39: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

39

Phonological categories and pronunciation variation (5)

Distinctive features Binary variables which express some generalizations about groups of phonemes

Used to represent each phoneme as a matrix of feature values

Place features[labial], [coronal], [dorsal]

Manner features[consonantal], [vocalic], [continuant], [sonorant]

Voicing features[voice]

Vowel features[high], [low], [back], [round]

Page 40: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

40

Phonological categories and pronunciation variation (6)

Main use of featuresCapture natural articulatory classes of phones

Build articulatory feature detectors and use them to help phone detection

Page 41: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

41

Phonological categories and pronunciation variation (7)

Predicting phonetic variationPhonological rule

Caveat:Variation is a stochastic process

Many non-phonetic factors are important to this prediction task

Page 42: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

42

Phonological categories and pronunciation variation (8)

Factors influencing phonetic variationNon-phonetic

Speech rateWord frequencySpeaker’s state of mindMorphological boundariesSociolinguistic factors

Phonetic Intrinsic sound qualityProsodic boundariesCoarticulation

Page 43: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

43

Acoustic phonetics and signals (1)

Waves

Page 44: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

44

Acoustic phonetics and signals (2)

Page 45: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

45

Acoustic phonetics and signals (3)

For computers to record and manipulate speech, it is necessary to perform analog-to-digital conversion

A two-step processSampling—limit the number of places after the decimal point on the time axis

Quantization—limit the number of places after the decimal point on the amplitude axis

Page 46: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

46

Acoustic phonetics and signals (4)

Sampling rate

Number of sample taken per second

At least two samples per cycle

Nyquist frequencythe highest frequency component that can be captured with a given sampling rate

= ½ sampling rate

Page 47: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

47

Acoustic phonetics and signals (5)

Frequency = 100 HzSampling rate = 200 HzNyquist frequency = 100 Hz

Page 48: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

48

Acoustic phonetics and signals (6)

signal not in the original signal aliasing

Page 49: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

49

Acoustic phonetics and signals (7)

Quantization Analogous to measuring the amplitudes in the waveform with a ruler

The main issue is the accuracy of the amplitude measurements

The most popular choices for the number of bits used to encode speech samples are 8, 12, and 16 bits

Page 50: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

50

Acoustic phonetics and signals (8)

Page 51: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

51

Acoustic phonetics and signals (9)

Recording formatChannels: mono or stereo

Format: linear or compressed Linear: linear PCM

Compressed: -law log compression

Common format.wav, .aiff, .au

Page 52: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

52

Acoustic phonetics and signals (10)

Page 53: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

53

Acoustic phonetics and signals (11)

Fundamental frequency = F0

Measures speed of vocal fold vibration

Hertz

AmplitudeMeasures amount of air pressure variation

Pascal (Pa)

RMS

IntensitySound power per unit area measuring at a listener’s location

Decibels (dB)

Page 54: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

54

Acoustic phonetics and signals (12)

Page 55: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

55

Acoustic phonetics and signals (13)

Perceptual propertiesPitch

Mental sensation or perceptual correlate of F0

Mel scale

Loudness Perceptual correlated of power

Human ear has greater resolution in the low power range

Loudness interacts with frequency

Page 56: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

56

Acoustic phonetics and signals (14)

Page 57: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

57

Acoustic phonetics and signals (15)

Page 58: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

58

Acoustic phonetics and signals (16)

most sensitive

quick sensitivity drop

Page 59: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

59

Acoustic phonetics and signals (17)

1000 Hz 100 Hz

1x 2x 1x 2x

Page 60: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

60

Acoustic phonetics and signals (18)

Autocorrelation method

A pitch extraction algorithm that correlates the

signal with itself at various offsets

The offset that gives the highest correlation gives

the period of the signal

Page 61: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

61

Acoustic phonetics and signals (19)

Page 62: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

62

Acoustic phonetics and signals (20)

Interpreting phones from a waveform

Page 63: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

63

Acoustic phonetics and signals (21)

Page 64: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

64

Acoustic phonetics and signals (22)

FFT

Page 65: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

65

Acoustic phonetics and signals (23)

Page 66: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

66

Acoustic phonetics and signals (24)

The source-filter model

Page 67: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

67

Phonetic resources

Pronunciation dictionariesCELEX

CMUdict

PRONLEX

Phonetically annotated corpusEnglish: TIMIT, Switchboard, Buckeye

German: Kiel corpus

Japanese: CSJ

Mandarin: AS, NTU (Taiwan), CASS (China)

Phonetic softwardsPRAAT

Page 68: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

68

Advanced: articulatory and gestural phonology (1)

Articulatory phonology

Represents a speech utterance as a sequence of

potentially overlapping articulatory gestures

Advantages:

Gesture scores are likely to be much better hidden

states at capturing the continuous nature of speech than

a discrete sequence of phones

Help model the fine-grained effects of coarticulation of

neighboring gestures

Page 69: Phonetics Janice Fon Graduate Institute of Linguistics National Taiwan University

69

Advanced: articulatory and gestural phonology (2)