The Speech Chain (Denes Pinson, 1993)

Tasko SPPA 6010 Advanced Speech Science

The Speech Chain (Denes & Pinson, 1993)

What information is embedded within the speech acoustic signal?

Phonetic information Affective information Personal information Transmittal information Diagnostic Information

Branches of science employed to understand speech communicationPhysics Acoustics Aerodynamics Kinematics Dynamics

Biology Anatomy

Gross anatomy Microscopic anatomy Molecular biology Neuroimaging

Physiology Electrophysiology

Physical Quantities Basic vs. Derived Scalar vs. Vector Area Volume Displacement Velocity Acceleration Force

Pressure Work Power Intensity Resistance

Ohm’s Law (V=IR)

Speech anatomy as “tubes” and “valves”

Speech production is achieved through the systematic regulation of air pressures and flows within the lungs and vocal tract.

Source-Filter Theory of Speech Production

The sounds we hear as speech is the product of a sound source that has undergone filtering by the vocal tract

source and the filter may be considered to be independent of each other

Source-Filter Theory

Sound: Acoustics review What is sound? Graphic representation of sound Classifying sounds Filters Resonance The decibel

What is sound? It may be defined as the propagation of a

pressure wave in space and time. propagates through a medium

What is sound? Mass-spring model

Wave action of molecular motionTime

Distance

Amplitude waveform

Position

Amplitude waveform

Amplitude

Question: How long will this last?

Model of air molecule vibrationTime

Distance

a b c d

Simple Harmonic Motion: Sine Wave

Features Amplitude Period Frequency

Hz octave

Graphic representation of sound Time domain

Called a waveform Amplitude v. time

Frequency domain Called a spectrum Amplitude spectrum

amplitude vs. frequency Phase spectrum

phase vs. frequency May be measured using a

variety of “window” sizes

Spectrogram frequency v. amplitude v. time

Same sound, different graphs

Time domain

Frequency domain

From Hillenbrand

Are all sound waves simply sinusoids?NO! Waves can be summed Simple waves can combine to produce complex waves Fourier: French Mathematician:

Any complex waveform may be formed by summing sinusoids of various frequency, amplitude and phase

Fourier Analysis Provides a unique (only one) solution for a given sound signal Is reflected in the amplitude and phase spectrum of the signal Reveals the building blocks of complex waves, which are sinusoids

Classification of sounds Number of frequency components

Simple Complex

Relationship of frequency components Periodic Aperiodic

Duration Continuous Transient

Complex periodic sounds: Graphic appearance

From Hillenbrand

Complex periodic sounds: Graphic appearance

Brief Digression

Amplitude vs. Phase Spectrum

Amplitude spectrum: different

Phase spectrum: same

Amplitude vs. Phase Spectrum

Amplitude spectrum: same

Phase spectrum: different

Digression concluded

Aperiodic sounds: Graphic appearance

From Hillenbrand

What “class” of sound is speech?

The “envelope” of a sound wave Amplitude envelope Spectrum envelope

Amplitude envelope

From Hillenbrand

Spectrum envelope

From Hillenbrand

Amplitude Spectrum: Window Size “instantaneous” amplitude spectrum (long term) average amplitude spectrum

“Instantaneous” Amplitude Spectra

(Long Term) Average Amplitude Spectrum

The Spectrogram

Rotate90 degrees

Rotate it so thatThe amplitude isComing out of thepage

AThis is really narrow because it is a slice in time

Dark bands= amplitudePeaks

Two main types of spectrograms Wide-band spectrograms

Akin to spectrum envelopes “lined up” Frequency resolution not so sharp

Narrow-band spectrograms Akin to amplitude spectrums “lined up” Frequency resolution is really sharp

Highlights harmonic structure

Highlights spectrum envelope

Filters What is a filter? How are they relevant to speech? Frequency response curve Representing filter operation Types of filters

Frequency Response Curve (FRC)

Frequencylow high

Center frequency

lower cutofffrequency

upper cutoff frequency

passband

Operation of a filter on a signal

NOTE: Amplitude spectrum describes a soundFrequency response curve describes a filter

Source-Filter Theory revisited

Some frequency selective filtersLow-pass filtersHigh-pass filtersBand-pass filters

Resonance What is resonance? Free vibration Forced vibration Acoustic resonators Resonance and speech Resonators as frequency selective filters

Resonance and Speech

Resonators as frequency selective filters

Measuring signal amplitude Amplitude vs. loudness Sound intensity vs. sound pressure Decibel scale

Linear vs. logarithmic Absolute vs. relative Reference values Deriving the equations

The Speech Chain (Denes Pinson, 1993)

Documents

Agnes Denes - Projecting Public Space - Guide

Pinson TechCenterAnalysis

Stage 3 Pinson Mary Frances

Adam Pinson Glb

Agnes Denes: Tree Mountain Articles

Branches of phonetics - · PDF fileBranches of phonetics From Denes and Pinson The Speech Chain (acoustic) signal Acoustic phonetics studies the acoustic, physic characteristics of

Denes Kubicek - · PDF fileDenes Kubicek Oracle ACE ... Create Web 2.0 Applications using Apex By Denes Kubicek, ... table.taw10_Button1 td.taw10_R img

Design Code South Denes - Great Yarmouth

Baseball Challenge! Pinson Fieldtrip Challenge Questions!!!

Pinson, Powell,Sturgeon / Diversity Technology Project1 Poetics of Diversity Diversity technology project Education 301/ 02 Melissa Pinson Troy Powell

Maryam Farmand, Richard Celestre, Peter Denes, A. L. David

Fundamentals of Electricity Markets - Pierre Pinson\Fundamentals of Electricity Markets". An overview Pierre Pinson Technical University of Denmark. DTU Electrical Engineering - Centre

LING 520 Introduction to Phonetics I - Linguistics · LING 520 Introduction to Phonetics I Fall 2008 Week 1 ... • Phonetics is the study of speech sounds. (from Denes & Pinson,

[Denes Agay]the Joy of Classics

Repertório Denes Brito

[Denes Agay]the Joy of Boogie and Blues

Jane Setter University of Reading Tim Wharton Kingston ... · Denes, P. B. & Pinson, E. N. 1993. The Speech Chain: The physics and biology of spoken language (2nd edn.). New York:

Megan Maddox Elka Cupid Georgina Pinson. Past information of Hospital Information System by Georgina Pinson Present information of Hospital Information

Denes Martos - Fundamento de Politica

Infographic If you Only... - Iris Pinson