Upload
others
View
20
Download
0
Embed Size (px)
Citation preview
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Language and Computers (Ling 384)Topic 1: Text and Speech Encoding
Detmar Meurers∗
Dept. of Linguistics, OSUAutumn 2006
∗ The course was created together with Markus Dickinson and Chris Brew.
1 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Language and Computers – where to start?
I If we want to do anything with language, we need a wayto represent language.
I We can interact with the computer in several ways:I write or read textI speak or listen to speech
I Computer has to have some way to representI textI speech
2 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Language and Computers – where to start?
I If we want to do anything with language, we need a wayto represent language.
I We can interact with the computer in several ways:I write or read textI speak or listen to speech
I Computer has to have some way to representI textI speech
2 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Language and Computers – where to start?
I If we want to do anything with language, we need a wayto represent language.
I We can interact with the computer in several ways:I write or read textI speak or listen to speech
I Computer has to have some way to representI textI speech
2 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Outline
Writing systems
Encoding written language
Spoken language
Relating written and spoken language
3 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Outline
Writing systems
Encoding written language
Spoken language
Relating written and spoken language
3 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Outline
Writing systems
Encoding written language
Spoken language
Relating written and spoken language
3 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Outline
Writing systems
Encoding written language
Spoken language
Relating written and spoken language
3 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Writing systems used for human languages
What is writing?“a system of more or less permanent marks usedto represent an utterance in such a way that it canbe recovered more or less exactly without theintervention of the utterer.”(Peter T. Daniels, The World’s Writing Systems)
Different types of writing systems are used:
I AlphabeticI SyllabicI Logographic
Much of the information on writing systems and the graphics used aretaken from the amazing site http://www.omniglot.com.
4 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Writing systems used for human languages
What is writing?“a system of more or less permanent marks usedto represent an utterance in such a way that it canbe recovered more or less exactly without theintervention of the utterer.”(Peter T. Daniels, The World’s Writing Systems)
Different types of writing systems are used:
I AlphabeticI SyllabicI Logographic
Much of the information on writing systems and the graphics used aretaken from the amazing site http://www.omniglot.com.
4 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Alphabetic systems
Alphabets (phonemic alphabets)
I represent all sounds, i.e., consonants and vowelsI Examples: Etruscan, Latin, Korean, Cyrillic, Runic,
International Phonetic Alphabet
Abjads (consonant alphabets)
I represent consonants only (sometimes plus selectedvowels; vowel diacritics generally available)
I Examples: Arabic, Aramaic, Hebrew
5 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Alphabetic systems
Alphabets (phonemic alphabets)
I represent all sounds, i.e., consonants and vowelsI Examples: Etruscan, Latin, Korean, Cyrillic, Runic,
International Phonetic Alphabet
Abjads (consonant alphabets)
I represent consonants only (sometimes plus selectedvowels; vowel diacritics generally available)
I Examples: Arabic, Aramaic, Hebrew
5 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Alphabet example: FraserAn alphabet used to write Lisu, a Tibeto-Burman language spoken by
about 657,000 people in Myanmar, India, Thailand and in the Chinese
provinces of Yunnan and Sichuan.
(from: http://www.omniglot.com/writing/fraser.htm)
6 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Abjad example: PhoenicianAn abjad used to write Phoenician, created between the 18th and 17th
centuries BC; assumed to be the forerunner of the Greek and Hebrew
alphabet.
(from: http://www.omniglot.com/writing/phoenician.htm)
7 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
A note on the letter-sound correspondence
I Alphabets use letters to encode sounds (consonants,vowels).
I But the correspondence between spelling andpronounciation in many languages is quite complex,i.e., not a simple one-to-one correspondence.
I Example: English
I same spelling – different sounds: ought, cough, tough,through, though, hiccough
I silent letters: knee, knight, knife, debt, psychology,mortgage
I one letter – multiple sounds: exit, useI multiple letters – one sound: the, revolutionI alternate spellings: jail or gaol; but chef does not have
an alternative seagh (despite sure, dead, laugh)
8 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
A note on the letter-sound correspondence
I Alphabets use letters to encode sounds (consonants,vowels).
I But the correspondence between spelling andpronounciation in many languages is quite complex,i.e., not a simple one-to-one correspondence.
I Example: English
I same spelling – different sounds: ought, cough, tough,through, though, hiccough
I silent letters: knee, knight, knife, debt, psychology,mortgage
I one letter – multiple sounds: exit, useI multiple letters – one sound: the, revolutionI alternate spellings: jail or gaol; but chef does not have
an alternative seagh (despite sure, dead, laugh)
8 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
A note on the letter-sound correspondence
I Alphabets use letters to encode sounds (consonants,vowels).
I But the correspondence between spelling andpronounciation in many languages is quite complex,i.e., not a simple one-to-one correspondence.
I Example: English
I same spelling – different sounds: ought, cough, tough,through, though, hiccough
I silent letters: knee, knight, knife, debt, psychology,mortgage
I one letter – multiple sounds: exit, useI multiple letters – one sound: the, revolutionI alternate spellings: jail or gaol; but chef does not have
an alternative seagh (despite sure, dead, laugh)
8 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
A note on the letter-sound correspondence
I Alphabets use letters to encode sounds (consonants,vowels).
I But the correspondence between spelling andpronounciation in many languages is quite complex,i.e., not a simple one-to-one correspondence.
I Example: EnglishI same spelling – different sounds: ought, cough, tough,
through, though, hiccough
I silent letters: knee, knight, knife, debt, psychology,mortgage
I one letter – multiple sounds: exit, useI multiple letters – one sound: the, revolutionI alternate spellings: jail or gaol; but chef does not have
an alternative seagh (despite sure, dead, laugh)
8 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
A note on the letter-sound correspondence
I Alphabets use letters to encode sounds (consonants,vowels).
I But the correspondence between spelling andpronounciation in many languages is quite complex,i.e., not a simple one-to-one correspondence.
I Example: EnglishI same spelling – different sounds: ought, cough, tough,
through, though, hiccoughI silent letters: knee, knight, knife, debt, psychology,
mortgage
I one letter – multiple sounds: exit, useI multiple letters – one sound: the, revolutionI alternate spellings: jail or gaol; but chef does not have
an alternative seagh (despite sure, dead, laugh)
8 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
A note on the letter-sound correspondence
I Alphabets use letters to encode sounds (consonants,vowels).
I But the correspondence between spelling andpronounciation in many languages is quite complex,i.e., not a simple one-to-one correspondence.
I Example: EnglishI same spelling – different sounds: ought, cough, tough,
through, though, hiccoughI silent letters: knee, knight, knife, debt, psychology,
mortgageI one letter – multiple sounds: exit, use
I multiple letters – one sound: the, revolutionI alternate spellings: jail or gaol; but chef does not have
an alternative seagh (despite sure, dead, laugh)
8 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
A note on the letter-sound correspondence
I Alphabets use letters to encode sounds (consonants,vowels).
I But the correspondence between spelling andpronounciation in many languages is quite complex,i.e., not a simple one-to-one correspondence.
I Example: EnglishI same spelling – different sounds: ought, cough, tough,
through, though, hiccoughI silent letters: knee, knight, knife, debt, psychology,
mortgageI one letter – multiple sounds: exit, useI multiple letters – one sound: the, revolution
I alternate spellings: jail or gaol; but chef does not havean alternative seagh (despite sure, dead, laugh)
8 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
A note on the letter-sound correspondence
I Alphabets use letters to encode sounds (consonants,vowels).
I But the correspondence between spelling andpronounciation in many languages is quite complex,i.e., not a simple one-to-one correspondence.
I Example: EnglishI same spelling – different sounds: ought, cough, tough,
through, though, hiccoughI silent letters: knee, knight, knife, debt, psychology,
mortgageI one letter – multiple sounds: exit, useI multiple letters – one sound: the, revolutionI alternate spellings: jail or gaol; but chef does not have
an alternative seagh (despite sure, dead, laugh)
8 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
More examples for non-transparent letter-soundcorrespondences
French
(1) a. Versailles→ [veRsai]
b. ete, etais, etait, etaient → [ete]
Irish
(2) a. Baile A’tha Cliath (Dublin)→ [bl'a: kli uh]
b. samhradh (summer)→ [sauruh]
c. scri’obhaim (I write)→ [shgri:m]
What is the notation used within the []?
9 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
More examples for non-transparent letter-soundcorrespondences
French
(1) a. Versailles→ [veRsai]
b. ete, etais, etait, etaient → [ete]
Irish
(2) a. Baile A’tha Cliath (Dublin)→ [bl'a: kli uh]
b. samhradh (summer)→ [sauruh]
c. scri’obhaim (I write)→ [shgri:m]
What is the notation used within the []?
9 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
More examples for non-transparent letter-soundcorrespondences
French
(1) a. Versailles→ [veRsai]
b. ete, etais, etait, etaient → [ete]
Irish
(2) a. Baile A’tha Cliath (Dublin)→ [bl'a: kli uh]
b. samhradh (summer)→ [sauruh]
c. scri’obhaim (I write)→ [shgri:m]
What is the notation used within the []?
9 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
The International Phonetic Alphabet (IPA)
I Several special alphabets for representing sounds havebeen developed, the best known being the InternationalPhonetic Alphabet (IPA).
I The phonetic symbols are unambiguous:
I designed so that each speech sound gets its ownsymbol,
I eliminating the need for
I multiple symbols used to represent simple soundsI one symbol being used for multiple sounds.
I Interactive example chart: http://web.uvic.ca/ling/resources/ipa/charts/IPAlab/IPAlab.htm
10 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
The International Phonetic Alphabet (IPA)
I Several special alphabets for representing sounds havebeen developed, the best known being the InternationalPhonetic Alphabet (IPA).
I The phonetic symbols are unambiguous:I designed so that each speech sound gets its own
symbol,I eliminating the need for
I multiple symbols used to represent simple soundsI one symbol being used for multiple sounds.
I Interactive example chart: http://web.uvic.ca/ling/resources/ipa/charts/IPAlab/IPAlab.htm
10 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
The International Phonetic Alphabet (IPA)
I Several special alphabets for representing sounds havebeen developed, the best known being the InternationalPhonetic Alphabet (IPA).
I The phonetic symbols are unambiguous:I designed so that each speech sound gets its own
symbol,I eliminating the need for
I multiple symbols used to represent simple soundsI one symbol being used for multiple sounds.
I Interactive example chart: http://web.uvic.ca/ling/resources/ipa/charts/IPAlab/IPAlab.htm
10 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Syllabic systems
Syllabic alphabets (Alphasyllabaries)
I writing systems with symbols that represent aconsonant with a vowel, but the vowel can be changedby adding a diacritic (= a symbol added to the letter).
I Examples: Balinese, Javanese, Tibetan, Tamil, Thai,Tagalog(cf. also: http://www.omniglot.com/writing/syllabic.htm)
Syllabaries
I writing systems with separate symbols for each syllableof a language
I Examples: Cherokee. Ethiopic, Cypriot, Ojibwe,Hiragana (Japanese)(cf. also: http://www.omniglot.com/writing/syllabaries.htm#syll)
11 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Syllabary example: Cypriote
The Cypriot syllabary or Cypro-Minoan writing is thought to have
developed from the Linear A, or possibly the Linear B script of Crete,
though its exact origins are not known. It was used from about 800 to 200
BC.
(from: http://www.omniglot.com/writing/cypriot.htm)
12 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Syllabic alphabet example: Lao
Script developed in the 14th century to write the Lao language, based on
an early version of the Thai script, which was developed from the Old
Khmer script, which was itself based on Mon scripts.
Example for vowel diacritics around the letter k:
(from: http://www.omniglot.com/writing/lao.htm)
13 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Logographic writing systems
I Logographs (also called Logograms):I Pictographs (Pictograms): originally pictures of
things, now stylized and simplified.
Example: development of Chinese character horse:
I Ideographs (Ideograms): representations of abstractideas
I Compounds: combinations of two or more logographsI Semantic-phonetic compounds: symbols with a
meaning element (hints at meaning) and a phoneticelement (hints at pronunciation).
I Examples: Chinese (Zhongwen), Japanese (Nihongo),Mayan, Vietnamese, Ancient Egyptian
14 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Logographic writing systems
I Logographs (also called Logograms):I Pictographs (Pictograms): originally pictures of
things, now stylized and simplified.
Example: development of Chinese character horse:
I Ideographs (Ideograms): representations of abstractideas
I Compounds: combinations of two or more logographsI Semantic-phonetic compounds: symbols with a
meaning element (hints at meaning) and a phoneticelement (hints at pronunciation).
I Examples: Chinese (Zhongwen), Japanese (Nihongo),Mayan, Vietnamese, Ancient Egyptian
14 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Logographic writing systems
I Logographs (also called Logograms):I Pictographs (Pictograms): originally pictures of
things, now stylized and simplified.
Example: development of Chinese character horse:
I Ideographs (Ideograms): representations of abstractideas
I Compounds: combinations of two or more logographsI Semantic-phonetic compounds: symbols with a
meaning element (hints at meaning) and a phoneticelement (hints at pronunciation).
I Examples: Chinese (Zhongwen), Japanese (Nihongo),Mayan, Vietnamese, Ancient Egyptian
14 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Logographic writing systems
I Logographs (also called Logograms):I Pictographs (Pictograms): originally pictures of
things, now stylized and simplified.
Example: development of Chinese character horse:
I Ideographs (Ideograms): representations of abstractideas
I Compounds: combinations of two or more logographs
I Semantic-phonetic compounds: symbols with ameaning element (hints at meaning) and a phoneticelement (hints at pronunciation).
I Examples: Chinese (Zhongwen), Japanese (Nihongo),Mayan, Vietnamese, Ancient Egyptian
14 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Logographic writing systems
I Logographs (also called Logograms):I Pictographs (Pictograms): originally pictures of
things, now stylized and simplified.
Example: development of Chinese character horse:
I Ideographs (Ideograms): representations of abstractideas
I Compounds: combinations of two or more logographsI Semantic-phonetic compounds: symbols with a
meaning element (hints at meaning) and a phoneticelement (hints at pronunciation).
I Examples: Chinese (Zhongwen), Japanese (Nihongo),Mayan, Vietnamese, Ancient Egyptian
14 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Logographic writing systems
I Logographs (also called Logograms):I Pictographs (Pictograms): originally pictures of
things, now stylized and simplified.
Example: development of Chinese character horse:
I Ideographs (Ideograms): representations of abstractideas
I Compounds: combinations of two or more logographsI Semantic-phonetic compounds: symbols with a
meaning element (hints at meaning) and a phoneticelement (hints at pronunciation).
I Examples: Chinese (Zhongwen), Japanese (Nihongo),Mayan, Vietnamese, Ancient Egyptian
14 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Logograph writing system example: Chinese
Pictographs
Ideographs
Compounds of Pictographs/Ideographs
(from: http://www.omniglot.com/writing/chinese types.htm)
15 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Logograph writing system example: Chinese
Pictographs
Ideographs
Compounds of Pictographs/Ideographs
(from: http://www.omniglot.com/writing/chinese types.htm)
15 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Logograph writing system example: Chinese
Pictographs
Ideographs
Compounds of Pictographs/Ideographs
(from: http://www.omniglot.com/writing/chinese types.htm)
15 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Semantic-phonetic compounds
An example from Ancient Egyptian
(from: http://www.omniglot.com/writing/egyptian.htm)
16 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Semantic-phonetic compounds
An example from Ancient Egyptian
(from: http://www.omniglot.com/writing/egyptian.htm)
16 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Two writing systems with unusual realization
Tactile
I Braille is a writing system that makes it possible to readand write through touch; primarily used by the (partially)blind.
I It uses patterns of raised dots arranged in cells of up tosix dots in a 3 x 2 configuration.
I Each pattern represents a character, but some frequentwords and letter combinations have their own pattern.
Chromatographic
I The Benin and Edo people in southern Nigeria havedeveloped a system of writing based on different colorcombinations and symbols.
(cf. http://www.library.cornell.edu/africana/Writing Systems/Chroma.html)
17 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Braille alphabet
18 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Chromatographic system
19 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Relating writing systems to languages
I There is not a simple correspondence between awriting system and a language.
I For example, English uses the Roman alphabet, butArabic numerals (e.g., 3 and 4 instead of III and IV).
I We’ll look at three other examples:I JapaneseI KoreanI Azeri
20 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Relating writing systems to languages
I There is not a simple correspondence between awriting system and a language.
I For example, English uses the Roman alphabet, butArabic numerals (e.g., 3 and 4 instead of III and IV).
I We’ll look at three other examples:I JapaneseI KoreanI Azeri
20 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Japanese
Japanese: logographic system kanji, syllabary katakana,syllabary hiragana
I kanji: 5,000-10,000 borrowed Chinese characters
I katakanaI used mainly for non-Chinese loan words, onomatopoeic
words, foreign names, and for emphasisI hiragana
I originally used only by women (10th century), butcodified in 1946 with 48 syllables
I used mainly for word endings, kids’ books, and forwords with obscure kanji symbols
I romaji: Roman characters
21 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Japanese
Japanese: logographic system kanji, syllabary katakana,syllabary hiragana
I kanji: 5,000-10,000 borrowed Chinese charactersI katakana
I used mainly for non-Chinese loan words, onomatopoeicwords, foreign names, and for emphasis
I hiraganaI originally used only by women (10th century), but
codified in 1946 with 48 syllablesI used mainly for word endings, kids’ books, and for
words with obscure kanji symbols
I romaji: Roman characters
21 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Japanese
Japanese: logographic system kanji, syllabary katakana,syllabary hiragana
I kanji: 5,000-10,000 borrowed Chinese charactersI katakana
I used mainly for non-Chinese loan words, onomatopoeicwords, foreign names, and for emphasis
I hiraganaI originally used only by women (10th century), but
codified in 1946 with 48 syllablesI used mainly for word endings, kids’ books, and for
words with obscure kanji symbols
I romaji: Roman characters
21 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Japanese
Japanese: logographic system kanji, syllabary katakana,syllabary hiragana
I kanji: 5,000-10,000 borrowed Chinese charactersI katakana
I used mainly for non-Chinese loan words, onomatopoeicwords, foreign names, and for emphasis
I hiraganaI originally used only by women (10th century), but
codified in 1946 with 48 syllablesI used mainly for word endings, kids’ books, and for
words with obscure kanji symbols
I romaji: Roman characters
21 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Japanese example
The example uses kanji (red), hiragana (black), and katakana (blue):
Translation:
Capsule Hotel
A simple hotel where each room is capsule-shaped. When businessmen
miss the last train home, they can stay overnight very cheaply instead of
paying a lot of money to go home by taxi.
(from: http://www.omniglot.com/writing/japanese.htm#origin)
22 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Korean
“Korean writing is an alphabet, a syllabary and logographsall at once.” (http://home.vicnet.net.au/˜ozideas/writkor.htm)
I The hangul system was developed in 1444 during KingSejong’s reign.
I There are 24 letters: 14 consonants and 10 vowelsI But the letters are grouped into syllables, i.e. the letters
in a syllable are not written separately as in the Englishsystem, but together form a single character.E.g., “Hangeul” (from: http://www.omniglot.com/writing/korean.htm):
I In South Korea, hanja (logographic Chinese characters)are also used.
23 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Korean
“Korean writing is an alphabet, a syllabary and logographsall at once.” (http://home.vicnet.net.au/˜ozideas/writkor.htm)
I The hangul system was developed in 1444 during KingSejong’s reign.
I There are 24 letters: 14 consonants and 10 vowelsI But the letters are grouped into syllables, i.e. the letters
in a syllable are not written separately as in the Englishsystem, but together form a single character.E.g., “Hangeul” (from: http://www.omniglot.com/writing/korean.htm):
I In South Korea, hanja (logographic Chinese characters)are also used.
23 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Korean
“Korean writing is an alphabet, a syllabary and logographsall at once.” (http://home.vicnet.net.au/˜ozideas/writkor.htm)
I The hangul system was developed in 1444 during KingSejong’s reign.
I There are 24 letters: 14 consonants and 10 vowelsI But the letters are grouped into syllables, i.e. the letters
in a syllable are not written separately as in the Englishsystem, but together form a single character.E.g., “Hangeul” (from: http://www.omniglot.com/writing/korean.htm):
I In South Korea, hanja (logographic Chinese characters)are also used.
23 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Azeri
A Turkish language with speakers in Azerbaijan, northwestIran, and (former Soviet) Georgia
I 7th century until 1920s: Arabic scripts. Three differentArabic scripts used
I 1929: Latin alphabet enforced by Soviets to reduceIslamic influence.
I 1939: Cyrillic alphabet enforced by StalinI 1991: Back to Latin alphabet, but slightly different than
before.→ Latin typewriters and computer fonts were in greatdemand in 1991
24 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Azeri
A Turkish language with speakers in Azerbaijan, northwestIran, and (former Soviet) Georgia
I 7th century until 1920s: Arabic scripts. Three differentArabic scripts used
I 1929: Latin alphabet enforced by Soviets to reduceIslamic influence.
I 1939: Cyrillic alphabet enforced by StalinI 1991: Back to Latin alphabet, but slightly different than
before.→ Latin typewriters and computer fonts were in greatdemand in 1991
24 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Azeri
A Turkish language with speakers in Azerbaijan, northwestIran, and (former Soviet) Georgia
I 7th century until 1920s: Arabic scripts. Three differentArabic scripts used
I 1929: Latin alphabet enforced by Soviets to reduceIslamic influence.
I 1939: Cyrillic alphabet enforced by Stalin
I 1991: Back to Latin alphabet, but slightly different thanbefore.→ Latin typewriters and computer fonts were in greatdemand in 1991
24 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Azeri
A Turkish language with speakers in Azerbaijan, northwestIran, and (former Soviet) Georgia
I 7th century until 1920s: Arabic scripts. Three differentArabic scripts used
I 1929: Latin alphabet enforced by Soviets to reduceIslamic influence.
I 1939: Cyrillic alphabet enforced by StalinI 1991: Back to Latin alphabet, but slightly different than
before.→ Latin typewriters and computer fonts were in greatdemand in 1991
24 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Comparison of writing systems
What are the pros and cons of each type of system?
I accuracy: Can every word be written down accurately?I learnability: How long does it take to learn the system?I cognitive ability: Are some systems unnatural? (e.g.
Does dyslexia show that alphabets are unnatural?)I language-particular differences: English has thousands
of possible syllables; Japanese has very few incomparison
I connection to history/culture: Will changing a writingsystem have social consequences?
25 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Comparison of writing systems
What are the pros and cons of each type of system?
I accuracy: Can every word be written down accurately?
I learnability: How long does it take to learn the system?I cognitive ability: Are some systems unnatural? (e.g.
Does dyslexia show that alphabets are unnatural?)I language-particular differences: English has thousands
of possible syllables; Japanese has very few incomparison
I connection to history/culture: Will changing a writingsystem have social consequences?
25 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Comparison of writing systems
What are the pros and cons of each type of system?
I accuracy: Can every word be written down accurately?I learnability: How long does it take to learn the system?
I cognitive ability: Are some systems unnatural? (e.g.Does dyslexia show that alphabets are unnatural?)
I language-particular differences: English has thousandsof possible syllables; Japanese has very few incomparison
I connection to history/culture: Will changing a writingsystem have social consequences?
25 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Comparison of writing systems
What are the pros and cons of each type of system?
I accuracy: Can every word be written down accurately?I learnability: How long does it take to learn the system?I cognitive ability: Are some systems unnatural? (e.g.
Does dyslexia show that alphabets are unnatural?)
I language-particular differences: English has thousandsof possible syllables; Japanese has very few incomparison
I connection to history/culture: Will changing a writingsystem have social consequences?
25 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Comparison of writing systems
What are the pros and cons of each type of system?
I accuracy: Can every word be written down accurately?I learnability: How long does it take to learn the system?I cognitive ability: Are some systems unnatural? (e.g.
Does dyslexia show that alphabets are unnatural?)I language-particular differences: English has thousands
of possible syllables; Japanese has very few incomparison
I connection to history/culture: Will changing a writingsystem have social consequences?
25 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Comparison of writing systems
What are the pros and cons of each type of system?
I accuracy: Can every word be written down accurately?I learnability: How long does it take to learn the system?I cognitive ability: Are some systems unnatural? (e.g.
Does dyslexia show that alphabets are unnatural?)I language-particular differences: English has thousands
of possible syllables; Japanese has very few incomparison
I connection to history/culture: Will changing a writingsystem have social consequences?
25 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Encoding written language
I Information on a computer is stored in bits.I A bit is either on (= 1, yes) or off (= 0, no).
I A list of 8 bits makes up a byte, e.g., 01001010I Just like with the base 10 numbers we’re used to, the
order of the bits in a byte matters:I Big Endian: most important bit is leftmost (the standard
way of doing things)I The positions in a byte thus encode: 128 64 32 16 8 4 2
1I “There are 10 kinds of people in the world; those who
know binary and those who don’t”(from: http://www.wlug.org.nz/LittleEndian)
I Little Endian: most important bit is rightmost (onlyused on Intel machines)
I The positions in a byte thus encode: 1 2 4 8 16 32 64128
26 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Encoding written language
I Information on a computer is stored in bits.I A bit is either on (= 1, yes) or off (= 0, no).I A list of 8 bits makes up a byte, e.g., 01001010I Just like with the base 10 numbers we’re used to, the
order of the bits in a byte matters:I Big Endian: most important bit is leftmost (the standard
way of doing things)I The positions in a byte thus encode: 128 64 32 16 8 4 2
1I “There are 10 kinds of people in the world; those who
know binary and those who don’t”(from: http://www.wlug.org.nz/LittleEndian)
I Little Endian: most important bit is rightmost (onlyused on Intel machines)
I The positions in a byte thus encode: 1 2 4 8 16 32 64128
26 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Converting decimal numbers to binary - TabularMethod
Using the first 4 bits, we want to know how to write 10 in bit(or binary) notation.
8 4 2 1? ? ? ?
8 < 10 ? ? ?1 8 + 4 = 12 > 10 ? ?1 0 8 + 2 = 10 = 10 ?1 0 1 0
27 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Converting decimal numbers to binary - TabularMethod
Using the first 4 bits, we want to know how to write 10 in bit(or binary) notation.
8 4 2 1? ? ? ?8 < 10 ? ? ?
1 8 + 4 = 12 > 10 ? ?1 0 8 + 2 = 10 = 10 ?1 0 1 0
27 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Converting decimal numbers to binary - TabularMethod
Using the first 4 bits, we want to know how to write 10 in bit(or binary) notation.
8 4 2 1? ? ? ?8 < 10 ? ? ?1 8 + 4 = 12 > 10 ? ?
1 0 8 + 2 = 10 = 10 ?1 0 1 0
27 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Converting decimal numbers to binary - TabularMethod
Using the first 4 bits, we want to know how to write 10 in bit(or binary) notation.
8 4 2 1? ? ? ?8 < 10 ? ? ?1 8 + 4 = 12 > 10 ? ?1 0 8 + 2 = 10 = 10 ?
1 0 1 0
27 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Converting decimal numbers to binary - TabularMethod
Using the first 4 bits, we want to know how to write 10 in bit(or binary) notation.
8 4 2 1? ? ? ?8 < 10 ? ? ?1 8 + 4 = 12 > 10 ? ?1 0 8 + 2 = 10 = 10 ?1 0 1 0
27 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Converting decimal numbers to binary - DivisionMethod
Decimal Remainder? Binary10/2 = 5 no 0
5/2 = 2 yes 102/2 = 1 no 0101/2 = 0 yes 1010
28 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Converting decimal numbers to binary - DivisionMethod
Decimal Remainder? Binary10/2 = 5 no 05/2 = 2 yes 10
2/2 = 1 no 0101/2 = 0 yes 1010
28 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Converting decimal numbers to binary - DivisionMethod
Decimal Remainder? Binary10/2 = 5 no 05/2 = 2 yes 102/2 = 1 no 010
1/2 = 0 yes 1010
28 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Converting decimal numbers to binary - DivisionMethod
Decimal Remainder? Binary10/2 = 5 no 05/2 = 2 yes 102/2 = 1 no 0101/2 = 0 yes 1010
28 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Converting decimal numbers to binary - DivisionMethod
Decimal Remainder? Binary10/2 = 5 no 05/2 = 2 yes 102/2 = 1 no 0101/2 = 0 yes 1010
28 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Using bytes to store characters
With 8 bits (a single byte), you can represent 256 differentcharacters. Why would we want so many?
I If you look at a keyboard, you will find lots ofnon-English characters.
I With 256 possible characters, we can store every singleletter used in English, plus all the things like commas,periods, space bar, percent sign (%), back space, andso on.
29 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Using bytes to store characters
With 8 bits (a single byte), you can represent 256 differentcharacters. Why would we want so many?
I If you look at a keyboard, you will find lots ofnon-English characters.
I With 256 possible characters, we can store every singleletter used in English, plus all the things like commas,periods, space bar, percent sign (%), back space, andso on.
29 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
An encoding standard: ASCII
I ASCII = the American Standard Code for InformationInterchange
I 7-bit code for storing English textI 7 bits = 128 possible characters.I The numeric order reflects alphabetic ordering.
30 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
The ASCII chartCodes 1–31 are used for control characters (backspace, linefeed, tab, . . . ).
3233 !34 “35 #36 $37 %38 &39 ’40 (41 )42 *43 +44 ,45 -46 .47 /
48 049 150 251 352 453 554 655 756 857 958 :59 ;60 <61 =62 >63 ?64 @
65 A66 B67 C68 D69 E70 F71 G72 H73 I74 J75 K76 L77 M78 N79 O80 P81 Q
82 R83 S84 T85 U86 V87 W88 X89 Y90 Z91 [92 \93 ]94 ^95 _96 ‘
97 a98 b99 c100 d101 e102 f103 g104 h105 i106 j107 k108 l109 m110 n111 o112 p113 q
114 r115 s116 t117 u118 v119 w120 x121 y122 z123 {124 —125 }126 ˜127 DEL
31 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
E-mail issues
I Have you ever had something like the following at thetop of an e-mail sent to you?[The following text is in the ‘‘ISO-8859-1’’ character set.]
[Your display is set for the ‘‘US-ASCII’’ character set. ]
[Some characters may be displayed incorrectly. ]
I Mail sent on the internet used to only be able to transferthe 7-bit ASCII messages. But now we can detect theincoming character set and adjust the input.
I Note that this is an example of meta-information =information which is printed as part of the regularmessage, but tells us something about that message.
32 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
E-mail issues
I Have you ever had something like the following at thetop of an e-mail sent to you?[The following text is in the ‘‘ISO-8859-1’’ character set.]
[Your display is set for the ‘‘US-ASCII’’ character set. ]
[Some characters may be displayed incorrectly. ]
I Mail sent on the internet used to only be able to transferthe 7-bit ASCII messages. But now we can detect theincoming character set and adjust the input.
I Note that this is an example of meta-information =information which is printed as part of the regularmessage, but tells us something about that message.
32 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
E-mail issues
I Have you ever had something like the following at thetop of an e-mail sent to you?[The following text is in the ‘‘ISO-8859-1’’ character set.]
[Your display is set for the ‘‘US-ASCII’’ character set. ]
[Some characters may be displayed incorrectly. ]
I Mail sent on the internet used to only be able to transferthe 7-bit ASCII messages. But now we can detect theincoming character set and adjust the input.
I Note that this is an example of meta-information =information which is printed as part of the regularmessage, but tells us something about that message.
32 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Multipurpose Internet Mail Extensions (MIME)
MIME provides meta-information on the text, which tells us:
I which version of MIME is being usedI what the charcter set isI if that character set was altered, how it was altered
Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: 7bit
33 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Multipurpose Internet Mail Extensions (MIME)
MIME provides meta-information on the text, which tells us:
I which version of MIME is being usedI what the charcter set isI if that character set was altered, how it was altered
Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: 7bit
33 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Different coding systems
But wait, didn’t we want to be able to encode all languages?There are ways ...
I Extend the ASCII system with various other systems,for example:
I ISO 8859-1: includes extra letters needed for French,German, Spanish, etc.
I ISO 8859-7: Greek alphabetI ISO 8859-8: Hebrew alphabetI JIS X 0208: Japanese characters
I Have one system for everything→ Unicode
34 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Different coding systems
But wait, didn’t we want to be able to encode all languages?There are ways ...
I Extend the ASCII system with various other systems,for example:
I ISO 8859-1: includes extra letters needed for French,German, Spanish, etc.
I ISO 8859-7: Greek alphabetI ISO 8859-8: Hebrew alphabetI JIS X 0208: Japanese characters
I Have one system for everything→ Unicode
34 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Different coding systems
But wait, didn’t we want to be able to encode all languages?There are ways ...
I Extend the ASCII system with various other systems,for example:
I ISO 8859-1: includes extra letters needed for French,German, Spanish, etc.
I ISO 8859-7: Greek alphabetI ISO 8859-8: Hebrew alphabetI JIS X 0208: Japanese characters
I Have one system for everything→ Unicode
34 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Unicode
Problems with having multiple encoding systems:
I Conflicts: two encodings can use the same number fortwo different characters and use different numbers forthe same character.
I Hassle: have to install many, many systems if you wantto be able to deal with various languages
Unicode tries to fix that by having a single representation forevery possible character.
“Unicode provides a unique number for everycharacter, no matter what the platform, no matterwhat the program, no matter what the language.”(www.unicode.org)
35 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Unicode
Problems with having multiple encoding systems:
I Conflicts: two encodings can use the same number fortwo different characters and use different numbers forthe same character.
I Hassle: have to install many, many systems if you wantto be able to deal with various languages
Unicode tries to fix that by having a single representation forevery possible character.
“Unicode provides a unique number for everycharacter, no matter what the platform, no matterwhat the program, no matter what the language.”(www.unicode.org)
35 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
How big is Unicode?
Version 3.2 has codes for 95,221 characters from alphabets,syllabaries and logographic systems.
I Uses 32 bits – meaning we can store232 = 4, 294, 967, 296 characters.
I 4 billion possibilities for each character? That takes a lotof space on the computer!
36 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Compact encoding of Unicode characters
I Unicode has three versionsI UTF-32 (32 bits): direct representationI UTF-16 (16 bits): 216 = 65536I UTF-8 (8 bits): 28 = 256
I How is it possible to encode 232 possibilities in 8 bits(UTF-8)?
I Several bytes are used to represent one character.I Use the highest bit as flag:
I highest bit 0: single characterI highest bit 1: part of a multi byte character
I Nice consequence: ASCII text is in a valid UTF-8encoding.
37 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
How do we type everything in?
I Use a keyboard tailored to your specific languagee.g. Highly noticeable how much slower your Englishtyping is when using a Danish-designed keyboard.
I Use a processor that allows you to switch betweendifferent character systems.e.g. Type in Cyrillic characters on your Englishkeyboard.
I Use combinations of characters.An e followed by an ’ might result in an e
I Pick and choose from a table of characters.
So, now we can encode every language, as long as it’swritten.
38 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
How do we type everything in?
I Use a keyboard tailored to your specific languagee.g. Highly noticeable how much slower your Englishtyping is when using a Danish-designed keyboard.
I Use a processor that allows you to switch betweendifferent character systems.e.g. Type in Cyrillic characters on your Englishkeyboard.
I Use combinations of characters.An e followed by an ’ might result in an e
I Pick and choose from a table of characters.
So, now we can encode every language, as long as it’swritten.
38 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
How do we type everything in?
I Use a keyboard tailored to your specific languagee.g. Highly noticeable how much slower your Englishtyping is when using a Danish-designed keyboard.
I Use a processor that allows you to switch betweendifferent character systems.e.g. Type in Cyrillic characters on your Englishkeyboard.
I Use combinations of characters.An e followed by an ’ might result in an e
I Pick and choose from a table of characters.
So, now we can encode every language, as long as it’swritten.
38 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
How do we type everything in?
I Use a keyboard tailored to your specific languagee.g. Highly noticeable how much slower your Englishtyping is when using a Danish-designed keyboard.
I Use a processor that allows you to switch betweendifferent character systems.e.g. Type in Cyrillic characters on your Englishkeyboard.
I Use combinations of characters.An e followed by an ’ might result in an e
I Pick and choose from a table of characters.
So, now we can encode every language, as long as it’swritten.
38 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Unwritten languages
Many languages have never been written down. Of the 6700spoken, 3000 have never been written down.
I Salar, a Turkic language in China.I Gugu Badhun, a language in Australia.I Southeastern Pomo, a language in California
39 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
The need for speech
I What if we want to work with an unwritten language?I What if we want to examine the way someone talks and
don’t have time to write it down?
Many applications for encoding speech:I Building spoken dialogue systems, i.e. speak with a
computer (and have it speak back).I Helping people sound like native speakers of a foreign
language.I Helping speech pathologists diagnose problems
40 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
The need for speech
I What if we want to work with an unwritten language?I What if we want to examine the way someone talks and
don’t have time to write it down?
Many applications for encoding speech:I Building spoken dialogue systems, i.e. speak with a
computer (and have it speak back).I Helping people sound like native speakers of a foreign
language.I Helping speech pathologists diagnose problems
40 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
What does speech look like?
We can transcribe (write down) the speech into a phoneticalphabet.
I It is very expensive and time-consuming to havehumans do all the transcription.
I To automatically transcribe, we need to know how torelate the audio file to the individual sounds that wehear.⇒We need to know:
I some properties of speechI how to measure these speech propertiesI how these measurements correspond to sounds we
hear
41 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
What does speech look like?
We can transcribe (write down) the speech into a phoneticalphabet.
I It is very expensive and time-consuming to havehumans do all the transcription.
I To automatically transcribe, we need to know how torelate the audio file to the individual sounds that wehear.
⇒We need to know:I some properties of speechI how to measure these speech propertiesI how these measurements correspond to sounds we
hear
41 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
What does speech look like?
We can transcribe (write down) the speech into a phoneticalphabet.
I It is very expensive and time-consuming to havehumans do all the transcription.
I To automatically transcribe, we need to know how torelate the audio file to the individual sounds that wehear.⇒We need to know:
I some properties of speechI how to measure these speech propertiesI how these measurements correspond to sounds we
hear
41 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
What makes representing speech hard?
Difficulties:
I People have different dialects and different size vocaltracts and thus say things differently
I Sounds run together, and it’s hard to tell where onesound ends and another begins.
I What we think of as one sound is not always (usually)said the same: coarticulation = sounds affecting theway neighboring sounds are saide.g. k is said differently depending on if it is followed byee or by oo.
I What we think of as two sounds are not always all thatdifferent.e.g. The s see is very acoustically similar to the sh inshoe
42 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
What makes representing speech hard?
Difficulties:
I People have different dialects and different size vocaltracts and thus say things differently
I Sounds run together, and it’s hard to tell where onesound ends and another begins.
I What we think of as one sound is not always (usually)said the same: coarticulation = sounds affecting theway neighboring sounds are saide.g. k is said differently depending on if it is followed byee or by oo.
I What we think of as two sounds are not always all thatdifferent.e.g. The s see is very acoustically similar to the sh inshoe
42 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
What makes representing speech hard?
Difficulties:
I People have different dialects and different size vocaltracts and thus say things differently
I Sounds run together, and it’s hard to tell where onesound ends and another begins.
I What we think of as one sound is not always (usually)said the same: coarticulation = sounds affecting theway neighboring sounds are saide.g. k is said differently depending on if it is followed byee or by oo.
I What we think of as two sounds are not always all thatdifferent.e.g. The s see is very acoustically similar to the sh inshoe
42 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
What makes representing speech hard?
Difficulties:
I People have different dialects and different size vocaltracts and thus say things differently
I Sounds run together, and it’s hard to tell where onesound ends and another begins.
I What we think of as one sound is not always (usually)said the same: coarticulation = sounds affecting theway neighboring sounds are saide.g. k is said differently depending on if it is followed byee or by oo.
I What we think of as two sounds are not always all thatdifferent.e.g. The s see is very acoustically similar to the sh inshoe
42 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Articulatory properties: How it’s produced
We could talk about how sounds are produced in the vocaltract, i.e. articulatory phonetics
I place of articulation (where): [t] vs. [k]I manner of articulation (how): [t] vs. [s]I voicing (vocal cord vibration): [t] vs. [d]
But unless the computer is modeling a vocal tract, we needto know acoustic properties of speech which we canquantify.
43 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Articulatory properties: How it’s produced
We could talk about how sounds are produced in the vocaltract, i.e. articulatory phonetics
I place of articulation (where): [t] vs. [k]I manner of articulation (how): [t] vs. [s]I voicing (vocal cord vibration): [t] vs. [d]
But unless the computer is modeling a vocal tract, we needto know acoustic properties of speech which we canquantify.
43 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Articulatory properties: How it’s produced
We could talk about how sounds are produced in the vocaltract, i.e. articulatory phonetics
I place of articulation (where): [t] vs. [k]I manner of articulation (how): [t] vs. [s]I voicing (vocal cord vibration): [t] vs. [d]
But unless the computer is modeling a vocal tract, we needto know acoustic properties of speech which we canquantify.
43 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Acoustic properties: What it sounds like
Sound waves = “small variations in air pressure that occurvery rapidly one after another” (Ladefoged, A Course inPhonetics)⇒ Akin to ripples in a pond
I speech flow = rate of speaking, number and length ofpauses (seconds)
I loudness (amplitude) = amount of energy (decibels)I frequencies = how fast the sound waves are repeating
(cycles per second, i.e. Hertz)I pitch = how high or low a sound isI In speech, there is a fundamental frequency, or pitch,
along with higher-frequency overtones.
I intonation = rise and fall in pitch
44 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Oscillogram (Waveform)
(Check out the Speech Analysis Tutorial, of the Deptartment of Linguistics at Lund University, Sweden at
http://www.ling.lu.se/research/speechtutorial/tutorial.html, from which the illustrations on this and the following
slides are taken.)
45 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Oscillogram (Waveform)
(Check out the Speech Analysis Tutorial, of the Deptartment of Linguistics at Lund University, Sweden at
http://www.ling.lu.se/research/speechtutorial/tutorial.html, from which the illustrations on this and the following
slides are taken.)
45 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Fundamental frequency (F0, pitch)
46 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Fundamental frequency (F0, pitch)
46 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Spectrograms
Spectrogram = a graph to represent (the frequencies of)speech over time.
47 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Spectrograms
Spectrogram = a graph to represent (the frequencies of)speech over time.
47 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
How measurements correspond to sounds wehear
I How dark is the picture? → How loud is the sound?We can measure this in decibels.
I Where are the lines the darkest? →Which frequenciesare the loudest and most important?We can measure this in terms of Hertz, and it tells uswhat the vowels are.
I How do these dark lines change? → How are thefrequencies changing over time?Which consonants are we transitioning into?
48 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
How measurements correspond to sounds wehear
I How dark is the picture? → How loud is the sound?We can measure this in decibels.
I Where are the lines the darkest? →Which frequenciesare the loudest and most important?We can measure this in terms of Hertz, and it tells uswhat the vowels are.
I How do these dark lines change? → How are thefrequencies changing over time?Which consonants are we transitioning into?
48 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
How measurements correspond to sounds wehear
I How dark is the picture? → How loud is the sound?We can measure this in decibels.
I Where are the lines the darkest? →Which frequenciesare the loudest and most important?We can measure this in terms of Hertz, and it tells uswhat the vowels are.
I How do these dark lines change? → How are thefrequencies changing over time?Which consonants are we transitioning into?
48 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
How did we get these measurements?
sampling rate = how many times in a given second weextract a moment of sound; measured in samples persecond
I Sound is continuous, but we have to store data in adiscrete manner.
CONTINUOUS DISCRETE
I We store data at each discrete point, in order to capturethe general pattern of the sound
49 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
How did we get these measurements?
sampling rate = how many times in a given second weextract a moment of sound; measured in samples persecond
I Sound is continuous, but we have to store data in adiscrete manner.
CONTINUOUS DISCRETE
I We store data at each discrete point, in order to capturethe general pattern of the sound
49 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Sampling rate
I The sampling rate is often 8000 or 16,000 samples persecond. The rate for CDs is 44,100 samples/second (orHertz (Hz))
I The higher the sampling rate, the better quality therecording ... but the more space it takes.
I Speech needs at least 8000 samples/second, but mostlikely 16,000 or 22,050 Hz will be used nowadays.
50 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Sampling rate
I The sampling rate is often 8000 or 16,000 samples persecond. The rate for CDs is 44,100 samples/second (orHertz (Hz))
I The higher the sampling rate, the better quality therecording ... but the more space it takes.
I Speech needs at least 8000 samples/second, but mostlikely 16,000 or 22,050 Hz will be used nowadays.
50 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Sampling rate
I The sampling rate is often 8000 or 16,000 samples persecond. The rate for CDs is 44,100 samples/second (orHertz (Hz))
I The higher the sampling rate, the better quality therecording ... but the more space it takes.
I Speech needs at least 8000 samples/second, but mostlikely 16,000 or 22,050 Hz will be used nowadays.
50 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Applications of speech encoding
Mapping sounds to symbols (alphabet), and vice versa, isn’tall that easy.
I Automatic Speech Recognition (ASR): sounds to textI Text-to-Speech Synthesis (TTS): texts to sounds
51 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Automatic Speech Recognition (ASR)
Automatic speech recognition = process by which thecomputer maps a speech signal to text.
Uses/Applications:
I DictationI Telephone conversationsI People with disabilities – e.g. a person hard of hearing
could use an ASR system to get the text
52 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Automatic Speech Recognition (ASR)
Automatic speech recognition = process by which thecomputer maps a speech signal to text.Uses/Applications:
I DictationI Telephone conversationsI People with disabilities – e.g. a person hard of hearing
could use an ASR system to get the text
52 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Kinds of ASR systems
Different kinds of systems:
I Speaker dependent = work for a single speakerI Speaker independent = work for any speaker of a given
variety of a language, e.g. American EnglishI Speaker adaptive = start as independent but begin to
adapt to a single speaker to improve accuracy
53 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Kinds of ASR systems
I Differing sizes of vocabularies, from tens of words totens of thousands of words
I continuous speech vs. isolated-word systems:I continuous speech systems = words connected
together and not separated by pausesI isolated-word systems = single words recognized at a
time, requiring pauses to be inserted between words→ easier to find the endpoints of words
54 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Kinds of ASR systems
I Differing sizes of vocabularies, from tens of words totens of thousands of words
I continuous speech vs. isolated-word systems:I continuous speech systems = words connected
together and not separated by pausesI isolated-word systems = single words recognized at a
time, requiring pauses to be inserted between words→ easier to find the endpoints of words
54 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Steps in an ASR system
1. Digital sampling of speech
2. Acoustic signal processing = converting the speechsamples into particular measurable units
3. Recognition of sounds, groups of sounds, and words
May or may not use more sophisticated analysis of theutterance to help.
55 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Steps in an ASR system
1. Digital sampling of speech
2. Acoustic signal processing = converting the speechsamples into particular measurable units
3. Recognition of sounds, groups of sounds, and words
May or may not use more sophisticated analysis of theutterance to help.
55 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Steps in an ASR system
1. Digital sampling of speech
2. Acoustic signal processing = converting the speechsamples into particular measurable units
3. Recognition of sounds, groups of sounds, and words
May or may not use more sophisticated analysis of theutterance to help.
55 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Steps in an ASR system
1. Digital sampling of speech
2. Acoustic signal processing = converting the speechsamples into particular measurable units
3. Recognition of sounds, groups of sounds, and words
May or may not use more sophisticated analysis of theutterance to help.
55 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Text-to-Speech Synthesis (TTS)
Could just record a voice saying phrases or words and thenplay back those words in the appropriate order.Or can break the text down into smaller units
1. Convert input text into phonetic alphabet2. Synthesize phonetic characters into speech
To synthesize characters into speech, people have tried:
I using formulas which adjust the values of thefrequencies, the loudness, etc.
I using a model of the vocal tract and trying to producesounds based on how a human would speak
56 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Text-to-Speech Synthesis (TTS)
Could just record a voice saying phrases or words and thenplay back those words in the appropriate order.Or can break the text down into smaller units
1. Convert input text into phonetic alphabet2. Synthesize phonetic characters into speech
To synthesize characters into speech, people have tried:
I using formulas which adjust the values of thefrequencies, the loudness, etc.
I using a model of the vocal tract and trying to producesounds based on how a human would speak
56 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
It’s hard to be natural
When trying to make synthesized speech sound natural, weencounter the same problems as what makes speechencoding in general hard:
I The same sound is said differently in different contexts.I Different sounds are sometimes said nearly the same.I Different sentences have different intonation patterns.I Lengths of words vary depending on where in the
sentence they are spoken.The car crashed into the tree.It’s my car.Cars, trucks, and bikes are vehicles.
57 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Speech to Text to Speech
If we convert speech to text and then back to speech, itshould sound the same, right?
I But at the conversion stages, there is information loss.To avoid this loss would require a lot of memory andknowledge about what exact information to store.
I The process is thus irreversible.
58 / 59
Language andComputers
Topic 1: Text andSpeech Encoding
Writing systemsAlphabetic
Syllabic
Logographic
Systems with unusualrealization
Relation to language
Comparison of systems
Encoding writtenlanguageASCII
Unicode
Typing it in
Spoken languageTranscription
Why speech is hard torepresent
Articulation
Acoustics
Relating written andspoken languageFrom Speech to Text
From Text to Speech
Demos
Text-to-Speech
I AT&T mulitilingual TTS system:http://www.research.att.com/projects/tts/demo.php
I Nuance Realspeak:http://www.nuance.com/realspeak/demo/default.asp
I various systems and languages:http://www.ims.uni-stuttgart.de/˜moehler/synthspeech/
59 / 59