23
DOCUMENT RESUME ED 335 901 FL 019 374 AUTHOR Ching, Teresa TITLE Tones for Profoundly Deaf Tone-Language Speakers. PUB DATE Aug 90 NOTE 23p.; In: CUHK Papers in Linguistics, No. 2. p1-22, Aug 1990; see FL 019 373. PUB TYPE Speeches/Conference Papers (150) EDRS PRICE MF01/PC01 Plus Postage. DESCRIPTORS Classroom Techniques; Comparative Analysis; *Deafness; Elementary Secondary Education; Foreign Countrien; Hearing Aids; Instructional Effectiveness; *Intonation; Language Research; Language Tests; Linguistic Theory; *Lipreading; Skill Development; Testing; *Tone Languages; Videotape Recordings; *Visual Perception ABSTRACT A study assessed the practical use of the simplified speech pattern approach to teaching lipreading in a tone language by comparing performance using an acoustic hearing-aid and a Sivo-aid in a tone labelling task. After initial assessment, subjects were given training to enhance perception of lexically contrastive tones, then post-tested. The test used was audio-video recorded test material in Cantonese used to assess speech receptive ability, which includes a tonal component. For each subject, visual stimuli were presented, some accompanied by an auditory signal (either speech tone or larynx tone) through either acoustic hearing aids car a Sivo-aid. One treatment used iipreading alone. Subjects in the experimental group were foul profoundly deaf children; all of their deaf classmates served as a control group. Results indicated that the auditory signal contributes to tonal reception more effectively using the Sivo-aid, but some variation still occurred. It is concluded that the simplification approach allows a better match to the user's hearing capabilities, making better use ol residual hearing, and allows gradual development of perceptual skills relating to suprasegmentals as well as segmentals. (MSE) *********************************************************************** Reproductions supplied by EDRS are the best that can be made from the original document. ***********************************************************************

DOCUMENT RESUME ED 335 901 FL 019 374 AUTHOR TITLE PUB ... · for example, O'Connor. and Arnold, 1965). The production of tonal contrasts relates primarily to the speaker's control

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: DOCUMENT RESUME ED 335 901 FL 019 374 AUTHOR TITLE PUB ... · for example, O'Connor. and Arnold, 1965). The production of tonal contrasts relates primarily to the speaker's control

DOCUMENT RESUME

ED 335 901 FL 019 374

AUTHOR Ching, TeresaTITLE Tones for Profoundly Deaf Tone-Language Speakers.PUB DATE Aug 90NOTE 23p.; In: CUHK Papers in Linguistics, No. 2. p1-22,

Aug 1990; see FL 019 373.PUB TYPE Speeches/Conference Papers (150)

EDRS PRICE MF01/PC01 Plus Postage.DESCRIPTORS Classroom Techniques; Comparative Analysis;

*Deafness; Elementary Secondary Education; ForeignCountrien; Hearing Aids; Instructional Effectiveness;*Intonation; Language Research; Language Tests;Linguistic Theory; *Lipreading; Skill Development;Testing; *Tone Languages; Videotape Recordings;*Visual Perception

ABSTRACT

A study assessed the practical use of the simplifiedspeech pattern approach to teaching lipreading in a tone language bycomparing performance using an acoustic hearing-aid and a Sivo-aid ina tone labelling task. After initial assessment, subjects were giventraining to enhance perception of lexically contrastive tones, thenpost-tested. The test used was audio-video recorded test material inCantonese used to assess speech receptive ability, which includes atonal component. For each subject, visual stimuli were presented,some accompanied by an auditory signal (either speech tone or larynxtone) through either acoustic hearing aids car a Sivo-aid. Onetreatment used iipreading alone. Subjects in the experimental groupwere foul profoundly deaf children; all of their deaf classmatesserved as a control group. Results indicated that the auditory signalcontributes to tonal reception more effectively using the Sivo-aid,but some variation still occurred. It is concluded that thesimplification approach allows a better match to the user's hearingcapabilities, making better use ol residual hearing, and allowsgradual development of perceptual skills relating to suprasegmentalsas well as segmentals. (MSE)

***********************************************************************Reproductions supplied by EDRS are the best that can be made

from the original document.***********************************************************************

Page 2: DOCUMENT RESUME ED 335 901 FL 019 374 AUTHOR TITLE PUB ... · for example, O'Connor. and Arnold, 1965). The production of tonal contrasts relates primarily to the speaker's control

CORK PAPERS IN LuarIanco No.2 (Aug 1990)

U.S. DEPARTMENTOF EDUCATIONMice ol Educational

Research and ImprovementEDUCATIOWLRESOURCES INFORMATION

CENTER (ERIC)Jechts document has been reproduCed

asreceived from the person or organizationonginahng itCl Minor changes

have been made to impr0136reprOduChOn quality

Points ol wow or opinionsstated in this document do not necessarily represent

officialOERI position or policy

"PERMISSIONTO REPRODUCE

TH/SMATERIALHAS BEEN GRANTED BY

TO THE EDUCATIONALRESOURCESINFORMATION

CENT7R (ERIC)."

TONES FOR PROFOUNDLY DEAF TONE-LANGUAGE SPEAKERS*

Teresa ChingCUHK

0°ZSignificance of tonesThe use of tones to signal different meanings is an

inherent characteristic of a tone language likeCantonese. Syllable-based tonal contrasts can berealized by one of six tonal contours, namely, the high

C.4 level tone, the high rising tone, the mid level tone, thelow falling tone, the low rising tone, and the low leveltone. This may be illustrated by the segmentalcombination /ji/. The utterance means "clothing","chair", "meaning", "child", "ears" or "two", accordingto which of the six tones the speaker has selected in hisproduction of /ji/. This systematic use of pitchvariations on the syllable level constitutes lexical tonecontrasts. Tonal patterns can also be superimposed on anutterance for discoursal functions, such as interrogativeas opposed to declarative; and for affective purposes,for instance, to express attitudes and emotions. Thislinguistic use of pitch on the sentence level isintonation, and is also characteristic of non-tonelanguages, such as English (see, for example, O'Connorand Arnold, 1965).

The production of tonal contrasts relates primarilyto the speaker's control of the rate of vibration of hisvocal folds in phonation. The hearer perceives changesin the fundamental frequency as differences in pitch.When speech communication takes place in a tone languageenvironment, the ability to produce and perceive tonalcontrasts is of utmost importance, for lexicaldistinctions and grammatical meanings are dependent onthe systematic use of voice pitch. Figure 1 shows thecontrastive tone patterns in Cantonese.

Figure 1 about here

*To appear in the Proceedings of the 2nd Asian-PacificRegional Conference on Deafness, Jakarta, 1989.

BEST COPY AVAILABLE 21

Page 3: DOCUMENT RESUME ED 335 901 FL 019 374 AUTHOR TITLE PUB ... · for example, O'Connor. and Arnold, 1965). The production of tonal contrasts relates primarily to the speaker's control

From a developmental perspective, vocalisation isone component of the auditory-vocal dimension ofcommunication activity (see Bruner, 1975) which theinfant uses to express its intentions at a very earlystage in life. Learned patterns of prosodic behaviourand language specific prosody tend to emerge during thefirst year of life (Weir, 1962; Dore,1975; Crystal,1975). Recent work on the acquisition of tone languagesall agree that phonetic accuracy in the production oflexical tones is learned earlier than in the productionof segments (Tuaycharoen, 1978; Tse, 1978; Clumeck,1980). In normal language acquisition, the establishmentof efitcient phonatory control precedes accuratearticulatory control. This normal sequence must be asure guide for helping the profoundly deaf child todevelop speech communicative ability. Not only is theestablishment of phonatory skills of pragmatic and socialimportance, it also underlies subsequent verbal andcognitive development.

II Tones and the profoundly hearing-impairedWith an average hearing loss over the first fourfrequencies (250Hz, 500Hz, lkHz and 2kHz) of greater than100dB, the profoundly hearing-impaired listener oftenencounters great difficulty in understanding speech. Thisis especially so in a tone language situation, becausetones cannot be lipread (Ching, 1986). In anexperimental task in which the lipreadability ofCantonese connected speech is investigated, it was foundthat the performance, measured as number of wordsconveyed in a minute, is worse than that of the same taskin English (Rosen, Yourcin and Moore, 1981). It is muchmore difficult to understand speech on the basis oflipreading alone in a tone languageenvironment. Theinvisible voice pitch contrasts carry an importantfunctional load in the language system, but lexical tonescalnot be lipread in isolation or in context for meaningto be conveyed.

When information related only to thevoice pitch of the speaker is available auditorily, theenhancement of receptive ability in Cantonese is a 200%gain. Much of the lexical ambiguity is resolved, and thebenefit is directly related to the provision of tonalinformation to complement lipread information. A gainof 76% was obtained for the same task in Fnglisb. Sincethe larynx activity of the speaker cannot be seen on theface, while certain articulatory movements are visible,lipreading can best be complemented by the availabilityof clear information relating to the speaker's voice.The complexity of the acoustic speech signalundermines the ability of the deaf listener to hearspeech. While conventional hearing-aids tend to provideamplification across the speech spectrum, this does notalways contribute to improving speech reception. It has

2 3

4

Page 4: DOCUMENT RESUME ED 335 901 FL 019 374 AUTHOR TITLE PUB ... · for example, O'Connor. and Arnold, 1965). The production of tonal contrasts relates primarily to the speaker's control

been reported that profoundly hearing-impaired listenersare best at discriminating frequency changes at lowfrequencies, particularly when these are presented as apure tone rather than a complex tone (Stock and Rosen,1986). The limited auditory functioning of the impairedear is not well served by the conventional acoustichearing-aids used. Lebisch (1989), for instance,commented on the mismatch between the recommendation ofthe audiologist who fits the hearing-aids and thepreference of the experienced user. The latterconsistently adjusts for a higher gain in the lowfrequency end, and a lesser gain above lkHz than thesettings suggested by the professional. As frequencyselectivity worsens (widened critical bands) andfrequency discriminability degrades at higherfrequencies, what can be processed may be masked by othercomponents in the amplified signal. Background noisewould also exert influence on the entire auditoryspectrum. Not only is the deaf listener unable to usethe additional information in the speech signal, he isalso deprived of what he can use.

Even in the case of profound impairment, there isusually some residual hearing abilities. For example,Rosen et al (1987) reported for their profoundly deaflisteners the ability to distinguish periodic fromaperiodic sounds, and to discriminate changes infrequPncy in the low frequency range (below 500Hz).These capabilities are of practical importance in speechperception.

The range within which there is residual hearingcorresponds to the larynx frequency range of the speaker.Figure 2 shows a typical left-hand corner audiogram of aprofoundly deaf listener, and the corresponding larynxfrequency range of two Cantonese speakers.

Figure 2 about here

Variations in tone and intonation are conveyed bysystematic changes in the fundamental frequency patternsin the speaker's voice, and these occur below 500Hz innormal speech. If the varying voice pitch could beclearly conveyed to the profoundly deaf listener, hewould be able to discriminate changes in frequency inthis range and use the tonal information forunderstanding speech.

3

Page 5: DOCUMENT RESUME ED 335 901 FL 019 374 AUTHOR TITLE PUB ... · for example, O'Connor. and Arnold, 1965). The production of tonal contrasts relates primarily to the speaker's control

III Speech pattern approach to nhancing tonalperception

Tone patterns are most useful to the impairedlistener who has to depend on lipreading forunderstanding speech. For these patterns to be presentedin a way matched to the limited auditory abilities,simplification is necessary. Speech pattern features canbe extracted from the complex speech signal and presentedin a simplified form.

The extraction of tonal patterns from speech can becarried out by the use of a laryngograph, which sensesvocal fold closure by two electrodes externally placed onthe speaker's neck (Fourcin, 1974). Moore et al (1985)reported extenaive work using the speech patternextraction approach. Fourcin (1986a) described thepossibility of presenting simplified tonal information bymeans of a specially designed hearing-aid. A profoundlydeaf listener using the Sivo-aid, which provides him onlywith a sinusoidal representation of voice fuAdamentalfrequency variation, performs consistently better atlipreading connected speech than when he uses his ownhigh quality acoustic hearing-aid, which provides himwith the entire speech signal. Rosen et al (1987) alsoprovided evidence showing that for some impairedlistelers, simplifying the speech signal to a sinusoid isadvanzageous to speech reception.

The presentation of tonal and prosodic informationin a simplified form can be implemented in the use of theSivo-aid. The device basically receives a speech input,extracts the voice fundamental frequency from the signal,and generates an acoustic sinusoid at the appropriatefrequency and amplitude level. The implementation isaetailed in Rosen et al, 1987.

IV Video-recorded tests of tons perceptionSince visual information is of crucial importance to

speech perception, particularly for hearing-aid users,voice pitch information must be evaluated as an aid tolipreading. The relative usefulness of presenting asimplified speech pattern for enhancing speechperception is assessed using video-recordedlipreading tests. It is profitable to start with simplepatterns of contrasts and to gradually build up incomplexity on the basis of increasing speech processingabilitier.

The present work aims at assessing the practical useof the simplified speech pattern approach by comparingthe performance using an acoustic hearing-aid and theSivo-aid in a tone labelling task. The initialassessment is complemented by a related programme oftraining tn enhance perception of lexically contrastive

4

Page 6: DOCUMENT RESUME ED 335 901 FL 019 374 AUTHOR TITLE PUB ... · for example, O'Connor. and Arnold, 1965). The production of tonal contrasts relates primarily to the speaker's control

tones. Subsequent assessment provides an objectivemeasure of progress.

1 Method

A battery of audio-video recorded test material inCantonese has been developed to assess speech receptiveability. This includes a tonal component and aconsonantal component.

Of primary concern here is the tests on tonalcontrasts. These are graded, from two tonediscrimination involving the High Level and the LowFalling; to three tone contrasts invorying the High Levelvs. High Rising vs. Low Falling; to the entire system ofsix tone contrast, namely High Level, High Rising, MidLevel, Low Falling, Low Rising, and Low Level tones.These tonal contrasts are all based on /ji/, which givesreadily available lexical labels corresponding to the sixtonal patterns (see Figure 1 for the larynx frequencypatterns).

A female native speaker of Cantonese wasrecorded. Figure 3 shows the voice characteristics ofthe speaker.

Figure 3 about here

The frequency of vocal fold vibration was derived from along term sample of the larynx waveform, determined on aperiod by period basis. The second order probabilityhistogram shows the distribution of laryngeal periods atdifferent frequencies. The modal frequency is 243Hz,with a wide range of vibratory activity in the dominantrange of 170 - 329Hz. This range within which variedtonal and intonational patterns are realized can beillustrated in the digram distribution, derived byplotting successive periods against each other. (For adetailed explanation of this laryngograph-based micro-computer analysis of vocal fold function, see Fourcin,1986b).

The recordings were made on a Sony U-matic high bandvideo-cassette-recorder. Speech was recorded on onechannel and simultaneously derived laryngograph signal onthe other.

Each of the test items was embedded in a frame/-ni-ko _hai / (this is ), the inter-stimuli interval was 7 seconOs. Each test consisted of

5

Page 7: DOCUMENT RESUME ED 335 901 FL 019 374 AUTHOR TITLE PUB ... · for example, O'Connor. and Arnold, 1965). The production of tonal contrasts relates primarily to the speaker's control

ten tokens of each stimulus, making a total of twenty inthe two-tone tests, and thirty in the three-tone tests.A practice session preceded each test session, giving thefundamental frequency patterns of the contrastive tonesand the corresponding lexical items.

Response sheets were used, on which the subjectswere required to circle the appropriate lexical itemafter each stimulus was presented.

2 Conditions

All conditions used visual stimuli, and four of thempresented auditory signal either via sound field when thesubjects used their own hearing-aids or through theSivo-aid. The auditory signal can be one of two types,speech tones or larynx tunes. A fifth condition waslipreading alone.

The tests aimed at assessing the relativecontribution of the conventional hearing-aid and theSivo-aid; and the use of speech tones and larynx tonesfor lexical tone reception. The Sivo-aid presentsinformation related only to the voice fundamentalfrequency of the speaker, with practically no spectralinformation; while the conventional hearing-aid presentsthe complex speech signal. The speech tones containvocal tract information, while the larynx tones containbasically tonal information.

Before the testing session, each subject adjustedfor the most comfortable listening level for allconditions with auditory signal. The individual settingsfor each subject when listening to recorded speech andrecorded larynx tones were also observed for optimalreception using the Sivo-aid.

3 Subjects

Four profoundly deaf children served as subjects(Figure 4 gives the pure tone audiograms of thechildren). After the initial assessment, the childrenwere placed in weekly training sessions using the Sivo-aid and a visual display (a Visi-pitch display). Thesubjects were tested again after a four-week programme.

Figure 4 about here

A control group, which comprised all students in thesame class as the subjects, was also tested. They all

6 7

Page 8: DOCUMENT RESUME ED 335 901 FL 019 374 AUTHOR TITLE PUB ... · for example, O'Connor. and Arnold, 1965). The production of tonal contrasts relates primarily to the speaker's control

used their own hearing-aids and'lipread speech tones,larynx tones, and finally lipread with no auditorysignal. All children were in the age range of 10-12years.

All subjects were tested individually in a sound-..reated room. The video signal was presented on a 12in.colour monitor and the audio signal via a loudspeaker forthe sound field conditions. As for the Sivo-aidconditions, the audio signal was fed directly into thehearing-aid.

4 Results

The two-tone labelling tests were used. Thisinvolves labelling a stimulus as meaning either"clothing" (for the high level tone) or "child" (for thelow falling tone). The orthographic representations ofthese lexical labels are well within the knowledge ofeven the youngest child tested.

Table 1 gives the labelling results of all children.Responses were generally random (50% or below), showingno discrimination between the two tones. Either thesubjects did not understand the task completely, or theylack the ability to classify the simple stimuliaccurately. It is apparent that tonal contrasts cannotbe lipread, even in a closed class of two oppositions.

Table 1 about here

Four of the twenty-three children tested attained acriterion level of 75% correct in the two-tone tests whenlipreading speech tones with their own hearing-aids.These are severely hearing-impaired children with anaverage hearing loss in the region 75 - 90dB over thefirst four frequencies. They are making better use oftheir residual hearing than their p7ofoundly deaf peergroup. They are also getting additional information fromthe speech tones than from the larynx tones.

Further assessment using a three-tone test andsubsequent tests of the entire tonal system would reveallimitations in their linguistic capabilities, which couldthen be complemented by a rehabilitative programme toimprove their prosodic skills. Normally hearing childrenperforming the same task can confidently label the twotone contrasts accurately by five, and the three tonecontrasts by six. Ching (1984) reported that childrenmade confident judgments on the entire system of tonal

7

Page 9: DOCUMENT RESUME ED 335 901 FL 019 374 AUTHOR TITLE PUB ... · for example, O'Connor. and Arnold, 1965). The production of tonal contrasts relates primarily to the speaker's control

contrasts in Cantonese by about ten years of age.

As the present work is concerned with using asimplified approach to enhance tone receptive abilityin the profoundly deaf, the performance of theprofoundly deaf subjects is of primary interest.

Comparing the four subjects' performance acrossconditions of presentation, it can be seen that theauditory signal contributes to tonal reception via theSivo-aid more effectively (see Table 2). Subject 1 andsubject 2 performed better when using the Sivo-aid thanwhen using their own aid. Subject 3 responded best tothe larynx tones received via the Sivo-aid. Subject 4was not able to identify the high level and low fallingtones at all.

Table 2 about here

The Sivo-aid presented an auditory signalcorresponding to the fundamental frequency of theutterance in the form of a sinusoid. The signal is welldefined in periodicity, and frequency changes can beclearly conveyed. This accounts for the significantlyhigher scores in the Sivo-aid conditions as compared withthose in the Own aid conditions for subject 1. He makesno use of the spectral information presented through hisown hearing-aid. It is likely that the complex signalprecludes the effective use of the available fundamentalfrequency information. The loss of acoustic informationin the sinusoidal presentations is not associated with apotential loss in labelling efficiency. The scores forthe Sivo-aid conditions are not significantly differentfrom those in the Own aid conditions for the other threesubjects. In fact, the scores are all slightly higher.

The general inability in lexical tone labelling canthus be attributed no_ so much to the loss or auditoryinformation, but rather to the lack of listeningexperience to classify the auditory informationmeaningfully and accurately.

5 Training

Extensive training can make a lot of difference inspeech perceptual tasks. White et al (1982), forinstance, used a question/statement test to assess theperception of fundamental frequency contours of a patientusing different speech coding schemes. Higher scoreswere obtained with the scheme which presented fundamental

8

Page 10: DOCUMENT RESUME ED 335 901 FL 019 374 AUTHOR TITLE PUB ... · for example, O'Connor. and Arnold, 1965). The production of tonal contrasts relates primarily to the speaker's control

frequency of the utterance only, but, the score was notsignificantly different from chance: Fourcin et al(1979), however, reported significant improvement on thesame task for their four patients using an auditorystimulation which presented only fundamental frequency.The patients reported in the latter study had hadconsiderable training in labelling prosodic contrastsbefore they were tested.

While sinusoidal presentations can simplify theacoustic signal so that it is better matched to thelimited sensory capability of the profoundly deaflistener, appropriate training can help in thedevelopment of the perception of tonal contrasts, so thatit can be an important source of information for thelipreader.

The four subjects were given extensive trainingspecifically on the tonal contrasts in Cantonese. Theyused the Sivo-aid for each training session so that thelarynx frequency patterns of the speaker could be clearlypresented auditorily. There was also a visual display tohelp them monitor their own production. Live training inperceiving and producing the tonal contrasts lastedfifteen minutes per session, and three sessions weregiven per week to each individual subject. The trainingprogramme initially went on for four weeks, after whichthe subjects were tested again.

Figure 5 compares the scores before and aftertraining for the four subjects using the video-recordedlipreading tests, showing overall improvement uithtraining. Table 2 shows the relative enhancement oflabelling ability for each individual subiect.

Figure 5 about here

Subject 1 showed confident labelling and performedperfectly when the larynx tones were presented via theSivo-aid. He also scored 75% correct when using his ownaid. There is learning effect for all lipreadingconditions on the same task. Subject 2 demonstratedsignificant improvement, scoring 85% correct labellingwhen using her own aid and 90% correct using the Sivo-aidafter training. Obviously she was not only gaining fromthe simplified signal but the increased listeningexperience also enabled her to make better use of theacoustic signal presented via her own aid. The resultsof subject 3 before and after training were not very muchdifferent. Although he was able to attend to the

1 09

Page 11: DOCUMENT RESUME ED 335 901 FL 019 374 AUTHOR TITLE PUB ... · for example, O'Connor. and Arnold, 1965). The production of tonal contrasts relates primarily to the speaker's control

differences between the two tones in live training, hislabelling was not very confident. Further training isnecessary so that he can better Mentify the perceiveddifferences. Subject 4 is probabl, poorest in frequencyresolution ability, although the pure tone audiogram doesnot give information relating to this aspect. Hislabelling score was 90% correct when larynx tones werepresented via the Sivo-aid. The speech tones, whichcontain more spectral information possibly interfereswith his effective use of the acoustic signal foridentifying the contrasts between a high level tone and alow falling tone. While he was completely unable toclassify the stimuli before training, he scored 60%correct when lipreading with auditory speech tones aftertraining.

6 Further work

On the basis of the improved labelling ability ofsubjects 1 and 2, a third tone, the high rising tone wasintroduced. The subjects were first assessed using thevideo-recorded three tone lipreading tests. Subject 1labelled the high level and low falling tonesconfidently, but was completely unable to identify thenew tone. Subject 2 showed degraded performance andoverall inability to classify the stimuli. The subjectswere then given appropriate training on the three tonecontrasts in Cantonese, using the Sivo-aid and the visualdisplay. The subjects were re-assessed after tentraining sessions.

Figure 6 compares the subjects' performance beforeand after training. Subject 1 showed overallimprovement, and perfect identification when lipreadingwith larynx tones presented via the Sivo-aid. He alsoscored 83% correct using his own aid when listening tospeech tones. Subject 2 scored 60% correct for the Sivo-aid condition, but her overall performance using her ownaid was not better than chance.

Figure 6 about here

V Summary and DiscussionThe present work uses a simplified speech pattern

approach to enhance perception of tonal contrasts inCantonese. The speech pattern is directly related to thelarynx frequency of the speaker, which is known to aidlipreading most; and the simplification is implemented inthe use of the Sivo-aid. Lipreading tests designed onthe basis of speech patterns and graded in terms of

10 1.1

Page 12: DOCUMENT RESUME ED 335 901 FL 019 374 AUTHOR TITLE PUB ... · for example, O'Connor. and Arnold, 1965). The production of tonal contrasts relates primarily to the speaker's control

compleXity are useful for identifying the difficulties,guiding specific training, and measuring learningeffects. Appropriate training has led profoundly deafsubjects from a complete inability to discriminate tonesto confident labelling and identification of lexicaltones.

As speech pattern features may gradually increase incomplexity to encompass more contrastive information, itwould be possible to help profoundly deaf listeners todevelop perceptual skills relating o suprasegmental aswell as segmental contrasts in speech.

The simplification approach makes it possible toprovide a better match to the hearing capabilities of theuser, so that he could makn better use of his residualhearing. While speech pattern features relating toperiodicity can be better carried by sinusoidalpresentations, the range of frequency variation can alsobe transposed to a region at which there is optimaldiscriminative ability. So long as the essentialpatterns are preserved, the information thus presentedcan be usefully employed for speech perception.

Especially when working in a tone languageenvironment, hearing-ahl design or stimulation techniquesneed to take into consideration the potential benefitsobtainable with the profoundly deaf listener using aspeech pattern extraction and simplification approach.Assessment and rehabilitation work guided by thisknowledge would speed up learning process and ensuremeaningful results, both with regard to the developmentof perceptual skills as well as adequate expressiveskills.

1 2

11

Page 13: DOCUMENT RESUME ED 335 901 FL 019 374 AUTHOR TITLE PUB ... · for example, O'Connor. and Arnold, 1965). The production of tonal contrasts relates primarily to the speaker's control

Reference',

Bruner J. (1975) The ontogenesis of speech acts. Journalof Child Language. 2:1-19.

Ching Y.C. (1984) Lexical tone pattern learning inCantonese children. Language Learning andCommunication. 3.3:317-334(1986) Voice pitch information for the deaf.Proceedings of the lst Asian-PacificRegional Conference on Deafness, December,1986, Hong Kong. Hong Kong Society for theDeaf, 1988. 340-343.(1988) Lexical tone perception by Cantonesedeaf children. In I.M. Liu, M.J. Chen andH.C. Chen (eds) Cognitive Aspects of theChinese Language, vol.I. Hong Kong: AsianResearch Service. 93-102.

Clumeck H. (1980) The acquisition of tone. In G.H. Yeni-Komshian, J.E. Kavanagh and C.A. Ferguson(eds) Child Phonology, vol. I: Production.New York: Academic Press.

Crystal D. (1975) The English Tone of Voice. London:- Edward Arnold.

Dore J. (1975) Holophrases, speech acts and languageuniversals. Journal of Child Language. 2:21-40.

Fourcin A.J. (1974) Laryngographic examination of vocalfold vibration. In B. Wyke (ed) Ventilatoryand Phonatory Control Systems. 315-333.London: OUP.

(1986a) Hearing aids for tonal languages.Proceedings of the 1st Asian-Pacific RegionalConference on Deafness, December, 1986, HongKong. Hong Kong Society for the Deaf, 1988.72-83.(1986b) Electrolaryngographic assessment of

vocal fold function. Journal of Phonetics.14:435-442.

Fourcin A.J., S. Rosen, B.C.J. Moore, E.E. Douek, G.P.Clark, H. Dodson and L.H. Bannister (1979) External

electrical stimulation of the cochlea:clinical, psychophysical, speech-perceptualand histological findings. British Journalof Audiology. 13:85-107.

Lebisch H. (1989) Different routes of hearing instrumentfitting. Paper presented at the 2nd Asian-Pacific Regional Conference on Deafness.Jakarta, July 31 - August 4.

Moore H.C.J., A.J. Fourcin, S. Rosen, J.R. Walliker,D.M. Howard, E. Abberton E.E. Douek and S. Frampton

(1985) Extraction and presentation of speechfeatures. In R.A. Schindler and N.M.Merzenich (eds) Cochlear Implants. New York:Raven Pres.

31 12

Page 14: DOCUMENT RESUME ED 335 901 FL 019 374 AUTHOR TITLE PUB ... · for example, O'Connor. and Arnold, 1965). The production of tonal contrasts relates primarily to the speaker's control

O'Connor J.D. and G. Arnold (1965) Intonation ofColloquial English. Longman.

Rosen S., A.J. Fourcin and B.C.J. Moore (1981) Voicepitch as an aid to lipreading. Nature.291:150-152.

Rosen S., J.R. Walliker, A. Fourcin and V. Ball (1987) Amicroprocessor-based acoustic hearing aid forthe profoundly impaired listener. Journal ofRehabilitation Research and Development. Vol.24. no. 4: 239-260.

Stock D. and S. Rosen (1986) Frequency discrimination andresolution at low frequencies in normal andhearing-impaired listeners. Speech, Hearingand Language: Work in Progress. Phonetics andLinguistics, University College London.2:193-222.

Tse K.P. (1978) Tone acquisition in Cantonese: alongitudinal case study. Journal of ChildLanguage 5:191-204.

Tuaycharoen P. (1978) The babbling of a Thai baby: echoesand responses to the sounds made by adults.In N. Waterson and C.E. Snow (eds)Development of Communication: Social andPragmatic Factors in Language Acquisition.Chichester: Wiley.

Weir R.H. (1962) Language in the Crib. The Hague:Mouton.

White R.L., M.K. Herndon and R.G. Matthews (1982) The useof computers in the development of a cochlearprosthesis. In J. Raviv (ed) Uses ofComputers in Aiding the Disabled. NorthHolland, Amsterdam. 147-165.

14

13

Page 15: DOCUMENT RESUME ED 335 901 FL 019 374 AUTHOR TITLE PUB ... · for example, O'Connor. and Arnold, 1965). The production of tonal contrasts relates primarily to the speaker's control

1000

300

100

30

Fx PATTERNS OF TONES

.5 sec

2

CANTONESE TON ES

1 HIGH LEVEL 4 LOW FALLING2 HIGH RISING 5 LOW RISING3 MID LEVEL 6 LOW LEVEL

Figure 1 gives the fundamental frequency patterns (measured ona period-by-period basis) of the Cantonese tonesproduced by a male and a female speaker. Therelative patterning of the tonal contours is the

same, although there are absolute differences in

frequency.

14 15

Page 16: DOCUMENT RESUME ED 335 901 FL 019 374 AUTHOR TITLE PUB ... · for example, O'Connor. and Arnold, 1965). The production of tonal contrasts relates primarily to the speaker's control

.20

.10

010

20

30

40

SO

SO

70

90

90

103

110

120

,

..,

\o

.

125 250 500 1000 2000 4000 8000FREQUENCY (Hz)

Fx DISTRIBUTION

F(N 4899) -1000

;300 r

-100

M(N5548) - 30

.01 001PROBABILITY

Figure 2 shows a typical left-hand-corner pure tone audiogramand the fundamental frequency distribution of twoadult Cantonese speakers, a male and a female. Thefrequency range at which there is measurable hearingcoincides with that of voice pitch variations inspeech.

16

Page 17: DOCUMENT RESUME ED 335 901 FL 019 374 AUTHOR TITLE PUB ... · for example, O'Connor. and Arnold, 1965). The production of tonal contrasts relates primarily to the speaker's control

Dx - 2nd Order

II

ProbZ

1.8

1.1

ION

Title : DILVS(F)Total = 4798 81Z range (Hz)MEN = 237 Nz 178 - 329MODE = 243 Hz 98% range (Hz)MEDIN = 237 Hz 166 - 348

TitleDILYS(F)

31

2nd FxValue (Hz)

Total =9326

9QUIT

flDUMP

38

Curslor frel ;:ncg

111 381

9 fl f2QUIT DUMP CURSOR

IN1itz

Figure 3 presents the fundamental frequency distribution ofthe speaker used for producing the tonal stimuli.Her range is indicated by the scatter plot.

16

1 7

Page 18: DOCUMENT RESUME ED 335 901 FL 019 374 AUTHOR TITLE PUB ... · for example, O'Connor. and Arnold, 1965). The production of tonal contrasts relates primarily to the speaker's control

-20

.10

10

20

30

40

50

80

70

80

90

100

110

120

-20

-10

0

10

3 20

30

40

W W

O Wm

<80=so

100

110

120

NAME_S1

1

. ,

1

1

___,..,

ME=._. EP=

III. AM.; \ I.

125 250 SOO 1000 2000 4000 8000FREQUENCY (HO

I ' .

I I 1: 1 !

. 1

I

I

I

. I

:

,in:

,.

71111111111MMI

i

-..,125 250 500 1000 2000v\ 4000 8000

FREQUENCY (Hz) A

-20

.10

10

20

30

40

50

80

70

80

90

100

110

120

.20

NAMES2

,

I 0 .

..

,,

. ;

_

1a

.N1.11111111111111111111ra-74111111111111111111111

.,_

-10

10

TO

30

40

50

60

70

80

90

100

110

120

125 250 SOO 1000 2000 4000 8000FREQUENCY 11,141

NAME S 41

.4

1

1

I

iI

;

I

I 4

,. 1

s

t

11141111111\i

0

1111162g1125 250 5C0 1000 2

FREQUENCY (Hz)4000 8000

Figure 4 gives the pure tone audiograms oZ the four profoundl)deaf children who served as subjects.

1 81_7

Page 19: DOCUMENT RESUME ED 335 901 FL 019 374 AUTHOR TITLE PUB ... · for example, O'Connor. and Arnold, 1965). The production of tonal contrasts relates primarily to the speaker's control

4 SUBJECTSBEFORE TRAINING

AFTER TRAINING

SF :SP SF: Lx LA Sivo:SP

CONDITIONSSivo:Lx

Figure 5 shows the labelling of the four subjectswhen lipreading with their own aids (SF),lipreading with no auditory stimuli (LA) andlipreading with the Sivo-aid (Sivo). Theauditory stimulus, when present, iseither speech (Sp) or larynx tones (Lx).Proportion of correct labelling before andafter training is compared for the subjects.Two-tone contrasts were used as stimuli.

18

19

Page 20: DOCUMENT RESUME ED 335 901 FL 019 374 AUTHOR TITLE PUB ... · for example, O'Connor. and Arnold, 1965). The production of tonal contrasts relates primarily to the speaker's control

.8

.6

.4

2

1

.8

.6

140

.4

.2

S2 BEFORE TRAINING

AFTER TRAINING

yom

.ior 300 Hz

100

SF :Sp SF:Lx LA Sivo: Sp Sivo: Lx

CONDITIONSFigure 6 compares the labelling performance of two

subjects befcre and after training for thefive conditions.

PO

19

Page 21: DOCUMENT RESUME ED 335 901 FL 019 374 AUTHOR TITLE PUB ... · for example, O'Connor. and Arnold, 1965). The production of tonal contrasts relates primarily to the speaker's control

LIPREADING CANTONESE TONES

HIGH LEVEL : LOW FALLING

Conditions Lips

Speech

Lips Lips

Larynx tones Alone

Proportion

Control group:

correct % )

P31 50 50 50P32 55 55 55P33 60 55 40P34 75 75 55P35 55 50 40P36 50 60 55P37 100 75 45P38 50 65 55P41 60 60 25P42 45 60 40P43 60 50 40P44 55 65 45P45 70 50 45P46 85 70 50P51 50 45 50P52 75 50 60P53 55 60 45P54 70 60 40P55 45 65 25

Subjects

S1 70 45 45S2 60 30 35S3 60 40 25S4 50 50 50

Table 1 gives the results of the two tone labellingtests. Twenty-three children took thetests, and they lipread under threeconditions: lipreading with speech tones,lipreading with larynx tones, andlipreading alone. The children used theirown aids in conditions with auditory stimuli.

20

21

Page 22: DOCUMENT RESUME ED 335 901 FL 019 374 AUTHOR TITLE PUB ... · for example, O'Connor. and Arnold, 1965). The production of tonal contrasts relates primarily to the speaker's control

v

LIPREADING CANTONESE TO1ES

HIGH LEVEL : LOW FALLING

ConditionsOwn aid Own aid Lips Sivo aid Sivo aid

+ + + +Speech Larynx tones Alone Speech Larynx tones

Proportion correct

S1 (Before Training)14/20 9/20

(After Training)15/20 12/20

9/20

12/20

16/20

17/20

15/20

20/20

S2 (Before Training)12/20 6/20 7/20 13/20 8/20

(After Training)17/20 13/20 7/20 18/20 14/20

S3 (Before Training)12/20 11/20 5/20 6/20 13/20

(After Training)12/20 11/20 8/20 10/20 13/20

S4 (Before Training)10/20 10/20 10/20 9/20 10/20

(After Training)12/20 7/20 10/20 12/20 18/20

Table 2 Individual labelling scores of four subjectsbefore and after training for the fiveconditions in a two-tone lipreading test.

Page 23: DOCUMENT RESUME ED 335 901 FL 019 374 AUTHOR TITLE PUB ... · for example, O'Connor. and Arnold, 1965). The production of tonal contrasts relates primarily to the speaker's control

halinamladmenta

I wish to express my gratitude to the staff and students of theVictoria Park School for the Deaf for their co-operation,without which this study would not have been possible.

My thanks also to Professor A J Fourcin for his advice, and forthe provision of the Sivo-aid for this project to be carriedout in Hong Kong. I am also grateful to the technical staff atUniversity College London for their help in producing the testbattery. Dilys Cheung also contributed by running the testswith normally hearing children.

03

22