18
Google Web Speech API Implementation Case Study: English Skill Online Practice Prajaks Jitngernmadan Faculty of Informatics, Burapha University

Google Web Speech API Implementation Case Study: English Skill Online Practice Prajaks Jitngernmadan Faculty of Informatics, Burapha University

Embed Size (px)

Citation preview

Page 1: Google Web Speech API Implementation Case Study: English Skill Online Practice Prajaks Jitngernmadan Faculty of Informatics, Burapha University

Google Web Speech API ImplementationCase Study: English Skill Online Practice

Prajaks JitngernmadanFaculty of Informatics, Burapha University

Page 2: Google Web Speech API Implementation Case Study: English Skill Online Practice Prajaks Jitngernmadan Faculty of Informatics, Burapha University

Google Web Speech API Implementation :: Prajaks Jitngernmadan :: BUU 2

Agenda Objectives Introduction Technologies System Design System Implementation Conclusion References

Page 3: Google Web Speech API Implementation Case Study: English Skill Online Practice Prajaks Jitngernmadan Faculty of Informatics, Burapha University

Google Web Speech API Implementation :: Prajaks Jitngernmadan :: BUU 3

Objectives To design an automatic free-text

answer correcting system architecture

To apply Google Web Speech API for speech recognition

To design and develop a simple online English training system prototype

Page 4: Google Web Speech API Implementation Case Study: English Skill Online Practice Prajaks Jitngernmadan Faculty of Informatics, Burapha University

Google Web Speech API Implementation :: Prajaks Jitngernmadan :: BUU 4

Introduction Language is one of the key successful

factors.

Multi-cultural society.

Common Language English

AEC in 2015

Most of Thais lack of English speaking and listening skill.

Page 5: Google Web Speech API Implementation Case Study: English Skill Online Practice Prajaks Jitngernmadan Faculty of Informatics, Burapha University

Google Web Speech API Implementation :: Prajaks Jitngernmadan :: BUU 5

Introduction Thai Characters

Shy

Modest

especially when it comes to English

Page 6: Google Web Speech API Implementation Case Study: English Skill Online Practice Prajaks Jitngernmadan Faculty of Informatics, Burapha University

Google Web Speech API Implementation :: Prajaks Jitngernmadan :: BUU 6

Introduction The online English training system has

to be

Supporting the users to practice translating and speaking skill with real-time feedback.

Easy to access web-based.

Encouraging the users interactively.

Providing necessary information.

Page 7: Google Web Speech API Implementation Case Study: English Skill Online Practice Prajaks Jitngernmadan Faculty of Informatics, Burapha University

Google Web Speech API Implementation :: Prajaks Jitngernmadan :: BUU 7

Technologies How to correct the answer

Text comparison method Similar Text Algorithm

Input Answer:: user

Given key:: admin

similar_text() % similarity

Page 8: Google Web Speech API Implementation Case Study: English Skill Online Practice Prajaks Jitngernmadan Faculty of Informatics, Burapha University

Google Web Speech API Implementation :: Prajaks Jitngernmadan :: BUU 8

Technologies How to recognize the speech

Web Speech API <input lang=”en” x-webkit-speech> Google Chrome version 25+

Input Speech:: user

Google Web Speech API

Output Text

Page 9: Google Web Speech API Implementation Case Study: English Skill Online Practice Prajaks Jitngernmadan Faculty of Informatics, Burapha University

Google Web Speech API Implementation :: Prajaks Jitngernmadan :: BUU 9

System Design Translating Practice Structure

answer

Solve-1

Solve-2

Solve-3

Highest Score CalculateInput

Compared by Similar Text

select the best result

wrong

>= 80%?

correct

Thresholduser

no yes

Page 10: Google Web Speech API Implementation Case Study: English Skill Online Practice Prajaks Jitngernmadan Faculty of Informatics, Burapha University

Google Web Speech API Implementation :: Prajaks Jitngernmadan :: BUU 10

System Design Speaking Practice Structure

Web browserChrome

Google Server

Text from voice

Web Speech API (over Internet)

Convert to text

speak

user

Translating Process

Page 11: Google Web Speech API Implementation Case Study: English Skill Online Practice Prajaks Jitngernmadan Faculty of Informatics, Burapha University

Google Web Speech API Implementation :: Prajaks Jitngernmadan :: BUU 11

System Design Overall System Structure

Internetuser

admin

Google Chrome 25+ ApplicationServer

Database

Page 12: Google Web Speech API Implementation Case Study: English Skill Online Practice Prajaks Jitngernmadan Faculty of Informatics, Burapha University

Google Web Speech API Implementation :: Prajaks Jitngernmadan :: BUU 12

System Design Database Design

Page 13: Google Web Speech API Implementation Case Study: English Skill Online Practice Prajaks Jitngernmadan Faculty of Informatics, Burapha University

Google Web Speech API Implementation :: Prajaks Jitngernmadan :: BUU 13

System Implementation First Prototype Approach

Page 14: Google Web Speech API Implementation Case Study: English Skill Online Practice Prajaks Jitngernmadan Faculty of Informatics, Burapha University

Google Web Speech API Implementation :: Prajaks Jitngernmadan :: BUU 14

System Implementation First Prototype Approach

Page 15: Google Web Speech API Implementation Case Study: English Skill Online Practice Prajaks Jitngernmadan Faculty of Informatics, Burapha University

Google Web Speech API Implementation :: Prajaks Jitngernmadan :: BUU 15

Conclusion Hands-on English system (English Skill

Online Practice)

Web-based application

Designed and developed under the conceptual interaction and didactics

System gives the responses within a minute for speaking, the response time depends on the

Internet connection speed

Page 16: Google Web Speech API Implementation Case Study: English Skill Online Practice Prajaks Jitngernmadan Faculty of Informatics, Burapha University

Google Web Speech API Implementation :: Prajaks Jitngernmadan :: BUU 16

Conclusion Future Works

Improve the answer correcting method

Redesign the user interface for more interactive and user-friendly

Test and collect data of learning improvement for statistical analysis

Acknowledgment Faculty of Informatics at Burapha University

Computer Graphics and Multimedia Research Laboratory

Page 17: Google Web Speech API Implementation Case Study: English Skill Online Practice Prajaks Jitngernmadan Faculty of Informatics, Burapha University

Google Web Speech API Implementation :: Prajaks Jitngernmadan :: BUU 17

References Similar text, (2013). PHP Manuals, http://php.net/manual/en/function.similar-

text.php. Last Accessed: December 15, 2013. Web Speech API, (2013). https://dvcs.w3. org/hg/speech-api/raw-file/tip/

speechapi.html. Last Accessed: December 15, 2013 jQuery, (2013). http://jquery.com/. Last Accessed: December 15, 2013. ภาษาอั�งกฤษ, (2013). http://th.wikipedia.org/ wiki/ ภาษาอั�งกฤษ Last Accessed:

Dec 15, 2013 EF EPI Country Rankings, (2013) . http://www.ef.co.th/epi/ Last Accessed Dec

15, 2013 Google Web Speech API, (2013).

http://commondatastorage.googleapis.com/io-2013/presentations/ 4057%20Web%20Speech%20API%20creates%20Interactive%20Experiences%20-%20Google%20I-O%202013%20Codelab.pdf, Last Accessed Dec 15, 2013

Michael F. McTear, (2002). Spoken dialogue technology: enabling the conversational user interface, ACM Computing Surveys (CSUR) Volume 34 Issue 1, pp 90-169.

Araki, M. and Takegoshi, D. (2012). Computer Software and Applications Conference (COMP SAC), pp 195 - 202.

Page 18: Google Web Speech API Implementation Case Study: English Skill Online Practice Prajaks Jitngernmadan Faculty of Informatics, Burapha University

Google Web Speech API Implementation :: Prajaks Jitngernmadan :: BUU 18

Thank you for your attention!