Voice-Enabling Chatbots

  • View
    1.202

  • Download
    1

Embed Size (px)

DESCRIPTION

You don't have to put you ear on the ground, and still can literally hear it coming. The broad introduction of Voice User Interfaces, allowing the interaction with mobile devices through voice, may become the biggest advancement in user interface design since the transition from text-based to graphical user interfaces.

Text of Voice-Enabling Chatbots

  • 1. Voice-Enabling ChatbotsSlides: http://wolfpaulus.com/slidesCode: git clone https://github.com/wolfpaulus/bots.git 2012-2013 Wolf Paulus - http://wolfpaulus.com
  • 2. Star Trek 2012-2013 Wolf Paulus - http://wolfpaulus.com
  • 3. Graphical User Interfaces - Mac System 1 (1984), Windows 95 (1995) 2012-2013 Wolf Paulus - http://wolfpaulus.com
  • 4. Voice User Interfaces - Ford Sync, Siri, and Cora 2012-2013 Wolf Paulus - http://wolfpaulus.com
  • 5. Speed and Accuracy of Speech Recognition 2012-2013 Wolf Paulus - http://wolfpaulus.com
  • 6. Wearable Computing - Google Project Glass, Pebble Watch, Apple iWatch (concept) 2012-2013 Wolf Paulus - http://wolfpaulus.com
  • 7. Artist on Android 2012-2013 Wolf Paulus - http://wolfpaulus.com
  • 8. Artist on Android, Voice User Interface attens navigation and conguration hierarchies 2012-2013 Wolf Paulus - http://wolfpaulus.com
  • 9. Adaptive Multi-Rate Narrowband Speech Codec 8 KHz sampling rate and 12 Kb encoding rateSpeech Recognition Client - Record, Encode, Compress, Send, Receive Transcription and Condence 2012-2013 Wolf Paulus - http://wolfpaulus.com
  • 10. Horsemen of Speech Recognition 2012-2013 Wolf Paulus - http://wolfpaulus.com
  • 11. 2001 Space Odyssey 2012-2013 Wolf Paulus - http://wolfpaulus.com
  • 12. Speech SynthesisUse a pre-installed Text-To-Speech EnginePackage and ship a distinct Synthesizer andVoice with mobile applicationUse a web-service to synthesis text into speechaudio (VAAS)Voice Matters 2012-2013 Wolf Paulus - http://wolfpaulus.com
  • 13. Speech Synthesis on Android 2012-2013 Wolf Paulus - http://wolfpaulus.com
  • 14. Echo BotCreating a simple Voice-Enabled Android App AIML Bot Cora 2012-2013 Wolf Paulus - http://wolfpaulus.com
  • 15. Speech Recognitionprivate void startVoiceRecognitionActivity() { final Intent intent = new Intent(RecognizerIntent.ACTION_RECOGNIZE_SPEECH); // Specify the calling package to identify your application intent.putExtra(RecognizerIntent.EXTRA_CALLING_PACKAGE, getClass().getPackage().getName()); // Display an hint to the user about what he should say. intent.putExtra(RecognizerIntent.EXTRA_PROMPT, getResources().getString(R.string.speakPROMPT)); // Given an hint to the recognizer about what the user is going to say intent.putExtra(RecognizerIntent.EXTRA_LANGUAGE_MODEL, RecognizerIntent.LANGUAGE_MODEL_FREE_FORM); // Specify how many results you want to receive. The results will be sorted // where the first result is the one with higher confidence. intent.putExtra(RecognizerIntent.EXTRA_MAX_RESULTS, 1); //intent.putExtra(RecognizerIntent.EXTRA_LANGUAGE, new Locale("es").getLanguage()); startActivityForResult(intent, VOICE_RECOGNITION_REQUEST_CODE);} 2012-2013 Wolf Paulus - http://wolfpaulus.com
  • 16. Speech Synthesisprivate void android.speech.tts.TextToSpeech mTts;..// Instantiate TextToSpeech with the current Context and an OnInitListenermTts = new TextToSpeech(this, this);..private void onInit(final int status) { if (status == TextToSpeech.SUCCESS && mTts != null) { mTts.setOnUtteranceCompletedListener(new TextToSpeech.OnUtteranceCompletedListener() { public void onUtteranceCompleted(final String s) { startVoiceRecognitionActivity(); } }); } }private void say(final String s) { final HashMap map = new HashMap(1); map.put(TextToSpeech.Engine.KEY_PARAM_UTTERANCE_ID, UTTERANCE_ID); mTts.speak(s, TextToSpeech.QUEUE_FLUSH, map); mTV_TTS.setText(s);} 2012-2013 Wolf Paulus - http://wolfpaulus.com
  • 17. Echo Bot access Web Service perform on DeviceCapture Speech InputConvert Speech into Text Synthesize Voice (Message) Speek Message 2012-2013 Wolf Paulus - http://wolfpaulus.com
  • 18. stock quote for ... Stock Quote Bot access Web Service perform on Device Capture Speech Input Convert Speech into Text Execute Command Synthesize Voice (Message) Speek Message 2012-2013 Wolf Paulus - http://wolfpaulus.com
  • 19. access Web Service perform on Device Capture Speech Input Convert Speech into Text AIML Bot Create Text Response Message or Command ? CmdMsg Execute Command Msg Synthesize Voice (Message) Speek Message 2012-2013 Wolf Paulus - http://wolfpaulus.com
  • 20. Voice-Enabled Web Bots Recognition Synthesis 2012-2013 Wolf Paulus - http://wolfpaulus.com
  • 21. Voice User Interfaces - Ford Sync, Siri, and Cora 2012-2013 Wolf Paulus - http://wolfpaulus.com
  • 22. ThanksSlides: http://wolfpaulus.com/slidesCode: git clone https://github.com/wolfpaulus/bots.git 2012-2013 Wolf Paulus - http://wolfpaulus.com