QnA bot. Experience

http://www.slideshare.net/YuriyGuts/natural-language-processing-nlp

1

Standards in QA systemsRule-based systems

https://www.researchgate.net/publication/235923461_QArabPro_A_Rule_Based_Question_Answering_System_for_Reading_Comprehension_Tests_in_Arabic 2

Standards in QA systemsBag of words

http://www.slideshare.net/hadyelsahar/word-embedings-why-the-hype-55769273

3

Bag of words + TF-IDF

http://www.slideshare.net/hadyelsahar/word-embedings-why-the-hype-55769273

Standards in QA systems

4

Word embedding

https://blog.heuritech.com/2016/04/11/report-of-the-heuritech-deep-learning-meetup-6-with-yann-lecun/

Standards in QA systems

5

1D Convolutional neural network

http://www.wildml.com/2015/12/implementing-a-cnn-for-text-classification-in-tensorflow/

Standards in QA systems

6

Recurrent Neural Network

Standards in QA systems

http://karpathy.github.io/2015/05/21/rnn-effectiveness/7

Standards in QA systems

8

Main problems 1) Limited data

9

Main problems2) Difference between train dataset and “real life”

10

Main problems3) “I don't know” answers

11

Main problems 4) Quality metrics

https://arxiv.org/pdf/1603.08023v2.pdf12

Main problems5) Model degradation and “refitting model”

13

Main problems 6) Trash questions

Where is the nearest library?14

One more thing...

Russian language parser

Word embedding API (word2vec, Glove)

Solutions for business

15

Наши

кейсы

From Russia with love