Disrupting Your Hack With Artificial Intelligence

Disrupting Your HackWith Artificial IntelligenceElliot Turner (AlchemyAPI, IBM Watson)

TechCrunch Disrupt SFSept 19, 2015

Disrupt SF 2015

Some Background …

(now 70,000+) !

Disrupt SF 2015

Some Background …

He took it pretty well!

Disrupt SF 2015

HAL? Robots? SIRI? Watson?

A.I.? What exactly are we talking about?

Disrupt SF 2015

A.I. = Smarter Applications

Disrupt SF 2015

A.I. = Disrupting Industries

Disrupt SF 2015

A.I. = Increasingly Embedded Everywhere

Monitoring your credit card transactions for fraud…

Recommending products on retail websites...

Understanding your voice on your mobile phone…

Analyzing your tax returns…

Reading your handwriting on personal checks…

Blocking spam in your inbox…

Disrupt SF 2015

Using A.I. Cloud APIs - No PhD Required

Speech Recognition Machine Translation

Computer Vision Natural Language Processing

Question Answering Automated Dialog

Vast array of A.I. technologies, one HTTP call away. Even a Raspberry Pi can use it!

Disrupt SF 2015

Watson Developer Cloud

IBM is democratizing “Full Stack A.I.” via the Watson Developer Cloud

Disrupt SF 2015

Building an A.I.- enabled Hack

"Is thispoisonous?"

Example app: "Voice + visual assistant for hikers in anycountry"

Intended use case: Answer verbal and visual questions about plants and animals encountered on a hike

“Es esta venenosa?"

Disrupt SF 2015

Cloud APIs provide speech recognition capability to any network-enabled device, across many different

spoken languages.

What you can do: respond to spoken commands, transcribe audio and video files, search audio

streams for specific key phrases ...

Moving beyond the keyboard: Speech Recognition

Disrupt SF 2015

Integrating Speech Recognition into your App

● APIs support analyzing audio files or streaming audio data in real-time

● Innovators include IBM Watson, Nuance, Google, and AT&T

● IBM Watson speech API info available at:○ https://www.ibm.com/smarterplanet/us/en/ibmwatson/developerclou

d/speech-to-text.html

Speech recognition example:

curl -k -u “username:password” -X POST --limit-rate 40K \--header "Content-Type: audio/flac” --header "Transfer-Encoding: chunked" \--data-binary @audio.flac \“https://stream.watsonplatform.net/speech-to-text/api/v1/recognize?continuous=true”

Disrupt SF 2015

{ "results": [ { "alternatives": [ { "confidence": 0.8691191673278809, "transcript": “this is some transcribed speech" }

Integrating Speech Recognition into your App

curl -k -u “username:password” -X POST --limit-rate 40K \--header "Content-Type: audio/flac” --header "Transfer-Encoding: chunked" \--data-binary @audio.flac \“https://stream.watsonplatform.net/speech-to-text/api/v1/recognize?continuous=true”

Disrupt SF 2015

Giving machines sight: Computer Vision

Cloud APIs provide the ability to recognize objects (buildings, cars, ...), logos, and faces contained

within photographs.

What you can do: drive search in your application with camera-phone images, automatically organize

photo libraries, "visually" index video files, filter inappropriate content ...

Disrupt SF 2015

Integrating Computer Vision into your App

● APIs tag photos with what they contain, recognize faces, read signs /product labels, and more

● Innovators include IBM Watson, AlchemyAPI, Google, Baidu, and others

● IBM Watson + AlchemyAPI computer vision API info available at:○ http://www.alchemyapi.com/products/alchemyvision○ http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/

visual-recognition.html

Computer Vision 1-liner:

curl --data-binary @photo.jpg ”http://access.alchemyapi.com/image/ ImageGetRankedImageKeywords?imagePostMode=raw&apikey="$API_KEY

Disrupt SF 2015

Integrating Computer Vision into your App

curl --data-binary @photo.jpg "http://access.alchemyapi.com/calls/image/ ImageGetRankedImageKeywords?imagePostMode=raw&knowledgeGraph=1&apikey="$API_KEY

"imageKeywords": [ { "text": "boxing", "score": "0.970688”, “knowledgeGraph”: { “typeHierarchy”: “/activities/sports/boxing” } }, { "text": "sport", "score": "0.930862", “knowledgeGraph”: { “typeHierarchy”: “/activities/sport” } }

Disrupt SF 2015

Cloud APIs provide automatic translation of text across many different languages.

What you can do: automatically translate foreign-language content for your users, real-time

translation of forum posts or chat sessions, search within foreign language documents ...

Breaking language barriers: Machine Translation

Disrupt SF 2015

Integrating Machine Translation into your App

● APIs automatically translate between many different languages.

● Innovators include IBM Watson, Google, and Microsoft

● IBM Watson translation API info available here:○ https://www.ibm.com/smarterplanet/us/en/ibmwatson/developerclou

d/language-translation/api/v2/

Language Translation example:

curl -u “username:password“ -H "content-type: plain/text“ -X POST -d "text=Hello world.“ "https://gateway.watsonplatform.net/language-translation/api/v2/translate?source=en&target=es"

Disrupt SF 2015

Integrating Machine Translation into your App

"translations": [ { "translatedText": ”Where is my hotel?" } ]

“¿Dónde está mi hotel?"

curl -u “username:password“ -H "content-type: plain/text“ -X POST -d "text=¿Dónde está mi hotel?" "https://gateway.watsonplatform.net/language-translation/api/v2/translate?source=es&target=en"

Disrupt SF 2015

Cloud APIs provide the ability for computers to derive "meaning" from text (documents, web pages,

tweets, …)

What you can do: tag documents by topic, drive content recommendation engines, contextually

target advertisements ...

Reading like a Human: Natural Language Processing

Disrupt SF 2015

Integrating Natural Language Processinginto your App

● APIs automatically tag documents, extract facts and events, ...

● Innovators include IBM Watson, AlchemyAPI, Google, and others

● IBM Watson + AlchemyAPI language API info available here:○ https://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/

services-catalog.html

○ http://www.alchemyapi.com/

Named entity tagging + sentiment analysis 1-liner:

curl "http://access.alchemyapi.com/calls/text/ TextGetRankedNamedEntities?apikey=$API_KEY&sentiment=1&text=Woohoo+I+am+coming+to+San+Fran!"

Disrupt SF 2015

"language": "english", "entities": [ { "type": "City", "relevance": "0.33", "sentiment": { "type": "positive", "score": "0.325672" }, "count": "1", "text": ”San Fran", "disambiguated": { "name": ”San Francisco", "website": "http://www.sfgov.org", "dbpedia": "http://dbpedia.org/resource/San_Francisco", "freebase": "http://rdf.freebase.com/ns/m.0d61p"

”Woohoo I am coming to San Fran! #TCDisrupt"

Integrating Natural Language Processing into your App

curl "http://access.alchemyapi.com/calls/text/ TextGetRankedNamedEntities?apikey=$API_KEY&sentiment=1&text=Woohoo+I+am+coming+to+San+Fran!"

Disrupt SF 2015

Expert in a box: Question Answering

Cloud APIs provide the ability to answer natural language questions, such as "Who invented the

Segway?"

What you can do: leverage questions like "was this company acquired?" to trigger processes in data pipelines or GUI displays, automatically answer

questions from your own corpus of data ...

Disrupt SF 2015

Integrating Question Answering into your App

● APIs automatically answer questions posed in plain language

● Innovators include IBM Watson, AlchemyAPI, Google, and others

● IBM Watson question answering API info available here:○ https://www.ibmdw.net/watson/docs/

IBM Watson Example API Call JSON:

{ "question":{ "questionText":"His 1983 hit \"Beat it\" featured Eddie Van Halen on guitar." }}

Disrupt SF 2015

Integrating Question Answering into your App

"answers": [ { "id": 0, "text": "Michael Jackson", "confidence": 0.42276 }

{ "question":{ "questionText":"His 1983 hit \"Beat it\" featured Eddie Van Halen on guitar." }}

Disrupt SF 2015

Putting it all together: Sample A.I. App Workflow

Use Watson Speech API to accept speech input

Use Watson Translation API to convert to English

“Es esta venenosa?"

"Is this poisonous?"

Take a picture of the item the question is about

Use AlchemyVision API to interpret the photograph "fly agaric"

Use Watson Q&A API to answer the question Is this poisonous + fly agaric

Example app: "Voice + visual assistant for international hikers"

Disrupt SF 2015

Getting Started: Watson + Alchemy Resources

Sign up for Bluemix (Get API keys!)

https://console.ng.bluemix.net/registration/

GitHub (Sample code!)

Watson: https://github.com/watson-developer-cloudAlchemyAPI: https://github.com/AlchemyAPI

App Gallery (Get inspired!)

http://devpost.com/software/built-with/ibm-watson

Ask for help! Just look for someone wearing a Watson shirt.

Disrupt SF 2015

Hackathons: Where great ideas are born!• I’ve been sponsoring and judging hackathons for the past 5 years

• Seen multiple teams raise funding, build companies, have successful exits

• We hold internal hackathons monthly and frequently see innovations pushed into production

• If your startup isn’t doing internal hackathons yet – get going! They’re *awesome*

Let’s go build something amazing. Change the world. Use A.I. to make it happen!

Disrupt SF 2015

Thanks for listening! Questions ?

Elliot TurnerDirector of Alchemy, IBM Watson

CEO & Founder, AlchemyAPI

eturner@us.ibm.com