Innovation and Inspiration through Cognitive Computing: IBM Watson

1

InnovationandInspirationthroughCognitiveComputing:IBMWatson

SwamiChandrasekaranExecutiveArchitectIBMWatsonswamchan@us.ibm.com@swamichandra

Applied Artificial Intelligence Conference, San Francisco - May’2016

©IBM2016AppliedArtificialIntelligenceConference 2

PleaseNote

IBM’sstatementsregardingitsplans,directions,andintentaresubjecttochangeorwithdrawalwithoutnoticeatIBM’ssolediscretion.

Informationregardingpotentialfutureproductsisintendedtooutlineourgeneralproductdirectionanditshouldnotbereliedoninmakingapurchasingdecision.

Theinformationmentionedregardingpotentialfutureproductsisnotacommitment,promise,orlegalobligationtodeliveranymaterial,codeorfunctionality.Informationaboutpotentialfutureproductsmaynotbeincorporatedintoanycontract.Thedevelopment,release,andtimingofanyfuturefeaturesorfunctionalitydescribedforourproductsremainsatoursolediscretion.

PerformanceisbasedonmeasurementsandprojectionsusingstandardIBMbenchmarksinacontrolledenvironment.Theactualthroughputorperformancethatanyuserwillexperiencewillvarydependinguponmanyfactors,includingconsiderationssuchastheamountofmultiprogrammingintheuser’sjobstream,theI/Oconfiguration,thestorageconfiguration,andtheworkloadprocessed.Therefore,noassurancecanbegiventhatanindividualuserwillachieveresultssimilartothosestatedhere.

5/25/16


Hi,I’mSwamiChandrasekaran

@swamichandra

ChiefTechnologistinIBMWatson–

CognitiveSolutions


Chapter1

TheInquisitiveMind


Expertise matters more today than ever before.


Whatwillaninquisitivemindwanttoknowfromtext?

5/25/16

Frankly, sophisticated audiences are not a problem. Dumb audiences are a problem. But I think audiences are getting more sophisticated — that’s just a product of time. In the ’50s, audiences accepted a level of artifice that the audiences in 1966 would chuckle at. And the audiences of 1978 would chuckle at what the audience of 1966 said was okay, too. The trick

is to try to be way ahead of that curve, so they’re not chuckling at your movies 20 years down the line. With Pulp Fiction, people were like, “Wow, I have never seen a movie like that

before. A movie can do that?” I don’t think that’s the case anymore. I’m not talking ridiculously over anyone’s head anymore. I think people watched Django and InglouriousBasterds and thought they were really out there, but they got it …. Brian DePalma used to

talk about that all the time, about all the s–t he had to deal with, at every single junket. And suddenly they’re all blaming each other for the apocalypse, but the apocalypse is the Civil

War. But that wasn’t what I was necessarily thinking about on page 72 in my bedroom when I was writing it. Gracias !!

KeyEntities/Concepts&

Relationshipsexpressed

Expandonthekey

Concepts&ConceptAssociations

Explore informationfromanextractedKnowledgeGraph

Sentiment &SentimentTargets

Deeperunderstandingonauthor’spersonality

Language identification

Ask questions&interactinnatural

languageResonance,EmotionandToneofthetext

http://www.ew.com/article/2015/12/31/quentin-tarantino-hateful-eight-interview


EntitiesDetected ConceptsDetected


Emotion&Tone

Sentiment

Taxonomy


KnowledgeGraph ImportantKeywords


Tarantino&Federer– Asseenbyahumanbeing


Tarantino&Federer– AsseenbyWatson’sVisualRecognition

5/25/16

Multiclassdetection

FacialRecognition

Customclasses

©IBM2016AppliedArtificialIntelligenceConference 1212© 2014 International Business Machines Corporation

Cognitiveisthenewcompetitiveadvantage.

© 2014 International Business Machines Corporation


Chapter2

CognitiveComputing


Cognitivesystemsdemocratizeinnovationbyscalingknowledge.

S en so r s Da t a Ana l y t i c s I n fo rma t i on Cogn i t i ve

In g es t i on , I n t eg ra t i on , Governan c e


Cognitivesystems amplifyhumancognition.


Andthecognitivesystemsarenotprogrammed.Theylearn theirbehavior

throughtraining.


Examples include:Analyst reportstweetsWire tap transcriptsBattlefield docsE-mailsTextsForensic reports

NewspapersBlogsWikiCourt rulingsInternational crime databaseStolen vehicle dataMissing persons data

Data, information, and expertise create the foundation.

Cognitivesystemsrelyoncollectionsofdataandinformation


DissectingCognitiveSystems

5/25/16

CognitiveSystems

Vision

Language

Speech

Data&Insights

CognitiveSystemsUnstructuredData K n ow l e d g e

EntityExtraction SentimentAnalysis EmotionAnalysis ConceptTagging AuthorExtraction EntityResolution

PsychographicAnalysis Dialog TexttoSpeech MLAnnotations RelationExtraction KnowledgeGraph

FaceDetection ImageClassification PassageRanking FeedDetection TradeoffAnalysis ParetoAnalysis

InformationTheory DomainLexicons FeatureWeighting MachineLearning NeuralNets EntityResolution

SyllableAnalysis

VoiceSynthesis

GraphComputing

ScaleoutIngestion

MachineTranslation ImageTagging LanguageIdentification Multi-classDetect Diarization LanguageModels NLClassification

Analytics

Descriptive

Classification

Clustering

Reasoning

KnowledgeGraph


Three capabilitiesdifferentiatecognitivesystemsfromtraditionalprogrammedcomputingsystems…

ReasoningTheyreason. Theyunderstandunderlying ideasandconcepts. Theyformhypothesis. Theyinferandextractconcepts.

LearningTheynever stoplearning getting morevaluablewithtime.Advancing witheachnewpieceofinformation,interaction, andoutcome. Theydevelop“expertise”.Understanding

Cognitive systemsunderstandlikehumansdo.

….allowingthemtointeractwithhumans.


RetrieveandRank

EntityExtractionSentimentAnalysisEmotionAnalysisKeywordExtractionConceptTaggingTaxonomyClassificationAuthorExtractionLanguage DetectionTextExtractionMicroformats ParsingFeedDetectionLinkedDataSupportConceptExpansionConcept InsightsDialogDocumentConversionLanguage Translation

Natural LanguageClassifierPersonality insightsRelationship ExtractionRetrieve andRankToneAnalyzerEmotiveSpeech toTextText toSpeechFaceDetectionImageLinkExtractionImageTaggingTextDetectionVisual InsightsVisualRecognitionAlchemyData NewsTradeoffAnalytics

50underlying technologies

NaturalLanguageClassifier

ToneAnalyzer

…andthenleverageWatsonAPIstoapplycognitivecapabilities.

http://www.bluemix.com


Chapter3

Actionsspeaklouder

Watsoniscreatinganewpartnershipbetweenpeopleandcomputersthat

enhances,scales,andaccelerates humanexpertise

TabulatingSystemsEra

1900

ProgrammableSystemsEra

1950

CognitiveSystemsEra

2011


CogniToys Capabilities• Conversationalwithapersonality!• Ageappropriatecontentbasedonchild’sprevious

interactionswiththetoyStorytellingStorycreationFuncommandstodiscoverduringplay

• Proprietaryeducational frameworkthatfuseseducational contentintothetoysplaypattern

• ParentPanelthatgivesparentsreal-time feedbackonachilds learningbasedontoy-childinteraction

PLAYANDLEARN- BACKEDBYIBMWATSONCogniToys arethenextgenerationofinternetconnectedsmarttoysthatlearnandgrowwithyourchild.

www.cognitoys.com


VariousadoptionpatternsworkingacrossstructuredandunstructureddatawithNLP,Vision,SpeechandMachineLearning

ENGAGE DISCOVEREXPLORE DECIDE EMBED

Expressintents,askquestionsforgreaterinsight

Naturallanguagedialogue

BuildBotsforvariouschannels

360-degreeinfoappsatthepointofimpact

PlatformAPI’stofurtherenhancecognitiveprocessing

Findexternalinformationinrealtime

Whenfindingthequestion isasimportantasfindingtheanswer

Findrationaleforgivenresponses

Scalingtomillionsofdocuments

Ingestandanalyzedomainsources,infomodels

Evidence-baseddecisionswithgreaterconfidence

BuildyourapplicationusingcallableWatsonServiceAPIs

Canbecombinedwiththe100sofotheravailableAPI’sonBluemix

Transformcustomerexperiences

Search, consolidate&analyze

enterprisedata

AccelerateResearchinto

Insight

Evaluatepossibleoptions&choosethe

bestone

EnrichappswithCognitive,NLP,Vision&MachineLearningcapabilities


Someofthekeyneedsweareseeingfromcustomers…

• Helpmeseebeyondthehype

• Helpgetmestartedquickly&rightawaya.k.a speedtomarket

• BreadthofcapabilitiesacrossLanguage,Vision,Speech,Insights,Analytics

• Mydataismycrownjewel

• Helpmewiththedata– acquisition,cleansing,mungingandingestion

• Idon’thavedatascientists…yet

• Abilitytotrain/adaptthemodelswithmyowndata

• Abstractthehardscienceawayfromme

• Abilitytousemyownlanguagemodels

• API’s.API’s.API’s

• Platformcanscale&issecure

• Whatdoyouhaveformyindustry?

5/25/16



Watsonatworkintheworld.

5/25/16

"Woodside totapintoIBM'sWatson” - CIO

"IBM’sWatsonNowPowers AIForUnderArmour”- TechCrunch

"SoftBank's Pepper robotisgetting anintelligence boostfromIBM'sWatson"-TheVerge

"Medtronic, IBMteamupondiabetesapptopredict possiblydangerouseventshoursearlier."- TheWashingtonPost

"IBM’sWatsonHelpedPickKia’sSuperBowl‘Influencers’”- WallStreet Journal

"HowCanIHelp You?IBM'sWatsonPowers Hilton's RoboticConcierge" -FastCompany

"IBMandApple canputWatson'sA.I. insights insideAppleWatch"-ComputerWorld

"ThomsonReuters todeploy IBMWatsontechnology”- InfoTechLead

"IBM'sWatsonLandsAJobWithKPMG.” -InformationWeek

"TheNorthFace UsesIBM'sWatsontoMakeOnline ShoppingSmarter" -The Street


Otherexamplesofcognitiveapplications….• Self-ServiceStudentAdvisor

• FinancialAdvisor

• PopulationHealthManagement

• TechnicalSupportServicesSystem

• TumorDetection

• LifeSciencesExploration

• RetailShoppingAssistant

• Productandservicequality

• Drugefficacy

• Frauddetection

• OncologyAdvisor

• DigitalMarketingdevelopment&execution

• ClinicalTrailsMatching

• DemandGenerationInsights

• Customersatisfactionandsurveyanalysis

• Claimsanalysis,paymentvalidationandlossreview

• CognitiveServiceMaintenance


MoreFoodforthought….

• ContactCenterInsights

• Muti-channelVirtualAgents

• CognitiveCommerce

• CognitiveRoboticsProcessAutomation

• Conciergetoaddressguestneedsandenquiries

• Emotionalanalysisfromtext,visionandspeech

• Audience/visitorinsightsfromtheirreviewsandsocialposts

• Analysis&Insightfromcustomerconversations

• TrendingTopics&affiliatedtopics

• CognitiveLocationbaseddecisionsforentertainmentvenues

• VirtualAgentsleveragingBots

• HR/WorkforceOptimization

• Discoverywithevidence-based,relevantpathways

5/25/16


Speakingoffoodandcocktailthatwaspromised….

5/25/16

https://www.ibmchefwatson.com/recipe/03ade0cdfa4a22ecc0c4a37393f51e7e

© 2016 IBM Corporation 324/11/16

facebook.com / ibmwatson ibmwatson.com @ibmwatson

WhatwillyoudowithCognitiveComputing?

Improveyourprocessesandoperations

Enablenewkindsofengagement

Createbetterproducts

Leverageexpertise

EnablenewbusinessmodelsData Watson

Data & Analytics

Innovation and Inspiration through Cognitive Computing: IBM Watson