AmelaKarahasanovićamela@sintef.no

InteractingwithAIModule3

WorkingandlivingwithAI

Moduleoverview

[3.1&3.2]EvaluationofinteractionwithAI

Overview

Task-orientedevaluation

Abilitybasedevaluation

UserExperience,ValuesandAI

[3.3&3.4]Human- AIpartnership

Human-robotteams

TaskdistributionbetweenhumansandAI

Levelsofautomation

Human-in-the-loopandsituationawareness

[3.5&3.6]Lessonslearnedfromstudiesofhuman– AIinteractionPersonalityofrobotsandtrust

Empathywithalgorithms

Evaluationinthelaband"inthewild"

Evaluationinindustrycontext

[3.7&3.8]Writingworkshop

[3.3&3.4]Human- AIpartnership

• Human-robotteams• TaskdistributionbetweenhumansandAI• Levelsofautomation• Human-in-the-loopandsituationawareness

• SometasksincludinganexamplefromtheAirTrafficManagement• Assignments

What isAI?

Artificialintelligence(AI)systemsaresoftware(andpossiblyalsohardware)systemsdesignedbyhumansthat,givenacomplexgoal,actinthephysicalordigitaldimensionbyperceivingtheirenvironmentthroughdataacquisition,interpretingthecollectedstructuredorunstructureddata,reasoningontheknowledge,orprocessingtheinformation,derivedfromthisdataanddecidingthebestaction(s)totaketoachievethegivengoal.Asascientificdiscipline,AIincludesseveralapproachesandtechniques,suchasmachinelearning(ofwhichdeeplearningandreinforcementlearningarespecificexamples),machinereasoning(whichincludesplanning,scheduling,knowledgerepresentationandreasoning,search,andoptimization),androbotics(whichincludescontrol,perception,sensorsandactuators,aswellastheintegrationofallothertechniquesintocyber-physicalsystems)

HIGH-LEVELEXPERTGROUPONARTIFICIALINTELLIGENCE,EUCommissionhttps://ec.europa.eu/digital-single-market/en/news/definition-artificial-intelligence-main-capabilities-and-scientific-disciplines

Bigquestion– 5minutes

• WhichtasksdoYOUthinkcouldbedonebyAI?• WhichtasksdoYOUthinkshouldnotbedonebyAI?

• Discussioninthegroups

Robotsrole:designandfosteringtrust(Philipsatal.2016)

6

• Arobotisateammemberinsteadofatool• Peoplesmentalmodelsofrobotsdoesn'tfitrealityleadingtodistrustordiscountingusingtheautomatedsystems

Robotsrole:designandfosteringtrust(Philipsatal.2016)

7

• Replacephysicalcapabilities• BigDogrobot

• Multiplyphysicalcapabilities• Industrialrobot

• Augment/ExtendphysicalCapabilities• AMAROB'sfriendrobot

SINTEFs friendly robot

• https://www.sintef.no/en/latest-news/a-friendly-robot/• https://www.youtube.com/watch?v=sUp3EL-8xgE&feature=youtu.be

Robotsrole:designandfosteringtrust(Philipsatal.2016)

9

• Providecomfort• Parorobot

• Inform/Augmentemotionalcapabilities• NAOrobot,Romibo robot• Teachingsocialskills,• Therapeutichorseriding(autism)

Paro helping elderly

https://www.bing.com/videos/search?q=paro+robot+elderly&view=detail&mid=6DDD0D7EE6BD0D7D01D36DDD0D7EE6BD0D7D01D3&FORM=VIRE

Chatbotasafriend

https://gemini.no/2019/10/kan-man-bli-venn-eller-kjaereste-med-en-chatbot/

Robotsrole:designandfosteringtrust(Philipsatal.2016)

12

• Multiplycognitivecapabilities• Additionalsensoryinformation

• Extendcognitivecapabilities• robotshelpinginnucleardisaster

• Human-dogsnarcoticssearchteam• reciprocalinterdependencies:handlerprovidessearchguidelines,dogprovidessensory

alerts,teamprovideslocationofnarcotics

What isAI?

Artificialintelligence(AI)systemsaresoftware(andpossiblyalsohardware)systemsdesignedbyhumansthat,givenacomplexgoal,actinthephysicalordigitaldimensionbyperceivingtheirenvironmentthroughdataacquisition,interpretingthecollectedstructuredorunstructureddata,reasoningontheknowledge,orprocessingtheinformation,derivedfromthisdataanddecidingthebestaction(s)totaketoachievethegivengoal.Asascientificdiscipline,AIincludesseveralapproachesandtechniques,suchasmachinelearning(ofwhichdeeplearningandreinforcementlearningarespecificexamples),machinereasoning(whichincludesplanning,scheduling,knowledgerepresentationandreasoning,search,andoptimization),androbotics(whichincludescontrol,perception,sensorsandactuators,aswellastheintegrationofallothertechniquesintocyber-physicalsystems)

HIGH-LEVELEXPERTGROUPONARTIFICIALINTELLIGENCE,EUCommission

14

Decisionmakingincomplextime-criticaldomains

Steag

Decisionsupportsystemisasystemsupportingdecision-makingactivities.

Typeofproblemswheredecisionsupportsystemscanbeusefulandwaysforinvolvinghumans

15

• Combinatorialproblems;largesearchspace– humanscanhelppruningadecisiontree• Computationallyintensiveproblems;humanscanguidecomputationandweightcost/benefitsoffurthercomputations• Heuristic-heavyproblems;humanshelpselectingheuristics• Visualproblems;abstractproblemsthatmightberepresentedvisually:imageclassification,geographicalclustering;visualpresentationhelphumans(hold-on,freeze)

Malasky,J.S,HumanMachineCollaborativeDecisionMakinginaComplexOptimizationSystem,MIT,2003

What isthe problem?

…anAmericanAirlinesflightcrashedinthemountainsofColombiain1996killingallaboardduetoamixtureofprogrammingerror,overrelianceontheautomation,andpoorfeedbackdeprivingthepilotsofanunderstandingofwhattheautomationwasdoing

(Endsley,2004)

Approachestotaskallocation

17

• Adhocallocation• Formalandbalancedapproachincludingcomparativeassessmentofhumanandmachineperformance;usingKeyPerformanceIndicators(performance,situationawareness,costs,cognitivetaskload,trust,humantendencyforboredom,keepingskills,recoveryfromsystemfailure,teamdynamic…)andknowledgeaboutman/machinecapabilities• Takeintoaccountpolitical,ethicalandlegalreasons

Approachestotaskallocation

18

• SheridanandVerplank's 10levelAutonomyscale• Level1– humanstakealldecisions• Level2– Computeraidsinhighlightingkeyinformationonscreenordeclutteringirrelevantinformation• Level3- Systemgatherskeyinformationandintegrates• Level4- Computeraidsindoingeachactionasinstructed• Level5- Computercompletelycarriesoutsingularorsetsoftaskscommandedbyhuman• Level6- Computerandhumangeneratedecisionoptions,humandecidesandcarriesoutwithsupport• Level7- Computergeneratesrecommendedoptions,humandecides(orinputownchoice)andsystemcarriesout

• Level8– informsthehumanonlyifasked• Level9– informsthehumanonlyifthecomputerdecidesto• Level10– thecomputersactsautonomouslyignoringthehuman

Sheridan,T.B.,Verplank,W.,HumanandComputerControlofUnderseaTeleoperators,MIT,1978

Adaptiveautomation

Decisionofwhentopasscontrolfromautomationtothehumanbasedon:• Aconsistenttimeinterval• Theoccurrenceofcriticalevents• Detectionofhumanperformancebelowacertaincriterionlevel• Useofpsychophysiologicalmonitoringtodetectlossesofarousalorother

cuesofpoorperformance(e.g.,lossofconsciousness)• Theuseofmodelsofhumanperformancetopredictthebesttimesto

intervene

Acompanyintroducesanintelligentagent(robot)thatwilltakecareofrecruitmentandhiringnewemployees.Describethefunctionalitythatsuchagentshouldhave.Whichtaskcoulditperform?Whendoingthisconsidernotonlycurrenttechnologybutalsotechnologythatwillcomeinrelativelynearfuture(5-10years).Thenconsidertwoscenarioswherethisagenthavetwodifferentautomationlevels.Inthefirstscenariotheagentwillhavealevelofautomation6or7.Inthesecondscenariotheagentwillhavealevelofautomationbetween8,9or10.Whichtasksshouldtheagentperform,andwhichtasksshouldhumansperform?Whatareadvantagesanddisadvantagesrelatedtothistaskdistribution?Whatarethepossibleproblemsthatmightoccur?Howtoovercomethem?

Task– tobedoneintheclassroom(15minutes)

Youhaveanintelligentagent(canbearobot)asyourpersonalassistant.Describethefunctionalitythatsuchagentshouldhave.Whichtaskcoulditperform?Whendoingthisconsidernotonlycurrenttechnologybutalsotechnologythatwillcomeinrelativelynearfuture(5-10years).Thendiscusstwoscenarioswherethisagenthavetwodifferentautomationlevels.Inthefirstscenariotheagentwillhavealevelofautomation6or7.Inthesecondscenariotheagentwillhavealevelofautomationbetween8,9or10.Discusswhichtaskstheagentperformandwhichtasksshouldhumansperform.Whatareadvantagesanddisadvantagesrelatedtothistaskdistribution?Whatarethepossibleproblemsthatmightoccur?Howtoovercomethem?

Task– tobedoneintheclassroom(20minutes)

“theperceptionoftheelementsintheenvironmentwithinavolumeoftimeandspace,thecomprehensionoftheirmeaning,andtheprojectionoftheirstatusinthenearfuture”(Endsley,1988).

Situationawareness

23

Importantincomplextime-criticaldomains

Steag

• Importantwithorwithoutautomation• Differentlevelsofautomatonleadtodifferentchallenges• Out-of-the-loopsyndrome– whatifautomationfails,boredom,fatigue

• Loosingthecompetenceandabilitytoadequatelyreactinnon-nominalsituations

•GOTOhttp://www.freegames.net/game/air-traffic-control.htmlandplayforawhile•Evaluate situation awarenes inthe group byusingthe givenquestionnaire andasimpleinterview

Task – tobedoneinthe classroom (15minutes)

ATMexampleEvaluationof DACwith ATCOs

25

26

Layoutof the exercise

27

ATCOs CWPstatic approach ATCOs CWPDAC

Datacollection

• Observations• Logfiles(simulator,UI)• Screencaptures• Videorecordingofscreens• Interviews(audiorecords)• AudiorecordsofthecommunicationbetweentheATCOsandpilots• Questionnaires

28

29

Module3– Groupassignment– Appendix3–deadline15.11.2019Eachgroupistoevaluatetheonewidelyusedsystemforevaluation(Netflixrecommendationengine,googlemapsinstruction,ruter…)orthesystemyouhavebeenworkingonduringthefirsttwomodules.Process:• Decidethesubjectandthescopeoftheevaluation.Whatareyougoingtoevaluate?Whyhaveyouselectedthissystem?• MakeaplanforevaluatingthesystemusingtheguidelinesforHuman-AIInteraction.Howareyougoingtoevaluatethesystem?• Evaluatethesystemover3-4days• Describewhathaveyoufound

Deliverable:• Describebrieflytheevaluationplan,theevaluationresultsandlessonslearntfromusingtheguidelines(3-4pages).Thisshouldbe

includedasincludeasAppendix3inthefinalreport

Expectedworkload:• 4-8hoursworkforeachgroupmemberIncaseofproblems,emailAmela(amela@sintef.no).

Module3– Groupassignment– Finalreport

• Adescriptionofthegroup,whoyouare- names.• Adescriptionofwhatareaof“interactionwithAI”youareinterestedinworkingwith.• Backgroundsection:Positionyourworkrelativetoexistingknowledgeandpractice• Minimum1maximum2questionsthatyouwanttoaddress.Pleasewritesomesentencesaboutthequestions.Thesequestions

canchangeandevolvelaterinthemidtermreportandinthefinalreport- asyougoaboutinvestigatingyourquestions.• Methodsection– overallapproach,designprocess(optional,butencouraged),datacollection methods• Sketchesand/orprototypes(optional,butencouraged)• Findings(progress,initialoutcomes)• (new)Discussion• (new)Conclusion• (new)LessonsLearned• Minimumseven referencestoliterature.

.

Collaborationandlevels of automation

Philipsatal.(2016)giveataxonomyandexamplesofhuman-robotscollaboration.Choose2-3examples,describetheirlevelsofautonomyasdescribedin(Endsley,2004;chapter10.5.2),andreflectonadvantagesanddisadvantagesifwedecrease/increasetheircurrentlevelofautonomy.Pages2-4

Module3– Individualassignment– deadline15.11.2019