ArBaWing Ar$ficial Bandits and...

ArBaWingAr$ficialBanditsandWingmen

aprojectonFCASautonomyPe<erÖgren

ArBaWing

MessagesfromThisMorning

•  “Autonomyisacurrentpriority”–  AFRLCommanderMcMurry

•  “AkeytrendisAutoma4onandAutonomoussystems”–  SaabDirectorofFutureBusiness,LarsSjöström:

ArBaWing

Outline•  ProblemFormula$on– USAFPerspec$ve– Robust,Efficient,TransparentAutonomy– WhiteBoxvsBlackBoxAutonomy

•  Resultssofar•  FocusAhead

ArBaWing

ExampleResult

ArBaWing

ProblemFormula$on

•  FutureCombatAirSystem(FCAS):– MixofMannedandUnmannedsystems–  DistributedSensorsandWeapons–  FlexibleandAdap$ve

•  Needs:–  AutonomousDecisionMaking

•  Robust,Transparent,Efficient–  HumanAutonomyTeam

•  Robust,Transparent,Efficient

ArBaWingProjectGoals

ArBaWing

USAFPerspec$veUSAFVision:•  Human-AutonomyTeamsCri$calfactors:•  Robustness•  AutonomyLevels•  Easeofinterac$on•  Automa$ontransparency(i.e.Robust,Transparent,Efficient)

MicaEndsley

ArBaWing

WhyRobustandEfficientAutonomy?

•  WhyRobust?– Combatisunpredictable– Avoidbri<leautonomy(narrowassump$ons)

•  WhyEfficient?– Needtowincombat

ArBaWing

WhyTransparentAutonomy?

•  Operatorneedsto– KnowWhatsystemdoesandWhy– TrustSystem– StayintheLoop

•  RulesofEngagementàTransparency– Whydidyoufire?– Changesbetweenmissions

ApproachestoAI

•  BlackBoxExamples–  DeepLearning

•  State-of-the-Arton–  AlphaGo–  Objectrecogni$on–  OldAtarigames(several)

•  WhiteBoxExamples–  FiniteStateMachines–  Subsump$onArchitechture–  BehaviorTrees

•  State-of-the-Arton–  NewComputergames–  AirCombatSimula$on

Proposedsolu$on

•  DeepLearning–  Efficiency(extra)–  Needs30milliontrainingdatapoints•  fromWhiteboxdesign

•  BehaviorTrees–  Transparency–  Robustness–  Efficiency(State-of-Art)

•  and...–  RulesofEngagementcheck

–  Verifica$on/Valida$on–  Quickadapta$ontochange(Amraam->Meteor)

& Combina$on

AItool:BehaviorTrees

•  FromComputerGameAI•  Generalizesearlierapproaches–  FiniteStateMachines–  Subsump$onArchitecture–  Teleo-Reac$veApproach–  DecisionTrees

•  BTeditorsforMajorGameEngines:–  UnrealEngine–  Unity3D–  Pygame

•  Advantages– Modularity–  Flexibility–  Reuseability

ArBaWing

Resultssofar:Forma$ons

ArBaWing

Resultssofar:Combat1vs1

ArBaWing

Resultssofar:Combat2vs1

ArBaWing

Resultssofar:Combat2vs2

ArBaWing

Resultssofar:Patrolling

ArBaWing

Resultssofar

•  CoderunningdailyatFLSC(aircombatsim.center)

•  4pilotsvs4virtual– killsonbothsides– hardtotellwhoiswho

ArBaWing

FocusAheadforKTH/Saab

•  Inves$gateHuman-AutonomyTeams– CombineWhite/BlackBoxSolu$ons

– DifferentAutonomyLevels– Robustness,Efficiency,Transparency

ArBaWing

Organiza$on:KeyPartners•  Pe<erÖgren

–  AssociateProf.inRobo$csandAutonomousSyst,KTH–  9yearsatFOI,designingAirCombatbehaviorsatFLSC

•  HenriqueCostaMarques,PhD–  FormerBrazilianAirForcePilot–  ITAresearcherinAutonomousAirCombat

•  JoaoAlexandroB.M.Vilela–  FormerBrazilianAirForcePilotandflightinstructor–  AELBusinessDevelopmentmanager

•  LarsPääjärvi–  HeadofSensorFusionandTacLcalControl,SaabAeronau$cs

ArBaWing

Funding

•  ITA/AEL– 2MScstudentsduring2016– 2PhDstudentsstar$ng2017•  AELFundingfor1PhDstudentatITA

•  KTH/Saab– 1MScstudent2016– WillapplyforNFFP7project

ArBaWing

ThankYou...