AirSim: A Powerful Simulator for Robotics Research · import cv2 import sys ('127.e.e.1')...

AirSim: A Powerful Simulator for

Robotics Research

Yulai Weng

CIS 700/002: Topics in Safe Autonomy

Department of Computer and Information Science

School of Engineering and Applied Science

University of Pennsylvania

02/12/2019

1

2

Successes of Machine Intelligence

Real World Flying Systems

Three Fundamental Challenges

4

Old Version of UAV Simulators

5

AirSim: The Next Generation Simulator

6

What Does Simulator Enables?

7

Why Use Unreal Engine?

8

The Heart of the Vehicle

9

How Simulator Works?

10

What Does Physics Engine Do?

11

The Physics Loop

12

May the Force & Torque be with You

13

Physics: Dynamics

14

Simulating IMU

15

Simulating Barometer

16

Simulating Magnetometer

17

The Architecture of AirSim

18

AirSim is Open Source

19

Experiment: Simulation vs. Reality

20

AirSim Has APIs

21

Make Drone Move in AirSim Using APIs

22

23

AirSim Extensibility

24

AgIoT: Precision Agriculture

25

AgIoT: Vision

26

AgIoT: System Architecture

27

Autonomous 3D Scanning of

Large Structures

28

Expands AirSim AI Simulator to

Include Autonomous Car Research

29

End-to-End Deep Learning for

Autonomous Driving

30

Deep Reinforcement Learning

for Autonomous Driving

31

AirSim on Unity

32

Thanks !

33