24
Alexander Kolbai Rainer Bareiß Connected Autonomous Driving December 9th 2019 AI-Monday, Porsche Digital Autonomous Driving - Meetup Connected Autonomous Driving

Autonomous Driving - Meetup Connected Autonomous Driving · This Meetup is for autonomous driving enthusiasts, self-driving car engineers and those who want to create a seamless connected

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Autonomous Driving - Meetup Connected Autonomous Driving · This Meetup is for autonomous driving enthusiasts, self-driving car engineers and those who want to create a seamless connected

Alexander KolbaiRainer BareißConnected Autonomous Driving

December 9th 2019AI-Monday, Porsche Digital

Autonomous Driving - MeetupConnected Autonomous Driving

Page 2: Autonomous Driving - Meetup Connected Autonomous Driving · This Meetup is for autonomous driving enthusiasts, self-driving car engineers and those who want to create a seamless connected

This Meetup is for autonomous driving enthusiasts, self-driving car engineers and those who want to create a seamless connected user experience of mobility, information and services in cities.

We want to connect schools, creatives, engineers, startups, companies, politics for exchange & projects. We’re part of a growing worldwide community –

a „Homebrew computer club for autonomous mobility“

- that was started by Chris Anderson, Will Roscoe and Adam Conway: diyrobocars.com.

Rainer Bareiss Alexander Kolbai

Founded: October 2017Members: 973Meetups: 26 (22 in Stuttgart, 3 Silicon Valley, 1 Leipzig 35c3)

We‘re working together with leaders and friendsof the autonomous driving maker & startupscene and industry in

▪ Oakland▪ Berlin▪ Detroit▪ Ann Arbor▪ Shenzhen

Connected Autonomous Driving – Stuttgart / RB / AK 12.12.2019Seite 2

Connected Autonomous DrivingOur Mission

Sponsered by

Page 3: Autonomous Driving - Meetup Connected Autonomous Driving · This Meetup is for autonomous driving enthusiasts, self-driving car engineers and those who want to create a seamless connected

Sessions, Talks, Come together Build, Train, Race and have Fun

Connected Autonomous Driving – Stuttgart / RB / AK 12.12.2019Seite 3

Last Meetup

www.meetup.com/de-DE/Connected-Autonomous-Driving

Connected Autonomous DrivingOur Events

Page 4: Autonomous Driving - Meetup Connected Autonomous Driving · This Meetup is for autonomous driving enthusiasts, self-driving car engineers and those who want to create a seamless connected

Connected Autonomous Driving – Stuttgart / RB / AK 12.12.2019Seite 4

DiyRealRoboCarTomorrow

Connected Autonomous Drivingthe platform for tomorrows talents – the development path

DiyRoboKidCarToday

DiyRoboCarToday

Page 5: Autonomous Driving - Meetup Connected Autonomous Driving · This Meetup is for autonomous driving enthusiasts, self-driving car engineers and those who want to create a seamless connected

Connected Autonomous Driving – Stuttgart / RB / AK 12.12.2019Seite 5

Connected Autonomous DrivingImpressions from DiyRoboCar Home Stuttgart

Page 6: Autonomous Driving - Meetup Connected Autonomous Driving · This Meetup is for autonomous driving enthusiasts, self-driving car engineers and those who want to create a seamless connected

Connected Autonomous Driving – Stuttgart / RB / AK 12.12.2019Seite 6

Autonomous DrivingImpressions from DiyRoboCar Home Stuttgart

Page 7: Autonomous Driving - Meetup Connected Autonomous Driving · This Meetup is for autonomous driving enthusiasts, self-driving car engineers and those who want to create a seamless connected

Background

Page 8: Autonomous Driving - Meetup Connected Autonomous Driving · This Meetup is for autonomous driving enthusiasts, self-driving car engineers and those who want to create a seamless connected

Connected Autonomous Driving – Stuttgart / RB / AK 12.12.2019Seite 8

Connected Autonomous DrivingThe DiYRoboCar History

▪ Will Roscoe developed the software framework for the donkey-car.

▪ Python was chosen as programing language▪ The Raspberry Pi is the ideal SBC platform for a cheap and

powerful system with a very big community.▪ For the machine learning part Tensorflow a open-source

software library for dataflow programming was chosen. On top of Tensorflow the open source neural network library KERAS is used as a user-friendly framework.

▪ Adam Conway was responsible for the hardware and he build the first donkey-car.

▪ He searched for a cheap and ready to run RC model car which works together with the Raspberry Pi and a servo controller board.

Page 9: Autonomous Driving - Meetup Connected Autonomous Driving · This Meetup is for autonomous driving enthusiasts, self-driving car engineers and those who want to create a seamless connected

Connected Autonomous Driving – Stuttgart / RB / AK 12.12.2019Seite 9

Autonomous DrivingSmall Scale AI CARS - Overview

▪ NVIDIA JetBot

▪ ...

▪ DiYRoboCar – The Original

▪ MIT RACECAR

aws.amazon.com/de/deepracermit-racecar.github.io/

▪ DUCKIETOWN

▪ AWS DEEP RACER – The Clone

github.com/NVIDIA-AI-IOT/jetbotwww.donkeycar.com www.duckietown.org

▪ NVIDIA JetBot

▪ Next Generation DIYRoboCar

Page 10: Autonomous Driving - Meetup Connected Autonomous Driving · This Meetup is for autonomous driving enthusiasts, self-driving car engineers and those who want to create a seamless connected

Technology

Page 11: Autonomous Driving - Meetup Connected Autonomous Driving · This Meetup is for autonomous driving enthusiasts, self-driving car engineers and those who want to create a seamless connected

Autonomous DrivingA real autonomous Car

Connected Autonomous Driving – Stuttgart / RB / AK 12.12.2019Seite 11

▪ Lidar Sensors▪ Radar Sensors▪ Cameras▪ Sound Sensors

Page 12: Autonomous Driving - Meetup Connected Autonomous Driving · This Meetup is for autonomous driving enthusiasts, self-driving car engineers and those who want to create a seamless connected

Autonomous DrivingThe Classic DiYRoboCars - Parts

Raspberry PI

PWM Board

NVIDIA Nano

Motorboard

or

3D Printed Parts

Chassies RC Car

Page 13: Autonomous Driving - Meetup Connected Autonomous Driving · This Meetup is for autonomous driving enthusiasts, self-driving car engineers and those who want to create a seamless connected

Autonomous DrivingParts of next generation of DiYRoboCars

GoogleCoral Board

ArduinoUNO

NVIDIA Nano

Fahrtregler

Giro Sensor

Connected Autonomous Driving – Stuttgart / RB / AK 12.12.2019Seite 13

Page 14: Autonomous Driving - Meetup Connected Autonomous Driving · This Meetup is for autonomous driving enthusiasts, self-driving car engineers and those who want to create a seamless connected

Driving & Training Results

Page 15: Autonomous Driving - Meetup Connected Autonomous Driving · This Meetup is for autonomous driving enthusiasts, self-driving car engineers and those who want to create a seamless connected

• Learn from a human (Behavioral cloning)

• Train DiyRoboCar in a Car Unity Simulator (Reinforcement Learning)

Autonomous DrivingTwo Methods to train a DiyRoboCar

Images + Steering+ Speed Data

http://docs.donkeycar.com/guide/simulator/

Connected Autonomous Driving – Stuttgart / RB / AK 12.12.2019Seite 16

Page 16: Autonomous Driving - Meetup Connected Autonomous Driving · This Meetup is for autonomous driving enthusiasts, self-driving car engineers and those who want to create a seamless connected

• The drive loop records 30 pictures and json files each second. Each pictures has a matching json file with the steering and throttle values.

Autonomous DrivingTraining data (Images and Labels)

Images from theCar Camera

Labels

{"cam/image_array": "5755_cam-image_array_.jpg", "user/throttle": 0.3, "user/mode": "user", "milliseconds": 1261941, "user/angle": 0.24741355632190923}

Connected Autonomous Driving – Stuttgart / RB / AK 12.12.2019Seite 17

Page 17: Autonomous Driving - Meetup Connected Autonomous Driving · This Meetup is for autonomous driving enthusiasts, self-driving car engineers and those who want to create a seamless connected

Autonomous DrivingThe Neural Network developed on Keras / Tensorflow

Connected Autonomous Driving – Stuttgart / RB / AK 12.12.2019Seite 18

Page 18: Autonomous Driving - Meetup Connected Autonomous Driving · This Meetup is for autonomous driving enthusiasts, self-driving car engineers and those who want to create a seamless connected

Biased Neural Nets Negative Influence on training datas

Connected Autonomous Driving – Stuttgart / RB / AK 12.12.2019Seite 19

Page 19: Autonomous Driving - Meetup Connected Autonomous Driving · This Meetup is for autonomous driving enthusiasts, self-driving car engineers and those who want to create a seamless connected

What a Neural Net Should Learn

Connected Autonomous Driving – Stuttgart / RB / AK 12.12.2019Seite 20

Page 20: Autonomous Driving - Meetup Connected Autonomous Driving · This Meetup is for autonomous driving enthusiasts, self-driving car engineers and those who want to create a seamless connected

Autonomous DrivingObject Detection, Edge Detection, Line Following

Connected Autonomous Driving – Stuttgart / RB / AK 12.12.2019Seite 21

Page 21: Autonomous Driving - Meetup Connected Autonomous Driving · This Meetup is for autonomous driving enthusiasts, self-driving car engineers and those who want to create a seamless connected

Autonomous Racing, Dec 7th 2019autonomous cars now beat fastest human

Connected Autonomous Driving – Stuttgart / RB / AK 12.12.2019Seite 23

Page 22: Autonomous Driving - Meetup Connected Autonomous Driving · This Meetup is for autonomous driving enthusiasts, self-driving car engineers and those who want to create a seamless connected

Outlook

Page 23: Autonomous Driving - Meetup Connected Autonomous Driving · This Meetup is for autonomous driving enthusiasts, self-driving car engineers and those who want to create a seamless connected

Rainer Bareiß

LinkedIn: https://www.linkedin.com/in/rainer-bareiss/

Connected Autonomous Driving – Stuttgart / RB / AK 12.12.2019Seite 25

Alexander Kolbai

Autonomous DrivingContact

Slack: donkeycar.slack.comGithub: https://github.com/autorope/donkeycar

LinkedIn: https://www.linkedin.com/in/g-alexander-kolbai-63173580/

Page 24: Autonomous Driving - Meetup Connected Autonomous Driving · This Meetup is for autonomous driving enthusiasts, self-driving car engineers and those who want to create a seamless connected

Autonomous Driving

Q&A