17
DATE Adrenaline Fueled Development: Racing With Autonomous Vehicles Session: 23317 Jendrik Jördening Anthony Navarro Data Scientist Product Lead Akka Technologies Udacity [email protected] [email protected]

Adrenaline Fueled Development: Racing With Autonomous Vehicles · [email protected] [email protected]. 2 7/28/17 The Program Udacity launched the world’s only Self-Driving

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Adrenaline Fueled Development: Racing With Autonomous Vehicles · jendrik.joerdening@akka.eu anthony.n@udacity.com. 2 7/28/17 The Program Udacity launched the world’s only Self-Driving

1 7/28/17

DATE

Adrenaline Fueled Development: Racing With Autonomous VehiclesSession: 23317

Jendrik Jördening Anthony NavarroData Scientist Product LeadAkka Technologies [email protected] [email protected]

Page 2: Adrenaline Fueled Development: Racing With Autonomous Vehicles · jendrik.joerdening@akka.eu anthony.n@udacity.com. 2 7/28/17 The Program Udacity launched the world’s only Self-Driving

2 7/28/17

The ProgramUdacity launched the world’s only Self-Driving Car training program in November 2016 receiving over 15,000 applications for this Nanodegree program!

Page 3: Adrenaline Fueled Development: Racing With Autonomous Vehicles · jendrik.joerdening@akka.eu anthony.n@udacity.com. 2 7/28/17 The Program Udacity launched the world’s only Self-Driving

3 7/28/17

The ChallengeUdacity teamed up with PolySync to sponsor a team to participate in the Self-Racing Cars event at Thunderhill Raceway, California on April 1-2, 2017.

The challenge was to send a Kia Soul, provided by PolySync, around Thunderhill Raceway autonomously using only a single camera and GPS as sensors.

Page 4: Adrenaline Fueled Development: Racing With Autonomous Vehicles · jendrik.joerdening@akka.eu anthony.n@udacity.com. 2 7/28/17 The Program Udacity launched the world’s only Self-Driving

4 7/28/17

The TeamA team of 17 Self-Driving Car students came together on February 15th to participate in the race and represent Udacity and PolySync.

The international team was represented 5 different countries from diverse backgrounds with two things in common: a love for learning and self-driving cars!

Page 5: Adrenaline Fueled Development: Racing With Autonomous Vehicles · jendrik.joerdening@akka.eu anthony.n@udacity.com. 2 7/28/17 The Program Udacity launched the world’s only Self-Driving

5 7/28/17

Development Phases

weeks to work as a team

days of on-site development, training, and integration

hours of adrenaline fueled racing and coding

Only possible with GPU computations powered by GTX 1070

Page 6: Adrenaline Fueled Development: Racing With Autonomous Vehicles · jendrik.joerdening@akka.eu anthony.n@udacity.com. 2 7/28/17 The Program Udacity launched the world’s only Self-Driving

6 7/28/17

Preparation● Build a simulator for the

thunderhill race track● Examined Polysync Car Sensor

Samples● Trained and Tested Neural

Networks● Discovered big difference

between Real and Simulation Data

Page 7: Adrenaline Fueled Development: Racing With Autonomous Vehicles · jendrik.joerdening@akka.eu anthony.n@udacity.com. 2 7/28/17 The Program Udacity launched the world’s only Self-Driving

7 7/28/17

29th March – Meet & Greet

Page 8: Adrenaline Fueled Development: Racing With Autonomous Vehicles · jendrik.joerdening@akka.eu anthony.n@udacity.com. 2 7/28/17 The Program Udacity launched the world’s only Self-Driving

8 7/28/17

30th March Morning – First Day on the Track Race Track●

Page 9: Adrenaline Fueled Development: Racing With Autonomous Vehicles · jendrik.joerdening@akka.eu anthony.n@udacity.com. 2 7/28/17 The Program Udacity launched the world’s only Self-Driving

9 7/28/17

30th March Evening – Turn, Baby, Turn!

Page 10: Adrenaline Fueled Development: Racing With Autonomous Vehicles · jendrik.joerdening@akka.eu anthony.n@udacity.com. 2 7/28/17 The Program Udacity launched the world’s only Self-Driving

10 7/28/17

31st March – Double Failure (Brakes and Steering)

Page 11: Adrenaline Fueled Development: Racing With Autonomous Vehicles · jendrik.joerdening@akka.eu anthony.n@udacity.com. 2 7/28/17 The Program Udacity launched the world’s only Self-Driving

11 7/28/17

31st March 4 p.m. – Testing the first models

Page 12: Adrenaline Fueled Development: Racing With Autonomous Vehicles · jendrik.joerdening@akka.eu anthony.n@udacity.com. 2 7/28/17 The Program Udacity launched the world’s only Self-Driving

12 7/28/17

1st April 9 a.m. - Race Day 1 Master One Turn

Page 13: Adrenaline Fueled Development: Racing With Autonomous Vehicles · jendrik.joerdening@akka.eu anthony.n@udacity.com. 2 7/28/17 The Program Udacity launched the world’s only Self-Driving

13 7/28/17

2nd April 9 a.m. - Race Day 2

Page 14: Adrenaline Fueled Development: Racing With Autonomous Vehicles · jendrik.joerdening@akka.eu anthony.n@udacity.com. 2 7/28/17 The Program Udacity launched the world’s only Self-Driving

14 7/28/17

Results

Made it around all turns autonomously! ...but not in one lap

● How to deploy a real end-to-end deep neural network on a car● Integrating physical systems can be difficult● Reality and simulation are completely different things● Hybrid team from students and industry can benefit each other a lot!● Nothing can replace the real-world experience● Such events are the greatest networking opportunities

Page 15: Adrenaline Fueled Development: Racing With Autonomous Vehicles · jendrik.joerdening@akka.eu anthony.n@udacity.com. 2 7/28/17 The Program Udacity launched the world’s only Self-Driving

15 7/28/17

Path Forward - ROS Bridge and SegNet

Page 16: Adrenaline Fueled Development: Racing With Autonomous Vehicles · jendrik.joerdening@akka.eu anthony.n@udacity.com. 2 7/28/17 The Program Udacity launched the world’s only Self-Driving

16 7/28/17

Semantic Segmentation Utilising a U-Net and Feature Extraction from Yolov2 @Akka

Credit: M. Cordts, M. Omran, S. Ramos, T. Rehfeld, M. Enzweiler, R. Benenson, U. Franke, S. Roth, and B. Schiele, "The Cityscapes Dataset for Semantic Urban Scene Understanding," in Proc. of the IEEE Conference on Computer Vision and Pattern Recognition

Page 17: Adrenaline Fueled Development: Racing With Autonomous Vehicles · jendrik.joerdening@akka.eu anthony.n@udacity.com. 2 7/28/17 The Program Udacity launched the world’s only Self-Driving

THANK YOU FOR YOUR ATTENTION

Jendrik Jördening Anthony NavarroData Scientist Product ManagerMailto: [email protected] Mailto: [email protected]

The full story:

Our Very Own Grand Challenge