DSC 2020 Europe VR

DSC 2020 EUROPE VR

Driving Simulation & Virtual Reality Conference & Exhibition

Palais des Congrès - Antibes September 9, 2020

Title

Presenter

Accelerate automotive simulation development

Seb Loze | Simulation Industry Manager

T : @SLFeeding #DSC2020 | sebastien.loze@epicgames.com

#UE4 | @UNREALENGINE

Remember last year ?

Key takeaways from 2019 DSC speech :

1. Epic Games is strongly investing in some core non-game industries including Simulation

2. Unreal Engine is free (source code is available for free on GitHub as well)

3. Eager to aggregate insights coming from the simulation experts

#UE4 | @UNREALENGINE

Remember yesterday ?

If you missed James Butcher Unreal Engine tutorial :

https://learn.unrealengine.com/

#UE4 | @UNREALENGINE

Driving Simulations | Smart and beautiful (and vice versa)

Depending on their goals, priorities in the development process of driving simulators is focussing on 8 criterias impacting the way images are displayed (or not) :

● Image accuracy ● Photorealism ● Dynamics Engine Integration ● HIL Integration● AI Integration● Open Architecture ● Support of standards● Pipeline Optimization

“One thing that we're not necessarily doing is we're not doing a fancy 3D world like this because we are simulating perception.” - Uber, Matt Ranney

“UE4 allowed us to achieve an impressive graphics quality, allowing top quality lighting effects, and rain/wet terrain simulation” - Kunos Assetto Corsa, Marco Massarutto

#UE4 | @UNREALENGINE

Driving Simulations | Smart and beautiful (and vice versa)

(Attributed values are projections based on typical use cases observations)

Automotive digital marketing Man in the loop Simulator AV Simulator / machine learning Racing video game

#UE4 | @UNREALENGINE

Unreal Engine | Driving Simulation use cases examples

https://www.infoq.com/presentations/uber-self-driving-software/

Inside a self-driving Uber

https://venturebeat.com/2019/04/20/gms-cruise-is-preparing-for-a-self-

driving-future-in-the-cloud/

GM’s Cruise is preparing for a self-drivingfuture in the cloud

https://www.extremetech.com/extreme/281649-nvidia-ai-can-render-

complete-urban-environments-in-unreal-engine-4

Nvidia AI Can Render Complete Urban Environments in Unreal Engine 4

https://zoox.com/journal/

Zoox merging Simulation & Reality

https://www.vertechs.jp/autocity

Reikko and Vertechs create Auto City

https://www.prnewswire.com/news-releases/otsl-strengthens-its-3d-

real-time-sensor-simulator-framework-cosmosim-r-ecosystem-for-

autonomous-driving-300883916.html

OTSL strengthens 3D Real-Time Sensor Simulator Framework COSMOsim (R) Ecosystem

https://www.microsoft.com/en-us/garage/blog/2018/04/project-road-

runner-train-autonomous-driving-algorithms-for-road-safety/

Microsoft Road-Runner photo-realistic simulation and deep learning to train autonomous driving algorithms

https://www.ijrte.org/wp-content/uploads/papers/v8i1/A7288058119.pdf

Development of Pedestrian Artificial Intelligence Utilizing Unreal Engine 4

#UE4 | @UNREALENGINE

https://www.youtube.com/watch?v=FJsn2OGsLOc

https://www.youtube.com/watch?v=wv5UeSZST5w

https://www.youtube.com/watch?v=CUH5hwkl7dI&t=10s

https://www.youtube.com/watch?v=feteiyjsHOQ https://www.youtube.com/watch?v=SyUQ2IImObA

https://www.youtube.com/watch?v=5Xqqe9WcZnk

Digital Marketing - 2020 - Examples

#UE4 | @UNREALENGINE

AV simulation and Engineering - 2020 - Examples

https://www.youtube.com/watch?v=skanz-dzaAg https://www.youtube.com/watch?v=ORpo_cpDH4shttps://www.unrealengine.com/en-US/spotlights/ike-develops-virtual-

simulator-for-automated-trucks-with-unreal-engine

https://carla.org/

https://www.dspace.com/en/pub/home/news/sensor_realistic_simulation.

cfm#143_54589

https://www.unrealengine.com/en-US/spotlights/cm-labs-links-best-in-

class-real-time-toolsets-for-highest-fidelity-engineering-and-training-

simulation

#UE4 | @UNREALENGINE

Driving Simulations | Smart and beautiful (and vice versa)

(Attributed values are projections based on typical use cases observations)

Automotive digital marketing Man in the loop Simulator AV Simulator / machine learning Racing video game

#UE4 | @UNREALENGINE

#UE4 | @UNREALENGINE

#UE4 | @UNREALENGINE

What is so special about Driving Sim?

Challenges

Content Creation

Non visible spectrum

Data accuracy

Deployment

Solutions

Handling formats / GIS / Terrain Data / Stream the world

Sensors ( handling / representation )

Identifying potential integrations

Cloud vs local

#UE4 | @UNREALENGINE

Content creation - the “classic” approach

UE4 integrated Landscape - Create your own procedural geotypical environment

● Hand-crafted landscape, Terrain splines, Foliage tools, Marketplace assets● Several training zones in same environment

● https://docs.unrealengine.com/en-

US/Engine/OpenWorldTools/index.html

● https://docs.unrealengine.com/en-US/Engine/Landscape/index.html

● With terrain generation tools (World Machine, Instant Terra, World Creator, TerraForm)

● …)

#UE4 | @UNREALENGINE

Content creation - The “GIS data integration” approach

Adapting to traditional simulation content creation pipelines

VectorZeroRoadRunner

ESRICityEngine

TrianGraphics Trian3DBuilder

Presagis O2U

OpenStreetMap(free plugin)

Presagis Terra Vista (UE4 output compiler WIP)

LiDAR Point Cloud(UE 4.24 free plugin)

#UE4 | @UNREALENGINE

Content creation - The “GIS data integration” approach

Adapting to traditional simulation content creation pipelines

VectorZeroRoadRunner

ESRICityEngine

TrianGraphics Trian3DBuilder

Presagis O2U

OpenStreetMap(free plugin)

Presagis Terra Vista (UE4 output compiler WIP)

LiDAR Point Cloud(UE 4.24 free plugin)

#UE4 | @UNREALENGINE

Content creation - The “Standard DB” approach

ESRI ArcGIS Presagis CDB ORB Viewer

SimblocksCDB RTP for UE

CESIUM 3D Tiles

#UE4 | @UNREALENGINE

#UE4 | @UNREALENGINE

Content creation - your “Homemade” solution

< Insert here your challenges >

Using Unreal Engine source code and open structure allows you to create your own importers and your optimization process from your source data

#UE4 | @UNREALENGINE

Non visible spectrum

#UE4 | @UNREALENGINE

Non visible spectrum

LIDAR semantic

#UE4 | @UNREALENGINE

Non visible spectrum

< Insert here your challenges >

We are using the sensors from our partners. We can help you to implement yours. Some implementations are being done internally by Epic Games.

Your voices are important to help us to define what is our next step.

#UE4 | @UNREALENGINE

Simulation data accuracy

#UE4 | @UNREALENGINE

Deployment

#UE4 | @UNREALENGINE

How to conclude ?

Progress have been made. Challenges have been taken care of. Partners are being supported to provide new solutions to the community.

We can do better. Let’s make sure we don’t wait until the next DSC to chat.

Send us a line ---> Simulation@epicgames.com

Seb Loze | Simulation Industry ManagerT : @SLFeeding #DSC2020 | sebastien.loze@epicgames.com