Tips and Tricks to Get the Most out of Your Virtual-Reality...

Tips and Tricks to Get the Most out of Your Virtual-Reality

Experiences in Stingray

Olivier Dionne Software Development Manager

Benjamin Slapcoff Software Engineer

Andrew Grant Product Manager

Stingray Renderer Overview

Profiler and VR Optimizations

Building Immersive Experiences

Content Tips and Tricks

Outline

Warhammer Vermintide - Fatshark, [PC | PS4 |

Hamiltons Great Adventure - Fatshark

[PC/PS3/Android]War of the Roses- Fatshark [PC]

Helldivers - Arrowhead (Sony) [PC | PS4 | PS3 |

PS Vita]

Gauntlet - Arrowhead (Sony) [PS4, PC]

The Showdown Effect - Arrowhead [PC]

Autodesk Stingray V1.6

Shaders, resource creation, resource manipulation and flow of

rendering pipeline entirely defined in data

Data is expressed in SJSON

Hot-reloadable for quick iteration times

Allows for fast experimentation and debugging

Flexible Data-Driven Renderer

Ties all rendering sub-systems

Dictates the order of operations for a

Defines quality settings, device

capabilities and default shader libraries to

Three key ingredients

Resource sets – memory allocations /

deallocations

Resource generators – resource updating

Layer configurations – frame scheduling

Stingray render_config

High refresh rates: 90Hz (11.11ms per frame)

Frame buffer: 2160x1200

Super sampled to reduce aliasing artifacts

Off-screen buffer scaled by 1.5x in each dimension (3240x1800)

Shaded visible pixels

Challenges in VR

Resolution Refresh Rate (Hz) MPixels per Second

720p 60 55

1080p 60 124

2160p 60 498

VR (3240x1800) 90 525

Sequential stereo rendering

Two distinct scene cameras to represent eyes. Submit entire

scene for left eye, then resubmit scene again for right eye.

Easiest strategy to start supporting VR devices and their

tracking systems

Inefficient: Draw calls and state changes are doubled

Not CPU or GPU cache friendly!

Stingray VR – Humble beginnings…

Live Design Booth AU2015

Stingray Profiler

“Gentlemen, we can rebuild him. We have the technology…”

Frustums are a big deal…

Stingray VR – Optimizations

Culling Cascaded shadow

mapping

Clustered shading

Compute single compound frustum to incorporate both eyes

Bail early on non-visible (depth and stencil compare)

GPU geometry instancing to render in stereo

Even instances clip

position scaled and

shifted left

Odd instances clip

position scaled and

shifted right

Dynamic clip plane

Geometry

instance count

doubled

Stingray VR - Today

Adaptive quality

Foveated rendering

Multi GPU support

Mobile optimizations

Stingray VR – What’s Next

Building VR Experiences

using Stingray

Template for both Oculus and HTC Vive

Very similar functionality exposed in both the Lua API and Flow

Stingray VR Templates

Template for both Oculus and HTC Vive

Very similar functionality exposed in both the Lua API and Flow

Initialization in respective lua files (steam_vr.lua/oculus.lua)

Stingray VR Templates

VR settings in settings.ini

A lot of premade functionality present in the templates

First Example: Teleportation

Teleporting with a fade transition…

Teleportation Marker

Last improvement…

Without Local Position Adjustment

With Local Position Adjustment

Final Result

Second example: Picking up objects

Multi-threaded game engine (Game thread, Render thread, GPU

thread, etc).

GPU thread operates 2 frames behind Game Thread

VR Trackers updated on Render Thread

Documentation and Online

Resources

Optimizing Content For

VR in Stingray

Don’t make me sick

Is overdraw set too high?

Am I running too many post-processes?

Am I rendering too many polygons?

Am I running out of GPU texture memory?

Am I casting too many shadows? (batches)

Typical Optimization Checklist

Reduce overdraw to 1.4

Templates are 1.6 by default

Disable TAA

Enable FXAA

Render Settings – overdraw and anti-aliasing

Disable all un-necessary post processes

Auto-Exposure

Post Processes

Red Herring

Poly Reduction

3DS Max:

Optimize, ProOptimizer

PolyReduce

Simplygon

Instant Field Aligned Meshes:

https://github.com/wjakob/instant-meshes

Poly Reduction Tools

Texture Blowout

Am I maxing out my texture memory?

Tool: Procexp

GPU Tab

GPU Dedicated Memory

Optimization Checklist: Textures

Resize all textures to be powers-of-two and of

reasonable size

1024x1024, 256x512, etc

XnView

Show All Files (recursive)

Sort by Properties

Batch processing

Texture Optimization Basics

Compression requirements

Why power of two?

Enable compression on all textures:

Color(albedo) no alpha: DXT1

Color with alpha: DXT5

Normal: BC5

RMA: DXT1

Single-channel linear textures: BC4

Texture Optimization Basics (for PC/Consoles)

Tool: Texture Manager

Output Format

Discard Largest

Texture Optimization Basics

Am I casting too many shadows?

Tool: Artist Performance HUD

Optimization Checklist: Shadow Casting

Disable shadow casting where unnecessary

Objects in shadow, floors, etc

Convert point lights to Spotlights

1/6 cost of point lights

Bake Lighting

Shadow Proxies

Tool: Unit Editor

Cast Shadows

Optimization Checklist: Batching

Tool: Artist Performance HUD

Optimization Checklist: Batching

One batch per material, per mesh, per shadow

casting observer, per camera

What Is a Batch?

One Cube

One Plane

One Spotlight

2 Shadow Casting

Batches

2 G-Buffer Batches

One Cube

One Plane

One Sunlight

5 Shadow Casting

Batches

2 G-Buffer Batches

One Cube

One Plane

One Omni Light

6 Shadow Casting

Batches

2 G-Buffer Batches

Merge meshes

Re-import

Reduce Materials

Create LODs

Optimization Checklist: Reduce Batching

Create Occluder

Remember: Occluders occlude from all

observers!

Optimization Checklist: Occluders

Same Geometry

Same Materials

Material supports Instancing

Batch Merging

Standard import materials are optimized for

compatibility – not performance!

Material Optimization

Create simple materials

Use inheritance

Parent materials

Use standard_rma materials

RMA = Roughness, Metalness, Ambient Occlusion

Included in v1.6

Material Optimization

You can’t always get what you want

But if you try sometimes…

Game artists can help!

In Closing

Tobias Persson

Niklas Frykholm

Mikael Hansson

Andreas Asplund

Jim Sagevid

Jean-Philippe Grenier

Anders Lindqvist

Rex Hill

Acknowledgements

Dan Matlack

Paul Kind

Matthew Harwood

Autodesk is a registered trademark of Autodesk, Inc., and/or its subsidiaries and/or affiliates in the USA and/or other countries. All other brand names, product names, or trademarks belong to their respective holders. Autodesk reserves the right to alter product and services offerings, and

Tips and Tricks to Get the Most out of Your Virtual-Reality...

Documents

3V Tips ‘n Tricks CHAPTER 8 3V Tips ‘n Tricks - Ningapi.ning.com/.../3.3Vtipsandtricksen026368.pdf · 3V Tips ‘n Tricks Table Of Contents TIPS ‘N TRICKS INTRODUCTION TIP #1:

Item #21491 DEEP JAW SHRINKER STRETCHER STAND2 Eastwood Technical Assistance: 800.343.9353 >> techelp@eastwood.com The EASTWOOD ELITE DEEP JAW SHRINKER STRETCHER STAND is designed

Increasing the Volume with Inventor Tube & Pipe - Autodeskaucache.autodesk.com/au2016/sessionsFiles/15320/11505/handout_15320... · Increasing the Volume with Inventor® Tube & Pipe

Rogers: Tips and Tricks for Alma Analytics Tips and Tricks

GEN21973 AutoCAD Electrical 60 in 60 - Autodeskaucache.autodesk.com/au2016/sessionsFiles/21973/... · © 2016 Autodesk Join the conversation #AU2016 AutoCAD Electrical: 60 Tips in

WF21421 AutoCAD Civil 3D: Tips, Tricks, and Unnatural Actsaucache.autodesk.com/au2016/sessionsFiles/21421/12642/handout... · AutoCAD Civil 3D: Tips, Tricks, and Unnatural Acts

IT20300 String Theory—Dynamo for Absolute Beginnersaucache.autodesk.com/au2016/sessionsFiles/20300/11996/handout... · – Is an introductory course that explains the very basics

Argos Tips & Tricks - Evisionsgo.evisions.com/hubfs/CoHEsion Louisville Session Content/Beginning... · Argos Tips & Tricks Michael Capulong ... Tips & Tricks 19. ...

Mind Tricks Story Board - WordPress.com€¦ · Mind Tricks Story Board Callum Blackman s0257555. Mind Tricks Story Board Callum Blackman s0257555. Mind Tricks Story Board Callum

Tips & Tricks

Git tricks

Tips & Tricks Tips & Tricks for Writing Interpretive Text

Python Tricks: The Book - Python Training by Dan Bader Tricks Sample.pdf · WhatPythonistasSayAboutPythonTricks:TheBook ”Ilovelovelovethebook. It’slikehavingaseasonedtutorexplain-ing,well,tricks!I’mlearningPythononthejobandI’mcomingfrom

Slick Tricks: Tips & Tricks from the UniSim Design Support team

Revit and Dynamo For Landscape Architecture - Autodeskaucache.autodesk.com/au2016/sessionsFiles/20475/13051/presentatio… · Revit and Dynamo For Landscape Architecture AR20475 William

Autodesk 2017 Global Collaborative Implementation ...aucache.autodesk.com/au2016/sessionsFiles/20876/11528/additional... · Autodesk 2017 Global Collaborative Implementation ... the

AR20422 Everyday Dynamo: Automating Simple Solutions That ...aucache.autodesk.com/au2016/sessionsFiles/20422/12226/handout... · Everyday Dynamo: Automating Simple Solutions That

#AU2016 Unlock the "I" in BIM with Data Democratization

FACTORS THAT CONTRIBUTE TO THE NORFA'IZAH BINTI …ir.uitm.edu.my/id/eprint/21491/1/PPb_NORFA'IZAH SAFARUDDIN M BM 07_5.pdfFACTORS THAT CONTRIBUTE TO THE EFFECTIVENESS OF PERODUA CUSTOMER

Communicating and Managing 3D Engineering Data …aucache.autodesk.com/au2016/sessionsFiles/22336/13361/presentation... · Communicating and Managing 3D Engineering Data Using 3D