23047 Designing the Collaborative Virtual Workspace ...on- 23047 DESIGNING THE COLLABORATIVE VIRTUAL

  • View
    1

  • Download
    0

Embed Size (px)

Text of 23047 Designing the Collaborative Virtual Workspace ...on- 23047 DESIGNING THE COLLABORATIVE VIRTUAL

  • 1www.esi-group.com

    Copyright © ESI Group, 2017. All rights reserved.Copyright © ESI Group, 2017. All rights reserved.

    www.esi-group.com

    MUNICH | 10 – 12 OCT 2017

    23047 DESIGNING THE COLLABORATIVE VIRTUAL WORKSPACE INFRASTRUCTURE

    Jan Wurster, ESI Group Room 14a | 12 OCT 2017 | 23047 2:30pm to 3:00pm

  • 2www.esi-group.com

    Copyright © ESI Group, 2017. All rights reserved.

    ENGINEERING WORKSPACES courtesy of Getty Images

  • 3www.esi-group.com

    Copyright © ESI Group, 2017. All rights reserved.

    ENGINEERING WORKSPACES courtesy of BMW Group

  • 4www.esi-group.com

    Copyright © ESI Group, 2017. All rights reserved.

    ENGINEERING WORKSPACES

  • 5www.esi-group.com

    Copyright © ESI Group, 2017. All rights reserved.

    ENGINEERING WORKSPACES courtesy of Valmet Automotive

  • 6www.esi-group.com

    Copyright © ESI Group, 2017. All rights reserved.Copyright © ESI Group, 2017. All rights reserved.

    “Augmented And Virtual Reality Fuel The Future Workplace“

    Forbes Mag, Nov 2016

  • 7www.esi-group.com

    Copyright © ESI Group, 2017. All rights reserved.

    Evolution of Engineering Workspaces

    Once upon a time: Physical Prototypes as central element of a shared workspace

    ▪ Interacting with peers

    ▪ Continuous validation and practical engineering

    Established VR: Virtual Prototypes in Virtual Environments

    ▪ All but removes the need for physical prototypes, saving time, effort and resources

    ▪ Great for Collaboration!

    Cost, complexity, maintenance and availability in digital prototypes sometimes lead to less validation and collaboration.

  • 8www.esi-group.com

    Copyright © ESI Group, 2017. All rights reserved.

    Evolution of Engineering Workspaces

    Workplace VR! ▪ Finally: Affordable immersive hardware!

    However .. ▪ Collaboration?

    ▪ Efficient use of expensive hardware resources?

    ▪ Complexity of setup and maintenance?

    ▪ Software affordability?

  • 9www.esi-group.com

    Copyright © ESI Group, 2017. All rights reserved.

    Evolution of Engineering Workspaces

  • 10www.esi-group.com

    Copyright © ESI Group, 2017. All rights reserved.

    Evolution of Engineering Workspaces

    Workplace VR! ▪ Finally: Affordable immersive hardware!

    However .. ▪ Collaboration?

    ▪ Efficient use of expensive (and noisy) resources?

    ▪ Complexity of setup and maintenance?

    ▪ Software affordabiblity?

    ▪ Augmentable and integration into decision workflows?

  • 11www.esi-group.com

    Copyright © ESI Group, 2017. All rights reserved.

    Evolution of Engineering Workspaces

    • Offer the benefits of VR in engineering to non-experts

    • Adopt to and support changes in infrastructure

    • Integrate and support processes in the 4.0 enterprise

    • Lower the technical obstacles without compromising quality of results

    • Use the opportunity of mobile VR ubiquity - match today‘s flexible work styles

    SOFTWARE AFFORDABILITY

    HARDWARE ACCESSIBILITY

    INTUITIVE USABILITY

    Virtualization & Cloud

    Technology

    Immersive

    Virtual Reality Experience

  • 12www.esi-group.com

    Copyright © ESI Group, 2017. All rights reserved.

    Collaborative Virtual Workspace Challenges

    SOCIAL COLLABORATION

    HETEROGENOUS DEVICE LANDSCAPE

    INFRASTRUCTURE INTEGRATION

    COLLABORATIVE INTERACTION

  • 13www.esi-group.com

    Copyright © ESI Group, 2017. All rights reserved.

    Collaborative Virtual Workspace Challenges

    SOCIAL COLLABORATION

    HETEROGENOUS DEVICE LANDSCAPE

    INFRASTRUCTURE INTEGRATION

    COLLABORATIVE INTERACTIONRealtime Stereoscopic

    Panoramic Visualization

    Virtualization

    On Premise Cloud Computing

    Supporting Presence

  • 14www.esi-group.com

    Copyright © ESI Group, 2017. All rights reserved.

    Collaboration and Sharing COLLABORATIONPRESENCE

  • 15www.esi-group.com

    Copyright © ESI Group, 2017. All rights reserved.

    Collaboration and Sharing COLLABORATIONPRESENCE DEVICES

    1:N Explain and

    share

    PRESENT

    N:1 Understand and

    discuss

    LEARN & DISCUSS

    N:N Collaboratively Investigate,

    Evaluate and Decide

    INTERACT & COLLABORATE

  • 16www.esi-group.com

    Copyright © ESI Group, 2017. All rights reserved.

    Spatial Stream

    Collaboration and Sharing

    Communication and Presence

    ▪ Voice is a key requirement in training, collaboration or presentation scenarios.

    ▪ Avatars and presence are a necessary ‚storytelling‘ device.

    ▪ Multimodality through Spatial Audio feedback helps locate the presenter and points of interest

    COLLABORATIONPRESENCE DEVICES

    Client

    Client Client

    Presenter

    Visualization Session Instance

    ODS Stream Stream Casting

    RTCMultiConnection

    Interactions

    P2P Voice / Audio

    Interactions

  • 17www.esi-group.com

    Copyright © ESI Group, 2017. All rights reserved.

    Collaboration and Sharing

    Consistency in Presentation ▪ Each environment and device has its own unique capabilities

    ▪ Decisions taken in collaborative discussion should not be influenced by presentation

    ▪ Definitely not a ‚lowest common denominator‘ approach - but visual consistency is key for presenting decision-relevant content

    Diversity in Expertise ▪ Individual proficiency should not keep users from developing the necessary insight to

    decide and discuss.

    Heterogeneous Device Landscape ▪ Developing market with new devices to be added as they become available

    COLLABORATIONPRESENCE DEVICES

  • 18www.esi-group.com

    Copyright © ESI Group, 2017. All rights reserved.

    Decoupled Visualization to a Heterogeneous Device Landscape

    Personal VR HMDs

    Projection-based VR CAVE, Powerwall

    C e

    n tr

    al iz

    ed V

    R

    Im m

    e rs

    iv e

    V R

    Mobile VR Cardboard, GearVR, Daydream

    m o

    b ile

    V R

  • 19www.esi-group.com

    Copyright © ESI Group, 2017. All rights reserved.

    Decoupled Visualization to a Heterogeneous Device Landscape

    Personal VR HMDs

    Projection-based VR CAVE, Powerwall

    C e

    n tr

    al iz

    ed V

    R

    Im m

    e rs

    iv e

    V R

    Mobile VR Cardboard, GearVR, Daydream

    m o

    b ile

    V R

  • 20www.esi-group.com

    Copyright © ESI Group, 2017. All rights reserved.

    Displaying Streamed Immersive Content

    Decoupled Remote Visualization

    ST R

    EA MNative Thin Client for projection-

    based / immersive VR ▪ Custom protocol for device data ▪ ODS Streaming for

    ▪ presentation-only scenarios ▪ low bandwidth / high latency networks

    ▪ 1:1 Output Streaming pipeline for ▪ Interactive scenarios ▪ High bandwidth / low latency networks

    ▪ GPU decoding for lowest possible latency

    “Delivering Immersive Experiences through GPU Virtualization & Streaming”

    Jan Wurster, Solution & Technology Expert, ESI Group

    — Source: GTC 2017, s7203

  • 21www.esi-group.com

    Copyright © ESI Group, 2017. All rights reserved.

    Decoupled Visualization to a Heterogeneous Device Landscape

    Personal VR HMDs

    Projection-based VR CAVE, Powerwall

    C e

    n tr

    al iz

    ed V

    R

    Im m

    e rs

    iv e

    V R

    Mobile VR Cardboard, GearVR, Daydream

    m o

    b ile

    V R

    “Immersive Cloud Experiences with NVIDIA GRID & ESI Virtual Reality Technology”

    Andreas Mank, Team Leader Visualization, ESI Group

    Jan Wurster, Solution & Technology Expert, ESI Group

    — Source: GTCE 2016, s6147

  • 22www.esi-group.com

    Copyright © ESI Group, 2017. All rights reserved.

    Stereoscopic Panoramics

    Decoupled Remote Visualization

    LEFT

    RIGHT

    Top / Bottom Format at >= 2048x2048 resolution

    Omnidirectional Stereo ▪ Low visualizuation latency

    ▪ Feasible bandwidth for streaming

    ▪ Interactive / dynamic content

    ▪ Straightforward through Raytracing

    ▪ Reasonable Quality Approximation through Realtime Rasterization

  • 23www.esi-group.com

    Copyright © ESI Group, 2017. All rights reserved.

    Omni-Directional Stereo Image Synthesis

    Stereoscopic Panoramics

    STEREO CAMERA SETUP ODS APPROXIMATED ODS APPROXIMATED

    References P.D. Bourke. “Synthetic Stereoscopic Panoramic Images” Google Developers – „Rendering Omni‐directional Stereo Content“

  • 24www.esi-group.com

    Copyright © ESI Group, 2017. All rights reserved.

    Rasterizing Realtime Stereoscopic Panoramics

    Decoupled Remote Visualization

    LEFT

    RIGHT

    Top / Bottom Format at &g