27
Mixing Virtual Reality and 2D Visualization – Using Virtual Environments as Visual 3D Information Systems for Discussion of Data from Geo and Environmental Sciences Dr. Björn Zehner, Department of Environmental Informatics [email protected], [email protected] Given at the International Conference on Computer Graphics Theory and Applications 2010 (GRAPP2010), Angers, France, 21st May 2010

Mixing Virtual Reality and 2D Visualization – Using ... · Mixing Virtual Reality and 2D Visualization – Using Virtual Environments as Visual 3D Information Systems for Discussion

  • Upload
    others

  • View
    5

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Mixing Virtual Reality and 2D Visualization – Using ... · Mixing Virtual Reality and 2D Visualization – Using Virtual Environments as Visual 3D Information Systems for Discussion

Mixing Virtual Reality and 2D Visualization – Using Virtual Environments as Visual 3D Information Systems for Discussion of Data from Geo and Environmental Sciences Dr. Björn Zehner, Department of Environmental Informatics [email protected], [email protected]

Given at the International Conference on Computer Graphics Theory and Applications 2010 (GRAPP2010),Angers, France, 21st May 2010

Page 2: Mixing Virtual Reality and 2D Visualization – Using ... · Mixing Virtual Reality and 2D Visualization – Using Virtual Environments as Visual 3D Information Systems for Discussion

Page 2 Björn Zehner - International Conference on Computer Graphics Theory and Applications 2010 (GRAPP2010)

Successful application of immersive visualization in many areas

This technology has been used for a long time now in:AutomotiveArchitectureMechanical Engineering

Since 1999 it is also often used by Oil & Gas companiesto discuss their complicated reservoir data sets.

It is rarely used in environmental sciences and geosciencesoutside these industries and the question is why.

Page 3: Mixing Virtual Reality and 2D Visualization – Using ... · Mixing Virtual Reality and 2D Visualization – Using Virtual Environments as Visual 3D Information Systems for Discussion

Page 3 Björn Zehner - International Conference on Computer Graphics Theory and Applications 2010 (GRAPP2010)

The Bitterfeld site in East-Germany isan example for a very complicateddata set from environmental geoscience.

Page 4: Mixing Virtual Reality and 2D Visualization – Using ... · Mixing Virtual Reality and 2D Visualization – Using Virtual Environments as Visual 3D Information Systems for Discussion

Page 4 Björn Zehner - International Conference on Computer Graphics Theory and Applications 2010 (GRAPP2010)

What do we do with these data?

Source: Google maps (bottom left) and Zehner, 2002/1998.

Page 5: Mixing Virtual Reality and 2D Visualization – Using ... · Mixing Virtual Reality and 2D Visualization – Using Virtual Environments as Visual 3D Information Systems for Discussion

Page 5 Björn Zehner - International Conference on Computer Graphics Theory and Applications 2010 (GRAPP2010)

What do we do with these data?

Source: Google maps (bottom left) and Zehner, 2002/1998.

Page 6: Mixing Virtual Reality and 2D Visualization – Using ... · Mixing Virtual Reality and 2D Visualization – Using Virtual Environments as Visual 3D Information Systems for Discussion

Page 6 Björn Zehner - International Conference on Computer Graphics Theory and Applications 2010 (GRAPP2010)

GIS Systems

Page 7: Mixing Virtual Reality and 2D Visualization – Using ... · Mixing Virtual Reality and 2D Visualization – Using Virtual Environments as Visual 3D Information Systems for Discussion

Page 7 Björn Zehner - International Conference on Computer Graphics Theory and Applications 2010 (GRAPP2010)

Related/former work

Using additional Gadgets, such as PDFs

Using 2D widgets (WIMP interfaces), projected

on planes in 3D space - an example is the

InsideReality software from Schlumberger.

Using Video Wall Controllers (explained later)

Page 8: Mixing Virtual Reality and 2D Visualization – Using ... · Mixing Virtual Reality and 2D Visualization – Using Virtual Environments as Visual 3D Information Systems for Discussion

Page 8 Björn Zehner - International Conference on Computer Graphics Theory and Applications 2010 (GRAPP2010)

The target:

Providing an example system as proof of concepthow a 2D/3D visual information system could looklike in terms of interaction and visualization.

In terms of hardware

In terms of software

Page 9: Mixing Virtual Reality and 2D Visualization – Using ... · Mixing Virtual Reality and 2D Visualization – Using Virtual Environments as Visual 3D Information Systems for Discussion

Page 9 Björn Zehner - International Conference on Computer Graphics Theory and Applications 2010 (GRAPP2010)

Display design considerations?

UFZ’s display system is mainly used for presentations and discussions:Large screenHigh resolution for showing much detailVR capability (tracking, stereo)Option to show 2D information, e.g. areal imagesOption to mix 2D and 3D

Page 10: Mixing Virtual Reality and 2D Visualization – Using ... · Mixing Virtual Reality and 2D Visualization – Using Virtual Environments as Visual 3D Information Systems for Discussion

Page 10 Björn Zehner - International Conference on Computer Graphics Theory and Applications 2010 (GRAPP2010)

Mode 1: Virtual Reality (cluster based)

Page 11: Mixing Virtual Reality and 2D Visualization – Using ... · Mixing Virtual Reality and 2D Visualization – Using Virtual Environments as Visual 3D Information Systems for Discussion

Page 11 Björn Zehner - International Conference on Computer Graphics Theory and Applications 2010 (GRAPP2010)

Mode 1: Virtual Reality (cluster based)

Page 12: Mixing Virtual Reality and 2D Visualization – Using ... · Mixing Virtual Reality and 2D Visualization – Using Virtual Environments as Visual 3D Information Systems for Discussion

Page 12 Björn Zehner - International Conference on Computer Graphics Theory and Applications 2010 (GRAPP2010)

Mode 2: Using a video wall controller

Page 13: Mixing Virtual Reality and 2D Visualization – Using ... · Mixing Virtual Reality and 2D Visualization – Using Virtual Environments as Visual 3D Information Systems for Discussion

Page 13 Björn Zehner - International Conference on Computer Graphics Theory and Applications 2010 (GRAPP2010)

Mode 2: Using a video wall controller

Page 14: Mixing Virtual Reality and 2D Visualization – Using ... · Mixing Virtual Reality and 2D Visualization – Using Virtual Environments as Visual 3D Information Systems for Discussion

Page 14 Björn Zehner - International Conference on Computer Graphics Theory and Applications 2010 (GRAPP2010)

Mode 3: Cluster and video wall controller

Page 15: Mixing Virtual Reality and 2D Visualization – Using ... · Mixing Virtual Reality and 2D Visualization – Using Virtual Environments as Visual 3D Information Systems for Discussion

Page 15 Björn Zehner - International Conference on Computer Graphics Theory and Applications 2010 (GRAPP2010)

Mode 3: Cluster and video wall controller

Page 16: Mixing Virtual Reality and 2D Visualization – Using ... · Mixing Virtual Reality and 2D Visualization – Using Virtual Environments as Visual 3D Information Systems for Discussion

Page 16 Björn Zehner - International Conference on Computer Graphics Theory and Applications 2010 (GRAPP2010)

The OpenSG scenegraph

Open source (www.opensg.org)Implements distributed rendering via a clusterSeparates the structure of the scenegraphand the content (e.g. materials, geometry)Nodes of the scenegraph are named

Names are used for this workto link to further information

Page 17: Mixing Virtual Reality and 2D Visualization – Using ... · Mixing Virtual Reality and 2D Visualization – Using Virtual Environments as Visual 3D Information Systems for Discussion

Page 17 Björn Zehner - International Conference on Computer Graphics Theory and Applications 2010 (GRAPP2010)

Software setup

Page 18: Mixing Virtual Reality and 2D Visualization – Using ... · Mixing Virtual Reality and 2D Visualization – Using Virtual Environments as Visual 3D Information Systems for Discussion

Page 18 Björn Zehner - International Conference on Computer Graphics Theory and Applications 2010 (GRAPP2010)

Tools for 3D interaction

Further information:PositionOrientation

Picking

Navigation

Page 19: Mixing Virtual Reality and 2D Visualization – Using ... · Mixing Virtual Reality and 2D Visualization – Using Virtual Environments as Visual 3D Information Systems for Discussion

Page 19 Björn Zehner - International Conference on Computer Graphics Theory and Applications 2010 (GRAPP2010)

Examples for 3D interactionVolume of interest (VOI):

6 clip planes clip all

information outside

of the box.

Chair-cut: 3 perpendi-

cular clip planes clip an

octant of the volume.

Page 20: Mixing Virtual Reality and 2D Visualization – Using ... · Mixing Virtual Reality and 2D Visualization – Using Virtual Environments as Visual 3D Information Systems for Discussion

Page 20 Björn Zehner - International Conference on Computer Graphics Theory and Applications 2010 (GRAPP2010)

Example for 3D interaction - VOI

Page 21: Mixing Virtual Reality and 2D Visualization – Using ... · Mixing Virtual Reality and 2D Visualization – Using Virtual Environments as Visual 3D Information Systems for Discussion

Page 21 Björn Zehner - International Conference on Computer Graphics Theory and Applications 2010 (GRAPP2010)

Example for 3D interaction - VOI

Page 22: Mixing Virtual Reality and 2D Visualization – Using ... · Mixing Virtual Reality and 2D Visualization – Using Virtual Environments as Visual 3D Information Systems for Discussion

Page 22 Björn Zehner - International Conference on Computer Graphics Theory and Applications 2010 (GRAPP2010)

Example for 3D interaction – chair-cut

Page 23: Mixing Virtual Reality and 2D Visualization – Using ... · Mixing Virtual Reality and 2D Visualization – Using Virtual Environments as Visual 3D Information Systems for Discussion

Page 23 Björn Zehner - International Conference on Computer Graphics Theory and Applications 2010 (GRAPP2010)

Example for 3D interaction – chair-cut

Page 24: Mixing Virtual Reality and 2D Visualization – Using ... · Mixing Virtual Reality and 2D Visualization – Using Virtual Environments as Visual 3D Information Systems for Discussion

Page 24 Björn Zehner - International Conference on Computer Graphics Theory and Applications 2010 (GRAPP2010)

Button is pressed

Ray intersectsleft or right sideof the display

Ray intersectsmain screen orfloor of the display

Report to the 2D-Window-Manager

Joystick is usedfor scrolling 2Dwindows

Steering what is shown in the 2D windows

Next slide

Page 25: Mixing Virtual Reality and 2D Visualization – Using ... · Mixing Virtual Reality and 2D Visualization – Using Virtual Environments as Visual 3D Information Systems for Discussion

Page 25 Björn Zehner - International Conference on Computer Graphics Theory and Applications 2010 (GRAPP2010)

Root

Group„Boreholes“

Group„Geology“

Group„VTK-Data“

Geom„Bor_1“

:Geom„Bor_13“

Geom„Tertiary“

:Geom„Perm“

Geom„Iso_Pb“

:

Ray intersection with the scenegraph

2D Window Manager„Bor_1“ -> show X on left window„Bor_2“ -> ……..

:„Bor_14“-> show Y on left window

-> show Z on right window

„Bor_1“ has been picked

Left Window

showing X

Steering what is shown in the 2D windows

Page 26: Mixing Virtual Reality and 2D Visualization – Using ... · Mixing Virtual Reality and 2D Visualization – Using Virtual Environments as Visual 3D Information Systems for Discussion

Page 26 Björn Zehner - International Conference on Computer Graphics Theory and Applications 2010 (GRAPP2010)

Example: Selection of a borehole

Page 27: Mixing Virtual Reality and 2D Visualization – Using ... · Mixing Virtual Reality and 2D Visualization – Using Virtual Environments as Visual 3D Information Systems for Discussion

Page 27 Björn Zehner - International Conference on Computer Graphics Theory and Applications 2010 (GRAPP2010)

Overall feedback was good so far. The 2D navigation window helps when people are lost.

Problems:-The wide angle of view allows only to view

one side screen at a time, possibly an advantage of usingadditional gadgets or 2D widgets in 3D space.

-Datamanagement

Next step: Incorporating the system into a large projectat the UFZ for evaluation and comparison to other approaches.

Conclusions/Problems/Outlook