Tabletop Interactive Camera ControlMukesh Barange / Master Thesis 2010

Armando de la Re Vega

WGM #53May 4th 2012

Introduction

•Controlling virtual camera covers positioning, motion planning and computing the user's viewpoint in a scene.

•Virtual Camera control is an important problem in 3D computer graphics areas.

•Camera control systems in many 3D computer applications is inspired by cinematographic techniques.

•Users interact with 3D virtual environment by viewing the scene generated by the virtual camera.

2

Techniques for Camera Control in a Virtual Environment•A virtual 3D camera view is defined by

parameters of the camera:▫Position.▫Direction vector.▫Field of view (lens angle).

•Numbers of techniques have been proposed for both interactive and automatic control of virtual camera. ▫Modelers, videogames, visualization,

multimodal systems.3

Techniques for Camera Control in a Virtual Environment

•Computing the camera path, evaluation and avoidance of occlusions are some key challenges in interactive camera control.

•The basic objectives of the camera control are choosing the best position and angle of the camera and providing an occlusion free view of virtual environment.

4

Multitouch for Camera Control

•Multi-touch surfaces can accept natural hand gestures and other intuitive devices as input.

•Intuitive, consistent look and feel, and direct engagement of the objects.

•Offer an interesting alternative to control objects with many DOFs.

•There are many issues related to the interactive control of a virtual camera.

5

Camera Control in Cinematography

•Camera Positioning.▫Tracking: moves alongside a character.▫Panning: rotates in vertical axis.

•Shot composing.▫Close up (shoulders).▫Close shot (waist).▫Medium shot (knee).▫Full shot (all).▫Long shot (distance).

•Cut.6

Camera Control in Computer Graphics

•Automatic approach.▫Declarative properties (orientation,

distance).▫Path properties.

•Reactive approach.▫Driven in direct response to properties in

current images.•Interactive control.

▫Responses to directions from the user.

7

Camera Control in Computer Graphics

•Degrees Of Freedom (DOF).▫Input.▫Output.

•7DOFs for camera (Output).▫3 location.▫3 orientation.▫1 field of view.

8

Interactive Camera Control

• Tasks in camera control:▫ Navigation.▫ Object selection.▫ Object manipulation.

• Taxonomy of interaction metaphors:▫ Direct camera control (D).

Object centered (OCD): explore a single object. User centered (UCD): scene exploration.

▫ Indirect camera control (I).▫ Object selection (OS).▫ Object manipulation (OM).9

Interactive Camera Control

•Navigation:▫Eyeball in hand (UCD / 6DOFs).▫Scene in hand (OCD / 6DOFs).▫Flying vehicle control (UCD / 6DOFs).▫UniCam (UCD / Multitouch??).

•Selection:▫Ray-casting and Cone-casting (OS).

•Selection and Manipulation:▫The virtual hand (UCD,OS,OM, 6DOFs).

10

Exploration of 3D Objects

•Scene in hand.•HoverCam.•ScrutiCam.

11

Tabletop Interaction

•Capacitance.

•Optical.▫Frustrated Total Internal Reflection.▫Diffused Ilumination.▫Diffused Surface Ilumination.

•Resistance.

12

• One-finger for rotation and translation (2DOF).▫Rotate and translate (RNT).

▫R(Z), T(X,Y).▫Improved RNT (TNT).

▫R(Z), T(X,Y).

Taxonomy based in Tabletop Interaction

13

Taxonomy based in Tabletop Interaction

• Two fingers for zoom-rotation-translation.▫Sticky tool (6DOFs).

Move in x,y. Spin in z. Scale.

14

Taxonomy based in Tabletop Interaction

• Three Fingers interaction (6DOFs).▫Shallow-depth 3D interaction.

R(z), T(x,y), R(x,y).

▫Sticky tool. R(z), T(x,y), R(x,y), Z(x,y,z)

15

Multi-touch surface Interaction and Camera control•Navidget.

▫Well suited to navigate in large environments.

▫Harder to use for precise movements.

16

Multi-touch surface Interaction and Camera control•ScrutiCam.

▫Moving to the center of the screen.▫Moving to any other direction.

17

Multi-touch surface Interaction and Camera control•Follow My Finger navigations(FmF).

▫Two views.▫Autofocus.

18

Tabletop Interactive Camera Control

•Frame metaphor ▫3DOFs Translation.▫3DOFs Orientation.▫1DOF Scaling

19

Tabletop Interactive Camera Control

• Frame mode (cannot interact with objects).▫ One finger gestures.

Translation (outside frame). Rotation frame in z axis (inside radius). Translation and rotation (inside rectangle out radius). Object selection (touch object).

▫ Two finger gestures. Zoom and rotation z.

▫ Three finger gestures. Panoramic yaw and pitch.

▫ Four finger gestures. Translation and Tracking.

20

Tabletop Interactive Camera Control

•Object mode.▫One finger gesture.

Select and translate object.▫Two finger gesture.

Zoom and rotation.▫Three finger gesture.

Arcing around object.

21

UniCam

•Distinct camera methods:▫Film plane translation.▫Orbiting about the center of the display.▫Orbiting about a specific 3D point.▫Click to focus on surface points.▫Click to focus on silhouettes edges.▫Region zooming.▫Saving and restoring viewpoints.

22

3D Positioning Techniques for Multi-touch Displays•First approach:

▫Multiple viewports.▫First touch = Orthogonal ray.▫Second touch = depth of ray.

•Second approach:▫Only one view.▫Second touch movement = depth of ray.

23

3D camera control

• Direct controls.▫Translation x, y.▫Rotation x, y.▫Zoom in, Zoom out.▫Rotation z.

• Indirect controls.▫Help.▫Auto rotate.▫Wire mode.▫Frame per second.▫ Invert camera (up).▫Change view (Normal, anaglyph, Quad).24

3D Camera Control

•OSGviewer▫Reset viewing position.▫Exit application.▫Stereo mode: fusion distance.▫Full screen.

25

Benddesk: Multi-touch on a Curved Display

▫ http://hci.rwth-aachen.de/benddesk▫ http://www.youtube.com/watch?v=5VNTPwVvLzE&feature=rel

ated

26

Bibliography• Tabletop Interactive Camera Control. Mukesh Barange.

Master Thesis 2010• ScrutiCam: Camera Manipulation Technique for 3D

Objects Inspection. F. Decle, M. Hachet, P. Guitton.• Navidget for Easy 3D Camera Positioning from 2D

Inputs. M. Hatchet, F. Decle, S. Knödel, P. Guitton• UniCam - 2D Gestural Camera Controls for 3D

Environments. R. Zeleznik, A. Forsberg.• TNT: Improved Rotation and Translation on Digital

Tables. J. Liu, D. Pinelle, S. Sallam, S. Subramanian, C. Gutwin.

• Sticky Tools: Full 6DOF Force-Based Interaction for Multi-Touch Tables. M. Hancock, T. ten Cate, S. Carpendale.

27

Bibliography• Shallow-Depth 3D Interaction: Design and Evaluation

of One-, Two- and Three-Touch Techniques. M. Hancock, S. Carpendale, A. Cockburn.

• HoverCam: Interactive 3D Navigation for Proximal Object Inspection. A. Khan, B. Komalo, J. Stam, G. Fitzmaurice, G. Kurtenbatch.

• Follow My Finger Navigation. R. Ajaj, F. Vernier, C. Jacquemin.

• Are Existing Metaphors in Virtual Environments Suitable for Haptic Interaction. J. De Boeck, C. Raymaekers, K. Coninx.

• Camera Control in Computer Graphics: Models,Techniques and Applications. M.Christie, P. Oliver. Course Notes Siggraph 2009.

• 3D Positioning Techniques for Multi-touch Displays. A. Martinet, G. Casiez, L. Grisoni.28

Thanks

29