The Visualization The Visualization Brazilian NetworkBrazilian Network

Bruno FeijóVisionLab/PUC-Rio

Some Pioneer Results – Some Pioneer Results – BrazilBrazil

ComputingBroadcast ProductionElectronic Systems: Banking, VotingSoftware Engineering (LUA, Agents, ...)

Visualization in early 80’s: TV GloboComputer Graphics in the Broadcast Industry

Developments with a Spin-off: PDI

First in Television Drama TechnologyFirst to use 1-inch videotape in outdoor shootingsPartnership with Sony

First Outdoor Blue Screen (early 90’s)

The Concept Of The Concept Of VisualizationVisualization

It is more than data visualization and Virtual Reality applications

Visualization as visual simulation of processes and environments with a technological basis shared by several strategic sectors

Game = cinema = TV = simulator = …

Strategic MacrosectorDigital Content Production, Broadcast, Cinema, Oil, Games, Defense, …

VisualizationVisualizationFuture scenarioFuture scenario

Computational HolographyEntertainment, Defense, Communication, Education

Artificial IntelligenceUltra-Definition (4K, 8K, …)WaterThe Connection Point

A single point with information, education, entertainment, communication, and services – ...visual

Strategic development policy – Minister of Science and Technology

A network of intelligence connecting industry and academy

Research, Development and Innovation

Goals: To organize the visualization sector and to promote innovation in order to increase competitiveness

Structured by competences

Visualization Brazilian Visualization Brazilian NetworkNetworkRBVRBV

RBVRBVCurrent CompetencesCurrent Competences

[2] Broadcast and Digital Content Prodution (PUC-Rio)

SP: [4] Industrial (USP)

RG: [5] Security and Defense (PUC-RS)

PE: [1] Games and Simulation (UFPE)

Strategic Kernel – RBV JPessoa Digital Production Pole of Olinda Pole of Games - PortoDigital

Lamce/UFRJ VisionLab/PUC-Rio

UFRJTechnologicalPark(under construction)

Pole Rio Cine&Video

[3] Energy, Gas, and Oil (UFRJ)Rio:

Rio

Economic Cluster (Pole)

1

234

5

University Lab aligned

With R&D&I&Business

StrategicKernels:clusters of intelligence executing National Strategic Projects

National Strategic Projects:Global projects involving more than one Competence and having economic feasibility

Specific Project:Isolated project belonging to a Competence

Key Concepts:- Local Productive Clusters- Strategic firms- Logistics- Resource equalization- Management uniformity- First organizing, financing later

R&D Lab(University)

Cluster of Production and Business

Studios to rentClusters and Motion CaptureOffices for resource allocationProduction system supportRepresentatives of agencies for developmentInfrastructure for technical support

Digital Production Commission

R&D Training ServicesNew Products

Pilot AxisVisionLab-PoleRio

MarketP&D

Sub-network(capilarity)

Mechanism for Economic Feasibility

GovernmentSectors

NationalDevelopment

Bank

Internationalorganisms

Strategicfirms

Incubators

Conection to other networks and groups of excellence through inductions or projects in consortium

The Model Of Regional Integrated The Model Of Regional Integrated AxisAxis

VisionLab/Pole RioVisionLab/Pole Rio

Studios&

VisionLab

VisionLab

Firms( 100)

BusinessCenter

Studios

Expansion Area

VisionLabCampus PUC-Rio, Gávea

VisionLabPole Rio Cine&Video

R&D And Innovation In R&D And Innovation In RBVRBV

Emerging and developing country

Low- cost high technology

Simplicity

Cross-functional developmentBetween sectors or companies

Focus on processes

Secrecy versus patentSecrecy, short life cycle, and steps aheadResearch papers and product documentation

VisionLab RVisionLab R&&DD&&II

Reconstruction and Reconstruction and SimulationSimulation

Reconstruction and Reconstruction and SimulationSimulation

Special EffectsSpecial EffectsRealistic Simulation through time

VisionLab for BAND/NBP/RTP (Portugal)

Acident Simulation for TV Drama (3D models + image)VisionLab for NBP/RTP (Portugal)

3D model

3x cheaper and 2x faster

Low Cost Touch Screen Low Cost Touch Screen InterfaceInterface

acrylic

projector

camera

plastic film

Array of infrared LEDs Low cost

High speed

High accuracy

No sound sensors

Platform:

Windows Media Encoder

.Net

IPTV ExperimentsIPTV Experiments

Active Objects

Simultaneous Broadcasting

- digital TV

- internet

http://www.shoptime.com.br/apollo/internetTV.do

Main Text

Text Status

Menu

Traffic

Wheather

Screen Layout for Digital TV

Interactive Digital TVInteractive Digital TVPUC-Rio modelPUC-Rio model

Interactivity icon

Application(VisionLab)

Middleware(NCL/Telemidia)

Standard

WatermarkInteractivity icon

Low-Cost Digital Asset Low-Cost Digital Asset ManagementManagement

(in the compressed domain)

HW And SW For HD Stereo HW And SW For HD Stereo ProjectionProjection

VisionLabAbsolute Technologies

VLab Stereo Player - 2K (High Definition) - no flicking - no audio dependence

The most compact 2K stereo projection system in Brazil

High Definition Stereo High Definition Stereo ProductionProduction

Conventional 3D model

Relief impostor(an image in real time)

Shading model

Image-based Rendering for Image-based Rendering for Games & SimulationsGames & Simulations

CPU-GPU ParallelArchitecture

3D Game Engines, 3D Game Engines, Experimental Games, and Experimental Games, and Mobile GamesMobile Games

Multiplayer Online

Game in Mobile

Phones

Storytelling for Interactive Storytelling for Interactive TV and DefenseTV and Defense

Automatic animation of the attack scene, corresponding to the predicate attack

Currentscene

• There are variations, but the backbone of the plot is not destroyed

• There are both global visions and local/individual visions of the plot

• The characters are intelligents, but fuzzy and emotional – this is Affective Computing in Participative Games

• Dramatic Gaming vs Action Game

The plot has a logical structure. Scenes are predicates with pre e post-conditions, e.g.: attack(draco, princess_castle). Red scenes should wait and green scenes are free to connect.

Emotional Talking HeadsEmotional Talking Heads

VisionLabTeleMídiaIMPA

Facial animationEmotion ModelVirtual Narrator

E1

E2

E3

E4

E5

E6

E7

E8

1.0

0.5

sadness

gloominess grief

disgustloathing

boredom

anger

fury

annoyance

anticipation

interest

vigilance

joy

extasydelight

trust

admiration

acceptance

fear

terror

timidity

surprise

astonishment

uncertainty

Image-based shading for 2D Image-based shading for 2D AnimationAnimation

VisionLabIMPA

D- Digitalization T- Thinning Ch- Chain code N- Normal vectors

O- Outside vectors S- Smoothing F- Flood fill I- Interpolation C- Contour

Preprocessing

Shading

Tracking

Pipeline for the Preprocessing Module

Shading Example

Compression for Irregular Compression for Irregular MeshesMeshes

VisionLabMechanics Dept.Mathematics Dept.

CHalfEdge Structure

Two vectors of integers only (V and M)

3D Bunny with 9672 triangles compressed with the CLERS code(red for C, dark blue for L, green for E, yellow for R, and light blue for S)

C – create; L – left; E – end; R – right; S – split

Example: CCCCcRsLcRCCcRsLEsLRLRE

Microsoft Research Faculty Summit 2007