iDiff 2008 conference #03 IP-Racine Brainstorm

IDIFF 30 Jan 2008

Brainstorm MultimediaImproving Digital Filmmaking by

using Virtual Set technology.by

Hector Viguer

IDIFF 30 Jan 2008

Brainstorm Evolution.

• Working Fields:– VR-Sets for Broadcast– Presentations.

• High end.• Stereo.

– Real Time Render Engine.• Aston.• Accuweather

– Film Previz.• R&D IPRacine• Production - Encodacam.

IDIFF 30 Jan 2008

VR SET: BBC 2007.

IDIFF 30 Jan 2008

NASDAQ 2006.

IDIFF 30 Jan 2008

Brainstorm Evolution.

• 1993 Brainstorm is founded from 2 companies: – Montesa Graphics: Software development

• Custom made software for TV stations.• Custom render engine for animations.

– Punto y Chroma: Production House• 1994: First VR Studio for Television

(Antena3 Spain)• 1995: First International convention:

NAB• UP to now selling REAL TIME

graphics solution all over the world.

IDIFF 30 Jan 2008

Brainstorm Evolution.

• Film related Projects– Level 47– ILM (Artificial intelligence)– Shadow Projects– General Lift (Encodacam)

IDIFF 30 Jan 2008

Brainstorm Evolution.

• LEVEL 47– Low budget– Use Virtual Set Techniques.– Use of Precalculated VR

environments (Brenders)– 1997

IDIFF 30 Jan 2008

Brainstorm Evolution.

• LEVEL 47, MOVIE CLIP

IDIFF 30 Jan 2008

Brainstorm Evolution.

• Industries Light & Magic– Artificial Intelligence.– Publications.– Siggraph.– 2001

IDIFF 30 Jan 2008

ILM.

• Computer Graphics World 2001

IDIFF 30 Jan 2008

ILM.

IDIFF 30 Jan 2008

ILM.

IDIFF 30 Jan 2008

ILM.

• Visual FX

IDIFF 30 Jan 2008

ILM.

• AI, MOVIE CLIP

IDIFF 30 Jan 2008

Brainstorm Evolution.

• Shadow Projects. Puppets, puppetiers & VR– Television: “The Book of Pooh”.– Film tests:

• Monkey King.• Sizzling Kung Fu Mice.

IDIFF 30 Jan 2008

Shadow Projects.

IDIFF 30 Jan 2008

Shadow Projects.

IDIFF 30 Jan 2008

Shadow Projects.

IDIFF 30 Jan 2008

Shadow Projects.

IDIFF 30 Jan 2008

Shadow Projects.

• Monkey King.

IDIFF 30 Jan 2008

Shadow Projects.

• Monkey King.

IDIFF 30 Jan 2008

Shadow Projects.

• Monkey King.

IDIFF 30 Jan 2008

Shadow Projects.

• Monkey King.

IDIFF 30 Jan 2008

Shadow Projects.

• Monkey King.

IDIFF 30 Jan 2008

Shadow Projects.

• Monkey King.

IDIFF 30 Jan 2008

Shadow Projects.

• Monkey King.

IDIFF 30 Jan 2008

Shadow Projects.

• MOKEY KING, MOVIE CLIP

IDIFF 30 Jan 2008

Shadow Projects.

• Sizzling Kung Fu Mice.

IDIFF 30 Jan 2008

Shadow Projects.

• Sizzling Kung Fu Mice.

IDIFF 30 Jan 2008

Shadow Projects.

IDIFF 30 Jan 2008

Shadow Projects.

IDIFF 30 Jan 2008

Brainstorm Evolution.

• General Lift. – Motion Capture Specialist.– Joint Development:

• Encodacam.– Projects:

• Panavision demo.• I Robot (Vancouver) 2004• Stealth (Australia) 2005• Shark Boy and Lava Girl, 2005• Riddick Chronicles, 2006• Speed Racer, 2007/2008

IDIFF 30 Jan 2008

General Lift.

IDIFF 30 Jan 2008

General Lift.

IDIFF 30 Jan 2008

General Lift.

• Sizzling Kung Fu Mice.

IDIFF 30 Jan 2008

General Lift.

IDIFF 30 Jan 2008

General Lift.

• PANAVISION DEMO, MOVIE

IDIFF 30 Jan 2008

General Lift.

• I ROBOT– Vancouver 2004.– Press Releases

• Cinefex 99• Cinema UK• ACS• Film and Video• Premiere• Summer of supervisors

IDIFF 30 Jan 2008

General Lift.

IDIFF 30 Jan 2008

General Lift.

• I ROBOT

IDIFF 30 Jan 2008

General Lift.

• I ROBOT

IDIFF 30 Jan 2008

General Lift.

• I ROBOT, MOVIE CLIPS

IDIFF 30 Jan 2008

General Lift.

• SHARK BOY AND LAVA GIRL

– 2005– Movie CLIPS

IDIFF 30 Jan 2008

General Lift.

• Riddick Chronicles (2006) • SPEED RACER (2007)

– Shooting finished– Nothing can be shown.– Shortly on the screens.

• FUTURE:– General Lift working independent from

Brainstorm.– Superman?

IDIFF 30 Jan 2008

VR Set Technology Applied.

• Benefits (I).– Director can see.

• Choosing the shots.– Cameramen can Frame.

• Framing with 3D environment.• Continuing shots over 3D.

– Dailies with low quality 3D.• Daily preview with CG BG.

IDIFF 30 Jan 2008

VR Set Technology Applied.

• Benefits (II).– Camera tracking position is

recorded.• No need of Post process tracking

retrieval.– Only good shots with BG are kept.

IDIFF 30 Jan 2008

VR Set Technology Applied.

• CURRENT STATUS.– IP-RACINE improvements.– HD Preview is possible.– Preview quality is growing very fast.

• Due to 3D Graphic cards and games.– Less Hardware required.

• Shaders technology• Chromakey using shaders.

IDIFF 30 Jan 2008

RealTime PREVIZ

• Current status of Quality.• SHADERS, MOVIE CLIP

IDIFF 30 Jan 2008

FILM - REAL TIME - PREVIZ.• REAL TIME RENDERING

– SDI and HD rendering in real time.– Real-time software Chroma-Key for

low quality preview.• EQUIPMENT & COST REDUCTION

– Off the shelf Graphic Boards:• Shader technology • OpenGL optimizations.

• VIRTUAL CAMERA PARAMETERS SENT TO VIPER CAMERA.

– Embedded as metadata

• LOCAL DATA RECORDING– Timecode/Camera parameters/Events

data recorder.– SD SDI video recorder.

IDIFF 30 Jan 2008

Original VR FILM DIAGRAM.

IDIFF 30 Jan 2008

Improved VR FILM DIAGRAM

SYSTEM WORKFLOW

IDIFF 30 Jan 2008

Workflow improvements.

• OnSet Previsualization:– Cost Reduction:

• Removal of Video Equipment.• Internal ChromaKey and Delay.

• OnSet PostProcessing.– HD Clip Playback directly in

Brainstorm.

IDIFF 30 Jan 2008

POSTPROCESSING.• QUASI-REALTIME.• ON-SET High Quality

Shot Preview.• Automated Tool.• Using Shaders:

– Textured Phong Lighting.– Textured Bump Map

Lighting.– High quality defocus.– High quality lighting effects– Software Chromakey– Colour Correction

IDIFF 30 Jan 2008

VR Set Technology Applied.

• FUTURE.– Seems promising.– But is slowly starting to be adopted.