54
IDIFF 30 Jan 2008 Brainstorm Multimedia Improving Digital Filmmaking by using Virtual Set technology. by Hector Viguer

iDiff 2008 conference #03 IP-Racine Brainstorm

Embed Size (px)

DESCRIPTION

IP-Racine presentation of Brainstorm results

Citation preview

Page 1: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

Brainstorm MultimediaImproving Digital Filmmaking by

using Virtual Set technology.by

Hector Viguer

Page 2: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

Brainstorm Evolution.

• Working Fields:– VR-Sets for Broadcast– Presentations.

• High end.• Stereo.

– Real Time Render Engine.• Aston.• Accuweather

– Film Previz.• R&D IPRacine• Production - Encodacam.

Page 3: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

VR SET: BBC 2007.

Page 4: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

NASDAQ 2006.

Page 5: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

Brainstorm Evolution.

• 1993 Brainstorm is founded from 2 companies: – Montesa Graphics: Software development

• Custom made software for TV stations.• Custom render engine for animations.

– Punto y Chroma: Production House• 1994: First VR Studio for Television

(Antena3 Spain)• 1995: First International convention:

NAB• UP to now selling REAL TIME

graphics solution all over the world.

Page 6: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

Brainstorm Evolution.

• Film related Projects– Level 47– ILM (Artificial intelligence)– Shadow Projects– General Lift (Encodacam)

Page 7: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

Brainstorm Evolution.

• LEVEL 47– Low budget– Use Virtual Set Techniques.– Use of Precalculated VR

environments (Brenders)– 1997

Page 8: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

Brainstorm Evolution.

• LEVEL 47, MOVIE CLIP

Page 9: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

Brainstorm Evolution.

• Industries Light & Magic– Artificial Intelligence.– Publications.– Siggraph.– 2001

Page 10: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

ILM.

• Computer Graphics World 2001

Page 11: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

ILM.

Page 12: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

ILM.

Page 13: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

ILM.

• Visual FX

Page 14: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

ILM.

• AI, MOVIE CLIP

Page 15: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

Brainstorm Evolution.

• Shadow Projects. Puppets, puppetiers & VR– Television: “The Book of Pooh”.– Film tests:

• Monkey King.• Sizzling Kung Fu Mice.

Page 16: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

Shadow Projects.

Page 17: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

Shadow Projects.

Page 18: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

Shadow Projects.

Page 19: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

Shadow Projects.

Page 20: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

Shadow Projects.

• Monkey King.

Page 21: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

Shadow Projects.

• Monkey King.

Page 22: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

Shadow Projects.

• Monkey King.

Page 23: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

Shadow Projects.

• Monkey King.

Page 24: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

Shadow Projects.

• Monkey King.

Page 25: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

Shadow Projects.

• Monkey King.

Page 26: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

Shadow Projects.

• Monkey King.

Page 27: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

Shadow Projects.

• MOKEY KING, MOVIE CLIP

Page 28: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

Shadow Projects.

• Sizzling Kung Fu Mice.

Page 29: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

Shadow Projects.

• Sizzling Kung Fu Mice.

Page 30: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

Shadow Projects.

Page 31: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

Shadow Projects.

Page 32: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

Brainstorm Evolution.

• General Lift. – Motion Capture Specialist.– Joint Development:

• Encodacam.– Projects:

• Panavision demo.• I Robot (Vancouver) 2004• Stealth (Australia) 2005• Shark Boy and Lava Girl, 2005• Riddick Chronicles, 2006• Speed Racer, 2007/2008

Page 33: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

General Lift.

Page 34: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

General Lift.

Page 35: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

General Lift.

• Sizzling Kung Fu Mice.

Page 36: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

General Lift.

Page 37: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

General Lift.

• PANAVISION DEMO, MOVIE

Page 38: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

General Lift.

• I ROBOT– Vancouver 2004.– Press Releases

• Cinefex 99• Cinema UK• ACS• Film and Video• Premiere• Summer of supervisors

Page 39: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

General Lift.

Page 40: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

General Lift.

• I ROBOT

Page 41: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

General Lift.

• I ROBOT

Page 42: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

General Lift.

• I ROBOT, MOVIE CLIPS

Page 43: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

General Lift.

• SHARK BOY AND LAVA GIRL

– 2005– Movie CLIPS

Page 44: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

General Lift.

• Riddick Chronicles (2006) • SPEED RACER (2007)

– Shooting finished– Nothing can be shown.– Shortly on the screens.

• FUTURE:– General Lift working independent from

Brainstorm.– Superman?

Page 45: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

VR Set Technology Applied.

• Benefits (I).– Director can see.

• Choosing the shots.– Cameramen can Frame.

• Framing with 3D environment.• Continuing shots over 3D.

– Dailies with low quality 3D.• Daily preview with CG BG.

Page 46: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

VR Set Technology Applied.

• Benefits (II).– Camera tracking position is

recorded.• No need of Post process tracking

retrieval.– Only good shots with BG are kept.

Page 47: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

VR Set Technology Applied.

• CURRENT STATUS.– IP-RACINE improvements.– HD Preview is possible.– Preview quality is growing very fast.

• Due to 3D Graphic cards and games.– Less Hardware required.

• Shaders technology• Chromakey using shaders.

Page 48: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

RealTime PREVIZ

• Current status of Quality.• SHADERS, MOVIE CLIP

Page 49: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

FILM - REAL TIME - PREVIZ.• REAL TIME RENDERING

– SDI and HD rendering in real time.– Real-time software Chroma-Key for

low quality preview.• EQUIPMENT & COST REDUCTION

– Off the shelf Graphic Boards:• Shader technology • OpenGL optimizations.

• VIRTUAL CAMERA PARAMETERS SENT TO VIPER CAMERA.

– Embedded as metadata

• LOCAL DATA RECORDING– Timecode/Camera parameters/Events

data recorder.– SD SDI video recorder.

Page 50: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

Original VR FILM DIAGRAM.

Page 51: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

Improved VR FILM DIAGRAM

SYSTEM WORKFLOW

Page 52: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

Workflow improvements.

• OnSet Previsualization:– Cost Reduction:

• Removal of Video Equipment.• Internal ChromaKey and Delay.

• OnSet PostProcessing.– HD Clip Playback directly in

Brainstorm.

Page 53: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

POSTPROCESSING.• QUASI-REALTIME.• ON-SET High Quality

Shot Preview.• Automated Tool.• Using Shaders:

– Textured Phong Lighting.– Textured Bump Map

Lighting.– High quality defocus.– High quality lighting effects– Software Chromakey– Colour Correction

Page 54: iDiff 2008 conference #03 IP-Racine   Brainstorm

IDIFF 30 Jan 2008

VR Set Technology Applied.

• FUTURE.– Seems promising.– But is slowly starting to be adopted.