FYP Project LYU0303:FYP Project LYU0303:

11

Video Object Tracking and Video Object Tracking and Replacement for Post TV ProductionReplacement for Post TV Production

Augmented RealityAugmented Reality

Augmented Reality (AR) is a form of human-Augmented Reality (AR) is a form of human-machine interaction where information is machine interaction where information is presented in the file of view of an individualpresented in the file of view of an individual augmenting the real world scene necessitating that augmenting the real world scene necessitating that

the user maintains a sense of presence in that world. the user maintains a sense of presence in that world. the virtual images are merged with the real view to the virtual images are merged with the real view to

create the augmented display. create the augmented display. technology for merging the real and virtual image technology for merging the real and virtual image

streams in tight constrain.streams in tight constrain.

AR (movie)AR (movie)

AR Animation (movie)AR Animation (movie)

Key Technologies of ARKey Technologies of AR

accurate registration of the virtual objects accurate registration of the virtual objects with the real world imagewith the real world image camera position, viewing parameterscamera position, viewing parameters digital composition, scene lighting, object digital composition, scene lighting, object

texture mappingtexture mapping real-time processing constrainreal-time processing constrain user viewing methoduser viewing method

AR SystemsAR Systems

Monitor Based Augmented RealityMonitor Based Augmented Reality Video See-through Augmented Reality Video See-through Augmented Reality

DisplayDisplay Optical See-through Augmented Reality Optical See-through Augmented Reality

DisplayDisplay

AR using Monitor (movie)AR using Monitor (movie)

AR using Head Mount Device (movie)AR using Head Mount Device (movie)

ARCADE: Augmented Reality Computing ARCADE: Augmented Reality Computing Arena for Digital EntertainmentArena for Digital Entertainment

AR provides new ways of digital AR provides new ways of digital entertainment possibilities when entertainment possibilities when combining with traditional entertainment combining with traditional entertainment channels. channels.

Key applications: TV and Movie Key applications: TV and Movie productions combining fantasy with realityproductions combining fantasy with reality

LYU0303: Video Object Tracking and LYU0303: Video Object Tracking and Replacement for Post TV productionReplacement for Post TV production

Design the special pattern markers for 3D Design the special pattern markers for 3D objects to be applied on objects during the video objects to be applied on objects during the video shooting shooting

Develop efficient algorithm to calculate the Develop efficient algorithm to calculate the object’s positions and orientations in the videoobject’s positions and orientations in the video Non real-time algorithmNon real-time algorithm MPEG-1 or DV quality videoMPEG-1 or DV quality video The special pattern marks and the detection algorithm The special pattern marks and the detection algorithm

must survive from the partial occlusion of the object. must survive from the partial occlusion of the object.

LYU0303: Video Object Tracking and LYU0303: Video Object Tracking and Replacement for Post TV productionReplacement for Post TV production

Develop algorithm to determine the lighting Develop algorithm to determine the lighting condition of the scene in a video condition of the scene in a video

Generate realistic images to replace the video Generate realistic images to replace the video object according to it’s positions and orientations object according to it’s positions and orientations non real-time algorithmnon real-time algorithm MPEG-1 or DV quality videoMPEG-1 or DV quality video Simple object, soda can or cereal boxSimple object, soda can or cereal box The algorithm must survive from the partial occlusion The algorithm must survive from the partial occlusion

of the object of the object Photometric registration problemPhotometric registration problem

Popular 2D MarkersPopular 2D Markers

Illustration of possible Special Illustration of possible Special Pattern Markers for 3D ObjectPattern Markers for 3D Object

Same Object Two Brand NamesSame Object Two Brand Names

ReferencesReferences

International Symposium on Mixed and Augmented RealiInternational Symposium on Mixed and Augmented Reality, ISMAR 1999-2002ty, ISMAR 1999-2002

Can be downloaded from IEEE website using Campus network Can be downloaded from IEEE website using Campus network (IP address restrictions)(IP address restrictions)

ieeexplore.ieee.org/xpl/tocresult.jsp?isNumber=24594ieeexplore.ieee.org/xpl/tocresult.jsp?isNumber=24594 Augmented Reality WebsiteAugmented Reality Website

www.augmented-reality.orgwww.augmented-reality.org MagicBookMagicBook

www.hitl.washington.edu/magicbook/www.hitl.washington.edu/magicbook/ Virtual ShowcaseVirtual Showcase

http://virtual-showcase.com/http://virtual-showcase.com/