Embed Size (px)
DESCRIPTION
Oct ‘11 – Oct ‘14. “creating a pervasive Augmented Reality paradigm, where information is presented in a ‘user’ rather than a ‘device’ centric way”. FP7-ICT-2011-1.5 Networked Media and Search Systems End-to-end Immersive and Interactive Media Technologies. Partners. FBK - Italy - PowerPoint PPT Presentation
Citation preview
FP7-ICT-2011-1.5 Networked Media and Search Systems End-to-end Immersive and Interactive Media Technologies
“creating a pervasive Augmented Reality paradigm, where information is presented in a ‘user’ rather than a ‘device’ centric way”
Oct ‘11 – Oct ‘14
Evolu
tion o
f Mo
bile
Platfo
rmCreate and
Deliver
Right
Content
Context Sensing Content
Delivery Modalities
User
Quality of
Experience
PartnersFBK - ItalyFraunhofer HHI - GermanyST-Microelectronics – ItalyMetaio - GermanyST-Microelectronics and ST-Ericsson – Francee-Diam Sistemas - SpainSony Mobile - SwedenINRIA - France 38%
25%
38% Research IstitutionsSMEIndustry
CoveragePure Research Applied Research
Lab Prototypes M
obile Prototypes Pre-product
Products
Market
End Users
ChallengesO AR focused platform development
O Visual registration chain user-device-world
O World modelling using consumer-level mobile devices
O Mobile contextual understanding
O Context sensitive content delivery
O User interactions with AR
AR Platform EvolutionO Multi-core CPU & GPU O Hi-res single or dual
cameras, plus large set of sensors
O Smart power management policies
O Address AR requirements in development of platform SW framework and services (e.g. sensor fusion, video pipe optimized for AR use)
O Optimize the whole processing chain, taking server side resources (i.e. The cloud) when possible
Registration chainO Match visual features with nearby
photos to identify ‘tagged’ landmarks
O Match visual features to synthetic models of the World
O Locate text/logos/signs in the environment then check against local geo-objects/events
O Use on-board sensors to guide image / audio processing algorithms
O Estimate user (body, face, hands) position with respect to the device
World modellingO Photogrammetric 3D
reconstruction using mono/ stereo cameras (including historical imagery)
O Structure from motion for modelling dynamic objects in the scene
O Planar surface identification for ad-hoc interactive surfaces
Mobile context understanding
O User motion/activity analysis using on-board sensors
O Fusion of cues from:O modelling and registrationO geo-objectsO geo-social activity
Context sensitive AR deliveryO Inject AR data in a natural manner
according to:O The environmentO OcclusionsO Lighting and shadowsO User activity
O Exploit user and environment ‘context’ to select best delivery modality (text, graphics, audio, haptic, etc.), i.e. scalable/simplify-able audio-visual content
User InteractionsO Explore evolving means of AR
delivery and interactionO In-air interfaces for sensing
gestures (motion of device, hands, face, etc..)
O 3D audioO Micro-projection for multi-
user, social-ARO AR visors/glasses
PrototypesO A consolidated prototype at the end of each
year to be evaluated through Use CasesO 3 Use Cases
O TourismO GamingO Personal assistant
“creating a pervasive Augmented Reality paradigm, where information is presented in a ‘user’ rather than a ‘device’ centric way”
