4D Reconstruction of the Past

Grant agreement no 32452

Overview

A complete approach able to search, process, model, 3D reconstruct, create metadata and build new production services and re-use cultural heritage content.

The importance of 4D urban environment modeling can be, further, emphasized by examining its two main components: 3D content Time-varying content (X+Y+Z+Time=4D).

Cultural and creative industries (CCI)

CCI economy sector can constitute one of the main European engines for growth and job creation

Currently it represents 4.5% of total European GDP and 3.8% of the workforce

Further growth is expected the following years: Request for skillful employers Request for new data / metadata formats and

applications We were motivated because of the above

Beyond 3d reconstruction

Reconstruction of historical monuments in 3d computer

Advantages: Data availability: thousands of images floating

around the web Involves time dimension: Temporal ordering of the

images using advance machine learning techniques. Metadata extraction: Export further information

from the images in order to create more accurate information: architectural style, building material, usage, etc.

The general idea

Research

methodology

and development process

Data acquisition•Obtain data from distributed & heterogeneous DBs/digital libraries•Use of cross-domain images

Spatial Matching Temporal Ordering•Overcome complexity of visual content•Sets of images representing the same place•Temporal ordering of images belonging to the same set

4D Reconstruction•Exploit temporal ordered images to reconstruct the scene in 4 dimensions

Simulation•Simulation system capable to generate a 3D urban model over time•Expand Web-Browsing

Data Aggregation•Meta-data engine

Harvesting Data/Injecting Metadata•EUROPEANA•UNESCO

Data origins

Available data

Web picturesBlueprints

Paintings

Organized databases

Other

Search & processing of data

Raw data Classification Temporal Ordering

New

er

Old

er

Redundant images

Search keyword: plateia omonoias 2 classes: useful & redundant images

Modeling & 3D reconstruction

Requirements: quick modeling and accurate adjustments to the measured data

Use of various data allow the positioning of the architectural element in the 3D scene: 2D plans and pictures (selection of pixels) 3D laser scanning (selection of cloud points)

Augmented reality application

The system bridges the gap between recreation and science and renders culture and history more accessible to a wider public.

More lively and realistic experience

Original image

Augmented image

Metadata creation & extraction

Specifying a set of metadata that are necessary for representing fully building identity

Dinning the associations between several metadata elements

Metadata Elements

Metadata Structure

Instantiation

Alignment

How can it be beneficial?

Availability of cultural content in digitized forms is a critical necessity for the preservation of the continuity of our heritage and identity as Europeans.

Serve as a base for new innovative applications in the field of 4D reconstruction, as well as an extension to already existing applications.

Conclusion

A new approach which enables us to reconstruct cultural heritage content on 4 dimensions.

Adoption of new schemes, for 4D visual content reconstruction under a scalable way, visual search at the wild and tools for visualization and augmented reality, is feasible.

Acknowledgments

The research leading to these results has received funding from the People Programme (Marie Curie Actions) of the European Union's Seventh Framework Programme FP7-PEOPLE 2007-2013 under REA grant agreement IAPP2012 no 324523

4D-CH Associated partners

7Reasons

Cyprus University of Technology

DigiNext

Fraunhofer Institute for Computer Graphics Research

Institute of Photogrammetry University of Stuttgart

Technical University of Crete

Synergies and complementarities of the partners

End of presentationThank you!

In the end, the character of a civilization is encased in its structures.

Gehry, Frank, Pritzker Prize-winner