Rich Semantics for Interactive 3D Models of Cultural Artifacts

Rich Semantics for Interactive 3D Models of Cultural Artifacts

Leslie F. Sikos, Ph.D. Flinders University, Australia

MTSR 2016, 23 Nov 2016 Göttingen, Germany

Rich Semantics for 3D Models

• Interactive 3D Applications

• Rationale

• 3D Ontologies: A Short History

• 3D Modeling Ontology

– Development

– Applications

Rich Semantics for Interactive 3D Models of Cultural Artifacts 2/21

Outline

Interactive 3D Applications

Rich Semantics for Interactive 3D Models of Cultural Artifacts 3/21

Virtual Museum – 2.5D, No 3D Models

The British Museum (Google Arts & Culture)

Interactive 3D Applications

Rich Semantics for Interactive 3D Models of Cultural Artifacts 4/21

3D Models with ROIs

The British Museum (Sketchfab)

Interactive 3D Applications

Rich Semantics for Interactive 3D Models of Cultural Artifacts 5/21

Interactive 3D Models

Smithsonian X 3D

Rationale

• Modeled or 3D scanned model in VRML or PLY

Rich Semantics for Interactive 3D Models of Cultural Artifacts 6/21

Unstructured 3D Models

Strengths

– Representation of

geometry and

properties

– Visualization

Weaknesses

– No semantics

– Automated processing

is difficult and

inefficient

Rationale

• 3D models in X3D

Rich Semantics for Interactive 3D Models of Cultural Artifacts 7/21

Semi-Structured 3D Models

– Machine-processable

– Not machine-interpretable

Example. The permissible values of directional

light intensity are real numbers between 0 and 1.

Rationale

• For example, a X3D model described

with domain ontology terms

Rich Semantics for Interactive 3D Models of Cultural Artifacts 8/21

Structured 3D Models

– Accurate description with semantics

– Efficient indexing and retrieval, related terms

– Machine-processability and -interpretability,

intelligent processing via reasoning

3D Ontologies

• OntologyX3D (2004)

• RDFS mapping of X3D (2006)

• Common Shape Ontology (2007)

• OWL mapping of X3D (2012)

• Kinect Ontology (2013)

Rich Semantics for Interactive 3D Models of Cultural Artifacts 9/21

A Brief History

The 3D Modeling Ontology

3D Modeling Ontology: OWL 2 mapping

of entire X3D v3.3 complemented by

terms from the 3D modeling industry not

covered by the X3D standard (ISO/IEC

19775, 19776, and 19777)

Rich Semantics for Interactive 3D Models of Cultural Artifacts 10/21

A Novel 3D Ontology

The 3D Modeling Ontology

• Namespace structure with versioning

support

• Transparent translation from X3D’s XML

vocabulary to OWL 2 is not optimal

• Property relations are not standardized

Rich Semantics for Interactive 3D Models of Cultural Artifacts 11/21

Modeling Challenges

The 3D Modeling Ontology

• New concept and role hierarchy

• De facto standard terms reused as per

Semantic Web best practices

• Resolved conceptual ambiguity and

homonymous role naming issues

Rich Semantics for Interactive 3D Models of Cultural Artifacts 12/21

Addressing Issues

The 3D Modeling Ontology

• Ambiguous properties, e.g., bottom

–bottom object property of a

cubemap: cubemap bottom texture –bottom datatype property of a

cone: cone bottom cap is created?

Rich Semantics for Interactive 3D Models of Cultural Artifacts 13/21

Addressing Issues (Continued)

The 3D Modeling Ontology

• Semantically enriched 3D cultural

heritage models, virtual museums

• Engineering

• Medical training

• Entertainment

Rich Semantics for Interactive 3D Models of Cultural Artifacts 14/21

Potential Applications

The 3D Modeling Ontology

Rich Semantics for Interactive 3D Models of Cultural Artifacts 15/21

Application Example

Semantic enrichment

of a 3ds Max ancient

Greek vase model

with structured

description and LOD

The 3D Modeling Ontology

Rich Semantics for Interactive 3D Models of Cultural Artifacts 16/21

Application Example

The 3D Modeling Ontology

Rich Semantics for Interactive 3D Models of Cultural Artifacts 17/21

Application Example (Continued)

The 3D Modeling Ontology

Rich Semantics for Interactive 3D Models of Cultural Artifacts 18/21

Application Example (Continued)

The 3D Modeling Ontology

Rich Semantics for Interactive 3D Models of Cultural Artifacts 19/21

Application Example (Continued)

The 3D Modeling Ontology

Rich Semantics for Interactive 3D Models of Cultural Artifacts 20/21

Application Potential

• Not only annotation and indexing

• Reasoning over 3D models, e.g.,

–Differentiate between ancient

Attican and Apulian red-figure vases

–Compare ancient vases by volume

Rich Semantics for 3D Models Conclusions

• Semantically enriched 3D models can be used

for reasoning intelligent 3D applications

• The 3D Modeling Ontology: The first 3D

ontology that covers the entire X3D standard

and provides a comprehensive coverage of

terms from the 3D modeling industry

21/21 Rich Semantics for Interactive 3D Models of Cultural Artifacts

Thank you.

Questions?