Rich Semantics for Interactive 3D Models of Cultural Artifacts

Leslie F. Sikos, Ph.D. Flinders University, Australia

MTSR 2016, 23 Nov 2016 Göttingen, Germany

Rich Semantics for 3D Models

• Interactive 3D Applications

• Rationale

• 3D Ontologies: A Short History

• 3D Modeling Ontology

– Development

– Applications

Rich Semantics for Interactive 3D Models of Cultural Artifacts 2/21

Outline

Interactive 3D Applications

Rich Semantics for Interactive 3D Models of Cultural Artifacts 3/21

Virtual Museum – 2.5D, No 3D Models

The British Museum (Google Arts & Culture)

Interactive 3D Applications

Rich Semantics for Interactive 3D Models of Cultural Artifacts 4/21

3D Models with ROIs

The British Museum (Sketchfab)

Interactive 3D Applications

Rich Semantics for Interactive 3D Models of Cultural Artifacts 5/21

Interactive 3D Models

Smithsonian X 3D

Rationale

• Modeled or 3D scanned model in VRML or PLY

Rich Semantics for Interactive 3D Models of Cultural Artifacts 6/21

Unstructured 3D Models

Strengths

– Representation of

geometry and

properties

– Visualization

Weaknesses

– No semantics

– Automated processing

is difficult and

inefficient

Rationale

• 3D models in X3D

Rich Semantics for Interactive 3D Models of Cultural Artifacts 7/21

Semi-Structured 3D Models

– Machine-processable

– Not machine-interpretable

Example. The permissible values of directional

light intensity are real numbers between 0 and 1.

Rationale

• For example, a X3D model described

with domain ontology terms

Rich Semantics for Interactive 3D Models of Cultural Artifacts 8/21

Structured 3D Models

– Accurate description with semantics

– Efficient indexing and retrieval, related terms

– Machine-processability and -interpretability,

intelligent processing via reasoning

3D Ontologies

• OntologyX3D (2004)

• RDFS mapping of X3D (2006)

• Common Shape Ontology (2007)

• OWL mapping of X3D (2012)

• Kinect Ontology (2013)

Rich Semantics for Interactive 3D Models of Cultural Artifacts 9/21

A Brief History

The 3D Modeling Ontology

3D Modeling Ontology: OWL 2 mapping

of entire X3D v3.3 complemented by

terms from the 3D modeling industry not

covered by the X3D standard (ISO/IEC

19775, 19776, and 19777)

Rich Semantics for Interactive 3D Models of Cultural Artifacts 10/21

A Novel 3D Ontology

The 3D Modeling Ontology

• Namespace structure with versioning

support

• Transparent translation from X3D’s XML

vocabulary to OWL 2 is not optimal

• Property relations are not standardized

Rich Semantics for Interactive 3D Models of Cultural Artifacts 11/21

Modeling Challenges

The 3D Modeling Ontology

• New concept and role hierarchy

• De facto standard terms reused as per

Semantic Web best practices

• Resolved conceptual ambiguity and

homonymous role naming issues

Rich Semantics for Interactive 3D Models of Cultural Artifacts 12/21

Addressing Issues

The 3D Modeling Ontology

• Ambiguous properties, e.g., bottom

–bottom object property of a

cubemap: cubemap bottom texture –bottom datatype property of a

cone: cone bottom cap is created?

Rich Semantics for Interactive 3D Models of Cultural Artifacts 13/21

Addressing Issues (Continued)

The 3D Modeling Ontology

• Semantically enriched 3D cultural

heritage models, virtual museums

• Engineering

• Medical training

• Entertainment

Rich Semantics for Interactive 3D Models of Cultural Artifacts 14/21

Potential Applications

The 3D Modeling Ontology

Rich Semantics for Interactive 3D Models of Cultural Artifacts 15/21

Application Example

Semantic enrichment

of a 3ds Max ancient

Greek vase model

with structured

description and LOD

The 3D Modeling Ontology

Rich Semantics for Interactive 3D Models of Cultural Artifacts 16/21

Application Example

The 3D Modeling Ontology

Rich Semantics for Interactive 3D Models of Cultural Artifacts 17/21

Application Example (Continued)

The 3D Modeling Ontology

Rich Semantics for Interactive 3D Models of Cultural Artifacts 18/21

Application Example (Continued)

The 3D Modeling Ontology

Rich Semantics for Interactive 3D Models of Cultural Artifacts 19/21

Application Example (Continued)

The 3D Modeling Ontology

Rich Semantics for Interactive 3D Models of Cultural Artifacts 20/21

Application Potential

• Not only annotation and indexing

• Reasoning over 3D models, e.g.,

–Differentiate between ancient

Attican and Apulian red-figure vases

–Compare ancient vases by volume

Rich Semantics for 3D Models Conclusions

• Semantically enriched 3D models can be used

for reasoning intelligent 3D applications

• The 3D Modeling Ontology: The first 3D

ontology that covers the entire X3D standard

and provides a comprehensive coverage of

terms from the 3D modeling industry

21/21 Rich Semantics for Interactive 3D Models of Cultural Artifacts

Thank you.

Questions?