Dr Joanna Isabelle Olszewska

School of Computing and Engineering, University of Huddersfield, UK.

VL 2011, 15.09.2011, Brighton, UK.

Spatio-Temporal Spatio-Temporal Visual OntologVisual Ontologyy

Dr Joanna Isabelle Olszewska

© J. I. Olszewska

Contents Ontology Definition Spatio-Temporal Visual Ontology (STVO)

Motivation Concepts Relations

Application: STVO-Coupled Active Contours Experiments Evaluation

Conclusions2

VL 2011, 15.09.2011, Brighton, UK.

© J. I. Olszewska

Ontology Definitions In Philosophy (IVth century BC)

« study of being »  In AI (1980’s)

specific vocabulary used to describe a certain reality

+ a set of explicit assumptions regarding the meaning of the vocabulary

In Computer Science (1993) « specification of a conceptualization »

3

VL 2011, 15.09.2011, Brighton, UK.

© J. I. Olszewska

Spatio-Temporal Visual Ontology Motivation

mapping of low-level descriptor values to higher-level semantics

bridging the gap between visual features and semantic knowledge

4

VL 2011, 15.09.2011, Brighton, UK.

© J. I. Olszewska

Spatio-Temporal Visual Ontology Concepts

5

VL 2011, 15.09.2011, Brighton, UK.

© J. I. Olszewska

Relations Spatial

Topological relations: Region Connection Calculus (RCC-8) relations

Directional relative postions: o’clock intra and inter-object relations

Relative distances (close/far relations)

Temporal Visual

Spatio-Temporal Visual Ontology

6

RCC-8 topological relations

O’clock inter-object spatial relations

O’clock intra-object spatial relations

VL 2011, 15.09.2011, Brighton, UK.

© J. I. Olszewska

Experiments

STVO-Coupled Active Contours

7

VL 2011, 15.09.2011, Brighton, UK.

© J. I. Olszewska

STVO-Coupled Active Contours Evaluation

Precision of detection

Precision of answers

8

Frame 1216 PAC GAC MTAC

precision of detection

0% 50% 100%

CVBASE Spatial onto Visual onto STVO

precision of answers

50% 50% 100%

= # correct contours / # targets

= # correct answers / # queries

VL 2011, 15.09.2011, Brighton, UK.

© J. I. Olszewska

Conclusions Spatio-Temporal Visual Ontology (STVO)

Granular conceptualization and a hierarchical representation of the visual observation domain

Semantical characterization of each visual scene and its components (e.g. objects of interest)

New sematically meanignful inter- and intra-object spatio-temporal relations

Support of the reasoning about photomoetric, geometrical and spatio-temporal relations between and within the multiple observed objects or parts of tem for the effective interpretation of visual information.

Application to Dynamic Visual Scene Analysis9

VL 2011, 15.09.2011, Brighton, UK.

Dr Joanna Isabelle Olszewska

School of Computing and Engineering, University of Huddersfield, UK.

Thank YouThank You

VL 2011, 15.09.2011, Brighton, UK.

Spatio-Temporal Spatio-Temporal Visual OntologVisual Ontologyy

Contact DetailsContact DetailsDr Ir Joanna Olszewskaj.olszewska@hud.ac.uk

School of Computing and EngineeringUniversity of Huddersfield, QueensgateHuddersfield, HD1 3DH, United Kingdom