18
10-11 July 2006 Amste rdam W3C Multimedia Semantics Incubator Gro up F2Fmeeting 10-11th July 2006 Patrizia Asirelli Institute of Information Science and Technologies - ISTI Italian National Research Council - CNR http://www.isti.cnr.it/ Ovidio Salvetti, Massimo Martinelli & Patrizia Asirelli Signals and Images Research Laboratory

Institute of Information Science and Technologies - ISTI Italian National Research Council - CNR

  • Upload
    sylvia

  • View
    30

  • Download
    0

Embed Size (px)

DESCRIPTION

Institute of Information Science and Technologies - ISTI Italian National Research Council - CNR http://www.isti.cnr.it/ Ovidio Salvetti , Massimo Martinelli & Patrizia Asirelli Signals and Images Research Laboratory. Ovidio Salvetti. He is Senior Scientist at ISTI-CNR - PowerPoint PPT Presentation

Citation preview

Page 1: Institute of Information Science and Technologies - ISTI Italian National Research Council  - CNR

10-11 July 2006 Amsterdam

W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006

Patrizia Asirelli

Institute of Information Science and Technologies - ISTI

Italian National Research Council - CNR

http://www.isti.cnr.it/

Ovidio Salvetti, Massimo Martinelli & Patrizia Asirelli

Signals and Images Research Laboratory

Page 2: Institute of Information Science and Technologies - ISTI Italian National Research Council  - CNR

10-11 July 2006 Amsterdam

W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006

Patrizia Asirelli

He is Senior Scientist at ISTI-CNR working in the field of theoretical and applied computer vision.His fields of research are image analysis, pictorial information systems, spatial modelling and intelligent processes for image understanding.

He is scientific coordinator of the activity on "Representation and Communication of Data and Metadata" in the EU Network of Excellence MUSCLE, Multimedia Understanding through Semantics, Computation and Learning.He is co-author of three books and monographs and more than three hundreds technical and scientific articles; he is also owner of ten patents regarding systems and software tools for image analysis.Dr. Salvetti has been scientific co-ordinator of several National and European research and industrial projects, in collaboration with Italian and foreign researc4h groups, in the fields of computer vision and high-performance computing for diagnostic imaging.He was vice-coordinator of the Subproject ‘Dedicated Processors’ of the CNR Finalised Programme ‘Information Systems and Parallel Computation’ and one of the promoters of the CNR Strategic Project ‘Knowledge through Images’.He is member of the Editorial Boards of the International Journals ‘G. Ronchi Foundation Acts’ and ‘Pattern Recognition and Image Analysis’. He is at present the CNR Contact Person in ERCIM (the European Research Consortium for Informatics and Mathematics) for the Working Group on ‘Vision and Image Understanding’ and Member of IEEE and Head of the Signals and Images Lab at ISTI.

[email protected] http://www.isti.cnr.it/php-pers/iselpers.php?Salvetti+Ovidio

Ovidio Salvetti

Page 3: Institute of Information Science and Technologies - ISTI Italian National Research Council  - CNR

10-11 July 2006 Amsterdam

W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006

Patrizia Asirelli

He is is a staff member at ISTI-CNR

Since 2002 he is involved with the activity of the "Signals & Images" Research Laboratory at ISTI-CNR working in the fields of Web technologies, of the XML language family and of the the Semantic Web.

Since 1999 coordinates the ISTI (IEI) Web Systems GroupSince 1997 member of the XML-ITALIA Organizer GroupSince 1989 collaborates with CNR (permanent staff since 1997)

[email protected] http://www1.isti.cnr.it/~Martinelli/

Massimo Martinelli

Program Committee at “WWW10” (Hong Kong 2001)Scientific Committee at the “XML Italy 2000” (Pisa)

He has been involved in several international research projects Currently he is involved in projects related to multimedia ontologies & information integration: - M.U.S.C.L.E. (EU): Multimedia Understanding through Semantics, Computation and Learning -- Heartfaid (EU): Medical-clinical processes and requirements in HF domain and - formulation of the decision making problems

Page 4: Institute of Information Science and Technologies - ISTI Italian National Research Council  - CNR

10-11 July 2006 Amsterdam

W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006

Patrizia Asirelli

She is senior researcher at the Institute o Science and Technology (ISTI) of the Italian National Research Council (CNR) and is involved with the activity of two research groups the Signal and Image Lab working in the MUSCLE NoE , and the Formal Methods and Tools Lab.

[email protected] http://www.isti.cnr.it/php-pers/iselpers.php?Asirelli+Patrizia

Patrizia Asirelli

Research interests have concerned Logic Programming and its applications. In particular her background is on Integrity Constraints for Deductive Databases; Semantic Integration of Deductive and/or Knowledge bases, with concerns on Languages for Mediation; Security issues, focusing on Access Control Policies.

At present her research interests regards the application of previous issues to the Semantic Web, this includes: multimedia metadata handling, logic / knowledge representation, and all issues related to ontology.

In the past years she has been responsible of many Research Projects; Head of the Language and Operating System Group at ISTI; Secretary of GULP (the Italian Association for Logic Programming); Deputy Leader of the Database Research Group of ERCIM, Scientific Officer for Mathematics and Information Technology at INTAS (Bruxelles).

Page 5: Institute of Information Science and Technologies - ISTI Italian National Research Council  - CNR

10-11 July 2006 Amsterdam

W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006

Patrizia Asirelli

Signal & Image Research Lab.Signal & Image Research Lab.• Years of experience in the field of image representation

and understanding; (also expertise in Sound and Video)

• Collaboration with the Dorodnicyn Computing Centre of the Russian Academy of Sciences.

• MUSCLE NoE - Multimedia Understanding through Semantics, Computation and Learning.

Leading WP9: Representation and Communication of Data and Meta-Data

• Participation to the MultiMedia Ontology Group Meeting, London

Call for Common Multimedia Ontology Framework

Page 6: Institute of Information Science and Technologies - ISTI Italian National Research Council  - CNR

10-11 July 2006 Amsterdam

W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006

Patrizia Asirelli

Our Goals

● To grant interaction between different communities in the MUSCLE NoE(vision, speech, text, ML, etc.)

● To define a strategy for the NoE to develop, maintain and provide an integrated metadata service able to support multiple meta-data standards, multiple users and the management of distributed and heterogeneous data, metadata and methodologies

● To act as facilitator in the communication, exchange and interoperability by advising on common formats, creating exchange interfaces, establishing additional standards where needed and formats for meta-data

● To establish a liaison with Standardization Bodies (W3C,...)● Automated retrieval of image analysis algorithms;● Automated construction and combination of algorithms

Page 7: Institute of Information Science and Technologies - ISTI Italian National Research Council  - CNR

10-11 July 2006 Amsterdam

W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006

Patrizia Asirelli

Multimedia Semantics:Multimedia Semantics:issues interesting/contributingissues interesting/contributing

● Multimedia Metadata

● Infrastructure

● Annotations

● Ontology

Page 8: Institute of Information Science and Technologies - ISTI Italian National Research Council  - CNR

10-11 July 2006 Amsterdam

W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006

Patrizia Asirelli

Multimedia MetadataMultimedia Metadata

Background• Multimedia data coming

from different fields• Metadata production,

storing, retrieve, elaboration

Key tools: • MPEG-7 provides detailed

and multimedia specific metadata descriptors.

• Semantic Web technologies (RDF, OWL, etc), promoted by the W3C, enable large scale interoperability of structured knowledge repositories.

Page 9: Institute of Information Science and Technologies - ISTI Italian National Research Council  - CNR

10-11 July 2006 Amsterdam

W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006

Patrizia Asirelli

4M Infrastructure4M InfrastructureMultiMedia Metadata ManagementMultiMedia Metadata Management

AlgorithmsOntology

Integration

X

O

<?xml version=“1.0” ?><mpeg-7>. . .</mpeg-7>

MPEG-7feature

processing

M

I

AAnnotations

XML DB

Page 10: Institute of Information Science and Technologies - ISTI Italian National Research Council  - CNR

10-11 July 2006 Amsterdam

W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006

Patrizia Asirelli

• Approach to the integration of 4M based on Semantic Web - state-of-the-art considered

• Java-based Infrastructure for– MPEG-7 features processing,– XML database managing,– algorithms ontology exploiting, – multimedia semantic annotating,– functions integrating.

• Different contexts: P2P, semi-authoritative, cluster.

4M4M

Page 11: Institute of Information Science and Technologies - ISTI Italian National Research Council  - CNR

10-11 July 2006 Amsterdam

W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006

Patrizia Asirelli

AnnotationsAnnotations• A tool to add annotations describing information inherent to particular application areas(health care information, personalphoto DB, etc...)

• Current annotations based onMPEG-7

• Design of rules to improve searching and reasoning capability (SWRL)

Annotations A

Page 12: Institute of Information Science and Technologies - ISTI Italian National Research Council  - CNR

10-11 July 2006 Amsterdam

W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006

Patrizia Asirelli

Multimedia OntologiesMultimedia OntologiesTo represent characteristics at different levels:

Low level Multimedia Object characteristics (media-dependent features etc.) High level - semantic information/annotations, algorithms, processes,

services, workflow, user preferences, etc.

With different purposes: Annotation, Retrieve, Reasoning, etc.

+Harmonization of existing ontology (modularization, combination/linking

of ontology, integration)

Core ontology->Upper Ontology

=>Need for a Common Multimedia Ontology Framework Contribute to the Call for Common Multimedia Ontology Framework for the definition

of a “meta”-ontology for multimedia objects.

Page 13: Institute of Information Science and Technologies - ISTI Italian National Research Council  - CNR

W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006

Patrizia Asirelli

Multimedia OntologiesMultimedia Ontologies● Two-Level Ontology Description

Multimedia Object - MPEG-7 Multimedia Understanding (high level) Algorithm Ontology

● towards the definition of a Concept-System

Page 14: Institute of Information Science and Technologies - ISTI Italian National Research Council  - CNR

10-11 July 2006 Amsterdam

W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006

Patrizia Asirelli

Algorithms OntologyAlgorithms OntologyImage analysis thesaurus of more than 1000 terms describing

image characteristics algorithms used to obtain images relations among terms

AlgorithmsOntology

O

Developed at the Dorodnicyn Computing Center of the Russian Academy of Science. Under transformation into OWL.

Page 15: Institute of Information Science and Technologies - ISTI Italian National Research Council  - CNR

10-11 July 2006 Amsterdam

W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006

Patrizia Asirelli

FF M&&TM&&T

Formal Method & Tool Laboratory at ISTI

Active in the fields of development and application of formal notations, methods and software support tools for the specification, design and verification of complex computer systems.

These systems often must meet real-time, security constraints and are used in safety-critical missions where also human factors play a major role.

In particular, we are currently involved in research activities in the areas of: • Model-checking algorithms,tools and applications• Quantitative extensions of Process Algebras e related tools• Formal Approaches to the modeling of Human-Computer Interaction• Precise UML• Formal Approaches to Requirements Engineering • Integration of process-algebraic, state-based and functional specification models

Page 16: Institute of Information Science and Technologies - ISTI Italian National Research Council  - CNR

10-11 July 2006 Amsterdam

W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006

Patrizia Asirelli

FF M&&TM&&TFormal Method & Tool Laboratory at ISTI

Interest in this Incubator Group wrtInterest in this Incubator Group wrt

● Semantics issues;Semantics issues;● Ontology issues;Ontology issues;● No multimediaNo multimedia (for the (for the moment).moment).

Page 17: Institute of Information Science and Technologies - ISTI Italian National Research Council  - CNR

10-11 July 2006 Amsterdam

W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006

Patrizia Asirelli

SENSORIA IP : Software Engineering for Service-Oriented Overlay Computers (IST-3-016004-IP-09  2005-2008)

Sensoria Service Ontology:The aim of the ontology is

– to provide a terminological background to enhance the integrationamong the work packages

– to define a basic set of concepts to include in languages for the design of service-oriented systems (high-level and user-oriented perspective)

FF M&&TM&&T

Formal Method & Tool Laboratory at ISTI

Page 18: Institute of Information Science and Technologies - ISTI Italian National Research Council  - CNR

10-11 July 2006 Amsterdam

W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006

Patrizia Asirelli

Thank You for your attention