04/19/23 art.live - 3rd IST Concertation meeting

3rd IST Concertation Meeting

art.live(IST 10942)

Xavier Marichal, UCL

ADERSA - ADETTI - Casterman - CSELT - EPFL - Fastcom - UCL - UJF

04/19/23 art.live - 3rd IST Concertation meeting

Project Objectives

ARchitecture and authoring Tools prototype for Living Images and new

Video Experiments

“The goal of the project is to develop an architecture and a set of tools, both generic

and application dependent, for the enhancement of narrative spaces thanks the

production of a mixed-reality environment.”

04/19/23 art.live - 3rd IST Concertation meeting

Glossary

Mixed RealityAugmented Reality Augmented Virtuality

Reality-Virtuality ContinuumReal environment Virtual environment

(World unmodeled) (World completely modeled)

Telepresence

04/19/23 art.live - 3rd IST Concertation meeting

Pre-Work

Http://urbicande.tele.ucl.ac.be

04/19/23 art.live - 3rd IST Concertation meeting

Concept

04/19/23 art.live - 3rd IST Concertation meeting

Installation Overview

server/router visual database

LANviewer

authoring tool command

WWW

camera(s) + DSP

04/19/23 art.live - 3rd IST Concertation meeting

System architecture

04/19/23 art.live - 3rd IST Concertation meeting

Technical Innovation• Intelligent camera: real-time integrated solution based on

DSPs for the low-level signal processing • Model-based segmentation: low-level high-level

interaction

• Query system: dynamic database that takes into account the

MPEG-7 standard • Mixed 2D-3D approach: 2D and 3D objects within 2D/3D

backgrounds

• Agent-based system: basic architecture (autonomous distributed system); behavior handling; (FIPA-compliant)

• Authoring tool

04/19/23 art.live - 3rd IST Concertation meeting

Socio-cultural Innovation

• Techno-narrative fusion

• Intrinsic properties of the digital media: strong synergies between conceptual methodologies and technological devices

• Exploit all aspects: procedural, participatory, spatial and encyclopedic

04/19/23 art.live - 3rd IST Concertation meeting

art.live position

• Original live narrative content within artistic worlds

• Architecture and tools to produce it with regular machines (PCs)

• FIPA-compliant platform

• Internal usage of MPEG-7 descriptors

• Use of MPEG-4 tools for transmission

• Link with COST211 for image seg. & an.

04/19/23 art.live - 3rd IST Concertation meeting

Progress so far

• State of the art & in-depth definition

• Preliminary integration for IST 2000 demo:– procedural real-time system with “actors”:

Camera acquisit.

Object segment.

Gravity centers

Triggers (interpr.)

Scenario Mgt

Scene compos.

Screen display

04/19/23 art.live - 3rd IST Concertation meeting

Future work

• Trial 1– “Jardins de la BD”, Bercy, Paris

http://www.asuivre.com/asuivre.asp?path=/dossiers/2000/jardinsbd/Default.asp

– March 1st - 21st– Real-time system with “players”: Database Mgt of all ‘external’ data elements (narrative graphs, drawings, maps...)

through the database Exhaustive list of descriptors (via MPEG-7 descriptions) and associated triggers MPEG-4 communication aspects Agentification of the interfaces Basic authoring tool for author/director to insert material in the database Embedded camera demonstration

04/19/23 art.live - 3rd IST Concertation meeting

Cooperation with other projects

• AMOVITE:– possibility for camera plug in art.live

architecture, but later on

• INTERFACE:– joint ICAV3D workshop: special session on

Mixed Reality

• SoNG:– discussion for MPEG-4 tools