The Online Audiovisual Archives of Social Sciences and ...semioweb.msh-paris.fr/escom/ressources_enligne/conferences/2007… · Archives of Research » (Archives audiovisuelles de

The Programme “Online Audiovisual Archive of Research in Social Sciences

and Humanities” (AAR)

© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris

PETER STOCKINGER

Equipe Sémiotique Cognitive et Nouveaux Médias (ESCoM)Fondation Maison des Sciences de l’Homme (FMSH)

Institut National des Langues et Civilisations Orientales (INALCO)

Lingnan University – Hong Kong

10th of April 2007

Design graphique et multimédia : Elisabeth de PABLO, MSH

http://www.semionet.com/


The main topics of this lecture are the following three ones:

1. Short presentation of the French programme « AudiovisualArchives of Research » (Archives audiovisuelles de la Recherche; AAR).

2. Presentation and discussion of the publishing of digital audiovisual and multimedia resources dedicated to thepreservation, valorisation and exploitation of scientific andcultural heritage.

3. The principal challenges for digital multimedia librairies (in a European perspective).

Lecture

Topics

Peter Stockinger: The AAR (Hong Kong, 2007)



1st topic

- A short presentation of the AAR programme and itsaudiovisual and multimedia web portal -




1st topic

Text, information and culture

AAR is an important production, R&D and publishing programme launched by Prof. Peter Stockinger ESCoM in his R&D lab during 2002 in Paris and aiming at :

the constitution of an audiovisual, multimedia portal of scientific heritage in social and human sciences;

the exploitation of the audiovisual content in research (scientific communication), education (pedagogical communication), science popularisation (popularisation), …

Concretely speaking:

actually more than 3400 hours of videos and other digital resources

composed of interviews, research seminars, reportages, documentaries, …) in almost all domains of social and human sciences.

Online exploration of the AAR: http://semioweb.msh-paris.fr/AAR



http://semioweb.msh-paris.fr/escom/fr/membres/p_stockinger/stockinger.htm


http://semioweb.msh-paris.fr/AAR/FR/


Figure 1 shows the home page of the web site hosting the AAR audiovisual and multimedia resources.

(figure 1)

1st topic

The AAR Programme



http://semioweb.msh-paris.fr/AAR/FR/Default.asp

http://semioweb.msh-paris.fr/AAR/FR/


Figure 2 shows one possible access to the online audiovisual and multimedia resources of AAR – the collections or series composing the archives. In our concrete case: the series of more than 260 interviews (with scholars, researchers, artists, …).

(figure 2)

1st topic

The AAR Programme



http://semioweb.msh-paris.fr/AAR/FR/EventsTypes.asp?type=1



Figure 3 shows a selection of video resources belonging to the series of more than 50 reportages and documentaries.

(figure 3)

1st topic

The AAR Programme




http://semioweb.msh-paris.fr/AAR/FR/EventsTypes.asp?type=33&author=&thema=&page=2&letter=&envoyer=&mots=&typeArchive=&domaine=&typeManif=33&nom=&etatManif=&state=


Figure 4 shows the access to the audiovisual and multimedia resources via a thematic catalogue. The chosen example: “World Languages and Literatures” composed of more than 30 entries.

(figure 4)

1st topic

The AAR Programme



http://semioweb.msh-paris.fr/AAR/FR/EventsThemas.asp?thema=177



http://semioweb.msh-paris.fr/AAR/FR/EventsThemas.asp?type=&author=&thema=177&page=3&letter=&envoyer=&mots=&typeArchive=&domaine=177&typeManif=&nom=&etatManif=&state=


Figure 5 shows the access to the audiovisual resources of the AAR with the help of a search engine and by means of key words. Concrete example: “Chinese literature” composed of about 17 entries.

(figure 5)

1st topic

The AAR Programme



http://semioweb.msh-paris.fr/AAR/FR/Search.asp?type=&author=&thema=&page=2&letter=&envoyer=quickSearch&mots=Chinese%20literature&typeArchive=&domaine=&typeManif=&nom=&etatManif=&state=

http://semioweb.msh-paris.fr/AAR/FR/Search.asp?type=&author=&thema=&page=2&letter=&envoyer=quickSearch&mots=chinese%20literature&typeArchive=&domaine=&typeManif=&nom=&etatManif=&state=


Figure 6 shows the home page of one of the thematic knowledge spacesof the AAR programme dedicated to the cultural heritage of minorities and social groups (“PCI”) composed of about 380 hours of video material.

(figure 6)

1st topic

The AAR Programme



http://semioweb.msh-paris.fr/corpus/pci/FR/





Figure 7 shows another thematic knowledge space of the AAR Programme dedicated to the linguistic and cultural diversity of mankind (“DLC”) composed of about 400 hours of video material.

(figure 7)

1st topic

The AAR Programme



http://semioweb.msh-paris.fr/corpus/dlc/FR/





Figure 8 shows the access to the whole collection of audiovisual resources documenting the activities of ALBI (Annie Curien, CNRS/FMSH) representing more than 90 hours of video material.

(figure 8)

1st topic

The AAR Programme



http://semioweb.msh-paris.fr/AAR/FR/Search.asp?type=&author=&thema=&page=2&letter=&envoyer=quickSearch&mots=alibi&typeArchive=&domaine=&typeManif=&nom=&etatManif=&state=

http://semioweb.msh-paris.fr/AAR/FR/Search.asp?type=&author=&thema=&page=2&letter=&envoyer=quickSearch&mots=alibi&typeArchive=&domaine=&typeManif=&nom=&etatManif=&state=


Figure 9 shows the home page of one specific ALIBI workshop hold in Shanghai.

(figure 9)

1st topic

The AAR Programme



http://semioweb.msh-paris.fr/AAR/407/accueil.asp?id=407

http://semioweb.msh-paris.fr/AAR/407/accueil.asp?id=407


2nd topic

- The « interactive hypermedia book » (IHB) -




The interactive hypermedia book (abbreviated: IHB) is a specific publishing genre of a given (closed or open) source corpus composed either exclusively by audiovisual sources or by different media sources.

It is – historically speaking – the principal publishing genre of the audiovisual and multimedia resources belonging to the AAR.

As its name already suggests, it is built in analogy to the “written book organised in chapters” which is a traditional publishing genre with some very well known general stereotypic characteristics such as:

the presence of a cover with recurrent (paratextual) information (title, author, publisher, ...);

the overall organisation in chapters, sections, etc.;

the presence of notes, an index, bibliographical information;

a textually linear ordering of sections, chapters, … but which hasn’t to be followed necessarily by the reader.

2nd topic

The« interactive »hypermediabook (IHB)

Peter Stockinger: The AAR (Hongkong, 2007)



The actually online interactive hypermedia book is in French with the title “L’univers des indiens huarpe de Guanachache” (English : “The –natural and cultural – world of the huarpe indios living in the Guanacacheregion”).

(figure 10)

The figure 9 above shows the “cover page” of the interactive book as well as the contents of it (cf. region within the red circle).

2nd topic




http://semioweb.msh-paris.fr/corpus/pci/803/introduction.asp?id=803

http://semioweb.msh-paris.fr/corpus/pci/803/introduction.asp?id=803


The figure 11 below show the pop up window containing the videosection of the interactive book which are, in this case, very simple:

they are ordered following the temporal progress of the series of interviews;

each of them contains the “video text” in three formats as well as (virtually) other information resources completing the video text

(figure 11)

2nd topic




http://semioweb.msh-paris.fr/corpus/pci/FR/video.asp?id=803&ress=2599&video=28038&format=47


Example : a series of interviews with Gregorio Manzur dedicated to the life world and culture of the huarpe croppers),

Source corpus:

mainly the video files documenting the series of interviews with the Argentinean writer,

some simple textual information composing the bibliography and biography of Gregorio Manzur,

as well as some static visual resources (i.e. images),

unpublished documents and writings of G. Manzur,

web sites documenting the world and life of the huarpe croppers.

The source corpus is an open one (it can be enriched by new video files or by other multimedia resources) .

The actually online available interactive hypermedia book may dynamically change – the interactive hypermedia book doesn’t possess a fixed, determined form (new headings may be added, new “video chapters”may be added, …)

2nd topic





From the point of view of the overall objectives that a hypermedia book is presumably able to fulfil:

The huarpe hypermedia book in its actual version :

tends to be above all a faithful report of what Gregorio Manzur has related about the huarpe civilisation:

it hasn’t any other specific objective than the trustful reporting of Mannzur’s discourse.

But other versions of this IHB:

may have other objectives: overtly pedagogical ones, political ones, moralizing ones, etc.

may be elaborated especially with respect to specific user groups, etc.

and will require, for this:

specific contents and specific comments and enrichments of selected video contents;

specific functional parts and specific fitting (organisation) of functional parts

specific interfaces .

2nd topic





In order to be able to produce such “other” versions of the actual version of the huarpe hypermedia book, we :

have to understand more explicitly the organisation, the structure of an IHB, i.e. its “grammar” as a genre or publishing genre;

have to understand the typical activities of “versioning”, of the rewriting of given source corpuses or again given, existing versions belonging to a specific genre, a specific publishing genre (viz., in our case, the IHB).

2nd topic





Discussion : The overall formal structure of THIS version of aninteractive hypermedia book is simple. It is represented by figure 12 below

(figure 12)

2nd topic





Discussion : The basic architecture for ALL video-book like realisations are shown in the diagram above (figure 13)

(figure 13)

2nd topic





Explanations

Parts: the elements that compose an interactive hypermedia book

Functional parts are, for example, the different “chapters”, especially the video chapters (composing one or more “headings”), the “cover page” (“home page”), an introduction, etc.

Physical parts are mainly the “page” itself and the different regions or zones that compose its interface (menu, text zone, image zone, …)

Fitting of parts means the ordering:

between the different chapters (and sub-chapters, …);

among the different regions and zones organising a physical page.

Graphical interface :

recovers all (figurative – eidetic -, topographical, chromatic, textual, …) elements

that compose the zones and regions of a page and that is mainlyresponsible of what is called the “visual chart” or identity of an IHB

2nd topic





“Source corpus” recovers all content data that are used for the authoring of an IHB:

“brute” video files (in our case, dominant), image files, sound files, textual files

“structured information”

and also already authored but reusable products (already existing, IHB, video-lexica, hypermedia encyclopaedias, multilingual versions, etc.); etc.

“Format” means that an IHB is a publishing type or genre

that can be “materialised”, physically transported and “consumed”for instance as a web site, a cderom, an ipod service, a psp service, a service for mobile phones or again a service of i-TV, etc.

Notice: the materialisation, transportation and consumption of an IHB and of any other type or genre of information or knowledge product

is determined by the specific technological, economical, social and also cultural constraints that characterise the use of the listed communication devices.

2nd topic





In any case, the “authoring” of IHB can be technically represented as a set of activities that apply to the above quoted elements in order to produce a concrete IHB.

The whole authoring process of a hypermedia book can be decomposed in routine steps and tasks which are:

1. Synopsis writing.

2. Source corpus collection and constitution.

3. Critical working through the source corpus and scenario designof the hypermedia book.

4. Processing (working on) the video content (for the “video heading”) as well as on other content for previously in the scenario identified headings.

5. Editing of the processed (video and other content) via publishing templates or models.

6. Publishing of the hypermedia book as a web site, a cdrom, a product for mobile devices, etc.

2nd topic





3rd topic

- The AAR audiovisual and multimedia resources: challenges and actually ongoing activities -




List of principal challenges that the audiovisual and multimedia resources of the AAR are facing:

transform this material in a useful tool for formal (secondary, higher) education

transform this material in a useful tool for informal learning (life long learning, u-learning, …)

open this material to a multilingual and multicultural knowledge market

use this material for other objective bounded purposes: political communication, social communication, …

re-use this material in order to contribute to the dialogue “culture, science and citizen”

prepare this material as a knowledge heritage of the actual generation left for future generations

prepare this material for its critical use in the construction of new knowledge.

3rd topic

Challenges and ongoingactivities




This means especially :

the re-authoring or again the repurposing of a given source corpus

with respect to given communication objectives, user groups and exploitation contexts

as well as with respect to chosen genres, publishing genres that are more or less well attuned to the just quoted constraints.

3rd topic





Actually ongoing R&D as well as teaching and learning activities for handling these challenges:

several French and European R&D projects (SAPHIR, LOGOS, DIVAS) dealing with the elaboration and implementation of methodologies and tools for re-authoring audiovisual corpuses as well as for annotating them for different destines or publics;

work with students on specific audiovisual corpuses in order to republish them as bilingual montages; hyper-documentations, thematic folders, video-lexica, etc.

Methodology: semiotic of digital audiovisual document

Tool: Interview – the semiotic workshop for re-authoring or repurposing multimedia source corpuses

First results:

Bilingual versions of audiovisual resources belonging to the AAR;

Multimedia online documentation dedicated to a specific problem, question, theme, etc.

3rd topic





The Interview tool interface – the segmentation of video corpuses (figure 14).

(figure 14)

3rd topic





Figure 17 show the 7 principal steps that have to be passed through in order to produce re-authored versions of a source corpus (figure 15).

(figure 15)

3rd topic





The 7 principal steps are:

1/ Textual description (Step 1):

each segment will receive a title and a very short summary in the target language

2/ Translation &Versioning (Step 2):

each segment has to be “translated” in the target language –translation can take the form of sub-titles, key word translation (“telegraphic style”), a word-to-word translation, a free version, etc.

3/ Thematic description (Step 3):

a segment can be described, in the target language, with respect to the principal topics developed in it

3rd topic





The 7 principal steps are:

4/ Keyword description (Step 4):

keywords referring to people, places, times, monuments, naturalenvironment, symbolic environment, etc. can be provided for eachsegment in the target language

5/ Peritextual description (Step 5):

each segment can be enriched, enhanced for people composing the target culture by means of links to other online resources or useful comments

6/ Paratextual description (Step 6):

the whole description has to be presented as an MMS realisation in a chosen target language and for a chosen target user (general title of the realisation, authors, …).

3rd topic





First results – bilingual versions of monolingual videos. Example: translation and adaptation for a Russian community of a conference given in English by Faleh Jabar (Iraq) on the Salafi suicide bombers in Iraq.

(figure 16)

3rd topic




http://semioweb.msh-paris.fr/AAR/FR/video.asp?id=672&ress=2157&video=1890&format=22

http://semioweb.msh-paris.fr/AAR/FR/video.asp?id=672&ress=2157&video=1890&format=22


The homepage of the bilingual English/Russian version produced by Olga Anissimova from the Tartu University in Estonia (figure 17).

(figure 17)

3rd topic




http://semioweb.msh-paris.fr/ressources_enligne/Enseignement/06_07/lisbonne/sites_web/jabar/index.html

http://semioweb.msh-paris.fr/ressources_enligne/Enseignement/06_07/lisbonne/sites_web/jabar/index.html


The list of newly identified and processed segments for the Russian public (figure 18).

(figure 18)

3rd topic




http://semioweb.msh-paris.fr/ressources_enligne/Enseignement/06_07/lisbonne/sites_web/jabar/Passages.html





The interface for reading and appropriating the content of a chosen segment in Russian and for Russian people (figure 19)

(figure 19)

3rd topic




http://semioweb.msh-paris.fr/ressources_enligne/Enseignement/06_07/lisbonne/sites_web/jabar/a696ac8f8-dabc-4282-a970-8fd462603b93.html





The actually available – and yet very small – list of bilingual versions on the AAR web portal (figure 20).

(figure 20)

3rd topic




http://semioweb.msh-paris.fr/AAR/FR/Versions.asp

http://semioweb.msh-paris.fr/AAR/FR/Versions.asp

Documents

The Online Audiovisual Archives of Social Sciences and ...semioweb.msh-paris.fr/escom/ressources_enligne/conferences/2007… · Archives of Research » (Archives audiovisuelles de