Knowledge Multimedia Processes in Technology Enhanced Learning

Lehrstuhl Informatik 5(Informationssysteme)

Prof. Dr. M. JarkeI5-RK-0909-1

CUELC

Ralf Klamma1, Marc Spaniol2, Matthias Jarke1

1RWTH Aachen University, Germany &2Max Planck Institute for Computer Science

ACM Multimedia WS Multimedia Technologies for Distant Learning MTDL 2009,

Beijing, China, October 23, 2009

Knowledge Multimedia Processes in Technology Enhanced Learning



CUELC

Agenda

Theoretical background– Cross-media theory of transcription– SECI model by Nonaka

Knowledge Multimedia Processes– Transcriptions– Practiced/Formalized Localizations– Addressing

Evaluations Conclusions & Outlook



CUELC

Cross-Media Theoryof Transcription

Jäger, Stanitzek: Transkribieren - Medien/Lektüre 2002

Strategies of transcriptivity Collection of learning materials are re-structured by new media Design is specific for media and learning communities by default

Strategies of addressing Social Software promotes the globalization of address spaces Personalization is mission critical for learning communities

Strategies of localisation Re-organization of local practices is stimulated by new media Need to model learning practice explicitly

TranscriptTranscriptPre-Texts

Addressee-based Transcription

Selection of Pre-Texts

Integration into the cultural Archive



CUELC

Multimedia Knowledge Managementfor Technology Enhanced Learning

Synthesis: Transcriptivity / SECI Model / Communities of PracticeGoal: Media theoretic focus on technology enhanced learning

EC-TEL 2007 [Spaniol et al.]

Combination:formalized Localization

Externalization:Transcription

Socialization:practiced Localization

Internalization:Addressing

TranscriptTranscriptPre-Texts

Transcript&

Context

Transcript&

Context



CUELC

Transcription: an IS view

Examples and Requirements on IS :– Creation and maintenance of multimedia metadata– Representation of multimedia relationships (hypermedia)– Extension of archiv for multimedia content

⇒ Implications for the management of multimedia:1. Deskriptors for multimedia2. Multimedia graph representation3. Extensibility of schemata and descriptors

Pre-Texts Inter- & intra-media transcription Transcript



CUELC

Transkription0 n {P}, }M,M,M,{M M n

„Video“„Audio“„Image“„Text“ N∈∪∈

P \M

Media:

Media in IS:

Transcripts:

Transcription:

Meta-transcription(manual):

Meta-transcription(in IS ):

(p)) (p), (p),( : tp ιµτ=

P \M P : →τ

∅∪→ M P : „Text“µ

„Text“M P : →ι



CUELC

Formalized Localization: an IS view

Examples and Requirements on IS:– Individual categorization of media– Creation and Maintenance of reference collections– Fine granular management of access rights

⇒ Implications for the management of metadata:1. Schemata for classification and vocabularies2. Variation sets of multimedia3. Digital rights management

Pre-Texts Inter- & intra-media transcription Transcript



CUELC

Formalized Localization:Keyword Index/ Category System

Keyword index:

Access relation:

Category index:

(Tree)-Order:

Access relation :

OKk1

k3

k2

kc

root

κro

ot,1 M

m1

m3

m2

md

λ c,1

λ 1,2λ 3,2

λ 1,d

κro

ot,2

κ1,

3κ

2,c

Ss1

s3

s2

sc

m1

m3

m2

md

λ c,1

λ 1,2λ 3,2

λ 1,d

{s} : S =

(M) S : i P→λ

{k} :K =

))k',(k,k'(k, : o ididκ=

s)(id, : k =

(M) ID : IDk P→λ

M



CUELC

Formalized Localization :Local Access Relation

Global access relation:

Local access relation:

Opeations in category schemata :

- Insert- Delete- Rename

Operations in media relations:

- Insert- Delete

OKk1

k3

k2

kc

root

κro

ot,1 M

m1

m3

m2

md

λ c,1

λ 1,2λ 3,2

λ 1,dκ

root

,2

κ1,

3κ

2,c

OKk1

k3

k2

kc

root

κro

ot,1

κro

ot,2

κ1,

3κ

2,c

OKk1

kη

kc

k2

root

κro

ot,1

κro

ot,c

κ1,η

κc,

2

κη ,

3

k3

delete kη

insert kη

rename k2and kc

λ 2,3

delete λ 2,3

insert λ 2,3

},O,{K : l lodallodallocallocal λ=

},O,{K : l globalglobalglobalglobal λ=



CUELC

Adressing:an IS View

Examples and Requirements on IS :– Representations of multimedia content in context– Options for legitimate peripheral participation– (asynchronous) cooperation support

⇒ Implications for the management of metadata:1. Metadata driven adaption of devices2. Profiles3. User preferences and usage histories

represent & discuss in context Transcriptin

context



CUELC

AdressingDiscussions:

Hypermedia documents:

Discussions on hypermedia documents:

Context-aware adressingof multimedia content:

))(t,(t : d pptpδ=

„Text“t M T : →δ

)h,d,l,(t : h wt

vupdl,t, p

)(= µ 0 w v,u, N∈

))(h,(h : d dl,t,hdl,t,h dl,t,δ=

I T : l →α

„Text“h M H →:δ



CUELC

Validation of the Concept

Klamma, Spaniol, Cao: MPEG-7 Compliant Community Hosting, JUKM, Springer 2006

CESE: Hypertext Environment for Talmud tractatesMARS: Transcription of electro-acoustic musicSOCRATES: Chat for Communities of AphasicsMECCA: Collaborative Screening of MoviesVEL 2.0: Virtual Entrepreneurship Lab

NMV & MEDINA: Dublin Core & MPEG-7 based Media TaggingACIS: GIS-Multimedia Management for Cultural HeritageMIST: Non-linear Story-Telling PROLEARN Academy, GRAECULUS, Multimedia Metadata, CUELC, Bamyian Valley: Community Portals

Collaborative adaptivelearning platforms

Self-observation toolsfor Communities

Measure, Analyses,Simulate

Socio-technicalinformation system

Development



CUELC

MIST – Multimedia Management• Creation and management:

- Media collections- Metadata- Media variations

• Collaborative indexing based on:- Free text annotations (à la Flickr)- Semantic MPEG-7 basetypes

Agent Event Concept Object Place Time State



CUELC

MIST – Story Creation

Illustration of episodic knowledge– Modeling of non-linear stories based on Movement Oriented Design (MOD)

[Sharda 2005]; Cooperation with Victoria University Melbourne, Australia– Decomposition of stories according to a problem hierarchy– Recall of semantic high-quality metadata on multimedia artifacts

Structure of Begin-Middle-End-Sequences

“Mapping“ of (sub)-problems to multimedia artifacts

Structured access to contents of the multimedia archive



CUELC

MIST – Story Consumption

Non-linear access sequences in multimedia stories, i.e. “success vs. failure“ depending on access sequenceContext information via multimedia annotations

Currently selected artifact

Optional successor-sequences

Free text annotations

MPEG-7 based annotations



CUELC

<e-Adventure> EditorAuthoring environment

for point and clickadventure games

Refinement of the raw educational game derived from the non-linear story

Specification of items and character references

Definition of dialogs⇒ Fully featured adventure game for vocational training

M. Spaniol, Y. Cao, R. Klamma, P. Moreno-Ger, B. Fernández Manjón, J. Luis Sierra, G. Toubekis :From Story-Telling to Educational Gaming: The Bamiyan Valley Case , in F. Li, J. Zhao, T. K. Shih R. Lau, Q. Li, D. McLeod (Eds.) Advances in Web Based Learning - ICWL 2008,



CUELC

Conclusions & Outlook Cross mediality for collaborative learning platforms supports

– Evolutinary development of multimedia learning services– Configuration and maintenance of multimedia learning repositories

Semantic self organization of learning communities supported by– Flexible semantic enrichment of complex processes based on

multimedia artifacts– Re-contextualization of multimedia knowledge in stories & games

Ongoing and future work– Mobile Storytelling based on a simplified mobile user interface– Use of templates for supporting inexperienced storytellers– Mashing up different stories to create and share innovative

knowledge



CUELC

Join us!

http://www.role-project.eu/ LinkedIn

http://www.linkedin.com/groupInvitation?gid=1590487

http://www.role-project.eu/�

http://www.linkedin.com/groupInvitation?gid=1590487�