Metadata and Personalized On-Line Learning

Lehrstuhl Informatik V(Informationssysteme)

Prof. Dr. M. Jarke

Ralf Klamma

12th

Intl. WorldWideWebConf.

I5-RK-0305-1

FK 427

Metadata and Personalized On-Line Learning

Ralf Klamma, Matthias Jarke

12th International World Wide Web Conference, Budapest, May 23, 2003

RWTH Aachen, Lehrstuhl für Informatik V (Information Systems)FIT, Fraunhofer Institute for Applied Computing, Birlinghoven

Collaborative research center FK 427 “Media and Cultural Communication”

Thanks to many collaborators ...


Prof. Dr. M. Jarke

Ralf Klamma

12th


I5-RK-0305-2

FK 427

Outline of the Talk Collaborative Research Center

“Media and Cultural Communication” Metadata for Personalization,

Personalized Metadata Conceptual Framework,

Architecture & Technical Considerations for Elearning

Applications and ExperiencesTalmudic tractate Study

EnvironmentVirtual Entrepreneurship LabVideo triage system


Prof. Dr. M. Jarke

Ralf Klamma

12th


I5-RK-0305-3

FK 427

Collaborative Research Center„Media and Cultural Communication“

Interdisciplinary research center of ABC universities Aachen, Bonn, Cologne

Since 1999 13 Projects with

~ 90 researchers Research guided by

developed lead categories


Prof. Dr. M. Jarke

Ralf Klamma

12th


I5-RK-0305-4

FK 427

Principle of Transcriptivity

Pre-“texts“

TranscriptInter- or intra-medial Transcription

Understandingand Critique

1. Set of (multimedia) pre-“texts“ condensed and structured, e.g. by metadata

2. New „reading“ of pre-“texts“ enabled

3. Discoursive knowledge creation process stimulatedselection of pre-“texts“ and transcription itself

Transcribing – Media/Reading

[Jäger, Stanitzek 02]


Prof. Dr. M. Jarke

Ralf Klamma

12th


I5-RK-0305-5

FK 427

What‘s that?


Prof. Dr. M. Jarke

Ralf Klamma

12th


I5-RK-0305-6

FK 427

Possible (scholarly) Metadata Original movie poster displayed

at US cinemas 1959 Otto Preminger movie

„Anatomy of a murder“ Transcripted from the opening

credits of the movie Saul Bass (saul-bass.com)

– Invention of self-contained titles– Unions forced Hollywood to credit

technicians in movies– „Vertigo“, „The man with the

golden arm“


Prof. Dr. M. Jarke

Ralf Klamma

12th


I5-RK-0305-7

FK 427

Transcribed German version of the movie poster

Transcribed / Re-addressed– German language use– Layout / Design– Citations inside the media

Culturally localized– Different cultural interface– Optimizing address space

Consequences for verbal metadata?


Prof. Dr. M. Jarke

Ralf Klamma

12th


I5-RK-0305-8

FK 427

The Talmud: A very old hypertext


Prof. Dr. M. Jarke

Ralf Klamma

12th


I5-RK-0305-9

FK 427

Learning Talmud Traditionally Talmud schools (Jeshiwot) as community of practice

– Talmud as authoritative source of knowledge– Discussion of dialogic encyclopaedia in small groups– Teachers as walking mentors in the learning process

In University– Basic Hebrew language skills– Usually short texts studied in class– Need to understand structure of complete texts– Need to learn connected knowledge (e.g. use of standard

phrases and arguments, hermeneutical rules)


Prof. Dr. M. Jarke

Ralf Klamma

12th


I5-RK-0305-10

FK 427

CESE: Multi-lingual hypertext system


Prof. Dr. M. Jarke

Ralf Klamma

12th


I5-RK-0305-11

FK 427

Learning Entrepreneurship• Learned in Entrepreneurship Centers together with

university teachers and people from practice • Additional skills necessary not available in textbooks

but role models• Know why• Know how

– Idea, technology, business knowledge – Communication, negotiations, etc.

• Know who– Networking, team building, consulting for customers and suppliers

• Know when– Window of opportunity, market entry, growth, exit

• Know where


Prof. Dr. M. Jarke

Ralf Klamma

12th


I5-RK-0305-12

FK 427

Virtual Entrepreneurship Lab:Semantic Zapping


Prof. Dr. M. Jarke

Ralf Klamma

12th


I5-RK-0305-13

FK 427

Media theory for learning communities

Strategies of Transcriptivity– collection of learning materials are re-structured by new media– no media-independent semantic knowledge– ontology design is inherently media- and community-dependent

Strategies of Addressing– Freely designed digital media foster globalization of

address spaces – Personalization and context adaptation are success-critical to

learning

Strategies of Localization– re-organization of localities stimulated by new media– new community-ware for self-organized discourses


Prof. Dr. M. Jarke

Ralf Klamma

12th


I5-RK-0305-14

FK 427

Semantic KnowledgeNon-verbal vs. Verbal

Linguisticness

Paradigmatic vs. Syntagmatic

Verbal Models, Metadata &

Ontologies

Structured vs. Semi-structured

Semantic Domain modeling

Figurativeness

Content vs. Cultural Interface

Feature extraction

Content based retrieval

(Histograms, Query by

Humming etc.)

But what about knowledge creation aka learning?

Immanuel Kant: Thoughts without content are empty, Intuitions without concepts are blind.

Hypoty-posis


Prof. Dr. M. Jarke

Ralf Klamma

12th


I5-RK-0305-15

FK 427

Sharing of Semantics through a Multimedia Repository

User

Community

Non-verbalsemantics

Multimedia Repository

Non-verbalsemantics

verbalsemantics

verbalsemantics


Prof. Dr. M. Jarke

Ralf Klamma

12th


I5-RK-0305-16

FK 427

Multimedia Semanticswith MPEG-7

Basis

Schema- Links&Media Basic Basic Tools Localization Tools datatypes

MPEG-7

[IEEE 02]

Userinteraction

User preferences

UsageHistory

Navigation & Access

Index

Views

Variations

Content organization Collections Models

Creation & Production

Content Management Media Usage

Content description

Structural aspects Semantic aspects


Prof. Dr. M. Jarke

Ralf Klamma

12th


I5-RK-0305-17

FK 427

ATLAS: Architecture for Transcription, Localization,

and Addressing Systems


Prof. Dr. M. Jarke

Ralf Klamma

12th


I5-RK-0305-18

FK 427

The XML-Mapping Challenge

<Device>

<Printer>

<Id val=„br1030“/>

<Server ip=„192.168.1.1“/>

</Printer>

<Papersize size=„A4“/>

</Device>

<Computerhardware>

<Laserprinter>

<Id val=„br1030“/>

<Ip>192.168.1.1</Ip>

</Laserprinter>

<Type>Network</Type>

</Computerhardware>


Prof. Dr. M. Jarke

Ralf Klamma

12th


I5-RK-0305-19

FK 427

Community verbal knowledge

XML Schema-Instance

XML Schema

references

Mapping

Individual verbal knowledge

XML Schema-Instance

XML Schema

referencesMPEG-7Graph

XSLTMappings

COMA

Mapping-Component

Weight-Interpreter

Mapping-Generator

Result-Presentationand

Feedback-Console

List of weightedMatches

XML-Analyzer

Plugable ComparisonStrategies

Plugable MatchStrategies

Matching Component

Ontology-AdministrationNative XML

Database DOMOntology Interface

Mapping Algorithm COMA


Prof. Dr. M. Jarke

Ralf Klamma

12th


I5-RK-0305-20

FK 427

Video triage system MECCA Community of practice

– Scientists: Cinematic sciences, art historians, ...– Students in legitimate peripheral participation

Joint Enterprise– Semantics of facial expression in movies – Classification and commentation of movie scenes

Shared history– Project background– University experience


Prof. Dr. M. Jarke

Ralf Klamma

12th


I5-RK-0305-21

FK 427

Domain ontology for MECCA


Prof. Dr. M. Jarke

Ralf Klamma

12th


I5-RK-0305-22

FK 427

MECCA Based on Virtual

Entrepreneurship Lab Ontology as the

intermediate result of the ongoing discourse

Two transcription modes– Media vs. Ontology

(Semantic Zapping)– Media commenting

on media (Hypermedia)


Prof. Dr. M. Jarke

Ralf Klamma

12th


I5-RK-0305-23

FK 427

MECCA Ontology Management


Prof. Dr. M. Jarke

Ralf Klamma

12th


I5-RK-0305-24

FK 427

Conclusions Personalizing metadata for learning communities

– Applied media theories – Transcribe digital media thus enabling better addressabilty– Oscillating transcription of verbal and non-verbal

semantic knowledge – Localization of digital media in a community of practice

Architectural and technical considerations in standardized metadata usage– Sharing semantics through multimedia repositories– Ontology management based on MPEG-7/XML– Personalization by mappings between shared and individual

semantics


Prof. Dr. M. Jarke

Ralf Klamma

12th


I5-RK-0305-25

FK 427

List of Completed and Ongoing Collaborative Efforts

Scientific community support– MARS: A tool for the transcription of electronic music– MAVIS: A database for the analysis of communities– GRAECULUS: A portal for the communication within the

cultural sciences Electronic Learning

– CESE: Comprehensive Study Environment for a Talmudic Tractate

– VEL: Virtual Entrepreneurship Lab– MECCA: Collaborative Video triage system– SOCRATES: A chat/talk tool for communities of aphasics

Technology

Metadata and Personalized On-Line Learning