Embed Size (px)
DESCRIPTION
Presentation given at WISE 2009, Tenth International Conference on Web Information Systems Engineering, Poznan, Poland, October 2009 ABSTRACT: The emergence of new media technologies in combination with enhanced information sharing functionality o ered by the Web provides new possibilities for cross-media annotations. This in turn raises new challenges in terms of how a true integration across di erent types of media can be achieved and how we can develop annotation services that are sufficiently flexible and extensible to cater for new document formats as they emerge. We present a general model for cross-media annotation services and describe how it was used to defi ne an architecture that supports extensibility at the data level as well as within authoring and visualisation tools.
Citation preview
2 December 2005
An Architecture for
Open Cross-Media Annotation Services
Beat Signer1 and Moira C. Norrie2
Department of Computer Science
Vrije Universiteit Brussel
1050 Brussels, Belgium
Institute for Information Systems
ETH Zurich
8092 Zurich, Switzerland
1 2
Beat Signer - Department of Computer Science - [email protected] 7, 2009
Motivation
Memex Annotea Project
Digital Libraries Cross-media Annotations
Beat Signer - Department of Computer Science - [email protected] 7, 2009
Motivation …
Existing annotation solutions support the annotation of
a fixed set of multimedia resources
How easy can those solutions be extended to support
emerging future digital or physical resource types? annotation tool should evolve over time
An open cross-media annotation solution has to provide
extensibility on the data level
on the annotation authoring and access level (user interface)
Beat Signer - Department of Computer Science - [email protected] 7, 2009
What is an Annotation?
A link in a hypermedia system is defined between an
existing source and target object
In addition to a link, the definition of an annotation often
includes the content authoring of the annotation object
itself (target object)
An annotation service therefore can be seen as a
specific application of a more general link service
Beat Signer - Department of Computer Science - [email protected] 7, 2009
Annotation Matrix
Four existing classes of annotation systems
A: single source and single annotation type
B: single source and multiple annotation types
C: multiple source and single annotation type
D: multiple source and multiple annotation types
Proposed open cross-media annotations cover the whole space
# resource types1 2 3 4 5 ...
1
2
3
4
5
...
# annotation types
B1
B2
D2
open cross-media
annotations
D1
A1... An C1 C2 C3
Beat Signer - Department of Computer Science - [email protected] 7, 2009
Annotation Model (RSL Extension)
Selectors Resources
Entities
Links
XHTML DocsXPointer
source target
Layers
Users
SERVERi
MoviesTime Spans
MOVIEi
WEBi
RSL Metamodel
Annotations
Annotation Model
Formal InformalComments
Explanations
...
Beat Signer - Department of Computer Science - [email protected] 7, 2009
Annotation Model (RSL Extension) ...
B. Signer and M. C. Norrie, As We May Link: A General Metamodel for Hypermedia Systems, in Proc. of ER 2007, Nov 2007
entity
link
Links
selector resource
(1,*)(1,*)
(1,1) (0,*)
(0,*) (0,*)
RefersTo
HasTargetHasSource
partition
HasProperties
parameter
Properties(0,*)
(0,*)
HasResolvercontextResolver
Context
Resolvers
Entities(0,*)
(0,*)
user
Users
parameter
Preferences
group
Groups
(0,*)
(0,*)
(0,*)
(0,*)
HasMembers
AccessibleTo
individual
Individuals
(0,*)
(0,*)
(1,1)
partition
HasPreferences
(0,*)
layer
LayersOnLayer |HasLayers|
(1,1)
(0,*) (0,*)
(0,*)
|HasChild|(1,*)
(0,*)
link
Structural
Links
link
Navigational
Links
partition
link
Annotations
CreatedBy
ResourcesSelectors
Beat Signer - Department of Computer Science - [email protected] 7, 2009
Data and Visual Plug-in Architecture
Annotation/Link
Service
Client Application
Annotation/Link
Browser & Editor
Visual Plug-ins
Resource Plug-in Repository
Data Plug-ins
Visual Plug-ins Data Plug-insVisual Plug-ins
Beat Signer - Department of Computer Science - [email protected] 7, 2009
Data and Visual Plug-in Architecture …
Integration of a new resource type includes development of a data plug-in
implementation of a visual plug-in
registration with the resource plug-in repository
Annotation/Link browser loads plug-ins on demand internal or external (third party application) visualisation
Third party applications use the annotation/link browser
for annotation visualisation similar to the integration of third-party applications with web
browsers
Non-monolithic annotation model and authoring tool resource-specific plug-ins
Beat Signer - Department of Computer Science - [email protected] 7, 2009
Visual Plug-ins
Annotation/Link Browser & Editor Client Application
showEntity(), getSelectedEntity()
showEntity()
Beat Signer - Department of Computer Science - [email protected] 7, 2009
Visual Plug-ins …
General annotation tool deals only with RSL-specific
data and not with any media-specific details create/delete links, user management, …
Definition of annotation anchors (resources or selectors)
handled by visual plug-ins separation of concerns
Two basic purposes rendering of specific resource types (resources and selectors)
creation and deletion of resources and selectors
Well defined visual plug-in API
Beat Signer - Department of Computer Science - [email protected] 7, 2009
Conclusions
Extensible open cross-media annotation solution plug-ins loaded on demand
Separation of concerns between annotation model and resource-specific data plug-ins
annotation tool and resource-specific visual plug-ins
No distinction between entities that can be used as
sources or annotations annotations and links as first-class objects
Annotation/Link browser and editor can be integrated
with third party applications
Beat Signer - Department of Computer Science - [email protected] 7, 2009
Further Information
Beat Signer, Fundamental Concepts for Interactive
Paper and Cross-Media Information Spaces,
ISBN 978-3-8370-2713-6, May 2008
http://vub.academia.edu/BeatSigner
