Upload
beat-signer
View
6.741
Download
0
Embed Size (px)
DESCRIPTION
Invited talk given at the User Interface Colloquium, Otto-von-Guericke University Magdeburg, Germany, November 2, 2009 While there have been dramatic increases in the use of digital technologies for information storage, processing and delivery over the last few decades, the affordances of paper have ensured its retention as a key information medium. Despite predictions of the paperless office, paper is ever more present in our daily work. However, there is a gap between the paper and digital worlds: information present in paper documents cannot be seamlessly transferred to digital media and digital services are not easily accessible from the paper world. ABSTRACT: In this talk I will present an information-centric approach for integrating paper with digital as well as physical media based on a general cross-media information platform (iServer). Some details about the architecture and implementation of the iServer platform as well as the underlying resource-selector-link (RSL) metamodel for cross-media linking will be highlighted. A selection of interactive paper applications that have been developed based on this platform over the past nine years will be presented, including the EdFest interactive paper guide for the Edinburgh festivals, the PaperPoint presentation tool as well as the PaperProof proof-editing solution. Challenges and solutions for novel forms of interactive paper and cross-media publishing are discussed based on the presented applications. This includes specific extensions of the iServer platform and RSL model as well as the application of our solution in new domains such as digital libraries, cross-media annotation and retrieval or personal cross-media information management that goes beyond the hierarchical information management imposed by the desktop metaphor.
Citation preview
Otto-von-Guericke-Universität Magdeburg, User Interface Colloquium, November 2, 2009
Paper-Digital User Interfaces
Beat Signer Department of Computer Science
Vrije Universiteit Brussel
Applications, Frameworks and Future Challenges
http://www.beatsigner.com
User Interface Colloquium, November 2, 2009 Beat Signer, [email protected]
Bridging the Paper-Digital Divide
User Interface Colloquium, November 2, 2009 Beat Signer, [email protected]
Personal Background
Research on paper-digital and cross-media
solutions over the last 8 years
realised more than 20 interactive paper applications
Involved in 2 European projects
Paper++ (2001-2004)
- focus on enhanced reading
PaperWorks (2005-2008)
- enhanced reading, writing and publishing
User Interface Colloquium, November 2, 2009 Beat Signer, [email protected]
Applications
Enhanced Reading
interactive paper maps
interactive festival brochures
educational materials
auction brochures
scientific publications
…
Enhanced Writing
photo album
researcher's notebook
mammography annotation
query by sketching
…
Paper-based Interfaces
PaperPoint
document proof-editing
digital libraries
video analysis tool
educational games
Art Installations
Lost Cosmonaut
Generosa Enterprise
Interactive Tabletops
photo browser
collaborative sketch tool
User Interface Colloquium, November 2, 2009 Beat Signer, [email protected]
EdFest Project
User Interface Colloquium, November 2, 2009 Beat Signer, [email protected]
EdFest Documents
User Interface Colloquium, November 2, 2009 Beat Signer, [email protected]
Design Challenges
User Interface Colloquium, November 2, 2009 Beat Signer, [email protected]
Rough Guide
User Interface Colloquium, November 2, 2009 Beat Signer, [email protected]
iGesture Framework
iGesture Workbench
create/test gesture sets and
algorithms
Different modalities
digital pen, tablet PC,
mouse, Wii remote, …
multimodal gestures
Open Source
http://www.igesture.org
User Interface Colloquium, November 2, 2009 Beat Signer, [email protected]
Print-n-Link
Handle existing PDF
documents
e.g. research papers
Automatic link autho-
ring at print time
applicable to other
domains
User Interface Colloquium, November 2, 2009 Beat Signer, [email protected]
PaperPoint Presentation Tool
Mobile PowerPoint
presentation tool
non-linear presentations
real-time annotations
digital whiteboard
...
Multi-pen support
brainstorming
User Interface Colloquium, November 2, 2009 Beat Signer, [email protected]
PaperPoint Stickers
Empty stickers linked
to specific PowerPoint
slides containing
text
images
movies, ...
Effective tool for inter-
active paper mockups
User Interface Colloquium, November 2, 2009 Beat Signer, [email protected]
PaperProof: Paper-Digital Proof-Editing
User Interface Colloquium, November 2, 2009 Beat Signer, [email protected] 14
Mammography Annotations
User Interface Colloquium, November 2, 2009 Beat Signer, [email protected]
The Lost Cosmonaut
Writing as a collaborative
act of memory and story-
telling
Reading, writing and
narrative as an act of
making sense
Handwriting as a tool for
human computer
interaction
In collaboration with Axel Vogelsang,
Artists in Labs Programme
User Interface Colloquium, November 2, 2009 Beat Signer, [email protected]
iPaper Research
Link Metamodel (RSL) Tools
Cross-Media Frameworks Applications
User Interface Colloquium, November 2, 2009 Beat Signer, [email protected]
RSL Metamodel and iServer
User Interface Colloquium, November 2, 2009 Beat Signer, [email protected]
Links
Users
Layers Plug-ins
Structure
Active
Content
User Interface Colloquium, November 2, 2009 Beat Signer, [email protected]
Active Components
Button
Slider
Slider2D
DateSelector
Browser
MapSelector
Rating
Capture
CaptureAndSpeak
Image
Sound
Movie
SQLClient
XCMRequest
ClientCtrlRequest
PaperPointControl
PaperPointAnnot
...
User Interface Colloquium, November 2, 2009 Beat Signer, [email protected]
Cross-Media Authoring and Publishing
Manual link authoring
Content-driven
publishing
e.g. EdFest brochure
Automatic link authoring
e.g. Print-n-Link
Collaborative authoring
User Interface Colloquium, November 2, 2009 Beat Signer, [email protected]
Content-driven Cross-Media Publishing
XCM content publishing
XML data
of festival
venues
and events
iServer cross-media link server
import
publish
XML link
definition
data
iPublish publishing framework
Structure Style
XSL CSS
Information-centric approach
User Interface Colloquium, November 2, 2009 Beat Signer, [email protected]
Interactive Paper 2.0
consumers /
publishers
books
publisher
web pages
videos
presentation slides
User Interface Colloquium, November 2, 2009 Beat Signer, [email protected]
Interactive Paper 2.0 ...
Global and open architecture instead of isolated
solutions
Two main challenges to be addressed
unqiue addressing and resolving of interactive
paper services
- requires a global paper lookup service (PLS) similar to the DNS on the Internet
service oriented architecture to enable cross-
application interaction and composition
User Interface Colloquium, November 2, 2009 Beat Signer, [email protected]
Interactive Paper 2.0 ...
It is not only about enabling interactions accross
different interactive paper solutions
integegration with existing paperless information
spaces (e.g. Web 2.0)
personal cross-media information management
Are we missing a basic layer in existing
interactive paper architectures?
User Interface Colloquium, November 2, 2009 Beat Signer, [email protected]
Future Challenges
Design
visual encoding of interactive areas and functionality
interaction design
- online/offline processing, lack of modal dialogues, ...
Interactive Paper 2.0
global publishing and interaction architecture
collaborative authoring and information sharing
seamless integration with personal cross-media
information management environments
User Interface Colloquium, November 2, 2009 Beat Signer, [email protected]
Conclusions
Interactive paper framework (iPaper)
information-centric approach supports different
technologies, functionalities and applications
separation of authoring and programming
rapid prototyping
Innovative authoring and publishing tools
manual, content-driven, automatic and collaborative
Future Interactive Paper 2.0 challenges!
User Interface Colloquium, November 2, 2009 Beat Signer, [email protected]
Further Information
Presentation available on
http://www.slideshare.net/signer/
Research papers about the presented applications
and frameworks are available on
http://vub.academia.edu/BeatSigner
Fundamental Concepts for Interactive Paper
and Cross-Media Information Spaces, Beat
Signer, ISBN 978-3-8370-2713-6, May 2008