Interactive Paper - Introduction and Basic Technology & Interactive Paper - Applications and...

Preview:

DESCRIPTION

Presentation given at Y-Toolbox, Workshop about Paper, Y (Institute for Transdisciplinarity), Bern University of Arts, Bern, Switzerland, April 2008

Citation preview

Y-Toolbox, April 17, 2008

Interactive PaperIntroduction and Basic Technology

Beat Signer

Global Information Systems Research Group

ETH Zurich

Applications and Future Developments

http://vub.academia.edu/BeatSigner

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

The Paperless Office (1975)

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

The "Paperless Office" (2003)

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

The Myth of the Paperless Office

For decades, people have predicted the

office of the future as a paperless office

documents generated, published and

distributed electronically

documents read electronically

What has happened to this

imminent revolution?

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Affordances of Paper

The physical properties of an object determine

how people use that object

Properties of paper

light, flexible, robust, porous, opaque, transparent, ….

Human actions

grasping, folding, tearing, carrying, writing, on ….

Paper supports forms of collaboration and

interaction difficult to mimic in the digital world

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Paper in Everyday Settings

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Electronic Paper (e-paper)

E-Ink Cooperation

paper-like high contrast

appearance

low power consumption

thin, light form

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Augmenting the Physical Space

Embedding computing functionality in everyday

objects instead of digitising the physical

environment

At breakfast Sal reads the news. She still prefers the paper form, as do

most people. She spots an interesting quote from a columnist in the

business section. She wipes her pen over the newspaper’s name, date,

section, and page number and then circles the quote. The pen sends a

message to the paper, which transmits the quote to her office.

The Computer for the 21st Century, Weiser, 1991

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Paper-Digital Integration Technologies

Document (object) identification / tracking

barcodes

RFID tags

optical tracking

Within-document position tracking

relative/absolute positions

support for mobility

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Listen Reader (Maribeth Back et al.)

Combines the look and feel of a real book with an

interactive soundtrack

RFID tags embedded in each page

Electric field sensors in the book binding

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Digital Pen and Paper

Developed by Anoto

Different pen manufacturers

Logitech, Maxel, Nokia,

Adapx, Livescribe ...

Pattern space

60 million km2

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Forms Automation Systems

Capture form data

data is processed and

stored in a database

Applications

policies

hospitals

transporation

...

No real-time interaction!

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Active Areas and Virtual Page Layers

image

video clip

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Cross-Media Link Server (iServer)

consumers /

publishers

books

publisher

web pages

videos

presentation slides

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

iPaper @ ETH Zurich

Cross-Media

Link Infrastructure

Tools

Publishing

Applications

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Edinburgh Fringe Festival

World's largest

international arts festival

4 weeks

~1700 events

~27000 performances

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

EdFest Project

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

EdFest User Trials

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

EdFest Demo

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Design of Interactive Paper Documents

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

References

The Myth of the Paperless Office, A.J. Sellen

and R. Harper, MIT Press, November 2001

Scrolling Forward: Making Sense of Documents

in the Digital Age, D.M. Levy, October 2001

Fundamental Concepts for Interactive Paper and

Cross-Media Information Spaces, B. Signer,

Diss ETH Zurich Nr. 16218, 2006

http://www.ipaper.ethz.ch

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Interactive Paper Applications

Enhanced Reading interactive paper maps

interactive festival brochures

educational materials

auction brochures

scientific publications

Enhanced Writing photo album

researcher's notebook

mammography

search system

Paper-Based Interfaces

PaperPoint

digital libraries

video analysis tool

educational games

Artists' Installations

Lost Cosmonaut

Generosa Enterprise

Interactive TableTops

http://www.globis.ethz.ch/research/paper/applications/

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

PaperPoint Presentation Tool

Mobile presentation tool

Non-linear presentations

Paper-based real-time

annotations

Digital whiteboard

Multi-pen support

brainstorming

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

PaperPoint Stickers

Empty Stickers linked to

specific PowerPoint slides

Digital information (text,

image, movie, ...)

embedded in slides

Mock-ups for interactive

paper applications

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Rough Guide

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Natural History Museum, London

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Natural History Museum, London ...

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Natural History Museum, London ...

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Natural History Museum, London ...

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

DiDA (Diploma in Digital Applications)

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Mammography Annotations

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Print-n-Link

Citations build the basis

for a scientific web of

publications

Use digital services to

search / retrieve cited

publications

Automatic authoring

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Print-n-Link …

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

PaperWeb

Print arbitrary web pages

with iDoc printer driver

All hyperlinks become

interactive on the printout

version

Automatic authoring of

links

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Document Editing

Digital and paper-based user interface

Support for collaborative editing

Multiple digital/physical editing iteration cycles

Digital Document

Printed Document

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

PaperProof

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Paper-Digital Structural Mapping

Dual document representation in digital and

physical document spaces

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

PaperProof

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

The Lost Cosmonaut

Writing as a collaborative

act of memory and story-

telling

Reading, writing and

narrative as an act of

making sense

Handwriting as a tool for

human computer

interaction

In collaboration with Axel Vogelsang,

Artists in Labs Programme

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

The Lost Cosmonaut …

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

The Lost Cosmonaut …

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Generosa Enterprise

Interactive drawing installation

Exhibited at the 150 Years ETH Zurich Jubilee (more

than 200'000 visitors)

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Generosa Enterprise …

Generation of a new artwork

http://www.generosa.ethz.ch/

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Generosa Enterprise …

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Interactive Table (iTable)

Pen-Based Google Earth Browser Pen-Based Drawing Tool

Photo Browser Photo Browser (Slider)

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Interactive Table (iTable) …

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Remote Sketching on Paper

Integration of Skype and

paper-based remote

sketching, Hermann

Hofstetter

HCI group University of

Konstanz, H. Reiterer

GlobIS group

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Query by Sketching (QbS)

Pen-based sketching

interface

University of Basel

GlobIS group

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

FLY Fusion™ Pentop Computer

Everything integrated into

the pen

Voice feedback

Applications on cartridge

english to spanish translator

calculator

...

Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

Pulse Smartpen

Record and replay

synchronised ink & audio

1 GB memory

16'000 pages

200 hours voice recording

96x18 OLED Display

Open application platform

Recommended