Integrated Ubiquitous Computing - Designing Urban Space with Digital Media - Florian Resatsch and Daniel Michelis

Integrated Ubiquitous Computing – Designing Urban Space with Digital MediaFlorian Resatsch & Daniel Michelis May, 8th 2006Uni Debrecen – Hungary

/ 2Florian Resatsch/Daniel Michelis

Agenda

1. Introduction

2. Ubiquitous Computing

3. Design Integration

4. Designing Ubiquitous Computing Applications –

IEB Experiments and Learnings

4.1 High D (Interface)

4.2 Hypertagging (Human-Computer

Interaction)

4.3 Bluespot (Infrastructure)

4.4 Magical Mirrors (Participation)

5. Integrated Ubiquitous Computing in Public Space


Institute of Electronic Business – I

The Institute of Electronic

Business (IEB) is an

affiliated institute of the

University of Arts, Berlin

Consultancy and research in the area of electronic business, communications and design

Network to connect scientists and practitioners


Institute of Electronic Business – II

Main Research AreasDigital Communication

e-Government

Ubiquitous Computing

Performance Marketing

Human Computer Interface

Key Facts

Employees: 25

Number of students: 160

Public-Private-Partnership

Director: Prof. Dr. Dr. Thomas Schildhauer


Agenda

1. Introduction







Interaction)





Ubiquitous Computing (UbiCom)

Definitions Ubiquitous Computing

“The most profound technologies are those that

disappear. They weave themselves into the fabric of

everyday life until they are indistinguishable from

it” (Weiser, M., 1991)

Ubiquitous Computing is

(1)numerous, casually accessible, often invisible

computing devices,

(2)frequently mobile or imbedded in the environment

and

(3)connected to an increasingly ubiquitous network

structure. (Source: National Institute for Standards and Technology, www.nist.gov/pc2001)


Development Stages

01001

Mainframe-Era:one Computer,many Users

01001

PC-Era:one Computer,

one User

01001

Ubiquitous-Computingmany Computers,

one User

01001

01001

01001

01001

01001 01001

01001 01001

01001

010010100101001

010010100101001

Time


UbiCom: Ubiquitous Connectivity

Mainframe-Era:Beginning connections

01001

PC-Era:Internet

Ubiquitous-ComputingWeb of Objects

01001

01001

01001

01001

01111

01001

01001

01001

01001 01001

01001 01001

01001

010010100101001

010010100101001

Time


Technological Advancements Enable UbiCom

150 M

100

50

0

400

200

0

2001 2005 1998 2002

Five year market forecast for numbersof MEMS chips produced for microelectronics(Source: MEMS Industry Group)

Five year trend:Number of stories in the New York times including the word „Sensor“(Source: Lexis-Nexis)

(Source: McCullough, M, 2004)


Extending Connection

Ubiquitous-ComputingDigital augemented physical objects and

new ways of interaction

01001

01001

01001 01001

01001 01001

01001

010010100101001

Internet (Virtual World)Real World

Information


Open Questions On UbiCom

What can we expect in terms of interaction,

information, data security, privacy?

What are successful applications in UbiCom scenarios?

(Source: Alois Ferscha, Uni Linz)


The IEB UbiCom Initiative

Cooperation of Universities and Industry

Management

Communication Technology


Why We Should Look At UbiCom?

• There is a paradigm shift from cyberspace to

pervasive or ubiquitous computing

• Digital technology pours out of the screen

into our daily life under the laws of physics

• The everywhere and ubiquitous approach will

be part of everyone‘s life

• To avoid scenarios as shown in „Minority

Report“ it is important to shape this vision

• Ubiquitous Computing is already here


Excursus: UbiCom Has Many Faces

Everyday life support via invisible data

gathering: Weather data with mobile phone

networks.

(Source: Tel Aviv University)


Excursus: UbiCom Has Many Faces

Using Near Field Communication and RFID to

support daily processes.

(Source: NTT DoCoMo)


Theoretical Overview of Intersecting Domains

Extending the science of human-computer

interface and programming into a culture of

situated interaction design:

(Source: M.McCullough, 2004)

UbiquitousComputing

Environmentalknowing

DesignValue &

Integration

InterfaceDesign

GeoWares

Types &Patterns


Basic Principlesof UbiCom

Content,

Infrastructure

and Interface

• Content needs to be prepared, processed,

stored and channelled to the user via an

appropriate medium. • The millions of single transactions and

interactions between microchips and human

actions determine the infrastructure.• The human-computer interface is the

contact point between man and machine and

the single point of contact in Ubiquitous

Computing scenarios.

„To anyone with too much gear and too little time, the mere

availability of technical capabilites [and functions]

hardly guarantees utilization“ (Clement Mok, Designer)

(Source: M.McCullough, 2004 and John Dewey)


Basic Principlesof UbiCom

Context,

Participation

and Value

• Whether features are understood depends

on the context in which they are

encountered.• Well-being requires a better state of

human activity. Much of our sense of

environment emerges from participation.• Value emerges from interactions and

(ex)change. Things have no value in

itself – they only have value for

someone.

„To anyone with too much gear and too little time, the mere

availability of technical capabilites [and functions]

hardly guarantees utilization“ (Clement Mok, Designer)

(Source: M.McCullough, 2004 and John Dewey)


The question is …

Interface

Content

Context

Infrastructure

Value

What are the success factors on …

Participation


How Can We Solve The Open Issues? Example: Interface

New ways of interaction are needed to create

context-sensitive, participatory interfaces

that create value

Foreground

Background

Virtual Physical

Graphical UserInterface

(GUI)

HapticInterface

InhabitableInterface

(smart space)

Ambientinterface

(Source: McCullough, M, 2004)


Infrastructure Levels of UbiCom

RFID Physical World

Network Process Center

Interfaces

Applications

Middleware

OS, Network

Hardware (PDA, Handy)

Processes Vertrags-abschluß

Trans-ponder-Einbau

KFZOrtung

on demand

Finder-prozess

KFZ-Rück-

führung

Transponder

Aktivierung

Deaktivierung

0 1 2 3 4 5 6

Billing

7

Transponder

Vertrags-Daten

Management

Design

Partners


Agenda

1. Introduction







Interaction)






Developing Products In Two Worlds

Quelle: Beat Schmid

Implementation

I

Implementation

II

World IFunctions in materials

World IISymbols in Hearts and

Minds


Integrative Design

Quelle: Beat Schmid

Technology Perception

Business


Examples: Failures and Successes of Design-Integration

Quelle: Beat Schmid

SuccessFailures


Increasing Importance of Implementation II

Implementation I

Implementation IIrequired time

Quelle: Beat Schmid


Agenda

1. Introduction







Interaction)





Agenda

1. Introduction







Interaction)





Implementation II – Reducing Complexity or „Ways Beyond Graphical Interfaces“

The starting point is to optimize the learned

way of interaction of GUIs and work into the

Inhabitable Smart Spaces

Foreground

Background

Virtual Physical


(GUI)

HapticInterface


(smart space)

Ambientinterface


Implementation II – Reducing Complexity or „Ways Beyond Graphical Interfaces““

The starting point is to optimize the learned

way of interaction of GUIs and work into the

Inhabitable Smart Spaces

Foreground

Background

Virtual Physical


(GUI)

HapticInterface


(smart space)

Ambientinterface

1. Optimization of the GUI


Implementation II – Reducing the Complexity

(Source: Avero, Berlin, www.avero.de)

Visualization ofmultidimensionaldata


before


Complexity Reduction Through Abstraction


now


Implementation II – Complexity Reduction


handy-tool


handy-tool Select Direction [5]


handy-tool Select Starting Time [>]


handy-tool Calculate Driving Time [3/7]


handy-tool Legend [*]


Agenda

1. Introduction







Interaction)





Implementation II – Reducing Complexity or „Ways Beyond Graphical Interfaces“

The next step was the trial of interfaces

beyond the screen itself into the smart

space.

Foreground

Background

Virtual Physical


(GUI)

HapticInterface


(smart space)

Ambientinterface

2. Extending the interfacebeyond the screen


Explorative research projecthypertagging


Installation DATACARRIER

• Installation in the German Historical Museum Berlin

• Traditional roles where exchanged, participants became DATACARRIERs

• RFID-tags embedded in personal invitations

• Participants become passive data carriers, that revealed their personal data unknowingly


We tagged the event tickets...


... to personalize executives, ...


...scanned their personal data,


displayed it on public screens,


... and observed the audience.


Installation FLOATING THOUGHTS

• Prototype at the International Symposium of Electronic Arts 2004

• Hypertags used as medium of communication

• Personal information could be stored and transmitted

• Data was physically attached to the vessel

• Goall: Explore usage patterns and “data drift”


Data was linked to RFID and...


... attached to physical objects.


Users could share thoughts and...


... locate them on the vessel.


What we expected...

What we expected ....


...and what we found.

... and what we found.


Agenda

1. Introduction







Interaction)





bluespot – The Future Advertising and Shopping Mile

The „Future Advertising and Shopping Mile“

is a research project on the integration

of various (digital) media in highly

frequented shopping areas in public

space.

Prototype went live on April, 26th 2006 in

Berlin, Germany in the area of the

„Kurfürstendamm“.

The idea: Ubiquitous availability of

services in public space!


The Area of the Prototype

Research Area

WittenbergplatzWittenbergplatz

George-Grosz-PlatzGeorge-Grosz-Platz


How Many People Are in The Areal?

People on a Regular Saturday

Samstag 11.00h bis 13.00h

7028

11543

0

4000

8000

12000

16000

20000

24000

28000

1999 2000 2001 2002 2003

Jahr

Num

ber o

f pas

sers

-by

Kurfürstendamm Tauentzienstrasse

Average amount9285 Personen


The Company Wall AG as the Intermediate

Available Street Furniture

Bus Stop Shelters

Kiosk Systems

City Info Panel

City Light Board

Aut. Public Toilet

Information Terminal

e-Info Terminals

Screen rounded

Indoor Cases

Some Examples


^4. bluespot


^4. bluespot


Process of the Project

Description of Different Projects Phases

1. Analysis1. Analysis 3. Recommendation for Future Activities

3. Recommendation for Future Activities

Results of the Analysis:

• Definition Target Groups

• Potentials of Different Media Categories

Results of the Analysis:

• Definition Target Groups

• Potentials of Different Media Categories

Description of the Conception:

• Concept of a Possible Infrastructure

• Based on a Portal System

Description of the Conception:

• Concept of a Possible Infrastructure

• Based on a Portal System

Precise Suggestions for Future Activities

• Build a Prototyp of the Portal System Including all Wall Key Accounts

Precise Suggestions for Future Activities

• Build a Prototyp of the Portal System Including all Wall Key Accounts

2. Conception2. Conception

4. The Prototype (Pilotphase)

4. The Prototype (Pilotphase)


The Combination of Advertising and Shopping

AdvertisingClients

Local Advertising Clients

Canalize Marketing Messages

Target Group:SHOPPER

Target Group:CONSUMER

Target Group:TOURIST

Mobile Devices e-Info Terminals Posters

Feedback Channel

Integration of the Media on Three Levels

Future ShoppingFuture Advertising

PORTAL


The Portal

Requirements

The Portal is Used by Different Groups with

Different Needs

Advertising Clients Passers-by Wall Employees

Functionalities• Log-In/Log-Out• Advertising Booking

Centre• Statistics

Functionalities• Mobile Couponing• Location-Based

Information• Maps of the City • WLAN

Functionalities• Content Administration• Advertising Clients

Administration• Statistics

Portal und Services

GUI Online GUI Online GUI Mobil GUI Terminal GUI Online

Pflic

hten

heft

besc

hrei

bt F

unkt

ione

nC

lickd

umm

y ze

igt

Funk

tione

n


Parts of the Concept: The Integration of City Light Posters Into the Scenario

Bluetooth Poster

Bluetooth Sender

CustomerProfiles

GUI Personal Identity

Assistant

User Profile Agent

ServiceAgents

for ContentSyndication

andDistribution

Browsing


Technical Concept/Infrastructure

Content Integration System

PORTAL

PORTAL

Content BUS

InhalteWerbekunden

InhaltePassantenDatenbank

Profile

Inhaltevon

WALL AGe-Info Terminal

oder Mobile Endgeräte

Advertising Portal

Transfer of data

Wall AG

TOURIST

AdvertisingClients

CONSUMER

SHOPPER

TOURISTCONSUMER

SHOPPER

TOURISTCONSUMER

Datavisuals

GSM, UMTSWLAN

TCP/IPTrans-missionLayer

Content Producer


The real thing…

The following

services were

distributed:• Free Wireless

Lan• Free Internet

Access• Free Telephone• Savings in a

Couponing

System• Cityinformation• New products in area


bluespot: WLAN Hotspots Locations


The First Shot:Bluespot Live


Reality: Passenger Survey

Which services of bluespot are you familiar with?

33

12

15

29

12

0 5 10 15 20 25 30 35

Stadtinformationen

Aktions-/Sparcoupons

Telefonie

Internetzugang amTerminal

W-LAN Zugang

% der Angaben


0

20

40

60

80

100

Shopping T

ipps

Veran

staltu

ngsüber

sich

t

Gas

trotip

ps

NightL

ife In

fos

Kinopr

ogra

mm

Hotel-I

nfo

Sehen

swürd

igke

iten (K

ultur&

Freiz

eit)

Wic

htig

e Tel

efonn

umm

ern

Stadtp

lan

Hinwei

se a

uf öffe

ntlic

he Toile

tten

Tipps

zum

akt

uelle

n Sta

ndort

% d

er A

ng

aben

Reality: Passenger Survey

What kind of city information do you need in

public space?

Very Interesting

Interesting

No answer..

So so

Not Interested in


Passenger Survey

Why did you just use the terminal?

0,00

5,00

10,00

15,00

20,00

25,00

Angeb

ote

des E

inzel

hand

els

Shopp

ing

Tipps

Veran

staltu

ngen

info

rmat

ionen

Gastro

tipps

NightL

ife In

fos

Kinopr

ogra

mm

Hotel-

Info

Kultur

und

Fre

izeit

Adres

sen/

Telefo

nnum

mer

n

Digita

le Sta

dtka

rte

Aus N

eugi

er

Sonst

iges

% d

er

Ne

nn

un

ge

n

Main reason:

Curiosity!


Learnings from bluespot

Infrastructure and Interface Success ComponentsThe access component (“can”): This factor assumes that there

is a required infrastructure - ranging from streets to

mobile phone networks - that must be available and the

corresponding devices to use the infrastructure.

The attention component (“know”): In addition, availability

alone is not sufficient to trigger the use of a service in

a public space, potential users must know about the

availability of the service and be informed where and how

to use it.

The willingness component (“want”): Finally, the potential

user must decide whether they are interested and willing

to use the service in the proposed way, another way or not

at all. The willingness component highlights the

importance of the contextual factors as discussed above.

To want something also includes that the services are to

be adapted to the relevant target group in terms of the

corresponding needs.


Shot #2



Agenda

1. Introduction







Interaction)






6. Outlook







Implementation II – Remediation

"The content of any medium is always another medium.

The content of writing is speech,

just as the written word is the content of print, a

nd print is the content of the telegraph“ (McLuhan)

Remediation • Jay David Bolter/Richard Grusin • New medium is always the representation of older medium

• transparent remediation – „The digital medium wants to erase itself,

so that the viewer stands in the same relationship to the content as

she would if she were confronting the original medium." • translucent remediation – visible difference between the new and the

old medium through enhanced funcitions • refashioning remediation – New technologies refashion the older

medium completly, while the origin of the older medium remains

visible • absorbing remediation – the older medium is completly absorbed by

newer medium

Quelle: Bolter/Grusin


Applied Remediation: SAP Media Facade








Agenda

1. Introduction







Interaction)





The answer is …

Interface

Content

Context

Infrastructure

Value

Participation

CombiningApplication

a serious combination of the factors..


What answers do we have???

The success factors … on only a few aspects.More research needs to be done.

- Face recognition as Interface/Participationdevice?

- Infrastrucural process centers?- Business Cases?




Every great advance in science has issued from a new audacity of imagination. John Dewey

KontaktFlorian [email protected]

Daniel Michelis [email protected]

Economy & Finance

Integrated Ubiquitous Computing - Designing Urban Space with Digital Media - Florian Resatsch and Daniel Michelis