13.05.07

RelateGateways

Extending Mobile Devices with Spatially Arranged Gateways to Pervasive Services.

Dominique Guinard

Dominique Guinard

2 / 20

Agenda

Introduction. End-to-End Service Discovery Model. Spatial Discovery. Network and Service Discovery. Interoperability. Conclusion and Questions.

Dominique Guinard

3 / 20

Introduction

Mobile users can benefit from access to pervasive services.

Network discovery technologies facilitate spontaneous connections.

However, these approaches are not user centric:^Difficult for users to identify services;^Lack of simple and natural interaction

techniques:^Lack of spontaneity in interaction…

Introduction

Dominique Guinard

4 / 20

Aim

Using the mobile device to:^ Identify services available in the user’s

immediate environment.^Consume the services in a natural and

seamless manner.

Need to:^ Include users in the discovery process.^Address identification, discovery and invocation.

Introduction

Dominique Guinard

5 / 20

End-to-End Service Discovery Model

Spatial Discovery

Invocation & Interoperability

Network & Service Discovery

Interaction Life-cycle

Mobile Code

Layer 1 Layer 2 Layer 3Mobile User Pervasive Services

Mo

del

Imp

lem

en

tati

on

$

E2E Model

Dominique Guinard

6 / 20

Layer 1: Spatial Discovery

Spatial Discovery

Invocation & Interoperability

Network & Service Discovery

Interaction Life-cycle

Mobile Code

Layer 1 Layer 2 Layer 3Mobile User Pervasive Services

Mo

del

Imp

lem

en

tati

on

$

Dominique Guinard

7 / 20

Gateways

Widgets as access points to the services:^Gateways.

Visual discovery of services:^Mapping the user’s

view of his environment on the mobile desktop.

Keyboard

Beamer and Display

Printer

Spatial Discovery

Dominique Guinard

8 / 20

Spatial Information

Mobile user interface (UI) as a “compass”:^Helps users to identify services available in the

immediate environment.

Spatial Discovery

Dominique Guinard

9 / 20

Implementation

Small Java Swing windows representing the service providers.

At the screen periphery.

Two interaction modes:^Drag-and-Drop.^Click.

Spatial Discovery

Dominique Guinard

10 / 20

Spatial Context

Spatial context currently delivered to the mobile client by a Wizard of Oz interface.

Relate:^ EU-founded project.^ Ad-hoc sensor network.^ Providing relative

positioning. Working on adapting

Relate to deliver real-time positioning data to the compass UI.

Spatial Discovery

Dominique Guinard

11 / 20

Layer 2: Network & Service Discovery

Spatial Discovery

Invocation & Interoperability

Network & Service Discovery

Interaction Life-cycle

Mobile Code

Layer 1 Layer 2 Layer 3Mobile User Pervasive Services

Mo

del

Imp

lem

en

tati

on

$

Dominique Guinard

12 / 20

Extending Relate

DOT

DOT

DOT

DOTPublic

Display Server

Ethernet Connection

DOT

DOT

USB DONGLE

USB Connection

Position + IP to Service

Network Discovery

Dominique Guinard

13 / 20

Layer 3: Invocation and Interoperability

Spatial Discovery

Invocation & Interoperability

Network & Service Discovery

Interaction Life-cycle

Mobile Code

Layer 1 Layer 2 Layer 3Mobile User Pervasive Services

Mo

del

Imp

lem

en

tati

on

$

Interoperability

Dominique Guinard

14 / 20

Service Architecture

ServiceProvider n

PresentationProvider

Network

OpenOffice Connector

Drag-and-Droppresentation

Invoke requester

Display presentation

ServiceRequester n

UniversalRequester

Pull-and-Push service

Push service

A service is composed of:^ A ServiceProvider, enclosing the service logic.^ A ServiceRequester containing enough information to invoke the

service. 2 types of services:

^ Push service (can be invoked using a Universal Requester).^ Pull-and-push service.

Interoperability

Dominique Guinard

15 / 20

Runtime Mobile Code

3: Load MobileCode1: Discover Service

using Relate

Mobile Code

2: Get Mobile Code

4: Invoke Service

The semantics of Pull-and-Push Services is unknown to the mobile client before discovery.

Packets of Mobile Code containing ServiceRequesters are downloaded and dynamically loaded on the mobile device.

Interoperability

Dominique Guinard

16 / 20

Settings

Test run in Lancaster, formative User Study in Munich.

Total of 20 users. 3 services in a large

office. 2 devices to interact

with the services:^ OQO Handheld.^ Paceblade TabletPC.

Keyboard

Tablet PC

Handheld PCMobile PhoneUser

OR

OR

OR

Beamer and Display

Printer

Wireless/Wired Router

Evaluation

Dominique Guinard

17 / 20

Evaluation Results

Most cited benefits:1. No installation, no configuration: saves time.2. Ease of interaction with the services: drag and drop.3. Dynamic spatial arrangement of the gateways: making

the UI more natural, especially useful in unknown places.

Suggested a number of UI improvements:^ Single interaction zone.^ Fish-eye.

Suggested a number of services to implement.

Evaluation

Dominique Guinard

18 / 20

Summary and Critics

The compass UI (Spatial Discovery Layer) helps users to:^ Identify co-located services.^ Interact with pervasive services in a simple and

uniform way.

The Service Architecture enables:^The dynamic discovery of previously unknown

services.^The rapid prototyping of pervasive services.

Conclusion

Dominique Guinard

19 / 20

Open Questions

Scalability of the application:^ In terms of user interface.^ In terms of Service Architecture.

User study is formative:^Need for a comparative study as well.^Need to evaluate the framework and its use for

the prototyping of mobile spatial applications. Security concerns:

^Spontaneity is nice but in leaves a number of doors open for attackers.

^Suggestions ?

Conclusion

Dominique Guinard

20 / 20

Questions ?

Contributors: Sara Streng, Hans Gellersen, Matthew Oppenheim, Carl Fischer.

Project’s homepage: http://ubicomp.lancs.ac.uk/relategateways

Contact: dguinard@guinard.org

Conclusion