Visual Model-based Design of Multi-platform Interactive Applications

HCI Group/ISTI-CNR

23 September 2002Pisa (I)

EUD-Net Workshop, Pisa, September 22nd 2002 2

Rationale Ever-increasing introduction of new types

of interactive devices Applications often need to be accessed

through different interactive devices How to support designers and developers? How to obtain interfaces able to adapt to

different targets while preserving usability?

EUD-Net Workshop, Pisa, September 22nd 2002 3

Goals Express context-dependent information in a set of

models that can be used at design-time and run-time

Develop tools using information contained in the models to drive the design and development of usable interfaces for multi-target applications

Techniques/components supporting development of adaptive/context-dependent applications

Address some case studies for validating the methods, techniques and tools

EUD-Net Workshop, Pisa, September 22nd 2002 4

Task –related issues in multiplatform applications

Same task on multiple platforms in the same manner

Tasks meaningful only on a single platform type

Dependencies among tasks performed on different platforms

Same task on multiple platforms but performed in different manner

EUD-Net Workshop, Pisa, September 22nd 2002 5

One model, many interfaces

EUD-Net Workshop, Pisa, September 22nd 2002 6

TERESA in the Reference Framework

EUD-Net Workshop, Pisa, September 22nd 2002 7

The Method

Task model for envisioned nomadic applications

System task model – desktop (XML)

System task model – cellphone (XML)

System task model (pda)

(XML)

…

Filter + Refine

Abstract UI – cellphone

(XML)

Openwave … Nokia

(WML, XHTML Mobile, VoiceXML, …)

Abstract UI – desktop(XML)

Multimedia PC Graphical PC Low res PC ( HTML, …)

Abstract UI – Pda

(XML)

Palm … Compaq

EUD-Net Workshop, Pisa, September 22nd 2002 8

Related Work The User Interface Markup Language (UIML) (

http://www.uiml.org/). Mainly developed by Harmonia and Virginia Tech.

The Abstract User Interface Markup Language (AUIML) is an XML vocabulary designed to allow the intent of an interaction with a user to be defined. This work has mainly been carried out at IBM.

The eXtensible Interface Markup Language (XIML) (http://www.ximl.org/) is an extensible XML specification language for multiple facets of multiple models in a model-based approach. This is developed by a forum driven by RedWhale software (HP and Applied materials).

EUD-Net Workshop, Pisa, September 22nd 2002 9

 

Interface

Presentation+

Structure Connection?

Interaction_aio_name

presentation_aio_name

aio aio_composition

interaction_aio application_aio

selection_aiocontrol_aio

edit_aio

single_choice_aio multiple_choice_aio+

singlechoice_low_card_aio+

singlechoice_medium_card_aio+

singlechoice_high_card_aio

+multiplechoice_low_card_aio+

multiplechoice_medium_card_aio+

multiplechoice_high_card_aio+

operator 1st_expression+ 2nd_expression?

name sub_presentation

sub_presentation

text_aio graphic_aio

text_edit_aiographic_edit_aio aio aio_composition

Structure of the language for abstract user interfaces

EUD-Net Workshop, Pisa, September 22nd 2002 10

Composition operators

Grouping (G) Relation (R) Ordering (O) Hierarchy (H)

EUD-Net Workshop, Pisa, September 22nd 2002 11

TERESA XML

WML

XHTML Mobile

Xml spec of CTT task model

Xml spec of operators & abstract interactors

Xml spec of Enabled Task Sets

.

.

.

XHTML

Abstract User Interface

Transformation Environment for inteRactivE Systems representAtions

EUD-Net Workshop, Pisa, September 22nd 2002 12

Current TERESA layout

EUD-Net Workshop, Pisa, September 22nd 2002 13

Filtering the model

EUD-Net Workshop, Pisa, September 22nd 2002 14

XML AIU language

EUD-Net Workshop, Pisa, September 22nd 2002 15

Initial layout for the prototyping phase

EUD-Net Workshop, Pisa, September 22nd 2002 16

Defining implementation of composition operators

EUD-Net Workshop, Pisa, September 22nd 2002 17

Changing design decisions

EUD-Net Workshop, Pisa, September 22nd 2002 18

Summary of the design decision

EUD-Net Workshop, Pisa, September 22nd 2002 19

Example of phone presentation

EUD-Net Workshop, Pisa, September 22nd 2002 20

Example of desktop presentation

EUD-Net Workshop, Pisa, September 22nd 2002 21

From system task model to abstract user interface

Shift from task to abstract interaction Shift from task to abstract interaction objects:objects:

1)1) Calculation of enable task setsCalculation of enable task sets

2)2) Heuristics for optimization in terms of Heuristics for optimization in terms of presentation sets and transitionspresentation sets and transitions

3)3) Mapping presentation task sets into sets of Mapping presentation task sets into sets of abstract interaction objects and dialogueabstract interaction objects and dialogue