72
HT MASH MAH AH SH MH Multi-model Adaptive Spatial Hypermedia Luis Francisco- Revilla Department of Computer Science Texas A&M University

Multi-model Adaptive Spatial Hypermedia

Embed Size (px)

DESCRIPTION

Multi-model Adaptive Spatial Hypermedia. Luis Francisco-Revilla Department of Computer Science Texas A&M University. 1. MASH. What is M ulti-model A daptive S patial H ypermedia?. 2. APPROACH. What were the challenges in creating MASH?. 3. SYSTEM. How was MASH instantiated?. 4. - PowerPoint PPT Presentation

Citation preview

Page 1: Multi-model Adaptive Spatial Hypermedia

HT

MASH

MAH

AH

SH

MH

Multi-model Adaptive Spatial Hypermedia

Luis Francisco-RevillaDepartment of Computer Science

Texas A&M University

Page 2: Multi-model Adaptive Spatial Hypermedia

4How effectively does the system function?

3How was MASH instantiated?

5What were the lessons learned?

1What is Multi-model Adaptive Spatial Hypermedia?

2What were the challenges in creating MASH?

Page 3: Multi-model Adaptive Spatial Hypermedia

1

Spatial Hypermedia

Hypermedia

Multi-model Adaptive Spatial Hypermedia

Multi-model Adaptive Hypermedia

Adaptive Hypermedia

Map-based Hypermedia

MASH

Page 4: Multi-model Adaptive Spatial Hypermedia

1Hypermedia often provides a

rigid presentation of the information

Problem

“Sometimes I want the link

and sometimes I don’t”

“I think these two objects

might be related”

HT

MASH

MAH

AH

SH

MH

Page 5: Multi-model Adaptive Spatial Hypermedia

1Adaptive Hypermedia

Personalize presentations

Adapt presentation to multiple aspects

Hypermedia

Multi model Adaptive Hypermedia

Adaptive Hypermedia

Task Model

User Model

Situation Model

Risk Model

HT

MASH

MAH

AH

SH

MH

Page 6: Multi-model Adaptive Spatial Hypermedia

1Multiple Independent Models

Complexity and scalability Easier knowledge engineering

Portability and reutilization Amortization of costs

Privacy and distribution Control over personal models

Not

Very

So-so

Not

So-so

Very

Not So-so Very

Not So-so Very

Not So-so Very

Not So-so Very

HT

MASH

MAH

AH

SH

MH

Page 7: Multi-model Adaptive Spatial Hypermedia

1Spatial Hypermedia

There was a need to know the context

Due to their heavy use, maps became the primary interface

Hypermedia

Spatial Hypermedia

Map based Hypermedia

Aquanet

VKB

HT

MASH

MAH

AH

SH

MH

Page 8: Multi-model Adaptive Spatial Hypermedia

Spatial Hypermedia

Objects are not restricted to represent documents (e.g. objects may represent chunks of information within a document)

Navigational Hypertext Spatial Hypertext

1HT

MASH

MAH

AH MH

SH

Page 9: Multi-model Adaptive Spatial Hypermedia

Spatial Hypermedia

Navigational Hypertext Spatial Hypertext

Objects are not restricted to represent documents (e.g. objects may represent chunks of information within a document)

1HT

MASH

MAH

AH MH

SH

Page 10: Multi-model Adaptive Spatial Hypermedia

Spatial Hypermedia

Navigational Hypertext Spatial Hypertext

Objects are not restricted to represent documents (e.g. objects may represent chunks of information within a document)

1 SH

HT

MASH

MAH

AH MH

Page 11: Multi-model Adaptive Spatial Hypermedia

1Spatial Hypermedia

Users can interact with the information and see the effects of altering its structure

Reflect “perceptually” vs. reflect “cognitively”

HT

MASH

MAH

AH

SH

MH

Page 12: Multi-model Adaptive Spatial Hypermedia

1Spatial HypermediaHT

MASH

MAH

AH

SH

MH

Communication is via perceivable structures

Systems use spatial parsers in order to develop a shared understanding of these structures

UserBack-endProcesses

Page 13: Multi-model Adaptive Spatial Hypermedia

1Spatial Hypermedia

In Web-based Spatial Hypermedia and Presentation Oriented Spatial Hypermedia, Readers and Authors are not the same person anymore

HT

MASH

MAH

AH

SH

MH

Page 14: Multi-model Adaptive Spatial Hypermedia

Spatial Hypermedia

Hypermedia

Multi-model Adaptive Spatial Hypermedia

Multi-model Adaptive Hypermedia

Adaptive Hypermedia

Map-based Hypermedia

1MASH

Page 15: Multi-model Adaptive Spatial Hypermedia

4

3

5

1

2

Page 16: Multi-model Adaptive Spatial Hypermedia

Adaptation in Spatial Hypermedia Content

Relational

Spatial

3

2

1

4

5

6

321 6

1

2APPROACH

Classification

Suggestions

Conflicts

Page 17: Multi-model Adaptive Spatial Hypermedia

Suggestions

Object

Model 1

Bold, Increase size

Models provide suggestions of how to adapt the information presentation

Classification

Suggestions

Conflicts 2APPROACH

Page 18: Multi-model Adaptive Spatial Hypermedia

Suggestions

Object

Object

Model 1

Bold, Increase size

Models provide suggestions of how to adapt the information presentation

Classification

Suggestions

Conflicts 2APPROACH

Page 19: Multi-model Adaptive Spatial Hypermedia

Methods and Techniques

Object

Model 1

Emphasize

Since Adaptive Hypermedia,high-level methods are translated to low-level techniques

Classification

Suggestions

Conflicts 2APPROACH

Page 20: Multi-model Adaptive Spatial Hypermedia

Methods and Techniques

Object

Object

Model 1

Emphasize

Emphasize = Bold, Increase size

In Spatial Hypermedia the

number of techniques

increases

Since Adaptive Hypermedia,high-level methods are translated to low-level techniques

Classification

Suggestions

Conflicts 2APPROACH

Page 21: Multi-model Adaptive Spatial Hypermedia

Methods and Techniques

Object

Model 1

Emphasize

Emphasize = Change border color, Increase border width

In Spatial Hypermedia the

number of techniques

increases

Since Adaptive Hypermedia,high-level methods are translated to low-level techniques

Classification

Suggestions

Conflicts 2APPROACH

Object

Page 22: Multi-model Adaptive Spatial Hypermedia

Methods and Techniques

Object

Model 1

Emphasize

Emphasize = Change background color, Increase font size

In Spatial Hypermedia the

number of techniques

increases

Since Adaptive Hypermedia,high-level methods are translated to low-level techniques

Classification

Suggestions

Conflicts 2APPROACH

Object

Page 23: Multi-model Adaptive Spatial Hypermedia

Methods and Techniques

Object

Model 1

Emphasize by 1.5; 0.80 confidence

In Spatial Hypermedia the

number of techniques

increases

Since Adaptive Hypermedia,high-level methods are translated to low-level techniques

Suggestions specify the adaptation method, its strength and the

model’s confidence in the suggestion

Classification

Suggestions

Conflicts 2APPROACH

Emphasize = Change background color, Increase font size

Object

Page 24: Multi-model Adaptive Spatial Hypermedia

Conflict Management

Model 2

Prevent from viewing

Object

Model 1

Emphasize

Conflicts occur when multiple adaptations cannot be simultaneously represented

?

Classification

Suggestions

Conflicts 2APPROACH

Page 25: Multi-model Adaptive Spatial Hypermedia

Conflict Management

Model 2

Prevent from viewing

Object

Model 1

Emphasize

?

Managing conflicts is more than resolving conflicts

Manage conflicts: Prevention Detection Resolution

Classification

Suggestions

Conflicts

Conflicts occur when multiple adaptations cannot be simultaneously represented

2APPROACH

Page 26: Multi-model Adaptive Spatial Hypermedia

Conflict Prevention

Augment medium expressiveness

Dynamically map high-level methods low-level techniques

Embrace ambiguity

Model 1Emphasize

Model 2

Emphasize Increase font size

De-emphasize Fade out De-emphasize

Classification

Suggestions

Conflicts 2APPROACH

Page 27: Multi-model Adaptive Spatial Hypermedia

Conflict Detection

Conflict propagation

Scope of conflicts Spatial parser

Suggestion 1 Suggestion 2

It does not look like a list anymore!

Conflicts can propagate in

many directions

Classification

Suggestions

Conflicts

Since the communication is via perceptible structures, when the structures break the communication breaks

2APPROACH

Suggestion 1 Suggestion 2

Page 28: Multi-model Adaptive Spatial Hypermedia

Conflict Resolution

Merge suggestions

Strategies: Weighted average Suggestion strength Suggestion confidence Model confidence Heuristic best

Object

Model 1:

emphasize

Model 2:

de-emphasize

Object

average suggestions

average suggestions

Classification

Suggestions

Conflicts 2APPROACH

Page 29: Multi-model Adaptive Spatial Hypermedia

Determine mapping from adaptation methods to techniques

Balancing author and reader control Specify mapping and resolution strategies

Conflict Resolution

emphasize

Object

Object

emphasize

emphasizeObject Object emphasize

Classification

Suggestions

Conflicts 2APPROACH

Page 30: Multi-model Adaptive Spatial Hypermedia

4

5

1

2

3

Page 31: Multi-model Adaptive Spatial Hypermedia

3SYSTEMWARP

Multi-model Adaptive Spatial Hypermedia

Executes in a Web-browser

Novel features Transclusion links Personal readings Annotations Behaviors

WARP

Behaviors

Process

Page 32: Multi-model Adaptive Spatial Hypermedia

3SYSTEMDemo 1 WARP

Behaviors

Process

Relationships: Explicit, Implicit, Transclusion Behaviors

Online News Collections

Commercial Web-page Transclusion, Import and Export

Page 33: Multi-model Adaptive Spatial Hypermedia

3SYSTEMBehaviors

User actions and system adaptations can affect existing spatial structures

Spatial parser identifies structures

Behaviors can preserve spatial relationships

WARP

Behaviors

Process

Page 34: Multi-model Adaptive Spatial Hypermedia

3SYSTEMAdaptation Process (1)

Objects prior to adaptation

Platform

Parser

Analyzer

Transformer

WARP

Behaviors

Process

Page 35: Multi-model Adaptive Spatial Hypermedia

3SYSTEMAdaptation Process (2)

Inference of implicit structures

Platform

Parser

Analyzer

Transformer

M1

M2

Mn

Models

WARP

Behaviors

Process

Page 36: Multi-model Adaptive Spatial Hypermedia

3SYSTEMAdaptation Process (3)

Context inference and conflict prevention

Platform

Parser

Analyzer

Transformer

M1

M2

Mn

Models

WARP

Behaviors

Process

Page 37: Multi-model Adaptive Spatial Hypermedia

3SYSTEMAdaptation Process (4)

Suggestion of adaptations

Platform

Parser

Analyzer

Transformer

M1

M2

Mn

Models

WARP

Behaviors

Process

Page 38: Multi-model Adaptive Spatial Hypermedia

3SYSTEMAdaptation Process (5)

Transformation and adaptations

Platform

Parser

Analyzer

Transformer

M1

M2

Mn

Models

WARP

Behaviors

Process

Page 39: Multi-model Adaptive Spatial Hypermedia

3SYSTEMAdaptation Process (6)

Extended conflict detection

Platform

Parser

Analyzer

Transformer

M1

M2

Mn

Models

Conflict?

WARP

Behaviors

Process

Page 40: Multi-model Adaptive Spatial Hypermedia

3SYSTEMAdaptation Process (7)

Alternative creation

Platform

Parser

Analyzer

Transformer

M1

M2

Mn

Models

AlternativesAlternatives

WARP

Behaviors

Process

Page 41: Multi-model Adaptive Spatial Hypermedia

3SYSTEMAdaptation Process (8)

Evaluation of alternatives

Platform

Parser

Analyzer

Transformer

M1

M2

Mn

Models

OK?OK?

WARP

Behaviors

Process

Page 42: Multi-model Adaptive Spatial Hypermedia

3SYSTEMAdaptation Process (9)

Final adaptation

Platform

Parser

Analyzer

Transformer

WARP

Behaviors

Process

Page 43: Multi-model Adaptive Spatial Hypermedia

5

1

2

3

4

Page 44: Multi-model Adaptive Spatial Hypermedia

Objectives

Comparative study Non-adaptive spatial hypermedia Multi-model adaptive spatial hypermedia

Investigate the effects of adaptation in the process of reading spatial hypermedia

Usability of the system

4EVALUATION

Experiment

Qualitative

Quantitative

3

2

1

Page 45: Multi-model Adaptive Spatial Hypermedia

Population

16 participants

18-40 years old

From Texas A&M University and Bryan/College Station community

Varying degrees of expertise (8 beginner, 8 advanced)

Experiment

Qualitative

Quantitative 4EVALUATION

Page 46: Multi-model Adaptive Spatial Hypermedia

Task

Web designers for a non-profit organization

Must author a Web page using a text editor in 90 minutes

Requirements and evaluation metrics for the Web page

Spatial hypertext about HTML as information support

Experiment

Qualitative

Quantitative 4EVALUATION

Page 47: Multi-model Adaptive Spatial Hypermedia

Evaluation Procedure

2:30 hours

Interview10 minutes

Completing the questionnaire about use of the system10 minutes

Authoring Web page90 minutes

Completing the HTML and XHTML questionnaire20 minutes

Completing the computer and Web expertise questionnaire5 minutes

Training in software tools (WARP and authoring environment)15 minutes

ActivityTime

Experiment

Qualitative

Quantitative 4EVALUATION

Page 48: Multi-model Adaptive Spatial Hypermedia

Initial Interface (not adapted)

Experiment

Qualitative

Quantitative 4EVALUATION

Page 49: Multi-model Adaptive Spatial Hypermedia

Demo 2 Experiment

Qualitative

Quantitative

Adaptation of the experiment’s interface

4EVALUATION

Page 50: Multi-model Adaptive Spatial Hypermedia

User Model Initialization Experiment

Qualitative

Quantitative 4EVALUATION

Page 51: Multi-model Adaptive Spatial Hypermedia

Initial interface (adapted for beginner)

Experiment

Qualitative

Quantitative 4EVALUATION

Page 52: Multi-model Adaptive Spatial Hypermedia

Initial Interface (adapted for advanced)

Experiment

Qualitative

Quantitative 4EVALUATION

Page 53: Multi-model Adaptive Spatial Hypermedia

Document Design

Content Kennedy and Musciano “HTML & XHTML: The Definitive Guide”

O’Reilley’s , 2002

Layout Encapsulate topics and subtopics Visually reflect the structure of the information Limited dynamic behaviors Adaptive behaviors

Multiple visual cues – size, font size, glow, alpha blur, zooming

Experiment

Qualitative

Quantitative 4EVALUATION

Page 54: Multi-model Adaptive Spatial Hypermedia

Qualitative Results

Gathered from observations, questionnaires,

interviews and comments

Emergent reading strategies

Changes in reading behavior

Experiment

Qualitative Results

Quantitative

Spatial layouts

Moving and rearranging

Collections and bookmarks

Informed link traversals

Adaptation and reading

4EVALUATION

Page 55: Multi-model Adaptive Spatial Hypermedia

Spatial Layouts

Easy navigation of large information spaces Effective concept encapsulation Reflect information structure

“I really like that I can see all of the chapters”

Experiment

Qualitative Results

Quantitative 4EVALUATION

Page 56: Multi-model Adaptive Spatial Hypermedia

Moving and Rearranging …to indicate what

is being read or what has been read

..to indicate “what is more important”

…in order to “see both and compare”

…“for reference”

Experiment

Qualitative Results

Quantitative 4EVALUATION

Page 57: Multi-model Adaptive Spatial Hypermedia

Informed Link Traversal

Informed link traversal Browsing before committing to maximizing collections

“You are not clicking on a bunch of links that may or may not have what you are looking for”

Experiment

Qualitative Results

Quantitative 4EVALUATION

Page 58: Multi-model Adaptive Spatial Hypermedia

Collections and Bookmarks

Maximizing sub-collections to bookmark sections

Minimizing collections as “I’m done with that!”

Experiment

Qualitative Results

Quantitative 4EVALUATION

Page 59: Multi-model Adaptive Spatial Hypermedia

Adaptation and Reading

Adaptation changed the way people read

Implementation guidelines: Using multiple visual cues Allow readers to maintain

control of the process

“What red glow?”

Experiment

Qualitative Results

Quantitative 4EVALUATION

Page 60: Multi-model Adaptive Spatial Hypermedia

Quantitative Results

Assessments of the quality of the Web pages in regards to: Content Presentation Overall

Scores computed according to pre-established metrics (provided to the users)

Experiment

Qualitative Results

Quantitative Results

4EVALUATION

Page 61: Multi-model Adaptive Spatial Hypermedia

ANOVA

Significantly better for the Adaptive case

Advanced users generated significantly better Web pages

Possible interaction

Overall p = 0.040

Content p = 0.038

Presentation p = 0.142

Non-adaptive vs. Adaptive

Overall p < 0.001

Content p < 0.001

Presentation p < 0.001

Novice vs. Advanced

Overall p = 0.103

Content p = 0.109

Presentation p = 0.147

Expertise-Adaptation Interaction

Experiment

Qualitative Results

Quantitative Results

4EVALUATION

Page 62: Multi-model Adaptive Spatial Hypermedia

Expertise and Overall Scores

Expertise vs. overall scores in the non-adaptive case

Expertise = HTML knowledge * (1 + Previous knowledge)

Experiment

Qualitative Results

Quantitative Results

4EVALUATION

0

500

1000

1500

2000

2500

3000

3500

4000

0 2 4 6 8 10Expertise

Sco

re

AdaptiveNon-adaptive

Page 63: Multi-model Adaptive Spatial Hypermedia

Expertise and Overall Scores

Experiment

Qualitative Results

Quantitative Results

Expertise vs. overall scores in the adaptive case

4EVALUATION

Expertise = HTML knowledge * (1 + Previous knowledge)

0

500

1000

1500

2000

2500

3000

3500

4000

0 2 4 6 8 10Expertise

Sco

re

AdaptiveNon-adaptive

Page 64: Multi-model Adaptive Spatial Hypermedia

Expertise and Overall Scores

Some clustering No significant

correlation between expertise and score

Experiment

Qualitative Results

Quantitative Results

4EVALUATION

Expertise = HTML knowledge * (1 + Previous knowledge)

0

500

1000

1500

2000

2500

3000

3500

4000

0 2 4 6 8 10Expertise

Sco

re

AdaptiveNon-adaptive

Page 65: Multi-model Adaptive Spatial Hypermedia

0

500

1000

1500

2000

2500

3000

3500

4000

0 2 4 6 8 10Expertise

Sco

re

AdaptiveNon-adaptive

Expertise and Overall Scores

Experiment

Qualitative Results

Quantitative Results

4EVALUATION

Some clustering No significant

correlation between expertise and score

Expertise = HTML knowledge * (1 + Previous knowledge)

Page 66: Multi-model Adaptive Spatial Hypermedia

0

500

1000

1500

2000

2500

3000

3500

4000

0 2 4 6 8 10Expertise

Sco

re

AdaptiveNon-adaptive

Experiment

Qualitative Results

Quantitative Results

Expertise and Overall Scores

4EVALUATION

Some clustering No significant

correlation between expertise and score

Expertise = HTML knowledge * (1 + Previous knowledge)

Page 67: Multi-model Adaptive Spatial Hypermedia

0

500

1000

1500

2000

2500

3000

3500

4000

0 2 4 6 8 10Expertise

Sco

re

AdaptiveNon-adaptive

Experiment

Qualitative Results

Quantitative Results

Expertise and Overall Scores

4EVALUATION

Some clustering No significant

correlation between expertise and score

Expertise = HTML knowledge * (1 + Previous knowledge)

Page 68: Multi-model Adaptive Spatial Hypermedia

4

1

2

3

5

Page 69: Multi-model Adaptive Spatial Hypermedia

Lessons learned

Future work 5CONCLUSIONSConclusions

Spatial Hypermedia supports the navigation of very large information spaces

Adaptive Spatial Hypermedia enhances the users’ ability to find the right information

Adaptation in Spatial Hypermedia is more elaborate than in Navigational Hypermedia

Adaptation affects the process of reading in Spatial Hypermedia

The use multiple independent models in the adaptation process is feasible and facilitates aspects such as authoring, reuse and distribution

5

3

1

2

4

Page 70: Multi-model Adaptive Spatial Hypermedia

Lessons learned

Future work

Future Work

CSCW implications

Mixed media and dynamic presentations

Interface for back-end systems: Software engineering Interface for digital libraries and

search engines

5CONCLUSIONS

Use machine learning in order to learn how to adjust automatically the adaptation parameters

Page 71: Multi-model Adaptive Spatial Hypermedia

Lessons learned

Future work

Broader Interests 5CONCLUSIONS

Adaptive visualization for content data analysis

Accessibility issues

Cross-cultural communication issues3

1

2

Page 72: Multi-model Adaptive Spatial Hypermedia

Questions?

www.csdl.tamu.edu/~l0f0954/research/WARP_research.html