User centered image management system

EGYED- ISZLAI : User centered image management system DIAL 2006 LYON 1

User centered image management system for digital libraries

EGYED-ZSIGMOND ElődLIRIS, INSA-Lyon

ISZLAI ZoltánSapientia EMTE, Targu-Mures


Outline

Addressed issue

Application

Theoretical model (Club ♣♣♣♣)

The prototype application


Addressed issue

Documents

pre formattingsegmentation

automatic/ assisted annotation

search

scanner or camera

Online image annotation and management system, which traces the actions of the users and uses the capitalized experience to help them according to the case based reasoning paradigm

Manual image annotation and search is a human relate d problem, difficult to formalize


Addressed issue

Images

Many UsersAnnotation and search system

Existing annotations

Lt. Tonton

Vérification

Massage

Dégagement

Homme en noir

Lt. Tonton

Homme en noirMassage

DégagementVérification

DA: Secouriste DA: VictimeDA: Opération

Annotations

Interpretation traces

Lt. Tonton

Vérification

Massage

Dégagement

Homme en noir

Lt. Tonton

Vérification

Massage

Dégagement

Homme en noir

Lt. Tonton

Vérification

Massage

Dégagement

Homme en noir

Lt. Tonton

Vérification

Massage

Dégagement

Homme en noir

Annotations (words)Images

Semantic gap

Interpretation


Outline

Addressed issue

Application




Application

Digitalization and online publication of documents from a library


Application

Marosvásárhely (Târgu-Mure ş)

ManuscriptsManuscripts ofof thethe mathematicianmathematicianJJáános BOLYAI (1802nos BOLYAI (1802 ––1860)1860)

fatherfather ofof thethe non non euclideaneuclidean geometrygeometry~ 15000 pages~ 15000 pages

Preserved in the TELEKI-BOLYAI library

in Roumania, Transylvania


Outline

Addressed issue

Application




Objets Utilisateurs

Procédés

Club ♣♣♣♣

We consider that a user manipulates objects through procedures .

Objects Users

Procedures

The trace model is based on a graph containing user, procedure and object type nodes.

The use of the system is traced according to this graph.


♣♣♣♣ Phases of the assistance management

Formalize objects manipulated and the relations among them:

use model

Gather (imagine) the different object manipulation procedures and formalize them in tasks

Methods to cut the traces in reusable and adaptable cases .

Decide which tasks to trace in order to capitalize user experience :

observation model

The use model and the observation model enables the traceconstruction


♣♣♣♣ Case Based Reasoning

elaborateProblem New case

Found case

Solution case

Adapted case

Learned case

search

compare

adapt

validate

Case base and domain theory

learn

Pb (resolved)

Sol (resolved)

Pb (target)

Sol (target)

Comparison

Resolved case Target case

[Aamodt and Plaza1994][Mille1998]

Adaptation


Users

Procedures

Objects

♣♣♣♣ Use and observation model

Annotate images

Search Navigate

Albums

Create gallery

through imagesthrough albums

Through usersThrough keywords

Images

Keywords

User1

User2


Application to image management

Images KeywordsUsersGalleries

Use model:

Simplified model


Observation model

GUI transition diagramme

was not successfulsearch

by suggested keyword

by suggested image

by entered keywords

by related keywordsOrthographical correction

with all the wordswith any of the words

select image

by user keywords

was successful

by user image result

by user ’s gallery

by user ’s gallery result

by user gallery keywords

Enlarging image

Select keyword

by all keywords

by suggested keywords

KIDKIDKID

KID KID KID

KIDKID

GID UIDIIDKID

UID IIDGID UID

KID

IID

IID

UID KID


♣♣♣♣ Tracing the use of the system

Users

Procedures

Objects

Annotate images

Search Navigate

Albums

Create gallery



Images

Keywords

User1

User2

Users

Procedures

Objects

Users

Procedures

Objects

Annotate images

Search Navigate

Albums

Create gallery



Images

Keywords

User1

User2

Trace view 1

Trace view 2


Following the user

Once the traces defined we cut them into reusable c ases

The assistance concerns :« What to do ? »

rather than « How to do ? »

type situations

Users

Procedures

Objects

Annotate images

Search Navigate

Albums

Create gallery

through images through albums


Images

Keywords

User1

User2

Users

Procedures

Objects

Users

Procedures

Objects

Annotate images

Search Navigate

Albums

Create gallery



Images

Keywords

User1

User2

Comparison Adaptation

Pb (target)

Pb (resolved)

Sol (target)

Sol (resolved)Sol (resolved)

Sol (target)


Traces

U:Angelo

P: Search

KID: Bolyai

P: select image

P: Enlarging image

IID:428665

KID: theoreme

KID: tulip

KID: parralel

KID: Math

KID: color

KID: petal

KID: hungarian

KID: german

KID: botanic

KID: love

KID: TelekiKID: card

KID: latin

P: by suggested keywords

KID: manuscript

Users

Procedures

Objects

O: GID

O: IID

O: UID

U:Angelo

U:Elod

U:Sonia

P: Search

P: Orthographical correction

P: by related keywords P: by user gallery

P: by all keywords

P: by user gallery keywords

P: Enlarging image

P: by user image result

P: by image keywords P: by suggested image

P: select image

P: Select keyword

P: by user gallerys

P: by suggested keyword

O: KID

Use trace model, trace explanation

Traces


Outline

Addressed issue

Application




Image management system

• Create an image management website to – publish the documents of the Teleki library– experiment user experience capitalization and reuse techniques

• Features :– Online image management– Image upload (one by one or zipped sets)– Keyword based manual description (free and selected)– Keyword based image search– Basic image processing tools

– Experience, image similarity and co-annotation base d keyword recommendation

– New graphical metaphors to explore the image base a nd keywords

• Objectives


Image annotation interface


Search interface


Conclusion / directions

• User tracing online image annotation and management system

• a case based reasoning use trace model

• non intrusive way of suggesting keywords and results to help users describe what they wish (dream) to find

• show the traces to the users

• Improve the user interface (new visual metaphors)

• Include more sophisticated image processing tools

• Beta version available online :

http://plexir-liris.insa-lyon.fr/myimages/

login/pass : test/testUsers

Procedures

Objects

Annotate images

Search Navigate

Albums

Create gallery



Images

Keywords

User1

User2

Users

Procedures

Objects

Users

Procedures

Objects

Annotate images

Search Navigate

Albums

Create gallery



Images

Keywords

User1

User2


Thank you

Questions ?

Internet

User centered image management system