IMAGE DIVERSITY ANALYSIS:CONTEXT, OPINION AND BIAS

P. Zontone, G. Boato, F. G. B. De NataleA. De Rosa, M. Barni, A. Piva

J. S. Hare, D. Dupplaw, P. H. Lewis

IMAGES CAN...

The main roles of images in the communications process

Attract attention and make documents more

appealing

Convey opinions and emotional messages

Convey information for documenting a claim

2003

2007

“Global warming is happening now!”

DIVERSITY

Values

Opinions

Geography

Time

Themes

Source

Rights Holder

Location

Intent

Context

Exploiting and analysing diversity in images

Diversity in image search results

Pure Visual DiversificationIAM@ImageCLEFphoto 2009 - results of a search for ‘euro’

without visual features

with visual features

✸

Image distribution in feature-space

Iterative re-ranking procedure by

maximising distance in feature-space

Input from text

search

Re-ranked

output

Diversified Image Search

DBPedia

Triple-Store

Yahoo

Wikipedia

Search Index

Yahoo Image

Search Index

DBPedia

SPARQL

Endpoint

Yahoo BOSS Web Service

Diversity Enabled Image Search Engine

Query Specification

Subject ContextDiversity

Axis

Search for

Wikipedia Page

about Subject

Get DBPedia URI

for Subject

Search DBPedia

for Resources

and Literals that

link the Diversity

Specification with

the Subject URI

Generate a list of queries, by combining

subject, context and resource names/literal

text. Use "dbprop:redirect of" to provide query

expansion for resources.

Search for images using the generated queries

Organise and present results

Response

Emotions

Anger

Amusement

Awe

Contentment

Disgust

Excitement

Fear

Sadness

Undifferentiated -ve

Undifferentiated +ve

IAPS: International Affective Picture System

Bias Detection

Contextual Analysis

Bri$sh

Na$onalParty

sameas

leader

Nick

Griffin

name

ideology posi$on

White

Na$onalismFascism

Far‐right

Image Tampering

Forensic Techniques

A Political Advertisement for George W. Bush

Automatic cloning detection (copy-move forgery)

The Rapper Snoop Dogg, or is it?

Summary

Images play an important role in the communication process.

There are many forms of diversity; it is possible to automatically extract, analyse & harness some of these in

the context of images.

Any Questions?