Team: Thomas Bartoschek, Gerald Pape, Jim Jones, Christian Kray, Tomi Kauppinen

Gestural Interaction with Spatiotemporal Linked Open Data

PiLOD. Amsterdam, The Netherlands.

jim.jones@uni-muenster.de

Name: Jim Jones

Gestural Interaction with Spatiotemporal Linked Open Data

2

Our goal: To make any public information about the university available in machine-readable formats for easy access and reuse.- Publications;- Cafeteria menus;- …

http://lodum.de

Name: Jim Jones

Gestural Interaction with Spatiotemporal Linked Open Data

3

LIFE is a two-year project funded by the German Research Foundation (DFG).

- Meta Search: Institute for Urban History;- Semantic Annotation and Georeferencing for Historic Maps …

http://lodum.de/life/

Name: Jim Jones

Agenda

•Motivation

•Application•Dataset Creation•Gesture-based Approach•Approach Evaluation

•Conclusion•Future Work

Gestural Interaction with Spatiotemporal Linked Open Data

4

Name: Jim Jones

Gestural Interaction with Spatiotemporal Linked Open Data

5

Name: Jim Jones

Gestural Interaction with Spatiotemporal Linked Open Data

6

Name: Jim Jones

Deforestation decreasing...2004: 27.423 km²2012: 4.571 km²(Awesome!)

Gestural Interaction with Spatiotemporal Linked Open Data

7

Known Issues Data produced queued for analysis

(Huge amounts) Hard to visualize Hard to correlate the produced data

with external variables.

Name: Jim Jones

Motivation

Gestural Interaction with Spatiotemporal Linked Open Data

8

•How to efficiently correlate the deforestation phenomena with external variables?

•How to effectively communicate it to the population?

Name: Jim Jones

Triangle of Sustainability● Wissenschaft Interaktiv

2012 (Interactive Science)

● Awarded with €10k for developing the project

● 4 weeks for development!

Gestural Interaction with Spatiotemporal Linked Open Data

9

Linked Open Data!

Name: Jim Jones

Why Linked Data?(In 1 minute)

Gestural Interaction with Spatiotemporal Linked Open Data

10

Name: Jim Jones

The Web

Gestural Interaction with Spatiotemporal Linked Open Data

11

• Awesome Discoverability!

• But just for humans :(

Name: Jim Jones

Semantics

Gestural Interaction with Spatiotemporal Linked Open Data

12

?The forbidden fruit

Xxx xxxx x xxxx xxx xxxxXxx xxxxxxx xx x x xxxxxxxx.

Cheers,-God

● What is the article about?● Who is the author?● What is inside the picture?● Where, when and by whom was the picture taken?● ...

Name: Jim Jones

Direct benefits of Linked Open Data

Gestural Interaction with Spatiotemporal Linked Open Data

13

• Attaches meaning to data• Allows efficient thematic searches (e.g. person, company, city,

book, etc.)

• Links different kinds of datasets making the WORLD a single big repository!

• Private data and public data can be mixed, enabling companies and individuals to make better decisions and generate innovations.

My Repository

Name: Jim Jones

Gestural Interaction with Spatiotemporal Linked Open Data

14

Where to get the data?

Name: Jim Jones

Creating Dataset...Gestural Interaction with Spatiotemporal Linked

Open Data15

“todos têm direito a receber dos órgãos públicos informações de seu interesse particular, ou de interesse coletivo ou geral, que serão prestadas no prazo da lei, sob pena de responsabilidade, ressalvadas aquelas cujo sigilo seja imprescindível à segurança da sociedade e do Estado”.

Lei Nº 12.527, November 18th, 2011

http://www.planalto.gov.br/ccivil_03/_Ato2011-2014/2011/Lei/L12527.htm

Name: Jim Jones

Creating Dataset...Gestural Interaction with Spatiotemporal Linked

Open Data16

Deforestation

• Soybeans Crops• Cattle• GDP• Population• Brazilian Municipalities' Area

• Downloads data from IBGE Servers• Creates Triples

Linked Brazilian Rainforest Dataset

Name: Jim Jones

Dataset

Vocabularies• Time and Space Core Vocabulary (TISC)

• http://observedchange.com/tisc/ns-20110511/ • Open Linked Amazon Vocabulary (OLA)

• http://observedchange.com/amazon/ns/

Gestural Interaction with Spatiotemporal Linked Open Data

17

Spatiotemporal Dataset● Aggregated in grid cells of 25km x 25km● Time-series 2004 - 2009

Name: Jim Jones

Motivation (Recap...)

Gestural Interaction with Spatiotemporal Linked Open Data

18

•How to efficiently correlate the deforestation phenomena with external variables?

•How to effectively communicate it to the population?

Gestural Interaction with Virtual Globes!

Name: Jim Jones

Gestural Interaction with Spatiotemporal Linked Open Data

19

Enviroment

Economy

Society

Correlated with Deforestation Data!

Name: Jim Jones

Gestural Interaction with Spatiotemporal Linked Open Data

20

Name: Jim Jones

Gestures

Gestural Interaction with Spatiotemporal Linked Open Data

21

pan zoom in / out time travel

Name: Jim Jones

Video ( +1 minute)

http://www.youtube.com/watch?v=Jjzj84R1Tgc

Gestural Interaction with Spatiotemporal Linked Open Data

22

Name: Jim Jones

Evaluating the Approach

Gestural Interaction with Spatiotemporal Linked Open Data

23

Name: Jim Jones

Evaluation Procedure and Material•5- 8 Minutes usage

•Questionnaire with 28 questions in two groups:

•1 group: demographic information •e.g. gender, age, primary hand, familiarity with gesture control

interfaces

•2 group: Task Load (NASA TLX – Task Load Index). Rating how well gestures and map actions fit together, from 0 to 20.

•e.g. In which scale you define the mental or physical workload for the gestures?

•No reward!

Gestural Interaction with Spatiotemporal Linked Open Data

24

Name: Jim Jones

Test Group •Participants: 43

•28 male•15 female

•Youngest : 10•Oldest: 59

•Left handed: 7•Right handed: 36

•Familiarity with gesture-based interfaces:

•Familiar: 19•Unfamiliar: 24

Gestural Interaction with Spatiotemporal Linked Open Data

25

Name: Jim Jones

ResultsGestural Interaction with Spatiotemporal Linked

Open Data26

Name: Jim Jones

Observations

•Most participants reported the gestures as mentally challenging in the first minutes

•Older people found the system very accessible, particularly when compared with their first time using a mouse.

•User recognition gets considerably affected when bystanders are ‘seen’ by the Kinect sensor.

Gestural Interaction with Spatiotemporal Linked Open Data

27

Name: Jim Jones

Software

Gestural Interaction with Spatiotemporal Linked Open Data

28

Virtual Globe (UI)

LOD Processing

Gestures (Kinect)

https://github.com/giatschool/triangle-of-sustainability

Name: Jim Jones

Hardware

Gestural Interaction with Spatiotemporal Linked Open Data

29

Name: Jim Jones

Try it yourself!

Gestural Interaction with Spatiotemporal Linked Open Data

30

• NASA World Wind SDK Tutorial•Getting started with the Java API and LOD application examples.•http://ifgi.uni-muenster.de/worldwind-tutorial/

•Linked Brazilian Amazon Rainforest Data•Getting familiar to the LBARD dataset.•http://linkedscience.org/tutorials/exploring-the-linked-brazilian-amazon-rainforest-data/

Name: Jim Jones

Triangle on Tour!

• SBPC Science Fair•Recife (August, 2013)

•KIT-Alumini Club Seminar•Recife (September,2013)

• GeoCamp•Campos do Jordao (November, 2013)

• Ecogerma•Belém (November, 2013)

Gestural Interaction with Spatiotemporal Linked Open Data

31

Name: Jim Jones

Conclusion•The triangle provides an attractive and easy to use solution for

displaying spatiotemporal LOD.

•It has a high acceptance in class-rooms (Already presented in many German schools)

•Participants were able to learn how to use 3 gestures without excessive workload.

•Linked Data offers a good bases for efficiently connecting deforestation data with external variables.

Gestural Interaction with Spatiotemporal Linked Open Data

32

Name: Jim Jones

Future Work

•Improve registration gestures•Inefficient when more than one person is in front of the sensor

•Try different Kinect frameworks.

•Enable registration by children (short people)•Minimum arm length problem.

Gestural Interaction with Spatiotemporal Linked Open Data

33

Name: Jim Jones

Gestural Interaction with Spatiotemporal Linked Open Data

34

Name: Jim Jones

Gestural Interaction with Spatiotemporal Linked Open Data

35

Muito obrigado.Danke Schön.

Kiitos.Dziękuję bardzo.

Thank you!

Name: Jim Jones

Gestural Interaction with Spatiotemporal Linked Open Data

36

Comments?

Questions?