Semantic Tagging on Historical Maps
Bernhard Haslhofer and Werner Robitza (University of Vienna)Carl Lagoze (University of Michigan)François Guimbretière (Cornell University)
ACM Web Science 2013, Paris
ACM Web Science 2013, May 2013
Tagging
2
flickr:wlappe/2902517299/
Paris
Paris
http://youtu.be/hWo-43ObCP8
ACM Web Science 2013, May 2013
Tagging - Problems
3
Paris
Paris
ACM Web Science 2013, May 2013
Label- vs. Semantic Tagging
utr
Label-based tagging[Marlow et al. 2006] K
u
rx
t
ryabout
Semantic tagging
tag: String tag: URI Reference
4
ACM Web Science 2013, May 2013 5
http://maphub.github.com
ACM Web Science 2013, May 2013
Semantic Tagging in Maphub
There is a DBpedia/Wikipedia URI behind each visual tag
http://dbpedia.org/resource/Mediterranean_sea
6
ACM Web Science 2013, May 2013
Semantic Tagging in Maphub
7
K
urx
t1
ryrz
+
t2
-
ACM Web Science 2013, May 2013
Research Questions
• What are the effects of semantic tagging on
• tag production
• types and categories of tags added
• user task load
... compared to other tagging techniques.
8
ACM Web Science 2013, May 2013
Methodology
• In-lab experiment, 24 students, 2 maps
• Each creating 4 annotations under varying conditions
• Label-based tagging (LT)
• Suggestive tagging (ST)
• Semantic tagging (SMT)
• Semantic tagging with context display (SMT-CTX)
• Pre- and post-test surveys (NASA TLX)
9
ACM Web Science 2013, May 2013
• No difference in accepted tags between SEM/SEM-CTX and LT
• Less rejected tags under SEM/SEM-CTX than under ST
Results / Effect on Tag Production
0
2
4
6
LT ST SMT SMT−CTXCondition
Mea
n N
umbe
r of T
ags
User Feedbackacceptedrejected
10
ACM Web Science 2013, May 2013
• Tag types : no significant difference among conditions
• 48% factual
• 52% personal
• Tag categories: no significant difference among conditions
• 54% locations
• 7% persons or groups
• 39% other
Results / Effect on Tag Types and Categories
11
ACM Web Science 2013, May 2013
Results / Effect on User Task Load
Mental Eff.
Physical Eff.
Temporal Eff.
Success
Effort
Frustr.
0 2 4Average TLX Score
conditionLTSTSMTSMT−CTX
• Additional effort caused by SMT and SMT-CTX had no effect on user task load
• Participants found SMT-CTX most useful and intuitive
12
ACM Web Science 2013, May 2013
Results / Summary
• Semantic tagging (as implemented in Maphub) provides unambiguous relationships to well-defined and linked Web resources and does NOT affect
• tag production
• types and categories of tags
• user task load
13
ACM Web Science 2013, May 2013
Other Observations
“I am doing this [annotation] because I am from the Philadelphia area”
14
ACM Web Science 2013, May 2013
Thanks !@bhaslhofer
http://slideshare.net/bhaslhofer
http://bernhardhaslhofer.info
http://maphub.github.io
15