Upload
others
View
0
Download
0
Embed Size (px)
Citation preview
12/13/10
1
webofdata webofpeople webofac2on
AlanDixLancasterUniversity
andTalis
www.hcibook.com/alan/papers/JWS-2010-world-of-action
aboutme
IworkatLancasterneartheLakeDistrict
andBirminghamintheMidlandsofEngland
12/13/10
2
…but
althoughIspeakEnglishIamnotEnglish
IamWelsh
rydwi’nCymraeg
…andlive...
inTiree,Scotland...thesunniest...andwindiestplaceintheUK
12/13/10
3
todayIamnottalkingabout…
• situateddisplays,eCampus,smalldevice–largedisplayinterac2ons
• visualisa2onandsampling
• funandgames,virtualcrackers,ar2s2cperformance,slow2me
• physicalityandproductdesign
• crea2vityandbadideasandmodellingdreamsandregret!
…orevenlotsoflights
hQp:/www.hcibook.com/alan/projects/firefly/
12/13/10
4
...butIamtalkingabout
theweb
web
data
• HTML,images,PDF• hypertextlinks• websearch
12/13/10
5
web
data
• web2.0• socialmedia
• socialnetworking
people
vfridge(dot.com)photolurking
vfridge...lookingtothewebfuture...in1999
inthemidstofdot.comyears...
dominantview:– expec2ng‘shakeout’– smallnumberoflargeplayers– futureofwebasTV‐stylebroadcastmedium
wethoughtdifferently....
12/13/10
6
thewebsharervision(1999)
“Theweb/Internetisnotjustamediumforpublishing,butapoten2alsharedplace.
Everyonemaybeawebsharer—notapublisherofformalpublic'content',butpersonalorsemi‐privatesharingofinformal'bitsandpieces'withfamily,friends,localcommunityandvirtualcommuni2es...”
soundsprescient(web2.0!)....andwastranslatedintoaproduct(vfridge)
sadlythecompanydied
buttheyoucans2llplaywithvfridgetoday
12/13/10
7
web
data
• peoplewanttodothings
BillGates:“The future of search is verbs.”
EstherDyson:"when people search, ... they are looking for ac9on"
ac2onpeople
web
data
butmustnotforget
thatattheheartoftheweb
iscomputa2on
ac2onpeople
computa2on
12/13/10
8
computa2on
data
• seman2cweb– RDF,OWLetc,opendata,linkeddata,data.gov.uk
ac2onpeople
computa2on
data
• seman2cweb• recommendersystems– Amazonforbooks,butnowubiquitous
ac2onpeople
12/13/10
9
computa2on
data
• seman2cweb• recommendersystems
• intelligentuserinterfaces– promisedlong...
ac2onpeople
onCue...moredot.comtales
computa2on
data
butallfittogether
globaldata+individualinterac2on=>personalisedac2on
ac2onpeople
12/13/10
10
focusingonac2on
howcanthesystemhelp?
2metoact
• whentoact(ini2a2ngac2on)– detec2nglociofac2onincurrentac2vity
• whattoacton(performingac2on)– sugges2ngparameters/valuesinac2ons
• howtoact(con2nuingac2on)– proposingfutureac2ons
12/13/10
11
whentoact
detec2nglociofac2onincurrentac2vity
data‐driveninterac2on
iden2fylociatpointofcrea2on
offeralterna2veRDForXMLformatsorusemarkupinwebpage– dedicatedmarkup
e.g.zLinks
– microformatshumanreadabletext...
...butalsomachinereadable forsearchenginesorplug‐ins
<p class="vcard">Hi, my name is <span class="fn">Jamie Jones</span> and I dig microformats!</p>
microformats.org
zitgist.com/products/zlinks
12/13/10
12
iden2fylociatpointofuse–Snip!t
1
usersselectsinwebpageandpresses“Snip!t”bookmarklet
2
Snip!tpopsuppagewithsuggestedthingstodowiththesnip(andsavesitforlater,likebookmark)
iden2fylociatpointofuse–Snip!t
recognisesvariousthingse.g.dates
playyourselfatwww.snipit.org
12/13/10
13
classofsystems‘datadetectors’
• late1990s– Intelselec2onrecogni2onagent– AppleDataDetectors(BonnieNardi)– CyberDesk(AndyWoodledtoonCue)
• recently– MicrosovSmartTags– Googleextensions– Citrine–clipboardconverter– CREOsystem(Faaberg,2006)
• wayback– Microcosm(Hypertextexternallinkage)
syntac2c/regexp
‘seman2c’/lookup
Snip!tusescombina2on
architecture
Snip!t–server‐side‘intelligence’ (onCue–wasclient‐side–internetspeedatthe2me!)
recognisers+services(inheritedfromonCue):
• recognisers:– scantextforpoten2aldata
• services:– matchdatatoac2ons
12/13/10
14
architecture
simplerecognisers– regularexpressions,tablelookup
e.g.postcodes,personalnamesfromcensusdata
differentkindsofrecogniserchaining:– fromseman2cstowiderrepresenta2on
e.g.postcodesuggestslookforaddress– fromseman2ctoseman2c
e.g.domainnameinURL– fromseman2ctoinnerrepresenta2on
e.g.fromAmazonauthorURLtoauthorname
representa2onvs.seman2csveryimportant
whattoacton
sugges2ngparameters/valuesinac2ons
12/13/10
15
personalontologies
• alluse‘general’categories:• postcode,name,place
• linkingtopersonalontology– usersownen22esandcategories
• howtobuild?– byhand(duringusefulinterac2ons)– automa2cally(miningfiles,emails,etc.)
– e.g.Gnowsisandotherseman2cdesktopprojects
me
Azrina
supervises
Geoff
supervises
Devina
married
Project:TIM
member
member
spreadingac2va2onoverontology
Person Univ City Country
Vivi
UoAAthens
Greece
George
UoPTripolis
m 1 m 1 m 1
spreadac2va2onthroughrela2oninstances
weakerspreadthrough1‐mlinksthanm‐1
long‐termmodifica2onofschemarela2onweights
ini2alac2va2onthroughuse
schema
instances
Costas
e
12/13/10
16
contextinforms
butwhatistherela2onship?maybeseman2cmarkuponform– goodSemWebstyle...butnotverypersonal
...ormoreinference...
HotelsRUs
AlanDix
LancasterUniv.
Name
Org.
entryoffirstfieldsetscontextforrestofform
contextinforms‐inference
matchtermsinformtoontologylookfor‘leastcostpaths’
• numberofrela2onshipstraversed,fan‐out
HotelsRUs
AlanDix
LancasterUniv.
Name
Org.
Person:ADix
name_of
Inst:ULanc
name_of
memberPerson:Devina
?
member
colleague
12/13/10
17
contextinforms‐inference
matchtermsinformtoontologylookfor‘leastcostpaths’
• numberofrela2onshipstraversed,fan‐out
latersuggestbasedonrules
HotelsRUs
Name
Org.
AkriviKa2fori
Univ.ofAthens
Person:?
name_of
Inst:?
name_of
member
Person:Vivi
Inst:UoA
member
howtoact
proposingfutureac2ons
12/13/10
18
singlestep–nextac2on
seenitalready...
• markupordatadetectors‐>loci
• findwebservicesthatusethedata
• stronglytypeddataisthelink
loca2ngwebservicesfordatatype
manywebservicesdesignedforhumanuseaddmeta‐informa2ontoservices– internal(seman2cpagemarkup)
– external(e.g.Snipit,MilanSearchCompu2ng)
<urlservice><type>name</type> <2tle>switchboard.com</2tle><descpaQern>lookupUSperson$nameatswitchboard.com</descpaQern><urlpaQern>hQp://www.switchboard.com/bin/cgiqa.dll?SR=&MEM=1&LNK=33:4&F=${forename}&L=${surname}</urlpaQern></urlservice>
www.snipit.org
12/13/10
19
reweavingthehiddenwebthroughuserinterac2on
hiddenwebapplica2on webpageswith
microformatsordatadetctors
meta‐datadescribinginput
webofdatasta2canddynamic
proposingsequencesofac2ons
• longhistory(lotsofworkearly1990s)• limitedsuccess– interleavedtasks– generalisa2on
• dataontologyhelps:‐)– input/outputlinkslike‘stringofpearls’– ontologytypeallowssinglesteplearning
12/13/10
20
howtogetlinks?
• userinterac2on:– drill‐downfrompreviousvalues
• systeminference:– sameform‐fieldlinkingasbefore
sowhat?