99
ESWC Summer School 2016 Understanding and Communicating with Data Dr. Chris Phethean University of Southampton

ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

ESWCSummerSchool2016UnderstandingandCommunicating

withData

Dr.ChrisPhetheanUniversityofSouthampton

Page 2: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

AboutMe

• Undergraduate,postgraduateandPhDfromUniversityofSouthampton• ComputerScience->WebScience->DataScience• Now• ResearchFellow• PrimarilyworkingontheEuropeanDataScienceAcademyproject• TeachonMScDataSciencecourse

Page 3: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Data…there’salotoutthere!

•AccordingtoIBM:•2.5Quintillionbytesofdataarecreatedeachday•90%ofthedataintheworldhasbeencreatedinthelastTWOyears.

http://www-01.ibm.com/software/data/bigdata/what-is-big-data.html

Page 4: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

https://www.linkedin.com/pulse/4-big-data-sources-can-used-commercial-lending-risk-modeling-azalone

Page 5: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Communicatingwithdata

• Manypeoplestruggletoconveythevalueoftheirdata• Asthecomplexityofdataincreases,sotoodoesthecomplexityoftheanalysisdonewithit• Theseresultsthenneedtobecommunicatedtoarangeofaudiences

• “Juststatisticsdoesnotgivethefullpicture”– ClaudiaonMonday

• Alongsidethiswecanusedatavisualisation togetabetterideaofwhatthedataissaying.

Page 6: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the
Page 7: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

DataVisualisation is…

• “TheVisualDisplayofQuantitativeInformation”• Thetitleofthisbookprovidesagoodstartingdefinition• WewillseelaterthatTufte isabignameintheworldofvisualisation

Page 8: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

WhataboutWikipedia?

• “tocommunicateinformationclearlyandefficientlyviastatisticalgraphs,plotsandinformationgraphics”• https://en.wikipedia.org/wiki/Data_visualization

• Keypoints• Communicateinformation• Clearly• Efficiently• Usingstatisticalgraphs,plots,informationgraphics

Page 9: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Anexample– Detroit(1)

Page 10: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Anexample– Detroit(2)

https://www.motorcitymapping.org/#t=parcels&s=detroit&f=all&x=preset2

Page 11: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Whydatavisualisation?

• Easiertospotkeyfeaturesinthedata• Actonemergingtrends

• Explainthestorythatthedatarepresents• Explorewhatthedatashowstofindinterestinginsights• Easiertocommunicatefindingsthanwithaspreadsheet

Page 12: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Dataisn’tnew:we’vealwaysneededtounderstandandcommunicateinsights

• Londoncholeraoutbreak,1854• JohnSnowinvestigatedtheoutbreak,observingclustersaroundBroadStreet• Usingamap-basedvisual,hetalliedhowmanycasewerereportedineachlocation

Page 13: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

CholerainLondon,1854

Page 14: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

JohnSnow

• Uponfurtherinvestigation,henoticedthatmanycaseswereclusteredaroundtheBroadStreetwaterpump.• Heusedthemaptoconvincetheauthoritiesandorderedthatthehandlewasremovedandthepumpinvestigated,andcasessubsequentlyreduced.• Thishelpedtochangescientificunderstandingofhowdiseasesarespread.

Page 15: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

TheFirstBarChart:Anapology

15

Readmore:Beniger,JamesR.,andDorothyL.Robyn.1978.“QuantitativeGraphicsinStatistics:ABriefHistory”.TheAmericanStatistician 32(1).[AmericanStatisticalAssociation,Taylor&Francis,Ltd.]:1–11.doi:10.2307/2683467.

Page 16: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

TypesofvisualisationExploreorExplain?

Page 17: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

TypesofVisualisation

• Datavisualisationscangenerallybesplitintotwomaincategories:

Exploratory Explanatory

‘Explore’yourdata ‘Explain’yourfindings

Provideaway toexamineyourdatafromdifferentviewpointsorwithdifferentfilters.

You’vefoundtheinterestingpointsinthedata,nowyouwant toexplainorcommunicatethemtoothers

Generallyallowsthereadertodrivetheexperience:Letthemgainasenseofwhatthedataisaboutandwhatitissaying,sothatyou/theycanfindtheinterestingpoints.

Generally‘author-driven’: yourmainfocusisontellingthestorythatyou’vefound,soyouwantto presentitasclearlyaspossible.

Page 18: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

ExploratoryVisualisation– Wherecanyouaffordtolive?

http://www.bbc.co.uk/news/business-23234033

Page 19: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

ExplanatoryVisualisation

http://wheredoesmymoneygo.org/bubbletree-map.html#/~/total

Page 20: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Storytelling

Page 21: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the
Page 22: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Humanshavebeentellingstoriesforcenturies…

https://annadoherty.wordpress.com/2012/10/06/history-of-animation-cave-paintings/

Page 23: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Storytellingwithdatavisualisation

• Storytelling:“Theconveyingofeventsinwords,soundand/orimages,oftenbyimprovisationorembellishment.”(Wikipedia)

• Recallthattheaimofvisualisationistoeffectivelyconveysomeinformationfromdata.• Youwantdecisionmakerstobeabletoseetheresults ofyouranalysis.• Theseshouldbeconveyedinamannerthatissuitablefortheintendedaudiencetounderstand.

Page 24: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Considerationsforthestory

• ClaudiacoveredtheseabitonMonday

• Whoareyouraudience?• Whatisthestory?• Whatdoyouwantpeopletodoafterseeingyourvisualisation?

Page 25: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

1.Youraudience

•Whatpriorknowledgedotheyposses?• Aretheyexpertsinthefield?Orgeneralpublic?

•Howmuchtime dotheyhave?•Willtheybeabletoexplorethevisualisationindepth,orjustglanceatit?

•Whatformat aretheycomfortabledigestinginformation?• Charts?Infographics?Interaction?

25

Page 26: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

2.Thestory

•Whatisitthatthedatashows?•Whatisyourkeyresult?Themessage.• Notthedataitself.• Northemethod.Theresult.

•Thestoryisvital– thisiswhatyouwillbe‘telling’inyourvisualisation.•Whydoyouwantpeopletolookatyourvisualisation?

26

Page 27: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

2.Thestory(2)

•Youreallyhavetoknowthestoryyourselfinorderto‘sellit’.• “Simplify,thenexaggerate”.• GeoffreyCrowther,TheEconomist• ReferringtojournalismtechniquesthathavebeenfollowedatTheEconomistsincethe1950s

• Important:thisdoesnotmeanlying!

27

Page 28: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

3.Theaction

•Whatdoyouwantpeopletodo afterwards?• Thisdependsontheaudience,andcontext.

•Changebehaviour?• E.g.,• Implementanewpolicy• Allocateresources• Campaignforchange• Changeeatinghabits• ...

28

Page 29: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Structuringyourstory:author- orreader-driven?

• Thetypeofstorywilldeterminethetypeofvisualisationyouneedtocreate.• Explanatoryvisualisationsaretypically‘author-driven’.• Anauthor-drivenstoryhasalinearordering,whichyouwalkthereaderthrough,withlittleornointeractivity.

• Exploratoryvisualisationsaremorelikelytobe‘reader-driven’.• Forreader-drivenstories,thereisnoprescribedorderingtothecontent,allowingthereadertointeractandfindtheirownstory.

Page 30: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Balancingauthor- andreader-drivenstories

• Asacompromisebetweenthetwoapproaches,wecanmergethemboth1. Initialauthor-drivensequence,thatopensupintoaninteractive

narrativeforexploration.

Oftendescribedasthe‘martiniglass’.

Page 31: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Balancingauthor- andreader-drivenstories

• Asacompromisebetweenthetwoapproaches,wecanmergethemboth2. Author-drivensequencewithinteractionallowed‘mid-narrative’– user

canexploreaparticularpointmorebeforemovingahead.

Oftendescribedasthe‘interactiveslideshow’.

Page 32: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Balancingauthor- andreader-drivenstories

• Asacompromisebetweenthetwoapproaches,wecanmergethemboth3. Generalthemepresentedallowingreader-driveninteraction,butthey

canthenchooseparticularelementstorevealadditionalauthor-drivendetails.

Oftendescribedasthe‘drill-downstory’.

Page 33: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Findinga‘compelling’narrative

•Thenarrativeshouldlinkthefactsthatyou’vefoundtogetherinanengaging way.• Ifyoucan’tfindanarrativestructure,thenyourfindingsmaynotbeasgoodasyouthink• Oryourdatamaybemoresuitedtoanexploratorydataanalysis(reader-driven) styleofvisualisation,lettingtheviewerfindtheirownstory.

33

https://hbr.org/2013/04/how-to-tell-a-story-with-data/

Page 34: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Communicatingyourmessage

•Twomaintechniquesforensuringyoueffectivelyconveyyourstory:•Highlightandemphasise• Showtheimportantinformationthatiskeytothestory,withoutdistractions.

•Organise• Structureinformationtheclearlyguidereaderstoproducethemostunderstanding.

Page 35: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Structurewithoutastory

35

https://contently.com/strategist/2015/11/25/why-good-infographics-are-more-than-just-pictures-and-numbers/

Page 36: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

HighlightingandEmphasisingTufte’s theoriesonchartjunk

Page 37: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Emphasisingkeyinformationforthemind(1)

• Makinganeffectivegraphiciseasierifweknowhowthemindworks• Asanexample,lookatthisimageandseehowmany‘3’sthereare:

198356425378452384684796121263489654231986354871315546821357912349876543212345

Page 38: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Emphasisingkeyinformationforthemind(2)

• Wecanmakeitaloteasiertoperceivebychangingthingsslightly

• Shadevariations=>Easytoperceive• Shapevariations=>Difficulttoperceive

1983 564253 784523 84684796121263 48965423 19863 548713 155468213 579123 49876543 2123 45

Page 39: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Chartjunk

•Chartjunk,accordingtoTufte,isanythingthatcanberemovedfromachartwithoutchangingitsmeaning• Itobscuresthetruemeaningandstory• Imageryisnotinformation• Imagerydrawsattentionawayfromdata• Short-termmemoryresourcesareusedtoidentifytheimagesratherthanunderstandthechart’smeaning

Page 40: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Chartjunk Example

0

1000

2000

3000

4000

5000

6000

Year 1 Year 2 Year 3 Year 4 Year 5

Number of customers

Number of customers

Necessary?

Necessary?

Necessary?

Page 41: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Chartjunk Example- Fixed

0

1000

2000

3000

4000

5000

6000

Year 1 Year 2 Year 3 Year 4 Year 5

Number of customers

Page 42: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the
Page 43: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Let’sfixthishorribleexample(2)

43

https://datavizblog.com/category/chartjunk/

‘Wedges’oftimeaddnothing–they’renotevenproportionallysized!

Pencils…they’renotdata

Whosearmisthis?!

Isthissayingsomeoneisworkinglateatnight,orontheircoffeebreak?

Page 44: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

0 10 20 30 40 50 60 70 80

FreeTimeandRest

Sportsand/orHobby

TimeWithFriends

TimewithFamily

Community&VolunteerWork

FurtherEducation

Nothing

%ofentrepreneurs

Whatentrepreneurssacrificedtostarttheirbusiness

44

Afterremovingallthe‘junk’andkeepingonlythe‘data’,weget:

Thegraphicwemadeissimple,butwillitreallyinterestpeople?Willtheyrememberit?

Page 45: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

TheBeautyParadox

• Howcomplexshouldagraphicbe?• Howmuchshouldyoushow?

• Tufte emphasisesminimalism• Communicateasmuchinformationfromasfewpixelsaspossible

• Dependingontheaudience,thismayormaynotbethebestapproach• Whencreatingavisualisation,youmustbalancetheneedtofocusonthestoryofthedata,withartanddesigndecisionstohelpyouraudienceengagewithandrememberthevisual.

Page 46: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

OrganisingandStructuringInformationVisualperceptionandgestalttheory

Page 47: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Howisdatadisplayed?

• Weturndataintoagraphicalrepresentationusing‘visualencodings’• Dependingonthetype ofdatayouhave,differentencodingswillbesuitable• E.g.ordereddata(discreteorcontinuous):• Size – thelargerthecircle,themoreofsomething• Orientation/rotation• Colour (saturation)

• E.g.nominaldata(categories):• Colour (hue)

• RedcirclestorepresentManchesterUnitedsupporters• BluecirclestorepresentChelseasupporters

Page 48: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Ordereddata

SIZE ORIENTATION / ROTATION COLOUR

Page 49: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Unordereddata

ResultingDisappointment

PriorOptimism

DifferencesinEnglandandWalessupporters’feelingsbeforeandafterEuro2016

Page 50: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Unordereddata

ResultingDisappointment

PriorOptimism

DifferencesinEnglandandWalessupporters’feelingsbeforeandafterEuro2016

Walessupporters

Englandsupporters

Page 51: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

RankingVisualEncodings

• In1985,ClevelandandMcGillpublishedintheJournaloftheAmericanStatisticalAssociation

• ‘GraphicalPerceptionandGraphicalMethodsforAnalyzing ScientificData’

• Theyproposedbasicguidelinesforchoosinganappropriategraphicform(oranappropriateencoding)

• Thepaperlistsandranks10‘elementaryperceptualtasks’

Page 52: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

ClevelandandMcGill

• Rankofgraphicpropertiesbasedonhumanabilitytounderstandinformation• Theseareparticularlyrelevantfordetectingdifferencesandmakingcomparisons• Positionalongacommonscale• Positiononidenticalbutnonalignedscales• Length• Angle,slope• Area• Volume,density,coloursaturation• Colourhue

• Foraccuratecomparisons,graphicalformsfromthetopofthislistshouldbeused.

Page 53: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

ChoosingaGraphicforVisualPerception

53

• Question:• Foraprecisecomparison,whichtypeofchartwouldbemostaccurate?

• Barchart?• Bubblechart?• Heatmap?

Page 54: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

ClevelandandMcGill- Example

0

0.5

1

1.5

2

2.5

3

3.5

0 0.2 0.4 0.6 0.8

0 0.2 0.4 0.6 0.8

ItiseasierforhumanstoperceivethedifferencesthevaluesforX=0.2andX=0.4usingpositionalongacommonscale(onthescatterplot),thanbyusingarea(inthebubblechart).

Page 55: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

ChoosingaGraphicforVisualPerception

55

• Whenprecisionislessimportant,lowerrankedvisualformscanbeusedwell• E.g.,spottinglargerpatterns

Butreallydifficulttocomparetwosimilarareas!

Page 56: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

56

Modernversion:https://en.wikipedia.org/wiki/Charles_Joseph_Minard#/media/File:Minard_map_of_napoleon.png

Howmanydimensionscanyoufindbeingrepresentedonthismap?

Page 57: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

PatternRecognition

• Aswellastheencodingused,human’salsoperceiveinformationbasedonhowitisorganised• AccordingtoGestaltTheory,thebrainandvisualsystemfollowanumberofprinciplesforperceptualorganisation• Howthebraingroupselementsinto‘patterns’

• ThisemergedasaschoolofthoughtfromGermanpsychologistsin1930s/40s

Page 58: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

GestaltTheory:PrinciplesofOrganisation

• Proximity– objectsthatarecloseareperceivedtobenaturalgroups

580

1

2

3

4

5

6

Page 59: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

GestaltTheory:PrinciplesofOrganisation(2)

• Similarity– identicalorsimilarobjectsbelongtoagroup

590

1

2

3

4

5

6

Page 60: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

GestaltTheory:PrinciplesofOrganisation(4)

• Connectedness– linkingusingalineorsimilar

60

Page 61: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

GestaltTheory:PrinciplesofOrganisation(5)

• Continuity:Smoothcontoursareeasiertoperceivethansharpangles

61

Person1 Person2 Person3 Person1 Person2 Person3

Page 62: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

GestaltTheory:PrinciplesofOrganisation(6)

• Closure:boundedareasindicateagrouping

6200.51

1.52

2.53

3.54

4.55

Page 63: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

GestaltTheory:TakeawayMessage

• Graphicscanbemademorefunctionalusingsimpletechniquesaroundorganisationandlayoutofcomponents• Conversely,notusingGestaltprinciplescorrectlymightmisleadusersastheywillmakewrongassumptionsaboutthecomponentsyoudisplay

63

Page 64: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Deceivingyourbrain

• Aswefindoutmoreabouthowthebrainworks,andhowitmakesassumptionsaboutwhatitalreadyknows,wecanlearnhowtolietoit• Ormoreimportantly,howtoavoidlyingtoit

• E.g.Whatdoyousee?

Page 65: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Whosawawhitesquareoverfourblackcircles?

65

Page 66: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

YourBrainisDeceivingYou!

• Thereisnowhitesquare.• Removethe4‘pacman’shapes,andthereisnothingthere!

• Yourbrainismakingassumptionsbasedonwhatitknowsabouttheworldalready• “Emptyareas”don’texist

• Thebrain‘perceives’morethanwhattheretinasinyoureyesactuallysee

66

Page 67: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

67

http://thebrainbank.org.uk/wp-content/uploads/2012/08/Ponzo_illusion.gif

Whichyellowlineislonger?

Page 68: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

68

http://thebrainbank.org.uk/wp-content/uploads/2012/08/Ponzo_illusion.gif

Whichyellowlineislonger?(2)

Page 69: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Don’tstretchthetruth!Tufte’s LieFactor

Page 70: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Warning!Thefollowingslidescontaindetailsonhowtodo“bad”things.Usethisknowledgeforgood,andavoidthesemistakes!

“Withgreatpowercomesgreatresponsibility”

Page 71: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

BeObjective

• Tufte createdaformulatocalculatethe‘liefactor’orhow‘misleading’agraphicis

• Liefactor=

• whereEffectSize =

• Areliablegraphicshouldbebetween0.95and1.05.

EffectSizeInGraphic / EffectSizeInData

(value2− value1) / value1

Page 72: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

LieFactor:AnExample

10200

10400

10600

10800

11000

11200

11400

11600

11800

12000

CandidateA CandidateB

Votes

• ThissuggeststhatAreceivedaroundthreetimesasmanyvotesasB.

Page 73: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

LieFactor:AnExample

10200

10400

10600

10800

11000

11200

11400

11600

11800

12000

CandidateA CandidateB

Votes

• ThissuggeststhatAreceivedaroundthreetimesasmanyvotesasB.

Page 74: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

LieFactor:AnExample

0

2000

4000

6000

8000

10000

12000

14000

CandidateA CandidateB

Votes • Inreality,thingsaremuchcloser.

• Theactualvaluessuggestaround11,750forA,and10,800forB– About13.2%difference

• Theoriginalgraphhowever,makesthedifferenceseem61.3%betweenthetwovalues

• 0.613/0.132=4.64

• Theoriginalchartthereforehadahighliefactorandisoverstatingtheeffect.– Wellover1.05!

Page 75: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Piecharts+3Dareparticularlybad

• Tocommunicateamessageclearlyandeffectively.• Agraphorchartshouldclarifywhatnumbersinatablearesaying.• 3DdoesNOThelpwiththis.

75

VotesABCDEF

Page 76: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Piecharts+3Dareparticularlybad

• Tocommunicateamessageclearlyandeffectively.• Agraphorchartshouldclarifywhatnumbersinatablearesaying.• 3DdoesNOThelpwiththis.

76

VotesABCDEF

VotesABCDEF

Party VotesA 60B 195C 60D 78E 265F 80

Page 77: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Whatmakesavisualisationa‘bad’visualisation?

Page 78: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

78

EXERCISEInpairs

Discusswhetheryouthinkthevisualisationisgoodorbad?

Why?Whatisthestorythatitistryingtotell?

Whatwouldyouchangeinordertoenhancethestory?

Page 79: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

79http://www.businessinsider.com/gun-deaths-in-florida-increased-with-stand-your-ground-2014-2?IR=T

The“fixed”version…

Page 80: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

80https://rstudio-pubs-static.s3.amazonaws.com/70948_b5daeeeecf824047b580c1a101407a98.html

Let’sfindallthethingswrongaboutthisvisualisation

Page 81: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

81

• Whatproblemdoesthissolve?• Isthisthebestwaytodisplaytheinformation?• Doeseverything addvalue?• Arethereclearlabels?

Page 82: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

82

ThankstoThierryDriver(Tableau)forthisexample

Titleisclearandaddressesthequestion

Barchartsallowforaclearercomparisonofvalues

Labelsaresimplerandmoreconsistent

Sortingofbarsaddsanothervisualisationelement

Page 83: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

DataVisTechnologies

Page 84: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Webtechnologiesandtheirroleinvisualisations

• Evenifyou’reusingahigh-level,onlinetoolthathandlesthecodeforyou,itispertinenttounderstandtheunderlyingtechnologiesoftheWeb.• Thesewillbe‘manipulated’tocreatemanytypesofgraphics.• Coveringthesetechnologiesindepthisnotthefocusofthecourse.Thefollowingisa(very)briefintroduction.

84

Page 85: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

85Imagefromhttp://blog.teamtreehouse.com/wp-content/uploads/2014/11/progressive-enhancement.png

Page 86: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Hypertext

• Hypertext:textwhichcontainslinkstoothertexts.• HTML(HypertextMarkup Language)• AlanguagethatdefinesthebasicstructureandcontentofaWebpageusingmarkup ‘tags’.• Eachtagdescribesadifferenttypeofcontent• E.g.,• <html></html>Foranhtmlpage• <body></body>Forthebodyofanhtmlpage• <p></p> Aparagraph• <ahref=“www.bbc.co.uk”>TheBBC</a>AlinktotheBBC

• ReadbyaWebBbrowser,whichdecideshowtodisplaythecontent.

86

Page 87: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

CSS(CascadingStyleSheets)

• DefinethedesignandpresentationofanHTMLdocument.• TellstheWebbrowsermoreinformationaboutthelookandfeelofeachHTMLelement– howshoulditbedisplayedonthescreen?• E.g.,

p{font-family:“TimesNewRoman”;color:blue;font-size:12px;

}

“MakeallparagraphsuseTimesNewRomanfont,size12,andcolourthetextblue.”

87

Page 88: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Javascript

• ThethirdessentialtechnologybehindtheWWW.• TheprogramminglanguageoftheWeb.• Programsthe‘behaviour’oftheWebpage.• Client-sidelanguage(runsontheuser’smachine,notontheserver).• Definehowapageshouldbehavewhenthereisauserevent(e.g.,clickingonsomething),

88

Page 89: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Javascript withHTML

• WhenthebrowserdisplaysanHTMLpageitcreatesahierarchicalstructureoftheHTMLelements.• ThisiscalledtheDocumentObjectModel(DOM).

• Javascript canaccessthissothatitcanchangespecificstylesofparticularelements• TheinteractionwiththeDOMiskeytohowD3 isusedtomakevisualisations.

89

Page 90: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

D3.js(Data-DrivenDocuments)

• Javascript library(“.js”).• BasedonstandardWebtechnologies.• UsesHTML,SVG,andCSStocreatevisualisationsfromdata.• Drives theconnectionbetweendata (providedbyuser)anddocuments(renderedbytheWebbrowser).

90

Page 91: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Generalsteps

• Loadingthedataintobrowser’smemory.• Bindingthedatatoelementswithinthedocument.• Transformingelementsbysettingvisualpropertiesbasedonthebounddata.• Transitioningelementsbetweenstates• Responsetouserinput.

91

Page 92: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

D3

• DynamicallyaccesstheDOMbehindawebpagetoapplystyles• DOM:• DocumentObjectModel• HierarchicalStructureofHTMLelements• Allowsthingslike• d3.select(“body”).append(“p”).text(“NewParagraph”);

92

Page 93: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

D3:ChainSyntax

• Using“.”stochainmethodstogether• Performseveralactionsinasinglelineofcode• Fastandeasy,butcancausedebuggingproblemslater• Javascript doesn’tcareaboutwhitespaceorlinebreaks• d3.select(“body”)

.append(“p”)

.text(“NewParagraph”);

93

Page 94: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

D3:ChainSyntax

• d3.select(“body”).append(“p”).text(“NewParagraph”);• Firstpasses‘select’aCSSselector– “body”,returningthefirstelementinDOMthatmatches.• ThencreatesanewDOMelement“p”andappendsittotheendofthepreviouslyselectedelement.Soaparagraphisappendedtothebodyelementofthedocumentinthiscase.Thenewelementispassedoninthechain.• Tothethetext()functionwhichtakesastringandinsertsitintothecurrentlyselectedelement(the“p”elementasthiswaspassedfromappend).

94

Page 95: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

D3Example• http://d3.artzub.com/wbca/• InteractivevisualisationofWorldBankcontracts

95

Page 96: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Tableau

• Forthehands-onsessionafterlunchwewilluseTableau• Draganddropvisualanalyticspackage• Connecttodatafrommultiplesourceswithoutanycode• Quicklybuildvisualstoexplorethedataandspottrends• Thecreatedashboardsandstoriestopresentyourdataandtellcompellingnarratives

• Thereisalicensekeyforyoualltouse,andyoucanuseTableaufortherestoftheweekinyourprojects• Or,ifyouwanttouseD3thereareawiderangeoftutorialsavailableonline

Page 97: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

TableauPublic

• TableauDesktopletsyoupublishyourworkbookto‘TableauPublic’• Hereyoucanbeaddedtotheirgalleryofprojects,withyourvisualisations hostedliveonline• Remainconnectedtothedatasotheyarefullyinteractive• WorkexactlyastheydoinTD• Cancreatecompellingdatastoriesandsharethemwithyouraudiencesimplyandeasily

Page 98: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

Summary

• Thepointofdatavisualisationistocommunicatewhatisimportantinyourdata,clearlyandeffectively• Youmayhaveaparticularstorytotell,oritmaybethatyouwanteachreadertofindtheirownstoryinthedata• Regardless,youwanttohighlightthekeyelementsofthedata,andnotdistractthereaderwithchartjunk orunnecessary‘art’• Wecanuseknowledgeabouthowthebrainworkstoorganisecontentonthepage/screeneffectivelytoenhanceunderstanding• Agoodvisualisationshouldnotlie.• Thereareahugerangeofvisualisationtechnologies.D3ispopularforcodingthem.Tableauisapopularhigh-leveldesktoptool.

Page 99: ESWC Summer School 2016 Understanding and …translectures.videolectures.net/site/normal_dl/tag=1064664/eswc2016_phethean...• Depending on the audience, this may or may not be the

FurtherReading

• Tufte,Edward.“TheVisualDisplayofQuantitativeInformation”2ndEdition• Cleveland,WilliamS.,andRobertMcGill."Graphicalperceptionandgraphicalmethodsforanalyzing scientificdata."Science 229.4716(1985):828-833.• Murray,Scott.InteractivedatavisualizationfortheWeb."O'ReillyMedia,Inc.",2013.• D3Tutorialssuchashttps://www.dashingd3js.com/table-of-contents• TheD3galleryforadaptableexamples:• https://github.com/mbostock/d3/wiki/Gallery

• Cairo,Alberto.TheFunctionalArt:Anintroductiontoinformationgraphicsandvisualization.NewRiders,2012

99