74
made available by Paul Keller under a CC-BY-2.0 license Thursday, 14 July 2011

"Data in the Digital Age" - Hadoop Big Data Meetup

Embed Size (px)

DESCRIPTION

 

Citation preview

Page 1: "Data in the Digital Age" - Hadoop Big Data Meetup

made available by Paul Keller under a CC-BY-2.0 license

Thursday, 14 July 2011

Page 2: "Data in the Digital Age" - Hadoop Big Data Meetup

made available by Paul Keller under a CC-BY-2.0 license

well .. sort of.

Thursday, 14 July 2011

Page 3: "Data in the Digital Age" - Hadoop Big Data Meetup

data in the digital age

kaitlin thaneyaustin big data user group, 13 july 2011

austin, texas

Thursday, 14 July 2011

Page 4: "Data in the Digital Age" - Hadoop Big Data Meetup

xi. background

Thursday, 14 July 2011

Page 5: "Data in the Digital Age" - Hadoop Big Data Meetup

about me

about me

sameAs

expattechnologistopen science

Thursday, 14 July 2011

Page 6: "Data in the Digital Age" - Hadoop Big Data Meetup

Thursday, 14 July 2011

Page 7: "Data in the Digital Age" - Hadoop Big Data Meetup

technology companypublisher link

london, nyc, tokyo

Thursday, 14 July 2011

Page 8: "Data in the Digital Age" - Hadoop Big Data Meetup

investment armincubator rolein-house dev

Thursday, 14 July 2011

Page 9: "Data in the Digital Age" - Hadoop Big Data Meetup

tiered approachbuild to scale

researcher-focused

Thursday, 14 July 2011

Page 10: "Data in the Digital Age" - Hadoop Big Data Meetup

<text>

Thursday, 14 July 2011

Page 11: "Data in the Digital Age" - Hadoop Big Data Meetup

about

1815

Thursday, 14 July 2011

Page 12: "Data in the Digital Age" - Hadoop Big Data Meetup

first geological map“strata”

reputation

Thursday, 14 July 2011

Page 13: "Data in the Digital Age" - Hadoop Big Data Meetup

data ... metadata / markup

experimentationmetrics

Thursday, 14 July 2011

Page 14: "Data in the Digital Age" - Hadoop Big Data Meetup

1. science is changing

Thursday, 14 July 2011

Page 15: "Data in the Digital Age" - Hadoop Big Data Meetup

1. science is changing(and the research workflow)

Thursday, 14 July 2011

Page 16: "Data in the Digital Age" - Hadoop Big Data Meetup

research

idea

experiment

lit review

materials

publish

share results

retestanalyze

collect data

Thursday, 14 July 2011

Page 17: "Data in the Digital Age" - Hadoop Big Data Meetup

blocking points

idea

experiment

lit review

materials

publish

share results

retestanalyze

collect data

(to name a few ... )

Thursday, 14 July 2011

Page 18: "Data in the Digital Age" - Hadoop Big Data Meetup

types of information

idea

protocolsparameters

content

the non-digital “stuff”

articlesproceedings

share results

retestanalysissynthesis

datasets

(will revisit later)

prof activitiesmentorship

patents

Thursday, 14 July 2011

Page 19: "Data in the Digital Age" - Hadoop Big Data Meetup

text texttext

Thursday, 14 July 2011

Page 20: "Data in the Digital Age" - Hadoop Big Data Meetup

Thursday, 14 July 2011

Page 21: "Data in the Digital Age" - Hadoop Big Data Meetup

remaining roadblocksspecialisation of tools (+/-)

interoperabilityaccessibility

design decisionsthe “social issue”

Thursday, 14 July 2011

Page 22: "Data in the Digital Age" - Hadoop Big Data Meetup

2. focus areas

Thursday, 14 July 2011

Page 23: "Data in the Digital Age" - Hadoop Big Data Meetup

(3)

Thursday, 14 July 2011

Page 24: "Data in the Digital Age" - Hadoop Big Data Meetup

knowledge discovery

software applications

research management

Thursday, 14 July 2011

Page 25: "Data in the Digital Age" - Hadoop Big Data Meetup

knowledge discovery

software applications

research management

Thursday, 14 July 2011

Page 26: "Data in the Digital Age" - Hadoop Big Data Meetup

data ...content, compounds,

collections

Thursday, 14 July 2011

Page 27: "Data in the Digital Age" - Hadoop Big Data Meetup

Thursday, 14 July 2011

Page 28: "Data in the Digital Age" - Hadoop Big Data Meetup

Thursday, 14 July 2011

Page 29: "Data in the Digital Age" - Hadoop Big Data Meetup

Thursday, 14 July 2011

Page 30: "Data in the Digital Age" - Hadoop Big Data Meetup

Thursday, 14 July 2011

Page 31: "Data in the Digital Age" - Hadoop Big Data Meetup

Thursday, 14 July 2011

Page 32: "Data in the Digital Age" - Hadoop Big Data Meetup

Thursday, 14 July 2011

Page 33: "Data in the Digital Age" - Hadoop Big Data Meetup

Thursday, 14 July 2011

Page 34: "Data in the Digital Age" - Hadoop Big Data Meetup

text texttext

Thursday, 14 July 2011

Page 35: "Data in the Digital Age" - Hadoop Big Data Meetup

can fine-tune

Thursday, 14 July 2011

Page 36: "Data in the Digital Age" - Hadoop Big Data Meetup

name disambiguation

Thursday, 14 July 2011

Page 37: "Data in the Digital Age" - Hadoop Big Data Meetup

10,11-dihydro-5-methyl-5H-dibenzo[b,e][1,4]diazepin-11-one

Thursday, 14 July 2011

Page 38: "Data in the Digital Age" - Hadoop Big Data Meetup

knowledge discovery

software applications

research management

Thursday, 14 July 2011

Page 39: "Data in the Digital Age" - Hadoop Big Data Meetup

gigabytes, not terabytes

Thursday, 14 July 2011

Page 40: "Data in the Digital Age" - Hadoop Big Data Meetup

CC-BY-2.0 - Plaxco Lab - http://www.flickr.com/photos/34857812@N04/

Thursday, 14 July 2011

Page 41: "Data in the Digital Age" - Hadoop Big Data Meetup

Thursday, 14 July 2011

Page 42: "Data in the Digital Age" - Hadoop Big Data Meetup

better trackingis needed

Thursday, 14 July 2011

Page 43: "Data in the Digital Age" - Hadoop Big Data Meetup

the non-digital

+ordering

processing

Thursday, 14 July 2011

Page 44: "Data in the Digital Age" - Hadoop Big Data Meetup

protocols parameterscalibrationliterature

Thursday, 14 July 2011

Page 45: "Data in the Digital Age" - Hadoop Big Data Meetup

parameters

the non-digital

Thursday, 14 July 2011

Page 46: "Data in the Digital Age" - Hadoop Big Data Meetup

about

the non-digital

Thursday, 14 July 2011

Page 47: "Data in the Digital Age" - Hadoop Big Data Meetup

not just tracking, but organisation +

analysis

Thursday, 14 July 2011

Page 48: "Data in the Digital Age" - Hadoop Big Data Meetup

Thursday, 14 July 2011

Page 49: "Data in the Digital Age" - Hadoop Big Data Meetup

000s100s200s300s400s500s600s

Thursday, 14 July 2011

Page 50: "Data in the Digital Age" - Hadoop Big Data Meetup

000s100s200s300s400s500s600s

... philosophy/psychreligionsocial sci...lang, natsci, mathstech/appliedsci

Thursday, 14 July 2011

Page 51: "Data in the Digital Age" - Hadoop Big Data Meetup

000s100s200s300s400s500s600s

computersciphilosophy/psychreligionsocial sci...lang, natsci, mathstech/appliedsci

problems

Thursday, 14 July 2011

Page 52: "Data in the Digital Age" - Hadoop Big Data Meetup

spatial, topical mappingarbitrary, heuristic

difficult to edit

Thursday, 14 July 2011

Page 53: "Data in the Digital Age" - Hadoop Big Data Meetup

Thursday, 14 July 2011

Page 54: "Data in the Digital Age" - Hadoop Big Data Meetup

Thursday, 14 July 2011

Page 55: "Data in the Digital Age" - Hadoop Big Data Meetup

Thursday, 14 July 2011

Page 56: "Data in the Digital Age" - Hadoop Big Data Meetup

Thursday, 14 July 2011

Page 57: "Data in the Digital Age" - Hadoop Big Data Meetup

knowledge discovery

software applications

research management

Thursday, 14 July 2011

Page 58: "Data in the Digital Age" - Hadoop Big Data Meetup

data capture(of a different sort)

Thursday, 14 July 2011

Page 59: "Data in the Digital Age" - Hadoop Big Data Meetup

tools for decision makers (research admin / funders)

using technology to spur cultural shift

Thursday, 14 July 2011

Page 60: "Data in the Digital Age" - Hadoop Big Data Meetup

existing system is imperfect

Thursday, 14 July 2011

Page 61: "Data in the Digital Age" - Hadoop Big Data Meetup

“Right now we're going through a Cambrian explosion of metrics.”

- Johan Bollen

Nature 465, 864-866 (2010) | doi:10.1038/465864a

Thursday, 14 July 2011

Page 62: "Data in the Digital Age" - Hadoop Big Data Meetup

citation / impact factorh - index

weighted citations (eigenfactor, sjr)“betweenness centrality”

alt-metrics, etc.

a wealth of mechanisms exist ...

Thursday, 14 July 2011

Page 63: "Data in the Digital Age" - Hadoop Big Data Meetup

challenges :harmonisation

track /maintainjudgement calls

external pressures

Thursday, 14 July 2011

Page 64: "Data in the Digital Age" - Hadoop Big Data Meetup

measurements still stuck in the paper

metaphor

Thursday, 14 July 2011

Page 65: "Data in the Digital Age" - Hadoop Big Data Meetup

what do we want on the back of our (science) baseball

cards?

“- paul groth (et al.)

UK folks, think Top Trumps

*

*

Thursday, 14 July 2011

Page 66: "Data in the Digital Age" - Hadoop Big Data Meetup

Thursday, 14 July 2011

Page 67: "Data in the Digital Age" - Hadoop Big Data Meetup

Thursday, 14 July 2011

Page 68: "Data in the Digital Age" - Hadoop Big Data Meetup

Thursday, 14 July 2011

Page 69: "Data in the Digital Age" - Hadoop Big Data Meetup

4. our goal

Thursday, 14 July 2011

Page 70: "Data in the Digital Age" - Hadoop Big Data Meetup

software that understands science

Thursday, 14 July 2011

Page 71: "Data in the Digital Age" - Hadoop Big Data Meetup

software that understands scientists

Thursday, 14 July 2011

Page 72: "Data in the Digital Age" - Hadoop Big Data Meetup

reflect changes in digital research

account for new “data”

Thursday, 14 July 2011

Page 73: "Data in the Digital Age" - Hadoop Big Data Meetup

more efficient researchincrease productivityaccelerate discovery

shift culture

Thursday, 14 July 2011