23
Big Data’s Long Tail Carly Strasser, John Kunze, Trisha Cruse University of California Curation Center, California Digital Library 10 December 2012 From Flickr by rahen z

Big Data's Long Tail

Embed Size (px)

DESCRIPTION

 

Citation preview

Page 1: Big Data's Long Tail

Big Data’s Long Tail

Carly Strasser, John Kunze,Trisha Cruse

University of California Curation Center, California Digital Library

10 December 2012

From Flickr by rahen z

Page 2: Big Data's Long Tail

The Long Tail

Size of dataset

# datasets

Page 3: Big Data's Long Tail

The Long Tail

Size of dataset

# researchers# datasets

Page 4: Big Data's Long Tail

The Long Tail

Size of dataset

# researchers# datasets

# grants

Page 5: Big Data's Long Tail

The Long Tail

Size of dataset

# researchers# datasets

# grants

grant ($)

Page 6: Big Data's Long Tail

The Long Tail

Size of dataset

# researchers# datasets

# grants

grant ($)

With data managers

and fancy tools

Do-it-yourself tools

Page 7: Big Data's Long Tail

From Flickr By puck90

UGLY TRUTH

Many researchers…are not taught data management

don’t know what metadata are

can’t name data centers or repositories

don’t share data publicly or store it in an archive

aren’t convinced they should share data

Page 8: Big Data's Long Tail

Intercept researchers where they already

work

Page 9: Big Data's Long Tail
Page 10: Big Data's Long Tail

Facilitate

Archiving

Sharing

Publishing

Data management

& organization

Data re-use & reproducibility

DataUp: the vision

Page 11: Big Data's Long Tail

Open Source Tool Add-in & Web

Application

Earth, Environmental,

& Ecological Researchers

?

Page 12: Big Data's Long Tail

Add-in • Download and install• Appears as “ribbon” in Excel• Windows Excel 2007+

Web-based application • Website that does something

with user’s files• New user interface• Any platform/spreadsheet

software?

Page 13: Big Data's Long Tail

FeaturesBest practices checkGenerate metadataGenerate citation

Post data to repository

Requirements

SENT TO MSRReleased Sept

4, 2012

Page 14: Big Data's Long Tail

Best Practices Check

Page 15: Big Data's Long Tail

Best Practices Check

Page 16: Big Data's Long Tail

Generate Metadata

Page 17: Big Data's Long Tail

17

Attribute Metadata

Page 18: Big Data's Long Tail

Create Data Citation

Page 19: Big Data's Long Tail

Create Data Citation: Get Identifier

ask CDL’s Merritt

repository for id

... which asks EZID for an id

Page 20: Big Data's Long Tail

Upload to a Repository

Tip: you can also choose a practice repository

Page 21: Big Data's Long Tail

The long tail of the long tail

A data repository for

AnyoneAnywhere

Page 22: Big Data's Long Tail

Build community

Add repositories

Add metadata schema

From

ani

mati

onre

sour

ces.

org

ONEShare, Merritt, UCSB,

Dryad, etc.

NSF DataNet, INTEROP, etc.