67
DLF Fall Forum October 31, 2011 Civil War Data150: Notes Toward a Linked Data Case Study Jon Voss Historypin Strategic Partnerships Director We Are What We Do @jonvoss Scott Nesbit Associate Director, Digital Scholarship Lab University of Richmond @csnesbit

Civil War Data 150 at DLF Fall Forum 2011

Embed Size (px)

Citation preview

Page 1: Civil War Data 150 at DLF Fall Forum 2011

DLF Fall ForumOctober 31, 2011

Civil War Data150: Notes Toward a Linked Data Case Study

Jon VossHistorypin Strategic Partnerships Director

We Are What We Do@jonvoss

Scott NesbitAssociate Director, Digital Scholarship LabUniversity of Richmond@csnesbit

Page 2: Civil War Data 150 at DLF Fall Forum 2011

1. Cultural Heritage in a Mashup Age

Page 3: Civil War Data 150 at DLF Fall Forum 2011
Page 4: Civil War Data 150 at DLF Fall Forum 2011

The DJ in the Library?

Page 5: Civil War Data 150 at DLF Fall Forum 2011

History & Mashup Culture

http://www.flickr.com/photos/37377809@N00/5304492185/in/pool-1633053@N21/

+

2010 National Archives Photo Contest

Page 6: Civil War Data 150 at DLF Fall Forum 2011

History & Mashup Culture

http://www.flickr.com/photos/37377809

Page 7: Civil War Data 150 at DLF Fall Forum 2011

2. Linked Open Data in

Libraries, Archives & Museums

Page 9: Civil War Data 150 at DLF Fall Forum 2011

Linking Open Data cloud diagram, by Richard Cyganiak and Anja Jentzsch. http://lod-cloud.net/

Page 10: Civil War Data 150 at DLF Fall Forum 2011
Page 11: Civil War Data 150 at DLF Fall Forum 2011

The LOD cloud as a whole grew by 300% in 2010

http://swib.org/swib11/

Page 12: Civil War Data 150 at DLF Fall Forum 2011

The LOD cloud as a whole grew by 300% in 2010

whereasthe amount of data

relevant for libraries grew by nearly

1000%http://swib.org/swib11/

Page 13: Civil War Data 150 at DLF Fall Forum 2011

Linked Open Datain

Libraries, Archive & MuseumsCulture

Technology

LawLODLAM

Page 14: Civil War Data 150 at DLF Fall Forum 2011

Join the LODLAM movement

• #lodlam

• http://lodlam.net proceedings online and on the road for the next year at various annual meetings and conferences

• http://groups.google.com/group/lod-lam

• Contribute!

Page 15: Civil War Data 150 at DLF Fall Forum 2011

3. A 2 minute or less primer:Tables to Graphs &

Triples

Page 16: Civil War Data 150 at DLF Fall Forum 2011

Going from Tables to Graphs

http://www.flickr.com/photos/thomasjwoods-com/2264301251

Page 17: Civil War Data 150 at DLF Fall Forum 2011

Going from Tables to Graphs

• nodes and links in a graph

Page 18: Civil War Data 150 at DLF Fall Forum 2011

Going from Tables to Graphs

• As computing power increases, the ability to build more and more complex graphs becomes a reality.

• Human vs. Machine readable

msulibraries lookbackmapsmsulibraries internetarchive

msulibraries librarycongress

lookbackmaps internetarchive

internetarchive librarycongress

Page 19: Civil War Data 150 at DLF Fall Forum 2011

Introducing Triples

jonvoss

Nodes & Links

Page 20: Civil War Data 150 at DLF Fall Forum 2011

Introducing Triples

jonvossfollows

Nodes & Links

Page 21: Civil War Data 150 at DLF Fall Forum 2011

Introducing Triples

jonvossfollows

csnesbit

Nodes & Links

Page 22: Civil War Data 150 at DLF Fall Forum 2011

Introducing Triples

• Quite simply: Subject, Predicate, Object

jonvossfollows

Nodes & Links

SILibrariescsnesbit

Page 23: Civil War Data 150 at DLF Fall Forum 2011

Introducing Triples

• Quite simply: Subject, Predicate, Object

• gives us the ability to describe entities in a way that is machine readable

jonvossfollows

Nodes & Links

SILibrariescsnesbit

Page 24: Civil War Data 150 at DLF Fall Forum 2011

Triples for machines

• triples can be serialized in many different ways, including Resource Description Framework, RDF/XML, RDFa, N3, Turtle, etc, but they all describe things in the <subject><predicate><object> format.

• of course, we need to be consistent and predictable for machines to understand us.

Page 25: Civil War Data 150 at DLF Fall Forum 2011

What do we know about the person: Ed Summers (aside from the fact that he

rocks)?

Bio: Hacker for libraries, digital archaeologist, pragmatist.

knows

knows

depiction of

bio

http://inkdroid.org/ehs.rdf

Page 26: Civil War Data 150 at DLF Fall Forum 2011

http://inkdroid.org/ehs.rdf

Page 27: Civil War Data 150 at DLF Fall Forum 2011

4. Civil War Data 150

Page 28: Civil War Data 150 at DLF Fall Forum 2011

http://civilwardata150.net

Page 29: Civil War Data 150 at DLF Fall Forum 2011

• Civil War vocabulary, or a way to link and traverse across datasets

• Regiments, Battles, Places

Page 30: Civil War Data 150 at DLF Fall Forum 2011

Primary Partners

Page 31: Civil War Data 150 at DLF Fall Forum 2011

Three Phase Project

Page 32: Civil War Data 150 at DLF Fall Forum 2011

Phase 1: Metadata collection

Licensing and publishing datasets

Page 35: Civil War Data 150 at DLF Fall Forum 2011

• http://creativecommons.org/licenses/

• http://www.opendatacommons.org/licenses/

CC BY

CC BY-SA

CC BY-ND

CC BY-NC

CC BY-NC-ND

CC BY-NC-SA

Open Data Published Data

CC0

Public Domain Mark

Public Domain Dedication and License (PDDL)

Attribution License (ODC-By)

Open Database License (ODC-ODbL)

Legal Tools

Page 36: Civil War Data 150 at DLF Fall Forum 2011

Phase 2: Vocabulary Alignment

Scripting or Human Judgement

Identifiying Battles, Regiments, Locations

Page 37: Civil War Data 150 at DLF Fall Forum 2011
Page 38: Civil War Data 150 at DLF Fall Forum 2011

Phase 3: Publishing/Visualizations

Page 39: Civil War Data 150 at DLF Fall Forum 2011

<rdf:RDF> <frbr:Work rdf:about="http://www.loc.gov/pictures/item/00651205/"> <dcterms:title> 7th N.Y. State Militia, Camp Cameron, D.C., 1861 </dcterms:title> <dcterms:subject rdf:resource=”http://www.perseus.tufts.edu/hopper/text?doc=Perseus%3Atext%3A2001.05.0146%3Achapter%3D30%3Aregiment%3DNY7StateMilitia”/> <dcterms:subject rdf:resource=”http://www.freebase.com/edit/topic/en/7th_new_york_militia”/> <dcterms:subject rdf:resource=”http://id.loc.gov/authorities/names/n97059093”/> <xhtml:license rdf:resource="https://creativecommons.org/publicdomain/"/> <cc:attributionName>Source: Library of Congress</cc:attributionName> </frbr:Work></rdf:RDF>

Page 40: Civil War Data 150 at DLF Fall Forum 2011
Page 41: Civil War Data 150 at DLF Fall Forum 2011
Page 42: Civil War Data 150 at DLF Fall Forum 2011
Page 43: Civil War Data 150 at DLF Fall Forum 2011

Why Humanists Should Like LOD

Visualizing Emancipation

Page 44: Civil War Data 150 at DLF Fall Forum 2011

Visualizing Emancipation

Why Humanists Should Like LOD

Page 45: Civil War Data 150 at DLF Fall Forum 2011

Visualizing Emancipation

Why Humanists Should Like LOD

Data Flows

Page 46: Civil War Data 150 at DLF Fall Forum 2011

Visualizing Emancipation

Why Humanists Should Like LOD

Data Flows

OfficialRecords

Page 47: Civil War Data 150 at DLF Fall Forum 2011

Visualizing Emancipation

Why Humanists Should Like LOD

Data Flows

OfficialRecords

Dyer’sCompendium

Page 48: Civil War Data 150 at DLF Fall Forum 2011

Visualizing Emancipation

Why Humanists Should Like LOD

Data Flows

OfficialRecords

Dyer’sCompendium

PerseusProject

Page 49: Civil War Data 150 at DLF Fall Forum 2011

Visualizing Emancipation

Why Humanists Should Like LOD

Data Flows

Page 50: Civil War Data 150 at DLF Fall Forum 2011

Why Humanists Should Like LOD

Page 51: Civil War Data 150 at DLF Fall Forum 2011

Visualizing Emancipation

Why Humanists Should Like LOD

Data Flows

ArmyRegimentLocations

XNew

Arguments+ =

Page 52: Civil War Data 150 at DLF Fall Forum 2011

Visualizing Emancipation

Why Humanists Should Like LOD

Data Flows

X Emancipationwhere: =

Page 53: Civil War Data 150 at DLF Fall Forum 2011

Visualizing Emancipation

Why Humanists Should Like LOD

Data Flows

“Early on Saturday morning last while off Point Lookout three negroes came to the ship in a canoe from the Virginia shore. They say they are free, but have no free papers, and assign as a reason for running away that they were required to fight. I have also on board two slaves taken from the Virginia shore by the late Commander J. Ward; they say they belong to Mrs. Stewart, a widow, residing near Mathias Point. I respectfully request instructions in relation to all these people.”

-Capt. S. C. Rowan, aboard the U.S.S. Pawnee, to Gideon Welles, Secretary of the Navy,

July 23, 1861

Page 54: Civil War Data 150 at DLF Fall Forum 2011

Visualizing Emancipation

Why Humanists Should Like LOD

Data Flows

Page 55: Civil War Data 150 at DLF Fall Forum 2011

Why Humanists Should Like LOD

Page 56: Civil War Data 150 at DLF Fall Forum 2011

CWD150

Why Humanists Should Like LOD

Data Flows

X U.S. Colored Troopswhere: =

Page 57: Civil War Data 150 at DLF Fall Forum 2011

CWD150

Why Humanists Should Like LOD

Data Flows

X Environmentwhere: =

Page 58: Civil War Data 150 at DLF Fall Forum 2011

CWD150

Why Humanists Should Like LOD

Data Flows

XSoldierHealth

where: =

Page 59: Civil War Data 150 at DLF Fall Forum 2011

CWD150

Why Humanists Should Like LOD

Data Flows

XSurvivalRates

where: =

Page 60: Civil War Data 150 at DLF Fall Forum 2011

CWD150

Why Humanists Should Like LOD

Data Flows

X Destructionwhere: =

Page 61: Civil War Data 150 at DLF Fall Forum 2011

CWD150

Why Humanists Should Like LOD

Data Flows

X Bushwhackingwhere: =

Page 62: Civil War Data 150 at DLF Fall Forum 2011

CWD150

Why Humanists Should Like LOD

Data Flows

X Railroadswhere: =

Page 63: Civil War Data 150 at DLF Fall Forum 2011

CWD150

Why Humanists Should Like LOD

Data Flows

X Riverswhere: =

Page 64: Civil War Data 150 at DLF Fall Forum 2011

CWD150

Why Humanists Should Like LOD

Data Flows

X Occupationswhere: =

Page 65: Civil War Data 150 at DLF Fall Forum 2011

CWD150

Why Humanists Should Like LOD

http://dsl.richmond.edu

Page 66: Civil War Data 150 at DLF Fall Forum 2011

Learn More at DLF:Linked Data: Hands on How-to

2-5pm Nov. 1 with

Kris Carpenter NegulescuRichard RogersMatt ZumwaltSusan Chun

Page 67: Civil War Data 150 at DLF Fall Forum 2011

DLF Fall ForumOctober 31, 2011

Civil War Data150: Notes Toward a Linked Data Case Study

http://civilwardata150.net

Jon VossHistorypin Strategic Partnerships Director

We Are What We Do@jonvoss

Scott NesbitAssociate Director, Digital Scholarship LabUniversity of Richmond@csnesbit