VRA 2014 Brave New World Cataloging, Harpring

Patricia Harpring Managing EditorPatricia Harpring, Managing EditorGetty Vocabulary Program

15 March 2014Patricia Harpring March 2014 Getty Vocabs as LOD For educational purposes. © J. Paul Getty Trust

Linked Data Linked Data› A set of best practices for publishing and connecting structured data on

the Web to enable the interlinking possibilities.› It builds upon standard Web technologies such as HTTP and URIs.› But, rather than using them to serve web pages for human readers, it

extends them to share information in a way that can be read automatically by computers.

Open data Open data › The idea that certain data should be freely available to everyone to use

and republish as they wish, without restrictions from copyright, patents or other mechanisms of control.

Linked Open Data (LOD)› A community project, sponsored by the Semantic Web Education and

Outreach group of the W3C, to extend the Web with a data commons by publishing various open datasets as RDF on the WEB and by setting y p g p y gRDF links between data items from different data sources.

› Both linked and open.Patricia Harpring , thanks to Joan Cobb March 2014 Getty Vocabs as LOD For educational purposes. © J. Paul Getty Trust

Li k d D t th W b Linked Documents on the Web› Connected by hypertext› Allows users to traverse via Web browsers› Data is made available in formats such as CSV XML or › Data is made available in formats such as CSV, XML, or

marked up as HTML tables Linked Data on the Web

› Connects data from diverse domains such as people › Connects data from diverse domains such as people, books, scientific publications, films, genes, drugs and clinical trials, online communities, statistical and scientific data.

› Enables new generation of search engines that follow the › Enables new generation of search engines that follow the links between data sources to deliver more complete answers as new data sources appear

› Operate on top of an unbound, global data space.› Uses the Web to create typed links between data from

different sources.Patricia Harpring , thanks to Joan Cobb March 2014 Getty Vocabs as LOD For educational purposes. © J. Paul Getty Trust

Semantic Web Linked Open Data (LOD) Resource Description Framework (RDF) LOD Ontologies & Vocabularies Uniform Resource Identifier (URI) Web Ontology Language (OWL) Simple Knowledge Organization System (SKOS) Triples and Triplestores Triples and Triplestores SPARQL Protocol RDF Query Language (SPARQL) Inference Inference Open World Assumption

Patricia Harpring , thanks to Joan Cobb March 2014 Getty Vocabs as LOD For educational purposes. © J. Paul Getty Trust

The process of deriving new information from the information l d hyou already have

› Simple and deterministic: If I know a rock weighs 1 kg. I can infer that the same rock weighs 2.2 lbs.

› Rule-based: If I know a person is under 16 and in California, I can infer that they are not allowed to drivethat they are not allowed to drive.

› Classification: If I know a company is in San Francisco or Seattle, I can classify it as a “west coast company.”

› Judgments: If I know a person’s height is 6 feet or more, I refer to them as tall.

› Online services: If I know a restaurant’s address, I can use a geocoder to find its coordinates on a map.

In the semantic web application, this often means creating new triples, based on logic applied to existing ones.

Monotonic Inference – if a statement is inferred from a set of axioms, adding an additional axiom cannot remove that inferred statement. To invalidate the inference would require at least one of the original axioms to be removed.


Patricia Harpring March 2014 Getty Vocabs as LOD For educational purposes. © J. Paul Getty Trust

AAT, the Art & Architecture Thesaurus®Generic terms for describing art, architecture, other material culture (e.g., oil paintings, Baroque, lithographers). Current totals: 5,500 records; 306,000 terms

• Getty Vocabularies are thesauri compliant with national (NISO) and international (ISO) standards for thesaurus construction

• Grow through contributions from the expert user community• Contributors and sources are cited



TGN, the Getty Thesaurus of yGeographic Names®Names, other information for current, historical administrative places and physical features (e.g., Firenze, Roman Empire, Ganges River) Current totals: 1 431 600; 2 038 000 namesGanges River). Current totals: 1,431,600; 2,038,000 names






ULAN, the Union List of Artist Names®Names, other information for artists, other people, corporate , , p p , pbodies related to art (e.g., Bartolo di Fredi, National Palace Museum). Current totals: 248,600 records; 642,900 names




AAT, the Art & Architecture Thesaurus®Generic terms for describing art, architecture, other material culture (e.g., oil paintings, Baroque, lithographers,sintering). Current totals: 5,500 records; 306,000 terms


ULAN, the Union List of Artist Names®Names, other information for artists, other people, corporate , , p p , pbodies related to art (e.g., Bartolo di Fredi, National Palace Museum). Current totals: 248,600 records; 642,900 names

CONA the Cultural Objects NameCONA, the Cultural Objects Name Authority®

Now accepting contributions. Includes titles, other information for moveable works and architecture (e ginformation for moveable works and architecture (e.g., Hagia Sophia, Mona Lisa, Fantastic Landscape with a Pavilion). Current totals: 5,500 records; 9,300 titles/names


Vocabularies contain critical features that

subject_id=500013247

features that them adaptable to linking:

Each vocabulary term_id=1500207490

Each vocabulary record is identified by a unique, persistent

i IDnumeric ID

Terms and controlled lists also each have

nat_code=905040

role id=31261also each have unique numeric IDs

role_id=31261

TGN subject id=7006827TGN subject_id 7006827

subject_id=500115332Patricia Harpring March 2014 Getty Vocabs as LOD For educational purposes. © J. Paul Getty Trustrel_type_code=1553

Relationships in the vocabularies are also relevant in linking

Th l l ti hi ( l f ULAN) Thesaural relationships (examples from ULAN)› Equivalence

Sèvres Porcelain Manufactory synonym for èManufacture nationale de Sèvres

› Hierarchical Sèvres Porcelain Manufactory is broader context for

l i h dEloy Brichard company› Associative

Sèvres Porcelain Manufactory was directed by R b t L i Ré 1832 1879 Robert, Louis-Rémy 1832-1879


Relationships beyond thesaural:

ULAN

› Conceptually linked prior to LOD› CONA has actual links

TGNTGNCONA Records

Source Records

AAT

IconographyAuthority


AAT, TGN, and ULAN have traditionally been licensed and released in various formats

Release formats

Online search form getty.edu/research/tools/vocabularies/index.html

Raw data files may be licensed from the Getty in Raw data files may be licensed from the Getty in relational tables and XML format and through Web services APIs

[I dditi t LOD l t ti idi [In addition to LOD, we plan to continue providing the data in relational tables and XML releases. If any format is discontinued in the future, users will be given advance notice]g ]


A current trend in managing art information is to increasingly make data about art, architecture, and cultural heritage objects available as Linked and cultural heritage objects available as Linked Open Data

This applies to the information directly describing the objects, but also the vocabularies used in the the objects, but also the vocabularies used in the descriptions

For years now, the Getty Vocabulary team has been receiving requests to publish our thesauri as been receiving requests to publish our thesauri as LOD; licensees were beginning to experiment on their own

It is time to stop asking “why” and to start It is time to stop asking why and to start exploring “how”


Institutional buy-in, particularly as LOD project coincides with the Getty’s Open Content initiative› The J. Paul Getty Museum and Getty Research

Institute make available, without charge, all available digital images to which the Getty holds the rights or that are in the public domain to be used for any purpose. No permission is required

› www.getty.edu/about/opencontent.html Also, GRI Portal: The Getty Research Portal™ is an

online search platform providing global access to o e sea c p a o p o d g g oba access o growing number of digitized art history texts

(Neither one as yet has LOD metadata)Patricia Harpring March 2014 Getty Vocabs as LOD For educational purposes. © J. Paul Getty Trust

Linked Open Data

BatchOnline Forms

Contributions from AAT, TGN, ULAN

Bi-weekly exports to the public web sitesBatch sites

Contribution Validation Application

(CVA)

Contribution Validation Application

(CVA)

Editorial System (VCS)Editorial System (VCS)

Web Service APIs(CVA)(CVA)

Contributions from CONA

i d

Yearly UTF-8 release

BatchLicensed

Data Admin ApplicationXML & REL

Patricia Harpring , from Joan Cobb March 2014 Getty Vocabs as LOD For educational purposes. © J. Paul Getty Trust


We plan to publish all four Getty vocabularies to the LOD cloud

The AAT was published to the LOD cloud in February 2014www.getty.edu/research/tools/vocabularies/lod/index.html› Plan to refresh the data every two weeksy

SPARQL endpoint: http://vocab.getty.edu/

Our base URI is http://vocab getty edu/ Our base URI is http://vocab.getty.edu/ e.g., http://vocab.getty.edu/aat/300311452

Under the ODC-BY 1 0 license Under the ODC BY 1.0 license


Open Data Commons Attribution License (ODC-By) v1.0

Allows that you (the users) are free to do the following:

To Share: To copy, distribute, and use the database To Create: To produce works from the database To Adapt: To modify transform and build upon the database To Adapt: To modify, transform, and build upon the database

As long as you Attribute: You must attribute any public use of the database, or works produced from the database, in the manner

ifi d i th li specified in the license › For any use or redistribution of the database, or works produced from it,

you must make clear to others the license of the database and keep intact any notices on the original database

http://opendatacommons.org/licenses/


Plans are in place to release the other vocabularies as LOD, target dates: TGN in July 2014 ULAN in January 2015 (various ontologies)TGN in July 2014, ULAN in January 2015 (various ontologies)and CONA in July 2015 (are investigating CIDOC CRM)

Sequence was chosen to take advantage of the way the vocabularies are connected: AAT is linked to itself; TGN pulls from AAT; ULAN from AAT and TGN; and CONA links to others

Also publishing LOD versions of lookup lists (e.g., languages, p g p ( g , g g ,bibliographic sources)

Subsequent phases will focus on how we use the data (e.g., using it on our own Web sites collaboration with external sites


using it on our own Web sites, collaboration with external sites, harvesting, visualization, etc.)

The majority of the work will be done by our in-house team, but we have established an open community and welcome collaboration: [email protected]: [email protected]

The teamGetty ITS Outside consultant, OntotextJoan Cobb Vladimir AlexievJoan Cobb Vladimir AlexievGregg Garcia

Getty Vocabulary Program (GRI)Patricia Harpring Jon Ward Antonio Beecroft Robin JohnsonPatricia Harpring, Jon Ward, Antonio Beecroft, Robin Johnson

ITS and GRI joint LOD steering committeeMurtha Baca, David Farneth, Joe Shubitowski, Mike Clardy, Marilyn Gillette, Joan Cobb, Gregg Garcia, Patricia Harpringgg p g

External Advisors (see list on our LOD page)


http://www.getty.edu/research/tools/vocabularies/lod/index.html

Visit this page for updates on status

www.getty.edu/research/tools/vocabularies/ write to us: [email protected]

Enables programmers and developers to query knowledge base via SPARQL language. Results are returned in machine-processable formats

SPARQL endpointSPARQL endpoint


The Ontologies used to express the AAT Where ever possible, we map AAT data elements to the

following external standards › SKOS, SKOSXL, ISO 25964 for representing the thesaurus information

DC DCT f ti› DC, DCT for common properties› BIBO, FOAF for sources and contributors› RDF, RDFS, OWL, XSD for system properties› R2RML for implementing the conversion of data from Oracle to Ntriples› R2RML for implementing the conversion of data from Oracle to Ntriples

GVP (Getty Vocabulary Program) ontology includes various classes, properties and individuals (values) used in the mapping that add further detail. Some examples:p› Broader Transitive › Term Characteristics › Sort Order

Patricia Harpring, thanks to Joan Cobb March 2014 Getty Vocabs as LOD For educational purposes. © J. Paul Getty Trust

› Historic Information› Associative Relationships

The Ontologies used to express the AAT Where ever possible, we map AAT data elements to the

following external standards › SKOS, SKOSXL, ISO 25964 for representing the thesaurus information

DC DCT f ti› DC, DCT for common properties› BIBO, FOAF for sources and contributors› RDF, RDFS, OWL, XSD for system properties› R2RML for implementing the conversion of data from Oracle to Ntriples

• RDF – defines structure and allows for the exportation of content in triples› R2RML for implementing the conversion of data from Oracle to Ntriples

GVP (Getty Vocabulary Program) ontology includes various classes, properties and individuals (values) used in the mapping that add further detail Some examples:

exportation of content in triples• RDFSchema – RDFs defines classes that are used in

the representation of object, predicates, subjects• Ontology – formal specifications that adds

further detail. Some examples:› Broader Transitive › Term Characteristics › Sort Order

semantics to the schema • SKOS, SKOS-XL, DCTerms, ISO 25964, PROV, BIBO,

FOAF are all ontologies that extend the basic RDF

› Historic Information› Associative Relationships

Patricia Harpring, thanks to Joan Cobb March 2014 Getty Vocabs as LOD For educational purposes. © J. Paul Getty Trust

We provide export files (data dumps) in several configurations and formats. Instructions are included online

Explicit exports p p› These are statements in NTriples format, generated directly from

the Getty Vocabulary Program’s database using R2RML Per-Entity Exportsy p

› These are downloadable semantic representation for a particular entity in RDF/XML, Turtle, NTripples, and JSON formats

Total Exports› Includes all statements (explicit and inferred) of all independent

entities in NTriples format

Patricia Harpring . thanks to Joan Cobb March 2014 Getty Vocabs as LOD For educational purposes. © J. Paul Getty Trust

For technical details, see documentation online Or write to vocabLOD@getty edu Or write to [email protected]



Editorial work to prepare for LOD required making links and mapping between vocabularies; from conceptual to actual linksE l i ULAN d l t i TGN t t AAT t E.g., roles in ULAN and place types in TGN must map to AAT terms

CONA

AAT

TGN

ULAN

TGN


• Nationality/ Culture/ Race/ Ethnicity in

Many links cannot be made automaticallyRace/ Ethnicity in ULAN should be linked to AAT

• Nat list was never actually linked to

Matching ULAN Nat. to AATactually linked to AAT

• Project to match encounters issues e g no match Thi e.g., no match, ambiguous match

• Must be resolved by hand

This “hessian” is bad match, =

no matchmatch, type of burlap

false match

ambiguous matchPatricia Harpring March 2014 Getty Vocabs as LOD For educational purposes. © J. Paul Getty Trust

Since CONA is linked to the other vocabularies, it is necessary to match incoming values to the AAT, ULAN, TGN, and CONA Iconography Authority when loadedCONA Iconography Authority when loaded

The CVA/Processor was developed for editors to use if auto-links are not possible

Contribution Validation Application software Contribution Validation Application, software architect Gregg Garcia

CONA record, creatorCONA record, creator

Koenig, Pierre (American architect, 1925-2004) 500086520link to ULANPatricia Harpring March 2014 Getty Vocabs as LOD For educational purposes. © J. Paul Getty Trust

How to avoid errors in linking Which Jan Smit?


<aat:300198841> <skos:prefLabel> "rhyta"@en

Triplesp y

<aat:300198841> <skos:altLabel> "ritons"@fr<aat:300198841> <rdf:type> <gvp:Concept><aat:300198841> <gvp:broaderPreferred> <aat:300194567><aat:300198841> <gvp:aat2100 distinguished from> <aat:300197140><aat:300198841> <gvp:aat2100_distinguished_from> <aat:300197140>

subject predicate objectrhyta – [are] distinguished from – stirrup cups

W3C standards (RDF) to describe the data in triples Three column format – known as a triple – forms the

rhyta [are] distinguished from stirrup cups

pfundamental building block of semantic representations.

Subject - corresponds to the entity – a ‘thing’ Predicates – property of the entity - names, birth/death

datesdates Objects - Subjects in another triple OR Literal values

Patricia Harpring . thanks to Joan Cobb, Gregg Garcia March 2014 Getty Vocabs as LOD For educational purposes. © J. Paul Getty Trust

<aat:300198841> <skos:prefLabel> "rhyta"@enp y<aat:300198841> <skos:altLabel> "ritons"@fr<aat:300198841> <rdf:type> <gvp:Concept><aat:300198841> <gvp:broaderPreferred> <aat:300194567><aat:300198841> <gvp:aat2100 distinguished from> <aat:300197140><aat:300198841> <gvp:aat2100_distinguished_from> <aat:300197140>


Challenges

Where our data didn’t fit into standards, we needed technical solutions in order to retain critical features that make our thesauri unique

Multilingual data: we already have terms in over 110 different languages and the potential is for thousands of languages (current, historical, dialects, etc.)

Sources and contributors linked at the record, term, and note levels; require sourcing


Editorial work to transform data acceptable for LOD; e.g., associative relationship typesChallengesChallenges


HTML XML RDFHTML XML RDF


CONA

AAT

TGN

ULAN

TGN

Enable users to find information that was previously not

English Heritag

Other Sites

Other Sites

Other Sites

Enable users to find information that was previously not available or not linked

Proven-ance Index

GettySearch

Arches

Heritage

Flemish Heritag

LA Survey

SitesOther Sites

Other Other Sites

CONA

Museum

AATA

Heritage

BulgariaOther Sites

Other Sites

Sites

CONA

AAT

TGN

ULAN

SpanishTranslation

Project

ChineseTranslation

Project

D t h

VIAF

Other Sites

AAT

TGN

ULAN

TGN

RKD

Project DutchTranslation

Projects

Iconography

Other Sites

LCSHOther Sites

Other Sites

TGN

gLCSHOther Sites Other

SitesOther Sites

Other Sites



VocabuVocabu-- W t th larieslaries

linked to linked to We are at the

beginning of the journeyother LOD other LOD

may allow may allow journey

We look forward to seeing what resources research research

and and seeing what resources will link or be linked to the Getty vocabulariesdiscovery discovery

never never

the Getty vocabularies

before before possiblepossible

Patricia Harpring March 2014 Getty Vocabs as LOD copyright J. Paul Getty Trust

Potential future use case: Researcher finds digitized books having to do Potential future use case: Researcher finds digitized books having to do with incense burners on Getty Portal; follows links for research, discovery

What now takes many hours or days to research, will be faster and easier with LOD, including the application of inference: creating

t i l b d l i li d t i ti new triples based on logic applied to existing ones

Another use case would be linking images using LOD metadata metadata at image repositories

Prezi presentation

http://prezi.com/mrdd5lccukns/research-using-the-getty-vocabularies/?utm ca


/ _mpaign=share&utm_medium=copy

Potential future use case: Researcher finds books having to do with Potential future use case: Researcher finds books having to do with incense burners on Getty Portal; follows links for research, discovery

Patricia Harpring , with Joan Cobb March 2014 Getty Vocabs as LOD For educational purposes. © J. Paul Getty Trust

Potential future use case: Researcher finds books having to do with Potential future use case: Researcher finds books having to do with incense burners on Getty Portal; follows links for research, discovery



Using TGN to link to d GISmaps and GIS






CONA ld id bj t CONA could provide subject access



etc., etc., etc.Patricia Harpring , with Joan Cobb March 2014 Getty Vocabs as LOD For educational purposes. © J. Paul Getty Trust

Patricia Harpringmanaging editorGetty Vocabulary Programpharpring@getty [email protected]