View
2.545
Download
1
Tags:
Embed Size (px)
DESCRIPTION
http://lod2.eu/BlogPost/webinar-series This webinar in the course of the LOD2 webinar series will present the release 3.0 of the LOD2 stack, which contains updates to *) Virtuoso 7 [Openlink]: the original row store of the Virtuoso 6 universal server has now been replaced by a column store, increasing the performance of SPARQL queries significantly, the store is now up to three times as fast as the previous major version. Linked Open Data Manager Suite [SWC]: the 'lodms' application allows the user to quickly set up pipelines for transforming linked data through the use of its many extensions. It also allows operations for extracting rdf from other types of data. *) dbpedia-spotlight-ui [ULEI]: a graphical user interface component that allows the user to use a remote DBpedia spotlight instance to annotate a text with DBpedia concepts. *) sparqlify [ULEI]: a scalable SPARQL-SQL rewriter, allowing you to query an SQL database as if it were a triple store. *) SIREn [DERI]: a Lucene plugin that allows you to efficiently index and query RDF, as well as any textual document with an arbitrary amount of metadata fields. *) CubeViz [ULEI]: CubeViz allows visualization of the Data Cube linked data representation of statistical data. It has support for the more advanced DataCube features, such as slices. It also allows the selection of a remote SPARQL endpoint and export of a modified cube. *) R2R [UMA]: the R2R mapping API is now included directly into the lod2 demonstrator application, allowing users to experience the full effect of the R2R semantic mapping language through a graphical user interface. *) ontowiki-csvimport [ULEI]: an OntoWiki extension that transforms CSV files to RDF. The extension can create Data Cubes that can be visualized by CubeViz. If you are interested in Linked (Open) Data principles and mechanisms, LOD tools & services and concrete use cases that can be realised using LOD then join us in the free LOD2 webinar series!
Citation preview
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 1
http://lod2.eu
Creating Knowledge out of Interlinked Data
EU-FP7 LOD2 WP6 – 12.-13.9.2013. Page 2 http://lod2.eu
Creating Knowledge out of Interlinked Data
http://lod2.eu
LOD2 is a large-scale integrating project co-funded by the European Commission within the FP7 Information and Communication Technologies Work Programme. This 4-year project comprises leading Linked Open Data technology researchers, companies, and service providers. Coming from across 12 countries the partners are coordinated by the Agile Knowledge Engineering and Semantic Web Research Group at the University of Leipzig, Germany.
LOD2 will integrate and syndicate Linked Data with existing large-scale applications. The project shows the benefits in the scenarios of Media and Publishing, Corporate Data intranets and eGovernment.
EU-FP7 LOD2 WP6 – 12.-13.9.2013. Page 3 http://lod2.eu
Creating Knowledge out of Interlinked Data
http://lod2.eu
Once per month the LOD2 webinar series offer a free webinar about tools and services along the Linked Open Data Life Cycle.
Stay with us and learn more about acquisition, editing, composing, connected applications – and finally publishing Linked Open Data.
EU-FP7 LOD2 WP6 – 12.-13.9.2013. Page 4 http://lod2.eu
Creating Knowledge out of Interlinked Data
http://lod2.eu
Third release of LOD2 StackPresented by Bert Van Nuffelen & Karel Kremer, TenForce
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 5
http://lod2.eu
Creating Knowledge out of Interlinked Data
A. LOD2 Stack Release 3.0 overview
B. Connecting the dots: Workbench for Statistical Office
Presentation Overview
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 6
http://lod2.eu
Creating Knowledge out of Interlinked Data
LOD2 STACK RELEASE 3.0
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 7
http://lod2.eu
Creating Knowledge out of Interlinked Data
Release 1: 25 components/Packages
Release 2: 37 components/Packages
Release 3: 47 components in LOD2 stack release 3• 10 new components/Packages• Of which 44 are available as a Debian package• Of which 24 are available through a graphical user
interface in the demonstrator and/or the statistical workbench
LOD2 stack progress
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 8
http://lod2.eu
Creating Knowledge out of Interlinked Data
Virtuoso 6.1.x RDF Store
(conductor,sparql, isparql, ods)
Virtuososponger
lod2webapi
RDFAuthor
Limes
ORE
D2RSemantic
Spatial Browser
sparqlproxy
SigmaEE
OntoWiki
LOD-refine
Silk-latc
stanbol
valiant
Dbpedia Spotlight
SPARQLed
PoolParty
Sieve
PoolParty Extractor
Inter-linking/ Fusing
Classifi-cation/
Enrichment
Quality Analysis
Evolution / Repair
Search/ Browsing/
Exploration
Extraction
Storage/ Querying
Manual revision/ authoring
dl-learner
CubeViz
LOD2 demonstrator
R2R
rdf-dataset-integration
Silk
SIREn
Sparqlify
CSVImport
Dbpedia Spotlight UI
CKAN (source)
Mondeca Sparql Endpoint Status
Sindice(source)
Dbpedia (source)
LOD2 Stack 3.0
lodms
LOD2 stat. Workbench
LOD2 Authentication WebID Component
Data Cube Validation Tool
Data Cube Merging Tool
Data Cube Slicing Tool
LOD2 Provenance Component
Facete
Virtuoso 7 RDF Store(conductor,
sparql, isparql, ods)
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 9
http://lod2.eu
Creating Knowledge out of Interlinked Data
Virtuoso 7 Universal Server (1/10)Inter-
linking/ Fusing
Classifi-cation/
Enrichment
Quality Analysis
Evolution / Repair
Search/ Browsing
/ Explorati
on
Extraction
Storage/ Querying
Manual revision/ authorin
g• A Column store implementation
• Queries up to three times as fast as latest major version
• Many other improvements
e.g. to load times and parallellization
• Benchmarking: BSBM results:http://wifo5-03.informatik.uni-mannheim.de/bizer/berlinsparqlbenchmark/results/V7/
http://virtuoso.openlinksw.com/
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 10
http://lod2.eu
Creating Knowledge out of Interlinked Data
• Easy integration of RDF datasets as dependencies for debian packages
• Allows packages to provide example data in an easy way
Rdf dataset integration (2/10)Inter-
linking/ Fusing
Classifi-cation/
Enrichment
Quality Analysis
Evolution / Repair
Search/ Browsing
/ Explorati
on
Extraction
Storage/ Querying
Manual revision/ authorin
g
RDF dataset
https://github.com/AKSW/rdf-dataset-integration
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 11
http://lod2.eu
Creating Knowledge out of Interlinked Data
• Scalable SPARQL-SQL rewriter,
• Query an SQL database as if it were a RDF store.
Sparqlify (3/10)Inter-
linking/ Fusing
Classifi-cation/
Enrichment
Quality Analysis
Evolution / Repair
Search/ Browsing
/ Explorati
on
Extraction
Storage/ Querying
Manual revision/ authorin
g
Sparqlify Relational Database
{ SPARQL } { SQL }
http://aksw.org/Projects/Sparqlify.html
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 12
http://lod2.eu
Creating Knowledge out of Interlinked Data
SIREn (4/10)Inter-
linking/ Fusing
Classifi-cation/
Enrichment
Quality Analysis
Evolution / Repair
Search/ Browsing
/ Explorati
on
Extraction
Storage/ Querying
Manual revision/ authorin
g• Semantic Information Retrieval Engine
• Lucene/SOLR extension
• Transformation of RDF graphs into trees to allow very efficient querying and search
http://siren.sindice.com/
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 13
http://lod2.eu
Creating Knowledge out of Interlinked Data
R2R Framework (5/10)Inter-
linking/ Fusing
Classifi-cation/
Enrichment
Quality Analysis
Evolution / Repair
Search/ Browsing
/ Explorati
on
Extraction
Storage/ Querying
Manual revision/ authorin
g• RDF vocabulary mapping framework
• Defines mapping language from one vocabulary to another
• Automatic Execution of mapping rules
http://wifo5-03.informatik.uni-mannheim.de/bizer/r2r/
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 14
http://lod2.eu
Creating Knowledge out of Interlinked Data
DBpedia Spotlight UI (6/10)Inter-
linking/ Fusing
Classifi-cation/
Enrichment
Quality Analysis
Evolution / Repair
Search/ Browsing
/ Explorati
on
Extraction
Storage/ Querying
Manual revision/ authorin
g• Lightweight Frontend for remote DBpedia Spotlight Instance
• User interface to extract Dbpedia Entities from text
https://github.com/AKSW/dbpedia-spotlight-ui
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 15
http://lod2.eu
Creating Knowledge out of Interlinked Data
LOD Manager Suite (7/10)Inter-
linking/ Fusing
Classifi-cation/
Enrichment
Quality Analysis
Evolution / Repair
Search/ Browsing
/ Explorati
on
Extraction
Storage/ Querying
Manual revision/ authorin
g
• quickly set up pipelines for transforming linked data
• many extensions
• Extract RDF from other types of data.
http://www.semantic-web.at/linked-open-data-management-suite-lodms
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 16
http://lod2.eu
Creating Knowledge out of Interlinked Data
• Generic Facetted Browser for RDF data
• Supports any remote SPARQL endpoint
• Automatically visualize RDF on a map
• Permalink functionality for sharing
Facete (8/10)Inter-
linking/ Fusing
Classifi-cation/
Enrichment
Quality Analysis
Evolution / Repair
Search/ Browsing
/ Explorati
on
Extraction
Storage/ Querying
Manual revision/ authorin
g
http://aksw.org/Projects/Facete.html
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 17
http://lod2.eu
Creating Knowledge out of Interlinked Data
• Facetted Browser for Data Cube Vocabulary
• Many different visualizations available
• Supports more advanced features like slices
• Support for RDF export and Permalinks
CubeViz (9/10)Inter-
linking/ Fusing
Classifi-cation/
Enrichment
Quality Analysis
Evolution / Repair
Search/ Browsing
/ Explorati
on
Extraction
Storage/ Querying
Manual revision/ authorin
g
http://aksw.org/Projects/CubeViz.html
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 18
http://lod2.eu
Creating Knowledge out of Interlinked Data
• Transforms CSV files to RDF
• Supports transformation to Data Cubes
• Template reuse supported
CSV Import (10/10)Inter-
linking/ Fusing
Classifi-cation/
Enrichment
Quality Analysis
Evolution / Repair
Search/ Browsing
/ Explorati
on
Extraction
Storage/ Querying
Manual revision/ authorin
g
http://aksw.org/Projects/CSVImport.html
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 19
http://lod2.eu
Creating Knowledge out of Interlinked Data
• LOD2 demonstrator: ‘intelligent bookmark service’ for stack- http://demo.lod2.eu/lod2demo
• LOD2 statistical office workbench: deeper integration in the context of statistical data- http
://demo.lod2.eu/lod2statworkbench
Demonstrating interaction between components
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 20
http://lod2.eu
Creating Knowledge out of Interlinked Data
• WebID for user profile and security in Statistical Workbench
• Authorization control to
- (Dis)Allow access to a section (URL) in the workbench
- Provide role based views inside a section (URL) in the
workbench (for native functionality in the workbench)
• Provenance information can be collected based on profile
LOD2 Authentication – Authorization – Provenance layer
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 21
http://lod2.eu
Creating Knowledge out of Interlinked Data
More info: Stack.lod2.eu
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 22
http://lod2.eu
Creating Knowledge out of Interlinked Data
• Release 3 requires a Ubuntu 12.04LTS 64bit machine
• A simple apt-get upgrade will be enough, BUT
• New version of the stack uses the Virtuoso Open Source edition, version 7
• Conflicts with old Virtuoso Open Source 6 package
• The package manager will guide you through the transition process
• But best ensure you have a backup of the contents of the database.
• Instructions on migrating your database: http://wiki.lod2.eu/display/LOD2DOC/Upgrading+an+installation+to+the+latest+release
Updating the stack to version 3
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 23
http://lod2.eu
Creating Knowledge out of Interlinked Data
Stack.lod2.eu and Wiki.lod2.eu• How to start & How to contribute• Overview of the individual api documentations • Tutorial section• Contact point: [email protected]
Public demo• http://demo.lod2.eu/lod2demo• http://demo.lod2.eu/lod2statworkbench
LOD2 Webinars series• http://lod2.eu/BlogPost/webinar-series• View them on youtube
More information …
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 24
http://lod2.eu
Creating Knowledge out of Interlinked Data
Component improvements
regular component updates e.g. bugfixes Virtuoso 7
New components
Facete: a client side faceted browser for linked data having geospatial
coordinates.
…But we want to learn from you!
Usage experience
Challenges encountered
Mail us at:
Further improvements
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 25
http://lod2.eu
Creating Knowledge out of Interlinked Data
In 2014, the stack moves to a project neutral space
• http://stack.linkeddata.org/
Repository for java artifacts for linked data
• http://mvn.linkeddata.org/
A collaboration with the GeoKnow project
Ensuring the continuity: LinkedData.org
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 26
http://lod2.eu
Creating Knowledge out of Interlinked Data
LOD2 STATISTICAL OFFICE WORKBENCH
The work on the statistical Office Workbench is a the result of a cooperation between the partners IMP, ULEI and TenForce.
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 27
http://lod2.eu
Creating Knowledge out of Interlinked Data
Data, knowledge and research interest available:• Publink with DG Infso for the Digital Agenda Scoreboard (2011)• Publink with Serbian National Statistical Office (2011-2012) & use case
described in D.6.4.1.• Publicdata.eu & Deliverable D9.4.1 : assessment of government data
shows that statistical data is freely available in large quantities. (2012)• LATC project: transformation or Eurostat data into RDF (2012)• Creation of Cubeviz application (2012-2013)
But:• No tool support for creation data cubes in RDF• No tool support for managing data cubes• No tool support for merging & splitting data cubes
And selecting a domain allows to explore the integration of components better.
Motivation of the work
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 28
http://lod2.eu
Creating Knowledge out of Interlinked Data
Statistical Office Use case
1. Public sector needs an infrastructure to publish into and curate information from the LOD cloud
2. Support for consumption of this data
1
2
define standards
StatisticianCSO IT Administrator
Investment service company
Data Analyst
publish data
automatic publishing
automatic harvesting
administration
automatic publishing
advancedanalysis
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 29
http://lod2.eu
Creating Knowledge out of Interlinked Data
Statistical Office Workbench – GUI
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 30
http://lod2.eu
Creating Knowledge out of Interlinked Data
• efficient transformation / conversion of traditional data stores (e.g. CSV, XML, relational databases) into linked, machine readable formats
• building and querying RDF Data Cube stores
• validating RDF Data Cube stores
• interlinking (e.g. code lists) and adding meaning to data
• visualization and exploration of multi-dimensional RDF data cubes
• publishing RDF Data Cube to CKAN
Functionalities
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 31
http://lod2.eu
Creating Knowledge out of Interlinked Data
DEMO STATISTICAL OFFICE WORKBENCH
Karel Kremer
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 32
http://lod2.eu
Creating Knowledge out of Interlinked Data
Demo LOD Lifecycle coverage
Inter-linking/ Fusing
Classifi-cation/
Enrichment
Quality Analysis
Evolution / Repair
Search/ Browsing/
Exploration
Extraction
Storage/ Querying
Manual revision/ authoring
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 33
http://lod2.eu
Creating Knowledge out of Interlinked Data
* Data Modified slightly to improve demo clarity
Introducing the Data
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 34
http://lod2.eu
Creating Knowledge out of Interlinked Data
• Data cube according to W3C: http://www.w3.org/TR/vocab-data-cube/
Data Cube Vocabulary
ns1:slice rdf:type qb:Slice .ns1:slice rdfs:label "only Europe region slice" .ns1:slice qb:sliceStructure local:onlyEurope .ns1:slice cube:Location cube:r1-c1 ; qb:observation cube:c1-r14 , cube:c1-r15,
cube:c1-r9 , cube:c1-r10 , cube:c1-r11 , cube:c1-r12 , cube:c1-r13 , cube:c1-r4 , cube:c1-r5 , cube:c1-r6 , cube:c1-r7 , cube:c1-r8 , cube:c1-r3 .
cube:c1-r3 rdf:typeqb:Observation ;
cube:Location cube:r1-c1 ;
cube:Disease cube:r3-c0 ;
cube:m " 7 782" ;qb:dataSet
cube:ds .
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 35
http://lod2.eu
Creating Knowledge out of Interlinked Data
Merging Data CubesD
isea
se
Region
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 36
http://lod2.eu
Creating Knowledge out of Interlinked Data
Scenario
Triple Store
CSV Import
Merge Data Cube
Link&
reconcile Visualiz
e
Statistical Office Workbench
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 37
http://lod2.eu
Creating Knowledge out of Interlinked Data
Scenario
Triple Store
CSV Import
Merge Data Cube
Link&
reconcile Visualiz
eCSV
CSV
RDF
RDF
RDF RDF
Code Lists
Publish
CKANContext
Statistical Office Workbench
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 38
http://lod2.eu
Creating Knowledge out of Interlinked Data
Scenario
Triple Store
CSV Import
Merge Data Cube
Link&
reconcile Visualiz
e
Statistical Office Workbench
CSV
CSV
RDF
RDF
RDF RDF
Code Lists
Publish
CKANContext
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 39
http://lod2.eu
Creating Knowledge out of Interlinked Data
* Data Modified slightly to improve demo clarity
Introducing the Data
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 40
http://lod2.eu
Creating Knowledge out of Interlinked Data
{ DEMO }
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 41
http://lod2.eu
Creating Knowledge out of Interlinked Data
• Get your own stack:
Install LOD2 stack from the Debian repository
Or download the pre-configured virtual machine
• Follow the tutorials here:
http://
wiki.lod2.eu/display/LOD2DOC/LOD2+Statistical+Workbench
• This and much more on: http://stack.lod2.eu
Try It Yourself!
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 42
http://lod2.eu
Creating Knowledge out of Interlinked Data
Credits
Jingle R.E.M., Martin Kaltenböck, Florian Kondert
CoordinationThomas Thurner
Martin Kaltenböck
Moderation Martin Kaltenböck
Presented byBert Van Nuffelen & Karel Kremer
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 43
http://lod2.eu
Creating Knowledge out of Interlinked Data
QUESTIONS?
Don’t forget: all info to be found at http://stack.lod2.eu !
EU-FP7 LOD2 WP6 – 12.-13.9.2013. Page 44 http://lod2.eu
Creating Knowledge out of Interlinked Data
http://lod2.eu
Hope you enjoyed staying with us – if you need more detailed information, visit us at www.lod2.eu and let us know how we can improve to meet your expectations!
Don’t forget to register for our next webinar
28.11.2013 – ORE + DLearner (by ULEI) December 2013 – NIF (by ULEI)
Have a great day and don’t forget http://stack.lod2.eu
EU-FP7 LOD2 WP6 – 12.-13.9.2013. Page 45 http://lod2.eu
Creating Knowledge out of Interlinked Data
http://lod2.eu