Linked Open Government DataOpen Government & Open Government Data Putting the L in Front: from Open Data to Linked Open Data (LOD)

Linking Open Data to Accelerate Low-Carbon Development A workshop for decision makers in clean energy organisations January 18th 2012 in Abu Dhabi, Masdar Institute Slides for download: http://www.slideshare.net/MartinKaltenboeck Martin KaltenböckManaging Partner & CFO, Semantic Web Company www.semantic-web.at

These slides are published under : http://creativecommons.org/licenses/by/3.0

@semwebcompany

2

Open GovernmentA new way of transparency, participation & collaboration

Open (Government) DataA worldwide movement for re-use of data & content

Putting the L in front From Open Data to Linked Open Data

The Power of Linking Open DataBenefits & Potentials of LOD

Agenda of Presentation

Open Government (Data)

A short introduction

Grafik: openchandler.org

3

4

The basic idea of Open Government is to establish a modern cooperation among politicians, public administration, industry and private citizens by enabling more transparency, democracy, participation and collaboration.

Some of the most important enablers for Open Government are free access to information and the possibility to freely use and re-use this information (e.g. data, content, etc).

After all, without information it is not possible to establish a culture of collaboration and participation among the relevant stakeholders.

Therefore, Open Government Data (OGD) is often seen as a crucial aspect of Open Government.

What is Open Government?

Where it started & where we are now!

© Semantic Web Company – http://www.semantic-web.at/ 5

6

Open Government Data (OGD) is a worldwide movement to open up data (& information) of the government / public administration* - that is NOT personal (individual related) – in human- and maschine readable open formats (non proprietary) for use & re use!

OPEN stands for lowering the barriers to ensure as broad as possible re-use (for everybody)!

There is a new paradigm in publishing Government Data = look, take and play!

* ….. data and information produced or commissioned by government or government controlled entities

What is Open Government Data?

7

20. 10. 2011, OGD Camp 2011 Warsaw - http://blogs.ec.europa.eu/neelie-kroes/tag/open-data/

I’ve said before that I’m a big fan of open data. Opening up public data will get citizens involved in society and political life, increase the transparency of public administration, and improve public decision making. Those benefits cannot be overestimated. And public data can be used in many unexpected ways, too: as the father of the Internet, Tim Berners-Lee, put it: “if people put data onto the web… it will be used by other people to do wonderful things in ways that they never would have imagined”.

There’s a huge amount of money here, and a huge amount of opportunity. I want to see Europe at the forefront of this development. So I’m going to be taking action to open up Europe’s public sector, by promoting creative and innovative re-use of public data.

Open Government Data in Europa

Outreach EC Activities

• June 2012 – Launch of EC Open Data Portal (Data & Information of EC departments)

• 100 Mio Euros for Open Data related acticities in EC funded R&D projects

• 2013 – Launch of a Pan-European Data Portal(Single Point of Access to Open Data of EU27)

8

There are more & more Open Data systems available by international organisations, NGOs and NPOs!

• United Nations – http://data.un.org • World Bank - http://data.worldbank.org • Eurostat – http://ec.europa.eu/eurostat • FAO – http://data.fao.org

• REEEP, Clean Energy Datasets: http://data.reegle.info • NREL, OpenEI: http://en.openei.org

• The Guardian - http://www.guardian.co.uk/world-government-data• New York Times - http://data.nytimes.com/

Global Open Data Initiatives

OGD Map Worldwide:http://bit.ly/open-data-map

9

1. CompletenessAll public data are made available. Public data are data that are not subject to valid privacy, security or privilege limitations, as governed by other statutes. 2. PrimacyData are published as collected at the source, with the finest possible level of granularity, not in aggregate or modified forms. 3. TimelinessData are made available as quickly as necessary to preserve the value of the data. 4. Ease of Physical and Electronic Access Data are available to the widest range of users for the widest range of purposes. 5. Machine readabilityData are reasonably structured to allow automated processing of it. 6. Non-discrimination Data are available to anyone, with no requirement of registration. 7. Use of Commonly Owned Standards (e.g. open formats) Data are available in a format over which no entity has exclusive control. 8. LicensingData are not subject to any copyright, patent, trademark or trade secret regulation. Reasonable privacy, security and privilege restrictions may be allowed as governed by other statutes.

Finally, compliance must be reviewable.

PLUS: Sunlight Foudation, August 2010: 9) Permanence & 10) Usage Costs

Principles of Open Government Data

http

://w

ww

.ope

ngov

data

.org

/hom

e/8p

rinci

ples

http

://su

nlig

htfo

unda

tion.

com

/pol

icy/

docu

men

ts/te

n-op

en-d

ata-

prin

cipl

es/

10

Open Government Data Requirements

The following 11 topics as a partial aspect of Open Government Data could be identified & described on the basis of a requirement analysis to implement OGD:

1. Need for Definitions

2. Open Government: Transparency and Democracy, Participation & Collaboration

3. Legal Issues

4. Impact on Society

5. Innovation and Knowledge Society

6. Impact on Economy / Industry

7. Licenses, Models for Exploitation, Terms of Use

8. Data relevant Aspects

9. Data Governance

10. Applications and Use Cases

11. Technological Aspects

Also take the Metadata into account!

Towards Open Government Metadata (Sept 2011)

In the EU eGovernment Action Plan semantic interoperability is mentioned “…as an essential precondition for open, flexible delivery of eGovernment services”.

Metadata IgnorancePublic administrations should become aware of the importance of Metadata in eGovernment and the need for coherent relevant management policies.

Scattered or Closed MetadataPublic administrations should organize the scattered Metadata in structured repositories,catalogues or libraries and provide open access to the collected resources.

Open Metadata for Humans & Open Reuseable MetadataPublic administrations should provide services to query, browse and export their Metadata in amachine-readable and preferably non-proprietary format (e.g. CSV, XML).

Linked Open MetadataPublic administrations should consider applying linked metadata policies, including use of RDFto document their Metadata, persistent design, use and maintenance of URIs, linking toexternal vocabularies/schemata, harmonize their resources to third parties' resources etc.

http://www.semic.eu/semic/view/documents/towards_open_government_metadata.pdf

11

David Eaves Centre for the Study of Democracy, Canada

Words to every OGD advocate:

Building an Open Government Data Infrastructure is like building a electric power grid. It‘s hard to measure it‘s impact on society and on economy, but it is evident that there is one.

„

“12

Putting the L in frontFrom Open Data to Linked Open Data

14

What is important when thinking about Open Data in use

•Interoperability to ensure broad & easy use & re-use•Human AND machine readable data•In open formats (using open standards)•To ensure smooth & cost efficient data integration•Local–regional–national–continent wide–worldwide effects

For several target groups with several interests

•Internal usage inside of Public Administration / Organisations

•Politicians / Decision Makers•Citizens (Citizen Analysts) / Employees•Economy & Industry / NPOs & NGOs•(Data) Journalists & Media•Education, Academia & Science

Open Data in Use: what is important for whom?

5 Stars for Open Data by Tim Berners Lee

15

16

What are the costs and benefits of ★ web data?As a consumer ...

✔ You can see it. You can print it.✔

You can store it locally (on your hard drive or on an USB stick).✔

You can enter the data manually into another system.✔

As a publisher ... ✔ It is easy to publish.

Costs & Benefits of 1 to 5 Star Data

What are the costs and benefits of ★★ web data?As a consumer: everything that you could do with web data, plus:★

✔ You can directly process it with proprietary software to aggregate it, perform calculations, visualise it, etc.

✔ You can export it into another (structured) format.As a publisher ...

✔ It is still easy to publish.

Adapted 5 star model by Michael Hausenblas

17

What are the costs and benefits of ★★★web data?As a consumer, everything that you could do with web data, plus:★★

✔ You do not have to pay for a format over which a single entity has exclusive controlAs a publisher ...

✔ It is still easy to publish.

What are the costs and benefits of ★★★★ web data?As a consumer, everything that you could do with web data, plus:★★★

✔ You can link to it from any other place, either on the web or locally. ✔ You can bookmark it. ✔ You can re-use parts of the data.

As a publisher ... ✔ You will need to invest some time slicing and dicing your data. ✔ You will need to assign URIs to data items and think about how to represent

the data. ✔ You have fine-granular control over the data items and can optimise their

access (e.g. load balancing, caching, etc.)

Adapted 5 star model by Michael Hausenblas

Costs & Benefits of 1 to 5 Star Data

18

What are the costs and benefits of ★★★★★ web data?

As a consumer, you can do everything that you could do with ★★★★web data, plus:

✔ You can discover new data of interest while consuming other information.

✔ You have access to the data schema.

As a publisher ... ✔ You will need to invest resources to link your data to other data on the

web. ✔ You make your data discoverable. ✔ You increase the value of your data.

Adapted 5 star model by Michael Hausenblas

Costs & Benefits of 1 to 5 Star Data

The Evolution of the Internet

19

Docu

men

ts

on

th

e W

eb

Web

of

Docu

men

tsA

KA

Hyp

ert

ext

Data

on

th

e W

eb

A

KA

Op

en

Data

Web

of

Data

AK

A H

yp

erd

ata

• Give things an URI!• Use RDF for Publishing!• Link your Data to other Data

(as well as the data models)!

• Provide a Standard-API

• Provide an API!

• Organise Data!

• License Data!• Raw Data

now!

20

Publish Data!

Use Web-Technologies

Use Linked Data!• The web is an Ecosystem

• Networked Data creates Network Effects

• Lowers Costs of Data

Integration

From Open Data to Linked Open Data

21

Data Integration on User Level and Application Level

The Idea of Hyperdata

22

Integration on Data Level

Application and/or API

The Idea of Hyperdata

The LOD Cloud: it is already there!

23

http://bit.ly/d37p4i

~50 bio. triples/facts

24

CC-BY-SA von campuspartybrasil (flickr)

Linked Data realizes the vision of evolving the Web into a global data commons, allowing applications to operate on top of an unbounded set of data sources, via standardised access mechanisms.

I expect that Linked Data will enable a significant evolutionary step in leading the Web to ist full potential.

The Vision of the New Internet

Linked Open DataBenefits & Potentials

• Less replication (offering same datasets in different places) & thereby cost saving

• Encouragement to re-use existing datasets on the basis of open standards

• Clear which datasets are providing similar / same information

• More innovation because datasets can be put in a new context and lead to interesting applications & create knowledge

• LOD can provide a powerful digital infrastructure for data management

LOD Benefits: An Overview

26

27

• Enables web-scale data publishing - distributed publication with web-based discovery mechanisms

• Everything is a resource – follow your nose to discover more about properties, classes, or codes within a code list

• Everything can be annotated - make comments about observations, data series, points on a map

• Easy to extend - create new properties as required, no need to plan everything up-front

• Easy to merge - slot together RDF graphs, no need to worry about name clashes

• Easy use and re-use on top of common schemas AND schema mapping

• Allows complex querying of several distributed data sources & systems

The Power of Linked Open Data

Parts of list: John Sheridan, OGD2011 Conference, Vienna, Austria: http://www.slideshare.net/semwebcompany/linking-uk-government-data-john-sheridan/

Linked (Open) Data as a ‚(National) Digital Infrastructure‘

28

Linked (Open) Data in the Intranet

29

http://bit.ly/21LmMA

Cost of Data Integration – 2 Approaches

30

Source: Price Waterhouse Coopers – Technology Forecast, Spring 2009

Can we afford to mash the data

with ours?

31

LOD – Huge Economic Potentials

http://www.mckinsey.com/mgi/publications/big_data/index.asp

Data have swept into every industry and business function and are now an important factor of production, alongside labor and capital.

Harnessing big data in the public sector has enormous potential, too. If US health care were to use big data creatively and effectively to drive efficiency and quality, the sector could create more than $300 billion in value every year. Two-thirds of that would be in the form of reducing US health care expenditure by about 8 percent.

In the developed economies of Europe, government administrators could save more than €100 billion ($149 billion) in operational efficiency improvements alone by using big data, not including using big data to reduce fraud and errors and boost the collection of tax revenues.

And users of services enabled by personal location data could capture $600 billion in consumer surplus.

© Semantic Web Company – http://www.semantic-web.at/ 32

Where is the Semantic Web used? Under the hood of lots of products

Infos & Kontakt

33

Martin Kaltenböck, CMCSemantic Web Company GmbH (SWC)

Lerchenfelder Gürtel 43A-1160 Wien

Semantic Web Company (SWC)

Webhttp://www.semantic-web.athttp://blog.semantic-web.athttp://poolparty.biz

m.kaltenboeck@semantic-web.atPhone: +43-1-402 12 35–25

LOD2Creating Knowledge out of Interlinked Data

Webhttp://www.lod2.euBloghttp://blog.lod2.eu

ANNEX

34

Linked Data: pay-as-you-go!

35

Dr. Sören AuerUniversity of LeipzigLOD2 – Project Co-ordinator

“Linked Data technologies can easily fill the gap between unstructured Intranet search and expensive & complicated Service Oriented Architectures (SOA).

Compared to SOA, Linked Data is a pay-as-you-go strategy, where data integration can be performed incrementally and in sync with the requirements and evolution of the data structures in the enterprise.”

http://bit.ly/emBNA5

36

Open Government Data Stakeholder Survey 2010/2011http://survey.lod2.eu

I current consume/publish data in the following formats

From Open Data to Linked Open Data

37

Open Government Data Stakeholder Survey 2010/2011http://survey.lod2.eu

I would ideally like to consume/publish data in the following formats

From Open Data to Linked Open Data