NoSQL in research: two stories

Alfredas Chmieliauskas

TU Delft, TBM, Energy & Industry Section

April 11, 2012

Alfredas Chmieliauskas NoSQL War Stories 1 / 27

What do we do at TUDelft E&I?

I modelling and simulation

I data analysis

I economic forecasting and policy analysis

I focus: big industry, infrastructure and energy

I current projects: energy sector in the EU, port of Rotterdam,etc

Alfredas Chmieliauskas NoSQL War Stories 2 / 27

Two stories

I Enipedia.org

I AgentSpring

Alfredas Chmieliauskas NoSQL War Stories 3 / 27

Enipedia.org

I is a semantic wiki for energy data

I 50’000+ pages on energy infrastructure (power plants, pipes,etc) and economics (markets, prices)

I user contributed database (wiki)

I analytics platform (powered by a triple store + sparqlendpoint)

I 12’000 unique monthly visitors, a few editors

Alfredas Chmieliauskas NoSQL War Stories 4 / 27

Enipedia.org stack

Figure: Stack

Alfredas Chmieliauskas NoSQL War Stories 5 / 27

Enipedia.org stack

Figure: StackAlfredas Chmieliauskas NoSQL War Stories 6 / 27

SparqlExtension: Visualisation

Figure: Gas FlowsAlfredas Chmieliauskas NoSQL War Stories 7 / 27

SparqlExtension: Visualisation

Figure: SPARQL behind gas flows

Alfredas Chmieliauskas NoSQL War Stories 8 / 27

Enipedia: Power plants

Figure: Major power plants in the EU

Alfredas Chmieliauskas NoSQL War Stories 9 / 27

Enipedia: Gas Infrastructure

Figure: Major natural gas pipelines

Alfredas Chmieliauskas NoSQL War Stories 10 / 27

SparqlExtension: Analytics

Figure: What if Japan switched from nuclear to natural gas? The resultis around 53Bcm of natural gas annually or 50% of current Japaneseimports and 18% of worlds total LNG market.

Alfredas Chmieliauskas NoSQL War Stories 11 / 27

Agent-based and graph-based simulations

I things + relations between them = network (or graph)

I graph + behavior = simulation

Alfredas Chmieliauskas NoSQL War Stories 12 / 27

AgentSpring

I AgentSpring - an agent+graph based:

I ...modeling framework

I ...simulation engine

https://github.com/alfredas/AgentSpring

Alfredas Chmieliauskas NoSQL War Stories 13 / 27

AS stack

I Neo4j

I Spring + SpringDataGraph

I Cypher and Gremlin graph query languages

I RMI based client-server comm.

I REST based web front-end

I R library

Alfredas Chmieliauskas NoSQL War Stories 14 / 27

AS modeling framework: define the network

Figure: Agent+things+relationships=network

Alfredas Chmieliauskas NoSQL War Stories 15 / 27

AS modeling framework: define behavior

Figure: Behavior of one agent (modular composition)

Alfredas Chmieliauskas NoSQL War Stories 16 / 27

AS simulation engine

Figure: Running simulation - new relations are formed

Alfredas Chmieliauskas NoSQL War Stories 17 / 27

Applications

I Interactions between energy markets (today)

I Interactions between infrastructure and markets (next time)

Alfredas Chmieliauskas NoSQL War Stories 18 / 27

Thank You For Listening

Questions, comments?a.chmieliauskas@tudelft.nl

Alfredas Chmieliauskas NoSQL War Stories 19 / 27