Sebastian Heise, MSc• COO & Founder• Pattern Recognition &
Machine Learning
6
Our Challenge
We are running areal-time self adapting system.
How to debug?
7
Many Data Connectors
Log data from the app
Log data from traffic feeds
(probes)
Internal log data from
infrastructureNUNAV Driver
NUNAV Cloud
City Traffic ManagementSensor Data
GPS DataMap Data
Incident Data
8
traffic profiles from probe data#1
9
10
Lane Identification
11
Traffic Prediction & Pattern
12
Road Sampling
13
Always-On Data-Processing #2
14
Errors
15
System Load
16
Performance Measurements#3
17
Graphs showing predicted arrival time accuracy
18
Top Tip
We use Splunk with Windows Azure (all our core systems are there)
When doing timespan queries from Azure Table Storage encode the time in the partition/row key (Azure Diagnostics dumped to table storage also have this encoding – use it).
If you are pushing a lot of data into Splunk, do it over UDP - it’s much more efficient