34
for SEC 2016 .io

SE2016 BigData Den Golotyuk "Big Data from 30 million daily users"

Embed Size (px)

Citation preview

for SEC 2016.io

i1

onthe.io

Our figures1 year from zero

30m+ uniques across our customers apps200 customers from USA/Europe/Asia

Big Data

i2

Huge data flow

i4

No apps anymore

i5

One source a year

Fantastic AI possibilities

Issues

Too complex tools...Tons of software addressing data collection and

processing. Universal. Hard to setup. Hard to use.

It show pageviews

Everything works already

i10

The gap

Analytics

i11

Bias

i12

Entropy

So we just get datado the complex stuff inside

and get the simple answers outside

Behind us2b daily request, 100Gb daily gzipped backups, 150

cloud and physical nodes

4 engineersMicroiterations. Microservices. Metrics driven.

i13

StackNode, JS, PHP, Python, Vertica, Mysql, Mongo,

Sphinx, Gearman, Redis, Statsd

Cloud

What we learned

1. We’re dumbHadoop, Spark, Cassandra, Elastic...

too advanced for us

2. Microservicesas a management approach

3. Expensive systemsaren’t cool, they’re poor

4. Most businessesdon’t even know what questions to ask

5. Nothing is really donein analytics, so join us