11
Seth Familian Founder + Principal, Familian&1 AUTOMATING BIG DATA

Automating Big Data (Dec-2016)

Embed Size (px)

Citation preview

Page 1: Automating Big Data  (Dec-2016)

Seth Familian Founder + Principal, Familian&1

AUTOMATING BIG DATA

Page 2: Automating Big Data  (Dec-2016)

INTRODUCTION

SETH FAMILIAN FOUNDER + PRINCIPAL, FAMILIAN&1

2

Corporate Strategy User Experience Design

Creative ProcraftinationTeaching + Education

Growth Hacking

Page 3: Automating Big Data  (Dec-2016)

AUTOMATING BIG DATA

THE ANALYTICS PROCESS

3

Page 4: Automating Big Data  (Dec-2016)

“Long” Data

AUTOMATING BIG DATA

THE “OLD SCHOOL” APPROACH4

Raw “Header”

File2

1

Affiliates Lookup File

Update Loop

Summary Index

saved searches

scheduled searches

TRANSFORM

InstantlyGenerates

EXTRACT LOAD

ChannelDashboards

Page 5: Automating Big Data  (Dec-2016)

AUTOMATING BIG DATA

SEGMENT-CLEARBIT ENRICHMENT5

RAW DATA EXTRACT

Core Website

Enrichment of email addresses

Page 6: Automating Big Data  (Dec-2016)

AUTOMATING BIG DATA

“NEW SCHOOL” EXAMPLE 16

RAW DATA EXTRACT LOADTRANSFORM

Traffic Sources & Session Stats

RAW DATA

Behavioral Segments, Funnels, Retention & LTV

EXTRACT

Additional aggregation and data refinement

Core Website

Social Engagement Footprint

Unified socialfootprint metrics

Enrichment of email addresses

CRM data store for easy segmentation + analysis

Additional context on Twitter followers

More flexible segments, funnels + retention metrics

Page 7: Automating Big Data  (Dec-2016)

AUTOMATING BIG DATA

“NEW SCHOOL” EXAMPLE 27

LOADCustom dashboards synced with 70+ APIs

Traffic Sources & Session Stats

Realtime (RT)

TRANSFORMRAW DATA EXTRACT

Core Website

Social Engagement Footprint

heavy-duty query tools already in place

App Databases

Custom aggregation scripts

Postgres or Redshift DB

Daily Pull

Internally-reported metrics summarized for triangulation

Daily CSV

Behavioral segmentation + in-app messaging

RT

Behavioral Segments, Funnels, Retention & LTV

RT

Unified socialfootprint metrics

Unified app downloads & ratings metrics

App Store Activity

email address enrichment

Page 8: Automating Big Data  (Dec-2016)

AUTOMATING BIG DATA 8

MORE ADVANCED AUTOMATION

Page 9: Automating Big Data  (Dec-2016)

DISCUSSION TIMEWORKING WITH BIG DATA 9

QUESTIONS · FEEDBACK · IDEAS · INSIGHTS

Page 10: Automating Big Data  (Dec-2016)

A BIT ABOUT ME 10MY GENERAL ASSEMBLY WORKSHOPS

Page 11: Automating Big Data  (Dec-2016)

THANK YOU

KEEP IN TOUCH!11

[email protected] · @SETHFAM1