Secure Data Scalability at Stylight with Tableau Online and Amazon Redshift / Tableau Conference on Tour - Berlin - Jun 9, 2015

BACKING UP OUR TABLEAU - STEPS TOWARDS A

RELIABLE REPORTING SOLUTION

Sergii Khomenko, Data Scient is t

Dr. Konstant in Wemhöner, Head of Business Intel l igence

WHATIS

STYLIGHT?

A S H O R T

I N T R O D U C T I O N

STYLIGHT.de Seite 2 / 42

CONTENT meets COMMERCE

N

E

W

The best place to discover & shop fashion.STYLIGHT.DE


GLOBAL INSPIRATION – LOCAL COMMERCE

A V A I L A B L E I N 1 4 C O U N T R I E S

Germany, Aust r ia, Switzer land, Netherlands, France, I taly, Sweden, UK,

Spain, Aust ral ia, Brazi l, US, Norway, Belgium


STYLIGHT ON THE GO

W H E N E V E R .

W H E R E V E R .


PROUD TO BLEED PURPLE

• Founded: 2008 in Munich

• OFFICES: Munich, London, New York

• Investors: Holtzbrinck Ventures,

Tengelmann Ventures, Seven Ventures

• Business Par tners: 350+ par tner shops

worldwide with 6000+ brands

• Total Employees — 160+

(over 19 nat ionali t ies f rom 4 cont inents)

F A C T S A N D F I G U R E S

TOTA

L N

° O

F EM

PLO

YEES

50

100

150

201520142013201220112010


GROSS MERCHANDISE VALUE

$360 MILLION

$2 70 MILLION

$175 MILLION

$50 MILL2011

2012

2013

2014


BI SETUP BEFORE OUTAGE

SETUP OF OUR REPORTING WORKFLOW

Department

Business Intelligence


OUR FIRST “DWH”: TABLEAU ONLINE


WHY WE CHOSE TABLEAU ONLINE?

• Easy to start using

• Works for free

• All data sources in one place

• Unified routine


WHY WE CHOSE TABLEAU ONLINE?

• combination of local and online/cloud sources

(Google Analytics, JDBC…)

• Sharing cross-continents - instantaneous

• easy distribution of reports with Tabcmd


SAMPLE REPORTS FROM OUR ENVIRONMENT


SAMPLE REPORTS FROM OUR ENVIRONMENT


3 TYPES OF DATA SOURCES

static snapshot incremental


HOW DATA SOURCES WERE UPDATED


LOADING AND MONITORING BEFORE OUTAGE

• 25 workbooks online with 119 views from

80 data sources

• Scheduled mails

• All refreshes scheduled manually


AND THEN IT CRASHED ...


BACK FROM CHRISTMAS … AND EVERYTHING CRASHED


SERVER OUTAGE JANUARY 2015

• Started with empty scheduled mail reports

(9th Jan)

• Monday >80% of views not working

• No clear communication from Tableau

• Server outage during our scheduled refreshes


SERIOUS DOWNTIME OF REPORTING INFRASTRUCTURE


3 TYPES OF DATA SOURCES AND HOW THEY WERE AFFECTED


FIRST THINGS FIRST: FIREFIGHTING

Replacement of all data sources in workbooks

Open Local copy New extract Replace


HOW TO REBUILD A BROKEN DATA SOURCE?

Biggest Issue: Workbooks could not be opened

due to broken data source

Understand how a Tableau data extract is build

Find a way to extract and recreate the essential parts

of a TDE



THE INSIDE OF A TABLEAU DATA SOURCE FILE


RECREATING THE FILES CONTENT


ISSUES, PLANS

• We have all DS accessible

• We know where data comes from

• Structure re-creation

• Migration without any manual input


DWH WITH AMAZON REDSHIFT

IMPROVING OUR TECHNICAL SETUP


GENERATION OF DATA INPUT FOR REDSHIFT


SERVER-SIDE MONITORING OF DATA REFRESHES


TRACKING DWH PERFORMANCE


BENEFITS

• Control over backups

• Control over refreshes

• Scale DWH up to petabyte scale

• Easy to add new ETL stages (EMR)

• More open for new challenges


MONITORING INSTALLED FOR ALL REFRESHING DATA SOURCES


ADDITIONAL ERROR LOGGING WITH LOGGLY


OUTCOME & FUTURE PLANS

POSITIVE OUTCOMES

• Number of data sources reduced by 30%

• Speed increase by using RedShift factor >100

• Scalable infrastructure for growing company

• More flexible connection of tables via RedShift


IMPROVING IT TO THE NEXT LEVEL!

• Open Source our Python tools

• Internal DWH mapping server

• Flexible to integrate new things

• Google Spreadsheet integration


HOW TO REACH US

T O O L S , T U G M U N I C H

Sergi i Khomenkosergi i .khomenko@styl ight .com

@lc0d3r

G E N E R A L I N F O , B I J O B S

Dr. Konstant in Wemhönerkonstant in.wemhoener@styl ight .com

@kwarks85

STYLIGHT Engineering: @CodeTai lors



STYLIGHTNymphenburger Straße 86

80636 Munich, Germany

Join us on Facebook: facebook.com/st yl ight

Fol low us on Twit ter : twi t ter.com/st yl ight

Fol low us on Instagram: ins tagram.com/st yl ight


Data & Analytics

Secure Data Scalability at Stylight with Tableau Online and Amazon Redshift / Tableau Conference on Tour - Berlin - Jun 9, 2015