17
Big Data Integration: Why Same Old, Same Old Won't Cut It

Webinar: Big Data Integration - Why Same Old, Same Old Won't Cut It

Embed Size (px)

Citation preview

Page 1: Webinar: Big Data Integration - Why Same Old, Same Old Won't Cut It

Big Data Integration: Why Same Old, Same Old Won't Cut It

Page 2: Webinar: Big Data Integration - Why Same Old, Same Old Won't Cut It

Today’s Agenda •  Discussion with Greg Benson - Big Data Integration: Why Now? •  SnapLogic Introduction: SnapReduce and the Hadooplex •  SnapLogic Elastic Integration Demonstration •  Discussion

Darren Cunningham VP of Marketing

Craig Stewart Sr. Director

Product Management

Greg Benson Chief Scientist

Page 3: Webinar: Big Data Integration - Why Same Old, Same Old Won't Cut It

About Greg Benson •  SnapLogic Chief Scientist •  Professor of Computer

Science at the University of San Francisco

•  Worked on research in distributed systems, parallel programming, OS kernels, and programming languages for the last 20 years

Page 4: Webinar: Big Data Integration - Why Same Old, Same Old Won't Cut It

Big Data Primer: What is Hadoop 2.0?

Page 5: Webinar: Big Data Integration - Why Same Old, Same Old Won't Cut It

Big Data Integration: Why Now? What’s Different

Page 6: Webinar: Big Data Integration - Why Same Old, Same Old Won't Cut It

What Do You Hear from Customers?

Page 7: Webinar: Big Data Integration - Why Same Old, Same Old Won't Cut It

SnapLogic: Connecting Data, Apps and APIs

Our unified platform significantly speeds up enterprise data access everywhere.

- Gaurav Dhillon, SnapLogic Founder and CEO

•  Experienced Team: Leadership from Informatica, Salesforce, Microsoft

•  Headquarters: San Mateo, CA •  Investors: Andreessen Horowitz & Ignition •  Advisory Board: AstraZeneca, HP, Symantec, Yahoo •  Customers: Adobe, Acxiom, Blackberry, Bloomin’

Brands, CapitalOne, Cisco, GE, iRobot, Netflix…

Page 8: Webinar: Big Data Integration - Why Same Old, Same Old Won't Cut It

Elastic Integration Platform as a Service

Integration Cloud!Designer, Manager, Dashboards

(Multi-tenant cloud service)

Elastic Execution!Snaplex

Snaps!(Buy or Build)

“Cloudplex”

“Groundplex”

“Hadooplex”

Page 9: Webinar: Big Data Integration - Why Same Old, Same Old Won't Cut It

Hybrid Deployment

•  Streams: No data is stored/cached

•  Secure: 100% standards-based

•  Elastic: Scales out & handles data and app integration use cases

Metadata

Data

Page 10: Webinar: Big Data Integration - Why Same Old, Same Old Won't Cut It

Elastic Scale Out

•  Each Snaplex can elastically expand and contract based on data traffic flowing through it

•  Built-in smarts to automatically scale the Snaplex out and in to handle variable traffic loads

Page 11: Webinar: Big Data Integration - Why Same Old, Same Old Won't Cut It

SnapLogic for Big Data Integration ACQUIRE PREPARE DELIVER

• Sort • Aggregate

• Join • Merge

• Transform

Hadoop + SnapReduce

Page 12: Webinar: Big Data Integration - Why Same Old, Same Old Won't Cut It

SnapReduce and the Hadooplex Acquire, Prepare, Deliver Big Data

YARN

YARN

MapReduce

MapReduce

MapReduce

MapReduce

MapReduce

MapReduce

MapReduce

MapReduce

Snaplex YARN Application!

MapReduce Generation!

Snaplogic iPaaS + Hadoop

= Snaplex Container

Page 13: Webinar: Big Data Integration - Why Same Old, Same Old Won't Cut It

Hadooplex: Snaplex YARN Application

= Snaplex Container

•  Snaplex has 3 types: o  Cloudplex o  Groundplex o  Hadooplex

•  Kerberos Authentication

•  Certified by Cloudera and Hortonworks

Page 14: Webinar: Big Data Integration - Why Same Old, Same Old Won't Cut It

SnapReduce: Pipelines Generate MapReduce

MAP MAP MAP MAP

REDUCE MAP MAP REDUCE

SnapReduce Compiler

Map Reduce

•  A checkbox option to SnapReduce-enable a pipeline

•  New support for SequenceFile, RCFile, document (JSON) processing for MapReduce jobs

YARN

Page 15: Webinar: Big Data Integration - Why Same Old, Same Old Won't Cut It

Big Data Integration Demonstration

Page 16: Webinar: Big Data Integration - Why Same Old, Same Old Won't Cut It

What’s Next?

Page 17: Webinar: Big Data Integration - Why Same Old, Same Old Won't Cut It

Discussion

@SnapLogic

Facebook.com/SnapLogic Plus.google.com/+SnapLogic