EMA Analyst Slides: 2013 Big Data Research Results

Preview:

DESCRIPTION

Big Data has moved beyond being just a buzzword. Organizations are operationalizing various Big Data technologies to answer critical business questions and power sophisticated workloads. Building on the success of their 2012 “Big Data Comes of Age” research report, EMA VP of Research, Shawn Rogers, EMA Senior Analyst, John Myers, and 9sight Consulting Founder and Principal, Dr. Barry Devlin, will reveal their latest big data research findings during this informative Webinar. Attendees will learn not just the what's of Big Data technologies but also the why’s of use cases, implementation strategies and technology choices, as well as discover: >>Most popular use cases for big data based on nearly 600 projects reviewed in this research >>Which Hadoop distributions are gaining traction >>The technical and business-driven-challenges for Big Data >>Most popular data sources for Big Data >>How organizations are continuing the trend of implementing the EMA Hybrid Data Ecosystem (HDE) in association with their Big Data initiatives

Citation preview

Operationalizing the Buzz:

Big Data 2013 A Review of EMA / 9sight Research

Shawn P. Rogers

VP of Research

EMA

John Myers

Senior Analyst

EMA

Dr. Barry Devlin

Founder & Principal

9sight Consulting

© 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Today’s Presenters

2 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Shawn Rogers, VP of Research, EMA

Shawn has more than 19 years of hands-on IT experience, with a focus on Internet-

enabled technology. In 2004 he co-founded the BeyeNETWORK and held the position of

Executive VP and Editorial Director. Shawn guided the company's international growth

strategy and helped the BeyeNETWORK grow to 18 Web sites around the world, making

it the largest and most read community covering the business intelligence, data

warehousing, performance management and data integration space.

John Myers, Senior Analyst, EMA

John has over 10 years of experience working in areas related to business analytics in

professional services consulting and product development roles. Additionally, John helps

organizations solve their business analytics problems, whether they relate to operational

platforms – such as customer care or billing – or applied analytical applications – such as

revenue assurance or fraud management.

Dr. Barry Devlin, Founder & Principal, 9sight Consulting

Barry has 30 years of experience in the IT industry, previously with IBM, as an architect,

consultant, manager and software evangelist. He is a founder of the data warehousing

industry and among the foremost authorities worldwide on business intelligence. He is a

widely respected consultant, lecturer and author of “Data Warehouse--from Architecture

to Implementation.”

Logistics for Today’s Webinar

3

• An archived version of the event

recording will be available at

www.enterprisemanagement.com

• Log questions in the Q&A panel

located on the lower right corner of

your screen

• Questions will be addressed during the

Q&A session of the event

Questions

Event recording

© 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Research Sponsors

4 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Agenda

• Research Highlights

• Respondents

• Projects

• Big Data Requirements

• Speed of Response

• Load

• Economics

• Complex Workload

• Structure

• Hybrid Data Ecosystem

• Question and Answer

5 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Research Methodology

• Highly Qualified

• Trends year over year

• Global in Coverage

• Balanced – Business and IT

• Real World Project Insights

• Almost 600 active Big Data projects

• Sponsors, workloads and more

6 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

2013 Research Highlights

7 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Key messages

• Clear move from market hype to real implementation

• Maturing of solutions

• More projects in production

• Machine-generated data shows significant growth

8 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Two thirds of respondents have more than one

Big Data project.

9 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

In operation grows from 36% to 53%

10 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

The REAL Big Data Logical Architecture

• REAL = Realistic, Extensible,

Actionable, Labile

• Three interconnected pillars

of information

• Messages, events, measures and

transactions from real world

• Metadata = context-setting information

• Adaptive information processing

• Instantiation, assimilation and

reification – ETL, ELT, Virtualization

• See “Business unIntelligence – Insight and

Innovation Beyond Analytics and Big Data”

http://bit.ly/BunI-Technics Events Measures Messages

Transactions

Reification

Utilization

Instantiation

Human-

sourced (information)

Machine-

generated (data)

Process-

mediated (data)

Context-setting (information)

Assimilation

Transactional (data)

11 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Machine-generated data jumps 14%

12 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Survey Respondents

13 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Respondent Perception of Corporate Innovation

14 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Innovators around the World

Slide 15 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Big Data Projects

16 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Project Sponsors

17 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Business Users Take the Lead

18 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Drivers of Big Data

19 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

20 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Importance of Data in Business

21 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Technical Motivators

22 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

23 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Big Data Size for 2013

5.5-100TB

1.1TB-2PB

30% indicated 11-20%

of overall data

management was

allotted to Big Data

initiatives

Most Common Response

Majority Response 24 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Big Data Management Size for 2014

6-120TB

1.2TB-2.8PB

Most Common Response

Majority Response

31% of Respondents

indicated 11-20%

growth for 2014

25 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

26 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Big Data Budgets for 2013

$550k-$5m

$10k-$20m

Most Common Response

Majority Response

40% of Respondents

indicated 11-20% of

overall IT Budgets

were assigned to

Big Data

27 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Who’s paying?

$88k-$1.25m

49% of Respondents

indicated non IT

sources of Big Data

Budget funding

28 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

29 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Big Data Platforms have Multiple Uses

30 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Increasing Workloads

31 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

32 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Expanding Beyond the Wall:

Rome

33 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Expanding Beyond the Wall:

When and Where to Apply Schemas

34 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Hybrid Data Ecosystem

35 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Hybrid Data Ecosystem 2012:

Creating a New Nucleus

36 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Hybrid Data Ecosystem 2013:

Distribution of Platforms

One Platform, 28.2%

Two Platforms, 32.1%

Three Platforms, 27.8%

Four Platforms, 4.3%

Five Platforms, 3.5%

Six Platforms, 1.5%

Seven Platforms, 0.4%

Eight Platforms, 2.3%

Sample Size = 259

37 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Hybrid Data Ecosystem 2013:

From Requirements to Consumers

38 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Question and Answer

39 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Question and Answer:

Please Log Questions in the Q&A Panel

Get the Big Data Operationalizing the

Buzz Research Report at

https://www.enterprisemanagement.

com/research

Available October 21, 2013!

40 © 2013 Enterprise Management Associates, Inc. & 9sight Consulting

Recommended