2014 Big Data Research by IDG Enterprise

Big DataGrowing Trends and Emerging Opportunities

Conducted across the IDG Enterprise brands: CIO, Computerworld, CSO, InfoWorld, ITworld and Network World

Purpose and Methodology

2

Survey Sample

Total Respondents 751

Margin of Error +/- 3.6%

Audience Base CIO, Computerworld, CSO, InfoWorld, ITworld, and Network World sites, email, and LinkedIn forums.

Survey Method

Survey Goal

To gain a better understanding of organizations' big data initiatives, investments and strategies.

Collection Online Questionnaire

Number of Questions 46 (incl. demographics)

Source: IDG Enterprise Big Data Study, 2014

3

Big Data Definition


Large volumes of a wide variety of data collected from various sources across the enterprise including transactional data from enterprise applications/databases, social media data, mobile device data, unstructured data/documents, machine-generated data and more.

Big data technologies are a new generation of technologies and architectures designed to extract value economically from these data sets by enabling high-velocity capture, discovery and/or analysis.

Data in high volume, high velocity and a high variety of information assets can deliver enhanced insights and decision making.

4

Data Terms

UNIT SIZE WHAT IT MEANS

Bit (b) 1 or 0 Short for “binary digit,” after the binary code (1 or 0) computers use to store and process data.

Byte (B) 8 bits Enough information to create an English letter or number in computer code. It is the basic unit of computing.

Kilobyte (KB) 1,000 or 210 bytes From “thousand” in Greek. One page of typed text is 2KB.

Megabyte (MB) 1,000KB; 220 bytes From “large” in Greek. The complete works of Shakespeare total 5MB. A typical pop song is about 4MB.

Gigabyte (GB) 1,000MB; 230 bytes From “giant” in Greek. A two-hour film can be compressed into 1-2GB.

Terabyte (TB) 1,000GB; 240 bytes From “monster” in Greek. All the catalogued books in America’s Library of Congress total 15TB.

Petabyte (PB) 1,000TB; 250 bytes All letters delivered by America’s postal service this year will amount to around 5PB. Google processes around 1PB every hour.

Exabyte (EB) 1,000PB; 260 bytes Equivalent to 10 billion copies of The Economist.

Zettabyte (ZB) 1,000EB; 270 bytes Approximately 1,000 Exabytes. Data in 2010 cracked the zettabyte barrier.

Yottabyte (YB) 1,000ZB; 280 bytes Currently too big to imagine.

The prefixes are set by an intergovernmental group, the International Bureau of weights and Measures.Yotta and Zetta were added in 1991; terms for larger amounts have yet to be established.

Source: The Economist

5

Amount of Data Climbing Sharply

Q. Approximately, how much data is your organization currently managing? AND Q. How much data do you expect to be managing 12-18 months from now? BASE: Plans to deploy/implement big data projects.


6

Interest in Big Data Continues to Rise

39%

14%

10%10%

15%12%

Q. Is your company currently implementing, planning or considering projects (i.e. devising strategies and projects to generate more value from existing data)?


7

CEO Largest Supporter of Big Data Efforts

CEO

Line of Business (as head)

Board of Directors

Marketing

Finance/Accounting

Strategy

Engineering

Sales

Research & Development

Customer Service

None (this is an IT-only initiative)

Not sure

47%

34%

29%

27%

24%

21%

20%

19%

18%

14%

10%

4%

Q. Which of the following business groups are supporting or sponsoring your big data efforts? BASE: Plans to deploy/implement big data projects.


8

36%

38%

39%

31%

48%

33%

23%

24%

28%

21%

34%

22%

18%

32%

25%

14%

34%

17%

21%

10%

21%

20%

45%

21%

LOB IT Pro Mid-Level IT IT Exec

Exec. IT Heavily Involved in Big Data Initiatives

Q What role do you play personally in your organization’s big data initiatives? I am involved in… BASE: Plans to deploy/implement big data projects.


Capturing

Storing

Analyzing

Searching/Sorting

Sharing

Visualizing

9

Laying the Groundwork for Big Data

Developing or buying software applications

Investing in additional server or storage hardware/software

Hiring staff with analytics skills

Utilizing an open source software framework (e.g., Apache Hadoop)

Migrating to cloud-based services for storage

Increasing network bandwidth

Migrating to cloud-based services for analytics

Contracting outside big data expertise

38%

37%

34%

30%

28%

27%

26%

26%

Q. Which of the following is your organization doing to manage big data initiatives? BASE: Plans to deploy/implement big data projects.


10

Limited availability of skilled employees to analyze data

Limited availability of skilled employees to manage big data

Limited budget

Security issues

Legacy issues (integration of exisiting tools)

Poor data quality

Difficulty integrating or analyzing real-time data

Development time

Growing demand on storage capacity/infrastructure

Scalability issues

Ability to demonstrate ROI from investments

Ownership/control issues

Access and usability for end users

Ensuring adequate bandwidth to support data capture and analysis

Difficulty uncovering actionable insights/inadequate reporting

Compliance/regulatory issues

Escalating infrastructure and maintence costs due to data growth

Lack of management support

40%

35%

49%

34%

30%

31%

29%

39%

28%

27%

27%

18%

25%

24%

21%

14%

22%

13%

41%

41%

40%

37%

36%

33%

32%

31%

30%

29%

26%

23%

22%

21%

21%

21%

19%

17%<1,000 1,000+

Need for Skilled Employees Ranks High

Q. What are the challenges that your organization is facing or expects to experience with its big data initiatives? BASE: Plans to deploy/implement big data projects.


11

Staffing Up for Big Data Initiatives

Q. With regard to big data initiatives, what skill sets does your organization currently have? AND Q. Which skill sets is your organization planning to hire within the next 12-18 months? BASE: Plans to deploy/implement big data projects.


12

• Organizations are seeing exponential growth in the amount of data managed with an expected increase of 76% within the next 12-18 months.

• Companies are intensifying their efforts to derive value through big data initiatives with nearly half (49%) of respondents already implementing big data projects or in the process of doing so in the future; however, enterprise organizations are ahead of the curve in implementation plans compared to SMB organizations.

• CEOs are focused on the value of big data and are partnering with IT executives who will purchase/manage/execute on the strategies.

• Organizations are investing in developing or buying software applications, additional sever hardware, and hiring staff with analytics skills in preparation for big data initiatives.

• Organizations are facing numerous challenges with big data initiatives and limited availability of skilled employees to analyze and manage data tops the list.

• In the next 12-18 months, organizations plan to invest in skill sets necessary for big data deployments, including data scientists (27%), data architects (24%), data analysts (24%), data visualizers (23%), research analysts (21%), and business analysts (21%).

Conclusion


13

• To view the full results, please contact Sue Yanovitch, VP, Marketing of IDG Enterprise at [email protected].

Learn More

mailto:[email protected]

Technology

2014 Big Data Research by IDG Enterprise