14
Copyright © 2010 SAS Institute Inc. All rights reserved. Copyright © 2010, SAS Institute Inc. All rights reserved. BCS (NLB) Big Data seminar “Big Data” John Morton, Chief Technology Officer SAS Institute 23 rd November 2011

BCS NLB Big Data presentation · What-if Analysis Ad Hoc Queries Pre-defined . Queries . Information Integration . 2006 2008% 2010 . Usage Sophistication. 0 100% . 20% . 13% . 25%

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: BCS NLB Big Data presentation · What-if Analysis Ad Hoc Queries Pre-defined . Queries . Information Integration . 2006 2008% 2010 . Usage Sophistication. 0 100% . 20% . 13% . 25%

Copyright © 2010 SAS Institute Inc. All rights reserved. Copyright © 2010, SAS Institute Inc. All rights reserved.

BCS (NLB) Big Data seminar “Big Data” John Morton, Chief Technology Officer SAS Institute 23rd November 2011

Page 2: BCS NLB Big Data presentation · What-if Analysis Ad Hoc Queries Pre-defined . Queries . Information Integration . 2006 2008% 2010 . Usage Sophistication. 0 100% . 20% . 13% . 25%

2

Copyright © 2010, SAS Institute Inc. All rights reserved.

Who is SAS: The Leader in Enterprise Analytics Software

Customer Partnerships: • 4.5 million users worldwide • 50,000+ sites in 114 countries • 92 of the Top 100 Fortune Global 500 • 9 of 10 Leading Media Agencies

• Over 1,000 Universities • Over 90% of US Federal Agencies • All 50 US State Governments

Services 11%

Financial Services 42%

Retail 4% Other

2%

Manufacturing 6%

Healthcare & Life Sciences

8%

Government 14% Energy & Utilities

2%

Education 3%

Communications 8%

Anticipate Opportunity, Empower Action, Drive Impact Basic company statistics: • Founded 1976: 11,000+ employees in 400+ offices • 600+ global alliances • 2010 worldwide revenue $2.43 B • 24% of revenues reinvested in R&D • Ranked in Leader’s Quadrant for Gartner’s 3 key areas for

Analytics: Data Intelligence, Analytics and Reporting • IDC: SAS is leader in Analytics with a 34.5% market share

Page 3: BCS NLB Big Data presentation · What-if Analysis Ad Hoc Queries Pre-defined . Queries . Information Integration . 2006 2008% 2010 . Usage Sophistication. 0 100% . 20% . 13% . 25%

3

Copyright © 2010, SAS Institute Inc. All rights reserved.

What is Big Data?

In 2011 (Gartner) this now includes – Complexity!!

May 2011 McKinseys Report “Big Data : The next frontier for Innovation, Competition and Productivity” stated : US healthcare reduction by $300 B a year 2/3rds from a 8% reduction in

national healthcare Retailers can increase operating margin by 60% by fully utilising data Euro 100 B reduction in Government administration across Europe

Big data is a term applied to data sets whose size is beyond the ability of commonly used software tools to capture, manage, and process the data within a tolerable elapsed time. Big data sizes are a constantly moving target currently ranging from a few dozen terabytes to many petabytes of data in a single data set. (Wikipedia)

In a 2001 (Gartner), defined data growth challenges (and opportunities) as being three-dimensional, increasing volume (amount of data), velocity (speed of data in/out), and variety (range of data types, sources).

Page 4: BCS NLB Big Data presentation · What-if Analysis Ad Hoc Queries Pre-defined . Queries . Information Integration . 2006 2008% 2010 . Usage Sophistication. 0 100% . 20% . 13% . 25%

4

Copyright © 2010, SAS Institute Inc. All rights reserved.

Big Data

Big data definition

Big data is the ability to extract value from huge data sets by employing big data analytics to make better and faster decisions

based not only on what has happened, but what will happen next. By identifying patterns, trends and insights from big data, organisations

will drive greater innovation, competitiveness and productivity.

Page 5: BCS NLB Big Data presentation · What-if Analysis Ad Hoc Queries Pre-defined . Queries . Information Integration . 2006 2008% 2010 . Usage Sophistication. 0 100% . 20% . 13% . 25%

5

Copyright © 2010, SAS Institute Inc. All rights reserved.

What Does it Mean? - People

Future You and technology

Customers/Citizens

Pace of Technology

10-14 jobs between age of 21 and 38

Page 6: BCS NLB Big Data presentation · What-if Analysis Ad Hoc Queries Pre-defined . Queries . Information Integration . 2006 2008% 2010 . Usage Sophistication. 0 100% . 20% . 13% . 25%

6

Copyright © 2010, SAS Institute Inc. All rights reserved.

Technology Shift

Dot com boom

£30 Terabyte disks

£2000 fault tolerant, supercomputers

Store everything file systems

Visualisation of data - Gamefication

In-Database processing

Massively-parallel processing (MPP) analytics

Page 7: BCS NLB Big Data presentation · What-if Analysis Ad Hoc Queries Pre-defined . Queries . Information Integration . 2006 2008% 2010 . Usage Sophistication. 0 100% . 20% . 13% . 25%

7

Copyright © 2010, SAS Institute Inc. All rights reserved.

Data Intensive Workloads - Usage Driven Technologies

Video Information Search

Predictive

Analytics

What-if

Analysis

Ad Hoc

Queries

Pre-defined

Queries

Info

rmat

ion

Inte

grat

ion

2006 2008 2010

Usage Sophistication

0%

100%

20%

13%

25%

Search &

Semantic

Analysis

TopQuadrant, Forester,

Intel IT study, Gartner

High Performance Analytics

• A weeks worth of the information in the Times equals a lifetimes worth of information in 1800

• Video content growing at an astonishing pace

• 40 Exabytes of data created this year….

Page 8: BCS NLB Big Data presentation · What-if Analysis Ad Hoc Queries Pre-defined . Queries . Information Integration . 2006 2008% 2010 . Usage Sophistication. 0 100% . 20% . 13% . 25%

8

Copyright © 2010, SAS Institute Inc. All rights reserved.

What Does it Mean? - Processes

3.0

Collaboration

Business Clock

Managing Data

Linked Data

Grey computing

Page 9: BCS NLB Big Data presentation · What-if Analysis Ad Hoc Queries Pre-defined . Queries . Information Integration . 2006 2008% 2010 . Usage Sophistication. 0 100% . 20% . 13% . 25%

9

Copyright © 2010, SAS Institute Inc. All rights reserved.

Decision Making

“It would appear, Hopkins, that your gut feel was only indigestion.”

Page 10: BCS NLB Big Data presentation · What-if Analysis Ad Hoc Queries Pre-defined . Queries . Information Integration . 2006 2008% 2010 . Usage Sophistication. 0 100% . 20% . 13% . 25%

10

Copyright © 2010, SAS Institute Inc. All rights reserved.

What Does it Mean? - Systems

Role of IT?

Context Aware

Relationships

The Burton Group

Today New Threats (e.g., IM, Rootkit)

Perimeter Ambiguity

Virtualization

Client Diversity

Digital Rights Management

End-point Performance and

Technology

VM VM VM VM VM VM VM VM VM VM VM VM

Tomorrow

Boundaries are changing

Page 11: BCS NLB Big Data presentation · What-if Analysis Ad Hoc Queries Pre-defined . Queries . Information Integration . 2006 2008% 2010 . Usage Sophistication. 0 100% . 20% . 13% . 25%

11

Copyright © 2010, SAS Institute Inc. All rights reserved.

11

Creating the illusion of simplicity

Page 12: BCS NLB Big Data presentation · What-if Analysis Ad Hoc Queries Pre-defined . Queries . Information Integration . 2006 2008% 2010 . Usage Sophistication. 0 100% . 20% . 13% . 25%

12

Copyright © 2010, SAS Institute Inc. All rights reserved.

Open Data and Transparency

Page 13: BCS NLB Big Data presentation · What-if Analysis Ad Hoc Queries Pre-defined . Queries . Information Integration . 2006 2008% 2010 . Usage Sophistication. 0 100% . 20% . 13% . 25%

13

Copyright © 2010, SAS Institute Inc. All rights reserved.

The real value is in the links!

Linked data – Shareable, understood, unified in format and access to data http://dbpedia.org

Page 14: BCS NLB Big Data presentation · What-if Analysis Ad Hoc Queries Pre-defined . Queries . Information Integration . 2006 2008% 2010 . Usage Sophistication. 0 100% . 20% . 13% . 25%

Copyright © 2010 SAS Institute Inc. All rights reserved.