Big Data’s Surprising Reach · – SPSS – Internal IBM technologies from open source like...

Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.

Big Data’s Surprising

Reach

Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.

What I Will Cover

•  The Environment •  The Spectrum •  Options •  Vendor Snapshots •  Observations

Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.

Email: constance@augmentext.com Voice:+1 502 777 2890

New studies “The New Landscape of Open Source Search, IDC, July 2012

“Adding Value to Corporate Libraries and Information Services” January 2012

“Next-Generation Corporate Libraries and Information Services” October 2009

Additional information at

www.arnoldit.com/sitemap.html

Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.

The Environment

Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.

Data Management Tools Distributed

Parallel Processing

Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.

Vendors Offer Three Options

Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.

On Premises: Control

Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.

Hybrid

Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.

Spectrum

Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.

The Four Big Data Vendor Sectors 1

•  Major Enterprise Vendors –  EMC –  HP –  IBM –  Oracle –  SAP (Hana)

•  Emerging Enterprise Vendors –  Amazon –  Connotate (Fetch) –  Google (Recorded Future) –  Palantir

Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.

The Four Big Data Vendor Sectors 2

•  Big Data Vendors from Intelligence Sector to Verticals –  Agilex –  Digital Reasoning –  Jack Be

•  Early Stage Innovators –  Cybertap –  Kaggle –  Quid

Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.

IBM

•  Acquiring companies to dominate the enterprise market –  Cognos –  i2 Group –  SPSS –  Internal IBM technologies from open source like Hadoop to

proprietary inovations like DB2, Power7 servers, IBM XIV Gen 3

•  Selling –  Solutions / consulting –  Hardware –  Engineering services

•  “No one gets fired for buying IBM.”

Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.

IBM Storage: Very Key Technology

http://www-03.ibm.com/systems/storage/news/announcement/big-data-20110712.html

Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.

Recorded Future

•  Top person is Christian Ahlberg, who developed SpotFire and sold that visualization technology to TIBCO

•  Recorded Future has funding from In-Q-Tel and Google

•  System processes via open source and proprietary technology: –  Large flows –  Real-time –  Unstructured and semi-structured content –  Displays “what you need to know”

•  Important because it is a precursor of what Google is likely to implement

Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.

Recorded Future Output

Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.

Agilex

•  Agiliex was founded in 2007 •  Technology VP is Roger Bradford

–  Content Analyst technology –  SAIC’s data analysis system –  Supports open source data management systems and uses

proprietary technology

•  Intelligence-agency centric system which has migrated to perform: –  Financial analyses –  Fraud detection –  “Person of importance” identification

Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.

Agilex: Profitable and Growing

Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.

Quid: Start Up in a Vertical

•  Start up: “make sense of the world around them so they can make truly informed decisions.”

•  Headquarters in San Francisco •  $10 million in funding from high-profile venture firms

from U.S., Korea, Singapore, the U.K, and Switzerland •  Solutions based on open source and proprietary

technology: –  Mobile –  Medical –  Finance

Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.

Quid Web Presence

Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.

Observations •  Consolidation •  Lack of Differentiation •  Theory Falls Short

–  Practical Implementation Preferred

•  Price competition evident: –  Open source price pressures –  IT Budget Constraints –  Lower Cost Alternatives Available

•  Volume of Customer Data –  Social Content –  Commercial Systems –  AND....

Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.