Top$2010$20Emerging$20Trends$20in$20Business$20Intelligence$20 $20Bardoliwalla

7/31/2019 Top$2010$20Emerging$20Trends$20in$20Business$20Intelligence$20 $20Bardoliwalla

1/37

The Top 10 Emerging Trends inBusiness Intelligence, Analytics,and Performance Management

Nenshad D. BardoliwallaMarch 2010


2/37

The slides here are a subset of what was

presented in person. Much of what wasdiscussed plus additional details thatcould not be covered due to timeconstraints can be read in this December2009 blog post here:

The Top 10 Trends for 2010 in Analytics,

Business Intelligence, and PerformanceManagement
http://www.enterpriseirregulars.com/5706/the-top-10-trends-for-2010-in-analytics-business-intelligence-and-performance-management/http://www.enterpriseirregulars.com/5706/the-top-10-trends-for-2010-in-analytics-business-intelligence-and-performance-management/http://www.enterpriseirregulars.com/5706/the-top-10-trends-for-2010-in-analytics-business-intelligence-and-performance-management/http://www.enterpriseirregulars.com/5706/the-top-10-trends-for-2010-in-analytics-business-intelligence-and-performance-management/http://www.enterpriseirregulars.com/5706/the-top-10-trends-for-2010-in-analytics-business-intelligence-and-performance-management/http://www.enterpriseirregulars.com/5706/the-top-10-trends-for-2010-in-analytics-business-intelligence-and-performance-management/


3/37

The Top 10 1 through 5

1. We will witness the emergence of packaged strategy-driven execution applications.

2. The holy grail of the predictive, real-time enterprisewill start to deliver on its promises.

3. The industry will put reporting and slice-and-dicecapabilities in their appropriate places and return to itsdecision-centric roots with a healthy dose of Web 2.0style collaboration.

4. Performance, risk, and compliance management willcontinue to become unified in a process-basedframework and make the leap out of the CFOs office.

5. SaaS / Cloud BI Tools will steal significant revenuefrom on-premise vendors but also fight for limited

oxygen amongst themselves.


4/37

The Top 10 6 through 10

6. The undeniable arrival of the era of big data will leadto further proliferation in data managementalternatives.

7. Advanced Visualization will continue to increase indepth and relevance to broader audiences.

8. Open Source offerings will continue to make in-roadsagainst on-premise offerings.

9. Data Quality, Data Integration, and DataVirtualization will merge with Master DataManagement to form a unified InformationManagement Platform for structured andunstructured data

10. Excel will continue to provide the dominant paradigmfor end-user BI consumption


5/37

Number One

We will witness the emergence of packaged strategy-driven executionapplications.


6/37

Strategy-Driven Execution

CreationPurchase Order

Creation SalesOrder Fulfillment

RequestRequest Global

ATPGlobal ATP

Check

Creation &Release DeliveryRequest

Release ASN

DeliveryExecution

Receives ASN

Update InventoryAccounting

UpdateInventory

Defection Risk

Will this customer leave toa competitor?

Inventory ForecastWill this be back in inventory?

... within process

... about process

Order Fulfillment GoalFulfill orders of most

profitable customers within1 day

Sourcing ControlAre suppliers for criticalparts delivering on time?

Delivery PerformanceHow effective is our fulfillment process?

Managing Performance and Risk in a Down Economy A Practical Approach to Optimizing BusinessPerformance for Everyone , May 2009


7/37

Number TwoThe holy grail of the predictive, real-timeenterprise will start to deliver on its promises.


8/37


9/37

Complex Event Processing Analysis of streams of data flowing from live sources

for patterns and significant business indicators for the purpose of taking actionCEP recognizes patterns of events.

Event A followed by event B within 30 secondsFive occurrences of event X within five minutes

CEP handles high event throughput.Thousands of RFID tags per secondThousands of stock ticker changes per second

CEP can handle events in many business andapplication contexts.

Airline baggage handling Algorithmic tradingClaims processing

Event Processing Breaks Out; These Are the Top Products, Forrester Research, August 13, 2009


10/37

Number ThreeThe industry will put reporting and slice-and-dice capabilities in their appropriate placesand return to its decision-centric roots with ahealthy dose of Web 2.0 style collaboration.


11/37

Decision Management Solution Components

Decision Management - A Strategy for Organizationwide Decision Support and Automation,IDC Ma 2009


12/37

Automating Operational Decisions

Heres how decisions and rules relate, JT on EDM, March 2009


13/37

Number FourPerformance, risk, and compliancemanagement will continue to become unifiedin a process-based framework and make theleap out of the CFOs office.


14/37

Cascade

Risk-AdjustedFinancial Plan

Unified Strategic Business ProcessBringing it All Together

GoalsKPIs

RisksKRIs

ComplianceControls

Model Optimize

Risk-AdjustedOperational Plan

Analyze

Adjust

Understandthe Corporate

and Departmental Context

AssignKPIs Goals and Set Targets

KRIs Risks and Set ThresholdsControls Compliance and Set

Effectiveness Tests

Build StrategicAction Plan and

Initiatives

Develop and SetThe Strategy

Monitor

Risk-AdjustedForecast

Managing Performance and Risk in a Down Economy A Practical Approach toOptimizing Business Performance for Everyone , May 2009


15/37

Unified Strategic Business Processes Embeddedin Execution Business Processes By Horizontal

Supply Chain Demand Chain

Finance

S&OPCommodity

RiskCustomer

Attrition RiskSales

Forecasting

SOX

Managing Performance and Risk in a Down Economy A Practical Approach toOptimizing Business Performance for Everyone , May 2009


16/37

Number Five

SaaS / Cloud BI Tools will stealsignificant revenue from on-premisevendors but also fight for limitedoxygen amongst themselves.


17/37

Do we really need MORE buzzwords?!!

TDWI - Making Sense of Software-as-a-Service BI, Wayne Eckerson, June 25, 2009


18/37

What do we mean by the cloud?Huge Resources : The illusion of infinitecomputing resources available on demand,thereby eliminating the need for CloudComputing users to plan far ahead for provisioningNo Commitment : The elimination of an up-front commitment by Cloud users, therebyallowing companies to start small andincrease hardware resources only when thereis an increase in their needs

Pay by the Drink : The ability to pay for useof computing resources on a short-term basisas needed (e.g., processors by the hour andstorage by the day) and release them as

neededAbove the Clouds: A Berkeley View of Cloud Computing, Feb 10, 2009


19/37

Peeling back the onion

Toward a Unified Ontology of Cloud Computing, Youseff et al., 2009

C C f Cl d BI


20/37

Common Concerns for Cloud BI

SecurityIntegrationData migrationSLAsPricing


21/37

Number SixThe undeniable arrival of the era of big datawill lead to further proliferation in datamanagement alternatives.

W ll li


22/37

We must master parallelism

No 5 GHz chips any time soon.Massive multi-core systems are only way tocontinue scaling. But parallel programming isREALLY hard.

HUGE amounts of data generated by allcompanies.

At these data volumes, calculations need to

move to the data or network I/O is saturated.

H d R l i l D b


23/37

RelationalDatabases:

An ACID DatabasesystemStores Tables (Schema)

Stores 100s of terabytesProcesses 10s of TB/queryTransactionalConsistencyLookup rows using indexMostly queries

Interactive response

Hadoop:

A data grid operatingsystemStores Files(Unstructured)

Stores 10s of petabytesProcesses 10s of PB/jobWeak ConsistencyScan all blocks in all filesQueries & DataProcessingBatch response (>1sec)

Hadoop vs. Relational Databases

23How Hadoop Revolutionized Data Warehousing at Yahoo and Facebook, Amr Awadallah, August 5, 2009

R C l B d S


24/37

Row versus Column-Based Storage

EmpID Lastname Firstname Salary

1 Smith Joe 400002 Jones Mary 500003 Johnson Cathy 44000

Column-Oriented DBMS, Wikipedia, Snapshot Taken onMarch 8, 2010

Serialized As:Row: 1,Smith,Joe,40000;2,Jones,Mary,50000;3,Johnson,Cathy,44000;Column: 1,2,3;Smith,Jones,Johnson;Joe,Mary,Cathy;40000,50000,44000;

Columnar Better Row Better

Aggregates over many rowswith few columns

Aggregates with manycolumns from same row

Adding new individualcolumnar values

Adding new rows when allcolumns present

h d hi ? $$$$$


25/37

Why does this matter to me? $$$$$

If you need to manage100+ TB,Structured and Unstructured Data

Oracle and others - $XXX,000,000

Hadoop + Other Components -$XXX,000

Once you hit Multi-TB range, gettingan RDBMS to scale becomes VERY

expensive!


26/37

Number Seven Advanced Visualization will continue toincrease in depth and relevance to broader audiences

Reports dont inspire!


27/37

Reports dont inspire!

BI m st be interacti e


28/37

BI must be interactive

Visual Examples, Tableau Software, March 2010

BI t b bil


29/37

BI must be mobile

RoamBi: Dynamic Data Visualization for the iPhone, Infosthetics, June 2009


30/37

Number EightOpen Source offerings will continue to makein-roads against on-premise offerings


31/37


32/37

Number 9Data Quality, Data Integration, and DataVirtualization will merge with Master DataManagement to form a unified InformationManagement Platform for structured and

unstructured data

Th I f i M Pl f


33/37

The Information Management Platform

Data Integration Data QualityMaster Data Management Text AnalyticsData Virtualization Metadata Management

Driven to Perform: Risk-Aware Performance Management From Strategy Through Execution, April 2009


34/37

Number TenExcel will continue to provide the dominantparadigm for end-user BI consumption

E l N t i h f hil


35/37

Excel: Not going anywhere for a while

Excel 2010 with enhanced charting, server option (Excel Services)SharePoint 2010PowerPivot

P Pi t


36/37

PowerPivot

A Peek Inside: The client architecture, PowerPivotGeek, November 11, 2009


37/37

Documents

Top$2010$20Emerging$20Trends$20in$20Business$20Intelligence$20 $20Bardoliwalla