Delivering agile business intelligence using data virtualization

Data Virtualization and Business Intelligence | Roadmap Information Subject to Change 1

Data Virtualization and Business Intelligence August 29, 2013 Syed Rasheed Senior Solutions Marketing Manager Kenneth W. Peeples, C|HFI, Security+ JBoss Technology Evangelist

2 Data Virtualization and Business Intelligence | Roadmap Information Subject to Change

Agenda

Syed Rasheed

• Business Intelligence Trends and Challenges

• Data Virtualization Overview

• How Data Virtualization enables Agile BI

Kenneth Peeples

• Data Virtualization Product Architecture

• Demonstration

Both

• Summary

• Q&A


Part I – DV and BI


Top 5 Factors driving the need for Agile Business Intelligence*

1. Constantly changing business needs (65%)

2. IT’s inability to satisfy new requests in a timely manner (57%)

3. The need to be a more analytics-driven organization (54%)

4. Slow and untimely access to information (47%)

5. Business user dissatisfaction with IT-delivered BI capabilities (34%)

Business need arise IT Respond

Agility Gap

* Self-Service Business Intelligence: TWDI Report and Survey of over 625 business and IT professionals


Data Access and Provisioning at the core of Business Intelligence Challenges

Data lives in Silos

With disparate access methods

With disparate storage characteristics

With disparate taxonomy

Common techniques to integrate data are complex, costly and time consuming

Hand coded integration

Replication

ETL

EAI


What is Data Virtualization?

• Data Virtualization makes data that is spread across various disparate sources; available to applications as if it is coming from a single dedicated source.

Data Source

Applications

Data Virtualization


How does JBoss Data Virtualization Works?

JBoss Data Grid

Connect

Compose

Consume

SAP Salesforce.com Oracle DW Hive Excel,

CSV files SQL Server

Unified Customer

View

Unified Product View

Unified Supplier View

JBo

ss

Dat

a V

irtu

aliz

atio

n

BI Analytics & Dashboards Mobile SOA Applications

Unified Virtual Database / Common Data Model

Mainframe

ESB, ETL

Native Data Connectivity

Standard based Data Provisioning JDBC, ODBC, SOAP, REST, XML, JMS, POJO, Hibernate

Data

Co

nsu

mers

D

ata

So

urc

es


Supported Data Sources

Enterprise RDBMS: Oracle IBM DB2 Microsoft SQL Server Sybase ASE MySQL PostgreSQL Ingres Enterprise EDW: Teradata Netezza Greenplum Specialty Data Sources: S-RAMP/ModeShape Repository Mondrian MetaMatrix LDAP

Enterprise & Cloud Applications: Salesforce.com SAP Big Data: Apache Hive NoSQL: JBoss Data Grid (Infinispan) MongoDB Technology Connectors: Flat Files, XML Files, XML over HTTP SOAP Web Services REST Web Services OData Services Office Productivity: Microsoft Excel Microsoft Access Google Spreadsheets


TOP 10 WAYS DATA VIRTUALIZATION ENABLE AGILE BUSINESS INTELLIGENCE DEVELOPMENT


#1 Data Flattening- Simplified Tables


#2 Tools Agnostic Common Data Model

Reusable, Common, Semantic Data Model

Jaspersoft Cognos Business

Object Microsoft Data Consumers

Data Sources

JBoss Data Virtualization Virtual DB


#3 Centralized Data Transformation

Report 1 Report 2 Report 3 Report 4 Data Consumers

Data Sources

JBoss Data Virtualization Format consistency

1234567890

123-456-7890

(123)-456-7890

123/456/7890

123,456,7890

[123]-456-7890


#4 Ubiquitous Data Consumption

BI App 1 BI App 2 BI App 3 BI App 4 Data Consumers

Data Sources

JBoss Data Virtualization Standard based

Provisioning

JDBC, ODBC, SOAP, REST, XML, JMS, POJO, Hibernate


#5 Optimized Data Access

Federating relational query engine.

Rule and cost based optimizer, advanced query planner

Multi-level caching

Pushdown Queries


#6 Centralize Data Integration


Data Sources

JBoss Data Virtualization

Virtual Customer

Master

Virtual Master Data

Virtual Product Master


#7 Centralized Business KPIs & Metrics Calculations


Data Sources

JBoss Data Virtualization Net Profit Operating

Margin Net Sales


#8 No Data Latency

select e.title, e.lastname from Employees as e JOIN Departments as d ON e.dept_id = d.dept_id where year(e.birthday) >= 1970 and d.dept_name = 'Engineering'

Data Source(s)

Virtual Table


#9 Minimization Need for Data Replication and Duplication

Define Data

Structure

Define ETL Logic

Prepare HW

Server

Install and Configure RDBMS

Create Database

Physical DB

Design and

Tuning

Load Tables

and Setup Batch

Updates

Require DBA,

Developer to

maintain and

manage

Design Data

Structure

Define Mappings

Define Virtual Tables

Enable Caching (if need)

Activities required to setup a physical vs. virtual data mart

VS.


#10 Only Open Source Data Virtualization Solution

Community driven innovation

Cost Effective Subscription Model

Best Enterprise Support

Comprehensive Middleware Platform


Big Data Integration

Hadoop


JBoss Data Grid

BI Analytics (historical, operational, predictive)

Capture, Process and Integrate Data Volume, Velocity, Variety

SOA Composite Applications

JBoss Messaging & Event Processing

Structured Data Streaming

Data Semi-

Structured Data

Red Hat Enterprise Linux Red Hat Storage

Cap

ture

& P

rocess

In

teg

rate

& A

naly

ze




Part 2 – Data Virtualization Demonstration


●JBoss Data Virtualization is a

data federation and

virtualization engine (the Teiid

Server) that allows you to query

multiple data sources

(RDBMSs, web services, files,

applications, etc) as though

they were a single unified

source.

●It builds on the JBoss EAP and

SOA Platforms and includes

model-driven development tools

and rich management

capabilities along with a robust

runtime

●The Teiid Server Runtime

executes as an additional

service/capability within the

JBoss container.

JBoss Data Virtualization Components

EDS v5



•Turn the data you have into the information you want.

•Standards-based read/write access to heterogeneous data stores in real time.

•Speeds application development by simplifying access to distributed data.

•Transforms data structure and semantics through data virtualization.

•Consolidates data into a “single view” without the need for more data.

•Centralized access control, auditing through robust security infrastructure.

•Creates services that provision data to business process in your SOA.

•Enterprise-proven – flexible, scalable, high-performance.


Data Service Data Service Data Service

SQL Web

Services


What does Data Virtualization/Teiid do?

Data Virtualization, with a focus on optimized real-time access.

Like a database, but the planner and optimizer are geared to data integration.

• Query decomposition/push-down

• XA Transactions for writes

Convenient relational abstraction with lots of other features

• XML Document Models

• SQL Views, Procedure language, XQuery integration

• Available as a JDBC driver, includes optional ODBC driver

• Built-in integration with RDBMSs, XML sources, LDAP, Salesforce, Services etc.

Tight integration with Teiid Designer


What does Teiid Designer do?

Creates source models

• By importing metadata

• By manually defining metadata

Creates view models

Creates Virtual Databases (VDB)

Uses Teiid (integrated with the Designer) to allow querying models prior to deployment



Three Topics that will be covered in the demo

• Decouple Data access logic from BI applications and Data Flattening

• BI tool agnostic, reusable, business friendly semantic data model(s)

• Improve security and compliance with centralized KPIs and metrics calculations


Prerequisites

Maven 3.0.3 or higher

JDK 1.7

JBoss Developer Studio 7

EAP 6.1

Teiid and Teiid Designer

Source to be posted

https://github.com/kpeeples/dv-and-bi.git

Article from Webinar

www.ossmentor.com - Teiid (Data Virtualization) and Business Intelligence







http://www.ossmentor.com/


Steps to create the example project

Scope: Walk through the Teiid Designer to create the virtual databases and deploy them to JBoss

Section 1 – Setup http://www.jboss.org/products http://download.jboss.org/jbosstools/updates/integration/kepler/in

tegration-stack/aggregate/4.1.2/ http://www.jboss.org/teiid http://www.jboss.org/teiiddesigner Section 2 – Teiid Designer Section 3 – Web Console Section 4 – Teiid Dashboard

http://www.jboss.org/products

http://download.jboss.org/jbosstools/updates/integration/kepler/integration-stack/aggregate/4.1.2/




http://www.jboss.org/teiid

http://www.jboss.org/teiiddesigner


Part 3 - Closing


Data Virtualization Benefits

• Empower your organization with instant access to the right data, at the right time, for the right people.

• Respond faster to change with flexible information infrastructure.

• Save co$t of unnecessary data replication and duplication.

• Complements existing integration technologies and approaches (SOA, ETL, EAI)

• Derive value from ALL new and old data sources – Big Data, Cloud Data, SaaS etc.


Call to Action

Evaluate JBoss Data Virtualization for your BI project

Download the software from Jboss.org

Get Started Quick download the demo

Red Hat JBoss Middleware

Deliver More, On Time, On Budget


Questions?