39
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | How to Leverage Your Investment in OBIEE Within a Big Data Architecture Kevin McGinley Oracle ACE Director Owner and Co-founder Red Pill Analytics July 9, 2014 Oracle Confidential – Internal/Restricted/Highly Restricted

How To Leverage OBIEE Within A Big Data Architecture

Embed Size (px)

DESCRIPTION

If you've invested in OBIEE and want to start exploring the use of Big Data technology, this presentation talks about how and why you might want to use OBIEE as the common visualization layer across both.

Citation preview

Page 1: How To Leverage OBIEE Within A Big Data Architecture

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |Oracle Confidential – Internal/Restricted/Highly Restricted

How to Leverage Your Investment in OBIEE Within a Big Data ArchitectureKevin McGinleyOracle ACE DirectorOwner and Co-founderRed Pill AnalyticsJuly 9, 2014

Page 2: How To Leverage OBIEE Within A Big Data Architecture

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Safe Harbor StatementThe following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

Oracle Confidential – Internal/Restricted/Highly Restricted

2

Page 3: How To Leverage OBIEE Within A Big Data Architecture
Page 4: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

How To Leverage Your Investment In OBIEE Within A Big Data

Architecture

4

KEVIN MCGINLEY

@kevin_mcginleymedium.com/@kevin_mcginley linkedin.com/in/kevinmcginley

Page 5: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

About Red Pill Analytics

Capacity AnalyticsAgile Cloud Development for Oracle BI & Analytics

CheckmateDevOps for Oracle BI

Single DosesTraining + Strategy + Solutioning + Infrastructure + Support

5

Page 6: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

Real Time BI with Kevin & Stewart

• 19 episodes over the last 2 years

• Featured guests from the Oracle BI, EPM, and Big Data industries

• Published on iTunes and YouTube

6

Page 7: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

Contents

• Connect OBIEE To Hive

• Typical Big Data Architecture Today

• Why Integrate OBIEE With Big Data?

7

Page 8: How To Leverage OBIEE Within A Big Data Architecture

Connect OBIEE To Hive

Page 9: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

What Is Hive?

• RDBMS table structures

• ETL capabilities in Hadoop

• SQL-like layer above HDFS

• Auto MapReduce coding

9

Storage

Filesystem(HDFS)

NoSQL(HBase)

Workload Management

MapReduce

Batch SQL(Hive)

Metadata

Page 10: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

A Basic Hive Table & Query

10

Page 11: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

Connect OBIEE To Hive

11

OBIEE

HiveQL via ODBC

Storage

Filesystem(HDFS)

NoSQL(HBase)

Workload Management

MapReduce

Batch SQL(Hive)

Metadata

Page 12: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

Steps

• Configure odbc.ini

• Download BI Admin tool ODBC drivers for Hive

• Create ODBC DSN

• Import data structures and create metadata

• Update database type

12

Page 13: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

Configure odbc.ini

13

odbc.ini file location

Configure a DSN connection for Hive database

Page 14: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

Create ODBC DSN

14

Choose the Hive driver for the ODBC DSN

Page 15: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

Create ODBC DSN

15

Set the Host and Port the same as

odbc.ini fileSet the default database name to the Hive database

Page 16: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

Create ODBC DSN

16

Test the connection

Page 17: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

Import Data Structures And Create Metadata

17

Create new or import into

existing RPD

Page 18: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

Import Data Structures And Create Metadata

18

Select the newly created DSN for

Hive

Add the user and password

Page 19: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

Import Data Structures And Create Metadata

19

Most of these won’t apply; keep

the defaults

Page 20: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

Import Data Structures And Create Metadata

20

Select the database or

tables like normal

Page 21: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

Update Database Type

21

Double-click the database

Imported table structure

Page 22: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

Update Database Type

22

Change database type to Apache

Hadoop

Page 23: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

Update Database Type

23

You are prompted to edit the

connection pool

Select Yes

Page 24: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

Update Database Type

24

Verify the call interface is ODBC 2.0

Page 25: How To Leverage OBIEE Within A Big Data Architecture

Typical Big Data Architecture Today

Page 26: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

OLTP Data Is Loaded Into Data Warehouse

26

Enterprise Data

Old

Sou

rces

Page 27: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

Experimenting With New Data Sources In Hadoop

27

Big DataEnterprise

Data

Old

Sou

rces

New

Sources

Page 28: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

Different Visualization Tools

28

Big DataEnterprise

Data

Old

Sou

rces

New

Sources

Visualization Tools

Visualization Tools

Page 29: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

Constant Data Movement Back And Forth

29

Big DataEnterprise

Data

Old

Sou

rces

New

Sources

Visualization Tools

Visualization Tools

Page 30: How To Leverage OBIEE Within A Big Data Architecture

Why Integrate OBIEE With Big Data?

Page 31: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

Common Visualization Tool = Less Data Movement

31

Big DataEnterprise

Data

Old

Sou

rces

New

Sources

Visualization Tool

Page 32: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

Three Main Reasons To Use OBIEE Across Both

• Streamline data access through common tools

• Provide Hadoop access to users without programming skills

• Federate queries across Hadoop & Oracle database to avoid constant data movement

32

Page 33: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

Federate OBIEE Across RDBMS and Hadoop

33

Hive Table

Oracle Table

Oracle Table

Oracle Table

Oracle Table

Page 34: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

Full Business Model & Presentation Layer

34

Page 35: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

Easy Report Creation

35

Page 36: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

Pros

• Easier data visualization capabilities

• Drag-and-drop ease of access

• No new skills to learn

• Centralized data access

36

Page 37: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

Cons

• Queries against Hive are slower than against Oracle

• Some data/metadata modeling and manipulation is required

• Might be throw-away work

37

Page 38: How To Leverage OBIEE Within A Big Data Architecture

www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics

The Future?

38

OBIEE

Storage

Filesystem(HDFS)

NoSQL(HBase)

Workload Management

MapReduce

Batch SQL(Hive)

Metadata

Interactive SQL(Impala)

Page 39: How To Leverage OBIEE Within A Big Data Architecture

Questions?