Upload
kevin-mcginley
View
355
Download
1
Embed Size (px)
DESCRIPTION
If you've invested in OBIEE and want to start exploring the use of Big Data technology, this presentation talks about how and why you might want to use OBIEE as the common visualization layer across both.
Citation preview
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |Oracle Confidential – Internal/Restricted/Highly Restricted
How to Leverage Your Investment in OBIEE Within a Big Data ArchitectureKevin McGinleyOracle ACE DirectorOwner and Co-founderRed Pill AnalyticsJuly 9, 2014
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Safe Harbor StatementThe following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
Oracle Confidential – Internal/Restricted/Highly Restricted
2
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
How To Leverage Your Investment In OBIEE Within A Big Data
Architecture
4
KEVIN MCGINLEY
@kevin_mcginleymedium.com/@kevin_mcginley linkedin.com/in/kevinmcginley
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
About Red Pill Analytics
Capacity AnalyticsAgile Cloud Development for Oracle BI & Analytics
CheckmateDevOps for Oracle BI
Single DosesTraining + Strategy + Solutioning + Infrastructure + Support
5
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Real Time BI with Kevin & Stewart
• 19 episodes over the last 2 years
• Featured guests from the Oracle BI, EPM, and Big Data industries
• Published on iTunes and YouTube
6
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Contents
• Connect OBIEE To Hive
• Typical Big Data Architecture Today
• Why Integrate OBIEE With Big Data?
7
Connect OBIEE To Hive
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
What Is Hive?
• RDBMS table structures
• ETL capabilities in Hadoop
• SQL-like layer above HDFS
• Auto MapReduce coding
9
Storage
Filesystem(HDFS)
NoSQL(HBase)
Workload Management
MapReduce
Batch SQL(Hive)
Metadata
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
A Basic Hive Table & Query
10
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Connect OBIEE To Hive
11
OBIEE
HiveQL via ODBC
Storage
Filesystem(HDFS)
NoSQL(HBase)
Workload Management
MapReduce
Batch SQL(Hive)
Metadata
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Steps
• Configure odbc.ini
• Download BI Admin tool ODBC drivers for Hive
• Create ODBC DSN
• Import data structures and create metadata
• Update database type
12
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Configure odbc.ini
13
odbc.ini file location
Configure a DSN connection for Hive database
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Create ODBC DSN
14
Choose the Hive driver for the ODBC DSN
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Create ODBC DSN
15
Set the Host and Port the same as
odbc.ini fileSet the default database name to the Hive database
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Create ODBC DSN
16
Test the connection
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Import Data Structures And Create Metadata
17
Create new or import into
existing RPD
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Import Data Structures And Create Metadata
18
Select the newly created DSN for
Hive
Add the user and password
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Import Data Structures And Create Metadata
19
Most of these won’t apply; keep
the defaults
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Import Data Structures And Create Metadata
20
Select the database or
tables like normal
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Update Database Type
21
Double-click the database
Imported table structure
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Update Database Type
22
Change database type to Apache
Hadoop
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Update Database Type
23
You are prompted to edit the
connection pool
Select Yes
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Update Database Type
24
Verify the call interface is ODBC 2.0
Typical Big Data Architecture Today
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
OLTP Data Is Loaded Into Data Warehouse
26
Enterprise Data
Old
Sou
rces
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Experimenting With New Data Sources In Hadoop
27
Big DataEnterprise
Data
Old
Sou
rces
New
Sources
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Different Visualization Tools
28
Big DataEnterprise
Data
Old
Sou
rces
New
Sources
Visualization Tools
Visualization Tools
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Constant Data Movement Back And Forth
29
Big DataEnterprise
Data
Old
Sou
rces
New
Sources
Visualization Tools
Visualization Tools
Why Integrate OBIEE With Big Data?
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Common Visualization Tool = Less Data Movement
31
Big DataEnterprise
Data
Old
Sou
rces
New
Sources
Visualization Tool
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Three Main Reasons To Use OBIEE Across Both
• Streamline data access through common tools
• Provide Hadoop access to users without programming skills
• Federate queries across Hadoop & Oracle database to avoid constant data movement
32
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Federate OBIEE Across RDBMS and Hadoop
33
Hive Table
Oracle Table
Oracle Table
Oracle Table
Oracle Table
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Full Business Model & Presentation Layer
34
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Easy Report Creation
35
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Pros
• Easier data visualization capabilities
• Drag-and-drop ease of access
• No new skills to learn
• Centralized data access
36
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Cons
• Queries against Hive are slower than against Oracle
• Some data/metadata modeling and manipulation is required
• Might be throw-away work
37
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
The Future?
38
OBIEE
Storage
Filesystem(HDFS)
NoSQL(HBase)
Workload Management
MapReduce
Batch SQL(Hive)
Metadata
Interactive SQL(Impala)
Questions?