56
Oracle BI Applications and OBIEE – New Developments Shyam Nath, IBM / BIWA SIG Robert Davis, Oracle May 2011

Oracle BI Applications and OBIEE – New Developments

Embed Size (px)

DESCRIPTION

• Reporting and Analytics Overview -Operational to Analytical• OBIEE (10g, 11g, 11.1.1.5)• Oracle Business Intelligence Applications• Value proposition of Packaged BIApplications• Sneak peak to BI Apps 7.9.6.3• Migration considerations to 7.9.6.3

Citation preview

Page 1: Oracle BI Applications and  OBIEE – New Developments

Oracle BI Applications and OBIEE – New Developments

Shyam Nath, IBM / BIWA SIG

Robert Davis, Oracle

May 2011

Page 2: Oracle BI Applications and  OBIEE – New Developments

Agenda

• Reporting and Analytics Overview -Operational to Analytical

• OBIEE (10g, 11g, 11.1.1.5)

• Oracle Business Intelligence Applications

• Value proposition of Packaged BI Applications

• Sneak peak to BI Apps 7.9.6.3

• Migration considerations to 7.9.6.3

Page 3: Oracle BI Applications and  OBIEE – New Developments

About Shyam

• OBIEE Architect with IBM GBS (Oracle Practice)

• OCP since 1998 on 4 different DB versions

• President/Founder of BIWA SIG – an IOUG SIG for BI, DW and Advanced Analytics professionals

• Regular speaker at Oracle OpenWorld (since ’03), Collaborate (since ’05), ODTUG-KScope (since ’08), BIWA Summit and RUG’s (NY/RM/SF/NO etc.)

• Bachelor’s from IIT-India, MBA and MS from Florida Atlantic University, Boca Raton, FL

Page 4: Oracle BI Applications and  OBIEE – New Developments

About Robert

• Oracle, Director - BI Applications with a focus on Partnerships & Alliances

• First exposure to BI was with Teradata in the early 90’s

• Supporting the BI Applications for over 8 years at Siebel and now Oracle

Page 5: Oracle BI Applications and  OBIEE – New Developments

OBIA – OTN Forum

Regular Contributor to OTN BI Apps Forumhttp://forums.oracle.com/

Page 6: Oracle BI Applications and  OBIEE – New Developments

OBI 11.1.1.5 / 7.9.6.3 Released!

OBIEE 10g OBIEE 11.1.1.3

OBIEE 11.1.1.5

OBIEE 10g

OBIA 7.9.6.2OBIA 7.9.6.3

How I felt about it!

Supported! Certified!

Page 7: Oracle BI Applications and  OBIEE – New Developments

7

BI Application – New Looks and Feel with 11.1.1.5!

Chart zooming

Page 8: Oracle BI Applications and  OBIEE – New Developments

Oracle BI 11.1.1.5 ReleasedOBIEE 11g Changes and New Features

• Focuses on OBIEE 11.1.1.5.0 – BI Platform• Presented May 25, 2011, noon ET (next Wed)• Major topics:

– First patch release for OBIEE 11g– Support for Oracle BI Applications release 7.9.6.3– Full support for the Apple iPad– Full support for OLAP sources including Essbase and Oracle OLAP– New support for Oracle TimesTen, MS SQL Server Analytic Services, and

SAP BW– Reduced memory requirements for Weblogic and streamlined install– 64-bit BI Admin Tool– New visualizations in the BI Admin tool– New BI Metadata Web Service

• Includes live demo of many new features• Presented by Dan Vlamis, Vlamis Software Solutions• Oracle PMs will be available for questions

Page 9: Oracle BI Applications and  OBIEE – New Developments

Operational v/s Analytical System

Page 10: Oracle BI Applications and  OBIEE – New Developments

Traditional Circular Join OBIEE Star (Logical/Physical)

BI Apps –Other Extreme

Page 11: Oracle BI Applications and  OBIEE – New Developments

Why Star Schema’s?

• ComputerWorld on Business Intelligence

BI Analysts salary range $82–$116K Data Modelers $81 – $111K, ComputerWorld Mar 2011

Page 12: Oracle BI Applications and  OBIEE – New Developments

OBIEE v/s Packaged BI Application

CRM ANALYTICS

ERP ANALYTICS

ORACLE BI ENTERPRISE EDITION (OBIEE)

AND OTHER OPERATIONAL AND ANALYTIC SOURCES

Sales

MarketingService and Contact Center

PriceLoyalty

FinancialsProcurement and Spend

Supply Chain and Order

Management

ProjectsHuman

Resources

Page 13: Oracle BI Applications and  OBIEE – New Developments

Case Studies - I

Family owned, 50 yrs old, $1b+ manufacturing company in Atlanta, GA•Several manufacturing plants using systems like JD Edwards, Demantra, EPM/Planning and Legacy/Main frame systems•ODS/Crystal Reports footprint•First formal DW initiative•OBIEE, ODI and BIP as tech stack•Need for Manufacturing, Plant Shop floor analytics, job profitability and Sales Analytics in first go•EPM-Workspace Integration•Highly formatted and complex BI Publisher reports•Better insights to profitability and cost to service a customer

Energy Services Company publicly traded, ~$2b in Houston, TX•New EBS R12 implementation in 4 divisions, HFM, Planning, one div replacing SAP•First formal DW initiative•OBIEE and BI Applications purchased•Need for HR, SCM/Procurement, Finance Analytics•Go-live in Phases such as HR, Fin and SCM•Other Energy industry specific applications in use•Some SQL Server/Crystal Reports•Better view of business across the enterprise

Page 14: Oracle BI Applications and  OBIEE – New Developments

Why OBIEE v/s BI Apps?

OBIEE•Need to integrate JD Edwards data with legacy mainframe data as manufacturing plants are in transition•In 2009 time frame BI apps for JDE Edwards have no coverage for manufacturing, shop floor production data and job profitability•Cost allocation engine needed for job costing and profitability•OBIEE, ODI and BIP as tech stack, shop trying to stay as Oracle tech/apps shop•Security with EPM-Workspace needed as Essbase/Planning in use since V7•Resulted in 4 subject areas

BI Apps•New ERP implementation provides opportunities packaged analytics for rapid deployment as the starter DW•One manufacturing division replacing SAP, so challenges in replacing existing SAP - Easy Access functionality•EBS Versions sliding from R12.1.1 to R12.1.3•No coverage for Oracle Process Manufacturing, HR Advanced Benefits etc in BI Apps today•HFM being used for consolidation and Eliminations•Resulted in HR, SCM/PS and Fin analytics as starters

Page 15: Oracle BI Applications and  OBIEE – New Developments

JD Edwards Tables

• The JD Edwards table names are quite cryptic

• This shows that that for building custom OBIEE solutions, deep ERP knowledge is required

• Need for data modeler, ETL/OBIEE architect and developers

Page 16: Oracle BI Applications and  OBIEE – New Developments

Oracle EBS Object NamesObject Name Function of the object E.g.

_ALL Underlying table with all the values PO_DISTRIBUTIONS_ALL

_B Base of underlying table, same as _ALL RA_TERMS_B

_TL Language translation table with translation of

descriptive fields in different languages

_VL View based on translation table OKE_K_Deliverables_VL

_BASIC_V View on top of the Basic table

_DFV Descriptive Flex Field related view, it will

have the defined values as Column names

instead of generic attribute 1, ..2

_KFV Key Flex Field views contain the

concatenated fields as it would be

displayed to the user. For e.g. A field may

consist of Division, Department and

Account fields and the KFV will have the

concatenated values.

Page 17: Oracle BI Applications and  OBIEE – New Developments

EBS Naming Conventions

• All objects accessed by EBS application have synonym in APPS schema, e.g.OKE.OKE_K_LINES has synonym APPS.OKE_K_LINES

• EBS Forms fetch data from a “user friendly” view with name ending is _V or _VL (e.g. OKE_K_Deliverables_VL).

• Views have descriptive value as opposed to the numeric id’s fields stored in the base table making it “human-readable” for reports.

• Views also implement security and restrictions to the data in various forms such as restrict values by language, org_id etc

• These variables are set by EBS (session context) when the user accesses data via the EBS application.

Page 18: Oracle BI Applications and  OBIEE – New Developments

Some EBS Schema Names

AP - Oracle Payables

AR - Oracle Receivables

GL - Oracle General Ledger

INV - Oracle Inventory

MRP - Oracle Master Scheduling/MRP

PA - Oracle Projects

PAY - Oracle Payroll

PER - Oracle Human Resources

PJM - Oracle Project Manufacturing

WIP - Oracle Work in Process

WMS - Oracle Warehouse Management System

WSH - Oracle Shipping

WSM - Shop Floor Management

Page 19: Oracle BI Applications and  OBIEE – New Developments

Install Process – BI Apps Route

• End user machines requires no software, browser based assess

• Windows boxes required for client software and for transferring some server software (A and B)

• Co-location of InformaticaPowerCenter Services and DAC Server – C

• Clients can be installed on multiple Windows boxes

Page 20: Oracle BI Applications and  OBIEE – New Developments

High Level Data Flow

• Source – eBS (Raw Data)

• ETL – Extraction Transform and Load (Informatica – PowerCenter or ODI)

• OBAW - Business Analytics Warehouse

• OBIEE Metadata

• OBIEE Content – Reports and Dashboards

Page 21: Oracle BI Applications and  OBIEE – New Developments

OBIEE – From Surface to Plumbing

Page 22: Oracle BI Applications and  OBIEE – New Developments

Supporting Infrastructure – Informatica and DAC

Page 23: Oracle BI Applications and  OBIEE – New Developments

Case Studies - II

Offshore Petroleum Services Company

•PeopleSoft and BI Apps

•2011 Q1 go-live with 7.9.6.2 and OBIEE 11.1.1.3, Platform update•Challenges resolved manually•For BI Apps 7.9.6.3 intake OBIEE needs to be upgraded too•Users are able to utilize enhanced visualization features of OBIEE 11g

Financial Services Company for Retirement Planning

•PeopleSoft, BI Apps and Financial Services Vertical App (OFSAA)

•HR Analytics is live •Fin Analytics to go-live on 7.9.6.2•Fin Srvc vertical BI apps uses OBIEE 10g and Essbase•Complex hierarchies DRM/Essbase•First step towards unified end user experience using OBIEE 10g

Page 24: Oracle BI Applications and  OBIEE – New Developments

24

• OBIEE 11g uses Fusion Middleware (FMW) components extensively, including the WebLogic Server (WLS) and Oracle Process Management Network (OPMN)

• WLS improves scalability and provides unified security framework

• Enterprise Manager provides a single platform to manage all applications from a single place.

• Only WLS supported so far (no support for WebSphere etc)

OBIEE 10g vs. OBIEE 11g architecture

10g architecture 11g architecture

Page 25: Oracle BI Applications and  OBIEE – New Developments

25

Installing BI Apps – Change from 7.9.6.2 to 7.9.6.3

• 7.9.6.2 looked for 10g(Trick the system!)

• 7.9.6.3 looks for 11g folder structure

• WLS Server Details

Page 26: Oracle BI Applications and  OBIEE – New Developments

Lessons Learnt 7.9.6.2 with OBIEE 11.1.1.3

• Categories:– RPD and Presentation

– LDAP and Security

– Custom branding of OBIEE

Page 27: Oracle BI Applications and  OBIEE – New Developments

27

Upgrade Decision process prior to 7.9.6.3 / 11.1.1.5 release

The OBIEE 11g Upgrade Decision Process

Use OBIEE 10g

Value rank

Consideration

Preferred platform Category

10g 11g

1 Use of action framework Architecture

2 Certification of Oracle BI applications

Certification

3 OS/Web server compatibility Certification

4 Data warehouse database certification

Certification

5 Integration with Hyperion/Essbase

Architecture

6 Tighter integration with BI publisher

Architecture

7 Consolidated maintenance Architecture

8 Scalability Architecture

9 Proven and time tested Other

10 Web browser compatibility Certification

11 Enhanced UI features Usability

12 Availability of resource pool Other

• New Custom OBIEE Implementation

• Existing custom OBIEE 10g implementations

• Upgrade custom implementations of OBIEE using Web Logic on Linux, Windows OS

• New implementation of OBIEE utilizing Oracle BI Applications – up to 7.9.6.2

• Existing OBIEE Implementations using one or more Oracle BI Applications

Upgrade Decision matrix Sliding Scale

Use OBIEE 11g New

Exis

ting

Page 28: Oracle BI Applications and  OBIEE – New Developments

28

Oracle BI Application 7.9.6.3 – Relevant Files

OBIEE

Platform

DAC /

Informatica

Page 29: Oracle BI Applications and  OBIEE – New Developments

29

BI Apps 7.9.6.3 - Upgrade Flow (11.1.1.5)

Page 30: Oracle BI Applications and  OBIEE – New Developments

30

Informatica 9.0.1 HF2 is the Data Integration / ETL Platform

Informatica 8.6.x going out of support by year end

Do not install Informatica in a directory with space in the name, for e.g. do not install in D:\Program Files\INFA

Page 31: Oracle BI Applications and  OBIEE – New Developments

OBIEE / BI Apps with “Appliance”Like DBMS System

• A very large Retailer – BI Apps on Exadata V2

• BI Apps on Teradata and Netezza??

Terdata (including V13.10 ) is supported for both OBIEE / OBIA

• Netezza is supported for OBIEE via ODBC, native connectivity expected in 11.1.1.6, no support for OBIA)

Page 32: Oracle BI Applications and  OBIEE – New Developments

Teradata BI Apps Best Practices

• For maximizing performance in Teradata deployments, follow these:

• Collect Statistics as a Prerequisite else ETL performance impact and possibly spool space error (error # 2646)

• LEFT OUTER JOIN Issue – some queries and source qualifiers may have to be re-written

• Group By is more efficient than Distinct – when low number of distinct values

• Pruning of Mappings and Tables – improve performance by stripping extraneous fields from mappings & tables

• Loader Configurations – Tpump, Moad, FastLoad etc.

• More tips in Document e19038.pdf – sec 3.5.2

Page 33: Oracle BI Applications and  OBIEE – New Developments

BI Apps with Exadata

• The Full Table Scan is no longer your enemy on Exadataside! FTS is very quick in Exadata but not in the regular 11g databases – source DB’s can choke!

• In certain situations the performance bottleneck at the source system database as it was not able to feed the Exadata box at it's import capacity – consider flat file extracts from sources and using DBFS

• The performance configurations like indexes might not be required in the Exadata boxes in certain situations

• Drop the distinct key indexes and change stats method in customsql.xml

Page 34: Oracle BI Applications and  OBIEE – New Developments

BI Apps on Exadata

• On larger tables like - AP_AE_LINES_ALL, avoid PARALLEL query option, the difference in time observed was from 4 hours to 2 minutes.

• Disable or drop all indexes with distinct_keys = 1 (b-tree and bitmaps) reason being such indexes are ineffective, with one unique value. So it's highly unlikely that Optimizer would ever consider them in building any execution plans, e.g. W_AR_XACT_F_F63,

W_GL_REVN_F_F35, W_GL_REVN_F_F24

• Avoid query transformation into a union-all query and scanning all the big tables twice. Here we will need to find a workaround to avoid the union-all to scan the tables once or find a way to reduce full scanning of the tables (partitioning/index etc). e.g table W_GL_ACCOUNT_D 8 mil rows getting scanned without any valid filtering

• Partitioned tables must have stats at both table and partition level

Page 35: Oracle BI Applications and  OBIEE – New Developments

Recap

• Looked at OBIEE v/s BI Apps

• Recent Development and Impacts

• Case Studies – your mileage may vary!

• Next part – Sneak Peak to 7.9.6.3

Page 36: Oracle BI Applications and  OBIEE – New Developments

Robert Davis

Oracle BI Apps 7.9.6.3 &

Sneak Peak

Page 37: Oracle BI Applications and  OBIEE – New Developments

Some Recent Development

• OBIEE 11.1.1.5 released for download on May 6, 2011

• OBI Apps 7.9.6.3 released same time!

• BI platform and BI apps are in-sync

• Last release 7.9.6.2 (09/2010) came after OBIEE 11.1.1.3 (08/2011) but was “supported” not “certified”

• Focus on exploiting 11g features and Mobile computing

Page 38: Oracle BI Applications and  OBIEE – New Developments

…recent

• BI Apps 7.9.6.3 requires– New BI platform

11.1.1.5– New Informatica

platform 9.0.1– New DAC (not 11g yet)

but hot fixed version 10.1.3.4.1

– Teradata 13.10 support

• Provides iPad/iPhonesupport out of box

Campaign PerformanceDashboard on iPad

BI Apps on iPhone

Page 39: Oracle BI Applications and  OBIEE – New Developments

General Direction – 7.9.6.3

• In 7.9.6.3 focus was on making the rpd, webcat and security model 11g ready.

• Oracle switched to role based security from group based• Some fixes in the rpd to satisfy the stricter consistency

checking in 11g • Leveraged some new Presentation capabilities in the

reports and dashboards (such as presentation hierarchies).

• OBIEE 11g now allows BI apps to unlock a breadth of new capabilities such as mobile/iPad, better systems management, scorecards, etc.

• Primarily a certification release

Page 40: Oracle BI Applications and  OBIEE – New Developments

Security Changes – 7.9.6.3

• New Security Model User>Group>Role

• RPD files now have RPD-specific passwords - used to encrypt the contents.

• Groups no longer exist in the RPD as objects. Data access security is implemented based on application roles to which a user belongs.

• Application roles are managed in an external policy store, exist in the RPD, as pointers (references) to the externally managed roles.

• Users managed in an external authentication provider, no longer in RPD. User objects exist in the RPD, as pointers (references) to the externally managed users.

WebLogic Server• User Administration • Group Administration

Enterprise Manager• Role Administration

Page 41: Oracle BI Applications and  OBIEE – New Developments

Oracle BI Applications Release Roadmap

7.9.77.9.7

OD

IIN

FA 7.9.6.27.9.6.2

11g11g

11g PS111g PS111g PS211g PS2

SAP

Apps

Unlimited

Fusion Apps

Convergence Release

•Dual ETL Support

•Applications Unlimited

•Fusion Apps

•SAP

•Select Edge / Industry7.9.6.37.9.6.3

Certification with OBIEE 11g

7.9.6.17.9.6.17.9.67.9.6

7.9.5.27.9.5.2

Available

Planned

7.9.7.17.9.7.1

Page 42: Oracle BI Applications and  OBIEE – New Developments

Future Directions - BI Apps

• Users often want one

place / tool for Operational and Analytical reporting

•Degree of details in warehouse•Right time data –need for intra-day ETL•Highly Formatted reports

•Security model across BI and Source Systems.

Page 43: Oracle BI Applications and  OBIEE – New Developments

Oracle BI Applications 7.9.6.311g Features

• Master Detail Linking

• Chart Sliders & Zooming

• Hierarchical Columns

• View prompts

• Cascading Prompts

Page 44: Oracle BI Applications and  OBIEE – New Developments

Procurement and Spend Analytics

Chart zooming

Page 45: Oracle BI Applications and  OBIEE – New Developments

Supply Chain and Order Management Analytics

Page 46: Oracle BI Applications and  OBIEE – New Developments

Graph SlidersPlayback option

Supply Chain and Order Management Analytics

Page 47: Oracle BI Applications and  OBIEE – New Developments

Graph Sliders

Master Detail Linking

Supply Chain and Order Management Analytics

Page 48: Oracle BI Applications and  OBIEE – New Developments

Select 2009 Q4

Detail graph shows Trend by Month for the

selected quarter

Supply Chain and Order Management Analytics

Page 49: Oracle BI Applications and  OBIEE – New Developments

Project AnalyticsIn-place Drill using

presentation hierarchies

Page 50: Oracle BI Applications and  OBIEE – New Developments

In-place Drill using presentation hierarchies

Fiscal Quarter shows only 2008

values

Cascading Prompts Select Fiscal Year = 2008

Financial Analytics

Page 51: Oracle BI Applications and  OBIEE – New Developments

Graph Sliders

Playback option

Enhanced Visualizations

Financial Analytics

Page 52: Oracle BI Applications and  OBIEE – New Developments

Human Resources Analytics

Page 53: Oracle BI Applications and  OBIEE – New Developments

Oracle Mobile for BI Apps

• Native mobile apps with full Dashboard functionality and all BI content types– Dashboard Drill/Navigate– Catalog navigation– Favorites– Alerts– Search– Actions

• Dashboards dynamically adjust to exploit the form-factor of the device

• Device support– iOS iPhone and iPad in 11.1.1.5– Android next– Blackberry awaited??

Page 54: Oracle BI Applications and  OBIEE – New Developments

Oracle BI Applications on Apple ipadExample: Marketing Analytics

Page 55: Oracle BI Applications and  OBIEE – New Developments

BI Apps Customers to 11g

Two approaches:• Upgrade to BI Applications

7.9.6.3– Certifies 11.1.1.5, out of the box support

for 11g capabilities– Recommended choice for net new

implementations and existing BI Apps customers needing 11.1.1.5 capabilities alike

• Platform-only upgrade for existing BI Apps deployments– Fully supported with OBIEE 11.1.1.5 but

not without challenges– Good option for heavily customized

deployments with strong need for 11.1.1.5 features

– Case Study of 7.9.6.2 customer

Page 56: Oracle BI Applications and  OBIEE – New Developments

� Recap OBIEE

� Recap BI Applications

� New 7.9.6.3

� Questions

[email protected]

� Follow up discussions at:

http://oraclebiwasig.blogspot.com/

Summary / Questions

Thanks to IOUG, Florian Shouten, Rich Solari, Abhinav Banerjee