39
Enterprise Reporting with ODS Michael Hansen CDO, Executive Director Institutional Analytics and Reporting Oregon State University Corvallis, Oregon [email protected]

Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

Enterprise Reporting with ODS

Michael HansenCDO, Executive Director Institutional Analytics and Reporting Oregon State UniversityCorvallis, Oregon

[email protected]

Page 2: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

Land Grant University - Est. 186832,000 Students9 - Colleges 4 - Campuses34 - Extension Offices

Oregon State University

Page 3: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

o Overview of Oregon State’s ODS/EDW Implementation

o Cost Analysis

o Implementation

o Performance

o OSU’s CORE BI Solution

Today’s Roadmap

Page 4: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

ODS/EDW Overview

Page 5: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

o Banner FIS/HRIS/SIS

o In-House Data Warehouse 1995-2014

o BI Query and Appworx Primary Reporting Tools

o Report Development de-centralized

Oregon State pre-ODS/EDW

Page 6: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

o June 2010 - Purchased Ellucian ODS/EDW, Cognos

o September 2010 - Project Implementation

o January 2013 - Project Closed Prior to Completion

o April 2013 - Project RestartProject Turned Over to Business/IT Project Team

o May 2013 - Cost Analysis, Requirements, RFI/RFP

o June 2014 - Deployed Hybrid BI Solution (ODS/CORE)

o June 2018 - BI Solution celebrated its 4th year of operations

ODS/EDW Project Overview

Page 7: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

Project Restart

January 2013

Page 8: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

April 2013 - Formed Business/IT Project Team

Page 9: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

1) Maintain Baseline ODS/EDW

2) Develop Standard Report Directory 6-second Average Report Rendering Time

3) Future Migration Path

May 2013 - Requirements

Page 10: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

12%840 users

100%6,200 users

$0 additional funding

May 2013 - Requirements

Page 11: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

ImplimentationCost Analysis

Post Mortum

Page 12: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

Cost Analysis

$1,250,000Implementation costs up to closing project

September 2010 through January 2013

Page 13: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

Cumulative Costs 1 yr 5 yr 10yr

Software 305,000 305,000 305,000

Software Maintenance

28,000 310,000 1,040,000

Security Admin 306,000 950,000 1,820,000

Total 639,000 1,465,000 3,165,000

Cost Analysis

4.26 FTE / yrCost equivalent per/year

Page 14: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

Implement Vendor BI Suite vs. Develop a BI Solution

1) Vendor BI Suite

a) No cost savings

2) Develop BI Solution

a) Leverage Site Licensesb) Adopt Open Source

Possible Cost Savings - Software Maintenance

$1,040,000Possible savings

Cumulative Costs 1 yr 5 yr 10yr

Software 305,000 305,000 305,000

Software Maintenance

28,000 310,000 1,040,000

Security Admin 306,000 950,000 1,820,000

Total 639,000 1,465,000 3,165,000

Page 15: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

Object Level Security vs. Role Based Security

1) Object Level Security

a) No savings in maintaining current model

2) Role Based Securitya) One-time cost to assign secuirty levelsb) Automate administration through nightly loads/scripts

$1,820,000Possible savings

Possible Cost Savings - Security Admin

Cumulative Costs 1 yr 5 yr 10yr

Software 305,000 305,000 305,000

Software Maintenance

28,000 310,000 1,040,000

Security Admin 306,000 950,000 1,820,000

Total 639,000 1,465,000 3,165,000

Page 16: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

Implementation

Meeting Project Requirements

Page 17: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

1) Maintain Baseline ODS/EDW

2) Develop Standard Report Portal6-second Maximum Report Rendering Time

3) Future Migration Path

4) No Additional Funding to Implement

May 2013 - Requirements

Page 18: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

1) Maintain Baseline ODS

Issues Encountered in Accomplishing Standard

Oregon State’s Business Practices:

1) Oregon State has over 200 modifications to Baseline BannerImplementation of Banner XE reduced mods to ~20

2) OSU’s use of ‘ID’ (SPRIDEN_ID) for Person SearchBaseline MST_PERSON.ID_NUMBER (SPRIDEN_ID) is not indexed in Baseline ODS

3) OSU’s use of FOPAL Shortcut (INDX)ACCOUNT _INDEX (ACCI_CODE) not universally supported in Baseline ODS

Requirements/Standards

Page 19: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

1) Maintain Baseline EDW

Issues Encountered in Accomplishing Standard

1) Inadequate Bandwidth - Weekly load took 48 - 72 hours

2) Oregon State’s Business Practices did not match delivered EDW product

3) Required Full Rewrite - Product Dropped

Requirements/Standards

Page 20: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

2) Develop Standard Report Portal6-second Maximum Report Rendering Time

Issues Encountered in Accomplishing Standard

1) ODS ViewsPoor performance (Views on Views and Functions)

2) DB Indexes OSU uses INDX short cut (ACCI_CODE, ACCOUNT _INDEX ) for FOPAL Elements which is not universally supported in ODS

3) OSU’s Data from 1995 to present is available If table statistics refreshed too infrequently on large tables Oracle execution plans will not be optimized

Object Name # Rows Threshold # of records # days Last Analyzed

MFT_TRANS_HISTORY 318,248,864 1% 3,182,489 69 07/15/2018

MPT_PAYROLL_DISTRIBUTION 138,730,080 1% 1,387,301 76 07/15/2018

MFT_OPERATING_LEDGER 48,121,755 1% 481,218 53 07/14/2018

MFT_GRANT_LEDGER 5,662,313 1% 56,623 62 06/23/2018

Requirements/Standards

Page 21: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

2) Develop Standard Report Portal6-second Maximum Report Rendering Time

Issues Encountered in Accomplishing Standard

4) ODS Oracle Execution Plans (Oracle 11g)Added Oracle bind aware hint to SQL https://blogs.oracle.com/optimizer/entry/how_do_i_force_ahttps://oracle-base.com/articles/11g/adaptive-cursor-sharing-11gr1

Select /*+bind_aware*/ *From odsmgr.payroll_distributionWHERE org IN(N‘16’, N‘21’, N‘35’)

5) Added Custom SSRS driver to strip out Unicode string constants to deal with Oracle row by row comparison

SSRS prepends ‘N’ to IN(text) WHERE org IN(N‘16’, N‘21’, N‘35’) https://support.microsoft.com/en-us/kb/239530

Select /*+bind_aware*/ *From odsmgr.payroll_distributionWHERE org IN(’16’, ’21’, ’35’)

Requirements/Standards

Page 22: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

3) Future Migration Path to Mitigate Vendor Lock-In

Issues Encountered in Accomplishing Standard

1) Oregon State’s Business Rules required rebuilding framework

2) Proprietary framework

Requirements/Standards

Page 23: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

4) $0 in New Funds to Complete Project

Accomplished Standard

1) Purchase Jaspersoft Software Commercial License$36K per year net increase Funded through software maintenance cost savings $1,040K - 180K = $860K Savings

2) No New Positons Added or Funded Reallocated existing resources

Requirements/Standards

Page 24: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

Architecture

Page 25: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

BI Architecture

CAS

web server app server

access security controls

SSRS/Tableau report servers

ODS Banner

SQL Server

user account access

proxy access

User SecurityManaged at the

application layer

Page 26: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

Role Based Access Control

6,000 employees

650 positions

classifications

security levels

250 employees

security overrides

Page 27: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

13Months to implement ODS Reporting Solution

875 Standard Reports

2,400+ Regular BI Users

Page 28: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

198 of 966 - 20% ODS objects used for production reporting

33custom db objects

75 - 8%ODS Objects in top 50 reports

Page 29: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

Performance

Moniotoring andOptimization

Page 30: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

BI Reporting Portal Adoption

-1,000

0

1,000

2,000

3,000

4,000

5,000

6,000

7,000

8,000

0

10,000

20,000

30,000

40,000

50,000

60,000

Month6 7 8 9 10 11 12 1 2 3 4 5 6 7 8 9 10 11 12 1 2 3 4 5 6 7 8 9 10 11 12 1 2 3 4 5 6 7 8 9 10 11 12 1 2 3 4 5

Year 2014 2015 2016 2017 2018

Reports Run Users

Linear (Users)

Page 31: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

ODS Reporting Performance Metrics

0

1

2

3

4

5

6

7

8

9

10

12 1 2 3 4 5 6 7 8 9 10 11 12 1 2 3 4 5 6 7 8 9 10 11 12 1 2 3 4 5 6 7 8 9 10 11 12 1 2 3 4 5 6

2015 2016 2017 2018

Seconds

Year/Month

Report Rendering Average Time in Seconds

Page 32: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

Monitor ODS Buffer Pool

Page 33: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

Monitor Oracle Execution Plans

Page 34: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

OSU CORE

BI Solution

Page 35: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

OSU CORE

Page 36: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

OSU CORE

Page 37: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

Recognition & Awards

A Common CurrencyBest Practices for the Data-Driven University

2015 NACUBO INNOVATION AWARD

2016 TDWI Best Practices AwardsBI and Analytics on a Limited Budget

Page 38: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

Questions?

Page 39: Enterprise Reporting with ODS - nweug.comnweug.com/presentations/2018/2018_NWEUG_Enterprise_Reporting_… · o June 2010 - Purchased Ellucian ODS/EDW, Cognos o September 2010 - Project

Resources

Education Advisory Board, University Executive Roundtable

• Developing a Data-Driven University, Strategies & Best Practices for Increasing Reporting and Analytical Capacity to Improve Institutional Effectiveness

(©2010 The Advisory Board Company-21067)

• Reinventing IT Services, A Five-Year Road Map for Function

(©2011 The Advisory Board Company-23293)

EAB, IT Forum

• A Common Currency, Achieving Excellence in Data Governance and Adoption of Analytics(©2015 The Advisory Board Company-30820)

National Association of College & University Business Officers (NACUBO)

• Business Officer, March 2016 by Margo Vanover Porter

DYI Data, Oregon State University’s CORE initiative standardizes reporting and makes data accessible to all employees, with the end goal of improving student success

Oregon State University, Business Intelligence Center

For more information: http://fa.oregonstate.edu/bic