20
Tennessee Board of Regents ODS/EDW Planning Presented by Thomas Danford Fall 2007

TBR ODS EDW Planning 2007

Embed Size (px)

DESCRIPTION

Presentation used to gain consensus on the adpotion of a data warehousing solution for the TBR.

Citation preview

Page 1: TBR ODS EDW Planning 2007

Tennessee Board of Regents

ODS/EDW Planning

Presented by Thomas Danford

Fall 2007

Page 2: TBR ODS EDW Planning 2007

Information Requirements of the TBR

Administrative and Academic Institutional Research

A i l d fDepartments

Easy-to-understand data layout coupled with industry-based, easy-to-use reporting tools that

A single, trusted source of institutional data

Accurate data based on consistently applied institutional b i l

CIO/IT audience

allow end-users to satisfy their own requests

business rules

Robust Information Access architecture based on commercially supported tools

An abstracted data model built

Executive Level

The same information “visible” to all layers of the institution

with and for higher education

Supports choice of reporting tools to meet varied needs and budgets

Less time arguing over data; more time using information to make better and timely decisions

2

Page 3: TBR ODS EDW Planning 2007

Reporting out of Banner can be Complex

EXAMPLE: The simple report below for 5 pieces of information requires accessing data fields from 4 Banner tables:

ID Name Address Phone Age_______________________________________________________________123-43-4564 Buler, Brian 1464 West Street West Chester PA (453)657-5768 43324-64-3445 Carol, Bob 84 South Street Philadelphia PA (728)495-4535 34848-39-4848 Crain, Joan 23 Brandywine Kenneth PA 23834-56-3443 Kaachen, Perry 3444 Broadview Allentown PA (435)309-5445 54…..….…

3

..

.

Page 4: TBR ODS EDW Planning 2007

Banner Normalizes Data (3rd Normal Form) so that it exists only in one locationthat it exists only in one location

The tables for the

SPRIDEN

The tables for the example report:

SPBPERS SPRADDR

SPRTELE

4

Page 5: TBR ODS EDW Planning 2007

SQL is the programming language used to manage data in Bannerto manage data in Banner

The SQL code for the example report:SELECT SPRIDEN_ID,SPRIDEN_NAME,SPRADDR_STREET_LINE1,SPRADDR_CITY,SPRADDR_STAT_CODE,SPRADDR_ZIPC_CODE,SPRTELE_PHONE_AREA_CODE||’-’||SPRTELE_PHONE_NUMBER,FUNC(AGE(SPBPERS_BIRTH_DATE))FROM SRPIDEN,A.SPRADDR,B.SPRTELE,SPBPERSWHERE SPRIDEN_CHANGE_IND IS NULLAND SPRIDEN_PIDM = SPBPERS_PIDM (+) AND SPBPERS_PIDM = SPRADDR_PIDM (+)AND SYSDATE BETWEEN A.SPRADDR_FROM_DATE (+) AND A.SPRADDR_END_DATE (+)AND A.SPRADDR_ADDR_CODE (+) = FUNC(ADDRHICR(SPRIDEN_PIDM,”OF”)AND A.SPRADDR_ASTA_CODE (+) = “A”AND A.SPRADDR_PIDM = B.SPRTELE_PIDM (+)AND A.SPRADDR_ADDR_CODE = B.SPRTELE_ADDR_CODE (+)AND B.SPRTELE_SEQ_NO (+) = (SELECT MAX( C.SPRTELE_SEQ_NO)

FROM C.SPRTELEWHERE C.SPRTELE_PIDM = B.SPRTELE_PIDMAND C SPRTELE ADDR CODE

5

AND C.SPRTELE_ADDR_CODE = B.SPRTELE_ADDR_CODE)….

…ORDER BY SPRIDEN_NAME;

Page 6: TBR ODS EDW Planning 2007

Approach Under Plus - IT Department Made Reports Based on Specifications Provided by Functional Users …

Frustrating developing specifications

Inefficient iterative processInefficient iterative process

Very time consuming

Multiple functional users competing for limited IT resources

Functional dependency on IT developed

6

Page 7: TBR ODS EDW Planning 2007

Information Access Maturity Model

SunGardSunGardPlusPlus

InstitutionalInstitutionalP fP f

AnalyticalAnalyticalR tiR ti

SelfSelf--ServiceServiceR tiR ti

PlusPlus

Reporting Created byReporting Created byPerformancePerformanceManagementManagementProcess ImprovementProcess ImprovementDashboard/ScorecardDashboard/ScorecardAnalytical ApplicationsAnalytical Applications

ReportingReportingHistorical TrendsHistorical TrendsForecastingForecastingData MiningData Mining

ReportingReportingAdAd--HocHoc

IT StaffIT Staff

Tim

e

CustomCustomReportsReports

Level 1 Level 2 Level 3 Level 4 Level 5

BaselineBaselineReportsReports

7

Not Available

Page 8: TBR ODS EDW Planning 2007

ODS/EDW & Banner ApproachODS/EDW & Banner Approach

Instead of continually spending IT staff time andInstead of continually spending IT staff time and budget on developing and programming reports for functional users, we will develop the infrastructure that simplifies how information is accessedsimplifies how information is accessed.

The infrastructure must support the enterprise and provide both a common framework and methodologyprovide both a common framework and methodologyfor solving Information access problems.

Simplifying the access gives both IT and functionalSimplifying the access gives both IT and functional users the information they need, when they need it, with less of an effort.

8

Page 9: TBR ODS EDW Planning 2007

Information Access Maturity Model

SunGardSunGardEnterprise Enterprise D t D t

SunGard SunGard Operational Operational D t StD t St

SunGardSunGard

BannerBannerData Data WarehouseWarehouse

Data StoreData StoreBannerBanner

AnalyticalAnalytical

InstitutionalInstitutionalPerformancePerformanceManagementManagement

S G d S G d

Tim

e

SelfSelf--ServiceService

AnalyticalAnalyticalReportingReporting

••Historical TrendsHistorical Trends••ForecastingForecasting••Data MiningData Mining

ManagementManagement••Process ImprovementProcess Improvement••Dashboard/ScorecardDashboard/Scorecard

••Analytical ApplicationsAnalytical Applications

SunGard SunGard PerformancePerformanceManagementManagementSolutionsSolutions

CustomCustomReportsReports

ReportingReporting••AdAd--HocHoc

gg

Level 1 Level 2 Level 3 Level 4 Level 5

BaselineBaselineReportsReports

9

Institution Adoption

Page 10: TBR ODS EDW Planning 2007

Information Access Maturity Model

SunGardSunGardPerformancePerformanceM t M t

SunGard SunGard Enterprise Enterprise D t D t

SunGard SunGard Operational Operational D t StD t St

SunGardSunGardBannerBanner

Management Management SolutionsSolutions

Data Data WarehouseWarehouse

Data StoreData Store

KPIsKPIs

OtherOtherSystemsSystems

BannerBanner ODSODS EDWEDWETL ETLETLKPIsKPIs

AlertsAlerts

BANNERBANNERQUERIESQUERIES

CUSTOMCUSTOMREPORTSREPORTS

SELFSELF--SRVCSRVCREPORTSREPORTS

Oracle DiscovererOracle DiscovererCognos ImpromptuCognos Impromptu

OLAPOLAPCUBESCUBES

ScorecardsScorecardsDashboardsDashboards

Level 1 Level 2 Level 3 Level 4 Level 5

&REPORTS&REPORTSg p pg p p

Others (any ODBC)Others (any ODBC) Cognos PowerplayCognos PowerplayOthersOthers

DashboardsDashboards

10

Page 11: TBR ODS EDW Planning 2007

11

Page 12: TBR ODS EDW Planning 2007

Data Modeling Strategy

Model specifically designed for end-user reporting

Applicable TBR (enterprise) wide

Simplified & standardized data structures

User-friendly table and field names

Designed from a reporting perspectiveg p g p p

Indexed and optimized for reporting

Flexible enough for individual campusFlexible enough for individual campus requirements

Consistency between Banner product releases

12

Consistency between Banner product releases

Page 13: TBR ODS EDW Planning 2007

Key Roles in ODS/EDW

(Senior) Data Architect(s) – An IT management role that is responsible for the data modeling, ETL processing, and administration of the ODS/EDW. Experience and Responsibilities:p

Designs data dictionaries & data warehouses Enterprise application and analytics integration Metadata registry Oracle RDBMS and Structured Query Language (SQL) XML, including schema definitions and transformationsODBC/JDBC linkages & reporting tools

Business & Systems Analyst(s) – An internal consultancy role that identifies options for improving business systems and bridges the information needs of the business with the use of the ODS/EDW. Experience and Responsibilities:

Gathers and defines business requirements Analyzes, maps, and documents processes (current state/future state) Identifies, collects, and analyzes data requirements (forecasting, trend analysis, etc.)Contribute to the design of the ODS/EDW from a business needs point of viewC t i d t KPI’ l t d d hb d t

13

Creates required reports, KPI’s, alerts, scorecards, dashboards, etc. ODBC/JDBC reporting tools

Page 14: TBR ODS EDW Planning 2007

Data Model Approach & Responsibilities

Model specifically designed for On Line Analytical Processing (OLAP) reportingAnalytical Processing (OLAP) reporting

Enterprise WideStar SchemasStar SchemasDesigned from a departmental perspectiveMultidimensional business analysisMultidimensional business analysis

Complex calculationsTrend analysisTrend analysisSophisticated data modeling

Documenting the ODS/EDW (ERDs Data Dictionaries

14

Documenting the ODS/EDW (ERDs, Data Dictionaries, Flow Charts, Metadata, etc.)

Page 15: TBR ODS EDW Planning 2007

Example: The Enrollment Star

15

Page 16: TBR ODS EDW Planning 2007

ETL Processing ResponsibilitiesCommercial ETL tool

Oracle Warehouse Builder (OWB)Oracle Warehouse Builder (OWB)Improved customizationImproved extensibilityImproved extensibilityUser defined time slices

Incremental RefreshIncremental RefreshOnly move what has changed

Feeds from Campuses to TBR ODS/EDWODS/EDW Campuses

16

Custom Warehouses (MTSU & UoM)

Page 17: TBR ODS EDW Planning 2007

ETL – Oracle Warehouse Builder

17

Page 18: TBR ODS EDW Planning 2007

Administration Responsibilities

Administration tool for execution and monitoring of ETL processesETL processes

Web-based

S /SJob Submission/Scheduling and Logging

Snap-Shots

Transformation Setup and Maintenance

Data cleansing

Security – (FGA)

Meta Data Repository

18

Meta Data Repository

Page 19: TBR ODS EDW Planning 2007

Data Warehouse Implementation Roadmap

Federal, State, THECRequirements

Business Discovery& Analysis

ProjectScoping

RequirementsGathering

Project & Infrastructure Planning

Business Analysis

DB Architecture Extraction Transform Load

Data Structure

andImplementation

& TestingDB Design

R ti &

and Management

Reporting &

Reporting & Analytics

ArchitectureReporting and Analytics

Development

19

Reporting & Analytics Design (KPIs, Dashboards,

Alerts, Etc.)

Implementation Testing Deployment & Support

Page 20: TBR ODS EDW Planning 2007

Di i Q&ADiscussion … Q&A

Special thanks to SunGard HE who provided content for this presentation. …

20