Data WarehouseOverview

September 28, 2012

presented byTerry Bilskie

Presentation Objectives:Data Warehouse OverviewDefinitionBenefits & ConsiderationsTerminologyArchitectureInformation Access Maturity Roadmap to a more Data Driven Institution

Data Warehouse, is it clear to you ?

Data Warehouse Definition A data warehouse is-subject-oriented,-integrated,-time-variant,-nonvolatilecollection of data in support of managementsdecision making process.

Data Warehouse is not: A single physical piece of hardware or a software product. A single project with an end A single solution or product

Data Warehouse is: A necessary component in order to achieve higher end reporting and analysis capability with respect to historical data, current trends, and future projections. A data source A combination of software and hardware

Subject-orientedData warehouse is organized around subjects such as admissions, particular degree conferred and students.It focuses on modeling and analysis of data for decision makers.Excludes data not useful in decision support process.

IntegrationData Warehouse is constructed by integrating multiple heterogeneous sources.Data Preprocessing are applied to ensure consistency.RDBMSLegacySystemDataWarehouseFlat FileData ProcessingData Transformation

Time-variantProvides information from historical perspective e.g. past 5-10 yearsEvery key structure contains either implicitly or explicitly an element of time

NonvolatileData once recorded cannot be updated.Data warehouse requires two operations in data accessingInitial loading of dataAccess of dataloadaccess

Data Warehouse BenefitsSpeed up reportingReduce reporting load on transactional systemsMake institutional data more user-friendly and accessibleIntegrate data from different source systemsEnable point-in-time analysis and trending over timeTo help identify and resolve data integrity issues, either in the warehouse itself or in the source systems that collect the data

Data Warehouse BenefitsHas a subject area orientation Integrates data from multiple, diverse sources Allows for analysis of data over time Adds ad hoc reporting and enquiry Provides analysis capabilities to decision makers Relieves the development burden on IT

Data Warehouse BenefitsProvides improved performance for complex analytical queries Relieves processing burden on transaction oriented databases Allows for a continuous planning process Converts corporate data into strategic information

Data Warehouse Considerations

High-level supportIdentification of reporting needs by subject area and organizational roleBridging the gap between reporting needs and technical specificationsPartnerships with central and campus administrative areasCustomer support and training

Data Warehouse TerminologyData WarehouseA copy of transaction data specifically structured for querying and reportingData MartA logical subset of the complete data warehouseOLAP (On-Line Analytic Processing)The activity of querying and presenting text and number data, usually with underlying multidimensional cubes of dataDimensional ModelingA specific discipline for modeling data that is an alternative to entity-relationship (E/R) modeling; usually employed in data warehouses and OLAP systems.

Data Warehouse ArchitectureWhat makes up a Data Warehouse ?

ConceptsCharacteristicsLogical & PhysicalComponents

ArchitectedData MartReplicationData Set DistributionAccess & AnalysisResource Scheduling & DistributionEnd UserWorkstationsA Data Warehouse Is A Component

*Tiered ArchitectureDataWarehouseData MartsData StorageTier1:Data Warehouse ServerAnalysisQuery/ReportsData miningFront-End ToolsTier3:Clients

Data Warehouse ArchitectureData Warehouse serveralmost always a relational DBMS,rarely flat filesOLAP serversto support and operate on multi-dimensional data structuresClientsQuery and reporting toolsAnalysis toolsData mining tools

Data Warehouse from a logical perspective

Another look from a logical perspective

How it fits into Business Intelligence Viewpoint

Data Warehouse from a conceptual perspective

A data warehouse is based on a multidimensional data model which views data in the form of a data cube

*Conceptual ModelStudent Profile Data ViewType of StudentCampusAt Rsiksum First TimeTransferReturning1234VincennesJasperIndianapolisOut of StateALL

Data to Knowledge Process

How a Data Warehouse fits within our overall Data Governance

Current Strategy / Approach

Current Data Access Delivery Mechanisms & ToolsAd-hoc Reporting AccessScheduled and On-Demand Report GenerationUsing tools such as e~print, discoverer, ms access and excel, jobsub, population selection, argos, etc.

Data Driven FrameworkPillars of Success

Questions and AnswersData Warehouse Concepts

*********