16
On Time Consulting Services Inc. www.ontimec.com " We have found you and your team to be capable (your exper- tise in Oracle data- bases and Oracle Warehouse Builder is noteworthy), profes- sional, and a pleasure to work with. I would highly recommend On Time Consulting Ser- vices to anyone re- sponsible for prompt, accurate, and suc- cessful delivery of Oracle-based pro- jects ." -- Ray Riggins , Data Management & Appli- cations Support, OCTA On Time Consulting Services has extensive experience in utilizing the latest development tools from Oracle including 9iAS. Our team of Data Warehouse Developers can reorganize and optimize your data from any UNIX or Mi- crosoft Applications into an Oracle Data Ware- house using OWB. We have extensive experi- ence in the Public Transit Industry and other industries, creating Data Marts from the fol- lowing applications: Genfare International's (GFI) Odyssey Bus Fare Collection System Giro's Hastus Transit Scheduling ACORS Coach Operators ETS Maintenance Sungard's IFAS Accounting Lawson Software HRIS/Payroll O N T IME C ONSULTING S ERVICES O RACLE E XPERTS On Time's team of ex- perts can get you moving, starting with servers and ending with applications that put your data to work for you. We can de- sign the fastest, most efficient systems that maximize the return on your investment. We de- sign OFA (Optimal Flexi- ble Architecture) compli- ant databases that are both fast and fault toler- ant. We maintain a full staff of Oracle professionals and are trained on the latest techniques and tools that can make your project a success. In addition to design and deployment services we can also provide experi- enced DBA’s and pro- gramming professionals to augment and mentor your staff. In this day and age, you need all the help you can get to stretch your staff without breaking your budget. O N T IME C ONSULTING S ERVICES I NC . NEWSLETTER DATE 08-01-04 VOLUME 1, I SSUE 1 O N T IME D ATA W AREHOUSING J OURNAL GET T HE ON TIME ADVANTAGE! Highly trained Oracle Experts Data Warehouse Expertise Customized Train- ing Programs Breadth of Applica- tions Experience Flexible I NSIDE THIS ISSUE : ON TIME S TORY 1 PORTAL P RIMER 2 ON TIME ORACLE 3 POOR DATA QUALITY 4 OCTA CASE S TUDY 5 DATA WAREHOUSING PAYS OFF 6 ORACLE WAREHOUSE BUILDER 12 DATA MART BASICS 15 ON TIME DATA WAREHOUSING 7 DATA WAREHOUSING OVERVIEW 8

O TIME DATA WAREHOUSING JOURNAL - ontimec.com file• Genfare International's (GFI) Odyssey Bus Fare Collection System • Giro's Hastus Transit Scheduling • ACORS Coach Operators

  • Upload
    others

  • View
    5

  • Download
    0

Embed Size (px)

Citation preview

On Time Consulting Services Inc. www.ontimec.com

" We have found you and your team to be capable (your exper-tise in Oracle data-bases and Oracle Warehouse Builder is noteworthy), profes-sional, and a pleasure to work with. I would highly recommend On Time Consulting Ser-vices to anyone re-sponsible for prompt, accurate, and suc-cessful delivery of Oracle-based pro-jects ." -- Ray Riggins , Data Management & Appli-cations Support, OCTA

On Time Consulting Services has extensive experience in utilizing the latest development tools from Oracle including 9iAS. Our team of Data Warehouse Developers can reorganize and optimize your data from any UNIX or Mi-crosoft Applications into an Oracle Data Ware-house using OWB. We have extensive experi-ence in the Public Transit Industry and other industries, creating Data Marts from the fol-lowing applications:

• Genfare International's (GFI) Odyssey Bus Fare Collection System

• Giro's Hastus Transit Scheduling

• ACORS Coach Operators

• ETS Maintenance

• Sungard's IFAS Accounting

• Lawson Software HRIS/Payroll

ON TIME CONSULTING SERVICES

ORACLE EXPERTS On Time's team of ex-perts can get you moving, starting with servers and ending with applications that put your data to work for you. We can de-sign the fastest, most efficient systems that maximize the return on your investment. We de-sign OFA (Optimal Flexi-ble Architecture) compli-

ant databases that are both fast and fault toler-ant.

We maintain a full staff of Oracle professionals and are trained on the latest techniques and tools that can make your project a success.

In addition to design and deployment services we

can also provide experi-enced DBA’s and pro-gramming professionals to augment and mentor your staff. In this day and age, you need all the help you can get to stretch your staff without breaking your budget.

ON TIME CONSULTING SERVICES INC.

NEWSLETTER DATE 08-01-04 VOLUME 1, ISSUE 1

ON TIME DATA WAREHOUSING JOURNAL

GET THE ON TIME ADVANTAGE!

• Highly trained Oracle Experts

• Data Warehouse Expertise

• Customized Train-ing Programs

• Breadth of Applica-tions Experience

• Flexible

INSIDE THIS ISSUE:

ON TIME STORY 1

PORTAL PRIMER 2

ON TIME ORACLE 3

POOR DATA QUALITY 4

OCTA CASE STUDY 5

DATA WAREHOUSING PAYS OFF

6

ORACLE WAREHOUSE BUILDER

12

DATA MART BASICS 15

ON TIME DATA WAREHOUSING

7

DATA WAREHOUSING OVERVIEW

8

On Time Consulting Services Inc. www.ontimec.com

Portals have become a critical compo-nent of the corporate knowledge management strategy. It's no won-der, because they offer a combined view of the BI (Business Intelligence) and knowledge-based infrastructure. In essence, they create a channel through which businesses can com-municate and collaborate, gaining greater visibility where it can be most effective.

Intranets

Intranets were probably the first at-tempt to make pocketized information available to users via a Web-based interface. Most early intranets failed because of a disconnect between us-ers, technology, and corporate con-tent. When employees or partners did use the intranets to obtain informa-tion, it was often incomplete or irrele-vant to their specific needs.

As usage patterns and technologies changed, attempts were made to make all enterprise information avail-able via one common interface. Such integration required that systems be able to speak to one another, includ-ing such systems as corporate data-bases, legacy mainframes, ERP, and even email. Hence was born the en-terprise information portal, or EIP.

Enter EIPs

EIPs have entered the picture at a time when communication and col-laboration are more essential than ever for business survival. Those or-ganizations that can evaluate complex trends, patterns, and relationships quickly have a strong competitive ad-vantage. EIPs deliver these capabili-ties.

The Vision of Web-Based Informa-tion Management

Portals are not one single technology or application, but rather a collection of related functional components that work together. The three essential ele-ments are:

• People: Those who need informa-tion from which to base their decisions or actions

• Content: The varying types of in-formation and knowledge within and among organizations

• Technology: The infrastructure that enables the timely capture, stor-age, and delivery of this content to those who need it.

By linking corporate data sources to a Web-browser interface, EIPs help peo-ple make crucial corporate decisions based on current data derived from multiple sources rather than from stale monthly reports. So-called "digital dashboards" take the integration one step further by providing messaging and communication within and among portals.

After determining which specific char-acteristics your portal needs to have -- and matching them with the appropri-ate portal products and services -- con-sider adding the following advanced features to your list.

• The ability to search both the por-tal's own indexes as well as those of other repositories or search engines, and return one consolidated result set to the user.

• The ability to recognize the exis-tence of other EIPs and cooperatively work with them to serve user needs.

(Continued on Pg. 4)

PORTAL PRIMER

“MOST EARLY INTRANETS

FAILED BECAUSE OF A

DISCONNECT BETWEEN USERS,

TECHNOLOGY, AND CORPORATE

CONTENT.”

PAGE 2 ON TIME DATA WAREHOUSING JOURNAL

On Time Consulting Services Inc. www.ontimec.com

PAGE 3 VOLUME 1, ISSUE 1

Does your Oracle Database deliver the

high-performance you need?

Let our Team of technicians help you stay in front.

4848 Lakeview Ave. Suite 100H

Yorba Linda, CA 92886

Voice: 714.693.8111

Fax: 714.693.0617

Experienced DBA’s Need a Tune-up?

Implementation and Conversion Specialists Time for a new Engine?

Certified On-Site Oracle Trainers Want better Driving Skills?

Experienced Data Warehouse Practitioners Ready to unleash the Power?

-

-

-

-

On Time Consulting Services Inc. www.ontimec.com

A survey conducted by The Data Warehousing Institute (TDWI), a for-profit research center for the data warehousing and business intelligence in-dustries, indicates that the current level of data quality costs U.S. busi-nesses $600 billion per year in printing, mailing costs and staff overhead alone.

This extreme figure was arrived at by Wayne Eck-erson, director of educa-tion and research at TDWI, through a survey of 647 respondents who quantified costs saved by corrected errors in cus-tomer files. "It was based on cost saving averages of our membership multi-plied by a reasonable number of companies. It's the money you would save in postage and print-ing mailers that never end up going to the intended persons," he says. Among respondents, savings esti-mates ranged from $10,000 to $20,000 all

the way up to $500,000 and more. Outliers were removed, and the result-ing average was multi-plied against D&B data of potentially affected busi-nesses, in this case one-half of 1 percent of U.S. companies.

The problem, according to TDWI, is that customer data degenerates at the rate of 2 percent per month because customers die, divorce, marry and move. In addition to data entry errors, missing val-ues and integrity errors tend to show up only when companies seek to aggregate data across the enterprise. That is, data warehousing, CRM and other e-business projects are at risk of failure be-cause data lose integrity as they are extracted from multiple operational systems. The true cost of poor quality data can grow higher still because loyal or potential custom-ers are missed in mail-ings, website and store

visits.

"It is a high number," says Eckerson. "But even at our company, with 15 employees, printing and mailing is our greatest expense. We spend mil-lions on that. If we're only a 15-person company, you begin to see that the mark is not that high."

TDWI's Data Quality Sur-vey estimates that about 40 percent of companies have experienced "losses, problems or costs" due to poor quality data, and that about half of survey respondents have no plans to implement a data quality program. The re-port recommends an eight-step methodology for addressing data loss, beginning with a top-down data quality pro-gram initiated by the CEO, overseen by a board of directors, and managed by a chief data quality officer or along lines of business.

and telephony devices.

EIPs help break down bar-riers to enterprise-wide communication and col-laboration while preserv-ing existing IT invest-ments in mainframes and other structured data sys-tems. They simply inte-grate these systems into a tactical knowledge base available to all employees who need it. If, as Gart-

(Continued from Pg 2.)

• The ability to support legacy applications not only via portal compo-nents and connectors but also directly via 3270/5250 emulation or support for WTS.

• The ability to deliver information and services to non-PC devices, espe-cially mobile, wireless,

ner asserts, intellectual capital will soon be the primary factor in measur-ing business value, EIPs are the key to securing your company's future.

THE COST OF POOR DATA QUALITY

PORTAL PRIMER

“CUSTOMER DATA DEGENERATES AT THE RATE OF 2

PERCENT PER MONTH BECAUSE

CUSTOMERS DIE, DIVORCE, MARRY

AND MOVE. IN ADDITION TO DATA

ENTRY ERRORS, MISSING VALUES AND INTEGRITY

ERRORS TEND TO SHOW UP ONLY

WHEN COMPANIES SEEK TO AGGREGATE

DATA ACROSS THE ENTERPRISE.”

PAGE 4 VOLUME 1, ISSUE 1

On Time Consulting Services Inc. www.ontimec.com

The Orange County Transporta-tion Authority (OCTA)

OCTA is the county's primary trans-portation agency. Located in South-ern California, the OCTA is focused on rail, freeways, streets, and public transportation. Its primary mission is to create, coordinate, finance, and deliver an easy-to-use public trans-portation network which keeps Or-ange County’s 2.8 million people moving.

While Southern California is known for its freeways, more than 60,000 Orange County residents a day rely on OCTA buses to travel to and from work, school, and a variety of other places. OCTA takes this responsibility seriously, placing more than 460 buses on 80 routes during peak hours. This activity generates over 5 million transactions of bus ridership data per month.

OCTA’s Information Challenge

OCTA relies on a variety of complex systems to support Bus Operations, including the following: Genfare GFI Farebox system for bus ridership, fare collection, and bus pass proc-essing; HASTUS vehicle and crew scheduling system for establishing bus routes and timetables; SunGard Bi-Tech IFAS accounting, a financial and personnel management system for government and not-for-profit entities; and a variety of custom ap-plications designed to support the activities of Coach Operators and Maintenance Employees.

OCTA’s initial approach to informa-tion management and decision sup-port was to create an individual data store (mostly using MS-Access) tai-lored to address a specific need for information. Over a number of years, a variety of separate databases were created, resulting in a chaotic envi-ronment of inconsistent (and often conflicting) information that could not support the volume of data gen-erated by ever-increasing bus rider-ship.

The On Time Data Warehouse Solution

On Time Consulting Services was engaged by OCTA to develop 2 new data ware-houses: one for Bus Ridership, and the other for Bus Pass usage. Oracle Ware-house Builder (OWB) was used to extract transactions from Genfare and HASTUS sys-tems into a staging area; then to load each data warehouse with the appropriate “facts” and “dimensions”. The data warehousing capabilities of an Oracle 9i database allow for quick and efficient summarization of “facts” by a variety of “dimensions”; for example, number of bus riders (fact) by bus route (dimension) and time of day (dimension). The Bus Ridership and Bus Pass data warehouses have assimilated over 100 million ridership transactions to provide summarized (and consistent) infor-mation that gives OCTA a clearer under-standing of revenues, costs, utilization, and ridership. With an enhanced ability to ana-lyze Bus Operations, OCTA is positioned to continually improve its services to the citi-zens Orange County. Improved visibility of Bus Ridership and Bus Pass information has also led to internal process changes to im-prove the quality of data in the source (Genfare and HASTUS) systems.

In addition to the Bus Ridership and Bus Pass data warehouses, On Time Consulting Services is also engaged in extending OCTA’s data warehouse environment by developing a number of specialized Data Marts. Each data mart is being developed using OWB/Oracle 9i, sharing (where ap-propriate) common dimensions, such as time (month, week, day, time of day), em-ployee (coach operator), bus number, etc. information for each maintenance and me-chanic employee from attendance, training, certification, shift assignments, and all other non-payroll related data.

About On Time Consulting Services

On Time Consulting Services, Inc. provides a comprehensive suite of Information Tech-nology (IT) consulting services, designed to provide critical expertise in all phases of a complete systems development life cycle. On Time provides experienced project man-agers and technologists who are not only adept at completing project tasks on time and on budget, but are also effective in

OCTA DATA WAREHOUSE CASE STUDY

OCTA’s primary mission is to

create, coordinate, finance, and

deliver an easy-to-use public transportation network which keeps Orange

County CA’s 2.8 million people

moving.

PAGE 5 ON TIME DATA WAREHOUSING JOURNAL

On Time Consulting Services Inc. www.ontimec.com

Two new studies indicate big returns in properly imple-mented data warehousing. But the reports clash on other key points, including how many businesses are actually tracking data ware-housing return on investment (ROI) and other financial metrics.

A Data Warehousing Institute study of 1,600 companies released this month shows only 13 percent of respon-dents track data warehousing ROI across the value chain, 37 percent said they plan to begin tracking ROI, and 27 percent said they are not tracking returns and have no plans to do so. The report was sponsored by Acxiom, Compaq, EMC, IBM, Micro-soft, NCR, Oracle, Sagent Technology, and Sybase.

Another new survey, con-ducted by marketing re-searcher Globalinkage for data warehousing vendor Informatica, includes data from 134 unnamed Infor-matica customers. The Glob-alinkage/Informatica study had a completely different result: 87 percent of compa-nies surveyed track data warehousing's total cost of ownership, return on invest-ment, or other financial measures of performance.

The two studies agree that properly implemented data warehousing can boost re-turns. But they clash on the question of how successful such implementations are.

Referring to the impact of data warehousing on cus-tomer relationship manage-ment, the institute found 16 percent of respondents said their data warehousing im-plementation is better than expected, 42 percent said it met their expectations, and 41 percent said they are ex-periencing difficulties.

"For certain companies strug-gling to build these ware-houses, the next step is how to drive the warehouse into the fabric of the company, so that it's part of its business culture, as opposed to a technological addendum," said Wayne Eckerson, direc-tor of education and research for the Data Warehousing Institute.

Neither study provides spe-cific ROI figures, and compa-nies in both surveys used a huge variety of financial measures, making compari-sons impractical.

The Globalinkage analysis found little evidence of adop-tion difficulties. While con-fined to Informatica clients, it

"probably is pretty represen-tative of anybody in data warehousing," said Glob-alinkage principal Gaye Clemson.

The institute study said benefits of data warehousing include increased productiv-ity. Issues facing companies seeking to integrate data warehousing into a larger corporate strategy include the need to change business processes, incentives, skills, and the need for close atten-tion to privacy concerns. Technical issues include the need to develop a scalable architecture and avoid over-collecting data.

Both studies found major benefits to successful use of data warehousing.

"There are tons of cost sav-ings, especially if you go to the Web to provide Web ac-cess to the scope of the pro-ject," Eckerson said. "The more data you can integrate, the more complete your view of customers, suppliers, and the more your business benefits."

Eckerson and Clemson agreed that businesses need to apply a range of financial metrics to their IT invest-ments such as data ware-housing.

• 15 years experience with Oracle database software, including current experi-ence with Oracle 9i data-base and Oracle 9i Appli-cation Server (9iAS).

• 4 years experience de-veloping and implement-ing Data Marts and Data Warehouses with Oracle Warehouse Builder (OWB), including current experience with OWB 9.2.

technical knowledge transfer, through personal mentoring with client per-sonnel. Specific areas of expertise are:

• 20 years of project man-agement experience in projects of varying size, scope, and complexity; specific experience with application development, software and database implementation/upgrade, and data warehouse pro-jects.

• 4 years experience with Oracle development tools, such as Discoverer, Forms, and Reports; cur-rent experience in an Ora-cle 9i environment.

To learn more, visit us at www.ontimec.com or

contact us toll-free at

866-239-3326

STUDIES FIND DATA WAREHOUSING PAYS OFF

OCTA CASE STUDY

"FOR CERTAIN COMPANIES

STRUGGLING TO BUILD THESE

WAREHOUSES, THE NEXT STEP IS HOW

TO DRIVE THE WAREHOUSE INTO

THE FABRIC OF THE COMPANY, SO THAT IT'S PART OF ITS

BUSINESS CULTURE, AS OPPOSED TO A TECHNOLOGICAL

ADDENDUM"

PAGE 6 VOLUME 1, ISSUE 1

On Time Consulting Services Inc. www.ontimec.com

PAGE 7 ON TIME DATA WAREHOUSING JOURNAL

but how can you get the information it carries?

Let our Team of Data Warehousing experts help.

Our experience with Oracle Warehouse Builder (OWB) enables us to efficiently

unload - Extract

repackage - Transform

and store - Load

your valuable cargo of data in a state-of-the-art Oracle Data Warehouse.

You’ve successfully launched your new system,

What’s your information destination?

the right information

at the right time

in the right format

using tools such as Oracle’s Discoverer.

Then let us help you find:

4848 Lakeview Ave. Suite 100H

Yorba Linda, CA 92886

Voice: 714.693.8111

Fax: 714.693.0617

On Time Consulting Services Inc. www.ontimec.com

DATA WAREHOUSING OVERVIEW

“THE PURPOSE OF A DATA

WAREHOUSE IS DIFFERENT THAN

THAT OF AN OLTP (ON LINE TRANSACTION PROCESSING) APPLICATION.”

PAGE 8 ON TIME DATA WAREHOUSING JOURNAL

Overview of Data Warehousing

Data Warehousing, as defined

by Bill Inmon, “… is a subject oriented,

integrated, time variant, non-volatile

collection of data in support of manage-

ment’s decision-making process”.

The purpose of a Data Ware-

house is different than that of an OLTP

(On Line Transaction Processing) appli-

cation. An OLTP system is based on

business processes that create and up-

date data in a database in order to sup-

port the day-to-day core operations of a

business. A Data Warehouse is based

on business processes that retrieve and

analyze the data created by OLTP sys-

tems -- in a format that allows people

to make day-to-day decisions, short-

term tactical plans, and longer-term

strategic plans.

OLTP systems are generally de-

signed using relational modeling con-

cepts. Data is stored in tables that have

been normalized to at least 3rd Normal

Form. The relational model allows for

efficient processing and storage of data,

with little or no redundancy of data.

The challenge in creating tactical and/or

strategic views of data is that the nor-

malization of the data makes generat-

ing these views difficult. There are 2

reasons for this; (1) the normalized

data structure requires complex queries

to collect and summarize related data from

many different tables, and (2) the amount

of computing resource required to perform

these complex queries depletes the server

resources needed for the OLTP operation.

Data Warehouse systems are de-

signed using a STAR or SNOWFLAKE model

to enable quick, concise queries. These 2

models utilize a central fact table sur-

rounded by a number of dimension tables.

The fact tables contain the measures and

the dimensions contain the attributes

about these measures; for example, a

sales order is a "fact", and the item sold,

the date of the order, and the store in

which the sale occurred are all

"dimensions" (attributes) about the sales

order. Dimensions are often common

ways of summarizing facts.

On Time Consulting Services Inc. www.ontimec.com

DATA WAREHOUSING OVERVIEW

“HOW CAN ON TIME

CONSULTING SERVICES HELP YOU IN YOUR

DATA WAREHOUSING EFFORT - GIVE US A CALL AND LETS TALK!”

PAGE 9 VOLUME 1, ISSUE 1

The STAR model (figure 3) employs a central, de-normalized fact table

surrounded by a set of de-normalized dimension tables. It is the most common

model used in data warehousing today and is supported by many of the tools

available on the market. Most major databases are capable of optimizing queries

against a STAR model.

Figure 2

The SNOWFLAKE model (figure 2) employs a central fact table surrounded by a

set of normalized dimensions. Notice how each of the de-normalized dimensions

are linked together with relationships (foreign keys). Not many reporting tools

support the SNOWFLAKE model due to the inability of the underlying database

to effectively optimize for the complexity of the queries presented.

On Time Consulting Services Inc. www.ontimec.com

DATA WAREHOUSING OVERVIEW

“A DATA MART CAN BE A

BUILDING BLOCK OF AN

ENTERPRISE DATA

WAREHOUSE THAT IS

CREATED IN INCREMENTS.”

PAGE 10 ON TIME DATA WAREHOUSING JOURNAL

Figure 3

Just as there are 2 different design models for data warehouses, there are

also 3 different types of data warehouses: the Enterprise Date Warehouse, the

Data Mart, and the Operational Data Store.

An Enterprise Data Warehouse is a data warehouse containing information

supporting the entire enterprise and is usually built as a single project. Enterprise

Data Warehouses are difficult to build as they take an extraordinary amount of

time, require a significant amount of resources/cost, and usually are irrelevant to

current business needs by the time they are completed. It is not unusual to have a

3-to-5-year project to implement an Enterprise Data Warehouse. Can you imagine

what the requirements of your enterprise will be 3 years hence?

A Data Mart is a single subject or single line-of-business structure usually

consisting of 1 or more fact tables and some dimensions that service a department

or line-of-business. A Data Mart can be a building block of an Enterprise Data

Warehouse that is created in increments. A Data Mart can usually be built in 3-to-

6 months, so it has a short development time, is relevant to current business

needs, and has a relatively low cost. Additionally, since the development time is

shorter, the enterprise realizes benefits sooner.

On Time Consulting Services Inc. www.ontimec.com

An Operational Data Store (ODS), also known as a

reporting system, is used for management reporting,

e.g. “how many widgets did I make today?” or “did I

make my quota of widgets today?” ODS systems can

simply be "clones" of a production OLTP system or

can be transformed into a snowflake or star configu-

ration.

A data warehouse project has the same

stages as a normal IT project: user requirements,

product definition, database definition, development,

test, implementation, and maintenance. After user

requirements are defined, the product definition and

database definition phases are key areas of work

within the project, and are facilitated by the use of a

development tool such as Oracle Warehouse Builder.

This is where the database structure is defined with

tables, attributes, foreign keys, check constraints,

primary keys, etc. Very little custom coding is re-

quired.

Most of the time spent in a data warehouse

project is dedicated to developing the ETL

(Extraction, Transformation, and Load) procedures.

ETL must be structured in such a way as to allow

rapid development, ease of modification during test-

ing, and ease of maintenance after implementation.

On-going changes to source tables/files and addi-

tional requirements for data in the data warehouse

must be expected and included in the project plan.

A data warehouse project, like any other im-

portant project, requires careful planning and the

availability of proper tools for each project phase.

More sophisticated tools that provide seamless inte-

gration through multiple project phases are a definite

advantage. They provide significant improvements in

efficiency and quality; however, they can be ex-

pensive. An organization may justify the cost of

sophisticated tools by spreading those costs over

many implementations, each of which can be

accomplished with greater efficiency and quality.

There are many data warehouse devel-

opment tools on the market; however, the tools

from Oracle Corporation are among the few that

provide tight integration with the database and

each other. The Oracle tools include: Oracle De-

signer (definition of business processes, function

modeling, E-R definition, etc), Oracle Warehouse

Builder (STAR schema definition, ETL modeling

and code generation), Oracle Discoverer (data

delivery for reports, graphs, web sites and so

forth), Oracle Express (tactical and strategic

analysis), and the Oracle Data Mining Suite

(finding relationships within your data that you

didn’t know existed).

This remainder of this article concen-

trates on Oracle Warehouse Builder (OWB) and

its effectiveness in assisting organizations to

bring data marts, ODS's and warehouses on-line

faster, more efficiently, and with improved main-

tainability.

DATA WAREHOUSING OVERVIEW

PAGE 11 VOLUME 1, ISSUE 1

On Time Consulting Services Inc. www.ontimec.com

What is Oracle Warehouse Builder?

Oracle Warehouse Builder (OWB) is Oracle’s tool for solving the complex problem of data extraction,

transformation and load (ETL) between various dispersed data sources and targets. In other words, OWB is

Oracle’s tool to design and deploy data warehouses, data marts, and operational data stores. In fact, OWB has

even been used to transfer data from older OLTP systems into new OLTP applications.

Oracle Warehouse Builder is both an ETL design and deployment tool; however, OWB is not a complete

applications life-cycle tool for data warehousing. OWB should be considered a component of a suite of tools

that comprise a complete business intelligence life cycle tool kit. The other tools are: Designer for business

analysis, functional modeling, E-R modeling and so on, Discoverer for management and basic tactical analy-

sis, Reports for report publishing, Express for tactical and strategic reporting and modeling, and Data Min-

ing Suite for data and relationship discovery.

DATA WAREHOUSING OVERVIEW

PAGE 12 ON TIME DATA WAREHOUSING JOURNAL

HOW DOES OWB ACHIEVE ITS GOALS?

How does Oracle Warehouse Builder achieve its Goals?

ETL processes can involve various steps and phases, which may span a number of systems, resources,

and functional areas. OWB enables the user to:

Import data source definitions

Design and create the target database schema

Define and create the data flows between sources and targets

Manage and update the source definitions

Manage, update, and upgrade the target schema

Design and create the ad-hoc query tool environment

Design and create the OLAP environment

Leverage Oracle database features to ensure scalability, reliability and flexibility

On Time Consulting Services Inc. www.ontimec.com

DATA WAREHOUSING OVERVIEW

“OWB PROVIDES MANY

CAPABILITIES THROUGH KEY COMPONENTS”

PAGE 13 VOLUME 1, ISSUE 1

Metadata Repository A set of relational tables and views in an Oracle data-base stores the metadata definitions. Meta data is data that describes the attributes of other data.

Client Application This java application that, via a graphical interface guides designers and developers through the definition and design of the application.

Code Generator This component generates scripts based on the meta-data in the repository, which can then be deployed to the target database schema. The generator is de-signed to integrate tightly with the Oracle database so that generated scripts will perform well in the Oracle database.

Runtime Environment The target environment not only stores the data loaded from the sources in both transformation and production schemas, it also holds audit information on the loading processes that move the data into these schemas.

Runtime Audit Viewer A Java application to inspect the audit data in the run-time environment.

Reporting Environment The reporting capabilities of Warehouse Builder allow users to access the metadata repository and view that metadata from a web-based application. This allows the provision of data about the warehouse, mart or ODS to a larger audience.

OWB provides these capabilities through a number of components:

“On Time Consulting Services

can shine some light on your

Oracle Data Ware-housing Project.

Call us to see how we can work together!”

On Time Consulting Services Inc. www.ontimec.com

DATA WAREHOUSING OVERVIEW

“Because of the repository, all information regarding the design of the system is stored and managed in one central place.”

PAGE 14 ON TIME DATA WAREHOUSING JOURNAL

Benefits of Using Oracle Warehouse Builder

Warehouse Builder provides a number of benefits to an organization:

Rapid System Design Warehouse Builder reduces the de-sign time by providing visual models, wizard-driven user interfaces, and a library of predefined transformations. It has been estimated that Ware-house builder can save between 40% and 60% of development costs over traditional design, and code

Centralized Design Information Because of the repository, all infor-mation regarding the design of the system is stored and managed in one central place. This reduces du-plication of metadata and creates a single source of truth avoiding the extra costs of inconsistencies

Reduced Time for Changes Re-import in the one source of truth in conjunction with target system upgrade enable a smooth mainte-nance process

Error Free Code By generating the code from a de-sign stored in one place, the code is not only error free but also easy to recreate, upgrade and maintain

On Time Consulting Services Inc. www.ontimec.com

To begin to design a data mart today, the data mart implementer must catego-rize, evaluate, purchase and install the various compo-nents of the data mart. This process alone can be time-consuming and difficult. But the work is just beginning. Looking at the data mart solutions on the market to-day, the data mart imple-menter must select among an array of components in different categories, includ-ing:

• Data transformation tools

• Specialized query engines

• Information analysis tools

Before you can get a single result or answer any user's question, you have to inte-grate the pieces into a work-ing data mart solution. The integration phase of the pro-ject may require a staff of dedicated integrators, often specialists hired for a job, and can take months. (In fact, it may continue through the life of the data mart, as

product upgrades for the differ-ent components must be incor-porated into the data mart.)

The product integration process typically includes integrating the components, testing for errors, and testing for the required functionality. When you add to this the time it takes to either train your own staff or select and hire the contract staff to perform it, the integration phase can add months to your data mart process. Any time spent in integration is time not spent addressing your user's specific needs, and delays the ultimate deployment of the data mart.

B. Drilling down to detail, and answering the question "Why is this happening?" based on the data available. Users need to be able to move from summary to de-tail data smoothly; this is supported by multidimen-sional analysis.

C. Predictive analysis; identi-fying "What is likely to hap-pen in the future," modeling, and forecasting. Newer data mining capabilities provide trend analysis and predic-tions.

A decision support user or user community typically progresses through three levels of data analysis.

A. Simple query and report-ing. This type of analysis answers the basic question "What is happening in my business now?" This may be the driving force for imple-menting the data mart in the first place.

A complete data mart solu-tion supports all of these types of analysis, and makes it easy for users to access and understand their options.

DATA MART BASICS

ANALYSIS IS KEY

WHAT IS A GOOD DATA MART? • A single, integrated

product that deploys quickly

• An open, standards-based environment for flexible decision support

• Transparent access to data, wherever it resides and whatever its type

• Rapid, robust, DSS-focused querying

• A broad range of analysis functions

• Usage-based tuning to optimize performance

• Simplified ongoing ad-ministration, requiring minimal resources

A well-architected data mart is user-centric, helping users answer business questions as easily as possible. Technol-ogy, integration, and imple-mentation shouldn't be a concern. You need to solve your user's business prob-lems quickly. You'd like the process to be easy. At the same time, the solution needs to be long-lasting, robust, and able to scale.

From this perspective, a good data mart solution should provide the following:

“A WELL-ARCHITECTED DATA MART IS

USER-CENTRIC, HELPING USERS

ANSWER BUSINESS

QUESTIONS AS EASILY AS

POSSIBLE.”

PAGE 15 VOLUME 1, ISSUE 1

On Time Consulting Services Inc. www.ontimec.com

On Time Consulting Services Inc. is committed to making our cli-ents successful by providing a comprehensive suite of Information Technology (IT) consulting services, designed to provide expertise in all phases of a complete systems development life cycle. From planning your next IT project to mentoring your in-house IT per-sonnel, our approach is to capitalize on our extensive industry ex-perience and in-depth knowledge of technology to deliver the maximum value to our clients. On Time has a variety of experienced technologists that use a cus-tomer-centric approach to design and deliver on-time and under budget projects. Our expertise has enabled us to contribute to the success of clients in a variety of industries, including Healthcare, Public Transportation, News media, Retail, Oil & Gas, Food Ser-vice, Gaming, Staffing, and Distribution. Based in Yorba Linda CA, On Time employs a network of consult-ants throughout the US and Canada who can help meet your chal-lenges of creating total business solutions that encompass every-thing from finance and accounting to customer relationship man-agement (CRM).

4848 Lakeview Ave. #100H Yorba Linda, Ca 92886

Phone: 714-693-8111 866-239-3326

Fax: 714-693-0617 Contact:[email protected]

ON TIME CONSULTING SERVICES INC.

solutions to immediate assignments or issues.

Some of the areas we can provide training in are:

• Introduction to Data Warehousing

• Data Warehouse Data-base Design

• Data Warehousing Fundamentals

• Oracle 9i Warehouse Builder: Implementation Oracle 9i: Data Ware-house Administration

• Oracle 9i New Fea-tures Overview

• Oracle 9i Designer: First Class

On Time Consulting Ser-vices can provide a broad range of training solu-tions for your company.

We can provide custom-ized classroom training (based on a technical skills assessment) that will deliver Oracle skills at the point where they can be put into practice.

We can also develop classroom training exer-cises that are based on actual (and familiar) data to enhance the learning process.

We can come alongside your existing Oracle re-sources and/or recent Oracle course graduates to provide personal men-toring while developing

• Oracle 9i Database Admini-stration Fundamentals I & II

• Oracle 9i Database: Imple-ment Partitioning

• Oracle 9i Data Guard Ad-ministration

• Oracle 9i Database Perform-ance Tuning

• SQL Statement Tuning Oracle 9iAS & 9iDS

• Oracle 9iAS Release 2: Ba-sic Administration

• Oracle 9iDS Release 2: Dis-coverer for End Users

• Oracle 9i Discoverer Admini-stration

Contact us for more information!

ON TIME PROVIDES ORACLE TRAINING

YOUR BEST SOURCE FOR ORACLE DATA WAREHOUSING INFORMATION

Bibliography:

Oracle Data Warehouse

Vin Kirkwood, On Time

Data Warehousing Pays Off

David Lewis, Internet Week

Cost of Poor Data Quality

Jim Ericson, Line 56

Portal Primer

Bhavish Sood, Plexus

Data Mart Considerations

BroadBase Information Syst.

WE’RE ON THE WEB AT WW W. ONTIMEC. C OM

ON TIME CONSULTING SERVICES INC.