IRMAC Enterprise Application Integration Ken Dschankilic, Manager Integration Architecture April 16, 2003 IRMAC Enterprise Application Integration Ken

IRMAC Enterprise Application Integration

Ken Dschankilic, Manager Integration ArchitectureApril 16, 2003



Canadian Tire Corporation, Limited


AgendaAgenda

• Who is Canadian Tire

• EAI Defined

• The Integration Problem

• Integration Frameworks

• Integration Design Patterns

• Dave Callingham’s EAI Components

• Integration at Canadian Tire

• Q & A

• Who is Canadian Tire

• EAI Defined

• The Integration Problem

• Integration Frameworks

• Integration Design Patterns

• Dave Callingham’s EAI Components

• Integration at Canadian Tire

• Q & A

Customer Count: 226.8MMRetail Sales: $7.4 Billion

Customer Count: 226.8MMRetail Sales: $7.4 Billion

Today, we are an inter-related Today, we are an inter-related family of businessesfamily of businesses

Today, we are an inter-related Today, we are an inter-related family of businessesfamily of businesses

Customer Customer Count: Count: 172.1MM172.1MM

Retail Sales: Retail Sales: $5529.5MM$5529.5MM

Customer Count: 1.7MM

Retail Sales: $53.4MM


Retail Sales: $53.4MMCustomer Count:

4.2MM GOR: $352.3MM


GOR: $352.3MM

Customer Count:8.7 millionRetail Sales: $510.4MM

Customer Count:8.7 millionRetail Sales: $510.4MM





• $7 billion (CDN) - Canadian Tire Corporation, $7 billion (CDN) - Canadian Tire Corporation, Limited is Canada’s most shopped retailerLimited is Canada’s most shopped retailer

– More than 1,000 retail outlets (Canadian Tire Associate More than 1,000 retail outlets (Canadian Tire Associate Stores, Gas Bars, Mark’s outlets) across CanadaStores, Gas Bars, Mark’s outlets) across Canada

– More than 45,000 employeesMore than 45,000 employees– More than 25 million customer transactions each yearMore than 25 million customer transactions each year– 90% of Canadians shop at a Canadian Tire store, 40% are in 90% of Canadians shop at a Canadian Tire store, 40% are in

our stores every weekour stores every week

• $7 billion (CDN) - Canadian Tire Corporation, $7 billion (CDN) - Canadian Tire Corporation, Limited is Canada’s most shopped retailerLimited is Canada’s most shopped retailer

– More than 1,000 retail outlets (Canadian Tire Associate More than 1,000 retail outlets (Canadian Tire Associate Stores, Gas Bars, Mark’s outlets) across CanadaStores, Gas Bars, Mark’s outlets) across Canada

– More than 45,000 employeesMore than 45,000 employees– More than 25 million customer transactions each yearMore than 25 million customer transactions each year– 90% of Canadians shop at a Canadian Tire store, 40% are in 90% of Canadians shop at a Canadian Tire store, 40% are in

our stores every weekour stores every week

Canadian Tire Corporation, LimitedCanadian Tire Corporation, Limited

– Canadian Tire Petroleum is the country’s largest Canadian Tire Petroleum is the country’s largest independent retailer of gasolineindependent retailer of gasoline

• 203 gas bars 203 gas bars • 21 Simoniz car washes21 Simoniz car washes

– Canadian Tire “Money” is the most widely recognized Canadian Tire “Money” is the most widely recognized loyalty program in Canadian retail loyalty program in Canadian retail

– Canadian Tire Financial Services is the largest non-Canadian Tire Financial Services is the largest non-bank issuer of MasterCard in Canadabank issuer of MasterCard in Canada

– Our website ended 2001 among the country’s top Our website ended 2001 among the country’s top three e-commerce websites three e-commerce websites

– Canadian Tire Petroleum is the country’s largest Canadian Tire Petroleum is the country’s largest independent retailer of gasolineindependent retailer of gasoline

• 203 gas bars 203 gas bars • 21 Simoniz car washes21 Simoniz car washes

– Canadian Tire “Money” is the most widely recognized Canadian Tire “Money” is the most widely recognized loyalty program in Canadian retail loyalty program in Canadian retail

– Canadian Tire Financial Services is the largest non-Canadian Tire Financial Services is the largest non-bank issuer of MasterCard in Canadabank issuer of MasterCard in Canada

– Our website ended 2001 among the country’s top Our website ended 2001 among the country’s top three e-commerce websites three e-commerce websites

Canadian Tire Corporation, LimitedCanadian Tire Corporation, Limited

EAI DefinedEAI Defined

What is Application Integration

• Yankee Group;

…the continuous process of improving the enterprises’ entire information technology base-applications, information, communications, and infrastructure to support the business.

• Gartner Group says;

“Application integration is defined as making independently designed application systems work together.”

• Mercator;

…EAI is the process of integrating different applications to enable an enterprise to communicate with a single voice.

The Integration Problem

“Imagine if you didn’t have common electric outlets and plugs in your house, and every time you bought a new appliance, you had to wire up the appliance to the wires in your wall. And everybody’s wires in everybody’s walls were different. And everybody’s appliance wiring was different. That’s really the way it works today with trying to integrate business software applications.” - Paul Margolis, past chairman of the OAG, Inc.

The Integration Problem

• Multiple, disparate applications• Multiple platforms• Multiple databases• Multiple transaction processors• Multiple data entry points• Multiple versions of the same data• Incompatible business data

Factors Contributing to the Problem

• Application systems are built at different times by different groups operating independently of each other

• Organizations are stuck w/ incompatible architectures and hard-to-maintain, but harder-to-eliminate legacy applications

• Organizations are embracing a buy before build strategy that favours purchased application packages over internal development

IT’s Dirty Little Secret

Planning Systems

Application System C

Application System B

Application System A

Program

Program

Program

Program

Program

Extract

Load

Down load file

screen scrape

Database Replicator

Extract

Down load file

Load

APPC

trans-action

file

Update

Sockets

Extract

Down load file

Load

Load

Extract

Down load file

– Need a systematic approach to the problemNeed a systematic approach to the problem– No E.F. Codd of IntegrationNo E.F. Codd of Integration

• No mathematical basisNo mathematical basis• No relevant academic leadershipNo relevant academic leadership

– Multiple Vendor Specific FrameworksMultiple Vendor Specific Frameworks• unlike DBMS marketplace where DB implementations are unlike DBMS marketplace where DB implementations are

similarsimilar• Integration Software vendors have widely different Integration Software vendors have widely different

implementation frameworksimplementation frameworks

– Need a systematic approach to the problemNeed a systematic approach to the problem– No E.F. Codd of IntegrationNo E.F. Codd of Integration

• No mathematical basisNo mathematical basis• No relevant academic leadershipNo relevant academic leadership

– Multiple Vendor Specific FrameworksMultiple Vendor Specific Frameworks• unlike DBMS marketplace where DB implementations are unlike DBMS marketplace where DB implementations are

similarsimilar• Integration Software vendors have widely different Integration Software vendors have widely different

implementation frameworksimplementation frameworks

Integration FrameworkIntegration Framework

– Standards only recently impact integration design Standards only recently impact integration design patternspatterns

• in the DBMS marketplace, standards were established in the DBMS marketplace, standards were established early in the development life cycleearly in the development life cycle

• in the Integration marketplace, only w/in the last 2 years in the Integration marketplace, only w/in the last 2 years have standards such as XML, Web Services emerged have standards such as XML, Web Services emerged

– Standards only recently impact integration design Standards only recently impact integration design patternspatterns

• in the DBMS marketplace, standards were established in the DBMS marketplace, standards were established early in the development life cycleearly in the development life cycle

• in the Integration marketplace, only w/in the last 2 years in the Integration marketplace, only w/in the last 2 years have standards such as XML, Web Services emerged have standards such as XML, Web Services emerged


– A Framework is required for integration:A Framework is required for integration:• AdaptersAdapters• TransformationTransformation• Asynchronous messagingAsynchronous messaging• Intelligent RoutingIntelligent Routing• Business Process ManagementBusiness Process Management• Canonical MessagesCanonical Messages

– A Framework is required for integration:A Framework is required for integration:• AdaptersAdapters• TransformationTransformation• Asynchronous messagingAsynchronous messaging• Intelligent RoutingIntelligent Routing• Business Process ManagementBusiness Process Management• Canonical MessagesCanonical Messages


– 3 Main Patterns to solve the integration problems:3 Main Patterns to solve the integration problems:• Data Consistency Data Consistency

– asynchronous, loosely coupledasynchronous, loosely coupled

• Multi-Step Business ProcessMulti-Step Business Process– asynchronous, loosely coupledasynchronous, loosely coupled

• Composite Application IntegrationComposite Application Integration– synchronous, tightly coupledsynchronous, tightly coupled

– 3 Main Patterns to solve the integration problems:3 Main Patterns to solve the integration problems:• Data Consistency Data Consistency

– asynchronous, loosely coupledasynchronous, loosely coupled

• Multi-Step Business ProcessMulti-Step Business Process– asynchronous, loosely coupledasynchronous, loosely coupled

• Composite Application IntegrationComposite Application Integration– synchronous, tightly coupledsynchronous, tightly coupled

Integration PatternsIntegration Patterns

Data Consistency Pattern

Integration Framework

Add prod 1234

Add item050 1234

Add UPC 17988

Add prod 1234

Multi-Step Business Processes Pattern

IntegrationFramework

Ship Notice981126

Alloc Order981126

Alloc Order981126

StoreOrder 981126

StoreOrder 981126

Ship Notice981126

Composite Application Pattern

Data

Programs

Data

Programs

Data

Programs

New code & dataLegacy Applications

Purchased applicationpackages

Integration Framework

Browser

Place Order

Check Logistics

Check Credit

Check Inventory

Vendor ImplementationsVendor Implementations

Integration at CTCIntegration at CTC

What needed to be fixed

• Organization issues– where does the Competency Centre reside– who does the work

• Methodology– no consistent way to document interfaces

• Exception Management– escalation process of data issues….

Key Data Issues

• Data QualityData Quality• Data ConsistencyData Consistency• Data OwnershipData Ownership• Semantic Knowledge and BehaviourSemantic Knowledge and Behaviour• LatencyLatency• FormatsFormats

Hub and Spoke PatternPoint to Point Hub & Spoke

Hub and spoke organizing principlesHub and spoke organizing principles

1. Don’t connect anything directly to

anything

2. Applications are autonomous and share

no databases directly

3. Knowledge of interconnections removed

from source and targets and moved to

the hub

BenefitsBenefits

1. Operational simplification

2. Adaptation to change

3. Reuse leverage

– 2 Brokers are in place:2 Brokers are in place:• Homegrown Broker supports near-time integration Homegrown Broker supports near-time integration

patternspatterns• Broker is MVS based using MQSeries to connect to Broker is MVS based using MQSeries to connect to

applications on:applications on:– AS/400, NT, DEC/ALPHA, AIX, MVSAS/400, NT, DEC/ALPHA, AIX, MVS

• Mercator supports batch integration patternsMercator supports batch integration patterns– Mercator is used for most of the transformationsMercator is used for most of the transformations

– Bulk data movement is done using homegrown File Bulk data movement is done using homegrown File Transfer/MQSeriesTransfer/MQSeries

– 2 Brokers are in place:2 Brokers are in place:• Homegrown Broker supports near-time integration Homegrown Broker supports near-time integration

patternspatterns• Broker is MVS based using MQSeries to connect to Broker is MVS based using MQSeries to connect to

applications on:applications on:– AS/400, NT, DEC/ALPHA, AIX, MVSAS/400, NT, DEC/ALPHA, AIX, MVS

• Mercator supports batch integration patternsMercator supports batch integration patterns– Mercator is used for most of the transformationsMercator is used for most of the transformations

– Bulk data movement is done using homegrown File Bulk data movement is done using homegrown File Transfer/MQSeriesTransfer/MQSeries

CTC Integration InfrastructureCTC Integration Infrastructure

CTC Integration InfrastructureCTC Integration Infrastructure

• 150+ interfaces150+ interfaces• 40+ w/ re-usable objects (source/target/mapping objects)40+ w/ re-usable objects (source/target/mapping objects)• 45 applications involved in integration with the Broker45 applications involved in integration with the Broker• Real-time messaging a combo of XML and ASCII payloadsReal-time messaging a combo of XML and ASCII payloads• 4000+ FT/MQ per day4000+ FT/MQ per day• 450+ Queue Managers450+ Queue Managers

What Worked• Re-use of infrastructureRe-use of infrastructure

– FT/MQ, MapsFT/MQ, Maps

• Mercator for batch legacy data & recently XML, DB2 & MQ Mercator for batch legacy data & recently XML, DB2 & MQ Adapters (95%)Adapters (95%)

• Messaging - APIs (5%)Messaging - APIs (5%)• Methodology & Design PatternsMethodology & Design Patterns• Competency CentreCompetency Centre• IMS Bridge to unlock legacy transactionsIMS Bridge to unlock legacy transactions• Phased rollout - unplug old-turn on new functions at the Phased rollout - unplug old-turn on new functions at the

hubhub







Documents

IRMAC Enterprise Application Integration Ken Dschankilic, Manager Integration Architecture April 16, 2003 IRMAC Enterprise Application Integration Ken