© 2005 Enterprise Architecture Solutions Ltd The Role of SOA in Enterprise Data Integration...

The Role of SOA in Enterprise Data Integration

Jonathan Carter

Enterprise Architecture Solutions

Introduction

• The Role of SOA• Case Study• Lessons learned• Future

The Role of SOA

• Allows you to evolve the data integration and information architectures

• Improves speed-of-delivery of solutions• Ubiquity of Web Services means the technology

barriers have been brought down• Abstracted view of the data• SOA, not SOT

– Technology constraints – Currently, not the answer for everything

• Strength lies in providing access to common data

Case Study - Global FMCG

– Globally-deployed EAI solution– New IT Strategy

Scenario

• Exchange Rates data• Distributed to many systems

– across the world – including several SAP systems

• Updated daily• Straight-forward data set

Existing architecture

Financial data siteFinancial data site

Message Message BrokerBroker

FTP pullFTP pull loadload

Data WarehouseData Warehouse

extractextract

<xml <do<o <e

ExratAB,1DE,F

<xml <do<o <e

• Multiple integration technologies• Multiple access points, no “single truth” for data• Difficult to manage load on data sources • Multiple security models and mechanisms• Unclear who owns the integration solution• Inconsistent mechanism for meta data sharing• Data usage tracking • Inconsistent data quality

Data Integration issues

Strategic drivers

• New IT Strategy• Convergence and consolidation of technology• Cost reduction• Simplification and clarity

– Infrastructure – Organisation

All of these had implications for the integration architecture

Delivering the strategic architecture

• Strategy definition– Defined a vision based on SOA– Select strategic technologies

• Roadmap– Plan controlled introduction of SOA approach and

technology

• Phase 1 Pilot– Candidate services– Scoped to internal integration only

• Phase 1 Rollout– Support organisation– Governance

Vision&

Strategy

Vision&

Strategy Roadmap Roadmap Pilot Pilot Rollout Rollout

Service Oriented Architecture

• What is a Service?– Useful– Discrete– Designed to be shared and client independent– Have ubiquitous access– Self describing

• Purpose of SOA is to separate the ‘what’ from the ‘how’– What do I need to access the service?– Where do I go to request the service?– I know what I need to give the service– I know what to expect to get back from the service

• Abstraction layer– Evolve architecture in a controlled way

Vision&

Strategy

Vision&

Strategy Roadmap

Roadmap

Rollout

What is a Service?

ExchangeRatesServiceExchangeRatesService•listExchangeRatesForCurrencyOnDatelistExchangeRatesForCurrencyOnDate •getExchangeRateForCurrencyOnDategetExchangeRateForCurrencyOnDate

DeveloperDeveloper

ProcurementProcurementsystemsystem

FinanceFinancesystemsystem

DataDataWarehouseWarehouse

ServiceServiceregistryregistry

InterfaceExchanglistExchgetEx

CRM CRM applicationapplication

Vision&

Strategy

Vision&

Strategy Roadmap

Roadmap

Rollout

Vision&

Strategy

Vision&

Strategy Roadmap

Roadmap

Rollout

Service Infrastructure

DeveloperDeveloperProcurementProcurement

systemsystemFinanceFinancesystemsystem

Service InfrastructureService Infrastructure

Enterprise Class

MonitoringLoadBalancing Failover

Security

Logging Alerts

PolicyFinan

PolicyFinanPolicyFinan

PolicyFinan

PolicyProcurPolicyProcur

Vision&

Strategy

Vision&

Strategy Roadmap

Roadmap

Rollout

Service Network

Vision&

Strategy

Vision&

Strategy Roadmap

Roadmap

Rollout

Strategic Technologies

DeveloperDeveloperProcurementProcurement

systemsystemFinanceFinancesystemsystem

WSDLWSDLSOAP SOAP SOAP

WS-SecurityWS-Security WS-ReliableMessagingWS-ReliableMessaging

WS-MetaDataExchangeWS-MetaDataExchange

WS-PolicyWS-Policy

SOA strategy addresses the issues

• Multiple integration technologies– Common and robust technology infrastructure with ubiquitous

access• Multiple access points, no “single truth” for data

– Provides abstraction layer for evolving your integration architecture in a controlled manner

• Difficult to manage load on data sources – Abstraction protects data source

• Multiple security models and mechanisms – Manageability through policy and role-based approach

• Unclear who owns the integration solution– Devolves organisation integration responsibilities

• Inconsistent mechanism for meta data sharing – Inherently centralises meta-data

• Data usage tracking– All access provided through service interface

• Inconsistent data quality– Single interface to common data

Vision&

Strategy

Vision&

Strategy Roadmap Roadmap Pilot

Rollout

Roadmap

2004 2005 2006 2007 2008

Evolve B2B Integration ArchitectureConsuming External Services

Publishing Services for External Consumption

B2B Collaborations

Phase 2

Evolve Process Integration ArchitectureCreating and Managing Shared Business Services

Business Process Automation

Business Activity Monitoring

Phase 3

Evolve Data & Application Integration Architectures

Simple Services

Enterprise Class

Phase 1

Phase1 Pilot architecture

PolicyFinan

PolicyFinanPolicyFinan

PolicyFinan

ExchangeRatesServiceExchangeRatesService•listExchangeRatesForCurrencyOnDatelistExchangeRatesForCurrencyOnDate •getExchangeRateForCurrencyOnDategetExchangeRateForCurrencyOnDate

•etc.etc.

FinancialFinancialDataData

ContentContentProviderProvider

FTP pullFTP pull loadload DataDataWarehouseWarehouse

Vision&

Strategy

Vision&

Strategy

Roadmap

Pilot Pilot Rollout

Rollout

Rollout - technology

Vision&

Strategy

Vision&

Strategy

Roadmap

Rollout Rollout

Rollout – service network

Support OrganisationSupport Organisation• OperationalOperational• GovernanceGovernance

Vision&

Strategy

Vision&

Strategy

Roadmap

Rollout Rollout

Lessons Learned

• Enterprise initiative • Organisation buy-in• Enterprise class infrastructure• Ownership• Useful service• Service definition• Schema management• Don’t be afraid to grow slowly• Control your scope

Benefits realised

• Increased speed of delivery• Improved quality• Higher level of development• Usage controlled through configuration rather

than coding• Enterprise-wide monitoring, alerting and usage

tracking• ‘Point-to-point’ development, ‘brokered’

management and runtime

Future

Extended capabilities• Publish / subscribe• Enhancements to security• Meta data management• Write-backs• Transformation as a service?

Further SOA usage• B2B data integrations• Event-based data distribution

The Role of SOA

• Allows you to evolve the data integration and information architectures

• Improves speed-of-delivery of solutions• Ubiquity of Web Services means the technology

barriers have been brought down• Abstracted view of the data• SOA, not SOT

– Technology constraints – Currently, not the answer for everything

• Strength lies in providing access to common data

jonathan.carter@e-asolutions.com

www.enterprise-architecture.com

Questions?

© 2005 Enterprise Architecture Solutions Ltd The Role of SOA in Enterprise Data Integration...

Documents

Enterprise Architecture Management (EAM) · PDF fileAgenda Swiss Post Solutions • We connect the physical and the digital worlds Enterprise Architecture Management (EAM) • Is it

An effective Enterprise Architecture Implementation ... · An effective Enterprise Architecture Implementation ... 2.2 Enterprise Architecture Implementation Methodology ... The Open

Enterprise Architecture and the Cloud - · PDF fileCloud). Enterprise architecture is a tool organizations leverage to ensure mapping of IT solutions to business or ... Enterprise

Enterprise Architecture for Architecture Driven Planning ...sparxsystems.com/press/articles/pdf/EAforADP.pdf · Enterprise Architecture for Architecture ... Enterprise Architecture

ANGLO AMERICAN ENTERPRISE ARCHITECTURE STRATEGY, FRAMEWORK ... · ANGLO AMERICAN ENTERPRISE ARCHITECTURE STRATEGY, FRAMEWORK AND REFERENCE MODEL 1 Johann Müller EA Solutions Manager

Architecting the Enterprise? Enterprise Architecture · Enterprise Architecture is the Glue between Business Architecture and IT Architecture Business Architecture IT Architecture

Micheál Higgins Enterprise Solutions Architecture CloudSigma Helix Nebula Big Science in the Cloud

Enterprise Architecture Guide - Queensland Health · Enterprise Architecture Guide 4.1 The Department of Health Enterprise Architecture The Department of Health Enterprise Architecture

Architecture for Mobile Enterprise Solutions

Enterprise Architecture and the Cloud - SNIA Architecture: An enterprise architecture (EA) is a rigorous description of the structure of an enterprise. ... Enterprise Architecture

Enterprise Architecture and the Cloud - SNIA Enterprise Architecture: ... Data protection ... Enterprise Architecture and the Cloud

+ Service Oriented Architecture (SOA) Enterprise Architecture (EA) Enterprise Service Bus (ESB) Yale Solutions Design October 2012

Everyday enterprise architecture - Tetradian · PDF fileEveryday enterprise architecture Sensemaking, strategy, structures and solutions Tom Graves Tetradian Consulting. Published

Smart Grid Roadmap & Enterprise Architecture Interest …smartgrid.epri.com/doc/Roadmapping - Enterprise Architecture... · Smart Grid Roadmap & Enterprise Architecture ... • The

PUMA - entreprise Agile Enterprise Architecture PUMA ... Incrementally Iterative Solutions Approach This Enterprise Architecture offers at last a formalized and justified answer to

Enterprise Architecture –An Overveics9117/2004 Student Seminars/Week 11... · John Zachman’s Enterprise Architecture ... Functioning Enterprise/User’s View ... Enterprise Architecture

Enterprise Architecture SURVEY RESULTS Common Solutions Group @UCSD January 9, 2014

Enterprise Architecture WHY? - The Open Group Procter... · Enterprise Architecture – WHY? (Practical Experiences) Andrew Procter CIO of Internet Solutions. ... eTOM = enhanced

Enterprise IT Architectures Enterprise Architecture ... · Enterprise IT Architectures Enterprise Architecture – Governance ... Enterprise IT Architectures Enterprise Architecture

Enterprise Architecture Strategy driven Enterprise Architecture Adrian Campbell