24
Proven Solutions for Enterprise Agility Proven Solutions for Enterprise Agility SOA Meets M&A Tactical Requirements, Strategic Gain Nov 7, 2006 Neal Ruskin Chief Enterprise Architect, Applications TD AMERITRADE TD AMERITRADE, Inc., member NASD/SIPC, a subsidiary of TD AMERITRADE Holding Corporation. TD AMERITRADE is a trademark jointly owned by TD AMERITRADE IP Company, Inc. and The Toronto-Dominion Bank. © 2006 TD AMERITRADE IP Company, Inc. All rights reserved. Used with permission. TD AMERITRADE and InfoWorld are separate, unaffiliated companies and are not responsible for one another’s services or policies.

Tactical Requirements, Strategic Gain

Embed Size (px)

Citation preview

Page 1: Tactical Requirements, Strategic Gain

Proven Solutions for Enterprise Agility

Proven Solutions for Enterprise Agility

SOA Meets M&ATactical Requirements, Strategic Gain

Nov 7, 2006

Neal RuskinChief Enterprise Architect, Applications

TD AMERITRADE

TD AMERITRADE, Inc., member NASD/SIPC, a subsidiary of TD AMERITRADE Holding Corporation. TD AMERITRADE is a trademark jointly owned by TD AMERITRADE IP Company, Inc. and The Toronto-Dominion Bank. © 2006 TD AMERITRADE IP Company, Inc. All rights reserved. Used with permission. TD AMERITRADE and InfoWorld are separate, unaffiliated companies and are not responsible for one another’s services or policies.

Page 2: Tactical Requirements, Strategic Gain

Proven Solutions for Enterprise Agility

Proven Solutions for Enterprise Agility

Introduction

• TD AMERITRADE began the SOA journey 3+ years ago

• in the middle of a major M&A integration

• continued through several smaller acquisitions

• and, now, the largest retail brokerage M&A integration ever

• As we deliver against immense tactical pressure, we’re also realizing our technology strategy and deriving benefit from SOA…

Page 3: Tactical Requirements, Strategic Gain

Proven Solutions for Enterprise Agility

Proven Solutions for Enterprise Agility

Agenda

• Who We Are

• SOA Today At TD AMERITRADE

• Stages Of Adoption• Groundwork• Proof of Concept• Build Out

• A View to the Future

• Potential Inhibitors

• Conclusions

Page 4: Tactical Requirements, Strategic Gain

Proven Solutions for Enterprise Agility

Proven Solutions for Enterprise Agility

Who We Are

• TD AMERITRADE - A Leading Provider of Retail Securities Brokerage Services

• Serving Independent Minded Investors, Traders and Advisors

• 6.19 Million Accounts* – Primarily Via Web Channel

• http://www.TDAMERITRADE.com

• Neal Ruskin, Chief Enterprise Architect, Applications

• Joined Sep 2003

• Initiate & Mature Enterprise Architecture Function

• 12+ Years Tech Management & Architecture in Online Investment Services

*As of September 29, 2006. Total Accounts include all open client accounts (funded and unfunded), except clearing accounts.

Page 5: Tactical Requirements, Strategic Gain

Proven Solutions for Enterprise Agility

Proven Solutions for Enterprise Agility

SOA Today at TD AMERITRADE

• Initial Services in Production• Key Projects via SOA• Seeing Reuse & Accelerated Integration

• Organizational Buy-In• “Altruistic” Tactical Funding / Sustained Strategic Funding

• Early Governance• Enterprise Architecture Oversight

• Maturing Structure, Process & Tooling • Solutions vs Services Teams• Service Ownership• Registry, Assembly, Testing, Governance

• Planning Composite Applications

Page 6: Tactical Requirements, Strategic Gain

Proven Solutions for Enterprise Agility

Proven Solutions for Enterprise Agility

Our Stages of SOA Adoption

• Groundwork• Enterprise Architecture Function• Understand, Educate and Sell

• Proof-of-Concept• Demonstrate Viability• Iron Out Initial Kinks

• Build Out• Leverage Tactical Projects• Work Targeted Strategic Investment

Page 7: Tactical Requirements, Strategic Gain

Proven Solutions for Enterprise Agility

Proven Solutions for Enterprise Agility

Groundwork: Business Context

• Closely Related Lines of Business• Active Trader• Long-Term Investor• Independent Advisor

• Rapid Product Cycles • 12-15 Week Projects• Client Experience Focus

• Strategic Emphasis on M&A

• Industry Commoditization

• Low Cost Structure

• Leverage Commonality

• Counter Tactical Tendency • Support & Accelerate Delivery

• Accelerate Integration

• Focus on Differentiation

• Leverage Incremental Investment

Page 8: Tactical Requirements, Strategic Gain

Proven Solutions for Enterprise Agility

Proven Solutions for Enterprise Agility

• Centralized IT Function

• In-House Development• Build Bias

• Relatively Small Core App Portfolio• Complex Stovepipes• Point-to-Point Integration• Redundant Data & Logic

• Mixed Technology Set

• Expensive Infrastructure

• In-House Operations• Availability Spotlight

Groundwork: Technology Context

• Leverage Centralized Control

• Strengthen Buy Capability

• Drive Rationalization• Decompose Applications• Remove Redundancy

• Support Heterogeneity & Standards

• Reduce Non-Differentiating Spend

• Facilitate Run Functions

Page 9: Tactical Requirements, Strategic Gain

Proven Solutions for Enterprise Agility

Proven Solutions for Enterprise Agility

• Team Formation• Senior Technology Thought Leaders

• Knowledge of Existing Portfolio, People, Process

• Reporting to CIO/CTO

Sp

end

Val

ue

Sp

end

Val

ue

Network & Communications

Hardware

Infrastructural SW

(OS, DB, App Serv, etc.)

Business Logic

Presentation Logic

Network & Communications

Hardware

Infrastructural SW

(OS, DB, App Serv, etc.)

Business Logic

Presentation Logic

Groundwork: EA Foundation

• Mission Statement

Shift Investment Up The Stack Accelerate Pace of Change

Page 10: Tactical Requirements, Strategic Gain

Proven Solutions for Enterprise Agility

Proven Solutions for Enterprise Agility

• Create Simpler & More Agile Applications Environment Via SOA • Break Up Large-Scale Silos• Consolidate & Centralize Related Functionality and Data

• Adopt Open Source Infrastructural SW and Commodity HW

• Simplify and Partition Network per Application, Usage & Security Requirements

Groundwork: EA Strategy

C D

H

JI

EG

H

A

B

F

B

B J

G

FD

G

D

EI

G

IF

I

J

C

B

C D

E F

G H

I J

A B

Page 11: Tactical Requirements, Strategic Gain

Proven Solutions for Enterprise Agility

Proven Solutions for Enterprise Agility

Groundwork: Vision of SOA

• Arrangement and Inter-Operation of Application Functionality and Data• Modularity• Standardization• Layering• Composition

SERVICE SERVICE SERVICE

FRONT ENDAPP

SERVICE SERVICE

FRONT ENDAPP

FRONT ENDAPP

Intermediaries assemble enterprise service functionality into business processes

Enterprise services represent stand-alone, business-level modules, meant to be shared across multiple applications

Domain Services Layer

Utility Services Layer

Application LayerFront-end applications provide user-interfaces to interact with business logic and processes

Page 12: Tactical Requirements, Strategic Gain

Proven Solutions for Enterprise Agility

Proven Solutions for Enterprise Agility

• Leapfrogging The “Service Zoo”• Coarse-Grained Services

• Parallel Well-Understood Business Concepts• Encapsulate Closely-Related Functionality & Data• Expose Multiple Operations

• Governed Build Out

• “Dumb” Fabric• Standardized Location & Invocation• Technology Agnostic• High-Performance & Resilience• Multi-Version• Aspects: Security, Logging, Monitoring, Management, Metering

• Event-Driven State Propagation (EDA)

Groundwork: Vision of SOA (Cont’d)

OrdMgmt

OrdMgmt<<implementation>>

<<contract>>

OrdMgmt

+ getOpenOrders(acctIDs): OrdList+ validateOrder(order): boolean+ placeOrder(order): boolean...

<<interface>>

Page 13: Tactical Requirements, Strategic Gain

Proven Solutions for Enterprise Agility

Proven Solutions for Enterprise Agility

Groundwork: Vision of SOA (Cont’d)

• Drive Rationalization of Underlying Applications• Re-Factor Legacy Applications Along Service Lines• Rationalize Data Resources• From Legacy Silos to Distributed Service Implementations

LegacyClients

Legacy App

Current State Function Extraction(Non-Core)

Function Recreation & Endpoint Deployment

Client Migration & Legacy Drawdown

Legacy App

Target 1 Target 2

Ext Srvc C

ExtSrvc B

LegacyClients

ExtSrvc A

EP

EP

EP

Func A

Func C

Func B

LegacyClients

LegacyApp

EP

SOAClients

OMSrvc C

EDA Integration

LegacyApp

Event Bus

Point-to-PointInterfaces

LegacyClients

OMSrvc BInt

Srvc A

ExtSrvc C

ExtSrvc B

ExtSrvc C

EP

EP

EP

SrvcComp ESrvc

Comp DSrvc

Comp B

SrvcComp CSrvc

Comp A

Distributed App

EP

EP

EPEP

EPEP

SOAClients

EP

Page 14: Tactical Requirements, Strategic Gain

Proven Solutions for Enterprise Agility

Proven Solutions for Enterprise Agility

Groundwork: Reference Architecture

• SOA Benefits Depend On:• Appropriate Service Partitioning• Generalized Operations

• Picture of Future State Service Portfolio

Push Client

Pull Client

Client Layer

Application LayerE

nte

rpri

se S

ervi

ces

ClearingPartners

Mkt Data Providers

Partner Resources

ExecutionPartners

Ref DataPartners

Push Client

Pull Client

Int Users

Ext Users

<<system>> <<system>>

Push Client

<<system>>

Push Client

<<system>>

Srvc

Banks IRS Other

Authenticated Pull PushPull Authenticated Push

Statement Partners

Pull Client

<<system>>

Push Client

SrvcSrvc

Srvc Srvc

Corp ActionVendors

End Users

Srvc

Analytical Apps

Offer Fulfillment Partners

Depositories

Srvc

Srvc SrvcSrvc Srvc

SrvcSrvc SrvcSrvc

Srvc

Pull Client

<<system>>

M

Push App Push App

Srvc Srvc Srvc Srvc

Srvc Srvc

Srvc Srvc Srvc Srvc Srvc Srvc

Introducing Brokers

Srvc AnalyticalApp

AnalyticalApp

AnalyticalApp

AnalyticalApp{any ent service}

Srvc

Pull ClientPull Client

Pull App Pull AppPull App Pull AppPull App Pull AppPull App Pull App Pull App

Event Bus

Push App

Event Bus

Utility Layer(task/process centric)

Domain Layer(entity centric)

C

VVCM

Page 15: Tactical Requirements, Strategic Gain

Proven Solutions for Enterprise Agility

Proven Solutions for Enterprise Agility

Groundwork: Sell! Sell! Sell!

• Key Promoters

• CIO & Senior Technology Management

• Senior Business Management• Corporate (CEO, CFO, COO)• Line of Business

• Technology Thought Leaders

• Implementers• Developers• Project Managers• Engineers• QA Analysts• Business Analysts

Cost

Capabilities

Silo Applications

SOA

Reuse & Agility

Redundancy

& Rig

idity

Up-Front Investment Required

Page 16: Tactical Requirements, Strategic Gain

Proven Solutions for Enterprise Agility

Proven Solutions for Enterprise Agility

The SOA Promise, The SOA Challenge

• Promise • Shorter Product Development Cycles• Faster Integrations• Cost-Reduction• Improved Client Experience (Integrated Capabilities)

• Challenge• Build Capabilities Once for All LOBs – No More Silos!• Overcome Tactical Mindset• Continue to Deliver Business Projects and Tackle Integrations

Page 17: Tactical Requirements, Strategic Gain

Proven Solutions for Enterprise Agility

Proven Solutions for Enterprise Agility

Proof-of-Concept

• Distributing Core Functionality

• Order Routing

• Back Office Clearing

• CIO Kick-Start

• “4 Services to Production in 3 Months”

• Above & Beyond Business Project Workload• Org-Wide Reward

Page 18: Tactical Requirements, Strategic Gain

Proven Solutions for Enterprise Agility

Proven Solutions for Enterprise Agility

Proof-of-Concept: Results

• Proven Feasibility & Performance• 4 service endpoints, 1 operation each• Initial Integration Fabric

• Policy Change – “All Java, All The Time”

• Strategic EA Engagement – “Getting In Front”• Understand, Influence, and Accelerate LOB Project Delivery • Provide Consultation & Governance for Project Work • Evangelize Technical Strategy & Influence Project Prioritization

• View of Entire Project Pipeline • Facilitate Transition to Service-Orientation • Guide Service Portfolio Planning

Page 19: Tactical Requirements, Strategic Gain

Proven Solutions for Enterprise Agility

Proven Solutions for Enterprise Agility

Build Out

• Tactical Investment (“Piggybacking”)• Making SOA Real / Reaping the Benefits• Leveraging Product Development & Supporting Integration Projects• Slow But Steady

• Strategic Investment• Independent Focus on Key Foundational Services• Dedicated Resources, Ownership, Cross-Project Coordination• Leverage External Technology Accelerators

• From Cost-Reduction to Top-Line Potential

Page 20: Tactical Requirements, Strategic Gain

Proven Solutions for Enterprise Agility

Proven Solutions for Enterprise Agility

Build Out: Key Foundational Services

• Analysis of Current Project Portfolio Prioritizes Investment

• Dependencies Concentrated “At The Bottom”

• Lifecycle Management of Core Business Entities

Service Reuse Opportunities

0

10

20

30

40

50

60

Srv A Srv B Srv C Srv D Srv E Srv F Srv G Srv HService

# o

f D

epen

den

cies

(All

Init

iati

ves)

Page 21: Tactical Requirements, Strategic Gain

Proven Solutions for Enterprise Agility

Proven Solutions for Enterprise Agility

SOA Today at TD AMERITRADE (Redux)

• Initial Services in Production• Key Projects via SOA• Seeing Reuse & Accelerated Integration

• Organizational Buy-In• “Altruistic” Tactical Funding / Sustained Strategic Funding

• Early Governance• Enterprise Architecture Oversight

• Maturing Structure, Process & Tooling • Solutions vs Services Teams• Service Ownership• Registry, Assembly, Testing, Governance

• Planning Composite Applications

Page 22: Tactical Requirements, Strategic Gain

Proven Solutions for Enterprise Agility

Proven Solutions for Enterprise Agility

A View to The Future

• It’s All SOA! No More SOA Projects vs Non-SOA Projects• Separation of Strategic and Tactical Development Concerns

• Solutions Assembly• Service Extension

• Accelerated Legacy Rationalization

• Formalize Governance & Metrics

• Adopt Tooling• QA Automation For Entire Stack• Monitoring & Correlation• Composite Application Assembly

• Address Organizational Aspects• Process, Training, Structure, Mindset

Page 23: Tactical Requirements, Strategic Gain

Proven Solutions for Enterprise Agility

Proven Solutions for Enterprise Agility

Potential Inhibitors

• M&A Integration Pressures

• Project-Centric View• Retreat to Legacy Extension

• Resource & Funding Contention

• Loss of Focus

• Coordination & Governance

• Technology

Page 24: Tactical Requirements, Strategic Gain

Proven Solutions for Enterprise Agility

Proven Solutions for Enterprise Agility

Conclusions

• SOA Works• Accelerates M&A Integration & Facilitates Ongoing Development

• Service-Oriented Transformation Takes Time• Process & Structure More Difficult Than Technology• Culture Is Paramount

• Seek Tactical & Strategic Balance For Incremental Delivery• Demonstrate Tangible Progress• Pay As You Go

• Benefits From a Strong Conceptual Foundation• Broader EA Function

• Constant Learning, Constant Tending, Constant Selling