40
REAL WORLD BAM @DanRosanova West Monroe Partners BIZTALK SUMMIT 2014, LONDON MARCH 03-04 sessio ns. discussions. networking and more brought to you by

BizTalk Business Activity Monitoring Real World BAM

Embed Size (px)

DESCRIPTION

BizTalk Business Activity Monitoring is probably the most powerful feature in the BizTalk solution stack and it is also the least utilized. In concept BAM offers us the ability to offer visibility, audit, tracking, and alerts all without changing our solutions or writing custom code. The reality is BAM has a learning curve that requires both understanding the implementation details and rethinking your approach to integration solutions to focus on business process / flow rather than technical integration. This session will walk through an advanced real world BAM implementation in the EDI space (purchase order, invoice, ship notice) focusing on a diverse but related series of steps in a long running business process to create a true business level view of several disparate integrations. Features covered will include creating tracking activities and views, progress and dimensions, continuations etc BizTalk Bam Step by Step is Explained. BizTalk Summit 2014, London March 03-04 Brought to you by BizTalk360

Citation preview

Page 1: BizTalk Business Activity Monitoring Real World BAM

REAL WORLD BAM@DanRosanovaWest Monroe Partners

BIZTALK SUMMIT 2014, LONDON

MARCH 03-04sessions. discussions. networking and

more

brought to you by

Page 2: BizTalk Business Activity Monitoring Real World BAM

WE DON’T ALWAYS KNOW WHAT WE DON’T KNOW

Page 3: BizTalk Business Activity Monitoring Real World BAM
Page 4: BizTalk Business Activity Monitoring Real World BAM

WHAT IS WRONG WITH BIZTALK SOLUTIONS?▪ Lack of visibility

▪ People only care about what they can see

▪ Are business people “impressed” by Integration?

▪ They love apps and websites!

Page 5: BizTalk Business Activity Monitoring Real World BAM

OUR BRAINS ARE VISUAL PROCESSORS

% Recognition

0 10 20 30 40 50 60 70 80 90

42

85

Recognition of concept

Picture Text

Page 6: BizTalk Business Activity Monitoring Real World BAM

BAM IS THE VIEW YOUR USERS NEED…SO WHAT IS BAM?▪ BAM is tracking

▪ BAM is aggregation and analytics (BUZZWORD)

▪ BAM is dynamic alerting

▪ BAM is scalable infrastructure

▪ BAM is code free – if you do it right

▪ BAM is a self service portal

Page 7: BizTalk Business Activity Monitoring Real World BAM

HOW IS BAM DIFFERENT?▪ What we want to see != What our users want to see

▪ Developers & Administrators want to see:▪ Suspended messages

▪ Errors

▪ Health

▪ Message Box throughput / latency

▪ We already have the perfect tool for this:

Page 8: BizTalk Business Activity Monitoring Real World BAM

WHAT DO USERS REALLY WANT TO SEE?▪ How many orders have I

▪ Received

▪ Invoiced

▪ Shipped

▪ What is the total value of orders this week / month / year?

▪ How long is it taking us to fulfill orders?

▪ Where in the process are _____’s orders and what can I tell them when they call and yell at me?

▪ How can I make my business more lean and profitable?

Page 9: BizTalk Business Activity Monitoring Real World BAM

WE ARE IN THE BUSINESS OF TECHNOLOGY

OUR USERS ARE IN THE BUSINESS OF BUSINESS

Page 10: BizTalk Business Activity Monitoring Real World BAM

TYPICAL ORDER PROCESSING FLOW

Customer ERP2 - Invoice

3 - Ship Notice

1 - Purchase Order

Page 11: BizTalk Business Activity Monitoring Real World BAM

THAT WHICH CANNOT BE MEASURED CANNOT BE MANAGED

W. EDWARDS DEMING

Page 12: BizTalk Business Activity Monitoring Real World BAM

EXAMINING THE SOLUTION

Web Receive 1Purchase Order

Web Receive 2ERP Invoice,

ASN

Web Send 1ERP PO

File Send 1Invoice

File Send 2ASN

Customers

Page 13: BizTalk Business Activity Monitoring Real World BAM

MAKING BAM IN 3 STEPS▪ Create Activity in Excel

▪ Create View in Excel

▪ Binding to solution in TPE

2View

1Activity

3Tracking Profile

Page 14: BizTalk Business Activity Monitoring Real World BAM

WHAT DATA WE WANT TO SEE▪ Business Data

▪ Order Total

▪ Buyer Postal Code

▪ PO Reference

▪ Invoice #

▪ Shipping #

▪ Milestones▪ Order Received

▪ Sent to ERP

▪ Invoice Generated

▪ Invoice Delivered

▪ Ship Notice Generated

▪ Ship Notice Delivered

Page 15: BizTalk Business Activity Monitoring Real World BAM

CREATING

ACTIVITIES

Page 16: BizTalk Business Activity Monitoring Real World BAM

WHAT DO WE WANT IN OUR VIEW?▪ What is the Status of an order?

▪ How long does an order take?

▪ How long does it take to invoice?

▪ What is my order count?

▪ What is my max / min fulfillment time?

Page 17: BizTalk Business Activity Monitoring Real World BAM

CREATING

VIEWS

Page 18: BizTalk Business Activity Monitoring Real World BAM

CREATING

VIEWS

Page 19: BizTalk Business Activity Monitoring Real World BAM

CREATING

VIEWS

Page 20: BizTalk Business Activity Monitoring Real World BAM

DEPLOYING THE TRACKING PROFILE▪ bm.exe - located in [BizTalk Install]\Tracking

▪ Do yourself a favor, add this to your path or use BAM GUI

▪ bm deploy-all –defininitionFile:SingleActTracking.xlsx

Page 21: BizTalk Business Activity Monitoring Real World BAM

BINDING TO OUR SOLUTION – 2 WAYS

TPE API

Page 22: BizTalk Business Activity Monitoring Real World BAM

ALWAYS USE THE TPE▪ The TPE binds to multiple points:

▪ Orchestration

▪ Message Content

▪ Message Context

▪ Messaging Properties

▪ TPE is the sandbox / safe room

▪ TPE can bind to many sources and ports concurrently

▪ TPE allows adding / changing BAM without solution changes*

Page 23: BizTalk Business Activity Monitoring Real World BAM

BIND

ING

THE ACTIVITY

Page 24: BizTalk Business Activity Monitoring Real World BAM

CON

TINU

ATION

S

Page 25: BizTalk Business Activity Monitoring Real World BAM

DEPLOYING THE TRACKING PROFILE▪ bttdeploy [Name of .btt file]

Page 26: BizTalk Business Activity Monitoring Real World BAM

RUNNING THE MOCKS – 3 EASY STEPS1. [Solution Root]\ERPMock\bin\debug\ERPMock.exe

2. [Solution Root]\LoadMock\bin\debug\LoadMock.exe

3. Look at the BAM Portal

4. Look at the aggregations

5. From Developer Command Prompt:dtexec /sql BAM_AN_SingleOrderView

6. Look at the aggregations again

Page 27: BizTalk Business Activity Monitoring Real World BAM

INSPECTIN

G TH

E RESULTS

Page 28: BizTalk Business Activity Monitoring Real World BAM

CREATING

ALERTS

Page 29: BizTalk Business Activity Monitoring Real World BAM

MESSIN

G W

ITH TO

RD

Page 30: BizTalk Business Activity Monitoring Real World BAM

HOW DOES THIS MAGIC WORK?

Page 31: BizTalk Business Activity Monitoring Real World BAM

BAM INFRASTRUCTURE▪ Databases

▪ Tables / Views

▪ SSIS

▪ TDDS (BAM Event Bus Service)

MessageBox BAMPrimaryImport BAMArchive

BAMStarSchema

BAMAnalysis

TDDS

SSIS

Page 32: BizTalk Business Activity Monitoring Real World BAM

BAM TABLES & VIEWS▪ BAM Creates Tables

NEVER USE THEM

▪ BAM Create Views

Page 33: BizTalk Business Activity Monitoring Real World BAM

BAM SSIS PACKAGES▪ BAM_DM_[ViewName]

▪ Data Management / archiving

▪ BAM_AN_[ViewName]▪ Processes the cube

Page 34: BizTalk Business Activity Monitoring Real World BAM

BAM DATA MAINTENANCE▪ Every time this job runs it partitions tables

▪ Think about when you want it to run

▪ Normally monthly

▪ Partitions age based on BizTalk settings▪ The entire completed partition archives

▪ 6 month default time

▪ bm get-activitywindow –Activity:SingleOrderView

Table

Table

Table_GUID

Table_GUID

ViewUNION

Page 35: BizTalk Business Activity Monitoring Real World BAM

BAM PRIMARY IMPORT CHANGES

USE [BAMPrimaryImport]GO

/****** Object: View [dbo].[bam_SingleOrderView_CompletedInstances] Script Date: 3/3/2014 4:10:18 AM ******/SET ANSI_NULLS ONGO

SET QUOTED_IDENTIFIER ONGO

CREATE VIEW [dbo].[bam_SingleOrderView_CompletedInstances] AS SELECT * FROM dbo.[bam_SingleOrderView_Completed] WITH (NOLOCK) UNION ALL SELECT * FROM [dbo].[bam_SingleOrderView_C52EE3A6_6C6E_4E47_AF7F_214B9D454BC7] WITH (NOLOCK)GO

Page 36: BizTalk Business Activity Monitoring Real World BAM

TDDS - BAM EVENT BUS SERVICE

You really don’t want to know!No, reallyIF you really feel the need check out the tables that start with “Tracking” in the BizTalkMsgBoxDb

And the “TDDS_” tables in BAMPrimaryImport

You have been warned!

Page 37: BizTalk Business Activity Monitoring Real World BAM

CONCLUSION▪ Always create BAM for your solutions

▪ Create views for each set of users (operations, sales, management)

▪ Create / Schedule BAM jobs (AN / DM)

▪ Teach your users to use BAM effectively

▪ Use BAM views from a custom portal / tool – like Excel

▪ Change the CSS for the portal to not look so 2004

Page 38: BizTalk Business Activity Monitoring Real World BAM

QUESTIONS

?

Page 39: BizTalk Business Activity Monitoring Real World BAM

TO IMPRESS THE BOSSONE LAST THING…

Page 40: BizTalk Business Activity Monitoring Real World BAM

REAL WORLD BAM@DanRosanova

Senior Architect

West Monroe Partners

http://danrosanova.wordpress.com/rwb