Embed Size (px)
DESCRIPTION
Atropos Latency Diagnostics Tool. COMP 415, Spring 2008. Table of Contents. Problem Formulation Solution Features Solution Architecture Major Systems Project Timeline Conclusion. Problem Formulation. Problem Formulation Solution Features Solution Architecture Major Systems - PowerPoint PPT Presentation
Citation preview
AtroposLATENCY DIAGNOSTICS TOOLCOMP 415, Spring 2008
TABLE OF CONTENTS
1. Problem Formulation2. Solution Features3. Solution Architecture4. Major Systems5. Project Timeline6. Conclusion
PROBLEM FORMULATION1. Problem Formulation2. Solution Features3. Solution Architecture4. Major Systems5. Project Timeline6. Conclusion
PROBLEM FORMULATION
Messages Take Time To Travel Across a Network
How Can We Find Bottlenecks? When Should We Cancel a
Message?
PROBLEM FORMULATION | BASIC SOLUTION
Catch Messages Correlate Store Associations Retrieve Latencies Display System Map
SOLUTION FEATURES1. Problem Formulation2. Solution Features3. Solution Architecture4. Major Systems5. Project Timeline6. Conclusion
SOLUTION FEATURES
Relocate-Ready Components Process Abstraction Encapsulated Optimization Points Variable Correlation Multiple Visualizations
SOLUTION ARCHITECTURE1. Problem Formulation2. Solution Features3. Solution Architecture4. Major Systems5. Project Timeline6. Conclusion
SOLUTION ARCHITECTURE
Data Flow Scalability Data Recipient Correlation Engine
DATA FLOW
DIAGRAM
o JPM Service
o Controller
o Database
o Manipulation
o View Client
SCALABILITY DIAGRAM
o Data Mining
o Correlation
o Database
DATA RECIPIENT DIAGRAM
o Possibilitieso Parsingo API Calls
o Batching
o Destinations
CORRELATIO
N EN
GINE
DIAGRAM
o Data Reader
o Data Writer
MAJOR SYSTEMS1. Problem Formulation2. Solution Features3. Solution Architecture4. Major Systems5. Project Timeline6. Conclusion
MAJOR SYSTEMS
Correlation Messaging View
Correlation Engine
CORRELATION A correlation engine holds sets of messages and
performs matching between the sets.
Data Reader
Input Messages
Output Messages
Server Log
Data Reader
Input Messages
Output Messages
Server Log
Correlation Rules
AssociationStore
ASSOCIATION GRAPH
Xml Configuration File Stores configuration of association graph Information about correlation rules to use Formats of data logs
Server A
Server B
Server C
In Out
In Out
In Out
DESIGN CHOICES In-memory correlation
Correlation Rules can create their own data structures to expedite their matching
Sliding Time Window Features
Scalability Flexibility Efficiency
MESSAGING
Components not colocated Ensure recoverability Handle large volumes of data
VIEW
Eclipse RCP framework External graphing package Wireframes
VIEW | ECLIPSE RCP FRAMEWORK
Integration with JPMorganChase Modular design Standardized system
VIEW | EXTERNAL GRAPHING PACKAGE
VIEW | W
IREFR
AMES
MULTIPLE SERVER VIEW
VIEW | W
IREFR
AMES
SINGLE SERVER VIEW
PROJECT TIMELINE1. Problem Formulation2. Solution Features3. Solution Architecture4. Major Systems5. Project Timeline6. Conclusion
PROJECT TIMELINE
Five Phases Phase 1: Due February 1st
Phase 2: Due February 15th Phase 3: Due March 1st
Phase 4: Due April 1st
Phase 5: Due May 1st
Front-Loaded Early Integration
PROJECT TIMELINE
Full Interface Skeleton Stub Modules Admin API (Control) AddMessage API Correlation (Default Rules) View Path Latency
Phase I
Phase IIPhase IIIPhase IVPhase V
PROJECT TIMELINE
Phase I
Phase IIPhase IIIPhase IVPhase V
PROJECT TIMELINE
Admin Client (Control) Correlation (Arbitrary) Message Batching Message Datastore Association Datastore Real-Time View
Phase IPhase II
Phase IIIPhase IVPhase V
PROJECT TIMELINE
Phase IPhase II
Phase IIIPhase IVPhase V
PROJECT TIMELINE
Engine Scheduling Correlation Strength Data Client Admin API Graph Node Datastore View Graph Latency
Phase IPhase IIPhase III
Phase IVPhase V
PROJECT TIMELINE
Phase IPhase IIPhase III
Phase IVPhase V
PROJECT TIMELINE
Zero & Many Correlation Parsing Module Single Message View
Phase IPhase IIPhase IIIPhase IV
Phase V
PROJECT TIMELINE
Phase IPhase IIPhase IIIPhase IV
Phase V
PROJECT TIMELINE
Re-Correlation Recoverability Control Path Datastore Collapse Nodes (View)
Phase IPhase IIPhase IIIPhase IVPhase V
CONCLUSION1. Problem Formulation2. Solution Features3. Solution Architecture4. Major Systems5. Project Timeline6. Conclusion
CONCLUSION
What to Solve How to Solve It
ArchitectureConcepts
When to Solve It
AtroposCUT THROUGH THE TANGLED WEB…
Thank You For Listening!
