HPSearch for Managing Distributed Services Authors Harshawardhan Gadgil, Geoffrey Fox, Shrideep Pallickara Community Grids Lab Indiana University, Bloomington

HPSearch for HPSearch for Managing Distributed Managing Distributed

ServicesServicesAuthorsAuthors

Harshawardhan Gadgil, Geoffrey Harshawardhan Gadgil, Geoffrey Fox, Shrideep PallickaraFox, Shrideep Pallickara

Community Grids LabCommunity Grids LabIndiana University, BloomingtonIndiana University, Bloomington

May 11, 2005May 11, 2005 Community Grids Lab Presentation Community Grids Lab Presentation for CCGrid 2005, WiP Sessionfor CCGrid 2005, WiP Session

22

Quick IntroductionQuick IntroductionWhat is HPSearch ?What is HPSearch ?

HPSearch (HPSearch (http://www.hpsearch.orghttp://www.hpsearch.org) is a ) is a scripting based system to help manage scripting based system to help manage data streams and services in distributed data streams and services in distributed applications.applications.– We specifically orient HPSearch towards We specifically orient HPSearch towards

managing a distributed publish – subscribe managing a distributed publish – subscribe infrastructure (NaradaBrokering).infrastructure (NaradaBrokering).

– Management can be viewed in 2 partsManagement can be viewed in 2 parts Setting up the distributed application Setting up the distributed application Querying dynamic system metadata, such as Querying dynamic system metadata, such as

– For logging purposesFor logging purposes– Monitor metadata to help dynamically rewiring system Monitor metadata to help dynamically rewiring system

to improve performanceto improve performance


33

MotivationMotivation SOAP processing essential in distributed applications (SOAP SOAP processing essential in distributed applications (SOAP

being the de-Facto standard)being the de-Facto standard) Various Web Service specifications target specific aspects Various Web Service specifications target specific aspects

of communication between distributed servicesof communication between distributed services– WS-AddressingWS-Addressing to address resources using transport neutral to address resources using transport neutral

mechanismsmechanisms– WS-Reliable MessagingWS-Reliable Messaging for reliable delivery of messages for reliable delivery of messages– WS-SecurityWS-Security for message protection for message protection – … … and many more !and many more !

Quality of service provided by inserting specific elements in Quality of service provided by inserting specific elements in the header of the SOAP messagethe header of the SOAP message

Handlers are required for processing different kinds of Handlers are required for processing different kinds of header elements, since it is difficult to address arbitrary header elements, since it is difficult to address arbitrary message exchange patterns using traditional RPC style message exchange patterns using traditional RPC style synchronous, one-way request-response communication. synchronous, one-way request-response communication.


44

MotivationMotivation(contd.)(contd.)

NaradaBrokering NaradaBrokering ((http://www.naradabrokering.orghttp://www.naradabrokering.org) has recently ) has recently been augmented with support for SOAP been augmented with support for SOAP processingprocessing

NaradaBrokering presents a way of creating NaradaBrokering presents a way of creating processing elements called handlers and chain processing elements called handlers and chain different handlers to process the SOAP messagedifferent handlers to process the SOAP message

Support for WS-Eventing, WS-RM, WS-Reliability Support for WS-Eventing, WS-RM, WS-Reliability and WS-Notification (in July)and WS-Notification (in July)– Federation among these specificationsFederation among these specifications


55

Some IssuesSome Issues With bigger and more With bigger and more complexcomplex broker broker

networksnetworks, , managementmanagement becomes becomes difficultdifficult

We imagine a similar problem of deployment We imagine a similar problem of deployment and and management of handlersmanagement of handlers within each within each brokerbroker

Currently, the Currently, the Broker Instantiation serviceBroker Instantiation service and and scripting objects aid in the creation of remote scripting objects aid in the creation of remote brokers and deploying broker topology by brokers and deploying broker topology by adding / deleting links between brokersadding / deleting links between brokers


66

HPSearch in the PictureHPSearch in the Picture

HPSearch would HPSearch would act as the act as the manager for manager for deploying deploying handlers at handlers at specific brokersspecific brokers

Configuring and Configuring and deploying deploying remote servicesremote services Broker

Network

Blown-up view of a broker


77

R

P 2

Proposed ArchitectureProposed Architecture

2 pipelines P1 and P2.2 pipelines P1 and P2. P1 does not satisfy P1 does not satisfy

certain QoScertain QoS HPSearch selects P2.HPSearch selects P2. Configures Relay Configures Relay

handler to use the handler to use the specific handler chain specific handler chain and deploys the and deploys the applicationapplication

Application

Handler

Pipeline

Relay HandlerCommunicates with the application in deciding what QoS is desired

Communication with other Brokers / Services

P 1


88

ExampleExample// Define some service// Define some services = new Application(s = new Application(

““http://host:port/SecureReliableService”);http://host:port/SecureReliableService”);

// Define the relay handler// Define the relay handlerh = new RelayHandler(“host:port”);h = new RelayHandler(“host:port”);

// Set QoS requirements// Set QoS requirementsh.add(“security”, “URI:Security”);h.add(“security”, “URI:Security”);h.add(“reliablility”, “URI:Reliability”);h.add(“reliablility”, “URI:Reliability”);s.setRelay(h);s.setRelay(h);

// Finally deploy the service// Finally deploy the services.deploy();s.deploy();


99

Advantages Advantages

Existing Applications may be Existing Applications may be combined with NaradaBrokering’s combined with NaradaBrokering’s existing infrastructureexisting infrastructure

Applications may be deployed Applications may be deployed remotely along with handler chains remotely along with handler chains meeting specific criteriameeting specific criteria

Can combine with Can combine with Broker DiscoveryBroker Discovery to find the best broker to connect toto find the best broker to connect to


1010

Questions / CommentsQuestions / Comments

Any Questions / Comments ?Any Questions / Comments ?

THANKS THANKS for attending the presentationfor attending the presentation

Documents

HPSearch for Managing Distributed Services Authors Harshawardhan Gadgil, Geoffrey Fox, Shrideep Pallickara Community Grids Lab Indiana University, Bloomington