Knowledge-Based Service Quality Assurance for Korea e-Government 29 th April 2008 Youngkon Lee (NIA/WSQM TC)

Knowledge-Based Service Quality Assurance for Korea e-Government

29th April 2008

Youngkon Lee (NIA/WSQM TC)

contents

Introduction

Implementation of WSQMS

Quality Data of WSQMS

Connect WSQMS with WS Registry

Update WS Registry

Quality Classification for WS Registry

Modification of WS Registry

Classification

Conclusions

WSQM TC 33

Question

Introduction

We implemented Korea e-Government Web service framework,

but ..

How to guarantee quality of Web services?

How to evaluate Web services?

How to store the quality of Web services?

How to search Web service on quality information?

Answer Implement Web Service Quality Management System (WSQMS)

Store quality data in WSQMS


Modify a part of WS Registry data structure

WSQM TC

Web service provider

44

Quality Test


Automatic test by agent

Reference to TAD(Test Assertion Document)

XML type report

Test of performance, conformability, message reliability, and

security

WSQMS

TAD (test assertion

document)

distribute test program

request quality test

auto executionrefer TAD

perform quality test

send quality test result

inspect quality test report

Quality test report(XML)TAD

• response time and throughput

• conformability

• message reliability

• security

Web service system

WSQM TC

Quality contents

Business Value

•Frequency of service use(month/day/hour)• frequency of service use per customer use(month/day/hour)• reputation

Service Level

• performance(response time, throughput)• reliability(usability, accessability, successability)

Interoperability

• conformability(WSDL, SOAP)• WS-I Basic Profile• e-Government WS Basic Profile

Business Processing• message reliability(WS-Reliability)• collaborativeness of WS (WSBPEL) 55

Quality Monitoring


Monitoring WS periodically

Measuring of business value, service level, business processing and

interoperability

Web service

Web service

Use service

message notification

refer TAD

TAD

• Interoperability

• conformability

• message reliability

• collaborability of WS

quality analysis

Web service

associate

provide quality report

request quality report

Agent

Agent

message notification

WSQMS

WSQM TC

Type InformationSupport

type

Web service

• number of request• number of success/failure• operating time• max/min response time

• Axis Plug-in• Servlet Filter• Proxy

WS containe

r

• usable memory• number of HTTP requests• number of HTTP failure• data amount of HTTP request/response• max/min number of HTTP threads• number of current operating HTTP threads

• Tomcat 5.x• Sun Application Server 8.x• IIS 5.x

OS

• CPU usage• real memory usable• virtual memory usable• Page In/Out/Fault• disk usage

• Solaris 8/9• HP-UX 11/11i• Windows 2000/XP/2003

66

Operation Monitoring


Real time monitoring WS, WS container, OS

Provide quality and operating report

Use WSDM spec and agent architecture

Web service system

Install agent

Request to subscribe operation information

WSQMS

Agent

Notify operation information

System manager

Register manager and service

Download agent

Reports

Provide the operation information

Real-time monitoring forWeb service resource

WSQM TC 77

Quality Factor

MeasurableFactor

EvaluationFactor

• Availability

• Accessability

• Successability

• Response time

• Throughput

Eval.Criteria

No Eval.Criteria

• Security

• Interoperability

• Biz Process

• Management

• Biz Value

• price

• service suitability

• use effect

• service brand

Single Criteria

ComplexCriteria

WSQDL for quality classification

Follows the criteria of WSQM for quality classification

Composed of 4 major quality factors


WSQM TC 88

WSQDL(Web Service Quality Description Language)


Composed of factor, subfactor, property, subproperty, function, and

performance

Concept of quality chain (connected factors)

Target Web services

Quality Factor

Biz process factor

Eval factor

Biz value factor

Measure factor

Property Sub property Function Performance

Sub factor

Sub factor Property Appraisal

Sub factor Property Function Performance

Metric

WSQM TC 99

Why?


User wants to search on quality data

Quality data is variable -> should be synchronized

WSQMS and WS Registry is complementary for each other

How?

Preserve functional independency

Sharing quality data

Implement API of SOAP-based

Automatic operation

WSQM TC 1010

Method 1: WS registry has a reference to WS quality data in WSQMS

How to share Quality Data?

Need no synchronization process for quality data between WS

registry and WSQMS

Restriction in use of quality data at WS registry

Method 2: WS registry has copy of WSQDL from WSQMS Need the synchronization process

Possible to search WS on WS quality data


WSQM TC 1111

Scenario of Method 1


WSQMS initiates WS quality activity

WS Registry provides WSDL

WSQMS provides quality information

Web service provider

register Web service

request new Web service info

provide WSDL of new Web service

Web service

test with agent

store quality data

Connection API

store reference of quality data

provide reference of quality info

WS RegistryWeb Service Quality Management System

Web serviceQuality info

WSQM TC 1212WS Provider

provide WSDL of new WS + request info of quality context

Web service

test with agent

ConnectionAPI

provide info of quality context

WS Registry

WS Registry manager

register quality context

register WS

Scenario of Method 2 WS Registry requests the data of quality context of a new WS

WSQMS provides WSQDL after testing

WS registry parses it and store the quality value as quality context

Web Service Quality Management System

store value of WS quality context

Web serviceQuality info

store quality data


WSQM TC 1313

Connection APIs

classification API name Function description

Search new WS

find_newBusinesses Search new biz entity

find_newServices Search new biz service

find_newBindings Search new binding

find_newtModels Search new tModel

Save WS quality data

save_refOfWSQDL

save_qualityContext

Write reference to quality data in tModelStore the quality context inform.

Modify&delete WS quality data

delete_qualityDataupdate_qualityData

Delete WSQDL tModel Modify WSQDL tModel

Synch WS inform

synch_WSDLSynch periodically WSDL between WSQMS and WS registry

Time inform of updating quality data

get_lastUpdateTimeQDget_lastUpdateTimeQC

Last update time of WSQDLLast update time for quality context

Messaging I/F

Security I/F

Registry Service Receiver

Quality Data Query Manager

Quality Data LC Manager

Quality Data Sender

Registry Service Requester

WSQMS

Messaging I/F

Security I/F

Registry Service Sender

Quality Data Requester

Quality Data LC Requester

Quality Data Receiver

Registry Service Request Receiver

Web Registry

For connection, quality data processing, WS registry service, and messaging

& security APIs are required.

Each module is composed of necessary functions, used by SOAP I/F.


WSQM TC 1414

Question

Update WS Registry

How to preserve the current implementation as possible as?

How to connect with WSQMS seamlessly?

How to organize the quality classification scheme?

Answer

Follow UDDI spec as possible as

Provide APIs for connection in SOAP style

Devise a new data structure such as categoryBag and quality

context

WSQM TC 1515

Method 1: modify overviewDoc

Add <wsqdlURL> tag in <overviewDoc>

Easy to understand, but difficult to process quality data flexibly

Update WS Registry

WSQM TC 1616

Method 2: add qualityBag

Add <qualityBag> tag in

tModel such as

<categoryBag>, storing

quality data reference

in tModel.

Possible independent

processing for quality

reference

Update WS Registry

WSQM TC 1717

Method 3: add qualityContext

Add <qualityBag> tag in

tModel such as method 2

for representing

<qualityContext>

Update WS Registry

WSQM TC 1818

Purpose


Enable user to search WS on quality data.

Enable high-level composite search on quality data.

For example: Search WS satisfying WS-I interoperability with 128

encryption key for DSIG, responding 0.01 sec.

Issues

How to compose the quality classification scheme?

How to update the value of quality classification item

up-to-date?

WSQM TC 1919

WSQDL

Metric Eval Biz Proc Biz Val

Interop Sec Manage

keySize encAlg

WSQMS UDDI tModel

<qualityBag> <tModelKey=“uddi:uddi.org:wsqm:quality:wsqdl-3344”/>

<qualityContext tModelKey=“uddi:uddi.org:wsqm:eval:security:keySize” value=“128”/>

<qualityContext tModelKey=“uddi:uddi.org:wsqm:eval:security:encAlg” value=“RSA”/>

</qualityBag>

Concept of quality context Path for representing quality factor according to WSQDL quality

chain

Represented as a set in <qualityBag>


WSQM TC 2020

WSDL 1

Quality context 1 value



WSDL 2




WSDL 3




Quality Context

WSquality

/eval/sec/keySize128: WS1, WS2

64: WS3

/eval/sec/encAlgRSA: WS1

DES: WS2, WS3

/eval/int/ratioWSI99: WS1

< 97: WS3

98: WS2

Quality classification

Quality classification Compose quality classification scheme with quality context Get a quality value on the quality context


WSQM TC 21

Background

Adopt UN/SPSC classification scheme for WS classification scheme, but

UN/SPSC classification is too complex to use WS classification.

55 segments, 350 families, 3600 classes, 17000 commodities

There are similar classification item and items with no clear criteria for

classification.

Most items in UN/SPSC is for industry of manufacturing.

Need an Advanced classification architecture

Modification of WS Registry Classification

WSQM TC 22


Method1: caching classification data

• Preserve cache storage for an item of classification scheme accessed once.• Give priority number to the cached data according to its access number • Issues

– Performance degradation due to abnormal access

Classification Scheme for WS Registry

request searchsearch

return result

cache data

result

Cache storage

segment

family

class

commodity

WSQM TC 23

Method 2: make synonym dictionary

• Implement synonym dictionary on the classification scheme.• Issues:

– Objective criteria for deciding synonymy of classification items

segment

family

class

commodity

Refer synonym

search

return result

Synonym dictionary



WSQM TC

segment

family

class

commodity


24

Method 3: tagging accessed classification items by user

• User tags classification items accessed with tag named by the user. • User can search more easily based on the tag data• Issues:

– Obstacle of tag data named wrongly.

request search

Return result

Tag classification


WSQM TC 25

Method 4: implement knowledge ontology for classification

• Define knowledge ontology classification item frequently asked. • For example,

– If a public project related with energy, then find out energy saving, measuring usage of energy, district heating.

• Issues – Difficult to make knowledge rule– Require additional knowledge search system.


WSQM TC

segment

family

class

commodity

Classification Scheme for WS Registry 26

Method 5: user classification with mapping script

• Make user classification scheme (industry, service, usage,…)• By mapping script, user classification should be synchronized with master

classification.• Issues:

– How to expand user classification flexibly

request search

Return result

User classification

Mapping script


WSQM TC 27

• After completion of these systems, WSQMS and WS registry, they could

contribute to enhance WS quality more rapidly.

WSQMS has been implemented.

trying to implement connection APIs

plan to modify national WS registry

• Classification scheme is critical for WS dissemination. It needs

continuous modification efforts.

• Further research for connection between national WS registries

Conclusions

WSQM TC 282828

Thank you

Youngkon Lee:

[email protected]

Documents

Knowledge-Based Service Quality Assurance for Korea e-Government 29 th April 2008 Youngkon Lee (NIA/WSQM TC)