P2P Distributed P2P Distributed Computing Computing Platform:Platform:

Korea@HomeKorea@HomeC.Y. ‘Connor’ Park

chan@kisti.re.krKISTI Supercomputing Center

- 2 - 16th APAN Meetings, BUSAN, KOREA

OverviewOverview

Korea@Home (KatH) : A Software Platform for Distributed Computing using Volunteer Computer Resources

Features Hybrid Peer-to-Peer architecture Secure PKI-based Security and Digital

Signature Web Services with SOAP messaging

- 3 - 16th APAN Meetings, BUSAN, KOREA

MotivationMotivation

To take advantage of and stimulate ‘Advanced Network Infrastructure in Korea’

To meet the growing needs of computing power for applications

Funded by ‘Ministry of Information and Communication (MIC)’

- 4 - 16th APAN Meetings, BUSAN, KOREA

InfrastructureInfrastructure

Over 10,000,000 Broadband network (xDSL, Cable) households - 2002. 11.

Over 58.4% of PCs with Pentium3+

76.9 78.6

23.1 21.4

0%

20%

40%

60%

80%

100%

2001.12 2002.12

Own PCs Not own PCs

82.3 89.3

17.7 10.7

0%

20%

40%

60%

80%

100%

2001.12 2002.12

Internet- enable Internet- unable

- 5 - 16th APAN Meetings, BUSAN, KOREA

Intention of ParticipationIntention of Participation

Korea@Home Understanding Intention of Providing Resources

Well-Understanding (44.9%)

Understanding roughly (21.8%)

Don’t Know (33.3%)

Keep up Providing (59.5%)

Providing later (30.4%)

Providing with Compensation (7.2%)

Don’t (2.9%)

•67.7% of Netizen already know what is Distributed Computing and Korea@Home.

•89.9% of Netizen have intention of providing their PC resources.

- 6 - 16th APAN Meetings, BUSAN, KOREA

Similar ProjectsSimilar Projects Science

SETI@Home, climateprediction.net

Life Science Folding@Home,

FightAIDS@Home Cryptography

Distributed.net, RSAttack576

Mathematics Mersenne Prime Search,

Pi(x) Project

Internet Grub, CycleTrader

Financial MoneyBee

Games ChessBrain

Miscellaneous DALiWorld

from http://www.aspenleaf.com/distributed/index.html

- 7 - 16th APAN Meetings, BUSAN, KOREA

Project HistoryProject History 2002. 4.

MIC launched the pilot project ‘Korea@Home’ Application : Virtual Screening for New Drug Design

2002. 8. First pilot production and test Client/Server Architecture Model

2002. 12. Second pilot production and test

2003. 4. Regularize the project “P2P Internet-based Distributed

Computing Platform Development” 2003. 9.

Announcement of Hybrid P2P-style Distributed Computing Platform

- 8 - 16th APAN Meetings, BUSAN, KOREA

ArchitectureArchitecture

CooperationCooperation

Cooperation

InternetInternet

Large-scaleApplication

ResourceManagement

Subscription

Distribution

Distribution Distribution

Distribution

Agent

Agent Agent

Agent

Job Request

- 9 - 16th APAN Meetings, BUSAN, KOREA

Design GoalsDesign Goals

Application Developers (Job Requester) Convenience

They should be able to use easily. Flexibility

The platform is general enough to be used by various applications.

Correctness The platform should return correct results.

- 10 - 16th APAN Meetings, BUSAN, KOREA

Design GoalsDesign Goals

PC agents (Resource Providers) Transparency

PC users are not disturbed in their own works. Reliability

It’s reliable not to make any security and privacy problem.

Reward There is any kind of compensation, even just

in mind.

- 11 - 16th APAN Meetings, BUSAN, KOREA

Design GoalsDesign Goals

Platform Scalability

Performance should be improved according to the growth of agents.

Adaptability It should put up with the dynamic features of

Internet.

- 12 - 16th APAN Meetings, BUSAN, KOREA

Implementation ChoicesImplementation Choices

Web Services SOAP messaging over https

Request-Response Model It is Agents’ duty to make most decisions.

PKI-based certification and Digital Signature for files

Make server as simple as possible, and Make PC agents

more intelligent

- 13 - 16th APAN Meetings, BUSAN, KOREA

Functional ClassificationFunctional Classification Resource Management

Authentication, Certification Simple accounting

Scheduling and Job distribution Job distribution with hybrid P2P style Result gathering

Client Management Client authentication Application preparation to work Digital signing Result returning to client

- 14 - 16th APAN Meetings, BUSAN, KOREA

Job DistributionJob Distribution

InternetInternet

KatH Server

Agent Agent Agent

Agent

Authentication

Working Specification Request• Is there any job for

me to work?•Who has the job

data? Getting data,

working, and returning result to server

- 15 - 16th APAN Meetings, BUSAN, KOREA

Networking IssuesNetworking Issues

Network Security DoS, Spoofing, Sniffing, …

Variable Connection Dial-up, cable, xDSL, T1/E1, … IPv6, WiFi, Bluetooth, …

Network Unobtrusiveness Background/shared communication

Transparency (Firewall/NAT)

- 16 - 16th APAN Meetings, BUSAN, KOREA

2002 Pilot Projects2002 Pilot Projects

Application : Virtual Screening for New Drug Design

Client-Server Architecture An Agent

Receives about 400KB-size file Executes during 20 minutes per working unit Returns about 190KB-size file

Total number of working job units : 50,000

- 17 - 16th APAN Meetings, BUSAN, KOREA

Virtual ScreeningVirtual Screening

Structure Analysis

Target Protein

Share

Analysis

Chemical DB

Disease Protein Ligand DB

Server

+ +

Client 1

+ +

+ +

Client 2

Client 3

Virtual High-Throughput Screening

Internet

Calculating Ligand PMI

Looking forDrug Candidate

Clinical Demo New Drug Mass-produce

Calculating Active Site PMI

- 18 - 16th APAN Meetings, BUSAN, KOREA

Experimental ResultsExperimental Results 1st Test

1,217 installed agents 2002.8.22-9.2 Max 53.5 Gflops / Avg. 31.78 Gflops

2nd Test 6,472 installed agents 2003.2.6-2.14 Max 644 Gflops / Avg. 470.6 Gflops

※ World Top Rank 124 - 629.7 Gflops: IBM xSeries Cluster Xeon 2.8 GHz - Myrinet/ 192(from http://www.top500.org, 2003.6)

- 19 - 16th APAN Meetings, BUSAN, KOREA

2003 Progresses2003 Progresses

P2P data distribution New Applications

Virtual Screening for New Drug Design Global Risk Management for financial

investment 3D image rendering

Supplementary plug-in Remote backup service

- 20 - 16th APAN Meetings, BUSAN, KOREA

Future worksFuture works

Make agents more intelligent with P2P

MPI-like API for application developer Fault-tolerance : checkpointing &

rollback recovery IPv6 enables Open-Source

- 21 - 16th APAN Meetings, BUSAN, KOREA

Thanks a lot! ^^

chan@kisti.re.kr