Embed Size (px)
DESCRIPTION
A Communication Relay Mechanism toward Construction of Virtual Cluster on Orverlay Network. PRAGMA14 Working Group 11-12 March 2008 Yasuyuki Kusumoto Osaka University, Cyber media Center. Motivation of this study. - PowerPoint PPT Presentation
Citation preview
A Communication Relay Mechanismtoward Construction of Virtual Cluster
on Orverlay NetworkPRAGMA14 Working Group
11-12 March 2008
Yasuyuki Kusumoto
Osaka University, Cyber media Center
Motivation of this studyIt is difficult to unify resources on Grid and
provide a single optimum computational system with a userHeterogeneous computational environmentDisability on network connectivity, such as NAT, FW
Requirement for virtual clusterHomogeneous computational machines
⇒virtualization technology (Xen)End to end communication among nodes of virtual
clusters⇒orverlay network(P2P framework: PIAX)・・・
・・・
siteA
siteCsiteB
os:solarislibrary:2.0.1
os:redhatlibrary:1.0.0
・・・os:debian
library:1.1.2
Grid resources
FirewallNAT
Heterogeneous
Disconnectivity
Virtual cluster on overlay network(P2P)Our approach for virtual cluster
Gathering computational machines on overlay networkDeployment of virtual machines on gathered machinesProviding a private network among virtual machines
goalproviding a customizable computational environment
with a user
virtual cluster
・・・・・・
Grid resources ・・・
Overlay network
virtualization virtualization
virtual cluster
Virtual network Virtual network
A communication relay mechanism
Private network communication among virtual machinesEnd-to-end communication with IP regardless of
NAT,FW⇒Virtual private network over a P2P environment
Relaying VPN communication on orverlay networkThis mechanism:
delivers VPN packets on overlay network regardless of NAT, FW
allows virtual machines to communicate with IP each other
Overlay network
relay relay relay relay relay
Communicationrelay mechanism
Virtual machine A
Virtual machine B
Virtual machine C
Virtual machine D
Virtual machine E
The communication relay mechanism architecture
OrverlayNetworkVPN
workerApp masterApp
VirtualNICIP:10.8.0.a
VirtualNICIP:10.8.0.b
vpnclient vpnserver
PIAX PIAX
ID communication
IP communication
TunnelAgent
TunnelAgent
hostA(worker) hostB(master)
forward vpn packets by using
logical ID communication
End-to-end communication with IP
Performance evaluation of the proposed mechanism
Communication throughputmaster-worker communication
(bandwidth:100Mbps)Execution of distributed computation
applicationsDock
cpu utilization: big network utilization: smallHimeno Benchmark cpu utilization: big network utilization: big
communicationthroughput[Mbps]
App:Dockexaction time[sec]
App:HimenoBenchscore[Mflops]
Physical cluster 93.3 773 737Virtual cluster 8.8(-90.3%) 779(-0.6%) 205(-72%)
SummaryThe proposed mechanism
provides virtual private network across multiple organizationsrealizes a virtual cluster on a P2P environment
Future worksImprovement of communication throughput
VPN hole-punching on overlay networkOn-demand construction of virtual clusters
Automatic deployment of virtual machines by utilizing data transfer functions of P2P
Collecting resources broadly by using the resource powerful searching ability of PIAX
fin
SummaryThe proposed mechanism
provides virtual private network across multiple organizationsrealizes a virtual cluster on a P2P environment
Future worksImprovement of communication throughputOn-demand construction of virtual clustersAutomatic deployment of virtual machines by
utilizing data transfer functions of P2P
Virtual cluster
Virtual cluster on overlay network(P2P)Advantages of P2P
Scalability of computational resourcesResource DiscoveryNetwork connectivity(solves problem of NAT, Firewall)
GoalTo provide a customizable computational environment
(virtual cluster) with a user
virtual cluster virtual cluster
・・・・・・
Resources of grid ・・・
Overlay network
virtualization virtualization
Requirements for communication among virtual cluster nodes
virtualization virtualization
virtualization
Virtual Cluster
Virtual Private Network
Overlay network
Private network communication among virtual machinesEnd-to-end communication with IP regardless of
NAT,FW⇒Virtual private network over a P2P environment
A communication relay mechanism
relays VPN communication on orverlay networkThis mechanism:
delivers VPN packets on overlay network regardless of NAT, FW
allows virtual machines to communicate with IP each other
Overlay network
relay relay relay relay relay
Communicationrelay mechanism
Virtual machine A
Virtual machine B
Virtual machine C
Virtual machine D
Virtual machine E
Motivation for studyVirtual cluster on orverlay network(P2P)
Scalability of computational resourcesDiscovery for resources
Virtual machine (Xen)
Virtual cluster on overlay network
siteA・・・ siteB
・・・
siteC・・・
Virtualization Virtualization
Virtualization
virtual clustervirtual cluster
Necessity for new communication mechanism
Virtual Private Network
Virtual Cluster
User’s job
Performance of proposed system
Communication throughputExecution of application
Dock :CPU-intensive application()
Physical cluster Virtyal cluster0
100
200
300
400
500
600
700
800
900
Exec
ute
time[
s]
Physical cluster Virtyal cluster0
10
20
30
40
50
60
70
80
90
100
thro
ughp
ut[M
bps]
・・・siteCsiteA
・・・siteB
・・・Virtualiza
tionVirtualiza
tionVirtualiza
tion
Virtual Private Network
Virtual Cluster
User’s job
overlay network
PIAX
virtualmachine
Xen
Summary and Future work Summary
Proposed system enable computers on orverlay network to communicate using IP address
Realization for Construction of virtual cluster utilizing our proposed communication system
Future work
Improvement of communication throughputOn-demand construction of virtual cluster
n overlay network1/2
・・・siteA siteCsiteB
・・・ ・・・Virtualization Virtualization Virtualization
Virtual Private Network
Virtual Cluster
User’s job
overlay network
PIAX
virtualmachine
Xen
Virtual cluster on overlay network
siteA・・・ siteB
・・・
siteC・・・
Virtualization Virtualization
Virtualization virtualmachine
Xen
overlay network
PIAX
virtual cluster
Necessity for new communication mechanism
Virtual Private Network
Virtual Cluster
User’s job
Necessity for new communication mechanism
User’s job
virtualization virtualization
virtualization
Virtual Private Network
Virtual Cluster
Overlay network
Necessity for new communication mechanism
Virtual Private Network
Virtual Cluster
virtualizationvirtualization
virtualization
Overlay network
User’s job
Virtual cluster on overlay network(P2P)Integration of virtual machines on wide area
distributed environment(P2P) Scalability of computational resourcesDiscovery for resources
Goal
virtual cluster virtual cluster
・・・・・・
Resources of grid ・・・
Overlay network
virtualization virtualization
virtualization
Virtual network
Virtual network
・・・
・・・
Grid resources ・・・
overlay network
virtual resource
virtual cluster
virtual resource
virtual cluster
