10
PERFORMANCE TESTING OF PVM AND MPI WITH THE MOSIX PROCESS MIGRATION IN A DISTRIBUTED COMPUTING ENVIRONMENT Mr. Ye Myint Naing [[email protected]] STATE MARINE TECHNICAL UNIVERSITY, ST.PETERSBURG 1 JINR, LIT 16-21 July,2012 Dubna

PERFORMANCE TESTING OF PVM AND MPI WITH THE MOSIX PROCESS MIGRATION IN A DISTRIBUTED COMPUTING ENVIRONMENT Mr. Ye Myint Naing [[email protected]]

Embed Size (px)

Citation preview

Page 1: PERFORMANCE TESTING OF PVM AND MPI WITH THE MOSIX PROCESS MIGRATION IN A DISTRIBUTED COMPUTING ENVIRONMENT Mr. Ye Myint Naing [yemyintnaing@gmail.com]

1

PERFORMANCE TESTING OF PVM AND MPI WITH THE MOSIX PROCESS MIGRATION IN A DISTRIBUTED COMPUTING ENVIRONMENT

Mr. Ye Myint Naing

[[email protected]]

STATE MARINE TECHNICAL UNIVERSITY, ST.PETERSBURG

JINR, LIT 16-21 July,2012 Dubna

Page 2: PERFORMANCE TESTING OF PVM AND MPI WITH THE MOSIX PROCESS MIGRATION IN A DISTRIBUTED COMPUTING ENVIRONMENT Mr. Ye Myint Naing [yemyintnaing@gmail.com]

2

WHAT IS MOSIX?

An operating system-like management system for distributed-memory architectures, such as clusters and multi-clusters, including remote clusters on Clouds

Main features: Provides a single-system image. Automatic resource discovery Dynamic workload distribution by process

migration

Page 3: PERFORMANCE TESTING OF PVM AND MPI WITH THE MOSIX PROCESS MIGRATION IN A DISTRIBUTED COMPUTING ENVIRONMENT Mr. Ye Myint Naing [yemyintnaing@gmail.com]

3

KERNEL LAYER OF MOSIX

Page 4: PERFORMANCE TESTING OF PVM AND MPI WITH THE MOSIX PROCESS MIGRATION IN A DISTRIBUTED COMPUTING ENVIRONMENT Mr. Ye Myint Naing [yemyintnaing@gmail.com]

4

MOSIX DIRECT FILE SYSTEM ACCESS

• Provides a unified view of all files and all mounted FSs on all nodes, as if they were within a single FS

• Makes all directories and regular files throughout a MOSIX cluster available from all the nodes

• Provides file consistency from different nodes by

maintaining one cache at the server (disk) node

• Parallel file access by process migrate

Page 5: PERFORMANCE TESTING OF PVM AND MPI WITH THE MOSIX PROCESS MIGRATION IN A DISTRIBUTED COMPUTING ENVIRONMENT Mr. Ye Myint Naing [yemyintnaing@gmail.com]

5

PROCESS MIGRATION

Page 6: PERFORMANCE TESTING OF PVM AND MPI WITH THE MOSIX PROCESS MIGRATION IN A DISTRIBUTED COMPUTING ENVIRONMENT Mr. Ye Myint Naing [yemyintnaing@gmail.com]

6

DYNAMIC LOAD BALANCING

Page 7: PERFORMANCE TESTING OF PVM AND MPI WITH THE MOSIX PROCESS MIGRATION IN A DISTRIBUTED COMPUTING ENVIRONMENT Mr. Ye Myint Naing [yemyintnaing@gmail.com]

7

PVM VS MOSIX

400X

400

600X

600

800X

800

1000

X100

00

0.5

1

1.5

2

2.5

3

3.5

6 processes(PVM without MOSIX)

10 processes(PVM without MOSIX)

6 processes(PVM with MOSIX)

Number of matrix

seco

nd

s

Page 8: PERFORMANCE TESTING OF PVM AND MPI WITH THE MOSIX PROCESS MIGRATION IN A DISTRIBUTED COMPUTING ENVIRONMENT Mr. Ye Myint Naing [yemyintnaing@gmail.com]

8

MPI VS MOSIX

2 3 4 5 60

2000

4000

6000

8000

10000

12000

14000

Number of process

Avg round trip time (MPI without Mosix)

Avg one way latency(MPI without Mosix)

Avg round trip time(MPI on Mosix)

Avg one way latency(MPI on Mosix)

Mic

rose

con

ds

Page 9: PERFORMANCE TESTING OF PVM AND MPI WITH THE MOSIX PROCESS MIGRATION IN A DISTRIBUTED COMPUTING ENVIRONMENT Mr. Ye Myint Naing [yemyintnaing@gmail.com]

9

CONCLUSIONS

High performance of a cluster on completely parallel tasks,

MOSIX preemptive process migration mechanism and its load balancing sheme.

For performance increase on strongly connected tasks it is necessary to increase speed of a network, for example using Gigabit Ethernet or Myrinet.

MOSIX don't manage to be reached a gain in performance of single process

Page 10: PERFORMANCE TESTING OF PVM AND MPI WITH THE MOSIX PROCESS MIGRATION IN A DISTRIBUTED COMPUTING ENVIRONMENT Mr. Ye Myint Naing [yemyintnaing@gmail.com]

10

THANKS YOU