19

Click here to load reader

5 Vampir Configuration At IU

  • Upload
    ptihpa

  • View
    613

  • Download
    5

Embed Size (px)

Citation preview

Page 1: 5 Vampir Configuration At IU

How To Use TheVampir Toolchain At IU

Robert [email protected]

May 2009

Page 2: 5 Vampir Configuration At IU

Robert Henschel

Contents• Quarry• BigRed• Hands On

Page 3: 5 Vampir Configuration At IU

Robert Henschel

General• Trace creation and visualization does not have to

happen on the same platform!– You can look at traces created on Quarry (or your

own desktop) on BigRed

Page 4: 5 Vampir Configuration At IU

Robert Henschel

Quarry – SoftEnv Keys• Vampir Version 5.2

+vampir-5.2-32 or +vampir-5.2-64

• VampirServer Version 1.10+vampirserver-1.10-32or+vampirserver-1.10-64

• VampirTrace Version [email protected]+openmpi-1.3.1-intel-10.1-64+vampirtrace-5.6.3-intel-64or @intel-10.1.022-32+openmpi-1.3.1-intel-10.1-32+vampirtrace-5.6.3-intel-32

Page 5: 5 Vampir Configuration At IU

Robert Henschel

Quarry – Running Vampir• Vampir Version 5.2

– Interactive job in PBS– On interactive nodes b005-b008

Page 6: 5 Vampir Configuration At IU

Robert Henschel

Quarry – Running Vampir• Vampir Version 5.2

– Interactive job in PBSqsub -I -Xsoft add +vampir-5.2-64vampir

– On interactive nodes b005-b008• You share the node with other people, this is

especially a problem for opening large trace files!ssh -X b005soft add +vampir-5.2-64vampir

Page 7: 5 Vampir Configuration At IU

Robert Henschel

Quarry – Running VampirServer• Vampir Server Version 1.10

– Server in PBS, viewer on interactive node– Server and viewer in interactive job in PBS– Server and viewer on interactive nodes b005-b008

Page 8: 5 Vampir Configuration At IU

Robert Henschel

Quarry – Running VampirServer• Vampir Server Version 1.10

– Server in PBS, viewer on interactive node• Server in PBS

–Make sure your “.soft” file contains+openmpi-1.3.1-intel-10.1-64+vampirserver-1.10-64

»Logout/Login to active changes in “.soft”–PBS script

Start jobqsub vampir.pbs

–Wait for the job to start

#PBS -l nodes=2:ppn=8,walltime=5:00:00#PBS -m ae#PBS -N VampirServer#PBSmpirun -np 16 -machinefile $PBS_NODEFILE vngd -n 16 1>$HOME/vampir.out 2>&1

Page 9: 5 Vampir Configuration At IU

Robert Henschel

Quarry – Running VampirServer–Lookup host and port information

» It may take a minute or two after the job started for this file to get updated!!!

cat $HOME/vampir.outRunning...Server listens on: b052:30000

• Viewer on interactive nodes b005-b008ssh -X b005soft add +openmpi-1.3.1-intel-10.1-64soft add +vampirserver-1.10-64vng -a b052 -p 30000

Page 10: 5 Vampir Configuration At IU

Robert Henschel

Quarry – Running VampirServer– Interactive job in PBS

• Only one nodeqsub -I -Xsoft add +openmpi-1.3.1-intel-10.1-64soft add +vampirserver-1.10-64mpirun -np 8 vngd -n 8 1>output 2>&1 &cat output

Running...Server listens on: b048:30000

vng -a localhost -p 30000

Page 11: 5 Vampir Configuration At IU

Robert Henschel

Quarry – Running VampirServer– On interactive nodes b005-b008

• Only one node• Runtime needs to be less than 24 hours• You share the node with other peoplessh -X b005soft add +openmpi-1.3.1-intel-10.1-64soft add +vampirserver-1.10-64mpirun -np 4 vngd -n 4 1>output 2>&1 &cat output

Running...Server listens on: b005:30000

vng -a localhost -p 30000

Page 12: 5 Vampir Configuration At IU

Robert Henschel

Quarry – Tracing with VampirTrace 5.6.3• VampirTrace is configured to work with the Intel

compilers version 10.1 and OpenMPI 1.3.1

• Include the following keys in your .soft [email protected]+openmpi-1.3.1-intel-10.1-64+vampirtrace-5.6.3-intel-64

• The VampirTrace compiler wrappers are now available• It is possible to use them also with GCC, if you need to

do that, please send a mail to [email protected]• We can also provide a version for the PGI compilers.

Page 13: 5 Vampir Configuration At IU

Robert Henschel

BigRed – SoftEnv Keys• Vampir Version 5.1

+vampir-5.1-64

• VampirServer Version 1.10+vampirserver-1.10-64

• VampirTrace Version 5.6.3+openmpi-1.3.1-ibm-64+vampirtrace-5.6.3-ibm-64or +openmpi-1.3.1-ibm-32+vampirtrace-5.6.3-ibm-32

Page 14: 5 Vampir Configuration At IU

Robert Henschel

BigRed – Running Vampir• Vampir Version 5.1

– Interactive job in LoadLeveler

Page 15: 5 Vampir Configuration At IU

Robert Henschel

BigRed – Running Vampir• Vampir Version 5.1

– Interactive job in LoadLevelersoft add +interactivejobinteractivejob -w 60soft add +vampir-5.1-64vampir

• interactivejob can be customize for longer interactive sessions

– run “interactivejob -?” for more

Page 16: 5 Vampir Configuration At IU

Robert Henschel

BigRed – Running VampirServer• Vampir Server Version 1.10

– Server in LoadLeveler, viewer on login node

Page 17: 5 Vampir Configuration At IU

Robert Henschel

BigRed – Running VampirServer• Vampir Server Version 1.10

– Server in LoadLeveler, viewer on login node• Server in LoadLeveler

–Make sure your “.soft” file contains+openmpi-1.3.1-ibm-64+vampirserver-1.10-64

»Logout/Login to active changes in “.soft”–Submit job to LoadLeveler

run_server.sh 4 DEBUG 15orrun_server.sh 16 LONG 15

–Wait for the job to start

Page 18: 5 Vampir Configuration At IU

Robert Henschel

BigRed – Running VampirServer–Lookup host and port information

» It may take a minute or two after the job started for this file to get updated!!!

cat $HOME/paralleljob.x.0.outRunning...Server listens on: s10c1b4:30000

• Viewer on login nodesoft add +vampirserver-1.10-64vng -a s10c1b4 -p 30000

Page 19: 5 Vampir Configuration At IU

Robert Henschel

BigRed – Tracing with VampirTrace 5.6.3• VampirTrace is configured to work with the IBM compilers

and OpenMPI 1.3.1

• Include the following keys in your .soft file+openmpi-1.3.1-ibm-64+vampirtrace-5.6.3-ibm-64

Logout/Login to active changes in the .soft file or run resoft from on command line.

• The VampirTrace compiler wrappers are now available