SURFsara HPC Cloud 19 nodes, 32 cores and 256 GB RAM each 400 TB storage in total Maximum 40 Gb access to storage Installation Automation Automatic tool installation ● Cloudman script with opennebula support ● Galaxy codebase ● PostgreSQL DB & Sun Grid Engine ● Common NGS tools, e.g., BWA, bowtie, samtools, etc. Automatic reference dataset installation ● Cloudbiolinux script ● Common genome builds, hg18, hg19, mm9, tair10, etc. ● Tool specific genome indexes for bowtie, BWA, etc. NBIC Galaxy @ SURFsara HPC Cloud Mattias de Hollander, David van Enckevort, Leon Mei, Marc van Driel, Rob Hooft System Architecture Implemented using Cloudman script NFS shared file system ● /mnt/galaxyTools: galaxy, 3rd party tools, ● /mnt/galaxyData: galaxy user data, postgres DB ● /mnt/galaxyIndices: genomes, liftover chains Persistent Master Node 4core, 32G Tools, User data, Genomes, 50TB Dynamic Worker Node Cloudman auto- scaling NFS mounts Internet Backup Acknowledgement Enis Afgan and the members of NBIC Galaxy administration team NIOO, SURFsara, CTMM-TraIT Contact: [email protected] Or visit: http://galaxy.nbic.nl Usage Used successfully in a number of NGS courses organized by NBIC Base image was used by several project specific Galaxy instances running at SURFsara HPC Cloud 2010-08 2010-09 2010-10 2010-11 2010-12 2011-01 2011-02 2011-03 2011-04 2011-05 2011-06 2011-07 2011-08 2011-09 2011-10 2011-11 2011-12 2012-01 2012-02 2012-03 2012-04 2012-05 2012-06 2012-07 2012-08 2012-09 2012-10 2012-11 2012-12 2013-01 2013-02 2013-03 2013-04 2013-05 2013-06 0 10 20 30 40 50 60 70 80 90 100 #new users per month 2010-08 2010-09 2010-10 2010-11 2010-12 2011-01 2011-02 2011-03 2011-04 2011-05 2011-06 2011-07 2011-08 2011-09 2011-10 2011-11 2011-12 2012-01 2012-02 2012-03 2012-04 2012-05 2012-06 2012-07 2012-08 2012-09 2012-10 2012-11 2012-12 2013-01 2013-02 2013-03 2013-04 2013-05 2013-06 0 1000 2000 3000 4000 5000 6000 #jobs per month

NBIC Galaxy @ SURFsara HPC Cloud€¦ · · 2017-03-29SURFsara HPC Cloud 19 nodes, 32 cores and 256 GB RAM each 400 TB storage in total Maximum 40 Gb access to storage Installation

Download PDF Report

Upload
vukhanh
View
213
Download
0

Embed Size (px)

Citation preview

Page 1: NBIC Galaxy @ SURFsara HPC Cloud€¦ · · 2017-03-29SURFsara HPC Cloud 19 nodes, 32 cores and 256 GB RAM each 400 TB storage in total Maximum 40 Gb access to storage Installation

SURFsara HPC Cloud 19 nodes, 32 cores and 256 GB RAM each 400 TB storage in total Maximum 40 Gb access to storage

Installation Automation Automatic tool installation

● Cloudman script with opennebula support

● Galaxy codebase● PostgreSQL DB & Sun Grid Engine● Common NGS tools, e.g., BWA, bowtie, samtools, etc.

Automatic reference dataset installation● Cloudbiolinux script● Common genome builds, hg18, hg19, mm9, tair10, etc.● Tool specific genome indexes for bowtie, BWA, etc.

NBIC Galaxy @ SURFsara HPC CloudMattias de Hollander, David van Enckevort, Leon Mei, Marc van Driel, Rob Hooft

System Architecture Implemented using Cloudman script NFS shared file system

● /mnt/galaxyTools: galaxy, 3rd party tools, ● /mnt/galaxyData: galaxy user data, postgres DB● /mnt/galaxyIndices: genomes, liftover chains

Persistent Master Node4core, 32G

Tools, User data,Genomes, 50TB

Dynamic Worker Node

Cloudman auto-scaling

NFS mountsInternet

Backup

Acknowledgement Enis Afgan and the members of NBIC Galaxy administration team NIOO, SURFsara, CTMM-TraIT

Contact: [email protected] visit: http://galaxy.nbic.nl

Usage Used successfully in a number of NGS courses organized by NBIC Base image was used by several project specific Galaxy instances running at SURFsara HPC Cloud

2010-082010-09

2010-102010-11

2010-122011-01

2011-022011-03

2011-042011-05

2011-062011-07

2011-082011-09

2011-102011-11

2011-122012-01

2012-022012-03

2012-042012-05

2012-062012-07