22
1 Jaime E. Combariza, PhD Director Maryland Advanced Research Computing Center HHPC@JHU

Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s

1

Jaime E. Combariza, PhDDirector

Maryland

Advanced

Research

Computing

Center

HHPC@JHU

Page 2: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s

IDIES Annual SymposiumOctober 17 ,2014

Data Lifecycle

2

IDIES Annual SymposiumOctober 17 ,2014

Storage

Preservation

Processing

Reuse

Publication

Analysis

Sharing

H

P

C

REPOSITORY

Generation

Page 3: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s

IDIES Annual SymposiumOctober 17 ,2014

Collecting Big Data

3

IDIES Annual SymposiumOctober 17 ,2014

High Res. telescopes

Satellites

Social Networks

FinancialMarkets

Brain Science

PredictiveComputational Science

Smart Networks

Virtual Libraries

HumanGenomics

Large Scale Experiments

Page 4: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s

IDIES Annual SymposiumOctober 17 ,2014

Data-Rich Environment (Effects)

4

IDIES Annual SymposiumOctober 17 ,2014

Eco-Informatics Biomedical Informatics

Astro-Informatics Data Driven Applications

Digital Humanities

Page 5: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s

IDIES Annual SymposiumOctober 17 ,2014

Opportunities

5

IDIES Annual SymposiumOctober 17 ,2014

Innovation, Competition and Productivity

Page 6: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s

IDIES Annual SymposiumOctober 17 ,2014

What’s being done

6

IDIES Annual SymposiumOctober 17 ,2014

• WH 2012 200M R&D for big data

• NSF & NIH (many programs)

• Gordon and Betty Moore Foundation

• Many schools VIDA, DI2,

• States, e.g.: Mass

• Xsede (9/2/14)

Page 7: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s

IDIES Annual SymposiumOctober 17 ,2014

HPC Ecosystem that supports computationally-intensive and data centric computing

What’s Maryland doing?

7

IDIES Annual SymposiumOctober 17 ,2014

Investment

Page 8: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s

IDIES Annual SymposiumOctober 17 ,2014

Data center and data-rich environment

9

IDIES Annual SymposiumOctober 17 ,2014

Infrastructure Network

Compute Engine

Storage

Cyberinfrastructure

Page 9: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s

IDIES Annual SymposiumOctober 17 ,2014

CIDR

Science DMZ @ JHU

11

IDIES Annual SymposiumOctober 17 ,2014

CIDR

40Gb/sLatrobe

MaloneCRB

PH

Clark

HoRNET

PHA

100Gb/s

Page 10: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s

IDIES Annual SymposiumOctober 17 ,2014 HPC Resources & Model

13

IDIES Annual SymposiumOctober 17 ,2014

• Approx 18,000 cores and 20 Petabytes storage

KSAS:10.5M Quarter

WSE: 10.5M/Q

SOM: 6.2M/Q

PH: 5.8M/Q

UMCP: 5.8M/Q

Page 11: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s

IDIES Annual SymposiumOctober 17 ,2014

Hardware

15

IDIES Annual SymposiumOctober 17 ,2014

Count Description

648 Regular compute nodes, 128 GB RAM, Haswell 2.5GHz, 24 cores

50 Large memory nodes, 1 Tbyte RAM, ivy Bridge 3.0GHz, 48 cores

24 GPU nodes, 48 Nvidia K40 GPUs, 24 cores per node

2 PB High Performance File System (CIFS)

14 PB zFS File System

FDR-14 Infiniband Connectivity 2:1 blocking

Rpeak= 771 TFLOPs, RMax=617 TFLOPs, (61st place on Top500)

Page 12: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s

IDIES Annual SymposiumOctober 17 ,2014

Governance

17

IDIES Annual SymposiumOctober 17 ,2014

• Facility Governing Board (3 members JHU, 3 members UMCP)

• Scientific Management Committee (4 faculty members from JHU and UMCP).– Policies

– Allocation models

– Utilization

Page 13: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s

IDIES Annual SymposiumOctober 17 ,2014

Timeline

18

IDIES Annual SymposiumOctober 17 ,2014

• Data center: End of November

• Network install “mid December”

• Hardware deployment Dec 1 - Jan 2015

• Production system:

Page 14: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s

IDIES Annual SymposiumOctober 17 ,2014

Co-Location

19

IDIES Annual SymposiumOctober 17 ,2014

• Priority

• Early Spring we will have better guidelines and policies

• Cluster/server hosting and management

• Cluster/server hosting

• Virtual servers

Page 15: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s

IDIES Annual SymposiumOctober 17 ,2014

Next . . .

20

IDIES Annual SymposiumOctober 17 ,2014

• Website• FAQs

• Instruction on how to connect

• Request accounts

• Queueing system and queues

• Software & Application support

• Add Condos

• Documentation

Page 16: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s

IDIES Annual SymposiumOctober 17 ,2014

Summary

21

IDIES Annual SymposiumOctober 17 ,2014

• Create state of the art HPC facility (current and future needs)

• Develop an HPC ecosystem:• To foster collaboration and advance research agendas

• Develop or improve tools for more effective data analysis

• Resource to attract and retain top researchers

• Facility to properly house HPC resources with different requirements (Co-location)

• Researchers concentrate on science not on IT

Page 17: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s

IDIES Annual SymposiumOctober 17 ,2014

Information

22

IDIES Annual SymposiumOctober 17 ,2014

[email protected]

• Web site (soon) marcc.jhu.edu

Page 18: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s

IDIES Annual SymposiumOctober 17 ,2014

23

IDIES Annual SymposiumOctober 17 ,2014

Page 19: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s

IDIES Annual SymposiumOctober 17 ,2014

Page 20: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s

IDIES Annual SymposiumOctober 17 ,2014

Page 21: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s

IDIES Annual SymposiumOctober 17 ,2014

Page 22: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s

IDIES Annual SymposiumOctober 17 ,2014