View
219
Download
0
Category
Tags:
Preview:
Citation preview
Status of STAR Asian Computing Center at
KISTI20 Sept. 2010
Kunsu Oh*, Jonghu Lee***Dept. of Physics Pusan National Univ., **KISTI
GSDC
3
1. STAR Collaboration & Comput-ing
RHIC (Relativistic Heavy Ion Collider)
• Au+Au, Cu+Cu, d+Au, p+p collision
• 5~200GeV/nucleon
International Collaboration• 594 scientists
• 54 institutes
• 12 countries
STAR detector is doing major upgrade on• Beam Luminosity X 10
• DAA rates X 10
4
STAR Computing
Produced Huge Data: ~1PB/year
Needed many Computing resources (CPU and storage)
Increase Asian Collaborations: Increase Asian Computing Needs
STAR Asian Computing Center!!
5
SACC Project
STAR Asian Computing Center
Creating and Developing a resource and facility in Asia
GoalHub for Asian CollaboratorsA new STAR computing center for data production
ProgressNetwork OptimizationSTAR software installationProduction and Analysis
6
GSDC
Supporting to various Data Intensive Researches
MISSION
Physics 2009 ~ Next ~ALICESTARBelleCDF
VariousBio-informaticsEarth ScienceAstrophysics
National Representative Playerin Data Centric Research Area
7
Current Status
ALICE Tier-1 Test-bedALICE Tier-2KIAF (Kisti Analysis Farm)
RAW Data
Tier-1
RAW Data
SUPPORTING DATA CENTRIC RESEARCH COMMUNITIES&
PROMOTION OF RESEARCH COLLABORATION
Computing and Storage Infrastructure Technology Development Apply Grid Technology to legacy app.
supportKorean Gov.
8
Members
No Name Role
1 Dr. Haengjin Jang Head of GSDC
2 Dr. Hyungwoo Park Project Management
3 Mr. Jinseung Yu Technical Staff (Network)
4 Mr. Heejun Yoon Technical Staff (DBA)
5 Dr. Beokyun Kim Technical Staff (Grid)
6 Dr. Christophe Bonnaud Technical Staff (Admin)
7 Dr. Seokmyun Kwon Technical Staff
8 Dr. Seo-Young Noh Technical Staff
9 Dr. Jonghu Lee Technical Staff (STAR contact)
10 Dr. Seungyun Yu Planning
11 Mr. Kyungyun Kim Technical Staff
12 Mr. Seunghee Lee Technical Staff
13 Ms. Tajia Han Technical Staff
9
Activities
ALICE Tier-1 Test-bed
Completed set-up ALICE Tier-1 test-bed this yearWill provide official service in a few years
ALICE Tier-2 Site availability: 98% since Feb. 2009
BelleProviding computing resources for Belle MC pro-duction (Grid)Bell to provide their data to KISTI GSDC
CDF Providing computing resources under NAMCAFSupporting CDFSoft development
LIGO Set-up LIGO cluster test-bed
GBrain Planning to cooperate with global brain research project (mainly from McGill Univ. Canada)
10
Current Computing Resources: Cluster Server
Cluster Spec Mem. Node Core kSI2k
Ce-aliceDellIntel Xeon E5405 2.0 GHz Quad 2 CPU
16GB 6 48 48
Ce01HPIntel Xeon E5420 2.5GHz Quad 2 CPU
16GB 16 128 219
Ce02IBMIntel Xeon E5450 3.0GHz Quad 2 CPU
16GB 38 304 650
This Year
IBMIntel Xeon X5650 2.66GHz 6 Core 2 CPU
24GB 36 432 1,2
11
Current Computing Resources:Storage
Year Model Disk/Tape Physical Size Usable Size
2008 NetApp FAS2050 Disk(SAN) 48TB 30TB
2009 NetAppFAS6080 Disk(SAN, NAS) 334TB 200TB
This Year HitachiUSP-V Disk(SAN) 960TB 600TB
This Year - Tape 100TB 100TB
Total 1442TB 930TB
13
Network Architecture
8Gb SAN S/W
….
10GbE S/W
…
SANU600TB
FC FCController #1 Controller #2
PFS Servers
10GbE S/W
GLORIAD
FCController 1,2
SANU160TB
2009
: 8Gb FC
: 1GbEthernet
: 10GbEthernet
1G/10GbE S/W
FC
Controller 1,2
NASU40TB
NAS NAS
WN Servers
…
1G Grid Servers
10G Grid Servers1G Grid Servers
….
Public
Private
2010
IBRIX Fusion Cluster File Sys-
tem
14
2. Current Status SACC
CollaborationProvide Service
ProvideComputing ResourcesSTAR Asian Users
(China, India, etc.)
KISTI GSDC will contribute STAR experiments.Particularly Asian user community
15
Network Architecture
1F 신규 2 전산실S/W
1F 신규 2 전산실S/W DJ-F10
DJ-F10 대전OME6500
대전OME6500 시애틀
OME6500
시애틀OME6500
시애틀OSR
시애틀OSR
DJ_7609Cisco7609
DJ_7609Cisco7609 1F –FDF(3,4)
1F –FDF(3,4)
Foundry 2402CF
Foundry 2402CF
2F 대용량데이터팀
1G
FDF(3,4)FDF(3,4)
FDF(3,4)FDF(3,4)
VLAN 124
IP : 134.75.238.1 / 26
VLAN 233
IP : 150.183.233.1 / 24
G3/18
G2/5G8/21
G0/26
T2/3
G2/11
1G
Starproject to BNL
KISTI 2F 대용량데이터팀 LAB
3F –FDF(3,4)3F –FDF(3,4) Foundry
SuperX
Foundry SuperX
Gloriad-KRGloriad-KR
10G Trunk
Vlan 123, Vlan124
VLAN 123
IP : 134.75.123.1 / 24
10G
1G Lightpath
Vlan124
10G Trunk
Vlan 12310G
시애틀 F-10시애틀 F-10
10G 10G
10G
10G
1G 1G
16
Current Resources
CPUsIntel Xeon E5450 300cores≈ 960kSI2K (1core = 3.2kSI2K)shared queue
StoragesDisk: 100TBTape: 100TB
Network 10G GLORIAD: Active
Software SL10i on the Scientific Linux 5.5 64bits
17
Resource Plan
2010 2011 2012
CPU (kSI2K) 960 2,080 3,100
StorageDisk (TB) 100 200 300
Tape (TB) 100 200 300
Network~10G (GLO-
RID) ~10G (GLO-
RID)~10G (GLO-
RID)
18
3. Future Plan of SACC
Before 2010
Jan. 2011
Summer 2011
Installation of additional CPUs (+430 cores) & Tests MOU between KISTI GSDC and BNL STAR Collaboration Start user service for Asian users MOU between KISTI GSDC and Asian institutes
RUN11 – online data transfer from BNL to KISTI GSDC
Installation of additional storages (100TB disk + 100TB tape)
19
Our Vision
GLOBAL SCIENCE DATA PIPELINE
ASIAN HUBFOR GLOBAL DATA CENTRIC RESEARCH
Recommended