View
212
Download
0
Category
Preview:
Citation preview
SDSS Data Transfer
Jing-Jou Yen
Division Manager
National Center for High-Performance
Computing(August 26, 2005)
22
OUTLINEOUTLINE
Project Background
Introduction to NCHC/TWAREN
Sloan Digital Sky Survey (SDSS) Overview
Network Architecture and Configuration
Network Performance Monitoring
Future Plan
33
SDSS Data Transfer Project
It is a joint program NCHC with the Fermi Laboratories to mirror the SDSS data.
The goal is to speed up the SDSS information sharing for physicists working in R&E institutes in Taiwan.
NCHC computing, storage and networking resources enhance functions in the astronomical research.
NCHC uses TaiWan Advanced Research and Education Network (TWAREN) for the SDSS data transfer.
NCHC’s Operations teams
will ensure the quality
for all efforts.
Computing Center
Network Operation Center
Knowledge Center
Taipei
Tainan
Hsinchu
Taichung
Core node equipment
44
NCHC is Taiwan’s only National Lab Dedicated to High-Performance Computing & Applications Storage, Networking & the Applications Development
NCHC Mission Provide resources and services Do research and development Offer education, training, and outreach
National Center for High-performance Computing
NCHC
High-performance Computers
TANet2/TWARENPC Clusters
Storage/DatabasesApplication SW
Education, Trainingand Outreach
ConsultationTraining Workshops
LecturesExhibits
Industrial, Government, Academic Projects
International CollaborationsConferences
High-performanceComputing & Networking
Research and Development
Resources and Services
55
TaiWan Advanced Research and Education Network
TWAREN TWAREN - Successor of TANet2 TWAREN - One of the Most Advanced Networks/Operations in the World TWAREN Goals
• To provide a network infrastructure for academic and R&E community.
• To stimulate creativity and foster talents TWAREN Architecture
• A hybrid network with 20G POS and DWDM technologies at its core.
• Hierarchical topology: 3 layers (core, GigaPoPs, end nodes)
• Eleven GigaPoPs - each links to the core
node at 20 Gbps and 1 dark fiber.
• Highly scalable and flexible
• Providing multiple services
• International links to the USA
• Integrated NMS Architecture
Taipei
NCU
NDHU
NCTU
NTHU
CCU
NCKU
NSYSU
NCNU
NCHU
SINICANTU
Tainan
Hsinchu
Taichung
66
TWAREN Network topology
Taipei
Hsinchu
Taichung
Tainan
NTU
NSYSUNCKU
CCU
NCNU
NCHU
NTHU
NCTUNCU
SinicaNTU
StarLightStarLight CANARIECANARIE
CANARIECANARIEPacific WavePacific Wave
LALALANLALALAN
MAN LANMAN LAN
3*STM-4+2*STM-1
3*STM-4+3*STM-1 2.5G
2G
1.25G
1.25G
NETHERNETHERLandLand
1.25G
1.8G
2.5G
77
HP OpenView Network Node Manager (NNM) & CiscoWorks2000 for LAN/WAN & CTM
Cisco IP Solution Center
Cisco Secure ACS
HP OpenView Extend Topology & Multicast
NetworkElements
EMS
NMS
SMS
BMS
WAN/LAN
Cisco Info Center(Micromuse)
Remedy Help Desk(Trouble Ticket System)
NOC
IPv6
MPLS
IP TelephonyMulticast
Multimedia
HP OpenView Operation Manager
HP OpenView Performance Insight
&Report Pack for Cisc
o MPLS VPN / IP QoS
/ Cisco Ping / SA/Netflow / IPT / CAR / RMON
& Customize Report
Raw Data
HP OpenViewService Information Portal (SIP)
Apps
Apps
Apps
Service DeskApps
Apps
Apps
Apps
Apps
Apps
CarrierOSS/NMS
AlarmSLA
Reports
TWAREN NMS ArchitectureTWAREN NMS Architecture
88
Sloan Digital Sky Survey (SDSS) Overview
It is an very ambitious astronomical survey project.
The goal is to image one-half of the northern celestial he
misphere, and a smaller portion of the southern sky.
It determines the positions and absolute brightnesses of
more than 100 million celestial objects.
The SDSS Southern Coadd project combines all images
to detect very faint and distant astronomical objects.
Fermi National Accelerator Laboratory (FNAL) uses Grid
3 to carry out a full coadd of all available data.
99
TWAREN Connections to Fermi Lab
Taipei
Hsinchu
Taichung
Tainan
NTU
NSYSUNCKU
CCU
NCNU
NCHU
NTHU
NCTUNCU
SinicaNTU
StarLightStarLight CANARIECANARIE
CANARIECANARIEPacific WavePacific Wave
LALALANLALALAN
MAN LANMAN LAN
3*STM-4+2*STM-1
3*STM-4+3*STM-1 2.5G
2G
1.25G
1.25G
NETHERNETHERLandLand
1.25G
1.8G
2.5G
1010
211.79.59.252
140.110.240.10/24
HC-7609P(NCHC-SW2)
198.49.208.10 131.225.7.156
TWAREN International Optical Network
211.79.63.57/29
211.79.63.58/29
211.79.63.59/29NCHC-SW1FNAL-SW
[SDSS-server][SDSS client]
211.79.59.250[FNAL measurement client for CDF][NCHC measurement server]
ONS in Sartlight
NCHC ONS (HC)
[FNAL measurement server for CDF]
Network Topology
15454CH
15454SF
15600TP1
15454TP2
15600HC
1111
211.79.59.252
140.110.240.10/24
HC-7609P(NCHC-SW2)
198.49.208.10 131.225.7.156
TWAREN International Optical Network
211.79.63.57/29
211.79.63.58/29
211.79.63.59/29NCHC-SW1FNAL-SW
[SDSS-server][SDSS client]
211.79.59.250[FNAL measurement client for CDF][NCHC measurement server]
ONS in Chicago SartlightHC NCHC ONS
[FNAL measurement server for CDF]
Network Connections
1212
Use Cisco 7609 & ONS (15454/15600) for connection
Use CTC, CTM or UCLP for lightpath set-up
Layer 1 international link for Hsin-Chu – Chicago
622 Mbps lightpath (Hsin-Chu – Taipei – S.F. – Chicago)
7 ONS’s included in the lightpath
Rsync: 2MB/s 8MB/s
Data Fragmentation
Policy Route
5.0 TB Storage
Network Set-ups
TWAREN International
NetworkONSONS
Starlight
FNAL
Hsin-chuNCHC
1313
• IPERF.MBPS: Max= 228.78 Mbps
• Reverse IPERF.MBPS: Max= 213.27 Mbps
• Available BW(Mbps): Max= 600.00 Mbps
• RTT: 182 ms
• No. of Hops: 3
Network Performance Monitoring
1414
Network Monitoring Topology at Fermilab
1515
Resources (Computing + Storage+ Network)
Partnership with Universities and Institutes
Production Certificate Authority
Processing Functions
Applications Definition
International Collaborations
Future Plan
Recommended