Network Upgrade of GALAXY Project - Jivegalaxy).pdf · Network Upgrade of GALAXY Project Kazunori Kumagai and Hisao Uose ... Gifi U. Network Upgrades ... Disadvantages

Network Upgrade of GALAXY Project

Kazunori Kumagai and Hisao UoseService Integration Laboratories

Nippon Telegraph and Telephone CorporationTokyo, Japan

[email protected], [email protected]

May 15, 2003 Hisao Uose, NTT Laboratories

GALAXY: Japanese e-VLBI Research TeamMembers

NTT Laboratories, Communications Research Laboratory (CRL), National Astronomical Observatory of Japan (NAOJ), Institute of Space and Astronautical Science (ISAS), Yamaguchi University and Gifu UniversityCollaboration with Super-SINET (NII) and Internet2®

TargetsR&D of “(Quasi) Real-time VLBI” observation systemScientific observation using the developed system

Network ResourcesDedicated OC-48 (2.4Gb/s) network spanning larger metropolitan Tokyo area connecting radio telescopes and research centers (Both IP and ATM)NTT’s R&D network (GEMnet) providing connectivity to SINET and R&E networks outside Japan through Abilene and AMPATHNew WDM equipment including OXCs are being introducedHigh-quality video conference systemsHigh performance PC arrays and Data storage


Recent DevelopmentSystem Development

Ultra High Speed Real-time System NAOJ, CRL2Gbps ATM data transfer system, 2Gbps sampler, correlator systems

IP system (Real-time and Near-real-time) CRL, NTTPC-VLBI board and multi-stream IP data transfer system

PC-based Software Correlator CRL

ObservationFixed beam survey with 4Gbps system NAOJFirst international e-VLBI observation with MIT Haystack CRLPrecise orbit determination of Nozomi satellite with PC-VLBI system

ISAS, NAOJ, CRL, Yamaguchi U., Gifi U.

Network Upgrades NTTMore IP equipmentConnection to Super-SINETNew DWDM/CWDM connections under constructionInstallation of large volume data storage (1.2TB)Installation of video conference systems (MPEG2 & H.323)


National Astronomical Observatory of Japan (NAOJ)

Kashima Space Research Center (CRL)

KSP Miura Station (CRL)

NTT Musashino R&D Center KSP Tateyama

Station (CRL)

Communications Research Laboratory (CRL)

KSP Koganei Station

KSP Kashima Station

2.4Gb/s ATM Network

GALAXY/KSP Network dedicated for realtimeVLBI (Pase1: 1996~1998)

Usuda Deep Space Center (ISAS)

Nobeyama Radio Observatory (NAOJ)


CRL (Koganei)

CRL (Koganei)

Very High Precision

Clock

RealtimeVLBI(KSP)

SyncUnit

NSU

NSU

NSU

NSU

TimeReceiver

NSU

NSU

NSU

NSU

NSU

SyncUnit

NAO (Mitaka)

NAO (Mitaka)

ISAS (Fuchinobe)

ISAS (Fuchinobe)

HasseiHassei

KashimaKashima

InuishiInuishi

UsudaUsuda

NobeyamaNobeyama

NTT Yokosuka Labs

NTT Yokosuka Labs

: 2.4Gb/s

Total Fiber Length: 3,200km

NTT Musashino Labs

NTT Musashino Labs

ATM-XC

RealtimeVLBI

(VSOP)

Repeaters

Repeaters

Physical Configuration (Phase1: 1996~1998)


Tokyo

KanagawaChiba

Ibaraki

GALAXY/KSP Network: Geographical View

208km

Dedicated NetworkOC-48 (2.4Gb/s)OC-48 x n (with WDM)

NAOJ (Mitaka)

CRL Kashima Research Center

NTT Musashino R&D Center

CRL (Koganei)

ISAS Usuda Deep Space Center

(Nagano)

NAOJ Nobeyama Radio Observatory

(Nagano)


Realtime VLBI over ATMKey Stone Project (1993-2001)

2.488 Gbps STM-16/OC-48 connection to 4 sitesK4 data recorder was transparently replaced by the network

Courtesy of CRL


Real-time VLBI System used in KSP (1996~)

ATM receiver +

VLBI ATM interface

Correlator

Courtesy of CRL


Network Upgrades (or downgrades)Physical Connections

Some long-haul links had to be abolished due to financial reasonsConnected to Super-SINET (2002)

Raw SDH links (2.4Gb/s) and direct IP peering with OC-12We’ve started installing DWDM/CWDM network among NTT R&D centers and NAOJ, CRL

Transport TechnologiesWe are upgrading IP portion of GALXYBut maintain ATM part for flexible use of the bandwidth“Wavelength on demand” coming in the sight

International connectionsGEMnet trans-Pacific link has been upgraded to OC-3 (to Pacific Wave & Abilene) yesterday!!SINET offers us ~300Mb/s for international experimentsNew link from NY to Starlight (OC-12) due this month

Network ApplicationsLarge data storage for PC-VLBI observation dataHigh-quality video conference system


SINET

AbileneBOSSNET+GLOWNET

GigE

GigE

HaystackObservatory

SINET

GALAXY and other Research Networks

東京

NAOJ

CRL Kashima

NTT Musashino

CRL

Usuda Deep Space Center

Nobeyama Radio

Observatory

NTT Yokosuka

NTT Atsugi

NIISINET

GEMnet

To Abilene

GALAXY network

GEMnet

GSI Tsukuba

Yamaguchi U.

Gifu U.


ISAS Usuda 64m

NAOJ Nobeyama 45m CRL Kashima 34m

Former KSP 11m antennas(Koganei, Kashima, Gifu, Chitose)

Antennas Used for our Experiments

• Yamaguchi Univ. 32m donated by KDDI• Tsukuba GSI 32m antenna

Recent additions


GALAXY

4Gbps Real-time Experiment (Dec, 2002)

Corr

4 Gbps

Super

-SIN

ET

• Data processing using two distributed correlators with the total throughput of 4Gbps

2 Gbps

• We plan to add the third antenna to achieve 6Gbps observation this year

Usuda 64m(ISAS)

Tsukuba 32m(Geographical Survey Institute)

NAOJ

CorrOC-48

4 Gbps

2 Gbps2 Gbps

2 Gbps

Courtesy of NAOJ


３７°

赤緯

３６°０ｈ

２４ｈ赤経

３７°

赤緯

３６°０ｈ２４ｈ赤経赤経

Beam Trace of Usuda 64m antenna (0.04 degree)

NRAO Greenbank Survey

Fixed Beam Survey using 4Gbps System

• Use of idle Antenna time in each weekend• 25 weeks of observations will cover the whole region of the figure

Courtesy of NAOJ


０５：１０：２１


IP Technologies for e-VLBIAdvantages

Utilization of “off-the-shelf” equipmentPCs, GbE routers, L2 switches, High-speed I/Os, etc...

Existing resources (R&E networks with vast BW)Sharing resources with other BW eating applications

Improved connectivity with other observation sitesUsing longer baseline becomes easierAvailable antenna selection will be wider

Compatibility to distributed processing schemes and flexible data retrieval / mining schemes

DisadvantagesHard to guarantee quality of serviceComplicated processing (error control, realignment of data packets etc.) necessary

Many challenging issues exist for communications carriers

The rationale for us (at NTT) to continue this projectThe rationale for us (at NTT) to continue this project


IP VLBI data transfer system (NTT)

IP-transmitting PCs

IP-receiving PCs and ID1 serializer

sampler and ID1 parallelizer


Example of Network Configuration

CRL Koganei

GR2000-20

ASX4000

Juniper M20

2.4GWDM

BS450

BS450

POS ATM GbE

CRL Kashima

NII

NAOJ

NTT Musashino R&D Center

ASX4000

Usuda

ASX1200Juniper M20BS450

GbE

GbE

STM-16

STM-16OC-12GR2000-20

ASX4000STM-16

GbE

OC-12

OC-12

BS450 GbE

2.4GWDM

10GWDM

M160STM-16

ATM-SW Router Hub

Galaxy-NW

GEMnet

Usuda LAN

LAN

Kashima LAN

ALMA Japan team

BS450Nobeyama

GbE

GbE

SINET Router

OC-3

Abilene

REP

WDM WDM

OC-12

Cisco GSR

GbE over lambda

OC-12


ATM Switch at NTT Musashino (ASX4000)


MPEG2 Video Conference System (Usuda)


MPEG2 Video Conference System (Musashino)


node

Physical Topology of the STAR (Simple Star)

Logical Topology ofNxN full mesh Interconnection

Other networks

WDM Bridge

l1, l2,..., ln

node

office

NｘN-AWG

A pair of fibres

Network Upgrade: Full-mesh lambda network


Si基板

WDM filter with silica-based PLC technology

Multi-demultiplexingmultiple WDM signals simultaneously

Arrayed Waveguide Grating developed by NTT


8 Lambdas

Optical device (AWG-STAR)

NTT Com

8 Lambdas 8 Lambdas

Network Upgrade with WDM Technologies

NTT Musashino Labs

NAOJ

CRL Koganei

NIINTT Yokosuka Labs

NTT Atsugi Labs

Optical XC

NAOJ Nobeyama CRL Kashima

ISAS Usuda

Optical XC


CWDM Multiplexers


Optical Amplifiers for CWDM signals


Experiment between Kashima and Westford

Mar. 25, 2003 (evlbi4)Westford (Mk5)-Kashima34m(K5), 2 hours, 56MbpsFringes were found on Mar. 27!

Courtesy of CRL


m

NAOJ Base

Remote monitoring of ALMA test instruments with the cooperation of Internet2, AMPATH and REUNA

AbileneNAOJMitakaCampus

Remote Control of ALMA Test Instruments

AMPATH REUNAGEMnet

USTrans Pacific Trans Americas ChileJapan

NAOJ Test Instruments

Musashino R&D Center

U. ChilePartner R&E Networks

San Pedro de Atacama


Future Plan

I’ll try to continue GALAXY project from NTT side byCombining our effort with NTT’s other R&D on broadband communicationsCombining the GALAXY network infrastructure with NTT’s research network (GEMnet)Introducing the latest photonic network technologies to be used under the actual ultra-high-speed applicationsCollaborating with other GALAXY members (CRL, NAOJ, ISAS and universities) and extending the connection to other antennas within JapanCollaborating with e-VLBI community outside JapanCollaborating with R&E networks/institutes including SINET (NII), Abilene (Internet2), Pacific Wave (UW), StarLight, AMPATH (FIU) and REUNA

Thank you very much!

Documents

Network Upgrade of GALAXY Project - Jivegalaxy).pdf · Network Upgrade of GALAXY Project Kazunori Kumagai and Hisao Uose ... Gifi U. Network Upgrades ... Disadvantages