45
Telecommunications O Network Overview Chad B. Jenkins, P.E. Tl i ti Pi i lE i Telecommunications Principal Engineer

Telecom Network Overview

Embed Size (px)

Citation preview

Page 1: Telecom Network Overview

TelecommunicationsONetwork Overview

Chad B. Jenkins, P.E.T l i ti P i i l E iTelecommunications Principal Engineer

Page 2: Telecom Network Overview

Telecom Network Overview

• Private Transport• Private Transport

• Network Architectureet o c tectu e

• Telemetry Systems

• Voice Systems

• Network Management

2010.03.04 - UTC Region 3 Telecom Network Overview 2

Page 3: Telecom Network Overview

Private Transport

• Core Network

• Backbone Network

• Equipment

Fiber Follies• Fiber Follies

2010.03.04 - UTC Region 3 Telecom Network Overview 3

Page 4: Telecom Network Overview

Core Network

PTA / E t OPP / W t

GNT / BCC

3xDS3

3xDS3

2xEth

14xDS1

GNTBCC

PTA / East OPP / WestOC-3

OC-3

OC

-12

OC

-12DS3-A

DS3-B

DS3-C

BRKM13 M13DSX

ADM DS3-A

DS3-B

DS3-C

VICM13 M13DSX

ADM

OC-12

OC-12

OC-3 OC-3

OC-3 OC-3

OC-3 OC-3

3xDS3

3xDS3

2xEth14xDS1

PTA

2xEth

3xDS3

3xDS3

2xEth OPP

2xEth

OC-3

OC-3

OC

-12

OC

-12

OC-3

OC-3

OC

-12

OC

-12

3x3x 1x

14x

3x3x1xDS3-C

DS3-B

DS3-A

DIXM13 M13DSX

ADM

DS3-C

DS3-B

DS3-A

PAXM13 M13DSX

ADM

xDS3

xDS3

xEth

xDS1

xDS3

xDS3

xEth

HQT

2010.03.04 - UTC Region 3 Telecom Network Overview 4

HQT / PCCPCC

Page 5: Telecom Network Overview

Typical Backbone Repeater

LMRSwitch

SCADASwitch

DIX

DS3-C

DS3-B

DS3-A

MTCDS3-C

DS3-B

DS3-A

PTA

M13 M13DSXADM

BAK

2010.03.04 - UTC Region 3 Telecom Network Overview 5

BAK

Page 6: Telecom Network Overview

Microwave Equipment

Microwave NetworksCM6 : OC 3 3xDS3 1xDS3 8xDS1CM6 : OC-3, 3xDS3, 1xDS3, 8xDS1Space Diversity, Hot Standby

Proxim WirelessL 1 T1Lynx : 1xT1

Exalt CommunicationsEX-2 4i EX-5i : 4xT1 + EthernetEX-2.4i, EX-5i : 4xT1 + Ethernet

RADwin

2010.03.04 - UTC Region 3 Telecom Network Overview 6

Air Mux 400

Page 7: Telecom Network Overview

Multiplex Equipment

Fujitsu SONETFlashwave 4100Eth t OC 12 OC 3 DS3 DS1Ethernet, OC-12, OC-3, DS3, DS1

Adtran M13Adtran M13MX2800 M13 Mux

Adtran Total Access604, 624, 750

RFL Electronics T1IMUX 2000

2010.03.04 - UTC Region 3 Telecom Network Overview 7

IMUX 2000System Protection Functions

Page 8: Telecom Network Overview

ADSS After Dove Shoot

2010.03.04 - UTC Region 3 Telecom Network Overview 8

Page 9: Telecom Network Overview

ADSS Fiber After Crop Duster

2010.03.04 - UTC Region 3 Telecom Network Overview 9

Page 10: Telecom Network Overview

Network Architecture

• Dynamic Routing

• Equipment

• Security

Public Transport• Public Transport

2010.03.04 - UTC Region 3 Telecom Network Overview 10

Page 11: Telecom Network Overview

Network Equipment

RuggedCom Firewall RoutersRX1000 : DS3, DS1, EthernetOSFP Dynamic Routing

RuggedCom IEEE 1613 SwitchesRS1600, RS2100, RS900, RMC40

B&B Electronics SwitchesESDS 100T

2010.03.04 - UTC Region 3 Telecom Network Overview 11

ESDS-100T

Page 12: Telecom Network Overview

Layered Security

SubstationLAN

CoreNetwork

EdgeNetwork

AccesNetwork

UserLAN

Master Remote RelayingN t k

Core

MasterRadio

RemoteRadio

Core

EngineeringWorkstation

OfficeSwitch

NetworkDevices

CoreRing

FirewallRouter

MicrowaveTower

AccessNetworkSwitch

FirewallRouter

Tower

EdgeFirewallRouter

NovaTechOrion LX

EMSFirewallOSI

EMS

RelayingField

2010.03.04 - UTC Region 3 Telecom Network Overview 12

FirewallRouterEMS Switch

Page 13: Telecom Network Overview

Public Transport Security

Satellite

Field Remote VSATiDirect iNFINTI 3000

SDN GlobalAtlanta Hub

PCC VSATiDirect iNFINTI 3000

Field TunnelDCB ET-3300

NetworkSwitch

Field RTU

NetworkSwitch

PCCDCB ET-6620

PCC

PCC CellularBlueTree Modem Alltel

Network

Field Remote CellularBlueTree Modem

Field TunnelDCB ET-3300

NetworkSwitch

Field RTU

2010.03.04 - UTC Region 3 Telecom Network Overview 13

Page 14: Telecom Network Overview

Public Transport Modems

BlueTree / Sixnet Cellular ModemsBlueTree / Sixnet Cellular ModemsBT-6600, BT-4600

Service Provider AlltelService Provider Alltel

iDirect iNFINTI 3000 VSAT Modem256 kbps Up / 1500 kbps DownSDN Global – Atlanta

7 Single Site Remotes3 Master Nodes for Backhaul2 Backup Loops Alternate Routes

2010.03.04 - UTC Region 3 Telecom Network Overview 14

2 Backup Loops – Alternate Routes2 Control Center Masters

Page 15: Telecom Network Overview

DCB Ethernet Tunnels

ET-6620 : Encrypted Ethernet BridgeThroughput > 200 Mbps

ET-3300 : Encrypted Ethernet BridgeThroughput 700 kbpsoug put 00 bps

Secure Local Area Network ExtensionOSPF Dynamic Routing Support

2010.03.04 - UTC Region 3 Telecom Network Overview 15

Page 16: Telecom Network Overview

Telemetry Systems

• Master NodesMaster Nodes

• Telemetry Radios

• Data Concentrators

I t Ti T l t• Inter-Tie Telemetry

• Ethernet Modems

• Proof is in the Pudding

2010.03.04 - UTC Region 3 Telecom Network Overview 16

Page 17: Telecom Network Overview

Telemetry Master Node

2010.03.04 - UTC Region 3 Telecom Network Overview 17

Page 18: Telecom Network Overview

GE MDS Telemetry Radios

MDS 2710 : 3.2 kbps, -108 dBm @ 220 MHzMDS 4710 : 9.6 kbps, -110 dBm @ 450 MHzMDS 9810 : 22 5 kbps 110 dBm @ 915 MHzMDS 9810 : 22.5 kbps, -110 dBm @ 915 MHz

MDS entraNET 900106 kbps, -106 dBM @ 915 MHz

MDS iNET 900 : 256 / 512 kbps, -99 / -92 dBmMDS iNET-II : 512 / 1024 kbps, -97 / -92 dBm

2010.03.04 - UTC Region 3 Telecom Network Overview 18

Page 19: Telecom Network Overview

Adapt4 : Cognitive IP Radio

Adapt4 XG1 @ 220 MHz-103 dBm @ 38 kbps-97 dBm @ 128 kbps97 dBm @ 128 kbps-95 dBm @ 192 kbps

Adapt4 XG2 @ 220 MHz-108 dBm @ 10 kbps-105 dBm @ 20 kbps@ p-101 dBm @ 40 kbps

Cognitive Software Defined RadioASAP : Automatic Spectrum Adaptation Protocol

SRT S R T h l

2010.03.04 - UTC Region 3 Telecom Network Overview 19

SRT : Spectrum Reuse Technology

Page 20: Telecom Network Overview

DNPoIP Data Concentrator

2010.03.04 - UTC Region 3 Telecom Network Overview 20

Page 21: Telecom Network Overview

Legacy RTU Transport

Prot

ocol

Orie

nted

Dat

a

Coni

tel 3

2-Bi

t P

4-

Wire

Aud

io

RS-2

32 B

yte

Or

2010.03.04 - UTC Region 3 Telecom Network Overview 21

Page 22: Telecom Network Overview

Ethernet Modems

Digi PortServer TS 88 RJ-45 RS-232 Serial Port8 RJ 45 RS 232 Serial Port

DCB EtherPath : Single Port Serial ServerDCB EtherBridge : Convert Serial Radio to Ethernet

NovaTech Orion 5R / LX16 DB9/Fiber Serial Ports

2010.03.04 - UTC Region 3 Telecom Network Overview 22

Page 23: Telecom Network Overview

Inter-Tie Telemetry

2010.03.04 - UTC Region 3 Telecom Network Overview 23

Page 24: Telecom Network Overview

Voice Systems

• Private Mobile Radio

• Telephone System

• Voice Recorder

2010.03.04 - UTC Region 3 Telecom Network Overview 24

Page 25: Telecom Network Overview

From Data over IP to VoIP

% SC• 100% IP SCADA Telemetry December 2008– Full Telemetry Support at both PCC and BCC

OSPF D i R ti– OSPF Dynamic Routing

• Voice over IP• Voice over IP– Private Mobile Radio Console System– Internal Phone SystemsInternal Phone Systems– Universal Voice Recorder

2010.03.04 - UTC Region 3 Telecom Network Overview 25

Page 26: Telecom Network Overview

Avtec Console System

PCC-A

PCC B

Repeater A

OutPost

Repeater B

PCC-B

OCCBCC-A

4 WireE&M

4 WireE&M

T

WANBCCPCC

CRC

Metering

BCC-B

Tower

Telecom

Metering

CentralGeneration

Transportation

TransmissionPCC

VP-GateBCC

VP-Gate

2010.03.04 - UTC Region 3 Telecom Network Overview 26

Page 27: Telecom Network Overview

Avtec Scout : PowerSouth Tab

2010.03.04 - UTC Region 3 Telecom Network Overview 27

Page 28: Telecom Network Overview

Avtec Scout : Members Tab

2010.03.04 - UTC Region 3 Telecom Network Overview 28

Page 29: Telecom Network Overview

Avtec Scout : Linc Tab

2010.03.04 - UTC Region 3 Telecom Network Overview 29

Page 30: Telecom Network Overview

Phone System Upgrade

VPI-BCC

VPGate-BCC

VPI-PCC

VPGate-PCCG450-GNT G450-HQT

BCC Phones Phones Phones PhonesPSTNPSTN PCC

GNT HQT LOW MIP

Fiber @ 1G DS3 @ 45M DS3 @ 45M

HQTGNT LOW MIP

PBX-HQT-CMPBX-HQT-CMMPBX-HQT-AES

PBX-GNT-CMPBX-GNT-CMMPBX-GNT-AES

PBX-MIP-CMPBX-MIP-CMMPBX-MIP-AES

PBX-LOW-CMPBX-LOW-CMMPBX-LOW-AES

CM PBX ApplicationCMM Voice MailAES Voice Recording PBX HQT AES

PBX-HQT-SIPPBX-HQT-UTILPBX-HQT-DOM0PBX-HQT-CONS

UPS-HQT-A

VPI-HQT

PBX GNT AESPBX-GNT-SIPPBX-GNT-UTILPBX-GNT-DOM0PBX-GNT-CONS

UPS-GNT-A

VPI-GNT

PBX MIP AESPBX-MIP-SIPPBX-MIP-UTILPBX-MIP-DOM0PBX-MIP-CONS

UPS-MIP-A

PBX LOW AESPBX-LOW-SIPPBX-LOW-UTILPBX-LOW-DOM0PBX-LOW-CONS

UPS-LOW-A

AES Voice RecordingSIP External VoIP TrunksUTIL Utility ServerDOM0 Domain ZeroCONS Console Domain

2010.03.04 - UTC Region 3 Telecom Network Overview 30

UPS-HQT-BUPS-GNT-B

Page 31: Telecom Network Overview

Network Management

S l t NMS• Survalent NMS– Alarm Management

– Performance Monitoring

• Other Monitoring– Kiwi Syslog Server

– PRTG Latency Measurements

• Reporting & Notification

2010.03.04 - UTC Region 3 Telecom Network Overview 31

Page 32: Telecom Network Overview

Survalent NMS

2010.03.04 - UTC Region 3 Telecom Network Overview 32

Page 33: Telecom Network Overview

Alarm Priorities

• Priority 0 – Normal– Green = Good– Also Used for Events

• Swap from Receiver A to B• Swap from Receiver A to B

• Priority 1 – Warning– Blue = Warning

• Pre-Acknowledged Abnormal ConditionExample : Errored Seconds– Example : Errored Seconds

• Priority 2 – Minor– Yellow = Caution

• Requires Manual AcknowledgementE l B k F il d– Example : Backup Failed

• Priority 3 – Major– Orange = Bad

• Requires Manual Acknowledgementff– Example : Traffic Down

• Priority 4 – Critical– Red = OH CRAP!

• Requires Manual Acknowledgement

2010.03.04 - UTC Region 3 Telecom Network Overview 33

– Example : Essential AC Failed

Page 34: Telecom Network Overview

Alarm Menu

2010.03.04 - UTC Region 3 Telecom Network Overview 34

Page 35: Telecom Network Overview

NMS Master Node

2010.03.04 - UTC Region 3 Telecom Network Overview 35

Page 36: Telecom Network Overview

Microwave Networks CM6

2010.03.04 - UTC Region 3 Telecom Network Overview 36

Page 37: Telecom Network Overview

RSL Historical Data

2010.03.04 - UTC Region 3 Telecom Network Overview 37

Page 38: Telecom Network Overview

Exalt Microwave

2010.03.04 - UTC Region 3 Telecom Network Overview 38

Page 39: Telecom Network Overview

Adtran MX2800

2010.03.04 - UTC Region 3 Telecom Network Overview 39

Page 40: Telecom Network Overview

RuggedCom RX1000 Router

2010.03.04 - UTC Region 3 Telecom Network Overview 40

Page 41: Telecom Network Overview

RuggedCom RS1600 Switch

2010.03.04 - UTC Region 3 Telecom Network Overview 41

Page 42: Telecom Network Overview

NMS DNP RTU

2010.03.04 - UTC Region 3 Telecom Network Overview 42

Page 43: Telecom Network Overview

Daily Reports

• Active Alarms• Bandwidth Delta• Blocked Alarms• CPU Utilization• Errored Seconds • FAA Tower Lighting

Detail Exceptions– Detail, Exceptions

• Generator– Fuel Estimate, Run Time

• Loss of Frame• Rebooted in Last 72 Hours

2010.03.04 - UTC Region 3 Telecom Network Overview 43

• Waveguide Pump

Page 44: Telecom Network Overview

Logging & Notification

Power : AC, DC, GeneratorEquipment : Comm, RebootBackup, Failover, Bandwidthp, ,

Security Access

Equipment Alarms

Port StatusPort Status

Comm : RTU, Meter3 Phase : Volts, Watts, pf

2010.03.04 - UTC Region 3 Telecom Network Overview 44

Page 45: Telecom Network Overview

Current Projects

• Core Router Upgrades

• NERC CIP Security

Mi E i i N th T it• Microwave Expansion in Northern Territory

• Phone System Upgrades

• Private Mobile Radio Narrowbanding

Smart Grid Communications• Smart Grid Communications

• Voice Recorder Installation

2010.03.04 - UTC Region 3 Telecom Network Overview 45