Smart Solutions for Network IP Migration

Smart Solutions

for Smart Networks

Page 1

Network Access

Timing and Synchronization

Test & Measurement

http://www.cxr.com

Smart Solutions for Smart Networks

Mike Ritz [email protected]

+1-408-573-2700

Smart Solutions for Network IP Migration

Agenda: • Architectures and Topologies

• Product life cycle

• Media and Protocol Conversion

• Application Cases

• Conclusion

Smart Solutions

for Smart Networks Page 2

Smart Solutions

for Smart Networks

Introduction

• Do SCADA and Transmission Network evolve at the same rate of change ?

• What benefits from communication technology progress ?

– Performance, added value services, lower cost

• Is there a universal communication technology that fits all the industry requirements ?

• What are the specific requirements in my organization that have impacts on my network design

– Topology and geography, resources, network history

Smart Solutions


Smart Solutions

for Smart Networks

SCADA System Architecture

• A typical SCADA system is made of 3 parts:

– Remote systems or remote sites: generator, substations, RTU, sensors, relays, valves, etc.

– A Master / Control Center or NOC (Network Operation Center)

– A communication / transmission network

Transmission

Network

Remote site

Control Center

Smart Solutions


Smart Solutions

for Smart Networks

Remote Monitoring

• Remote Control and Monitoring

– relay, generators, lights, doors

– sensor, temperature, humidity, voltage, current, pressure, smoke detection, water levels, etc.

– air conditioning, alarms, sirens, doors

Smart Solutions


Smart Solutions

for Smart Networks

Remote Monitoring

• Additional associated operation services

– voice communications

– Network access

– Images and video

• Impacts on

– bandwidth

– service availability

– latency for real time applications

– Quality, packet loss

Smart Solutions


Smart Solutions

for Smart Networks

Network Topologies

• Network requirements

– Bandwidth

– Topology and number of remote sites, geography, distance

– Network ownership : public, private

• Technologies

– T1 / DS3

– SONET

– Ethernet / IP

– MPLS

– Cellular 3G / LTE

– Multi-layer encapsulations: Ethernet over T1, T1 over IP over MPLS, etc.

• Media : copper / fiber / Microwave / cellular

• Anticipate next requirements

Smart Solutions


Smart Solutions

for Smart Networks

Network Topologies

• Private and Public network advantages

– cost of ownership / OPEX, control of operation, availability and performance, security, coverage, etc.

• Can I Speed up existing communication infrastructure?

– A copper pair can deliver tens of Mbps for Ethernet traffic

– Fiber upgrade and CWDM multiplexing

– MW upgrades

SCADA, video, Ethernet, voice

SONET

IP



Smart Solutions


Smart Solutions

for Smart Networks

Life Cycles

• SCADA systems and network technologies : different rate of change

• Network technology evolution since 70’s :

– Multi-drop base band modems, dial-up/LL modems, T1, DS-3, SONET, narrow-band MW, xDSL, Frame Relay, Ethernet / IP, ATM, 2/3G, MPLS, 4G/LTE, MPLS-TP

– 300 bps to +40 Gbps

• SCADA systems : RS-232 and E&M have been used since the 70’s

• Communication conversion equipment delivers a path between SCADA systems and the transmission network

40/100 GE

Throughput

t Modems

FR

SONET

T1

CWDM

RS-232 and E&M still here ! MPLS

Smart Solutions


Smart Solutions

for Smart Networks

Communication Interface Conversion

• RS-232 to DS-0 in a T1 DACS, with option for T1 over IP emulation

– Conversion : over-sampling, V.14, X.50, etc.

• RS-232 to IP conversion

– Best effort, application aware adaptation layer

– Security : authentication, non falsification, encryption

– Packetization latency

Ethernet

IP

TCP - UDP

SSL

Raw-

ip

COM

port

https Telnet Adaptation interface

Authentication &

Encryption

Application Data Data from the serial

interface

Smart Solutions


Smart Solutions

for Smart Networks


• Circuit Emulation Services over packet networks

– SAT over packet : RFC 4553

– CES over packet : RFC 5086

– AAL1 (ATM) over packet : RFC 5087

• Significant overhead on lower rate TDM applications

– Negligible on multiple T1’s, DS3, SONET

TDM frames

CES – SAT – TDMoIP header (4x B)

RTP option (12x B)

UDP (8x B)

IP (20x B)

Ethernet (18x B+)

1x T1 frame : 24x Bytes

Header : up to 62x Bytes

Smart Solutions


Smart Solutions

for Smart Networks


• Circuit Emulation Services over Packet Network

• Adaptive Clock Recovery

– G.823 compliant

– Accuracy : 10-7 to 10-9 according to the oscillator quality.

TDM Network Packet Network

Circuit / connection mode Connected or non-connetced mode

Guaranteed throughput Shared bandwidth

Negligible overhead Large overhead

Negligible network lattency Significant and variable network lattency

Constant bit rate Unpredictable throughput if best effort

Carries synchronization No synchronization, requires Sync-e & PTP

Negligible bit error rate and data loss Packet loss, QOS, congestion

Smart Solutions


Smart Solutions

for Smart Networks


• Circuit Emulation applications

Packet

Network

CES

Over

IP

T1, voice

T1, DS3, SONET

BTS

FXO/FXS

E&M, leased line

RTU

RS-530 / X.21

Pseudo-Wire Domain

CES

Over

IP

Clock Recovery

TDM

Network

Smart Solutions


Smart Solutions

for Smart Networks


• Case for Legacy interfaces : E&M, RS-232

• DS-0 interfaces in T1 multiplexers / channel banks

• Ethernet / IP integrated access devices with embedded Circuit Emulation Services

Packet

Network

E&M

FXS

Eth

SCADA - RTU

T1

RS232

Ethernet

MW

Voice

CES - IAD

Smart Solutions


Smart Solutions

for Smart Networks

Customer Application Case #1

• A Utility network, based on legacy T1 multiplexers over Microwave

– High availability and resiliency : multiple loop design

– Redundant synchronization network

– Add T1’s when need to grow and add new services

– Substation : RS-232, E&M, Ethernet, FXS

T1 MW

Fiber

Smart Solutions


Smart Solutions

for Smart Networks


• A Utility network based on SONET

– High availability and resiliency inherent to SONET and T1

– Scalability : OC-3 / OC-12 / OC-48 / etc.

– High Ethernet bandwidth : Ethernet over SONET

– RTU communication interfaces from

• T1 channel bank

• SONET + T1 DACS combined equipment

SONET

OC-n

RTU

Ethernet

Video

Voice

Eth

FXS

RS-232

E&M



Smart Solutions


Smart Solutions

for Smart Networks


• A Utility telemetry network based on public 3G mobile network

– Requirements : no network access, autonomous operation

– Digital input to metering devices

– RS-232

– Control

• RS-232 over IP

• SMS text messaging

• Dial-up / modems

3G

IP

Dial-up

Remote site

Smart Solutions


Smart Solutions

for Smart Networks


• Modern transportation communication network

– Ethernet optical network

– CES over packet and RS-232 to IP conversion for legacy SCADA

– CES over packet for PBX voice services

– Ethernet / IP services : VLAN & QOS

• Customer requirements : Communications cost savings, Internet access

Public

Network

Ethernet Optical Network

Station

Ethernet

RS-232

E&M

T1

Control

Smart Solutions


Smart Solutions

for Smart Networks

Conclusions

• Remote Monitoring is not yet full IP!

• Overall architecture is made of hybrid technologies, and will be for quite a while

– Significant cost already to build existing infrastructure

– Nobody wants a forklift upgrade!

• Conversion solutions required at the remote sites

• Each application has different constraints for QOS / SLA, resilience and availability, latency, security, cost, scalability

Smart Solutions


Smart Solutions

for Smart Networks

www.cxr.com Smart Solutions for Smart Networks

CARRIER - UTILITIES - DEFENSE TRANSPORT

Thank You !

Any questions ?

[email protected]

Booth # 63

Documents

Smart Solutions for Network IP Migration