2008 One Day Seminar Draft v3

7/25/2019 2008 One Day Seminar Draft v3

1/162

Copyright SEL 2008

Welcome to a SEL Seminar

September 17, 2008

New Delhi, India

Understanding IEC 61850 TechnologyUnderstanding IEC 61850 Technology Principles, Practice, and TrendsPrinciples, Practice, and Trends


2/162

Copyright SEL 2008

TodayTodays Agendas Agenda

1.1. IntroductionsIntroductions

2.2. Overview of Network Protocols and CommunicationOverview of Network Protocols and Communication

3.3. IEC 61850IEC 61850 MultivendorMultivendor InteroperabilityInteroperability

4.4. BreakBreak

5.5. Ethernet Switch Networks and SecurityEthernet Switch Networks and Security

6.6. Lunch BreakLunch Break7.7. Protocols and Services within IEC 61850Protocols and Services within IEC 61850

8.8. Certification and Conformance Testing of IEC 61850Certification and Conformance Testing of IEC 61850

9.9. BreakBreak

10.10. Guide Form SpecificationGuide Form Specification


3/162

Copyright SEL 2008

Tim Tibbals

Senior Product Engineer

19 Years of Experience

Authored Numerous

Technical Papers Member IEC Technical

Committee

Facilitator


4/162

Copyright SEL 2008

How about you?

Background

Experience

Why do you hope to learn?

How familiar are you with IEC 61850?


5/162

Copyright SEL 2008

Network Protocols and

Communications usingIEC 61850


6/162

Copyright SEL 2008

Users Wanted to Replace SCADA

Communications With Networked IEDs Standardized protocol

Self-describing devices

International adoption

Reduction in

obsolescence

Plug-and-play devices

Support for multiplefunctions in one device

Based upon commonlyavailable technology


7/162

Copyright SEL 2008

Object Models

1. Data Classdata unit of measure

2. Functional Constraintshow to

group the data3. Logical Nodesgroups of data

4. Logical Devicesdata storagelocations

5. Physical Address/Device

communicates the data

MMXU1

3

MX

2

V

1

MMXU2

3

MX

2

A

1

5

4

MMXU2$MX$A =


8/162

Copyright SEL 2008

Data Mapping

3 3

4

Logical Device Logical Node

PRO

MET

CON

ANN

LN0, LPHD, PDIS, PTOC,

PIOC, PDIF, PSCH, RDIR,

RPSB, CSWI, XCBR

LN0, LPHD, MMXU, MSQI,

LN0, LPHD, CSWI, GGIO

LN0, LPHD, GGIO

The following table is an example of typicallogical device and logical node organization.


9/162

Copyright SEL 2008

Example of an IEC 61850 Name

Bay12Unit2/MMXU3.PhV.phsA.cVal.mag.f

Part of Name What it Means Example of an Alternative

Logical Device Name Utility chosen name Feeder3

Logical Node Prefix -- not used in this example --

Logical Node Class Metering Measurement Unit PDIS Protection, DistanceLogical Node Instance Feeder number 3 7

Data Name Phase-to-ground voltages PPV Phase-to-phase volts

Data Attribute Name Phase A PhsB Phase B

Data Attribute Name Complex value after

deadbanding

instMag Instantaneous

value

Data Attribute Name Magnitude of complex value vAng angle in degrees

Data Attribute Name Floating point value i integer value

Data Attribute Names defined in a Common Data Class (CDC)


10/162

Copyright SEL 2008

MMS

Manufacturing Messaging Specification

(MMS) provides services for the

application-layer transfer of real-timedata within a substation LAN.

Defines the following:

Standard objects

Standard messaging

Encoding rules


11/162

Copyright SEL 2008

MMS Client Server Applications Unaware

When Transport Layers Restore Lost DataTCP Retransmission and Reassembly


12/162

Copyright SEL 2008

GOOSE

Generic Object Oriented Substation

Event (GOOSE) object within IEC 61850

is for high-speed control messaging.

Transmits Messages Containing:

Status

Controls

Measured values


13/162

Copyright SEL 2008

Custom IEC 61850 Ethertypes Bypass

the Transport Layer Like UDP Non-guaranteed, connectionless delivery

Multicast address ending in all 1s means

broadcast on this network, not routable

Generic Object Oriented Substation Event

(GOOSE), Sampled Values (SV)

Applications using these are responsible formessage loss, duplication, delay, out-of-order

delivery, and loss of connectivity


14/162

Copyright SEL 2008

Like UDP, GOOSE and SV

Ethertypes Do Not Restore Data Each message is complete; no multiple segments

Buffering will take too long

Retransmission out of sequence confuses applications


15/162

Copyright SEL 2008

GOOSE, SV Applications Survive

When Data Are LostNo need to resend because next message already

on its way

To get this behavior, we have no network layer,and therefore no routing

12

3

4

5

Data 1 Data 2 Data 3 Data 4 Data 5Lost data with

Sequence #3

12

4

5

Workstation Server


16/162

Copyright SEL 2008

1. Calculate New Hold Time2. Start Hold Timer

3. Increment Sequence Number

GOOSE Messages are Sent Constantly,

New Publication When Hold TimeExpires

DATASET CHANGE

RETRANSMIT-PENDING

SEND Message

New State:

1. Set Sequence Number = 0

2. Increment State Number3. Reset Hold Timer = Maximum Delay Time

Hold Timer Expired


17/162

Copyright SEL 2008

Dataset Change Due to Analog Value

Changing by More than Deadband(DB)

Value will not be reported until it changes by more thanthe db value

db is a % of the full scale value


18/162

Copyright SEL 2008

Dataset Change Due to Binaries

Changing State


19/162

Copyright SEL 2008

Transition Time Includes Time to

Detect, Transfer, and ProcessChange


20/162

Copyright SEL 2008

Time Between Publications Changes

Publishers calculate and report time to live (ttl) withdataset

Publishers multicast next message after delay = ttl

if there is no dataset change

Subscribers constantly calculate time to wait (ttw),

based on ttl within each message Subscriber considers data stale when time to wait

expires

If dataset change occurs, publisher sends new

message without waiting entire time delay


21/162

Copyright SEL 2008

Time Between Publications Changes

After dataset change, publisher multicasts with ttl = 4ms to increase likelihood that subscribers will hear

Publishers gradually increases ttl until it = Max Time

setting


22/162

Copyright SEL 2008

SCL Files

Substation Configuration Language (SCL) isan XML-based configuration language

that supports the exchange of database

configuration data among differentmanufacturers.


23/162

Copyright SEL 2008

Communications Configuration

Four Different File Types Defined in Part 6

System Specification Description (SSD)

power system functions

Substation Configuration Description (SCD)

complete substation

IED Capability Description (ICD) the data

reported by a type of IED

Configured IED Description (CID) the

configuration of a specific IED


24/162

Copyright SEL 2008

Five Sections Per File Defined in Part 6

Header identifies the configuration file

Substation identifies electrical connectionsand functions

Communications identifies addresses and

subnetworks

IED identifies functions and configuration of

devices

Data Type Templates used to build the other

sections


25/162

Copyright SEL 2008

System Specification Description

The system specification description file (.ssd)describes the single-line diagram and the

substation automation functionality using theassociated logical nodes

Single-line diagram connections

Logical nodes, logical node types

System Specification Tool

SSD

File

Library


26/162

Copyright SEL 2008

SSD: One-Line and Functions

PTOCTCTR

MMXU

XCBR

XSWI

CSWI

CSWI

CILO

YLTC ATCC

PTOCTCTR

MMXU

XCBR

XSWI

CSWI

CSWI

CILO

YLTC ATCC

IHMI ITCI

Bay

=Q1

Bay

=Q2

Station

Computer

NCC

Gateway

PTOCTCTR

MMXU

XCBR

XSWI

CSWI

CSWI

CILO

YLTC ATCC

PTOCTCTR

MMXU

XCBR

XSWI

CSWI

CSWI

CILO

YLTC ATCC

IHMI ITCI

Bay

=Q1

Bay

=Q2

Station

Computer

NCC

Gateway


27/162

Copyright SEL 2008

SCL Substation Section

Concepts of voltage level, bay, power functionality

Associates logical nodes (functions) with:

Electrical connections (required)

IEDs (optional)

Can be used to build a one-line diagram


28/162

Copyright SEL 2008

IED Capability Description

The IED capability description file (.icd) describes the

capabilities and (optionally) the preconfigured data model of

the IED

Logical devices, logical nodes, logical node types

Data sets

Control blocks not populated

Think of it as an IED template

IED Configuration Tool

ICDFile

Library


29/162

Copyright SEL 2008

ICD: Map IEDs to Logical Devices

PTOCTCTR

MMXU

XCBR

XSWI

CSWI

CSWI

CILO

YLTC ATCC

PTOCTCTR

MMXU

XCBR

XSWI

CSWI

CSWI

CILO

YLTC ATCC

IHMIStationComputer

NCCGateway

ControllerController

Protection Protection

Tap changer Controller Tap ch . Contr.

Switch IED

Breaker IED

MU

Transformer IED

Switch Switch

Switch Switch

Switch

IHMI

Bay Bay

PTOCTCTR

MMXU

XCBR

XSWI

CSWI

CSWI

CILO

YLTC ATCC

PTOCTCTR

MMXU

XCBR

XSWI

CSWI

CSWI

CILO

YLTC ATCC

IHMIIHMIStationComputer

NCCGateway

ControllerController

Protection Protection

Tap changer Controller Tap ch . Contr.

Switch IED

Breaker IED

MU

Transformer IED

Switch Switch

Switch Switch

Switch

IHMIIHMI

Bay Bay


30/162

Copyright SEL 2008

SCL IED and Data Type Sections

Defines the object model of each device

Correspondence between devices and access points

Shows structure of server, logical devices, logical

nodes, data objects, data attributes, and data types

Same information as available from self-description


31/162

Copyright SEL 2008

ICDFile

ICDFile

ICDFile

System Configuration Description

The substation configuration description file (.scd) describes thecomplete substation configuration

Single-line diagram

Communication network

IED configurations

Binding information

ICDFile

SCDFile

System Configuration Tool

SSDFile


32/162

Copyright SEL 2008

SCD: Add the Communications

Controller

PTOC

Protection 1

MMXU

CSWI

CSWI

CILO

ATCC

PTOC

Protection 2

Switch

Switch

Switch

Bay

Process level

bus segments

Station level

and interbay

Bus, e.g. ring

XCBR

XSWI

YLTC

Switch IED

Breaker IED

MU

Transformer IED

TCTR

TvTR

TCTR

TVTR

XCBR

Controller

PTOC

Protection 1

MMXU

CSWI

CSWI

CILO

ATCC

MMXU

CSWI

CSWI

CILO

ATCC

PTOC

Protection 2

Switch

Switch

Switch

Bay

Process level

bus segments

Station level

and interbay

Bus, e.g., ring

XCBR

XSWI

YLTC

Switch IED

Breaker IED

MU

Transformer IED

TCTR

TvTR

TCTR

TVTR

XCBR


33/162

Copyright SEL 2008

SCL Communications Section

Concepts of subnetwork, and access point

Identifies communications addresses of IEDs

Can be used for network management


34/162

Copyright SEL 2008

Configured IED Description

The configured IED description file (.cid) describes an instantiated

IED with all configuration parameters relevant for that IED

Created by the IED configuration tool from the .scd file

Includes the device-specific configuration data IED configuration via loading .cid file is recommended best

practice

As an alternate solution, a vendor-specific file may be used

CIDFile

IED Configuration Tool

SCDFile


35/162

Copyright SEL 2008

SCL Extensions Provide Built-in

Escape Clause Allow configuration of data types not part of IEC 61850

Example

IED SELOGIC is used to make specific information

Could extend SCL to define results and status

SCL allows three types of extensions

Extensions to the existing language

Private extensions with in-line data

Private extensions with off-line data


36/162

Copyright SEL 2008

Questions


37/162

Copyright SEL 2008

Multivendor

Interoperability


38/162

Copyright SEL 2008

InteroperabilityDemonstration

Included allvendors

Displayed

GOOSE traffic

graphically


39/162

Copyright SEL 2008

Support 8 Unique GOOSE Publications and 16Subscriptions 24 for Complex Interlocking

Cigre Multi-vendor Demonstration of 12 IEDs

SEL-451-4

Sisco softwareIED on PC

GE D60Siemens6MD669

Areva

P444

Siemens7SA525

SiemensBC1703

GEF650

Toshiba

GRZ100

ZIV

IRV-A

Team

Arteche

SEL-421

CFECFE L V tL V t


40/162

Copyright SEL 2008

This is, without any doubt, a great

advancement for the integration of control

and protection systems, and for integration

of the IEC 61850 International standard.

David Lancha, Project Manager, IBERINCO

CFECFEs La Ventas La Venta

WindfarmWindfarmWorlds First Multisupplier

IEC 61850 System


41/162

Copyright SEL 2008

SEL-451-4

SEL-451 SEL-451

SEL-387E

SEL-451

SEL-311L

SEL-421

SEL-487B

SEL-3332

230KV LineLVD93100

230KVAutotransformer

LVD92010

230KV TieLVD97010

230KV BusDiff

LVDDB9

RedundantHMI

RedundantSCADA

Gateway

GE F650 BC

Siemens 7SJ62

GE F60

Siemens 7SJ61

ZIV BC

GE T60

GE F35 GE L90

ZIV HMI

ZIV HMI

ZIV CPT

Each Bay Has Unique Bay Control IED


42/162

Copyright SEL 2008

System Architecture

Router+ Firewall

Remote HMI

RuggedCom

Fiber-OpticRing

DNP

Conitel

SW-4

SW-5

SW-3

SW-1

SW-2

GE F650 BC

SEL-451 50BF, 25, 27

SEL-387E

GE T60 87T

GE F60 50, 51HS

GE F35 50, 51TZ

Siemens 7SJ62 50, 51LS

Siemens 7SJ61 50, 51N

SEL-451-4 BC

SEL-451 50BF, 25, 27

ZIV 6MCV BC

SEL-421 21, 67

SEL-279H 79

SEL-451 50BF, 25, 27

GE L90 87L

SEL-311L

SEL-487B 87BGPS

ZIV CPT ZIV HMI ZIV HMI

SEL-3332

SCADA Gateway

GOOSE Retrip Operation 12 5ms


43/162

Copyright SEL 2008

GOOSE Retrip Operation 12.5msFaster Than Parallel Hardwire

GOOSE Breaker 21 TRIP A

Wired Contact Breaker 21 TRIP A

12.5 ms DifferenceBetween Inputs


44/162

Copyright SEL 2008

KONYA Industrial ParkChooses SEL and IEC 61850

500 large to mid-size electricity-dependenttenants: plastics, machinery, pharmaceuticals

Park management responsible for infrastructure:

electricity, gas, water, traffic, security

One 100 MW transformer and three 33 kV

tie lines from National Grid

65 MW maximum demand increasing by 15%

every year


45/162

Copyright SEL 2008

SEL-2407GPS-

ReceiverClock

Front-End 1SubstationComputing

Station 1

Front-End 2SubstationComputing

Station 2 Station3

Station4

Station5

Station 6 Station 7 Station 8

3 Tie Lines (6Future)

6 x SEL-311L

Server

1

Operator

Station 1

42-Inch LCDMonitors

SEL-3401GPS-Clock

54 SEL-751A Relays and 38 SEL-311L Relays

Server 2Operator

Station 2

Switch

8 Switching Stations, 99 Feeders

Switch

Printers


46/162

Copyright SEL 2008

Control Center

Manages 165DistributionSubstations

24 km redundant f iber-optic

ring Future distribution

automation via SEL-751A

Legened

MM1


47/162

Copyright SEL 2008

Indoor type fiber opticalCablePatchcord, singlemode, SC-SC, dublex

Fiber Optical TerminationBox

External type fiber opticalcableMetalic armoured,singlemode,24 coresControl and ProtectionHardwiring signals

Indoor type twisted pairpatchcord ethernet cableCAT5e

IEC61850 - TCP/IP 10/100Mbit/sec.

IEC61850 - IndustrialEthernetswitch

SEL-311LLine differential

andDirectional Overcurrent

Relay

SEL-751AOvercurrent

andEarth fault

relays

x4 pcs. x5 pcs.

Fiber optical Patch Panel48-72 connectors

3 Phase Currents3 Phase VoltagesDisc./Breaker Position

signalOpen and Close CommandsOther Feeder Alarms andsignals

MM1

3 Phase Currents3 Phase VoltagesDisc./Breaker Position

signalOpen and Close CommandsOther Feeder Alarms andsignals

G S f


48/162

Copyright SEL 2008

GEESE Migrate to Africa

SEL Deploying IEC 61850 MMS and GOOSE

City Power Pennyville 19 bays , 2 bus

sections, 3 transformers

City Power Khanyisa similar to above with

36 bays

City of Cape Town 2 complete substations

Nelson Mandela Bay Municipality

Three new substations in 2008 Each based on IEC 61850, each awarded to

Cit P J h b


49/162

Copyright SEL 2008

City Power Johannesburg

Harley Street Substation

Di t ib ti S it h A li ti


50/162

Copyright SEL 2008

Distribution Switch Application

I/O flexibility meets each installation

Master / remote configuration allows integration withexisting SCADA master

RTU R l t N t k C ld Al


51/162

Copyright SEL 2008

RTU Replacement Network Could Also

Connect I/O of Relays and MetersExample system database

32 AC analog inputs

2 DC analog inputs

24 digital inputs 16 digital outputs

192.168.0.15 192.168.0.25 192.168.0.30

192.168.0.20

SCADAMaster

DNP3 Serial

EthernetSwitch

GOOSE Messages

PAC_MASTER

PAC_Slave_A PAC_Slave_B PAC_Slave_C

D t Fl A t th S


52/162

Copyright SEL 2008

Data Flow Acts the Same as

Distributed RTU I/O Panels, and ItPerforms BetterDNP3 Master

Field Inputs

PAC_MASTER01

PAC_2411C01

PAC_2411B01

PAC_2411A01

D t Fl A t th S


53/162

Copyright SEL 2008



Field Inputs

GOOSE Inputs

PAC_MASTER01

PAC_2411C01

PAC_2411B01

PAC_2411A01

D t Fl A t th S


54/162

Copyright SEL 2008



Field Inputs

GOOSE Inputs

DNP3 Response

PAC_MASTER01

PAC_2411C01

PAC_2411B01

PAC_2411A01

D t Fl A t th S


55/162

Copyright SEL 2008



Field Inputs

GOOSE Inputs

DNP3 Response

DNP3 Command

PAC_MASTER01

PAC_2411C01

PAC_2411B01

PAC_2411A01

D t Fl A t th S


56/162

Copyright SEL 2008



Field Inputs

GOOSE Inputs

DNP3 Response

DNP3 Command

GOOSE Outputs

PAC_MASTER01

PAC_2411C01

PAC_2411B01

PAC_2411A01

D t Fl A t th S


57/162

Copyright SEL 2008



Field Inputs

GOOSE Inputs

DNP3 Response

DNP3 Command

Contact Output

GOOSE Outputs

PAC_MASTER01

PAC_2411C01

PAC_2411B01

PAC_2411A01


58/162

Copyright SEL 2008

Questions


59/162

Copyright SEL 2008

Ethernet Switch Networks

and Security

Concept of Separate Station LAN


60/162

Copyright SEL 2008

Concept of Separate Station LAN

(SCADA, P to P) and Process Bus (ITs)

IEC 62351 Security Standards


61/162

Copyright SEL 2008

IEC 62351 Security Standards

IEC 62351-1 Introduction

IEC 62351-2 Glossary

IEC 62351-3 TCP Profiles

IEC 62351-4 MMS Profiles

IEC 62351-5 60870-5 and derivatives

IEC 62351-6 IEC 61850 peer-to-peer

IEC 62351-7 Objects for Net Mgmt

TASE.2 / ICCP

IEC 101/102/103

IEC 61850

IEC 60870-5-104

DNP3

Redundancy: Ethernet Network


62/162

Copyright SEL 2008

Redundancy: Ethernet Network

Ethernet redundancy is accomplished via

various switching mechanisms in

combination with physical connections

Spanning Tree Algorithm (STA) decides

which switch is highest in hierarchy

(Root), routing tables that map to each

address

Redundant Path Created When STA


63/162

Copyright SEL 2008

Redundant Path Created When STA

Alerts Switches of Topology Change

STA determines which of three states each

switch port is in discarding tables, learningtables, or forwarding traffic

Managed switches discard and rebuild tableswhen they learn of topology change

Failed switch

Failed connection to IED

Failed connection within IED

Network Hardware Requirements


64/162

Copyright SEL 2008

IEEE 802.3x Full Duplex Operation Allows for no col lisions and no CSMA/CD!

IEEE 802.1p Priority Queuing Allows for high-priority tagging of real-time controltraffic!

IEEE 802.1Q VLAN (Virtual LANs) Allows for the segregation of real-time control

devices! IEEE 802.1w RSTP (Rapid Spanning Tree)

Allows for the creation of fault tolerant ringarchitectures!

Network Hardware RequirementsCritical Features for Real-Time Control

Dual Home Run Protection LAN


65/162

Copyright SEL 2008

Dual Home Run Protection LAN

Substation Network Future


66/162

Copyright SEL 2008

Substation Network Future

IED, Merging Units

With IEEE 1588

Switchyard

Protection

i1 i2-

To Sub X

SCADA, HMI

Fault Recorder

Substation Y

ix iy-

52

Process Bus100FX

Station Bus1000LX

Surveillance

A

B

C

i1 i2

HMIInformation Processor

Choose Switches Suitable for


67/162

Copyright SEL 2008

Choose Switches Suitable for

Substation Environment

Typical EMI & Environmental Phenomena

Electric and magnetic fields, electrostatic discharge

Conducted high-frequency electrical transients

High-energy power surges, ground potential rise during faults

Uncontrolled temperature & humidity, seismic / vibration

Dust, metallic particles, condensation, solar radiation

Networking

equipment must beas robust as IED

The Managed Switch


68/162

Copyright SEL 2008

The Managed Switch

Same as unmanaged, but add:

User interface via RS232, Telnet, SNMP, HTTP

Status, statistics, and troubleshooting facilities

Rapid Spanning Tree (IEEE 802.1w) for fault

tolerant loop architectures VLANs (802.1Q)

Quality of Service-QOS (802.1p)

And more truly an IED!

Rapid Spanning Tree (802 1W)


69/162

Copyright SEL 2008

Rapid Spanning Tree (802.1W)

RSTP is a switch protocol used to exchange state

information

Determines least-cost tree that ensures all switcheshave appropriate paths

Required to prevent broadcast storms

Very fast failover times under 50 ms

Link recovery times up to 2 seconds*

Ring size limited to 20 switches*

Available only on managed switches

* RuggedComs eRSTP improves on figures (50 ms & 80 ring)

N+1 Redundancy via RSTP


70/162

Copyright SEL 2008

N+1 Redundancy via RSTP

B

A

C

RSTPautomatically

determines thatlink B-C should be

a backup notraffic flows

52 A

B

C

ProtectionX

100FX

D

ProtectionY

RSTP After Failure


71/162

Copyright SEL 2008

RSTP After Failure

B

A

C

52 A

B

C

ProtectionX

D

ProtectionY

RSTP quickly

restores linkB-C to repairconnectivity

Any link,switch, or IED

can fail yeteither X or Yprotection isalways online

RSTP + Dual Home Run IED


72/162

Copyright SEL 2008

RSTP + Dual Home Run IED

B

A

C

52

IED

D Any link orswitch can

fail, yet

protection isalways online

100FX

Dual homing canbe done at MAC

or IP layer

A

B

C

VLAN (802 1Q)


73/162

Copyright SEL 2008

VLAN (802.1Q)

Virtual LAN: an independent Ethernet networkthat shares cabling infrastructure with othernetworks

Allows multiple devices at different physicallocations to act as if on an independent LAN

Each VLAN has a separate broadcast domain

IEEE 802.1Q standard defines tagged frame

format, allowing multiple VLANs to be carriedon a trunk

Bridging traffic between VLANs requires arouter

Ethernet Network Performance


74/162

Copyright SEL 2008


Segregation

Coexisting VLAN Example


75/162

Copyright SEL 2008

Coexisting VLAN Example

VLAN: Tagged vs Untagged


76/162

Copyright SEL 2008

VLAN: Tagged vs. Untagged

Untagged frames are standard 802.1d frames

Most end devices send/receive untagged traffic on edge port

Tagged frames contain 802.1P/Q extension Tagged traffic is typically only found on trunk ports; notable

exception is GOOSE

Standard

FrameDest. Src. Length / Type Data

6 bytes 6 bytes 2 bytes Variable

Dest. Src. Length / Type Data

6 bytes 6 bytes 2 bytes Variable

TPID TCI

Priority CFI VID

2 bytes

3 bits 1 bit 12 bits

2 bytes

Tagged

Frame

VLANs: Why Bother?


77/162

Copyright SEL 2008

VLANs: Why Bother?

A lot of broadcast traffic wastes bandwidth

VLANs reduce this traffic because it only goes where needed

Isolate IEDs with critical real-time traffic

Such devices will not incur processing overhead for unneeded

traffic

Isolate devices with excessive traffic output

Video surveillance equipment will generate prodigious

amounts of traffic VLANs keep it separated

Security

VLANs restrict traffic to required stations cannot sniff



78/162

Copyright SEL 2008


Priority

IEEE 802 1p Prioritization


79/162

Copyright SEL 2008

IEEE 802.1p Prioritization

Class of Service (CoS)

Multiple egress traffic

queues; higher-priority trafficsent first

Reduces jitter and latency

for time-sensitive traffic (likevoice / GOOSE)

Managed switches classify

and tag incoming untagged

traffic based on port number,

address, or DiffServ

1

2

2

2

1

2

2 1 1MES

Switches Add Latency


80/162

Copyright SEL 2008

Switches Add Latency

Latency is the time it takes a frame to get fromsource to destination

Store and forward introduces a minimumlatency of one frame time per switch hop

Frame latency ranges from 5 to 120 s perswitch at 100 Mbps proportional to frame size

Switch also introduces a processing latency on

the order of 5 s

QoS pushes important traffic to front of queue

to reduce latency

Calculation of Latency


81/162

Copyright SEL 2008

Calculation of Latency

Where:

LXY is the latency between any two devices for frame F

N is the maximum number of switches between X and Y

tF is the time it takes to transmit the frame F

tmaxF is the time it takes to transmit a 1500 byte frame

R is the percentage loading on the network (set to 100% for absolute worst

case)

S is the latency of the switch electronics (~5 s)

Equation assumes frame F has the highest priority in the network and such frames are

not simultaneous

LXY = N * tF + N* tmaxF* R + N*s

Latency Example


82/162

Copyright SEL 2008

Latency Example

10 switches between X & Y. 100Mbps network. Network loaded to50%. GOOSE frame of 64 bytes

tF = 64*8*1.25 / 100e6 = 6.4

s (1.25 is for 4B/5B encoding)

tmaxF = 1500*8*1.25/100e6 = 150 s

LXY = 10*6.4 + 10*150*0.5 + 20*5= 864 s

Max LXY = 1614 s

Gigabit Ethernet would reduce latency by factor of 10.

Ethernet Network Security


83/162

Copyright SEL 2008

Ethernet Network Security

Switches provide four main security features for

the network:

1. Management security: ability to monitor orconfigure the switches (SSL, SSH)

2. VLANs: ability to segregate traffic3. Port security: ability to deny access to the

network (802.1x)

4. Rate limiting: ability to limit ingress/egress

traffic

The Basic Real-Time Recipe


84/162

Copyright SEL 2008

The Basic Real Time Recipe

1. Install only devices that meet IEC 61850-3 and

IEEE 1613 environmental standards

2. Use fiber optics for long runs

3. Install fully managed Ethernet switches

supporting VLANs, CoS, RSTP, for networkcore

4. Consider unmanaged switches local to IED

The Basic Real-Time Recipe


85/162

Copyright SEL 2008

The Basic Real Time Recipe

5. Ensure N+1 redundancy via RSTP

6. Deploy 802.1P advantaged protocols like

61850 GSSE/GOOSE

7. Restrict, manage, monitor high-priority network

traffic

8. Calculate worst and typical case latency

introduced by store and forward switches;expect the worst


86/162

Copyright SEL 2008

Questions


87/162

Copyright SEL 2008

Protocols and ServicesWithin IEC 61850 to Perform

Substation Automation

Recall That IEC 61850 Focuses Only


88/162

Copyright SEL 2008

y

on Substation Automation IEC 61850 designed for substation automation

systems (SAS)

IEC 61850 not designed for between

substations, for between substations andcontrol centers, or for distribution automation

New work items for between substations andfor between substation and control center

Local and System Automation,


89/162

Copyright SEL 2008

y ,

Protection Are Out of ScopeConfigured intraditional ways

with existingtools

Inputs and

outputs to logicand protectionnow alsomapped to

IEC 61850

Self-Description Services Are a


90/162

Copyright SEL 2008

p

Series of Queries Each query is progressively more detailed

Based on MMS capabilities

Services defined:

GetLogicalDeviceDirectory

GetLogicalNodeDirectory

GetDataSetDirectory GetDataDirectory

GetDataDefinition

Logical DeviceLogical Device

Logical Node

DataDataData

Logical NodeDataDataData

Data SetData Set

Data SetData Set

Data SetData SetLogical NodeDataData

Logical NodeData

Data

Example of Browser View of Data


91/162

Copyright SEL 2008

p

Objects Revealed in Self DescriptionLOGICAL-NODE (BRICK)

FUNCTIONAL-CONSTRAINT (FC)

ATTRIBUTE (Data)

ATTRIBUTE

MMS-DATA

Polling of IED Data


92/162

Copyright SEL 2008

gTwo-Party Ad-Hoc Client Server

Association

SERVER

Client Client Client

From IEC61850-7-2

Polling for Data on Demand


93/162

Copyright SEL 2008

g

Data, Quality,Etc.

Data Objects

Ad Hoc Response

Filter&

Format

On Demand

Reaction

Get, Set Req

Get, Set Res

Parameters

Reporting of IED Data


94/162

Copyright SEL 2008

p gTwo-Party Configured Client Server

Association

Spontaneously reports members of data sets

Triggered by:

Data changes

Quality changes

Periodic integrity report

Select triggers ahead of time

Multiple clients, multiple data sets

Buffered and unbuffered modes

IED Data Sets


95/162

Copyright SEL 2008

Unbuffered Reporting Model


96/162

Copyright SEL 2008

p g

Data, Quality,Change Events

Data Objectsin Data SetFormatted

Reports

Filter&

Format

Report

Control

Get, Set Req

Get, Set Res

Parameters

Buffered Reporting Model


97/162

Copyright SEL 2008

Buffer

Data, Quality,

Change Events

Data Objectsin Data Set

FormattedReports

Report Control

Get, Set Req

Get, Set Res

Parameters

Filter

&

Format

Comparison of Polling and Reporting


98/162

Copyright SEL 2008

p g p g

MethodsRetrieval

Method

Time-critical

Information

Exchange

Can Lose

Changes

(of

Sequence)

Multiple

Clients to

Receive

Information

Last

Change

of Data

Storedby

Typical

Client

(Not

Restricted)

Polling for

Values on

Demand

NO YES YES - Browser

Unbuffered

ReportingYES YES YES* -

Real-time

GUI

BufferedReporting

YES NO YES* Server

Data

ConcentratorSOE, SER

Gateway

* With multiple instances of control blocks, one per client

Commanded and Automatic Control


99/162

Copyright SEL 2008

Services available for controlling objects:

Select (Sel) and SelectWithValue (SelVal)

Cancel

Operate (Oper) and TimeActivatedOperate

(TimOper)

Command Termination

Interaction Between General Control


100/162

Copyright SEL 2008

Model and Real Device

From IEC61850-7-2

Direct and Select Before Operate


101/162

Copyright SEL 2008

(SBO) Applies to common object classes:

Controllable single and double points Binary and analog controlled step position

Analog set point

Immediate and time activated

Two levels of security

Normal

Enhanced

Direct Control Normal Security


102/162

Copyright SEL 2008

Oper_req

Oper_res

Client Server

Action performed

SBO Control Normal Security


103/162

Copyright SEL 2008

Oper_req

Oper_res

Client Server

Action initiated

Sel_req

Sel_resPoint selected

SBO Control Enhanced Security


104/162

Copyright SEL 2008

Oper_req

Oper_res

Client Server

Action initiated

Sel_req

Sel_res Point selected

CmdTerm_resAction completed

High-Speed Peer-to-Peer Services


105/162

Copyright SEL 2008

IEC 61850-7-2 also defines:

Generic Object-Oriented Substation Event

(GOOSE)

Generic Substation Status Event (GSSE)

Sampled Measured Values

High-speed, connectionless services

Spontaneous reporting of data

Operate directly over Ethernet

GOOSE Service Models


106/162

Copyright SEL 2008

Generic Object-Oriented Substation

Event (GOOSE)

Fast and reliable distribution of data

Send to multiple subscribed peers

Data set interrogation services

Generic Substation State Event (GSSE)

Sends fixed set of status outputs

Also fast, reliable and multicast

IEC 61850 Peer-to-Peer Functions as


107/162

Copyright SEL 2008

Publish/Subscribe One direction only

Multi-cast, as opposed to broadcast

Filtering done in hardware

Subscriber only listens to whats needed

Very high speed

No positive acknowledgement of receipt

No channel performance statistics

GOOSE Services Model


108/162

Copyright SEL 2008

Data, Quality,Change Events


Fast Multicast Reports

Format

GOOSE

Control

Get, Set Req

Get, Set Res

Parameters

GOOSE Services Model


109/162

Copyright SEL 2008

Data, Quality,& Freeze

Change Events


Fast Multicast Reports

Format

GOOSE

Control

Get, Set Req

Get, Set Res

Parameters

GOOSE/GSSE Is Reliable Multicast


110/162

Copyright SEL 2008

DATASET CHANGE

RETRANSMIT-

PENDING

SEND Message

New State: 1. Sequence Number = 02. State Number Increments3. Reset HoldTimer

HoldTime expired1. Hold Time PresetCalculated2. Start Hold Timer3. Sequence Number

Incremented

Nonconventional Instrumentf f


111/162

Copyright SEL 2008

Transformer Interfaces

IEC 61850 9-1 (already obsolete) and 9-2

document sampled values

Likely require separate LAN due to high

bandwidth requirements

Estimates indicate it will require Gigabit

Ethernet for large-scale deployment

Sampled Values on the LAN


112/162

Copyright SEL 2008

Takes decentralization

one step further

Separates sampling

physically from

Measurement

Metering

Calculation

Sampled Values on the LAN


113/162

Copyright SEL 2008

More flexibility in

measurement

Any device may

measure any circuit

Smart CTs and PTs

No measurements yet

of communications

performance

Sampled Values Model


114/162

Copyright SEL 2008

SynchronousSampling

Data Objectsin Data SetPeriodic Reports

Format

SVControl

Get, Set Req

Get, Set Res

Parameters

Using Merging Unit forS l d V l


115/162

Copyright SEL 2008

Sampled Values

Combined Relay, Breaker Control,M i U it Si il t E i ti M th d


116/162

Copyright SEL 2008

Merging Unit Similar to Existing Method

Combined Relay, Breaker Control,M i U it Di t ib t d P t ti


117/162

Copyright SEL 2008

Merging Unit, Distributed Protection

Performance Classes


118/162

Copyright SEL 2008

P1, P2, P3M1, M2, M3

Performance Classes


119/162

Copyright SEL 2008

IEC 61850-10 Conformance testing does not testperformance or accuracy

Configuration Revision Management O t f S


120/162

Copyright SEL 2008

Out of Scope

SEL enables management of hardware, firmware, software,

and settings configuration information on LAN

Engineering Access Out of Scope


121/162

Copyright SEL 2008

SEL adds this to

IEC 61850 LAN via

Telnet, FTP,Tunneled Serial

Engineering Access Out of Scope ButFile Transfer Services Are Defined


122/162

Copyright SEL 2008

File Transfer Services Are Defined

IEC 61850 defines a mms file transfer service

Supports only file name, size, and timestamp

Does not standardize file use, content, orformat

This service causes confusion

Without standardization, vendors cannot possiblydo things similarly and interoperable

Forces private development

Observers see file transfer mentioned as a serviceand expect that its use is standardized andinteroperable

Possible Future Uses: Oscillography,Configuration Firmware Private


123/162

Copyright SEL 2008

Configuration, Firmware, Private

DeleteFile

GetFile

Responses

File System

SetFile

FileDirectory

File Name

File Size Timestamp

File namesmay be

structured

Communications Diagnostics Out ofScope Enabled on LAN by SEL


124/162

Copyright SEL 2008

Scope, Enabled on LAN by SEL

Multicast Non-Connection OrientedMessages Cant Perform Active Diagnostics


125/162

Copyright SEL 2008

Messages Can t Perform Active Diagnostics

Multicast to unknown receivers; no return

Receiver determines if message is late, lost

Not possible to know necessary message was

not sent (no trigger due to change) GOOSE passive information

Time to live age when message turns stale Sequence incremented each time message is

sent each message has unique sequence until

reset

GOOSE Supports Present Status andError Codes Not Statistics Calculation


126/162

Copyright SEL 2008

Error Codes, Not Statistics Calculation

Description of GOOSE Multicast


127/162

Copyright SEL 2008

Parameters in Diagnostic

Description of GOOSE StatusInformation in Diagnostic


128/162

Copyright SEL 2008

Information in Diagnostic

Description of GOOSE Error CodeInformation in Diagnostic


129/162

Copyright SEL 2008

Information in Diagnostic

Local and Wide Area Synchrophasors Out of Scope


130/162

Copyright SEL 2008

Out of Scope

Possible Future GOOSE or 9-2 Extension

SEL adds this to

IEC 61850 LAN via

Telnet, tunneled

serial, IEEE

C37.118

Verify CT wiring,

phase rotation,

settings


131/162

Copyright SEL 2008

Questions


132/162

Copyright SEL 2008

Certification andConformance Testing of

IEC 61850 Systems

IEC 61850 Vision of CommonCommunications


133/162

Copyright SEL 2008

Communications

IEC 61850 is massive over 1700 pages!

Evolving and growing created by human

process

It is a published standard this does notmean that it is clear or correct in every detail

Certification Will Help OvercomeComplexity to Reach Interoperability


134/162

Copyright SEL 2008

Complexity to Reach Interoperability

Increase likelihood that products from

different vendors will communicate andmeet our application needs

Model of an excellent process DNP3Users Group management of

DNP3 communications standard Resolution of interoperability issues

Conformance testing program

Industry Experts ManagingFuture of IEC 61850


135/162

Copyright SEL 2008

Future of IEC 61850

UCA International Users Group (UCAIUG) is

responsible for administering conformance

Design of conformance tests; accreditation of test laboratories

Responsible to document solutions to problems that emerge;

update and maintain test processes

IEC Technical Committee (TC) 57 Working Group (WG)

10 defines corrective action to solve problems that

emerge Network of industry and apparatus experts

Technical issues (TISSUES) process

Group of Experts (GoE) Created byOverlap of UCAIUG and WG10


136/162

Copyright SEL 2008

Overlap of UCAIUG and WG10

UCAIUG

Technical

Committee

Group of

ExpertsIEC TC57

WG10

Each part of the standard

has a responsible GoEmember identified

IEC 61850 Success Depends on CommonImplementation and Behavior


137/162

Copyright SEL 2008

p e e a o a d e a o

All vendors strive to conform to standard, do

development correct first time

Standard is large, comprehensive, and evolving

Some parts still ambiguous and vague Does not cover every contingency

Improving as we learn of deficiencies

Vendors, Test Labs, Users TogetherImprove Conformance Testing


138/162

Copyright SEL 2008

Improve Conformance Testing

Projects

IEC TC57

WorkingGroups

Test Cases

Tested

Products

Test

Systems

Products

Standards

Successful

Systems

Test

Laboratories

Product

Development

Test System

Development

Standards Committees

Vendors

Test LabsUsers

Implementation and Behavior of OneDevice Is Verified


139/162

Copyright SEL 2008

Device Is Verified

Equipment Simulator

AnalyzerDevice Under

TestTime Master

Ethernet Hub

Communications Simulator

Vendor-Supplied DocumentationDrives Test Plan


140/162

Copyright SEL 2008

Drives Test PlanProtocol Implementation

Conformance Statement

(PICS)

Summarizes communications

capabilities of tested system or device

Model Implementation

Conformance Statement

(MICS)

Details standard data object model

elements

Protocol Implementation eXtra

Information for Testing (PIXIT)

Documents specific informationregarding communications

capabilities of system or device not

documented within IEC 61850

TISSUE Implementation

Conformance Statement (TICS)

Specification for which Technical

Issues updates (TISSUES) have

been implemented in the current

version

Testing Follows UCAIUG Process


141/162

Copyright SEL 2008

TISSUES Process ProvidesFeedback


142/162

Copyright SEL 2008

Feedback

TISSUES

1st Proposal

Final Proposal

yellow TISSUESgreen TISSUES

IEC TC57 WG10

Initiator emails

Selected and distributed to the

responsible member of GoE

Responsible GoE member will

create 1st proposal and

distribute to all of GoE

After discussion, a final

proposal is distributed to

TISSUES group for vote

100% approval

Could be a short-

term fix

Yellow tissues get

resubmitted until100% approval

Green become partof the standard

Conformance Is First Step TowardSuccessful Integration


143/162

Copyright SEL 2008

Successful Integration

Conformance does device communicate as

standard specifies? Interoperability do two or more devices work

together on the LAN as expected when they

exchange standard IEC 61850 format

messages?

Performance or stress does device performappropriately when subjected to

communications and physical extremes?

Interoperability Is Not Formally Tested;Occurs During Project Development


144/162

Copyright SEL 2008

g j p

Flexibility of IED is important

Experience with multi-vendor systems is

necessary

SCL parameters via settings rather than ICDfile make configuration difficult

Vendors should do this during productdevelopment

Performance: Removed FromConformance


145/162

Copyright SEL 2008

Conformancef1, f2 Processing interval (convert field data into logic, logic

into outputs)

ta,tc Communicate message contents into logic, logic intomessage contents

tb

Time message

is on wire

Transfer time is

ta +tb +tc

Transmission time

is transfer time + f2

(processing interval)

Time Accuracy and ReliabilityRemoved From Conformance


146/162

Copyright SEL 2008

Removed From Conformance

Device clock time-set accuracy

Data timestamp accuracy

IEC 61850-3 measures of Reliability, availability, maintainability,

security, data integrity

Certificate Specifies Product, Firmware,Tested Parts of the Standard


147/162

Copyright SEL 2008

Specifies Which Conformance Blocks inPresent Version Were Tested


148/162

Copyright SEL 2008

No rules

aboutminimum

feature set;

we tested

what wasneeded for

SAS

KEMA Performed Platform Testingfor SEL


149/162

Copyright SEL 2008

for SEL

SEL-4XX interface testing verifies

implementation in the SEL-421, SEL-451,SEL-451-4, and SEL-487B

SEL-3XX interface testing verifiesimplementation used in two form factors

in the SEL-387E, SEL-311L, SEL-710,SEL-751A, SEL-2411

Certificate Table Format and TestVersions May Differ


150/162

Copyright SEL 2008

SEL devices were tested with the new and improved test procedures; others werenot

SEL certificate lists GOOSE 9ab on one line; Siemens lists 9a and 9b on two lines

Different Vendors, Different Products,Different Capabilities


151/162

Copyright SEL 2008

Different Capabilities

Things untested may very well be interoperable

things that are tested conformant may not be

interoperable

Conclusions Advice for Users


152/162

Copyright SEL 2008

IEC 61850 Part 10 and UCAIUGprocedures define a strong process for:

Interoperability issue discovery andresolution

Continuous improvement of the Standard

Know exactly what services were

conformance tested, versus whatservices the project needs to use

Learn about local issues

Testing Limitations and AmbiguitiesRemain


153/162

Copyright SEL 2008

Tests cover only small fraction of possibleerrors

Interoperability can never be assured byconformance

Version control there is no standard onwhen a retest is required

Platform testing there is no standarddescribing when one test for similar

devices is inadequate


154/162

Copyright SEL 2008

Application of IEC 61850Technology for Complete

Substation AutomationSystems

IEC 61850 Concept of Local

Issues

IEC 61850 Standardizes Data FlowAspects of Automation System


155/162

Copyright SEL 2008

p y

Standard performs nothing new in substation

automation

Provides new names and communications

methods to replace existing technology

In fact, it does not yet coverall present power

system management functions

Reliability-centered maintenance

Asset management; revision management

Substation automation functions

IEC 61850 Goals of CommunicationStandardization


156/162

Copyright SEL 2008

Interoperability

Capability of two or more IEDs of the same

or different supplier to exchange informationand use this information for the properexecution of the specific functions (IEC

61850-1)

Interchangeability

The ability to substitute a device supplied bya manufacturer with a device supplied byanother manufacturer without substituting

other elements of the system (IEC 61850-1)

Functionality of IEDs Is Out ofScope


157/162

Copyright SEL 2008

p

Interoperabili ty send and receive standardizedmessages

Interchangeability

Only at communications level

IEDs still perform differently

An IED can be replaced by several, and vice versa, as

long as data models remain the same

IEC 61850 5 Local Issues Are Outof Scope


158/162

Copyright SEL 2008

p

Since interoperability is also needed for a

proper operation of functions, the reaction of

the application in the receiving node has to beconsidered

IED reaction must satisfy required functionality

IED functionality must behave during

communications degradation

These requirements are function related local

issues and, therefore, outside the scope of the

IEC 61850 series

These Important Implementation DetailsNot Addressed by the Standard


159/162

Copyright SEL 2008

Local issues expected to be dealt with

Locally in the IED by the developer

Local to the substation by the user

Likely some combination of the two

Describe functionality that is required from the

system

Necessary to clarify IED requirements in

addition to IEC 61850 Compliance

Several Issues Became Challengesas Soon as the Standard Was Used


160/162

Copyright SEL 2008

Not every contingency had been

identified or standardized

Much useful information in the IEDs is not

represented in object models

Asset management, diagnostics, reports

Settings, notifications, performanceindicators

Even More as Substations WereConnected to Remote SCADA Systems


161/162

Copyright SEL 2008

Legacy protocols generally use simple

data types that do not translate into morecomplex 61850 data types

Mandatory 61850 attributes are often notavailable via SCADA protocols

Quality, time, control origin, etc.


162/162