© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 1 Cisco Confidential 1 © 2010 Cisco and/or its affiliates. All rights reserved.

Patrick Grossetete Technical Marketing Engineer, Internet of Things Business Unit pgrosset@cisco.com

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2

Manufacturing

Plantwide Ethernet, Intelligent Transportation, Smart Cities, S&C Refinery, Smart Connected Vehicle, Smart Grid

Data Center/Virtualization

Energy-Utility Mining Oil and Gas Transportation City Defense SP/M2M

Fog Computing

Embedded Services Router

Routers WiFi AP

SDK

IE 2000 IE 3000 CGS 1000 CGS 2500

5915 Embedded

Services Router 3200

ESS2000

Video Surveillance

IPICS .

Physical Access Manager

CGR 1000

819H 1552 Wirele

ss

CGR 2000

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 3

AMI Metering / HAN Gateway

Transformer Monitoring

Distribution Automation

EV Charging Infrastructure Direct Cellular

Connect Assets

Gas / Water Meters

Distributed Generation

SCADA Protection and

Control Network

RF Mesh or PLC Neighborhood Area Network

Direct Load

Control

NA

N T

ier

WA

N Tier

Network Management Operations

DA Operations AMI Operations

Cisco 1000 series Connected Grid

Routers

Work Force Automation

Cisco ASR 1000 series

Public or Private WAN Backhaul

(Cellular, WiMAX, Fiber/Ethernet

CGR 1240 CGR 1120

Protection and Control

Networks

Outdoor Lighting

AMI Data Center: Destination of FAN AMI Traffic, source of AMI

requests Network Operation Center; Used to manage and secure

The network components

Distribution Automation Control Center;

Destination of critical SCADA traffic

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 4

IPv6/IPv4

UDP/TCP

IEEE 802.15.4e MAC enhancements

IPv6 RPL

Web Services, EXI, SOAP, RestFul,HTTPS/CoAP

•  Open Standards – at all levels to ensure interoperability and reduce technology risk for utilities

•  Future proofing – common application layer services over various wired and wireless communication technologies

802.1x / EAP-TLS & IEEE 802.11i based Access Control

Physical Layer

IEEE 802.15.4 2.4GHz, 915, 868MHz

DSSS, FSK, OFDM

IEEE P1901.2 NB-PLC OFDM

IEEE 802.11 Wi-Fi

2.4, 5 GHz, Sub-GHz

IEEE 802.3 Ethernet UTP, FO

2G, 3G, LTE Cellular

IEEE 802.16 WiMAX

1.x, 3.xGHz

Data Link Layer

IEEE 802.15.4 including FHSS

IEEE P1901.2 802.15.4 frame

format

IEEE 802.11 Wi-Fi

IEEE 802.3 Ethernet

2G, 3G, LTE Cellular

IEEE 802.16 WiMAX

6LoWPAN (RFC 6282) IPv6 over Ethernet (RFC 2464) IPv6 over PPP (RFC 5072)

IP or Ethernet Convergence SubL.

Network Layer

Transport Layer

Application Layer

Addressing, Routing, Multicast, QoS, Security

Security (DTLS/TLS)

DNS, NTP, IPfix/Netflow, SSH RADIUS, AAA, LDAP, SNMP,…

(RFC 6272 IP in Smart Grid)

Metering IEC 61968 CIM, ANSI C12.22,

DLMS/COSEM,…

SCADA IEC 61850, 60870

DNP3/IP, Modbus/TCP,…

LLC

M A C

Mgmt

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 5

•  Application Layer •  Use case application from Vendor adopting the SDK •  Management is part of the SDK libraries (CoAP/CSMP), including

firmware upgrade

•  IPv6 protocol suite •  DHCPv6 (RFC 3315) for Address auto-configuration •  RPL (RFC 6206, 6550, 6551, 6553, 6554, 6719) for IPv6 routing •  IP QoS – 4 priority queues

•  IEEE 802.1x and 802.11i based security

•  6LoWPAN Header Compression (RFC 6282)

•  MAC layer: IEEE 802.15.4g or 1901.2 + IEEE 802.15.4e extensions

•  15.4e: EB and EBR for network discovery •  15.4e: Enhanced ACK for security and information carrying •  15.4e: Information Elements (RSSI, Time synchronization)

•  PHY layer – IEEE 802.15.4g RF or 1901.2 PLC compliant •  PLC – CENELEC A band in phase 1 •  RF – 902-928MHz or subset

Adaptation: 6lowpan (RFC 6282)

IPv6

TCP/UDP

PHY: IEEE 802.15.4g or 1901.2

MAC: 802.15.4g or 1901.2 + 802.15.4e extensions

Routing: RPL

Mgmt: CSMP

CoAP

Cisco Developer Network – IP Enabled Grid Devices: HW ref. model (PHY & MAC) + SW SDK library. Small footprint open standards IPv6-based communication stack

802.1x / EAP-TLS based Access Control Solution

Applications

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 6

Preamble SPD PHY Header

Auxiliary Security Header

Payload FCS Frame Control

Data Seq. Nbr

Addressing

•  Adaptation layer for IPv6 over IEEE 802.15.4 (RFC 4944, 6282) – No IPv4 equivalent!

•  Also adopted for IEEE 1901.2 PLC, etc

IEs Header & Payload

DST PAN ID

Mesh Address

6LoWPAN Compressed Hdr Payload

DST MAC Address

SRC PAN ID

SRC MAC Address

DSP

X 0 0

1 0

0 1 1 1

Not a LoWPAN frame

LoWPAN IPv6 addressing Hdr

LoWPAN mesh Hdr

LoWPAN fragmentation Hdr

Frag. 6LoWPAN Compressed Hdr Payload

Frag. 6LoWPAN Compressed Hdr Payload

DSP + IPHC Other 6LoWPAN Hdr field Payload

Header Dispatch (DSP) – understand what is coming

Mesh Address Mesh + Fragmentation

Frame Fragmentation

Mesh (L2 Routing)

6LoWPAN

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 7

•  Scalable and Standard-based IPv6 Address allocation

•  Reduced traffic – Rapid Commit option

•  Deliver additional information through options, i.e. Application’s server’s addresses, etc

IP WAN

DHCPv6 Server

DHCPv6 Relay

DHCPv6 Solicit DHCPv6 Solicit

forwarded over UDP DHCPv6 Solicit relays by CGR 1000 to DHCPv6 Server DHCPv6 Server

assigns an IPv6 address based PAN IPv6 prefix allocated to this CGR 1000

DHCPv6 Reply sent from DHCPv6 Server DHCPv6 Reply

forwarded over UDP DHCPv6 Reply Routable

IPv6 Address

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 8

•  RPL is a new Distance Vector routing protocol standardized by the IETF, specifically designed for Low Power and Lossy Networks (LLNs)

IETF RoLL WG defined a collection of RFCs (6550, 6551, 6553, 6554, 6206, 6217) to cover all identified use cases Adapted to nodes running over LLNs with little CPU and memory resources, low

bandwidth network interface, potentially battery powered

•  RPL runs over IPv6-only as “Route Over”, guaranteeing the use of a variety of data links and route re-distribution with other IPv6 routing protocols

New routing metrics: Energy, latency, link reliability, node state, link color,…

•  Support of various traffic flows Multi-Point to Point – ie: meters to Head-end servers – upstream route Point-to-MultiPoint – ie: Head-end servers to meters – downstream route Point-to-Point – ie: Sensor to Actuator

Utility Facilities

IP WAN RPL

Domain

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 9

1

5

Rugby Club

Transformer

298

709

1544

1577

1510

1466

786

431

725

205?

1657

1363

679

387

1685

1608

1492

1589

1576

1419?

1677

1584

976

1629

1512?

561

1479

1725

749

1539

881

504

1598

570

1491

1562

1432

RM832

8914

RM231

1838

RM021

7394

RM032

9710

1478

RM032

3157

RM006

8134

RM032

8783

????

1443

RM005

8061

RMB45

7860

451

1361

Green  Hse

RM227

9049

869

1466

1577

152

RM510

5160

1602

725

RM006

9543

1592

881 1539

749

1725

1544

709

1510mini  pillar

RM047

3137

1651

431

RM514

7729

RM032

8253

RM228

1039

RM006

P856344

RM2288

56914386

RM008

7838

RM006

3144

RM533

1986

298

700

mini  pillar

Cisco  Routers

Cisco  Node

Cisco  Node

Cisco  Node

Cisco  Node

Cisco  Node

Cisco  Node

334

CGR

392 407

398 385

315

348

368

354

415

322

365

357

328

321

410

366 367

1 hop

2 hops

3 hops

4 hops

373

353

347 381

363

370

409

414

331

341 361

317

379

397

390

395

352

416

359

337 340

384

369

421 333

351

420

382

362

419

320

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 10

Public or Private IP WAN

Cisco CG-NMS Server, DB

ASR 1000

•  FAN applications can leverage IPv6 Multicast services when addressing a group of end-points. In example:

o  End-points firmware upgrade o  AMI Head-end applications

o  Demand reset messages o  Demand response messages o  Targeted pings Group of meters

with same read time/cycle •  IPv6 Multicast has to be integrated

in network design of Utility NOC and WAN

• On CG-Mesh, Field Area Router can act as MLD proxy, therefore broadcasting the Multicast packet at Layer-2 on the Mesh

AMI Head-End Servers, DB

PAN #1 PAN #2 PAN #3

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 11

IP WAN

CGR 1000

SCADA

CGR 2010 (Raw TCP Server)

SCADA

Raw TCP Sessions for Serial protocols

Standard-based IPv4 over IPv6 - IETF MAP-T

SCADA/DMS server •  Raw TCP: natively or through IP/

Serial Redirector SW •  Native IPv4 SCADA protocol

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 12

IP WAN

CGR 1000

SCADA Server

MAP-T Border Relay MAP-T CPE

Private IPv4 address, i.e. 192.168.0.2

Private IPv4 address, i.e. 192.168.0.1

MAP IPv4 address, i.e.153.10.10.254

MAP IPv6 address i.e. 2031:6f8:147e: 10fe:99:a0a:fe00:0

NAT44

IPv6 WPAN address, i.e.

2013:DB8:9999:8888:5D03:8DE7:5

74F:9E86 WPAN IPv6 RPL entries [2013:DB8:9999:8888:207:8108:B8:1CC5] (1/2) \--- 2013:DB8:9999:8888:5D03:8DE7:574F:9E86 (1) \--- 2031:6F8:147E:10FE:99:A0A:FE00:0/128 # IPv6 route entries C 2013:DB8:9999:8888::/64 [0/0] via Wpan3/1, directly connected L 2013:DB8:9999:8888:207:8108:B8:1CC5/128 [0/0] via Wpan3/1, receive C 2031:6F8:147E:10FE:99:A0A:FE00:0/128 [0/0] via Wpan3/1, directly connected S 2610:D0:1200:CAFE::/64 [1/0], tag 1 via Tunnel1, directly connected

IPv6 route entries S 2013:DB8:9999:8888::/64 [1/0], tag 1 via Virtual-Access1, directly connected S 2031:6F8:147E:10FE:99:A0A:FE00:0/128 [1/0], tag 1 via Virtual-Access1, directly connected S 2610:D0:1200:CAFE::/64 [1/0] via ::128.0.1.0, NVI0 IPv4 route entries 153.10.0.0/24 is subnetted, 1 subnets S 153.10.10.0 [1/0] via 128.0.1.0, NVI0

IPv4 Local address 10.1.0.60

Default Gateway 10.1.0.22

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 13

IP WAN

CGR 1000

SCADA

CGR 2010 (Raw TCP Server)

SCADA

SCADA/DMS server & application Native Raw Socket or IP/Serial Redirector SW (Raw TCP client)

pat1#show wpan 3/1 rpl atr ============================= WPAN RPL TREE FIGURE [3] ============================= [2013:DB8:9999:8888:207:8108:B8:1CC5] (1/2) \--- 2013:DB8:9999:8888:5D03:8DE7:574F:9E86 (1) \--- 2031:6F8:147E:10FE:99:A0A:FE00:0/128 # RPL TREE: Num.DataEntries 2, Num.GraphNodes 3 (external 1)

asr1K# show ipv6 route …… S 2013:DB8:9999:8888::/64 [1/0], tag 1 via Virtual-Access1, directly connected S 2031:6F8:147E:10FE:99:A0A:FE00:0/128 [1/0], tag 1 via Virtual-Access1, directly connected S 2610:D0:1200:CAFE::/64 [1/0] via ::128.0.1.0, NVI0

•  IPv6 routes to be known on CGR1K and ASR1K •  static or dynamic routing •  dynamic routing required for PAN migration

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 14

In addition of IPv4 address space depletion and traditional ICT transition

•  A huge address space accommodating any expected multi-millions meter’s deployment, thousands of sensors (DA) over the hundred thousands of secondary substations and additionally all standalone meters.

•  IPv6 addressing standard – future proofing (10-15 years lifetime)

•  De facto IP version support for meters communication over RF Mesh IEEE 802.15.4 – as well as G3-PLC – since the standardized adaptation layer – IETF 6LoWPAN WG – only defines IPv6 as protocol version.

No IPv4 standard equivalent has been specified BUT must support IPv4 and non-IP applications/devices

•  De facto IP version for the standardized IETF Routing Protocol for Low Power and Lossy Networks (RPL) – IETF RoLL WG – as it is an IPv6-only protocol.

•  Flexibility of address set-up for zero-touch configuration, such as DHCP Individual address configuration + Prefix Delegation + Stateless IPv6 configuration

•  Leverage Network Services and Transition mechanisms easing application’s deployment

•  IP brings all knowledge about open standards, interoperability, application’s development, management, security and knowledgeable workforce to IOT

Thank you.