A FLEXIBLE, MULTI-PURPOSE, OPEN SOURCE TEST PLATFORM FOR IOT TESTING
Presented by Tibor Csöndes and Antal Wu-Hen-Chang
Ericsson Hungary Ltd.
[email protected], [email protected]
© All rights reserved
2 © All rights reserved
3 © All rights reserved
Source: Ericsson Mobility Report
November 2016
Connected Devices
in 202229 BILLION
18.1 billionM2M/IOT DEVICES
8,6 billionMOBILE PHONES
Connect autonomous devices to an application server
(device ↔ server)
Machine to Machine
Connect autonomous devices to each other as well
(device ↔ device)
Internet of Things
5.6 Billion in 2016
3 billionPC/TABLET/LAPTOOP/FIXED PHONES
3 Billion in 2016
7.3 Billion in 2016
4 © All rights reserved
IoT/M2M Communication- Evolving with Wide Range of Requirements
Massive IOT
CAPILLARY NETWORKS
LOGISTICS, TRACKING AND FLEET
MANAGEMENT
SMART
AGRICULTURE
SMART
BUILDING
SMART
METER
Critical IoT
TRAFFIC SAFETY &
CONTROL
INDUSTRIAL APPLICATION
& CONTROL
REMOTE
MANUFACTURING,
TRAINING,
SURGERY
REMOTE HEALTH
CARE
Cellular M2M today
• Electricity meters
• Connected cars
• POS terminals
• ETC
• ~400 million cellular
M2M connections
today
• Majority over GPRS
LOW COST, LOW ENERGY
SMALL DATA VOLUMES
MASSIVE NUMBERS
Massive IoT Radio
Access ULTRA RELIABLE
VERY LOW LATENCY
VERY HIGH AVAILABILITY
4G Evolution & 5G
5 © All rights reserved
Cellular for Massive IoTMeeting diversity of use case requirements
Coverage Battery life Throughput (peak) Security DeploymentMobility
EC-GSM-IoT 164dB
(+20dB)
10+ Year 473/473k
bps
SW
Cat-M1 160dB
(+15dB)
10+ Year 0.8/1 Mbps
full duplex
SWConnected &
idle mode
mobility
NB-IoT 164dB
(+20dB)
10+ Year 227/250kbps
multi-tone ULSWIdle mode
mobility
Bandwidth
600kHz
1.4MHz
200kHz
Idle mode
mobility
Massive IoT in Ericsson
6 © All rights reserved
LTE-M NB-IoT EC-GSM
IoT Platform
Massive IoT
Infrastructure DCP IoT Apps
Typically delivered
as a serviceDelivered either
on-premises or
partly as a service
Wi-Fi
Thread
BLE
3GPP LPWA access
Capillary networks for non-3GPP
devices
LoRa
Non-3GPP LPWA access
LTE
CAT1-4
IoT Cloud Services
Mobile
Broadband
GPRS
System under test: things
7 © All rights reserved
LTE-M NB-IoT EC-GSM
IoT Platform
Massive IoT
Infrastructure DCP IoT Apps
Typically delivered
as a serviceDelivered either
on-premises or
partly as a service
Wi-Fi
Thread
BLE
3GPP LPWA access
Capillary networks for non-3GPP
devices
LoRa
Non-3GPP LPWA access
LTE
CAT1-4
IoT Cloud Services
Mobile
Broadband
GPRS
System under test: infrastructure
8 © All rights reserved
LTE-M NB-IoT EC-GSM
IoT Platform
Massive IoT
Infrastructure DCP IoT Apps
Typically delivered
as a serviceDelivered either
on-premises or
partly as a service
Wi-Fi
Thread
BLE
3GPP LPWA access
Capillary networks for non-3GPP
devices
LoRa
Non-3GPP LPWA access
LTE
CAT1-4
IoT Cloud Services
Mobile
Broadband
GPRS
System under test: platform
9 © All rights reserved
LTE-M NB-IoT EC-GSM
IoT Platform
Massive IoT
Infrastructure DCP IoT Apps
Typically delivered
as a serviceDelivered either
on-premises or
partly as a service
Wi-Fi
Thread
BLE
3GPP LPWA access
Capillary networks for non-3GPP
devices
LoRa
Non-3GPP LPWA access
LTE
CAT1-4
IoT Cloud Services
Mobile
Broadband
GPRS
10 © All rights reserved
Testing challenges
Scaling-up to millions of IoT devices with
new traffic patterns
IoT traffic may cause disturbances for other
mobile subscribers
Diverse set of IoT functionalities and applied
technologies
New security risks
CAPACITY, SCALABILITY TESTS
COEXISTENCE TESTS
FUNCTIONAL TESTS
SECURITY TESTS
11 © All rights reserved
IoT testing with
12 © All rights reserved
Titan: open-source TTCN-3 test automation framework
• Developed at Ericsson Hungary
Titan supports IoT protocols
• TCP/HTTP, TCP/MQTT, UDP/DTLS/CoAP, SMS/CoAP …
oneM2M
• global consortium for standardizing IoT common services
• chosen Titan as the basis for oneM2M Tester
https://projects.eclipse.org/projects/tools.titan
“Internet of Lego”
13 © All rights reserved
Architecture of Lego truck
14 © All rights reserved
IoT Platform
INFRASTRUCTURE
(Internet)App
Wi-Fi
iot.eclipse.org
HARDWARE
(motors)
RASPBERRY
PI 3
CONTROL LOGIC
MQTTMQTT
HTTP
15 © All rights reserved
IoT traffic with RIOT ( )
16 © All rights reserved
Core Load Library
Application behavior (CEFSMs)
CoAP Library
LwM2M Library
MQTT Library HTTP Library
CoAP Peers
MQTT Devices Web Clients
Core Load Library
• Load generator components
• Resource mgmt.
• Scheduling
• REST API for presentation
Protocol Stacks
• Non-blocking functions
• Handling large number
of sessions
Protocol Stacks
• Finite State Machine based
• Simulating huge number
of instances
LwM2M Devices
CoAP Peers
MQTT Devices Web Clients
IoT traffic with RIOT ( )
17 © All rights reserved
Core Load Library
Application behavior (CEFSMs)
CoAP Library
LwM2M Library
MQTT Library HTTP Library
CoAP Peers
MQTT Devices Web Clients
Core Load Library
• Load generator components
• Resource mgmt.
• Scheduling
• REST API for presentation
Protocol Stacks
• Non-blocking functions
• Handling large number
of sessions
Protocol Stacks
• Finite State Machine based
• Simulating huge number
of instances
LwM2M Devices
CoAP Peers
MQTT Devices Web Clients
18 © All rights reserved
IoT traffic with RIOT
AppIoT
MQTT
19 © All rights reserved
Core Load Library
CoAP Library
LwM2M Library
Device Simulation (FSMs)
LwM2M Devices
HTTP Library
Web Clients
traffic
IoT traffic example
20 © All rights reserved
IoT traffic example
Core Load Library
CoAP Library
LwM2M Library
Device Simulation (FSMs)
LwM2M Devices
HTTP Library
Web Clients
traffic
21 © All rights reserved
IoT traffic example
Core Load Library
CoAP Library
LwM2M Library
Device Simulation
(FSMs)LwM2M Devices
HTTP Library
Web Clients
traffic
22 © All rights reserved
IoT traffic example
Core Load Library
CoAP Library
LwM2M Library
Device Simulation (FSMs)
LwM2M Devices
HTTP Library
Web Clients
traffic
23 © All rights reserved
IoT traffic example
Core Load Library
CoAP Library
LwM2M Library
Device Simulation (FSMs)
LwM2M Devices
HTTP Library
Web Clients
traffic
Register
201 Created
Read
204 Content
Deregister
202 Deleted
24 © All rights reserved
IoT traffic example
Core Load Library
CoAP Library
LwM2M Library
Device Simulation (FSMs)
LwM2M Devices
HTTP Library
Web Clients
traffic
25 © All rights reserved
IoT traffic example
Core Load Library
CoAP Library
LwM2M Library
Device Simulation (FSMs)
LwM2M Devices
HTTP Library
Web Clients
traffic
GET /api/clients
200 OK (JSON)
GET /api/clients/clientX/
200 OK (JSON)