iLab - Technical

Use cases

Brecht Vermeulen

2

Contents

Triple play Quality of experience

xDSL CPE test suite

IBBT GBO projectsFIPA, ePaper, Geobips

International connectivityVPN to City University of New York (CUNY)Planetlab

Communities16+

3

Use case I: Triple play QoE

Quality of Experience for userAudio/voiceVideoData

Projects:Cantata: Barco, IBBTChamp: Alcatel, UA, IBBTOSLU: Newtec, IBBTScone: Alcatel, IBBT

4

Triple play Quality of Experience: voice

VoIP comparisonSkypeSJPhone (soft phone, SIP/H.323)IP phones (Siemens, Cisco)

5

Voice quality: lab setup

Compares outgoing and incoming signal MOS ScorePESQ: voice over packet based networksPSQM: voice over networks with a fixed delayPEAQ: for hifi audio testing

SJPhone SJPhone

6

Voice quality: lab setup

Compares outgoing and incoming signal MOS ScorePESQ: voice over packet based networksPSQM: voice over networks with a fixed delayPEAQ: for hifi audio testing

SJPhone SJPhone

0

50

100

150

200

250

Skype Direct (138ms)

Skype P2P (160 ms) SJPhone (220 ms) Siemens/Cisco IPPhone (70-93 ms)

Program / Device

Del

ay (m

s)MOS<3.9

MOS<3.9

MOSG.711 4.3

MOSG.711 4.3G.729 3.9

MOS PSTN 3.8

7

Voice quality: Skype direct vs. P2P

Ordinary Host

Supernode

Skype Login server

Direct Connection Not Possible

Use of P2P Network

Direct Connection Possible

8

Telenet to skynet (P2P and direct): 24h

0

0,5

1

1,5

2

2,5

3

3,5

4

4,5

Time

MO

S Sc

ore

0

500

1000

1500

2000

2500

Time

Del

ay (m

s) Delay Max (within 1conversation) [ms]Delay Avg (within 1conversation) [ms]Delay Min (within 1conversation) [ms]

0

0,5

1

1,5

2

2,5

3

3,5

4

4,5

Time

MO

S Sc

ore

0

500

1000

1500

2000

2500

Time

Del

ay (m

s)

Delay Max (within 1conversation) [ms]

Delay Avg (within 1conversation) [ms]

Delay Min (within 1conversation) [ms]

MOS Delay

P2P

Direct 1000ms

2000ms

1000ms

2000ms4

4

3

3

9

Triple play: webserver performance

CPU

AMD dual Opteron 1,6GHz

AMD Athlon 643000+

AMD Athlon 1GHz

OS

Linux 2.4

Linux 2.6

Windows server 2003

HTTPHTTP/1.0 HTTP/1.1

Webserver

Apache 1.3 Apache 2.0

IIS 6.0Content

Small static page:Google

Large static page:static CNN

Dynamic page

10

AMD Athlon 64 3000+

0

2000

4000

6000

8000

10000

12000

14000

Google CNN CNN/1.0 Date Company

Apache 1.3 + Linux 2.4 Apache 2.0/prefork + Linux 2.4Apache 2.0/worker + Linux 2.4 Apache 2.0/perchild + Linux 2.4Apache 2.0/prefork + Linux 2.6 Apache 2.0/worker + Linux 2.6Apache 2.0/perchild + Linux 2.6 Apache 2.0/winNT + Windows Server 2003IIS 6.0 + W2K3 IIS 6.0 + W2K3 (ASP + MS Access)

Webserver performanceApache1.3Linux 2.4

Apache2.0Linux 2.4

Apache2.0Linux 2.6

Windows server 2003IIS 6.0

Tran

sact

ions

/s

11

Webserver: overload behavior

Linux/Apache 2.0 prefork –simple PHP

Linux/Apache 2.0 worker –HTTP 1.1 static

Linux/Apache 2.0 perchild – HTTP 1.0 static

Windows 2003 server – IIS 6.0

12

Webserver performance: bandwidth

OS BW (Mb/s)Small static page (google) W2K3 + IIS 6.0

Linux 2.4 + Apache 2.0/Worker319320

Large static page HTTP/1.0(CNN)

Linux 2.4 + Apache 2.0/Worker 282

Large static page HTTP/1.1(CNN)

W2K3 + IIS 6.0Linux 2.4 + Apache 2.0/WorkerTux + Linux 2.6

352318510

Dynamic PHP Linux 2.4 or 2.6 + Apache 1.3 12

Dynamic ASP W2K3 + IIS 6.0 12,7

PHP + MySQL Linux 2.6 + Apache 1.3 20,6

Off the shelf PC hardware: Athlon 3000, socket 754

13

SmartBits 6000B Performance Analysis SystemR

Mirr

ored

Por

t

Mirr

ored

Por

t

Triple play: video QoE – testbed

• Automatic testruns• In-house developed• See demonstration

• Linux servers• Windows servers• In-house streamers

• Network emulation• Different technologies

• Clients (multi-platform)• Quality analysis

Packet capturing during streaming

14

Contents

Triple play Quality of experience

xDSL CPE test suite

IBBT GBO projectsFIPA, ePaper, Geobips

International connectivityVPN to City University of New York (CUNY)Planetlab

Communities16+

15

Use case II: xDSL CPE test suite in Muse

The overall objective of MUSE is the research and development of a future, low cost, multi-service access networkEuropean IST (Information Society Technologies) research programBelgian partners: Alcatel, Thomson, IBBTIBBT iLab:

Development of a test suite for CPEs (with requirements of DSLforum, IETF, Muse)

Multi Service Access Everywhere (www.ist-muse.org)

16

Muse: xDSL CPE tests overview

Multicast (49 tests for 70 requirements)IGMPv3 Requirements

Packet RequirementsGroup Membership RequirementsMulticast Router Requirements

IGMPv3-Proxy RequirementsDSLForum Multicast Requirements

General RequirementsImmediate LeaveUpstream interfaces without an IP addressMultiple upstream interfacesFilteringForwarding

DHCP (+/-25 tests dhcp client, 25 tests dhcp server, > 60 requirements)VLAN Ethernet OAMGeneralSecurity

17

Example output of a DHCP test

TEST: TestServer_AllocateAddressReset DHCP serverBroadcast a DHCPDISCOVER messageWait for an ARP request from the server

failed: Did not receive an ARP request from 10.0.1.5Wait for a DHCPOFFER message

passed: Server 10.0.1.5 offered the 10.0.1.20 IP AddrBroadcast a DHCPREQUEST messageWait for a DHCPACK message

passed: received a valid DHCPACK messageAdding ARP entry for 10.0.1.20 at 45:87:e7:57:ee:13Stop DHCP serverFinish test

Test score for TestServer_AllocateAddress: good

18

Contents

Triple play Quality of experience

xDSL CPE test suite

IBBT GBO projectsFIPA, ePaper, Geobips

International connectivityVPN to City University of New York (CUNY)Planetlab

Communities16+

19

Use case III: IBBT GBO: FIPA

File based Integrated Production Architecture IP based architecture to share storage and computing power on single or multiple sites For digital media production, eHealth, ...Partners:

VRTIBMPorthusVideo promotionIBBT

iLab involvement: performance analysis and optimization of network/storage

20

FIPA: Research goal

In the IP network:Transfer of large media files

1 hour: 25 GBBitstream: 50 Mb/s

On high performance low delayLAN

Research goal :Find the optimal setup/configuration to achieve maximal throughput

Variables to play with:Network Card: normal NIC, TCP offload engineTCP + Ethernet parametersFTP, NFS, SMB/CIFS parameters

21

TCP offload engines

Normal NIC TCP offload engine

22

FIPA Tests & results: setup

Back-to-back tests between AMD dual Opteron systems (Opteron 246 @ 2GHz)

Intel PRO/1000 NIC (4 x 1 Gbps)TCP checksum & segm offload

Chelsio T204 TOE (4 x 1 Gbps)full TCP offload (= TCP Offload Engine)

TCP throughput measured with IperfGenerates TCP streams on different interfacesTransfers are memory-to-memory

LimitationsPCI-X bus: 64 bit @ 133 MHz ~ 1GB/s

PCI-X is a half-duplex bus, PCI Express is a full-duplex point-to-point connection

Maximal (unidir) TCP efficiency: 94.1% 941 Mbps per link99% for 9000 byte MTU

23

Chelsio TOE vs. Intel Pro 1000 (MTU 1500)4 links unidir: 3.7 Gb/s vs. Intel NIC 2.7 Gb/s4 links bidir: 7 Gb/s vs. Intel NIC 3.2 Gb/s

Jumbo frames on Intel: throughput +, CPU -

Tests & results: effect of offload and jumbo frames

Inte

l

Inte

lCh

elsi

o

Chel

sio

MTU 1500

MTU 9000

4 Gb/s

8 Gb/s

50%

100%

24

IBBT GBO e-Paper

Partners:PhilipsDe TijdHypervisionI-MergeBelgacomIBBT

iLab involvement: performance analysis of webservers for simultaneous content download

25

Web server CPU load with encryption

File 2MB, HP DL 145, dual opteron 1.6GHz

CPU Load - SimUsers/sec - SSL CipherSuites

0

20

40

60

80

100

120

10 20 30 40 50 60 70 80 90 100 110 120 130 140 150 160

SimUsers/sec

CPU

Loa

d (%

)

DES-CBC-SHA EXP-DES-CBC-SHAEXP-RC4-MD5 EXP-RC2-CBC-MD5EDH-RSA-DES-CBC3-SHA1 DES-CBC3-SHANo HTTPS

26

Influence of SSL offload

File 2MBAMD Athlon 3000

27

IBBT GBO: Geobips

GeoBIPS = Geographical BroadbrandIntegration for Public ServicesMobile crisis management system

Real-time overview of a disaster areaCollect, process, display and distribute static and dynamic information on top of a Geographical Information System (GIS)Dynamically build-up a network in the ‘crisis area’

Partners: Aventiv, Abiware, Capvidia, Cisco, Digipolis, Stad Antwerpen, Videohouse, IBBTiLab involvement: optimization of wireless“cubes”

28

Geo-BIPS use case

IPSec

IPSec

IPSec

1. While going to the site, intervention plans can be viewed.2. Fire truck arrives at the disaster site.3. Team enters the building, and places relay stations on

the go

29

GeoBIPS - demo

Axis video server

DVD-player (camera)

Reconnaissance team Relay Network Fire Truck

MAR

Tablet CO

WLTP

: Video-stream

30

Contents

Triple play Quality of experience

xDSL CPE test suite

IBBT GBO projectsFIPA, ePaper, Geobips

International connectivityVPN to City University of New York (CUNY)Planetlab

Communities16+

31

Use case IV: International connectivity

CUNY:VPN: 100Mb/s guaranteedFor dynamic reservation of VLANs with guaranteed BW for grid, conferencing, ...

Current status: UDP throughput=80Mb/s, TCP very low (Unexpected) packet loss somewhere

Planetlab: www.planet-lab.orgDistributed experiments2 nodes in iLab

708 nodes in 340 sites

32

Contents

Triple play Quality of experience

xDSL CPE test suite

IBBT GBO projectsFIPA, ePaper, Geobips

International connectivityVPN to City University of New York (CUNY)Planetlab

Communities16+

33

Use case V: Communities

iLab provides know-how to community site setup

E.g. 16+: webserver performance measurement, hardware setup