iLab - Technical
Use cases
Brecht Vermeulen
2
Contents
Triple play Quality of experience
xDSL CPE test suite
IBBT GBO projectsFIPA, ePaper, Geobips
International connectivityVPN to City University of New York (CUNY)Planetlab
Communities16+
3
Use case I: Triple play QoE
Quality of Experience for userAudio/voiceVideoData
Projects:Cantata: Barco, IBBTChamp: Alcatel, UA, IBBTOSLU: Newtec, IBBTScone: Alcatel, IBBT
4
Triple play Quality of Experience: voice
VoIP comparisonSkypeSJPhone (soft phone, SIP/H.323)IP phones (Siemens, Cisco)
5
Voice quality: lab setup
Compares outgoing and incoming signal MOS ScorePESQ: voice over packet based networksPSQM: voice over networks with a fixed delayPEAQ: for hifi audio testing
SJPhone SJPhone
6
Voice quality: lab setup
Compares outgoing and incoming signal MOS ScorePESQ: voice over packet based networksPSQM: voice over networks with a fixed delayPEAQ: for hifi audio testing
SJPhone SJPhone
0
50
100
150
200
250
Skype Direct (138ms)
Skype P2P (160 ms) SJPhone (220 ms) Siemens/Cisco IPPhone (70-93 ms)
Program / Device
Del
ay (m
s)MOS<3.9
MOS<3.9
MOSG.711 4.3
MOSG.711 4.3G.729 3.9
MOS PSTN 3.8
7
Voice quality: Skype direct vs. P2P
Ordinary Host
Supernode
Skype Login server
Direct Connection Not Possible
Use of P2P Network
Direct Connection Possible
8
Telenet to skynet (P2P and direct): 24h
0
0,5
1
1,5
2
2,5
3
3,5
4
4,5
Time
MO
S Sc
ore
0
500
1000
1500
2000
2500
Time
Del
ay (m
s) Delay Max (within 1conversation) [ms]Delay Avg (within 1conversation) [ms]Delay Min (within 1conversation) [ms]
0
0,5
1
1,5
2
2,5
3
3,5
4
4,5
Time
MO
S Sc
ore
0
500
1000
1500
2000
2500
Time
Del
ay (m
s)
Delay Max (within 1conversation) [ms]
Delay Avg (within 1conversation) [ms]
Delay Min (within 1conversation) [ms]
MOS Delay
P2P
Direct 1000ms
2000ms
1000ms
2000ms4
4
3
3
9
Triple play: webserver performance
CPU
AMD dual Opteron 1,6GHz
AMD Athlon 643000+
AMD Athlon 1GHz
OS
Linux 2.4
Linux 2.6
Windows server 2003
HTTPHTTP/1.0 HTTP/1.1
Webserver
Apache 1.3 Apache 2.0
IIS 6.0Content
Small static page:Google
Large static page:static CNN
Dynamic page
10
AMD Athlon 64 3000+
0
2000
4000
6000
8000
10000
12000
14000
Google CNN CNN/1.0 Date Company
Apache 1.3 + Linux 2.4 Apache 2.0/prefork + Linux 2.4Apache 2.0/worker + Linux 2.4 Apache 2.0/perchild + Linux 2.4Apache 2.0/prefork + Linux 2.6 Apache 2.0/worker + Linux 2.6Apache 2.0/perchild + Linux 2.6 Apache 2.0/winNT + Windows Server 2003IIS 6.0 + W2K3 IIS 6.0 + W2K3 (ASP + MS Access)
Webserver performanceApache1.3Linux 2.4
Apache2.0Linux 2.4
Apache2.0Linux 2.6
Windows server 2003IIS 6.0
Tran
sact
ions
/s
11
Webserver: overload behavior
Linux/Apache 2.0 prefork –simple PHP
Linux/Apache 2.0 worker –HTTP 1.1 static
Linux/Apache 2.0 perchild – HTTP 1.0 static
Windows 2003 server – IIS 6.0
12
Webserver performance: bandwidth
OS BW (Mb/s)Small static page (google) W2K3 + IIS 6.0
Linux 2.4 + Apache 2.0/Worker319320
Large static page HTTP/1.0(CNN)
Linux 2.4 + Apache 2.0/Worker 282
Large static page HTTP/1.1(CNN)
W2K3 + IIS 6.0Linux 2.4 + Apache 2.0/WorkerTux + Linux 2.6
352318510
Dynamic PHP Linux 2.4 or 2.6 + Apache 1.3 12
Dynamic ASP W2K3 + IIS 6.0 12,7
PHP + MySQL Linux 2.6 + Apache 1.3 20,6
Off the shelf PC hardware: Athlon 3000, socket 754
13
SmartBits 6000B Performance Analysis SystemR
Mirr
ored
Por
t
Mirr
ored
Por
t
Triple play: video QoE – testbed
• Automatic testruns• In-house developed• See demonstration
• Linux servers• Windows servers• In-house streamers
• Network emulation• Different technologies
• Clients (multi-platform)• Quality analysis
Packet capturing during streaming
14
Contents
Triple play Quality of experience
xDSL CPE test suite
IBBT GBO projectsFIPA, ePaper, Geobips
International connectivityVPN to City University of New York (CUNY)Planetlab
Communities16+
15
Use case II: xDSL CPE test suite in Muse
The overall objective of MUSE is the research and development of a future, low cost, multi-service access networkEuropean IST (Information Society Technologies) research programBelgian partners: Alcatel, Thomson, IBBTIBBT iLab:
Development of a test suite for CPEs (with requirements of DSLforum, IETF, Muse)
Multi Service Access Everywhere (www.ist-muse.org)
16
Muse: xDSL CPE tests overview
Multicast (49 tests for 70 requirements)IGMPv3 Requirements
Packet RequirementsGroup Membership RequirementsMulticast Router Requirements
IGMPv3-Proxy RequirementsDSLForum Multicast Requirements
General RequirementsImmediate LeaveUpstream interfaces without an IP addressMultiple upstream interfacesFilteringForwarding
DHCP (+/-25 tests dhcp client, 25 tests dhcp server, > 60 requirements)VLAN Ethernet OAMGeneralSecurity
17
Example output of a DHCP test
TEST: TestServer_AllocateAddressReset DHCP serverBroadcast a DHCPDISCOVER messageWait for an ARP request from the server
failed: Did not receive an ARP request from 10.0.1.5Wait for a DHCPOFFER message
passed: Server 10.0.1.5 offered the 10.0.1.20 IP AddrBroadcast a DHCPREQUEST messageWait for a DHCPACK message
passed: received a valid DHCPACK messageAdding ARP entry for 10.0.1.20 at 45:87:e7:57:ee:13Stop DHCP serverFinish test
Test score for TestServer_AllocateAddress: good
18
Contents
Triple play Quality of experience
xDSL CPE test suite
IBBT GBO projectsFIPA, ePaper, Geobips
International connectivityVPN to City University of New York (CUNY)Planetlab
Communities16+
19
Use case III: IBBT GBO: FIPA
File based Integrated Production Architecture IP based architecture to share storage and computing power on single or multiple sites For digital media production, eHealth, ...Partners:
VRTIBMPorthusVideo promotionIBBT
iLab involvement: performance analysis and optimization of network/storage
20
FIPA: Research goal
In the IP network:Transfer of large media files
1 hour: 25 GBBitstream: 50 Mb/s
On high performance low delayLAN
Research goal :Find the optimal setup/configuration to achieve maximal throughput
Variables to play with:Network Card: normal NIC, TCP offload engineTCP + Ethernet parametersFTP, NFS, SMB/CIFS parameters
21
TCP offload engines
Normal NIC TCP offload engine
22
FIPA Tests & results: setup
Back-to-back tests between AMD dual Opteron systems (Opteron 246 @ 2GHz)
Intel PRO/1000 NIC (4 x 1 Gbps)TCP checksum & segm offload
Chelsio T204 TOE (4 x 1 Gbps)full TCP offload (= TCP Offload Engine)
TCP throughput measured with IperfGenerates TCP streams on different interfacesTransfers are memory-to-memory
LimitationsPCI-X bus: 64 bit @ 133 MHz ~ 1GB/s
PCI-X is a half-duplex bus, PCI Express is a full-duplex point-to-point connection
Maximal (unidir) TCP efficiency: 94.1% 941 Mbps per link99% for 9000 byte MTU
23
Chelsio TOE vs. Intel Pro 1000 (MTU 1500)4 links unidir: 3.7 Gb/s vs. Intel NIC 2.7 Gb/s4 links bidir: 7 Gb/s vs. Intel NIC 3.2 Gb/s
Jumbo frames on Intel: throughput +, CPU -
Tests & results: effect of offload and jumbo frames
Inte
l
Inte
lCh
elsi
o
Chel
sio
MTU 1500
MTU 9000
4 Gb/s
8 Gb/s
50%
100%
24
IBBT GBO e-Paper
Partners:PhilipsDe TijdHypervisionI-MergeBelgacomIBBT
iLab involvement: performance analysis of webservers for simultaneous content download
25
Web server CPU load with encryption
File 2MB, HP DL 145, dual opteron 1.6GHz
CPU Load - SimUsers/sec - SSL CipherSuites
0
20
40
60
80
100
120
10 20 30 40 50 60 70 80 90 100 110 120 130 140 150 160
SimUsers/sec
CPU
Loa
d (%
)
DES-CBC-SHA EXP-DES-CBC-SHAEXP-RC4-MD5 EXP-RC2-CBC-MD5EDH-RSA-DES-CBC3-SHA1 DES-CBC3-SHANo HTTPS
26
Influence of SSL offload
File 2MBAMD Athlon 3000
27
IBBT GBO: Geobips
GeoBIPS = Geographical BroadbrandIntegration for Public ServicesMobile crisis management system
Real-time overview of a disaster areaCollect, process, display and distribute static and dynamic information on top of a Geographical Information System (GIS)Dynamically build-up a network in the ‘crisis area’
Partners: Aventiv, Abiware, Capvidia, Cisco, Digipolis, Stad Antwerpen, Videohouse, IBBTiLab involvement: optimization of wireless“cubes”
28
Geo-BIPS use case
IPSec
IPSec
IPSec
1. While going to the site, intervention plans can be viewed.2. Fire truck arrives at the disaster site.3. Team enters the building, and places relay stations on
the go
29
GeoBIPS - demo
Axis video server
DVD-player (camera)
Reconnaissance team Relay Network Fire Truck
MAR
Tablet CO
WLTP
: Video-stream
30
Contents
Triple play Quality of experience
xDSL CPE test suite
IBBT GBO projectsFIPA, ePaper, Geobips
International connectivityVPN to City University of New York (CUNY)Planetlab
Communities16+
31
Use case IV: International connectivity
CUNY:VPN: 100Mb/s guaranteedFor dynamic reservation of VLANs with guaranteed BW for grid, conferencing, ...
Current status: UDP throughput=80Mb/s, TCP very low (Unexpected) packet loss somewhere
Planetlab: www.planet-lab.orgDistributed experiments2 nodes in iLab
708 nodes in 340 sites
32
Contents
Triple play Quality of experience
xDSL CPE test suite
IBBT GBO projectsFIPA, ePaper, Geobips
International connectivityVPN to City University of New York (CUNY)Planetlab
Communities16+
33
Use case V: Communities
iLab provides know-how to community site setup
E.g. 16+: webserver performance measurement, hardware setup