Upload
kanthavel-thillai
View
20
Download
0
Tags:
Embed Size (px)
DESCRIPTION
sdxcvbn
Citation preview
Copyright 2002 OPNET Technologies, Inc. 1
Traffic Behavior and Queuing in a QoS Environment
Session 1813 Traffic Behavior and Queuing in a QoS Environment
Networking Tutorials
Prof. Dimitri P. Bertsekas
Department of Electrical Engineering
M.I.T.
Copyright 2002 OPNET Technologies, Inc. 2
Traffic Behavior and Queuing in a QoS Environment
Objectives
Provide some basic understanding of queuing phenomena
Explain the available solution approaches and associated
trade-offs
Give guidelines on how to match applications and solutions
Copyright 2002 OPNET Technologies, Inc. 3
Traffic Behavior and Queuing in a QoS Environment
Outline
Basic concepts
Source models
Service models (demo)
Single-queue systems
Priority/shared service systems
Networks of queues
Hybrid simulation (demo)
Copyright 2002 OPNET Technologies, Inc. 4
Traffic Behavior and Queuing in a QoS Environment
Outline
Basic concepts Performance measures
Solution methodologies
Queuing system concepts
Stability and steady-state
Causes of delay and bottlenecks
Source models
Service models (demo)
Single-queue systems
Priority/shared service systems
Networks of queues
Hybrid simulation (demo)
Copyright 2002 OPNET Technologies, Inc. 5
Traffic Behavior and Queuing in a QoS Environment
Performance Measures
Delay
Delay variation (jitter)
Packet loss
Efficient sharing of bandwidth
Relative importance depends on traffic type (audio/video,
file transfer, interactive)
Challenge: Provide adequate performance for (possibly)
heterogeneous traffic
Copyright 2002 OPNET Technologies, Inc. 6
Traffic Behavior and Queuing in a QoS Environment
Solution Methodologies
Analytical results (formulas)
Pros: Quick answers, insight
Cons: Often inaccurate or inapplicable
Explicit simulation
Pros: Accurate and realistic models, broad applicability
Cons: Can be slow
Hybrid simulation
Intermediate solution approach
Combines advantages and disadvantages of analysis and simulation
Copyright 2002 OPNET Technologies, Inc. 7
Traffic Behavior and Queuing in a QoS Environment
Examples of Applications
Analytical Modeling Discrete-Event Simulation
M/G/./. &
G/G/./.
FIFO
Analysis
M/G/./. &
G/G/./.
Priority
Analysis
Decomposition
with Kleinrock
Independence
Assumption
DES only with
Explicit Traffic
Hybrid DES
with Explicit
and
Background
Traffic Single Link with FIFO Service
Best Effort Service for Standard Data Traffic Yes N/A N/A Yes Yes
Best Effort Service for LRD/Self-Similar
Behavior TrafficYes N/A N/A Yes Yes
"Chancing It" with Best Effort Service for
Voice, Video and DataYes N/A N/A Yes Yes
Single Link with QoS-Based Queueing
Using QoS to differentiate service levels for
the same type of trafficN/A
Yes (loss of
accuracy) N/A Yes Yes
Using QoS to support different requirements
for different application types given as a
detailed study of setting Cisco Router
queueing parameters
N/AHighly
approximateN/A Yes Yes
Network of Queues
General network model extending the
previous QoS queueing modelN/A
Hop-by-hop
Analysis (loss
of accuacy)
Yes (some loss of
accuracy - e.g., traffic
shaping)
Yes (Run time a
function of network
complexity)
Yes [Fast with
minimal loss of
accuracy]
Reduction of the general model to a
representative end-to-end pathN/A
Hop-by-hop
Analysis (loss
of accuacy)
N/A
Yes (Run time a
function of network
complexity)
Yes [Fast with
minimal loss of
accuracy]
Analysis Scenarios
Copyright 2002 OPNET Technologies, Inc. 8
Traffic Behavior and Queuing in a QoS Environment
Queuing System Concepts: Arrival Rate, Occupancy, Time in the System
Queuing system
Data network where packets arrive, wait in various queues, receive
service at various points, and exit after some time
Arrival rate
Long-term number of arrivals per unit time
Occupancy
Number of packets in the system (averaged over a long time)
Time in the system (delay)
Time from packet entry to exit (averaged over many packets)
Copyright 2002 OPNET Technologies, Inc. 9
Traffic Behavior and Queuing in a QoS Environment
Stability and Steady-State
A single queue system is stable if packet arrival rate < system transmission capacity
For a single queue, the ratio
packet arrival rate / system transmission capacity
is called the utilization factor
Describes the loading of a queue
In an unstable system packets accumulate in various queues and/or get dropped
For unstable systems with large buffers some packet delays become very large
Flow/admission control may be used to limit the packet arrival rate
Prioritization of flows keeps delays bounded for the important traffic
Stable systems with time-stationary arrival traffic approach a steady-state
Copyright 2002 OPNET Technologies, Inc. 10
Traffic Behavior and Queuing in a QoS Environment
Littles Law
For a given arrival rate, the time in the system is proportional
to packet occupancy
N = T
where
N: average # of packets in the system
: packet arrival rate (packets per unit time)
T: average delay (time in the system) per packet
Examples:
On rainy days, streets and highways are more crowded
Fast food restaurants need a smaller dining room than regular
restaurants with the same customer arrival rate
Large buffering together with large arrival rate cause large delays
Copyright 2002 OPNET Technologies, Inc. 11
Traffic Behavior and Queuing in a QoS Environment
Explanation of Littles Law
Amusement park analogy: people arrive, spend time at
various sites, and leave
They pay $1 per unit time in the park
The rate at which the park earns is $N per unit time (N:
average # of people in the park)
The rate at which people pay is $ T per unit time (: traffic
arrival rate, T: time per person)
Over a long horizon:
Rate of park earnings = Rate of peoples payment
or
N = T
Copyright 2002 OPNET Technologies, Inc. 12
Traffic Behavior and Queuing in a QoS Environment
Delay is Caused by Packet Interference
If arrivals are regular or sufficiently spaced apart, no queuing
delay occurs
Regular Traffic
Irregular but
Spaced Apart Traffic
Copyright 2002 OPNET Technologies, Inc. 13
Traffic Behavior and Queuing in a QoS Environment
Burstiness Causes Interference
Note that the departures are less bursty
Copyright 2002 OPNET Technologies, Inc. 14
Traffic Behavior and Queuing in a QoS Environment
Burstiness Example Different Burstiness Levels at Same Packet Rate
Source: Fei Xue and S. J. Ben Yoo, UCDavis, On the Generation and Shaping Self-similar Traffic in Optical Packet-switched Networks, OPNETWORK 2002
Copyright 2002 OPNET Technologies, Inc. 15
Traffic Behavior and Queuing in a QoS Environment
Packet Length Variation Causes Interference
Regular arrivals, irregular packet lengths
Copyright 2002 OPNET Technologies, Inc. 16
Traffic Behavior and Queuing in a QoS Environment
High Utilization Exacerbates Interference
As the work arrival rate:
(packet arrival rate * packet length)
increases, the opportunity for interference increases
Time
Queuing Delays
Copyright 2002 OPNET Technologies, Inc. 17
Traffic Behavior and Queuing in a QoS Environment
Bottlenecks
Types of bottlenecks
At access points (flow control, prioritization, QoS enforcement needed)
At points within the network core
Isolated (can be analyzed in isolation)
Interrelated (network or chain analysis needed)
Bottlenecks result from overloads caused by:
High load sessions, or
Convergence of sufficient number of moderate load sessions at the same
queue
Copyright 2002 OPNET Technologies, Inc. 18
Traffic Behavior and Queuing in a QoS Environment
Bottlenecks Cause Shaping
The departure traffic from a bottleneck is more regular than the
arrival traffic
The inter-departure time between two packets is at least as
large as the transmission time of the 2nd packet
Copyright 2002 OPNET Technologies, Inc. 19
Traffic Behavior and Queuing in a QoS Environment
Bottlenecks Cause Shaping
Bottleneck
90% utilization
Outgoing traffic Incoming traffic
Exponential
inter-arrivals
gap
Copyright 2002 OPNET Technologies, Inc. 20
Traffic Behavior and Queuing in a QoS Environment
Bottleneck
90% utilization
Outgoing traffic Incoming traffic
Large
Medium
Small
Copyright 2002 OPNET Technologies, Inc. 21
Traffic Behavior and Queuing in a QoS Environment
Packet Trains
Inter-departure times for small packets
Copyright 2002 OPNET Technologies, Inc. 22
Traffic Behavior and Queuing in a QoS Environment
Variable packet sizes
Histogram of inter-departure times for small packets
sec
# of packets
Peaks smeared
Variable packet sizes
Constant packet sizes
Copyright 2002 OPNET Technologies, Inc. 23
Traffic Behavior and Queuing in a QoS Environment
Outline
Basic concepts
Source models
Poisson traffic
Batch arrivals
Example applications voice, video, file transfer
Service models (demo)
Single-queue systems
Priority/shared service systems
Networks of queues
Hybrid simulation (demo)
Copyright 2002 OPNET Technologies, Inc. 24
Traffic Behavior and Queuing in a QoS Environment
Poisson Process with Rate
Interarrival times are independent and
exponentially distributed
Models well the accumulated traffic of many
independent sources
The average interarrival time is 1/
(secs/packet), so is the arrival rate
(packets/sec)
Copyright 2002 OPNET Technologies, Inc. 25
Traffic Behavior and Queuing in a QoS Environment
Batch Arrivals
Some sources transmit in packet bursts
May be better modeled by a batch arrival process (e.g., bursts
of packets arriving according to a Poisson process)
The case for a batch model is weaker at queues after the first,
because of shaping
Copyright 2002 OPNET Technologies, Inc. 26
Traffic Behavior and Queuing in a QoS Environment
Markov Modulated Rate Process (MMRP)
Extension: Models with more than two states
Stay in each state an exponentially
distributed time,
Transmit according to different model
(e.g., Poisson, deterministic, etc) at each state
State 0 State 1
OFF ON
Copyright 2002 OPNET Technologies, Inc. 27
Traffic Behavior and Queuing in a QoS Environment
Source Types
Voice sources
Video sources
File transfers
Web traffic
Interactive traffic
Different application types have different QoS requirements,
e.g., delay, jitter, loss, throughput, etc.
Copyright 2002 OPNET Technologies, Inc. 28
Traffic Behavior and Queuing in a QoS Environment
Source Type Properties
Characteristics QoS
Requirements
Model
Voice * Alternating talk- spurts and silence
intervals.
* Talk-spurts produce
constant packet-rate
traffic
Delay < ~150 ms
Jitter < ~30 ms
Packet loss < ~1%
* Two-state (on-off) Markov
Modulated Rate Process (MMRP)
* Exponentially distributed time at
each state
Video * Highly bursty traffic (when encoded)
* Long range
dependencies
Delay < ~ 400 ms
Jitter < ~ 30 ms
Packet loss < ~1%
K-state (on-off) Markov Modulated
Rate Process (MMRP)
Interactive
FTP
telnet
web
* Poisson type
* Sometimes batch-
arrivals, or bursty,
or sometimes on-off
Zero or near-sero
packet loss
Delay may be
important
Poisson, Poisson with batch arrivals,
Two-state MMRP
Copyright 2002 OPNET Technologies, Inc. 29
Traffic Behavior and Queuing in a QoS Environment
Typical Voice Source Behavior
Copyright 2002 OPNET Technologies, Inc. 30
Traffic Behavior and Queuing in a QoS Environment
MPEG1 Video Source Model
Diagram Source: Mark W. Garrett and Walter Willinger, Analysis, Modeling, and Generation of Self-Similar VBR Video Traffic, BELLCORE, 1994
The MPEG1 MMRP model can be extremely bursty, and has
long range dependency behavior due to the deterministic
frame sequence
Copyright 2002 OPNET Technologies, Inc. 31
Traffic Behavior and Queuing in a QoS Environment
Outline
Basic concepts
Source models
Service models
Single vs. multiple-servers
FIFO, priority, and shared servers
Demo
Single-queue systems
Priority/shared service systems
Networks of queues
Hybrid simulation (demo)
Copyright 2002 OPNET Technologies, Inc. 32
Traffic Behavior and Queuing in a QoS Environment
Device Queuing Mechanisms
Common queue examples for IP routers
FIFO: First In First Out
PQ: Priority Queuing
WFQ: Weighted Fair Queuing
Combinations of the above
Service types from a queuing theory standpoint
Single server (one queue - one transmission line)
Multiple server (one queue - several transmission lines)
Priority server (several queues with hard priorities - one transmission
line)
Shared server (several queues with soft priorities - one transmission
line)
Copyright 2002 OPNET Technologies, Inc. 33
Traffic Behavior and Queuing in a QoS Environment
Single Server FIFO
Single transmission line serving packets on a FIFO (First-In-
First-Out) basis
Each packet must wait for all packets found in the system to
complete transmission, before starting transmission
Departure Time = Arrival Time + Workload Found in the System +
Transmission time
Packets arriving to a full buffer are dropped
Arrivals
Transmission Line
Copyright 2002 OPNET Technologies, Inc. 34
Traffic Behavior and Queuing in a QoS Environment
FIFO Queue
Packets are placed on outbound link to egress device in FIFO order
Device (router, switch) multiplexes different flows arriving on various ingress ports onto an output buffer forming a FIFO queue
Copyright 2002 OPNET Technologies, Inc. 35
Traffic Behavior and Queuing in a QoS Environment
Multiple Servers
Multiple packets are transmitted simultaneously on multiple
lines/servers
Head of the line service: packets wait in a FIFO queue, and
when a server becomes free, the first packet goes into service
Copyright 2002 OPNET Technologies, Inc. 36
Traffic Behavior and Queuing in a QoS Environment
Priority Servers
Packets form priority classes (each may have several flows)
There is a separate FIFO queue for each priority class
Packets of lower priority start transmission only if no higher
priority packet is waiting
Priority types:
Non-preemptive (high priority packet must wait for a lower priority
packet found under transmission upon arrival)
Preemptive (high priority packet does not have to wait )
Copyright 2002 OPNET Technologies, Inc. 37
Traffic Behavior and Queuing in a QoS Environment
Priority Queuing
Packets are classified into separate queues
E.g., based on source/destination IP address, source/destination TCP port, etc.
All packets in a higher priority queue are served before a lower priority
queue is served
Typically in routers, if a higher priority packet arrives while a lower priority
packet is being transmitted, it waits until the lower priority packet completes
Copyright 2002 OPNET Technologies, Inc. 38
Traffic Behavior and Queuing in a QoS Environment
Shared Servers
Again we have multiple classes/queues, but they are served
with a soft priority scheme
Round-robin
Weighted fair queuing
Copyright 2002 OPNET Technologies, Inc. 39
Traffic Behavior and Queuing in a QoS Environment
Round-Robin/Cyclic Service
Round-robin serves each queue in sequence
A queue that is empty is skipped
Each queue when served may have limited service (at most k packets
transmitted with k = 1 or k > 1)
Round-robin is fair for all queues (as long as some queues do
not have longer packets than others)
Round-robin cannot be used to enforce bandwidth allocation
among the queues.
Copyright 2002 OPNET Technologies, Inc. 40
Traffic Behavior and Queuing in a QoS Environment
Fair Queuing
This scheduling method is inspired by the most fair of methods:
Transmit one bit from each queue in cyclic order (bit-by-bit round robin)
Skip queues that are empty
To approximate the bit-by-bit processing behavior, for each packet
We calculate upon arrival its finish time under bit-by-bit round robin
assuming all other queues are continuously busy, and we transmit by FIFO
within each queue
Transmit next the packet with the minimum finish time
Important properties:
Priority is given to short packets
Equal bandwidth is allocated to all queues that are continuously busy
Copyright 2002 OPNET Technologies, Inc. 41
Traffic Behavior and Queuing in a QoS Environment
Weighted Fair Queuing
Fair queuing cannot be used to implement bandwidth allocation and soft priorities
Weighted fair queuing is a variation that corrects this deficiency
Let wk be the weight of the kth queue
Think of round-robin with queue k transmitting wk bits upon its turn
If all queues have always something to send, the kth queue receives bandwidth equal to a fraction wk / Si wi of the total bandwidth
Fair queuing corresponds to wk = 1
Priority queuing corresponds to the weights being very high as we move to
higher priorities
Again, to deal with the segmentation problem, we approximate as follows: For each packet:
We calculate its finish time (under the weighted bit-by-bit round robin scheme)
We next transmit the packet with the minimum finish time
Copyright 2002 OPNET Technologies, Inc. 42
Traffic Behavior and Queuing in a QoS Environment
Weighted Fair Queuing Illustration
Weights:
Queue 1 = 3
Queue 2 = 1
Queue 3 = 1
Copyright 2002 OPNET Technologies, Inc. 43
Traffic Behavior and Queuing in a QoS Environment
Combination of Several Queuing Schemes
Example voice (PQ), guaranteed b/w (WFQ), Best Effort
(Ciscos LLQ implementation)
Copyright 2002 OPNET Technologies, Inc. 44
Traffic Behavior and Queuing in a QoS Environment
Demo: FIFO
FIFO
Bottleneck
90% utilization
Copyright 2002 OPNET Technologies, Inc. 45
Traffic Behavior and Queuing in a QoS Environment
Demo: FIFO Queuing Delay
Applications have different
requirements
Video delay, jitter
FTP packet loss
Control beyond best effort
needed
Priority Queuing (PQ)
Weighted Fair Queuing (WFQ)
Copyright 2002 OPNET Technologies, Inc. 46
Traffic Behavior and Queuing in a QoS Environment
Demo: Priority Queuing (PQ)
PQ
Bottleneck
90% utilization
Copyright 2002 OPNET Technologies, Inc. 47
Traffic Behavior and Queuing in a QoS Environment
Demo: PQ Queuing Delays
FIFO
PQ Video
PQ FTP
Copyright 2002 OPNET Technologies, Inc. 48
Traffic Behavior and Queuing in a QoS Environment
Demo: Weighted Fair Queuing (WFQ)
WFQ
Bottleneck
90% utilization
Copyright 2002 OPNET Technologies, Inc. 49
Traffic Behavior and Queuing in a QoS Environment
Demo: WFQ Queuing Delays
FIFO
WFQ/PQ Video
PQ FTP
WFQ FTP
Copyright 2002 OPNET Technologies, Inc. 50
Traffic Behavior and Queuing in a QoS Environment
Queuing: Take Away Points
Choice of queuing mechanism can have a profound effect on performance
To achieve desired service differentiation, appropriate queuing mechanisms can be used
Complex queuing mechanisms may require simulation techniques to analyze behavior
Improper configuration (e.g., queuing mechanism selection or weights) may impact performance of low priority traffic
Copyright 2002 OPNET Technologies, Inc. 51
Traffic Behavior and Queuing in a QoS Environment
Outline
Basic concepts
Source models
Service models (demo)
Single-queue systems
M/M/1M/M/m/k
M/G/1G/G/1
Demo: Analytics vs. simulation
Priority/shared service systems
Networks of queues
Hybrid simulation (demo)
Copyright 2002 OPNET Technologies, Inc. 52
Traffic Behavior and Queuing in a QoS Environment
M/M/1 System
Nomenclature: M stands for Memoryless (a property of the
exponential distribution)
M/M/1 stands for Poisson arrival process (which is memoryless)
M/M/1 stands for exponentially distributed transmission times
Assumptions:
Arrival process is Poisson with rate packets/sec
Packet transmission times are exponentially distributed with mean 1/m
One server
Independent interarrival times and packet transmission times
Transmission time is proportional to packet length
Note 1/m is secs/packet so m is packets/sec (packet
transmission rate of the queue)
Utilization factor: r = /m (stable system if r 1)
Copyright 2002 OPNET Technologies, Inc. 53
Traffic Behavior and Queuing in a QoS Environment
Delay Calculation
Let
Q = Average time spent waiting in queue
T = Average packet delay (transmission plus queuing)
Note that T = 1/m + Q
Also by Littles law
N = T and Nq = Q
where
Nq = Average number waiting in queue
These quantities can be calculated with formulas derived by
Markov chain analysis (see references)
Copyright 2002 OPNET Technologies, Inc. 54
Traffic Behavior and Queuing in a QoS Environment
The analysis gives the steady-state probabilities of
number of packets in queue or transmission
P{n packets} = rn(1-r) where r = /m
From this we can get the averages:
N = r/(1 - r)
T = N/ = r/(1 - r) = 1/(m - )
M/M/1 Results
Copyright 2002 OPNET Technologies, Inc. 55
Traffic Behavior and Queuing in a QoS Environment
Example: How Delay Scales with Bandwidth
Occupancy and delay formulas
N = r/(1 - r) T = 1/(m - ) r = /m
Assume:
Traffic arrival rate is doubled
System transmission capacity m is doubled
Then:
Queue sizes stay at the same level (r stays the same)
Packet delay is cut in half (m and are doubled
A conclusion: In high speed networks
propagation delay increases in importance relative to delay
buffer size and packet loss may still be a problem
Copyright 2002 OPNET Technologies, Inc. 56
Traffic Behavior and Queuing in a QoS Environment
M/M/m, M/M/ System
Same as M/M/1, but it has m (or ) servers
In M/M/m, the packet at the head of the queue moves
to service when a server becomes free
Qualitative result
Delay increases to as r = /mm approaches 1
There are analytical formulas for the occupancy
probabilities and average delay of these systems
Copyright 2002 OPNET Technologies, Inc. 57
Traffic Behavior and Queuing in a QoS Environment
Finite Buffer Systems: M/M/m/k
The M/M/m/k system
Same as M/M/m, but there is buffer space for at most k
packets. Packets arriving at a full buffer are dropped
Formulas for average delay, steady-state occupancy
probabilities, and loss probability
The M/M/m/m system is used widely to size
telephone or circuit switching systems
Copyright 2002 OPNET Technologies, Inc. 58
Traffic Behavior and Queuing in a QoS Environment
Characteristics of M/M/. Systems
Advantage: Simple analytical formulas
Disadvantages:
The Poisson assumption may be violated
The exponential transmission time distribution is an
approximation at best
Interarrival and packet transmission times may be
dependent (particularly in the network core)
Head-of-the-line assumption precludes heterogeneous input
traffic with priorities (hard or soft)
Copyright 2002 OPNET Technologies, Inc. 59
Traffic Behavior and Queuing in a QoS Environment
M/G/1 System
Same as M/M/1 but the packet transmission time
distribution is general, with given mean 1/m and
variance s2
Utilization factor r = /m
Pollaczek-Kinchine formula for
Average time in queue = (s2 + 1/m2)/2(1- r)
Average delay = 1/m + (s2 + 1/m2)/2(1- r)
The formulas for the steady-state occupancy
probabilities are more complicated
Insight: As s2 increases, delay increases
Copyright 2002 OPNET Technologies, Inc. 60
Traffic Behavior and Queuing in a QoS Environment
G/G/1 System
Same as M/G/1 but now the packet interarrival time
distribution is also general, with mean and
variance 2
We still assume FIFO and independent interarrival
times and packet transmission times
Heavy traffic approximation:
Average time in queue ~ (s2 + 2)/2(1- r)
Becomes increasingly accurate as r
Copyright 2002 OPNET Technologies, Inc. 61
Traffic Behavior and Queuing in a QoS Environment
Demo: M/G/1
Packet inter-arrival times
exponential (0.02) sec
Capacity
1 Mbps
Packet size
1250 bytes
(10000 bits)
Packet size distribution:
exponential
constant
lognormal
What is the average delay and queue size ?
Copyright 2002 OPNET Technologies, Inc. 62
Traffic Behavior and Queuing in a QoS Environment
Demo: M/G/1 Analytical Results
Packet Size
Distribution Delay T (sec) Queue Size (packets)
Exponential
mean = 10000
variance = 1.0 *108
0.02
1.0
Constant
mean = 10000
variance = N/A
0.015
0.75
Lognormal
mean = 10000
variance = 9.0 *108
0.06
3.0
Copyright 2002 OPNET Technologies, Inc. 63
Traffic Behavior and Queuing in a QoS Environment
Demo: M/G/1 Simulation Results
Average Delay (sec) Average Queue Size (packets)
Copyright 2002 OPNET Technologies, Inc. 64
Traffic Behavior and Queuing in a QoS Environment
Demo: M/G/1 Limitations
Application traffic mix not memoryless
Video constant packet inter-arrivals
Http bursty traffic
Delay
P-K formula
Simulation
Copyright 2002 OPNET Technologies, Inc. 65
Traffic Behavior and Queuing in a QoS Environment
Outline
Basic concepts
Source models
Service models (demo)
Single-queue systems
Priority/shared service systems
Preemptive vs. non-preemptive
Cyclic, WFQ, PQ systems
Demo: Simulation results
Networks of queues
Hybrid simulation (demo)
Copyright 2002 OPNET Technologies, Inc. 66
Traffic Behavior and Queuing in a QoS Environment
Non-preemptive Priority Systems
We distinguish between different classes of traffic (flows)
Non-preemptive priority: packet under transmission is not
preempted by a packet of higher priority
P-K formula for delay generalizes
Copyright 2002 OPNET Technologies, Inc. 67
Traffic Behavior and Queuing in a QoS Environment
Cyclic Service Systems
Multiple flows, each with its own queue
Fair system: Each flow gets access to the transmission line in
turn
Several possible assumptions about how many packets each
flow can transmit when it gets access
Formulas for delay under M/G/1 type assumptions are
available
Copyright 2002 OPNET Technologies, Inc. 68
Traffic Behavior and Queuing in a QoS Environment
Weighted Fair Queuing
A combination of priority and cyclic service
No exact analytical formulas are available
Copyright 2002 OPNET Technologies, Inc. 69
Traffic Behavior and Queuing in a QoS Environment
Outline
Basic concepts
Source models
Service models (demo)
Single-queue systems
Priority/shared service systems
Networks of queues
Violation of M/M/. assumptions
Effects on delays and traffic shaping
Analytical approximations
Hybrid simulation (demo)
Copyright 2002 OPNET Technologies, Inc. 70
Traffic Behavior and Queuing in a QoS Environment
Two Queues in Series
First queue shapes the traffic into second queue
Arrival times and packet lengths are correlated
M/M/1 and M/G/1 formulas yield significant error for second
queue
Copyright 2002 OPNET Technologies, Inc. 71
Traffic Behavior and Queuing in a QoS Environment
Two bottlenecks in series
Bottleneck
Exponential
inter-arrivals
Bottleneck
No queuing
delay Delay
Copyright 2002 OPNET Technologies, Inc. 72
Traffic Behavior and Queuing in a QoS Environment
Approximations
Kleinrock independence approximation
Perform a delay calculation in each queue independently of other
queues
Add the results (including propagation delay)
Note: In the preceding example, the Kleinrock independence
approximation overestimates the queuing delay by 100%
Tends to be more accurate in networks with lots of traffic
mixing, e.g., nodes serving many relatively small flows from
several different locations
Copyright 2002 OPNET Technologies, Inc. 73
Traffic Behavior and Queuing in a QoS Environment
Outline
Basic concepts
Source models
Service models (demo)
Single-queue systems
Priority/shared service systems
Networks of queues
Hybrid simulation
Explicit vs. aggregated traffic
Conceptual Framework
Demo: PQ and WFQ with aggregated traffic
Copyright 2002 OPNET Technologies, Inc. 74
Traffic Behavior and Queuing in a QoS Environment
Basic Concepts of Hybrid Simulation
Aims to combine the best of analytical results and simulation
Achieve significant gain in simulation speed with little loss of
accuracy
Divides the traffic through a node into explicit and
background
Explicit traffic is simulated accurately
Background traffic is aggregated
The interaction of explicit and background is modeled either
analytically or through a fast simulation (or a combination)
Explicit
Background BackgroundBackgroundBackground
Copyright 2002 OPNET Technologies, Inc. 75
Traffic Behavior and Queuing in a QoS Environment
Explicit Traffic
Modeled in detail, including the effects of various protocols
Each packets arrival and departure times are recorded (together
with other data of interest, e.g., loss, etc.) along each link that it
traverses
Departure times at a link are the arrival times at the next link (plus
propagation delay)
Objective: At each link, given the arrival times (and the packet
lengths), determine the departure times
Copyright 2002 OPNET Technologies, Inc. 76
Traffic Behavior and Queuing in a QoS Environment
Aggregated Traffic
Simplified modeling
We dont keep track of individual packets, only workload counts
(number of packets or bytes)
We generate workload counts
by probabilistic/analytical modeling, or
by simplified simulation
Aggregated (or background) traffic is local (per link)
Shaping effects are complex to incorporate
Some dependences between explicit and background traffic
along a chain of links are complicated and are ignored
Copyright 2002 OPNET Technologies, Inc. 77
Traffic Behavior and Queuing in a QoS Environment
Hybrid Simulation (FIFO Links): Conceptual Framework
Given the arrival time ak of the kth explicit packet
Generate the workload wk found in queue by the kth packet
From ak and wk generate the departure time of the kth packet as
Departure Time dk = ak + wk + sk
where sk is the transmission time of the kth packet
Time
a K a K+1 w K w K+1
d K = a K + w K + s K
Explicit Explicit
Explicit Explicit Background Background
ARRIVAL TIMES
DEPARTURE TIMES
Copyright 2002 OPNET Technologies, Inc. 78
Traffic Behavior and Queuing in a QoS Environment
Simulating the Background Traffic Effects
Use a traffic descriptor for the background traffic (e.g., carried by special packets)
Traffic descriptor includes: Traffic volume information (e.g., packets/sec, bits/sec)
Probability distribution of interarrival times
Probability distribution of packet lengths
Time interval of validity of the descriptor
Generate wk using one of several ideas and combinations thereof
Successive sampling (for FIFO case)
Steady-state queue length distribution (if we can get it)
Simplified simulation (microsim - applies to complex queuing disciplines)
Copyright 2002 OPNET Technologies, Inc. 79
Traffic Behavior and Queuing in a QoS Environment
Hybrid Simulation (FIFO Case)
Critical Question: Given arrival times ak and ak+1, workload wk, and background
traffic descriptor, how do we find wk+1?
Note: wk+1 consists of wk and two more terms:
Background arrivals in interval ak+1 - ak
(Minus) transmitted workload in interval ak+1 - ak
Must calculate/simulate the two terms
The first term is simulated based on the traffic descriptor of the background traffic
The second term is easily calculated if the queue is continuously busy in ak+1 - ak
Time
a 1 a 2 a 3 . . .
. . .
Arrival times/Workload found
w 1 w 2 w 3
d 1 = a 1 + w 1 + s 1 d 2 = a 2 + w 2 + s 2 d 3 = a 3 + w 3 + s 3
Departure times
Copyright 2002 OPNET Technologies, Inc. 80
Traffic Behavior and Queuing in a QoS Environment
Short Interval Case (Easy Case)
Short interval ak+1 - ak (i.e., ak+1 < dk)
Queue is busy continuously in ak+1 - ak
So wk+1 is quickly simulated
Sample the background traffic arrival distribution to simulate the new
workload arrivals in ak+1 - ak
Do the accounting (add to wk and subtract the transmitted workload in
ak+1 - ak )
k d
a k
Time . . .
Short Interval
w k
w k+1 = w k + (New bkg arrivals) - (Old bkg transmissions)
d
a k+1 w k+1
k+1
Copyright 2002 OPNET Technologies, Inc. 81
Traffic Behavior and Queuing in a QoS Environment
Long Interval Case
Long interval ak+1 - ak (i.e., ak+1 > dk)
Queue may be idle during portions of the interval ak+1 - ak Need to generate/simulate
The new arrivals in ak+1 - ak The lengths of the busy periods and the idle periods
Can be done by sampling the background arrival distribution in each busy period
Other alternatives are possible
Time. . .
Long Interval
ak wkak+1 wk+1
dk
Idle PeriodsBusy Periods
dk+1
Copyright 2002 OPNET Technologies, Inc. 82
Traffic Behavior and Queuing in a QoS Environment
Steady-State Queue Length Distribution If the interval between two successive explicit packets is very
long, we can assume that the queue found by the second
packet is in steady state
So, we can obtain wk+1 by sampling the steady-state
distribution
Applies to cases where the steady-state distribution can be
found or can be reasonably approximated
M/M/1 and other M/M/. Queues
Some M/G/. systems
Copyright 2002 OPNET Technologies, Inc. 83
Traffic Behavior and Queuing in a QoS Environment
Micro Simulation: Conceptual Framework
Handles complex queuing systems
Micro-packets are generated to represent traffic load within the context
of the queue only (i.e., they are not transmitted to any external links)
For long intervals, where convergence to a steady-state is likely
Try to detect convergence during the microsim
Estimate steady-state queue length distribution
Sample the steady state distribution to estimate wk+1
Microsim speeds up the simulation without sacrificing
accuracy
Microsim provides a general framework
Applies to non-stationary background traffic
Applies to non-FIFO service models (with proper modification)
Copyright 2002 OPNET Technologies, Inc. 84
Traffic Behavior and Queuing in a QoS Environment
Examples of Applications
Analytical Modeling Discrete-Event Simulation
M/G/./. &
G/G/./.
FIFO
Analysis
M/G/./. &
G/G/./.
Priority
Analysis
Decomposition
with Kleinrock
Independence
Assumption
DES only with
Explicit Traffic
Hybrid DES
with Explicit
and
Background
Traffic Single Link with FIFO Service
Best Effort Service for Standard Data Traffic Yes N/A N/A Yes Yes
Best Effort Service for LRD/Self-Similar
Behavior TrafficYes N/A N/A Yes Yes
"Chancing It" with Best Effort Service for
Voice, Video and DataYes N/A N/A Yes Yes
Single Link with QoS-Based Queueing
Using QoS to differentiate service levels for
the same type of trafficN/A
Yes (loss of
accuracy) N/A Yes Yes
Using QoS to support different requirements
for different application types given as a
detailed study of setting Cisco Router
queueing parameters
N/AHighly
approximateN/A Yes Yes
Network of Queues
General network model extending the
previous QoS queueing modelN/A
Hop-by-hop
Analysis (loss
of accuacy)
Yes (some loss of
accuracy - e.g., traffic
shaping)
Yes (Run time a
function of network
complexity)
Yes [Fast with
minimal loss of
accuracy]
Reduction of the general model to a
representative end-to-end pathN/A
Hop-by-hop
Analysis (loss
of accuacy)
N/A
Yes (Run time a
function of network
complexity)
Yes [Fast with
minimal loss of
accuracy]
Analysis Scenarios
Copyright 2002 OPNET Technologies, Inc. 85
Traffic Behavior and Queuing in a QoS Environment
Demo End-to-end Delay: Baseline Network
Traffic modeled as
1) Explicit traffic
2) Background traffic
Copyright 2002 OPNET Technologies, Inc. 86
Traffic Behavior and Queuing in a QoS Environment
Target Flow: ETE delay as a function of ToS
Target flow: Seattle Houston - modeled using explicit traffic Varying its Type of Service (ToS)
Best Effort (0)
Streaming Multimedia (4)
Copyright 2002 OPNET Technologies, Inc. 87
Traffic Behavior and Queuing in a QoS Environment
Explicit Simulation Results for Target Flow
Total traffic volume
500 Mbps
Time modeled
35 minutes
Simulation duration
31 hours
Copyright 2002 OPNET Technologies, Inc. 88
Traffic Behavior and Queuing in a QoS Environment
Hybrid Simulation Results for Target Flow
Total traffic volume
500 Mbps
Time modeled
35 minutes
Simulation duration
14 minutes
Copyright 2002 OPNET Technologies, Inc. 89
Traffic Behavior and Queuing in a QoS Environment
Comparison: Hybrid vs Explicit Simulation
Copyright 2002 OPNET Technologies, Inc. 90
Traffic Behavior and Queuing in a QoS Environment
References
Networking
Bertsekas and Gallager, Data Networks, Prentice-Hall, 1992
Device Queuing Implementations
Vegesna, IP Quality of Service, Ciscopress.com, 2001
http://www.juniper.net/techcenter/techpapers/200020.pdf
Probability and Queuing Models
Bertsekas and Tsitsiklis, Introduction to Probability, Athena Scientific, 2002, http://www.athenasc.com/probbook.html
Cohen, The Single Server Queue, North-Holland, 1992
Takagi, Queuing Analysis: A Foundation of Performance Evaluation. (3 Volumes), North-Holland, 1991
Gross and Harris, Fundamentals of Queuing Theory, Wiley, 1985
Cooper, Introduction to Queuing Theory, CEEPress, 1981
OPNET Hybrid Simulation and Micro Simulation
See Case Studies papers in http://secure.opnet.com/services/muc/mtdlogis_cse_stdies_81.html