85
Applied Algorithm Design Lecture 4 Pietro Michiardi Institut Eurécom Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 1 / 85

Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

  • Upload
    others

  • View
    7

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Applied Algorithm DesignLecture 4

Pietro Michiardi

Institut Eurécom

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 1 / 85

Page 2: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Part 1: Network Flow - The fundamentals

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 2 / 85

Page 3: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Introduction (1)

In this Lecture we focus on a rich set of algorithmic problems that growout of the first problems we formulated in Lecture 1: BipartiteMatching.

Reminder: Bipartite GraphG = (V ,E) is an undirected graph whose node set can be partitionedas V = X ∪ Y , with the property that every edge e ∈ E has one end inX and the other end in Y .

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 3 / 85

Page 4: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Introduction (1)

Reminder: MatchingCollection of pairs over a set, with the property that no element of theset appears in more than one pair.

In a graph, the edges constitute pairs of nodes and we say that amatching in a graph G = (V ,E) is a set of edges M ⊆ E with theproperty that each node appears in at most one edge of M. M is aperfect matching if every node appears in exactly one edge of M.

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 4 / 85

Page 5: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Introduction (3)

Question: give a couple of applications of Matching in Bipartite Graphs

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85

Page 6: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Introduction (4)

One of the oldest problems in combinatorial algorithms is that ofdetermining the size of the largest matching in a bipartite graph G.This problem turns out to be solvable by an algorithm that runs inpolynomial time, but the development of this algorithm needsideas very different from the techniques we’ve seen so far.Instead of developing the algorithm directly, we begin byformulating a very general class of problems: Network Flowproblems, that include Bipartite Matching as a special caseWe develop a polynomial-time algorithm for the general problemof Maximum-Flow Problem

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 6 / 85

Page 7: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Flow Networks (1)

One often use graphs to model Transportation networks, that isnetworks whose edges carry some sort of traffic and whose nodes actas “switches” passing traffic between different edges.

Network models of this type have several ingredients:capacities on the edges, indicating how much traffic they can carrysource nodes in the graph, which generate trafficsink nodes in the graph, which can “absorb” traffic as it arrivesthe traffic itself which is transmitted over the edges of the graph

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 7 / 85

Page 8: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Flow Networks (2)

We will refer to the traffic on these networks as flow, an abstract entitythat is generated at source nodes, transmitted across edges, andabsorbed at sink nodes.

Flow networksA flow network is a directed graph G = (V ,E) with the following fea-tures:

Associated with each edge e is a capacity, which is anon-negative number we denote ce

There is a single source node s ∈ VThere is a single sink node t ∈ V

Nodes other than the source and the sink are called internal nodes.

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 8 / 85

Page 9: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Flow Networks: assumptionsWe now enumerate the assumptions we’ll make to simplify theanalysis:

1 no edge enters the source s2 no edge leaves the sink t3 there is at least one edge incident to each node4 all capacities are integers

And here’s an example of a flow network:

s

2

3

4

5

6

7

t

15

5

30

15

10

8

15

9

6 10

10

10 15 4

4

capacity

source sink

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 9 / 85

Page 10: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Defining Flows (1)

Definition: FlowsWe say that an s-t flow is a function f that maps each edge e to a nonnegative real number, f : E → <+

The value f (e) intuitively represents the amount of flow carried by edgee. A flow must satisfy the following two properties:

Flow: PropertiesCapacity conditions: ∀e ∈ E , 0 ≤ f (e) ≤ ce

Conservation conditions: ∀v ∈ V\{s, t}∑e into v

f (e) =∑

e out of v

f (e)

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 10 / 85

Page 11: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Defining Flows (2)

In words, we have:The flow on an edge f (e) cannot exceed the capacity of the edgeFor every node other than the source and the sink, the amount offlow entering must equal the amount of flow leavingThe source generates flowThe sink consumes flow

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 11 / 85

Page 12: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Defining Flows (2)

Definition: The value of a flowThe value of flow f , denoted v(f ) is defined to be the amount of flowgenerated at the source:

v(f ) =∑

e out of s

f (e)

f out(v) =∑

e out of v

f (e) ; f in(v) =∑

e into v

f (e)

Let S ⊆ V :

f out(S) =∑

e out of S

f (e) ; f in(S) =∑

e into S

f (e)

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 12 / 85

Page 13: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Defining Flows: examples (1)

4

0

0

0

0 0

0 4 4

0

0

0

Value = 40

capacity

flow

s

2

3

4

5

6

7

t

15

5

30

15

10

8

15

9

6 10

10

10 15 4

4 0

4

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 13 / 85

Page 14: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Defining Flows: examples (2)

10

6

6

11

1 10

3 8 8

0

0

0

11

capacity

flow

s

2

3

4

5

6

7

t

15

5

30

15

10

8

15

9

6 10

10

10 15 4

4 0

Value = 24

4

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 14 / 85

Page 15: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

The Max-Flow Problem

Given a flow network, a natural goal is to arrange the traffic so as tomake as efficient use as possible of the available capacity. Thus, thebasic algorithmic problem we will consider is the following:

Definition: Max-Flow ProblemGiven a flow network, find a flow of maximum possible value

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 15 / 85

Page 16: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Cuts in graphs (1)

We will now introduce a useful construct that is somehow relatedto the problems we are addressingGiven a graph G = (V ,E), we will find a way to partition its vertexsetRemember we have seen already an example of a cut: bipartitegraphs!

We will seek at finding the duality that exists between “cuts and flows”and exploit it to design an efficient algorithm for the max-flow problem.As a bonus we will obtain an algorithm for the dual problem of findingminimum capacity cuts.

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 16 / 85

Page 17: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Cuts in graphs (2)

Definition: s − t cutGiven a directed graph G(V ,E) an s − t cut is a partition (A,B) of Vwith s ∈ A and t ∈ B

Definition: Capacity of a cut

The capacity of a cut (A,B) is:

cap(A,B) =∑

e out of A

c(e)

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 17 / 85

Page 18: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Cuts in graphs: example 1

s

2

3

4

5

6

7

t

15

5

30

15

10

8

15

9

6 10

10

10 15 4

4

Capacity = 10 + 5 + 15 = 30

A

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 18 / 85

Page 19: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Cuts in graphs: example 2

s

2

3

4

5

6

7

t

15

5

30

15

10

8

15

9

6 10

10

10 15 4

4 A

Capacity = 9 + 15 + 8 + 30 = 62

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 19 / 85

Page 20: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

The Min-Cut Problem

Definition: the Min-Cut ProblemThe min-cut problem is to find an s − t cut of minimum capacity.

s

2

3

4

5

6

7

t

15

5

30

15

10

8

15

9

6 10

10

10 15 4

4 A

Capacity = 10 + 8 + 10 = 28

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 20 / 85

Page 21: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Flows and cuts (1)

Lemma:Let f be any flow, and let (A,B) be any s − t cut.Then, the net flow sent across the cut is equal to the amount leaving s.

Consider dividing the nodes of the graph G = (V ,E) in two sets A andB so that s ∈ A and t ∈ B. Any such division places an upper bound onthe maximum possible flow value, since all the flow must cross from Ato B somewhere.

Cuts turn out to provide very natural upper bounds on the values offlows, as expressed in the Lemma above. The Lemma is muchstronger than a simple upper bound actually. It says that by watchingthe amount of flow f that goes across a cut, we can exactly measurethe flow value: it is the total amount that leaves A minus the amountthat “swirls” back into A.

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 21 / 85

Page 22: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Flows and cuts: example 1

10

6

6

11

1 10

3 8 8

0

0

0

11

s

2

3

4

5

6

7

t

15

5

30

15

10

8

15

9

6 10

10

10 15 4

4 0

Value = 24

4

A

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 22 / 85

Page 23: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Flows and cuts: example 2

12

10

6

6

1 10

3 8 8

0

0

0

11

s

2

3

4

5

6

7

t

15

5

30

15

10

8

15

9

6 10

10

10 15 4

4 0

Value = 6 + 0 + 8 - 1 + 11

= 24

4

11

A

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 23 / 85

Page 24: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Flows and cuts: example 2

13

10

6

6

11

1 10

3 8 8

0

0

0

11

s

2

3

4

5

6

7

t

15

5

30

15

10

8

15

9

6 10

10

10 15 4

4 0

Value = 10 - 4 + 8 - 0 + 10

= 24

4

A

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 24 / 85

Page 25: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Flows and cuts (2)

Lemma:Let f be any flow, and let (A,B) be any s − t cut.Then, the net flow sent across the cut is equal to the amount leaving s.

v(f ) =∑

e out of A

f (e)−∑

e into A

f (e)

Proof.

v(f ) =∑

e out of s f (e)=

∑v∈A(

∑e out of v f (e)−

∑e into v f (e))

=∑

e out of A f (e)−∑

e into A f (e)

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 25 / 85

Page 26: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Flows and cuts: weak duality (1)Weak duality:

Let f be any flow and let (A,B) be any s − t cut. Then the value of theflow is at most the capacity of the cut.

Cut capacity = 30 ! Flow value " 30

s

2

3

4

5

6

7

t

15

5

30

15

10

8

15

9

6 10

10

10 15 4

4

Capacity = 30

A

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 26 / 85

Page 27: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Flows and cuts: weak duality (1)

Weak duality:Let f be any flow. Then for any s − t cut we have:

v(f ) ≤ cap(A,B)

!

v( f ) = f (e)e out of A

! " f (e)e in to A

!

# f (e)e out of A

!

# c(e)e out of A

!

= cap(A,B)

s

t

A B

7

6

8

4

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 27 / 85

Page 28: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Certificate of optimality

Corollary:

Let f be any flow, and let (A,B) be any cut.If v(f ) = cap(A,B) then f is a max flow and (A,B) is a min cut.

Value of flow = 28Cut capacity = 28 ! Flow value " 28

10

9

9

14

4 10

4 8 9

1

0 0

0

14

s

2

3

4

5

6

7

t

15

5

30

15

10

8

15

9

6 10

10

10 15 4

4 0A

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 28 / 85

Page 29: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Towards a Max-Flow Algorithm

The Max-Flow problem turns out to be difficult to address with mostlyof previous techniques we’ve seen in Lecture 3. Let’s try with a simple,greedy approach.

Start with f (e) = 0 for all edge e ∈ EFind an s − t path P where each edge has f (e) < c(e)

“Augment” flow along path PRepeat until you get stuck

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 29 / 85

Page 30: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Towards a Max-Flow Algorithm: example (1)

s

1

2

t

10

10

0 0

0 0

0

20

20

30

Flow value = 0

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 30 / 85

Page 31: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Towards a Max-Flow Algorithm: example (2)

s

1

2

t

20

Flow value = 20

10

10 20

30

0 0

0 0

0

X

X

X

20

20

20

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 31 / 85

Page 32: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Towards a Max-Flow Algorithm: example (3)

greedy = 20

s

1

2

t

20 10

10 20

30

20 0

0

20

20

opt = 30

s

1

2

t

20 10

10 20

30

20 10

10

10

20

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 32 / 85

Page 33: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Towards a Max-Flow Algorithm: Observations

What does it mean to augment the Flow, precisely?How can we make the algorithm outlined above more concrete?What is the difference between the optimal solution and thegreedy?

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 33 / 85

Page 34: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Towards a Max-Flow Algorithm: Discussion (1)

Let’s analyze informally what we’ve done so far.We started with zero flow: this clearly respects the capacity andconservation conditionsWe then try to increase the value of f by “pushing” flow along apath from s to t up to the limits imposed by edge capacitiesWe select (for example) the path < s,1,2, t > and increase theflow on each edge to 20, and leave f (e) = 0 on the other twoedges

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 34 / 85

Page 35: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Towards a Max-Flow Algorithm: Discussion (2)

s

1

2

t

20

Flow value = 20

10

10 20

30

0 0

0 0

0

X

X

X

20

20

20

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 35 / 85

Page 36: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Towards a Max-Flow Algorithm: Discussion (3)

In this way we still respect the capacity and conservationconditionsThe problem is that we are now stuck: there is no s − t path onwhich we can directly push flow without exceeding some capacityand yet we do not have a maximum flow

We need a more general way of pushing flow from s to t so that in asituation like this we have a way to increase the value of the currentflow.

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 36 / 85

Page 37: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Towards a Max-Flow Algorithm: Discussion (4)

Intuition: towards Residual GraphsEssentially, we’d like to:

Push 10 units of flow along < s,2 >→ now there is too much flowcoming into 2We “undo” 10 units of flow on < 1,2 >→ this restoresconservation condition at 2, but results in too little flow leaving 1we push 10 units of flow along < 1, t >→ we now have a validflow, of maximum value

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 37 / 85

Page 38: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Towards a Max-Flow Algorithm: Discussion (5)

greedy = 20

s

1

2

t

20 10

10 20

30

20 0

0

20

20

opt = 30

s

1

2

t

20 10

10 20

30

20 10

10

10

20

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 38 / 85

Page 39: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Residual Graph (1)

So we’ve described a more general way of pushing flow: we can pushforward on edges that have leftover capacity, and we can pushbackward on edges that are already carrying flow.

Definition: Residual Graph

Given a flow network G = (V ,E), and a flow f on G, we define theresidual graph Gf of G with respect to f as follows

The node set of Gf is the same as that of G

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 39 / 85

Page 40: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Residual Graph (2)

Definition: Residual Graph

For each edge e = (u, v) ∈ G on which f (e) < ce there arece − f (e) residual units of capacity on which we could try pushingforward.→ we include the edge e = (u, v) in Gf with a capacity of ce − f (e)and call this a forward edge

For each edge e = (u, v) ∈ G on which f (e) > 0, there are f (e)units of flow that we can undo if we want to, by pushing backward.→ we include the edge e′ = (v ,u) in Gf , with a capacity of f (e)and call this a backward edge

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 40 / 85

Page 41: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Residual Graph: example

Original Edge:e = (u, v) ∈ E .

I Flow f (e), capacityc(e)

Residual Edge:I Undo flow sentI e = (u, v) and

eR = (u, v)I Residual capacity:

cf (e) =

{c(e)− f (e) if e ∈ Ef (e) if eR ∈ E

u v 17

6

capacity

u v 11

residual capacity

6

residual capacity

flow

Residual Graph: Gf = (V ,Ef )I Residual edges with positive residual capacityI Ef = {e : f (e) < c(e)} ∪ {eR : f (e) > 0}

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 41 / 85

Page 42: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Augmenting paths in Residual Graphs (1)

We now want to make precise the way we push flow from s to t in Gf .Let P be a simple s − t path in Gf , that is a path that does not visitany node more than once

Definition: bottleneckWe define Bottleneck(P,f ) to be the minimum residual capacity ofany edge on P, with respect to the flow f

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 42 / 85

Page 43: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Augmenting paths in Residual Graphs (2)

Algorithm 1: augment(P,f )Let b = Bottleneck(P,f )foreach e = (u, v) ∈ P do

if e = (u, v) is a forward edge thenincrease f (e) ∈ G by b

elsee = (u, v) is a backward edgee = (v ,u)decrease f (e) ∈ G by b

endend

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 43 / 85

Page 44: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

The Ford-Fulkerson Algorithm

Algorithm 2: FF(G, s, t , c)foreach e ∈ E do

f (e)← 0endGf ← residual graphwhile (there exists augmenting path P in Gf ) do

Let P be a simple s − t path in Gff ′ ← Augment(P,f )f ← f ′

update Gf to Gf ′

endreturn f

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 44 / 85

Page 45: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

The Ford-Fulkerson Algorithm: Demo

Believe it or not! A demo!!

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 45 / 85

Page 46: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Max-Flows and Min-Cuts (1)

Let f̄ denote the flow that is returned by the Ford-Fulerkson algorithm.We want to show that f̄ has the maximum possible value of any flow inG and we do this as follows:

we exhibit an s − t cut (A∗,B∗) for which v(f̂ ) = c(A∗,B∗)this immediately establishes that f̂ has the maximum value of anyflowit also tells us that (A∗,B∗) has the minimum capacity of any s − tcut

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 46 / 85

Page 47: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Max-Flows and Min-Cuts(2)

The Ford-Fulerkson algorithm terminates when the flow f has no s − tpath left in the residual graph Gf . This turns out to be the only propertyneeded for proving its optimality.

Theorem: augmenting path theorem

If f is an s − t flow such that there is no s − t path in the residual graphGf , then there is an s − t cut (A∗,B∗) in G for which v(f̂ ) = c(A∗,B∗).Consequently, f has the maximum value of any flow in G and (A∗,B∗)has the minimum capacity of any s − t cut in G.

Theorem: Max-Flow Min-Cut theoremThe value of the max flow is equal to the value of the min cut.

We sketch the proofs of these theorems next.

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 47 / 85

Page 48: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Max-Flows and Min-Cuts(3)

We prove both theorems simultaneously showing that the following areequivalent:

1 There exists a cut (A,B) such that v(f ) = c(A,B)

2 Flow f is a max flow3 There is no augmenting path relative to f

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 48 / 85

Page 49: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Max-Flows and Min-Cuts(4)

Proof.1⇒ 2: This was the corollary to weak duality lemma2⇒ 3: We show contra-positive. Let f be a flow. If there exists anaugmenting path, then we can improve f by sending flow alongthat path3⇒ 1:

I Let f be a flow with no augmenting pathsI Let A be set of vertexes reachable from s in residual graphI By definition of A, s ∈ AI By definition of f , t /∈ A

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 49 / 85

Page 50: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Running Time of the Ford-Fulkerson algorithm

Assumption: all capacities are integers ∈ [1,C]

Invariant: Every flow value f (e) and every residual capacitiescf (e) remains an integer throughout the algorithm

Theorem:The F-F algorithm terminates in at most v(f ∗) ≤ nC iterations

Proof.Each augmentation increases value of the flow by at least 1

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 50 / 85

Page 51: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Running Time of the Ford-Fulkerson algorithm

Corollary:

If C = 1, the F-F algorithm runs in O(mn) time

Integrity Theorem:

If all capacities are integers, then there exists a max flow f for whichevery flow value f (e) is an integer

Proof.Since algorithm terminates, theorem follows from invariant.

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 51 / 85

Page 52: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Choosing good augmenting paths (1)

The execution of the F-F algorithm can end up in an exponentialnumber of augmentations!

Question: is the generic F-F algorithm polynomial in input size?Answer: No. If max capacity is C, the the algorithm can take Citerations.

s

1

2

t

C

C

0 0

0 0

0

C

C

1 s

1

2

t

C

C

1

0 0

0 0

0X 1

C

C

X

X

X

1

1

1

X

X

1

1X

X

X

1

0

1

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 52 / 85

Page 53: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Choosing good augmenting paths (2)

Use care when selecting augmenting paths.

Some choices lead to exponential algorithmsClever choices lead to polynomial algorithmsIf capacities are irrational, algorithm not guaranteed to terminate

Goal: choose augmenting paths so that:

You can find augmenting paths efficientlyThere are few iterations

Chose augmenting paths with: [Edmonds-Karp 1972]

Max bottleneck capacitySufficiently large bottleneck capacityFewest number of edges

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 53 / 85

Page 54: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Capacity scaling (1)

The intuition here is that choosing paths with highest bottleneckcapacity increases flow by max possible amount.

Don’t worry about finding exact highest bottleneck pathMaintain a scaling parameter ∆

Let Gf (∆) be the sub-graph of the residual graph consisting ofonly arcs with capacity at least ∆

110

s

4

2

t 1

170

102

122

Gf

110

s

4

2

t

170

102

122

Gf (100)

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 54 / 85

Page 55: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Capacity scaling (2)

Algorithm 3: Scaling-Max-Flow(G, s, t , c)foreach e ∈ E do

f (e)← 0end∆← smallest power of 2 ≥ CGf ← residual graphwhile (∆ ≥ 1) do

Gf (∆)← ∆−residual graphwhile (∃ augmenting path P ∈ Gf (∆)) do

f ← augment(f , c,P)update Gf (∆)

end∆← ∆/2

endreturn f

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 55 / 85

Page 56: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Capacity scaling: correctness

Assumption: all edge capacities are integers ∈ [1,C]

Integrity invariant: all flow and residual capacity values areinteger

Theorem: CorrectnessIf the algorithm terminates, then f is a max flow

Proof.By integrality invariant, when ∆ = 1⇒ Gf (∆) = Gf

Upon termination of ∆ = 1 phase, there are no augmenting paths

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 56 / 85

Page 57: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Capacity scaling: running time

Lemma 1:The outer while loop repeats 1 + dlog2Ce times

Proof.Initially C ≤ ∆ < 2C. ∆ decreases by a factor of 2 at each iteration

Lemma 2:Let f be the flow at the end of a ∆-scaling phase. Then the value of themaximum flow is at most v(f ) + m∆

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 57 / 85

Page 58: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Capacity scaling: running time

Lemma 3:There are at most 2m augmentations per scaling phase.

Let f be the flow at the end of the previous scaling phaseLemma 2⇒ v(f ∗) ≤ v(f ) + m(2∆)

Each augmentation in a ∆-phase increases v(f ) by at least ∆

Theorem:

The scaling max-flow algorithm finds a max flow in O(m2logC) augmen-tations. It can be implemented to run in O(m2logC) time.

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 58 / 85

Page 59: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Part 2: Network Flow - Applications

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 59 / 85

Page 60: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Matching

Definition: MatchingInput: undirected graph G = (V ,E)

M ⊆ E is a matching if each node appears in at most one edge inMMax Matching: find a max cardinality matching

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 60 / 85

Page 61: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Bipartite Matching (1)

Definition: Bipartite MatchingInput: undirected, bipartite graph G = (V ,E)

M ⊆ E is a matching if each node appears in at most one edge inMMax Matching: find a max cardinality matching

4

1

3

5

1'

3'

5'

2

4

2'

4'

matching

1-2', 3-1', 4-5'

RL

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 61 / 85

Page 62: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Bipartite Matching (2)

Definition: Bipartite MatchingInput: undirected, bipartite graph G = (V ,E)

M ⊆ E is a matching if each node appears in at most one edge inMMax Matching: find a max cardinality matching

1

3

5

1'

3'

5'

2

4

2'

4'

RL

max matching

1-1', 2-2', 3-3' 4-4'

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 62 / 85

Page 63: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Bipartite Matching: Max-Flow Formulation

Create a digraph G′ = (L ∪ R ∪ {s, t},E ′)Direct all edges from L to R and assign unit capacityAdd source s, and unit capacity edges from s to each node in LAdd sink t , and unit capacity edges from each node in R to t

s

1

3

5

1'

3'

5'

t

2

4

2'

4'

1 1

!

RL

G' 1

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 63 / 85

Page 64: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Bipartite Matching: Proof of correctness (1)

Theorem:Max cardinality matching in G is equal to the value of max flow in G′

Proof.We now prove ≤

Given max matching M of cardinality kConsider flow f that sends 1 unit along each of k pathsf is a flow, and has cardinality k

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 64 / 85

Page 65: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Bipartite Matching: Proof of correctness (2)

s

1

3

5

1'

3'

5'

t

2

4

2'

4'

1 1

!1

3

5

1'

3'

5'

2

4

2'

4'

G'G

1

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 65 / 85

Page 66: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Bipartite Matching: Proof of correctness (3)

Theorem:Max cardinality matching in G is equal to the value of max flow in G′

Proof.We now prove ≥

Let f be a max flow in G′ of value kIntegrality theorem⇒ k is integral hence we can assume f takes0− 1 valueConsider M = set of edges from L to R with f (e) = 1

I Each node in L and R participates in at most one edge in MI |M| = k : consider cut (L ∪ s,R ∪ t)

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 66 / 85

Page 67: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Bipartite Matching: Proof of correctness (4)

1

3

5

1'

3'

5'

2

4

2'

4'

G

s

1

3

5

1'

3'

5'

t

2

4

2'

4'

1 1

!

G'

1

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 67 / 85

Page 68: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Perfect Matching

Definition:A matching M ⊆ E is perfect if each node appears in exactly one edgein M

Question: When does a bipartite graph have a perfect matching?

Structure of bipartite graphs with perfect matching:We must have |L| = |R|What other conditions are necessary?What conditions are sufficient?

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 68 / 85

Page 69: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Perfect Matching (1)

Notation:Let S be a subset of nodes, and let N(S) be the set of nodes adjacentto node in S

Observation:If a bipartite graph G = (L ∪ R,E) has a perfect matching then|N(S)| ≥ |S| for all subsets S ⊆ L

Proof.Each node in S has to be matched to different node in N(S)

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 69 / 85

Page 70: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Perfect Matching (2)

No perfect matching:

S = { 2, 4, 5 }

N(S) = { 2', 5' }.

1

3

5

1'

3'

5'

2

4

2'

4'

L R

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 70 / 85

Page 71: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Bipartite Matching: running time

Question: remember what was the running time of the Gale-Shapleyalgorithm we saw in Lecture 1?

Which max flow algorithm to use for bipartite matching?Generic augmenting path: O(m v(f ∗)) = O(mn)

Capacity scaling: O(m2logC) = O(m2)

Shortest augmenting patha: O(m√

n)

aNot seen here.

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 71 / 85

Page 72: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Non-Bipartite Matching

Non-bipartite matching:Structure of non-bipartite graphs is more complicated, but wellunderstood: see [Tutte-Berge, Edmonds-Galai]Blossom algorithm: O(n4) [Edmonds 1965]Best known: O(m

√n) [Micali-Vazirani 1980]

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 72 / 85

Page 73: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Disjoint Paths: introduction

In the first part, we described a flow f as a kind of “traffic” in thenetwork. However, the actual definition we used has a static twist: foreach edge e, we simply specify a number f (e) saying the amount offlow crossing e.

Let’s see if we can revive the more dynamic, traffic-oriented picture abit and try formalizing the sense in which units of flow “travel” from thesource to the sink.

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 73 / 85

Page 74: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Edge Disjoint Paths: the Problem

Disjoint Path Problem:Given a digraph G = (V ,E) and two nodes s and t , find the maximumnumber of edge-disjoint s − t paths.

Definition:Two paths are edge-disjoint if they have no edge in common.

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 74 / 85

Page 75: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Edge Disjoint Paths: example (1)

s

2

3

4

5

6

7

t

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 75 / 85

Page 76: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Edge Disjoint Paths: example (2)

s

2

3

4

5

6

7

t

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 76 / 85

Page 77: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Edge Disjoint Paths: Max-Flow formulation (1)

Simply assign unit capacity to every edge!

Theorem:The maximum number of edge-disjoint s − t paths equals the max flowvalue.

Proof.We prove here ≤

Suppose there are k edge-disjoint paths P1, ...,Pk

Let f (e) = 1 if e participates in some path Pi : else set f (e) = 0Since path are edge-disjoint, f is a flow of value k

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 77 / 85

Page 78: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Edge Disjoint Paths: Max-Flow formulation (2)

Theorem:The maximum number of edge-disjoint s − t paths equals the max flowvalue.

Proof.We prove here ≥

Suppose max flow value is kIntegrality theorem⇒ there exists 0− 1 flow of value kConsider edge (s,u) with f (s,u) = 1

I by conservation, there exists an edge (u, v) with f (u, v) = 1I continue until you reach t , always choosing a new edge

Produces k (not necessarily simplea) edge-disjoint paths

acan eliminate cycles to get simple paths if desired

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 78 / 85

Page 79: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Network connectivity

The problem:Given a digraph G = (V ,E) and two nodes s and t , find minimumnumber of edges whose removal disconnects t from s.

Definition:A set of edges F ⊆ E disconnects t from s if all s − t paths use at leastone edge in F

Question1: why is this interesting? What are the applications of thisproblem?

1This is a typical exam question!!Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 79 / 85

Page 80: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Network connectivity: example (1)

s

2

3

4

5

6

7

t

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 80 / 85

Page 81: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Network connectivity: example (2)

s

2

3

4

5

6

7

t s

2

3

4

5

6

7

t

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 81 / 85

Page 82: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Edge-disjoint paths and Network connectivity (1)

Theorem: [Menger 1972]

The max number of edge-disjoint s − t paths is equal to the minimumnumber of edges whose removal disconnects t from s

Proof.We start by proving ≤

Suppose the removal of F ⊆ E disconnects t from s, and |F | = kAll s − t paths use at least one edge of F . Hence, the number ofedge-disjoint paths is at most k

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 82 / 85

Page 83: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Edge-disjoint paths and Network connectivity (2)

Theorem: [Menger 1972]

The max number of edge-disjoint s − t paths is equal to the minimumnumber of edges whose removal disconnects t from s

Proof.We start by proving ≥

Suppose max number of edge-disjoint paths is kThen max flow value is kMax-flow min-cut⇒ cut (A,B) has capacity kLet F be the set of edges going from A to B|F | = k and disconnects t from s

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 83 / 85

Page 84: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Edge-disjoint paths and Network connectivity (2)

2

s

2

3

4

5

6

7

t s

2

3

4

5

6

7

t

A

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 84 / 85

Page 85: Applied Algorithm Design Lecture 4michiard/teaching/slides/algodesign/lecture-4.pdf · Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 5 / 85. Introduction (4) One of the

Homework

Flow Networks, Max-Flow / Min-Cut problems are fundamental intoday’s applications!

Your task is simple: read the following research paper:

Research paper:Randomized decentralized broadcasting algorithmsLaurent Massoulie, Andy Twigg,Christos Gkantsidis, and Pablo RodriguezIEEE INFOCOM 2007

Why? Exam questions could be on this paper; gives a hint to whatwe’ll see in our last lecture.

Pietro Michiardi (EUR) Applied Algorithm Design Lecture 4 85 / 85