Paths in a Graph : A Brief Tutorial Krishna.V.Palem Kenneth and Audrey Kennedy Professor of...

Paths in a Graph : A Brief Tutorial

Krishna.V.PalemKenneth and Audrey Kennedy Professor of ComputingDepartment of Computer Science, Rice University

IntroductionMany problems can be modeled using graphs

with weights assigned to their edges:Airline flight timesTelephone communication costsComputer networks response times

Tokyo Subway

Weighted Graphs In a weighted graph, each edge has an associated

numerical value, called the weight of the edge Edge weights may represent, distances, costs, etc. Example:

In a flight route graph, the weight of an edge represents the distance in miles between the endpoint airports

ORDPVD

MIADFW

13871743

10991120

Shortest Path Problem Given a weighted graph and two vertices u and v, we want

to find a path of minimum total weight between u and v.Length of a path is the sum of the weights of its edges.

Example:Shortest path between Providence and Honolulu

Applications Internet packet routing Flight reservationsDriving directions

ORDPVD

MIADFW

13871743

10991120

1233337

Dijkstra’s Algorithm to compute the Shortest Path G is a simple connected graph.

A simple graph G = (V, E) consists of V, a nonempty set of vertices, and E, a set of unordered pairs of distinct elements of V called edges.

Each edge has an associated weight It is a greedy algorithm

A greedy algorithm is any algorithm that follows the problem solving metaheuristic of making the locally optimal choice at each stage with the hope of finding the global optimum.

Dijkstra’s Algorithm

The distance of a vertex v from a vertex s is the length of a shortest path between s and v

Dijkstra’s algorithm computes the distances of all the vertices from a given start vertex s

Assumptions: the graph is connected the edges are

undirected the edge weights are

nonnegative

We grow a “cloud” of vertices, beginning with s and eventually covering all the vertices

We store with each vertex v a label d(v) representing the distance of v from s in the subgraph consisting of the cloud and its adjacent vertices

At each step We add to the cloud the vertex

u outside the cloud with the smallest distance label, d(u)

We update the labels of the vertices adjacent to u 6

Application of Dijkstra’s AlgorithmFind shortest path from s to t using

Dijkstra’s algorithm

Dijkstra's Shortest Path Algorithm

distance label

S = { }

P = { s, 2, 3, 4, 5, 6, 7, t }

distance label

S = { }

P = { s, 2, 3, 4, 5, 6, 7, t }delmin

distance label

S = { s }

P = { 2, 3, 4, 5, 6, 7, t }decrease key

distance label

S = { s }

P = { 2, 3, 4, 5, 6, 7, t }

delmin

S = { s, 2 }

P = { 3, 4, 5, 6, 7, t }

S = { s, 2 }

P = { 3, 4, 5, 6, 7, t }

decrease key

S = { s, 2 }

P = { 3, 4, 5, 6, 7, t }

delmin

S = { s, 2, 6 }

P = { 3, 4, 5, 7, t }

S = { s, 2, 6 }

P = { 3, 4, 5, 7, t }

delmin

S = { s, 2, 6, 7 }

P = { 3, 4, 5, t }

S = { s, 2, 6, 7 }

P = { 3, 4, 5, t }

delmin

S = { s, 2, 3, 6, 7 }

P = { 4, 5, t }

59 XX 51

S = { s, 2, 3, 6, 7 }

P = { 4, 5, t }

59 XX 51

delmin

S = { s, 2, 3, 5, 6, 7 }

P = { 4, t }

59 XX 51

S = { s, 2, 3, 5, 6, 7 }

P = { 4, t }

59 XX 51

delmin

S = { s, 2, 3, 4, 5, 6, 7 }

P = { t }

59 XX 51

S = { s, 2, 3, 4, 5, 6, 7 }

P = { t }

59 XX 51

delmin

S = { s, 2, 3, 4, 5, 6, 7, t }

P = { }

59 XX 51

S = { s, 2, 3, 4, 5, 6, 7, t }

P = { }

59 XX 51

In-Class Exercise Find the shortest route to reach Honolulu (HNL) from

Providence (PVD)Use Dikjstra’s algorithm

ORDPVD

MIADFW

13871743

10991120

Why It Doesn’t Work for Negative-Weight Edges

If a node with a negative incident edge were to be added late to the cloud, it could mess up distances for vertices already in the cloud.

Dijkstra’s algorithm is based on the greedy method. It adds vertices by increasing distance.

C’s true distance is 1, but it is already in the cloud with d(C)=5!

Remarks on Dijkstra’s Shortest Path Algorithm

Dijkstra’s algorithm doesn’t account for graphs whose edges may have negative weightsBellman-Ford’s algorithm accounts for negative

weight pathsDijkstra’s algorithm works for a single source

and a single sink pair Floyd’s algorithm solves for the shortest path among

all pairs of vertices.Dijkstra’s shortest path algorithm can be

solved in polynomial time in graphs without negative-weight cyclesIt takes O(E+VlogV) time

Bellman-Ford algorithm

Bellman-Ford Algorithm takes O(E*V) time30

Example of Bellman-Ford Algorithm

Courtesy: Eric Demaine, MIT

We fix the source node as A

Courtesy: Eric Demaine, MIT32

TractabilitySome problems are undecidable: no computer

can solve themE.g., Turing’s “Halting Problem”

Other problems are decidable, but intractable: as they grow large, we are unable to solve them

in reasonable timeWhat constitutes “reasonable time”?

Some problems are provably decidable in polynomial time on an ordinary computerWe say such problems belong to the set PTechnically, a computer with unlimited memory

NPSome problems are provably decidable in

polynomial time on a nondeterministic computerWe say such problems belong to the set NPCan think of a nondeterministic computer as a

parallel machine that can freely spawn an infinite number of processes

P = set of problems that can be solved in polynomial time

NP = set of problems for which a solution can be verified in polynomial time

P NPThe big question: Does P = NP?

NP-CompletenessHow would you define NP-Complete?They are the “hardest” problems in NP

NP-Complete

NP-CompletenessThe NP-Complete problems are an interesting class of

problems whose status is unknown No polynomial-time algorithm has been discovered for an NP-

Complete problemNo superpolynomial lower bound has been proved for any NP-

Complete problem, eitherThe two chief characteristics of NP-complete problems are :

NP-complete is a subset of NP set of all decision problems whose solutions can be verified in polynomial

time; A problem s in NP is also in NP-complete if and only if every other

problem in NP can be transformed into s in polynomial timeUnless there is a dramatic change in the current thinking,

there is no “efficient time” algorithm which can solve NP-complete problems A brute-force search is often required

Longest Path AlgorithmThe longest path problem is the problem of

finding a simple path of maximum length in a given graph.

Unlike the shortest path problem, the longest path problem is NP-completeThe optimal solution cannot be found in polynomial

time unless P = NP.The NP-completeness of the decision problem

can be shown using a reduction from the Hamiltonian path problem. If a certain general graph has a Hamiltonian path,

this Hamiltonian path is the longest path possible, as it traverses all possible vertices.

Longest Path AlgorithmA Hamiltonian path (or traceable path) is a

path in an undirected graph which visits each vertex exactly once.

A Hamiltonian cycle (or Hamiltonian circuit) is a cycle in an undirected graph which visits each vertex exactly once and also returns to the starting vertex.

Determining whether such paths and cycles exist in graphs is the Hamiltonian path problem which is NP-complete.

Statistics

Krishna.V.PalemKenneth and Audrey Kennedy Professor of ComputingDepartment of Computer Science, Rice University

ContentsHistory of StatisticsBasic terms involved in StatisticsSamplingExamples & In-Class ExerciseEstimation theory

History of Statistics

Basic Terms Involved in Statistics

To understand sampling, you need to first understand a few basic definitions. The total set of observations that can be made

is called the population. A sample is a collection of observations made

It is usually a much smaller subset of the populationA parameter is a measurable characteristic of

a population, such as a mean or standard deviation.

A statistic is a measurable characteristic of a sample, such as a mean or standard deviation.

Terminology UsedThe notation used to describe these

measures appears below: N: Number of observations in the population. n: Number of observations in the sample. μ: The population mean. x: The sample mean. σ2: The variance of the population. σ: The standard deviation of the population. s2: The variance of the sample. s: The standard deviation of the sample.

Sampling TheorySimple random sampling refers to a sampling

method that has the following properties. population consists of N objects. sample consists of n objects. all possible samples of n objects are equally likely

to occur.

The main benefit of simple random sampling is that it guarantees that the sample chosen is representative of the population.ensures that the statistical conclusions will be valid.

Mean & Variance of the Sample

The sample mean is the arithmetic average of the values in a random sampleIt is denoted by:

x = (x1+x2… +xn)/n = 1/n * Σ xi Since it is taken from a random sample, x is a

random variableThe variance of a sample is the average squared

deviation from the sample meanIt is denoted by:

s2 = Σ ( xi - x )2 / ( n - 1 )

where s2 is the sample variance, x is the sample mean, xi is the ith element from the sample, and n is the number of elements in the sample

Note: Each xi can be defined as a random variable 54

Computing the Mean of PopulationWe have a sample with mean x and

variance s2

We know that μ is population mean & x is sample mean.

How do we compute the mean of the population using this?

xExEn*n

1E)x(E

1ii Since, E(cX) = c E(X)

Since, E(x1) = E(x2) … = μ

Hence, population mean can be estimated by computing the expectation of the sample mean.

Computing the Variance of PopulationWe have a sample with mean x and variance s2

We know that Var(x) = σ2/n (from slide 6 of lecture 11)

In the next slide, we have a skeleton for the proof.Use it to derive the proof yourself as an in-class exercise

How do we compute variance of the population using this?

xnExnEn

(From definition of s2)

(Use E(A+B) = E(A)+E(B) )

(Use x is constant & x =1/n Σ xi )

(Use, E(x1) = E(x2) … = E(xn) )

(Substitute, Var(X) =σ2 = E(X2)- μ2 &

Var(x) =σ2/n = E(X2)- μ2 )

Expand the Squared expression on the RHS

In-class exercise : Derivation of variance of Population

)n(n)(n

)x(nE)x(nE1n

)x(nE)x(E1n

xnxE1n

xn2xnxE1n

xx2xxE1n

xxE)s(E

(From definition of s2)

(Since, E(A+B) = E(A)+E(B) )

(Since, x is constant & x =1/n Σ xi )

(Since, E(x1) = E(x2) … = E(xn) )

(Since, Var(X) =σ2 = E(X2)- μ2 &

Var(x) =σ2/n = E(X2)- μ2 )

Complete Solution

Computing the Variance of PopulationWe have a sample with mean x and

variance s2

We know that Var(x) = σ2/n

How do we compute variance of the population using this?

Hence, population variance can be estimated by computing the expectation of the sample variance.

From the derivation, we obtained

E(s2) = σ2

Paths in a Graph : A Brief Tutorial Krishna.V.Palem Kenneth and Audrey Kennedy Professor of...

Documents

Audrey Flegel

Probability and Independence 1 Krishna.V.Palem Kenneth and Audrey Kennedy Professor of Computing Department of Computer Science, Rice University

History of Numbers and Expectations 1 Krishna.V.Palem Kenneth and Audrey Kennedy Professor of Computing Department of Computer Science, Rice University

200117 audrey (in) pdf vegan soup by audrey

Audrey Flack

A Conversation with Audrey Hepburn - BrokenArtGallery.combrokenartgallery.com/AConversationwithAudreyHepburn8.pdf · with Audrey Hepburn Audrey Hepburn: What you may first forget,

Givenchy Audrey

muñeca audrey

Audrey Osler

Audrey Process

Audrey Wood

Audrey Hepburnbeautytips

Audrey hepburn

Audrey Tautou

Audrey Tautou

Feedback on Project and Mini-Project I & Statistics 1 Krishna.V.Palem Kenneth and Audrey Kennedy Professor of Computing Department of Computer Science,

AUDREY BREAKFAST AT TIFFANY'S based on: Audrey Hepburn … · AUDREY BREAKFAST AT TIFFANY'S based on: Audrey Hepburn by Benny Stilling, color lithograph adhered to canvas mount, 1962

AUDREY - helenadarbujanova.czhelenadarbujanova.cz/sites/default/files/audrey_katalog_online_2.pdf · AUDREY BED AUDREY bed with an important detail - frame with your wedding photo

Audrey Kawasaki

Audrey Art