51
Outline The Problem The Solution Variants T-79.4001: The Hat Problem Janne Peltola 5.3.2008 Janne Peltola T-79.4001: The Hat Problem

T-79.4001 The Hat Problem

Embed Size (px)

DESCRIPTION

A seminar presentation given on the TKK course T-79.4001.Describes the hat problem, which combines information theory and game theory in a novel way.

Citation preview

Page 1: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

T-79.4001:The Hat Problem

Janne Peltola

5.3.2008

Janne Peltola T-79.4001: The Hat Problem

Page 2: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

1 The ProblemIntroductionSolutions

2 The SolutionAlgorithmEfficiency

3 Variants

Janne Peltola T-79.4001: The Hat Problem

Page 3: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

The situation

n players play a game. The rules are simple.

The players enter a room blindfolded.

A hat is put on each player’s head. The hat is either red orblue.

The players must guess the color of their hat or pass.

The players may not communicate with each other.

The players win if each non-passing guess is correct.

We wish to find a strategy which maximizes the probability p thatthe players win.

Janne Peltola T-79.4001: The Hat Problem

Page 4: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

The situation

n players play a game. The rules are simple.

The players enter a room blindfolded.

A hat is put on each player’s head. The hat is either red orblue.

The players must guess the color of their hat or pass.

The players may not communicate with each other.

The players win if each non-passing guess is correct.

We wish to find a strategy which maximizes the probability p thatthe players win.

Janne Peltola T-79.4001: The Hat Problem

Page 5: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

The situation

n players play a game. The rules are simple.

The players enter a room blindfolded.

A hat is put on each player’s head. The hat is either red orblue.

The players must guess the color of their hat or pass.

The players may not communicate with each other.

The players win if each non-passing guess is correct.

We wish to find a strategy which maximizes the probability p thatthe players win.

Janne Peltola T-79.4001: The Hat Problem

Page 6: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

The situation

n players play a game. The rules are simple.

The players enter a room blindfolded.

A hat is put on each player’s head. The hat is either red orblue.

The players must guess the color of their hat or pass.

The players may not communicate with each other.

The players win if each non-passing guess is correct.

We wish to find a strategy which maximizes the probability p thatthe players win.

Janne Peltola T-79.4001: The Hat Problem

Page 7: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

The situation

n players play a game. The rules are simple.

The players enter a room blindfolded.

A hat is put on each player’s head. The hat is either red orblue.

The players must guess the color of their hat or pass.

The players may not communicate with each other.

The players win if each non-passing guess is correct.

We wish to find a strategy which maximizes the probability p thatthe players win.

Janne Peltola T-79.4001: The Hat Problem

Page 8: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

The situation

n players play a game. The rules are simple.

The players enter a room blindfolded.

A hat is put on each player’s head. The hat is either red orblue.

The players must guess the color of their hat or pass.

The players may not communicate with each other.

The players win if each non-passing guess is correct.

We wish to find a strategy which maximizes the probability p thatthe players win.

Janne Peltola T-79.4001: The Hat Problem

Page 9: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

Some history

The problem was first proposed by T. Ebert (UCLA) in hisPh.D. thesis in 1998.

There’s certain charm as a puzzle but the problem doesn’tseem terribly relevant.

However, there are connections between its efficientalgorithmic solutions for n = 2k − 1 and coding theory.

Thus far the problem has eluded tractable solutions forn 6= 2k − 1.

Janne Peltola T-79.4001: The Hat Problem

Page 10: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

Some history

The problem was first proposed by T. Ebert (UCLA) in hisPh.D. thesis in 1998.

There’s certain charm as a puzzle but the problem doesn’tseem terribly relevant.

However, there are connections between its efficientalgorithmic solutions for n = 2k − 1 and coding theory.

Thus far the problem has eluded tractable solutions forn 6= 2k − 1.

Janne Peltola T-79.4001: The Hat Problem

Page 11: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

Some history

The problem was first proposed by T. Ebert (UCLA) in hisPh.D. thesis in 1998.

There’s certain charm as a puzzle but the problem doesn’tseem terribly relevant.

However, there are connections between its efficientalgorithmic solutions for n = 2k − 1 and coding theory.

Thus far the problem has eluded tractable solutions forn 6= 2k − 1.

Janne Peltola T-79.4001: The Hat Problem

Page 12: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

3 Players: a naıve strategy

Suppose n = 3. The players are Alice, Bob and Chuck.

If Alice and Bob pass, Chuck guesses correctly 50% of thetime.

Can we do better than this?

Janne Peltola T-79.4001: The Hat Problem

Page 13: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

3 Players: a naıve strategy

Suppose n = 3. The players are Alice, Bob and Chuck.

If Alice and Bob pass, Chuck guesses correctly 50% of thetime.

Can we do better than this?

Janne Peltola T-79.4001: The Hat Problem

Page 14: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

3 Players: a naıve strategy

Suppose n = 3. The players are Alice, Bob and Chuck.

If Alice and Bob pass, Chuck guesses correctly 50% of thetime.

Can we do better than this?

Janne Peltola T-79.4001: The Hat Problem

Page 15: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

3 Players: a better strategy

Each player looks at the other players’hats.

If the hats are different, he/she passes.

If the hats are of the same color, he/shepicks the opposite one.

This results in p = 34 , a 50% increase.

This strategy can be generalized for alln = 2k − 1.

R R RR R BB B BB R RB B RR B BB R BR B R

Janne Peltola T-79.4001: The Hat Problem

Page 16: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

3 Players: a better strategy

Each player looks at the other players’hats.

If the hats are different, he/she passes.

If the hats are of the same color, he/shepicks the opposite one.

This results in p = 34 , a 50% increase.

This strategy can be generalized for alln = 2k − 1.

R R RR R BB B BB R RB B RR B BB R BR B R

Janne Peltola T-79.4001: The Hat Problem

Page 17: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

3 Players: a better strategy

Each player looks at the other players’hats.

If the hats are different, he/she passes.

If the hats are of the same color, he/shepicks the opposite one.

This results in p = 34 , a 50% increase.

This strategy can be generalized for alln = 2k − 1.

R R RR R BB B BB R RB B RR B BB R BR B R

Janne Peltola T-79.4001: The Hat Problem

Page 18: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

3 Players: a better strategy

Each player looks at the other players’hats.

If the hats are different, he/she passes.

If the hats are of the same color, he/shepicks the opposite one.

This results in p = 34 , a 50% increase.

This strategy can be generalized for alln = 2k − 1.

R R RR R BB B BB R RB B RR B B

B R BR B R

Janne Peltola T-79.4001: The Hat Problem

Page 19: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

3 Players: a better strategy

Each player looks at the other players’hats.

If the hats are different, he/she passes.

If the hats are of the same color, he/shepicks the opposite one.

This results in p = 34 , a 50% increase.

This strategy can be generalized for alln = 2k − 1.

R R RR R BB B BB R RB B RR B B

B R BR B R

Janne Peltola T-79.4001: The Hat Problem

Page 20: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

7 Players

The size of the state space is 27 = 128.

The naıve strategy can be applied.

However, there is a complex strategy to achieve p = 6364 .

Next, the general strategy will be defined.

Janne Peltola T-79.4001: The Hat Problem

Page 21: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

7 Players

The size of the state space is 27 = 128.

The naıve strategy can be applied.

However, there is a complex strategy to achieve p = 6364 .

Next, the general strategy will be defined.

Janne Peltola T-79.4001: The Hat Problem

Page 22: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

7 Players

The size of the state space is 27 = 128.

The naıve strategy can be applied.

However, there is a complex strategy to achieve p = 6364 .

Next, the general strategy will be defined.

Janne Peltola T-79.4001: The Hat Problem

Page 23: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

7 Players

The size of the state space is 27 = 128.

The naıve strategy can be applied.

However, there is a complex strategy to achieve p = 6364 .

Next, the general strategy will be defined.

Janne Peltola T-79.4001: The Hat Problem

Page 24: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

The Idea

We have encoded certain states in C .

We present a strategy to obtain winning sequences via C .

We show that the strategy fails with probability p = 2−r .

Janne Peltola T-79.4001: The Hat Problem

Page 25: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

Definitions

Consider a game of n = 2r − 1 players and 2 colors.

Let v = (1110100)T ∈ Zn2 be the state vector.

Janne Peltola T-79.4001: The Hat Problem

Page 26: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

Definitions

Consider a game of n = 2r − 1 players and 2 colors.

Let v = (1110100)T ∈ Zn2 be the state vector.

Definition

Let H be an r × n matrix with entries in Z2. Suppose that allpossible nonzero columns occur exactly once. Then H is the checkmatrix (ie. HvT = 0) of a code C . The code is called an [n, n − r ]Hamming code.

Janne Peltola T-79.4001: The Hat Problem

Page 27: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

The Strategy

Recall the state vector v = (1110100)T ∈ Z72

We choose (for this case) H =1 1 1 1 0 0 01 1 0 0 1 1 01 0 1 0 1 0 1

For person 3, there are two possible v ’s: v0 = (1100100)T orv1 = (1110100)T .

Person 3 uses the following rules to determine his call:

If HvT0 6= 0 and HvT

1 6= 0, he passesIf HvT

0 = 0 and HvT1 6= 0, he calls Red

If HvT0 6= 0 and HvT

1 = 0, he calls Blue

Janne Peltola T-79.4001: The Hat Problem

Page 28: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

The Strategy

Recall the state vector v = (1110100)T ∈ Z72

We choose (for this case) H =1 1 1 1 0 0 01 1 0 0 1 1 01 0 1 0 1 0 1

For person 3, there are two possible v ’s: v0 = (1100100)T orv1 = (1110100)T .

Person 3 uses the following rules to determine his call:

If HvT0 6= 0 and HvT

1 6= 0, he passesIf HvT

0 = 0 and HvT1 6= 0, he calls Red

If HvT0 6= 0 and HvT

1 = 0, he calls Blue

Janne Peltola T-79.4001: The Hat Problem

Page 29: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

The Strategy

Recall the state vector v = (1110100)T ∈ Z72

We choose (for this case) H =1 1 1 1 0 0 01 1 0 0 1 1 01 0 1 0 1 0 1

For person 3, there are two possible v ’s: v0 = (1100100)T orv1 = (1110100)T .

Person 3 uses the following rules to determine his call:

If HvT0 6= 0 and HvT

1 6= 0, he passesIf HvT

0 = 0 and HvT1 6= 0, he calls Red

If HvT0 6= 0 and HvT

1 = 0, he calls Blue

Janne Peltola T-79.4001: The Hat Problem

Page 30: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

The Strategy

Recall the state vector v = (1110100)T ∈ Z72

We choose (for this case) H =1 1 1 1 0 0 01 1 0 0 1 1 01 0 1 0 1 0 1

For person 3, there are two possible v ’s: v0 = (1100100)T orv1 = (1110100)T .

Person 3 uses the following rules to determine his call:

If HvT0 6= 0 and HvT

1 6= 0, he passesIf HvT

0 = 0 and HvT1 6= 0, he calls Red

If HvT0 6= 0 and HvT

1 = 0, he calls Blue

Janne Peltola T-79.4001: The Hat Problem

Page 31: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

The Strategy

Recall the state vector v = (1110100)T ∈ Z72

We choose (for this case) H =1 1 1 1 0 0 01 1 0 0 1 1 01 0 1 0 1 0 1

For person 3, there are two possible v ’s: v0 = (1100100)T orv1 = (1110100)T .

Person 3 uses the following rules to determine his call:

If HvT0 6= 0 and HvT

1 6= 0, he passes

If HvT0 = 0 and HvT

1 6= 0, he calls RedIf HvT

0 6= 0 and HvT1 = 0, he calls Blue

Janne Peltola T-79.4001: The Hat Problem

Page 32: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

The Strategy

Recall the state vector v = (1110100)T ∈ Z72

We choose (for this case) H =1 1 1 1 0 0 01 1 0 0 1 1 01 0 1 0 1 0 1

For person 3, there are two possible v ’s: v0 = (1100100)T orv1 = (1110100)T .

Person 3 uses the following rules to determine his call:

If HvT0 6= 0 and HvT

1 6= 0, he passesIf HvT

0 = 0 and HvT1 6= 0, he calls Red

If HvT0 6= 0 and HvT

1 = 0, he calls Blue

Janne Peltola T-79.4001: The Hat Problem

Page 33: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

The Strategy

Recall the state vector v = (1110100)T ∈ Z72

We choose (for this case) H =1 1 1 1 0 0 01 1 0 0 1 1 01 0 1 0 1 0 1

For person 3, there are two possible v ’s: v0 = (1100100)T orv1 = (1110100)T .

Person 3 uses the following rules to determine his call:

If HvT0 6= 0 and HvT

1 6= 0, he passesIf HvT

0 = 0 and HvT1 6= 0, he calls Red

If HvT0 6= 0 and HvT

1 = 0, he calls Blue

Janne Peltola T-79.4001: The Hat Problem

Page 34: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

Why is this a good idea?

Lemma

There is a unique codeword c so that dH(v , c) = 1.

Proof.

Existence:

Let s = HvT 6= 0. s is a column of H, therefore s = HeTi .

H(v + ei )T = s + s = 0, so dH(v , c) = 1.

Janne Peltola T-79.4001: The Hat Problem

Page 35: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

Why is this a good idea?

Lemma

There is a unique codeword c so that dH(v , c) = 1.

Proof.

Uniqueness:

Let c1, c2 ∈ C so that dH(v , c1) = dH(v , c2) = 1.

Therefore v + c1 = ei and v + c2 = ej for some (i , j).

We have ei + ej = c1 + c2 ∈ C , so H(ei + ej)T = 0

HeTi = HeT

j so columns i and j must be equal, but there areno equal columns by definition ⇒ contradiction.

Janne Peltola T-79.4001: The Hat Problem

Page 36: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

Why is this NOT a good idea?

Theorem

The strategy is successful whenever HvT 6= 0, but fails whenHvT = 0.

Proof.

We previously showed that there is a unique codeword c sothat dH(v , c) = 1.

If we iterate through the vectors vi = v + ei , we find thatHvT

i = 0 only for one value of i .

Recall that we assumed that HvT 6= 0, therefore the caseHvT

0 = 0 precludes all other possibilities ⇒ v0 = v .

If HvT = 0, no one would pass ⇒ the strategy fails.

Janne Peltola T-79.4001: The Hat Problem

Page 37: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

Why is this NOT a good idea?

Theorem

The strategy is successful whenever HvT 6= 0, but fails whenHvT = 0.

Proof.

We previously showed that there is a unique codeword c sothat dH(v , c) = 1.

If we iterate through the vectors vi = v + ei , we find thatHvT

i = 0 only for one value of i .

Recall that we assumed that HvT 6= 0, therefore the caseHvT

0 = 0 precludes all other possibilities ⇒ v0 = v .

If HvT = 0, no one would pass ⇒ the strategy fails.

Janne Peltola T-79.4001: The Hat Problem

Page 38: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

Why is this NOT a good idea?

Theorem

The strategy is successful whenever HvT 6= 0, but fails whenHvT = 0.

Proof.

We previously showed that there is a unique codeword c sothat dH(v , c) = 1.

If we iterate through the vectors vi = v + ei , we find thatHvT

i = 0 only for one value of i .

Recall that we assumed that HvT 6= 0, therefore the caseHvT

0 = 0 precludes all other possibilities ⇒ v0 = v .

If HvT = 0, no one would pass ⇒ the strategy fails.

Janne Peltola T-79.4001: The Hat Problem

Page 39: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

Why is this NOT a good idea?

Theorem

The strategy is successful whenever HvT 6= 0, but fails whenHvT = 0.

Proof.

We previously showed that there is a unique codeword c sothat dH(v , c) = 1.

If we iterate through the vectors vi = v + ei , we find thatHvT

i = 0 only for one value of i .

Recall that we assumed that HvT 6= 0, therefore the caseHvT

0 = 0 precludes all other possibilities ⇒ v0 = v .

If HvT = 0, no one would pass ⇒ the strategy fails.

Janne Peltola T-79.4001: The Hat Problem

Page 40: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

A helpful lemma

Lemma

An [n, k] linear code has 2k elements.

Proof.

An [n, k] linear code C has a check matrix H ∈ Zk×n2 .

The elements of C are the columns + (000)T

By combinatorics, there are 2k elements.

Janne Peltola T-79.4001: The Hat Problem

Page 41: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

A helpful lemma

Lemma

An [n, k] linear code has 2k elements.

Proof.

An [n, k] linear code C has a check matrix H ∈ Zk×n2 .

The elements of C are the columns + (000)T

By combinatorics, there are 2k elements.

Janne Peltola T-79.4001: The Hat Problem

Page 42: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

A helpful lemma

Lemma

An [n, k] linear code has 2k elements.

Proof.

An [n, k] linear code C has a check matrix H ∈ Zk×n2 .

The elements of C are the columns + (000)T

By combinatorics, there are 2k elements.

Janne Peltola T-79.4001: The Hat Problem

Page 43: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

How often does one fail?

Theorem

The probability that players win by using the strategy is 1− 2−r .

Proof.

There are 2n elements in Zn2.

Therefore, the probability to find k specific elements is 2k

2n .

Therefore, the probability to hit an element v so thatHvT = 0 is 2−r .

The complement case’s (HvT 6= 0) probability is 1− 2−r .

Janne Peltola T-79.4001: The Hat Problem

Page 44: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

How often does one fail?

Theorem

The probability that players win by using the strategy is 1− 2−r .

Proof.

There are 2n elements in Zn2.

Therefore, the probability to find k specific elements is 2k

2n .

Therefore, the probability to hit an element v so thatHvT = 0 is 2−r .

The complement case’s (HvT 6= 0) probability is 1− 2−r .

Janne Peltola T-79.4001: The Hat Problem

Page 45: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

How often does one fail?

Theorem

The probability that players win by using the strategy is 1− 2−r .

Proof.

There are 2n elements in Zn2.

Therefore, the probability to find k specific elements is 2k

2n .

Therefore, the probability to hit an element v so thatHvT = 0 is 2−r .

The complement case’s (HvT 6= 0) probability is 1− 2−r .

Janne Peltola T-79.4001: The Hat Problem

Page 46: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

How often does one fail?

Theorem

The probability that players win by using the strategy is 1− 2−r .

Proof.

There are 2n elements in Zn2.

Therefore, the probability to find k specific elements is 2k

2n .

Therefore, the probability to hit an element v so thatHvT = 0 is 2−r .

The complement case’s (HvT 6= 0) probability is 1− 2−r .

Janne Peltola T-79.4001: The Hat Problem

Page 47: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

Food for thought

In the best tradition of the literature, I explore theopportunities for expanding the problem without providingactual solutions.

One could consider k colors instead of 2.

One could consider n 6= 2r − 1.

One could consider non-symmetrical color distributions.

One could consider variants with more error tolerance (i.e. 1error allowed). Could one solve n 6= 2r − 1 with relaxedconditions?

Janne Peltola T-79.4001: The Hat Problem

Page 48: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

Food for thought

In the best tradition of the literature, I explore theopportunities for expanding the problem without providingactual solutions.

One could consider k colors instead of 2.

One could consider n 6= 2r − 1.

One could consider non-symmetrical color distributions.

One could consider variants with more error tolerance (i.e. 1error allowed). Could one solve n 6= 2r − 1 with relaxedconditions?

Janne Peltola T-79.4001: The Hat Problem

Page 49: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

Food for thought

In the best tradition of the literature, I explore theopportunities for expanding the problem without providingactual solutions.

One could consider k colors instead of 2.

One could consider n 6= 2r − 1.

One could consider non-symmetrical color distributions.

One could consider variants with more error tolerance (i.e. 1error allowed). Could one solve n 6= 2r − 1 with relaxedconditions?

Janne Peltola T-79.4001: The Hat Problem

Page 50: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

Food for thought

In the best tradition of the literature, I explore theopportunities for expanding the problem without providingactual solutions.

One could consider k colors instead of 2.

One could consider n 6= 2r − 1.

One could consider non-symmetrical color distributions.

One could consider variants with more error tolerance (i.e. 1error allowed). Could one solve n 6= 2r − 1 with relaxedconditions?

Janne Peltola T-79.4001: The Hat Problem

Page 51: T-79.4001 The Hat Problem

Outline The Problem The Solution Variants

Summary

We found an interesting connection between coding theoryand game theory.

One can encode certain states and then make sure that thereare only unique legal states which encode to nearbycodewords.

One can use this knowledge to develop a near-optimalstrategy.

Janne Peltola T-79.4001: The Hat Problem