64
Auction Theory Class 9 – Online Advertising 1

Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Embed Size (px)

Citation preview

Page 1: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Auction Theory

Class 9 – Online Advertising

1

Page 2: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Outline

Part 1: Bla bla bla

Part 2: Equilibrium analysis of Google’s auction

2

Page 3: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Outline1. Introduction: online advertising

2. Sponsored search– Bidding and properties– Formal model– The Generalized second-price auction– Reminder: multi-unit auctions and VCG– Equilibrium analysis

3

Page 4: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Classic advertising

4

Page 5: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Classic advertising: newspapers

5

Page 6: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Classic advertising: TV

6

Page 7: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Classic advertising: Billboards

7

Page 8: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Online advertising

8

Page 9: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Banner ads1. General:

1. Examples: banner, sponserd search, video, videa games, adsense, in social networks

2. Some numbers3. advantages over classic ads4. Ppi,ppc,ppconversion

2. Sponsored search:1. Some history2. Definitions: ctr, conversion-rate3. GSP- definition, non truthfulness.4. Diagram of first-price yahoo data.5. Analysis of equilibrium.

9

Page 10: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Sponsored search

10

Page 11: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Semantic advertising

11

Page 12: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Email advertising

12

Page 13: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Online Advertising:Some rough numbers

• 2008:– Worldwide advertising spending: about 500 Billion– Online advertising: about 10% of that (!!!!)

• Google : over 98% of revenue from advertising (Total $21 Billion in 2008)

• Double digit growth in online advertising in the past and in the near future (expected)

13

Page 14: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Online advertising - advantages• Targeting

– By search keywords, context, – Personalized ads.

• Additional information– Time, history, personal data

• Advanced billing/effectiveness options– By eyeballs, clicks, actual purchases– “pay only when you sell”

• Advanced bidding options– No printing/”menu” costs.

• Variety of multimedia tools • Enables cheap campaigns, low entry levels.

14

Page 15: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Advertising types• Brand advertisers

• Direct advertisers

15

Page 16: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Revenue model• Pay per impression

– CPM- cost per mille. Cost per thousand impressions.– Good for brand advertisers

• Pay per click– CPC - cost per click. – Most prevalent– Brand advertisers get value for free.

• Pay per action– CPA – cost per action/acquisition/conversion.– Risk-free for advertisers– Harder to implement

16

Page 17: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Outline1. Introduction: online advertising

Sponsored search– Bidding and properties– Formal model– The Generalized second-price auction– Reminder: multi-unit auctions and VCG– Equilibrium analysis

17

Page 18: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Sponsored search auctions

18

Real (“organic”) search result Ads: “sponsored search”

Page 19: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Sponsored search auctions

19

Search keywords keywordskeywordsAd slots

Page 20: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Bidding

20

• A basic campaign for an advertiser includes:

• Some keywords have bids greater than $50– E.g., Mesothelioma

• Search engine provides assistance • traffic estimator, keyword suggestions, automatic bidding

• Google started (and stopped) pay-per-action sales.

List of : keywords + bid per click

“hotel Las Vegas” $5“Nikon camera d60” $30

Budget (for example, daily)

I want to spend at most $500 a day

Page 21: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Bidding: more details

21

When does a keyword match a user search-query?– When bidding $5 per “hotel California”.

Will “hotel California song” appear?

• Broad match – California hotel, hotel California Hilton, cheap hotel California.

• Exact match: – “hotel California” with no changes or additions.

• Negative words:– “hotel California –song -eagles “

• Many more options:– Geography, time, languages, mobile/desktops/laptops,

etc.

Page 22: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Economics of sponsored search

22

Internet usersSearch engines

advertisers

Page 23: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Click Through Rates

23

• Are all ads equal?

• Position matters.– User mainly click on top ads.

• Need to understand user behavior.

Page 24: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Click Through rate

24

9%4%

2%

0.5%

0.2%

0.08%

Page 25: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Click Through rate

25

c1

c2

c3

c4

ck

Page 26: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Formal model

26

• n advertisers

• For advertiser i: value per click vi

• k ad slots (positions): 1,…,k

• Click-through-rates: c1 > c2 > …> ck

– Simplifying assumption: CTR identical for all users.

• Advertiser i, wins slot t, pays p.

utility: ct (vi –p)

• Social welfare (assume advertisers 1,..,k win slots 1,…,k) :

k

iiivc

1

Page 27: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Example

27

v1=10

v2=8

v3=2

c1=0.08

c2=0.03

c3=0.01

Slot 1

Slot 2

Slot 3

The efficient outcome:

Total efficiency: 10*0.08 + 8*0.03 + 2*0.01

Page 28: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Brief History of Sponsored Search Auctions(Slide: Jon Levin)

• Pre-1994: advertising sold on a per-impression basis, traditional direct sales to advertisers.

• 1994: Overture (then GoTo) allows advertisers to bid for keywords, offering some amount per click. Advertisers pay their bids.

• Late 1990s: Yahoo! and MSN adopt Overture, but mechanism proves unstable - advertisers constantly change bids to avoid paying more than necessary.

• 2002: Google modifies keyword auction to have advertisers pay minimum amount necessary to maintain their position (i.e. GSP)- followed by Yahoo! and MSN.

Page 29: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

How would you sell the slots?

Yahoo! (that acquired Overture) sold ads in a pay-your-bid auction (that is, first-price auction).

Results: Sawtooth

29

Page 30: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Pay-your-bid data (14 hours)

30

Page 31: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Pay-your-bid data (week)

31

Page 33: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Why efficiency?Isn’t Google (and other internet companies) required

by their shareholders to maximize profit?

Reasons:– Long term thinking in a competitive environment.

– Making the whole pie larger.

– Easier to model and analyze…

33

Page 34: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

GSP

34

• The Generalized Second price (GSP) auction– I like the name “next-price auction” better.

• Used by major search engines– Google, Bing (Microsoft), Yahoo

Auction rules– Bidders bid their value per click bi

– The ith highest bidder wins the ith slot and pays the (i+1)th highest bid.

• With one slot: reduces to 2nd-price auction.

Page 35: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Example

35

b1=10

b2=8

b3=2

c1=0.08

c2=0.03

c3=0.01

Slot 1

Slot 2

Slot 3

Pays $8

Pays $2

b4=1

Pays $1

Page 36: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

GSP and VCG

36

• Google advertising its new auction:

“… unique auction model uses Nobel Prize winning economic theory to eliminate … that feeling that you’ve paid too much”

• GSP is a “new” auction, invented by Google.– Probably by mistake….

• But GSP is not VCG!• Not truthful!

• Is it still efficient? (remember 1st-price auctions)

Page 37: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Example: GSP not truthful

37

v1=10

v2=8

v3=2

c1=0.08

c2=0.03

c3=0.01

Slot 1

Slot 2

Slot 3

wins slot 1.utility: 0.08 * (10-8) = 0.16

wins slot 2.utility: 0.3 * (8-2) = 0.18

b1=10

b1=5

Page 38: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

VCG prices

38

b1=10

b2=8

b3=2

c1=0.08

c2=0.03

c3=0.01

Slot 1

Slot 2

Slot 3

Pays $5.625

Pays $1.67

b4=1

Pays $1Expected welfare of the others (1 participates):

8*0.03 + 2*0.01 = 0.26

Expected welfare of the others (without 1):8*0.08 + 2*0.03 + 1*0.01 = 0.71

VCG payment for bidder 1 (expected): 0.71 - 0.26 = 0.45

VCG payment for bidder 1 (per click): 0.45/0.08 = 5.625

Page 39: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Outline1. Introduction: online advertising

2. Sponsored search– Bidding and properties– Formal model– The Generalized second-price auction Reminder: multi-unit auctions and VCG– Equilibrium analysis

39

Page 40: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Reminder

40

• In the previous class we discussed multi-unit auctions and VCG prices.

Page 41: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

• Non identical items: a, b, c, d, e,

• Each bidder has a value for each itemvi(a),vi(b),bi(c),..

• Each bidder wants one item only.

Auctions for non-Identical items

41

Page 42: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Simultaneous Ascending Auction1. Start with zero prices.

2. Each bidder reports her favorite item Provisional winners are announced.

3. Price of over-demanded items is raised by $1. Following bids by losing bidders.

4. Stop when there are no over-demanded items.– Provisional winners become winners.

42

Claim: this auction terminates with:(1) Efficient allocation. (2) VCG prices ( ± $1 )

Page 43: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Walrasian Equilibrium• For a bidder i, and prices p1,…,pn we say that the

bundle T is a demand of i if for every other bundle S:

Sj

jiTj

ji pSvpTv )()(

• A Walrasian equilibrium is an allocation S1,…,Sn and item prices p1,…,pn such that:

– Si is the demand of bidder i under the prices p1,…,pn

– For any item j that is not allocated (not in S1,…,Sn) we have pj=0

Page 44: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Market clearing prices

44

• We saw: In a multi-unit auction with unit-demand bidders:– VCG prices are market-clearing prices

• Not true for more general preferences

– The allocation supported by market clearing prices (Walrasian equilibrium) is efficient.

• Always true

– The simultaneous ascending auction terminates with VCG prices

• And thus with an efficient allocation and market-clearing prices.

Page 45: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Market clearing prices

45

• Another interpretation of market-clearing prices:envy-free prices.

No bidder “envies” another bidder and wants to have their item + price instead oh hers.

Page 46: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Sponsored search as multi-unit auction

46

• Sponsored search can be viewed as multi-unit auction:– Each slot is an item– Advertiser i has value of ctvi for slot t.

• We can conclude: In sponsored search auctions, the VCG prices are market-clearing prices.– allocation is “envy free”

Slot 1Slot 2p2=3

p1=5I prefer “slot 1 + pay 5”to “slot 2 +pay 3”

Page 47: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Market Clearing Prices

47

b1=10

b2=8

b3=2

c1=0.08

c2=0.03

c3=0.01

Slot 1

Slot 2

Slot 3

Pays $5.625

Pays $1.67

b4=1

Pays $1 p1= $5.625 p2=$1.67 p3= $1

u1(slot 1)= 0.08*(10-5.625) =0.35u1(slot 2)= 0.03*(10-1.67) =0.25u1(slot 3)= 0.01(10-1) =0.09

Let’s verify that Advertiser 1 do not want to switch to another slot under these prices:

Page 48: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Equilibrium concept

48

We will analyze the auction as a full-information game.b2=1 b2=2 b3=3 ….

b1=1b1=2b1=3…

Payoff are determined by the

auction rules.

Reason: equilibrium model “stable” bids in repeated-auction scenarios. (advertisers experiment…)

Nash equilibrium: a set of bids in the GSP auction where no bidder benefits from changing his bid (given the other bids).

Page 49: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

GSP is efficient

49

Next slides: we will prove that the GSP auction is efficient.– although not truthful– That is, there is an equilibrium (in the complete-

information game) for which the allocation is efficient.• (there might be other equilibria that may be inefficient)

• Way of proof: we will use the VCG prices to define the equilibrium in the auction.

Page 50: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Equilibrium

50

Let p1,..,pk be market clearing prices.

Let v1,…,vk be the per-click values of the advertisers

Claim: a Nash equilibrium is when each player i bids price pi-1 (bidder 1 can bid any number > p1).

Proof:Step 1: show that market-clearing prices are

decreasing with slots.Step 2: show that this is an equilibrium.

Page 51: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Equilibrium bidding

51

b1=10

b2=8

b3=2

c1=0.08

c2=0.03

c3=0.01

Slot 1

Slot 2

Slot 3

b4=1

p1= $5.625 p2=$1.67 p3= $1

The following bids are an equilibrium:b1=6, b2=5.625, b3=1.67, b4=1

First observation: the bids are decreasing. Is it always the case?

Page 52: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Step 1

52

• We will show:if p1,…,pk are market clearing prices then p1>p2>…>pk

Slot j

Slot tUtility: ct ( vt – pt )

Utility: cj ( vt – pj )

Advertiser t wins slot t:

Market clearing prices: t will not want to get slot j and pay pj.

Since cj>ct, it must be that pt<pj.

≥ (j<t)

Page 53: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Step 2: equilibrium

53

• Under GSP, i wins slot i and pays pi.

• Should i lower his bid?If he bids below bi+1, he will win slot i+1 and pay pi+1.– Cannot happen under market –

clearing prices.

Slot i

Slot i+1

Slot i-1

• Let p1,…,pk be market-clearing prices.

bi-1=pi-2 , bi=pi-1 , bi+1=pi

bi

bi+1

bi+2

Page 54: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Equilibrium bidding

54

b1=10

b2=8

b3=2

c1=0.08

c2=0.03

c3=0.01

Slot 1

Slot 2

Slot 3

b4=1

p1= $5.625 p2=$1.67 p3= $1

The following bids are an equilibrium:b1=6, b2=5.625, b3=1.67, b4=1

Page 55: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Step 2: equilibrium

55

• Under GSP, i wins slot i and pays pi.

• Should i increase his bid?If he bids above bi-1, he will win slot i-1 and pay pi-2 (=bi-1)– But he wouldn’t change to slot

i-1 even if he paid pi-1 (<pi-2).

Slot i

Slot i+1

Slot i-1

• Let p1,…,pk be market-clearing prices.

bi-1=pi-2 , bi=pi-1 , bi+1=pi

bi-2

bi

bi-1

Page 56: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Proof completed• We showed that the bids we constructed compose

a Nash equilibrium in GSP.

• In the equilibrium, bidder with higher values have higher bids.

• Auction is efficient in equilibrium!

56

Page 57: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Another example

57

• Let’s consider a 2-slot case, so we can present the solution graphically.

b1=10

b2=8

b3=2

c1=0.08

c2=0.04

Slot 1

Slot 2

Page 58: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Another example

58

• Let p1,p2 be per-click prices.• What are the Walrasian equilibria in this auction?

(Reminder, each bidder should get his demand)– Bidder 3 should not demand any item:

• p1,p2 ≥ 2– Bidder 2 prefers slot 2:

• 0.04*(8-p2) ≥ 0.08*(8-p1) p1 ≥ p2/2 - 4– Bidder 1 prefers slot 1:

• 0.08*(10-p1) ≥ 0.04*(10-p2) p1 ≤ p2/2 - 5

b1=10

b2=8

b3=2

c1=0.08

c2=0.04

Slot 1

Slot 2

Page 59: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Another example

59

b1=10

b2=8

b3=2

c1=0.08

c2=0.04

Slot 1

Slot 2

2

4

5

2

The set of all Walrasian price

vectors

p1 ≤ p2/2 - 5

p1 ≥ p2/2 - 4

p1,p2 ≥ 2p1

p2

Page 60: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Another example

60

• What are the VCG prices?p1 = (8*0.08+2*0.04-8*0.04)/0.08 = 5

p2 = (2*0.04)/0.04 = 2

b1=10

b2=8

b3=2

c1=0.08

c2=0.04

Slot 1

Slot 2

Page 61: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Another example

61

b1=10

b2=8

b3=2

c1=0.08

c2=0.04

Slot 1

Slot 2

2

4

5

2

VCG prices

Recall: with unit-demand preferences, VCG prices are the lowest Walrasian prices

p1 ≤ p2/2 - 5

p1 ≥ p2/2 - 4

p1,p2 ≥ 2p1

p2

Page 62: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Another example

62

• What are the GSP prices?

p1 > 5

p2 = (2*0.04)/0.04 = 2

b1=10

b2=8

b3=2

c1=0.08

c2=0.04

Slot 1

Slot 2

Page 63: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Another example

63

b1=10

b2=8

b3=2

c1=0.08

c2=0.04

Slot 1

Slot 2

2

4

5

2

GSP prices

Total revenue is greater than in VCG

p1 ≤ p2/2 - 5

p1 ≥ p2/2 - 4

p1,p2 ≥ 2p1

p2

VCG

Page 64: Auction Theory Class 9 – Online Advertising 1. Outline Part 1: Bla bla bla Part 2: Equilibrium analysis of Google’s auction 2

Conclusion• Online advertising is a complex, multi-Billion dollar market

environment. – With a rapidly increasing share of the advertising market.

• These are environments that were, and still are, designed and created by humans.

• Hard to evaluate the actual performance of new auction methods.

• GSP is used by the large search engines.It is not truthful, but is efficient in equilibrium.

– GSP is a new auction, invented by Google, probably by mistake…

64