8
1 A Variable Threat Game of Ransom Avinash Dixit, Princeton University I had the privilege and pleasure of John and Alicia Nash’s friendship for almost a quarter century. When I think of John, the words that spring to my mind are modesty, courtesy, rationality, and precision; when I think of Alicia, the words are quiet courage and love. For someone who made such pathbreaking and deep contributions to mathematics and game theory, John was incredibly modest. At conferences or seminars he never tried to attract attention to himself, and was surprised (but clearly happy) when attention found him, which it always did. He was unfailingly courteous and attentive to all – students and senior professors alike – and had an amazingly good memory for names and faces of people he had met some years ago. In matters of rationality and precision, John perhaps overcompensated for what he called his “years of irrational thinking.” Indeed, he may have carried this logic too far in his advocacy of “ideal money,” a monetary standard as precise as the standard meter and kilogram preserved in Paris. The very word “standard” connotes precision, and its implications had to be followed through logically to the end. Most of us would not want such a rigid monetary standard and would place more value on flexibility to respond to shocks to the economy, but John’s logic gives us a clear and rigorous statement of the case for a rigid commitment. Of course I knew of John’s foundational research in game theory for almost half a century, and used the concepts of Nash equilibrium and the Nash bargaining solution more times than I can recall. In an earlier tribute I said that if John got a dollar every time someone wrote or said “Nash equilibrium,” he would be a rich man. 1 The same goes for the Nash bargaining solution, which is extensively used in 1 “John Nash – Founder of Modern Game Theory,” in Game Theory: A Festschrift in Honor of John Nash, eds. Constantina Kottaridi and Gregorios Siouroun, Athens: Eurasia Publications, 2002, pp. 98-100. The book is in Greek; the English version is on my web site, http://www.princeton.edu/~dixitak/home/nashenco.pdf

Avinash Dixit, Princeton Universitydixitak/home/NashMemVolContrib_Dixit.pdf · 2016. 2. 25. · Avinash Dixit, Princeton University I had the privilege and pleasure of John and Alicia

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Avinash Dixit, Princeton Universitydixitak/home/NashMemVolContrib_Dixit.pdf · 2016. 2. 25. · Avinash Dixit, Princeton University I had the privilege and pleasure of John and Alicia

1

AVariableThreatGameofRansom

AvinashDixit,PrincetonUniversity

IhadtheprivilegeandpleasureofJohnandAliciaNash’sfriendshipfor

almostaquartercentury.WhenIthinkofJohn,thewordsthatspringtomymind

aremodesty,courtesy,rationality,andprecision;whenIthinkofAlicia,thewords

arequietcourageandlove.

Forsomeonewhomadesuchpathbreakinganddeepcontributionsto

mathematicsandgametheory,Johnwasincrediblymodest.Atconferencesor

seminarshenevertriedtoattractattentiontohimself,andwassurprised(but

clearlyhappy)whenattentionfoundhim,whichitalwaysdid.Hewasunfailingly

courteousandattentivetoall–studentsandseniorprofessorsalike–andhadan

amazinglygoodmemoryfornamesandfacesofpeoplehehadmetsomeyearsago.

Inmattersofrationalityandprecision,Johnperhapsovercompensatedforwhathe

calledhis“yearsofirrationalthinking.”Indeed,hemayhavecarriedthislogictoofar

inhisadvocacyof“idealmoney,”amonetarystandardaspreciseasthestandard

meterandkilogrampreservedinParis.Theveryword“standard”connotes

precision,anditsimplicationshadtobefollowedthroughlogicallytotheend.Most

ofuswouldnotwantsucharigidmonetarystandardandwouldplacemorevalue

onflexibilitytorespondtoshockstotheeconomy,butJohn’slogicgivesusaclear

andrigorousstatementofthecaseforarigidcommitment.

OfcourseIknewofJohn’sfoundationalresearchingametheoryforalmost

halfacentury,andusedtheconceptsofNashequilibriumandtheNashbargaining

solutionmoretimesthanIcanrecall.InanearliertributeIsaidthatifJohngota

dollareverytimesomeonewroteorsaid“Nashequilibrium,”hewouldbearich

man.1ThesamegoesfortheNashbargainingsolution,whichisextensivelyusedin

1“JohnNash–FounderofModernGameTheory,”inGameTheory:AFestschriftinHonorofJohnNash,eds.ConstantinaKottaridiandGregoriosSiouroun,Athens:EurasiaPublications,2002,pp.98-100.ThebookisinGreek;theEnglishversionisonmywebsite,http://www.princeton.edu/~dixitak/home/nashenco.pdf

Page 2: Avinash Dixit, Princeton Universitydixitak/home/NashMemVolContrib_Dixit.pdf · 2016. 2. 25. · Avinash Dixit, Princeton University I had the privilege and pleasure of John and Alicia

2

laboreconomics,internationaltrade,andmanyotherareasofeconomicsand

politicalscience.

NowordscansufficetodescribeAlicia’scourageanddedicationtoJohnand

theirsonJohnny.IamsureJohn’srecoveryismostlyduetohercareandlove.Sheis

thetrueheroineoftheincrediblestoryoftheirlives.

AbstractionversusIllustration

Ithasbeensaidmanytimesthattheessenceofmathematicsisabstraction,2

andmanymathematiciansrevelinthemostabstractpossibledefinitionsand

propositionsonanysubject.ButJohnrosetoahigherlevelinrecognizingthatthe

bestentréeintotheworldofmathematicalconceptsisthroughspecific,simple,and

memorableexamples.Hisclassicpaperonbargainingillustratedthegeneral

solutionconceptwithanexchangeofgoodslikeaball,abat,apen,andahat.3Ina

veryhelpfulandperceptivequoteheprovidedformytextbook,hestatedthis

pedagogicalphilosophysuccinctly:“Thegenerousvarietyofillustrativecaseshas

theeffectthatwhatislearnedcanbemoreeasilyretainedthaniftherewereonly

theassertionsoftheoreticalconceptswithoutenlighteningexamples.”4

ThereforeIhavechosentowriteaboutanexamplethatvividlyillustrates

John’sextensionofhisclassicpaper,namelyvariablethreatbargaining.5Nash’s

originalbargainingsolutionwasformalizedasatwo-playercooperativegame𝐺,

wheretheplayerscommunicatetoagreeupontheirstrategies,andthesechoices

2Forexample,seeMathematics:AVeryShortIntroductionbyTimothyGowers,OxfordUniversityPress,2002.3JohnF.Nash,Jr.,“Thebargainingproblem,”Econometrica18:155-162,1950.4SeethebackcoverofAvinashDixit,SusanSkeathandDavidReiley,GamesofStrategy,NewYork:W.W.Norton,fourthedition2015.5JohnF.Nash,Jr.,“Two-personcooperativegames,”Econometrica21:128-140,1953.MyformalstatementfollowsR.DuncanLuceandHowardRaiffa,GamesandDecisions,NewYork:Wiley,1957,pp.140-141.

Page 3: Avinash Dixit, Princeton Universitydixitak/home/NashMemVolContrib_Dixit.pdf · 2016. 2. 25. · Avinash Dixit, Princeton University I had the privilege and pleasure of John and Alicia

3

areexternallyenforceable.Thereisaspecifiedpayoffvector(𝑣!, 𝑣!)whichwill

resultiftheplayersfailtoreachanagreement.Thisisoftencalledthethreatpoint,

orBATNA(BestAlternativeToNegotiatedAgreement)inthejargonoftheHarvard

BusinessSchool’snegotiationproject.6Thesetofallfeasiblepayoffsconstitutesa

compactset𝑃 ⊂ ℝ!;thesubsetconsistingofundominatedpayoffsisthebargaining

frontier𝐵.(Formally, 𝑏!, 𝑏! 𝜖 𝐵ifandonlyifthereisno 𝑝!,𝑝! 𝜖 𝑃suchthat

𝑝! ≥ 𝑏!and𝑝! ≥ 𝑏!withatleastoneoftheinequalitiesstrict;informally,𝐵isthe

north-eastfrontierof𝑃.)TheNashsolutionisthe(𝑥!, 𝑥!)in𝑃thatmaximizesthe

product 𝑥! − 𝑣! 𝑥! − 𝑣! .Ageneralizedversionhasthesolutionmaximizing

𝑥! − 𝑣! !(𝑥! − 𝑣!) !!! ,where0 < 𝜃 < 1, and𝜃, 1− 𝜃canrepresenttherelative

bargainingstrengthsofthetwoparties,ortheirrelativemeritsintheeyesofan

arbitrator.7(TheoriginalNashsolutionisequivalenttosetting𝜃 = 1/2.)Istrivialto

provethat(𝑥!, 𝑥!) 𝜖 𝐵.

Invariablethreatbargaining,anon-cooperativegame𝐺∗precedes𝐺.Its

Nashequilibriumpayoffs(𝑣!, 𝑣!)constitutetheBATNAof𝐺.Whenchoosinghis/her

strategyin𝐺∗,eachplayerwillseektoachievetheoutcomethatwillyieldthebest

payoffforhim/herintheensuingNashcooperativesolutionof𝐺.8

Whatisallthistellingusaboutthreatsinbargaining?Mostpeople,even

mathematicians,onafirstreadingwillbesomewhatbaffledbytheabstract

formulation.Avividandmemorableexamplewillclarifyit.

6RogerFisherandWilliamUry,GettingtoYes,Boston:HoughtonMifflin,1981.7SeeRogerMyerson,GameTheory,Cambridge,MA:HarvardUniversityPress,1991,pp.379,390.8Thisprocessoflookingaheadtotheoutcomeofalatergametochoosestrategiesinapriorgameisanearlyinstanceoftheconceptofsubgameperfectness,latermaderigorousandfamousbyReinhardSeltenin“Reexaminationoftheperfectnessconceptinextensivegames,”InternationalJournalofGameTheory4(1):25-55,1975.

Page 4: Avinash Dixit, Princeton Universitydixitak/home/NashMemVolContrib_Dixit.pdf · 2016. 2. 25. · Avinash Dixit, Princeton University I had the privilege and pleasure of John and Alicia

4

Ransom

InthemovieRansom,thesonofmultimillionaireTomMullen(playedbyMel

Gibson)hasbeenkidnapped.Themanholdinghimisdemandingaransomoftwo

milliondollars.MullengoesonliveTVwiththemoneyspreadoutonatablebefore

him,andmakesthefollowingannouncement:“Thewholeworldnowknows...my

son,SeanMullen,waskidnapped,forransom,threedaysago.Thisisarecent

photographofhim.Sean,ifyou'rewatching,weloveyou.Andthis...well,thisis

whatwaitsforthemanthattookhim.Thisisyourransom.Twomilliondollarsin

unmarkedbills,justlikeyouwanted.Butthisisascloseasyou'llevergettoit.You'll

neverseeonedollarofthismoney,becausenoransomwilleverbepaidformyson.

Notonedime,notonepenny.Instead,I'mofferingthismoneyasarewardonyour

head.Deadoralive,itdoesn'tmatter.Socongratulations,you'vejustbecomeatwo

milliondollarlotteryticket...excepttheoddsaremuch,muchbetter.Doyouknow

anyonethatwouldn'tturnyouinfortwomilliondollars?Idon'tthinkyoudo.I

doubtit.Sowhereveryougoandwhateveryoudo,thismoneywillbetrackingyou

downforalltime.Andtoensurethatitdoes,tokeepinterestalive,I'mrunninga

full-pageadineverymajornewspapereverySunday...foraslongasittakes.But...

andthisisyourlastchance...youreturnmyson,alive,uninjured,I'llwithdrawthe

bounty.Withanyluckyoucansimplydisappear.Understand...youwillneversee

thismoney.Notonedollar.Soyoustillhaveachancetodotherightthing.Ifyou

don't,well,then,Godbewithyou,becausenobodyelseonthisEarthwillbe.”9

Letusrepresentthisingame-theoreticlanguage.CallTomMullenplayer1;

thekidnapperJimmyShaker(playerbyGarySinise)isplayer2.Figure1showstheir

payoffs.Theoriginisatthepointoftheirinitialwealths.Beforethekidnapping,

Mullenalsohashisson;denotehisvalueorutilityfromthatinmoney-equivalent

termsby𝑎.Sothepayoffpointinthestatusquoexanteis 𝑎, 0 ,orthepointQin

9Thetextcomesfromhttp://www.imdb.com/title/tt0117438/?ref_=nv_sr_1,accessedFebruary16,2016.

Page 5: Avinash Dixit, Princeton Universitydixitak/home/NashMemVolContrib_Dixit.pdf · 2016. 2. 25. · Avinash Dixit, Princeton University I had the privilege and pleasure of John and Alicia

5

thefigure.ThelinethroughQwithslope-1showsallattainablepayoffpoints

startingatQandtransferringmoneybetweentheparties,andisthereforethe

bargainingfrontier.

Afterthekidnapping,ifnegotiationfails,MullenwilllosehissonbutShaker

won’tgetanymoney,soShaker’sthreatpointTistheorigin.Heasksfor$2million.

IfthisgoesthroughandMullengetshissonback,thepayoffswillbe(𝑎 − 2,2),

shownasthepointP.

Mullen’sstrategychangesthethreatpoint.Nowifthenegotiationfails,

Mullenwilllosehissonandenduppayingthe$2millionbountytothepersonwho

killsShaker(probablyoneofShaker’sconfederates),whileShakerwilllosehislife.

LetShaker’svaluationofhisownlifebedenotedby𝑏.Thenthepayoffsatthenew

BATNAare −2,−𝑏 . ThefigureshowsthisasthepointT*.

Figure1:VariouspayoffpointsintheRansomgame

Page 6: Avinash Dixit, Princeton Universitydixitak/home/NashMemVolContrib_Dixit.pdf · 2016. 2. 25. · Avinash Dixit, Princeton University I had the privilege and pleasure of John and Alicia

6

Withthisnewthreatpoint,MullenoffersShakerhissolutiontothe

bargainingproblem,namelygoingbacktothestatusquopointQ:bringmysonback

unharmedandIwillwithdrawthebountyonyourhead.10

ThefigureisdrawnasifthesesolutionsconformtotheNashbargaining

solution.Itiseasytoverifythatthisimplicitlysets𝑎 = 4and𝑏 = 6.Forothervalues

of𝑎and𝑏,theNashsolutionforMullen’scounterproposalneednotbeexactlyatQ.

AndthegameGmaybeplayedinsomewayotherthanNashbargaining,for

examplethethreatenermaybeabletomakeatake-it-or-leave-itoffertotheother

player.Butthefollowingreasoningyieldssomegeneralconclusionsapplicabletoall

suchvariants.

WhenwillMullen’sstrategygivehimanoutcomebetterthantheonehe

wouldgetbyaccedingtoShaker’soriginaldemand?IftheNashsolutionforthe

threatpointT*istothesouth-eastofthatforTalongthebargainingfrontier.This

happensifthelineT*QliesbelowthelineTP,thatis,if𝑏 > 2,thatis,ifShakervalues

hisownlifemorethantheransommoney.SinceT*istothesouth-westofT,in

changingthethreatpointfromTtoT*MullenworsensbothBATNAs.Hisstrategy

aimstoachieveShaker’sacceptanceofthealternativeproposal,becauseitcarries

thethreatofanevenbiggerlossforShakerthanforhimselfifthenegotiationfails.

Inotherwords,MullenisimplicitlysayingtoShaker:“Thiswillhurtyoumorethan

itwillhurtme.”Weoftenhearsuchstatementsmadeinargumentsanddisputes;

nowweseethestrategicroletheyplayinnegotiations.

If𝑏 > 6,thelinefromT*willmeetthebargainingfrontieratapointsouth-

eastof(𝑎, 0).ItwillthereforecorrespondtoanegativepayoffforShaker,thatis,he

willendupwithwealthbelowhisoriginallevel.ItisasifheispayingMullentotake

hissonback!Thismaybeimpossible,andifMullen’sthreatT*isthatsevere,the

10Movieshavetheirownrequirementsofdramatictensionanddenouementthatoverridegame-theoreticlogic.Toconformwiththosedemands,Ransomdoesnothaveanyefficientresolutiononthebargainingfrontierwhereoneoftheplayersaccedestotheother’sdemand,buttwiststhatendinchasesandgunfights.ButthatisnotmaterialtothebasicbargaininggameIwanttoillustrate.

Page 7: Avinash Dixit, Princeton Universitydixitak/home/NashMemVolContrib_Dixit.pdf · 2016. 2. 25. · Avinash Dixit, Princeton University I had the privilege and pleasure of John and Alicia

7

outcomemaybeacornersolutionatQ.However,itisnotoutsidetherealmof

possibilitiesthatkidnappersagreetopaytoberidoftheirhostage,atleastinsome

otherbranchesoffiction.11

Thevariablethreatstrategyof“Thiswillhurtyoumorethanitwillhurtme”

hasbeenusedinreallife.Forexample,smartlaborunionsthreatenorlaunch

strikesattimeswhenthatwilldeliverthebiggesthittothefirms’profits.British

coalminers’uniondidthisconsistentlyinthe1970s.Conversely,Mrs.Thatcher’s

strategyofprovokingtheunion’sleaderArthurScargillintostrikinginthespring

andsummerof1984wasinstrumentalinthecollapseofthestrike,andledtoa

collapseoftheunionitself.

Thesamestrategywasusedinthebaseballstrikeof1980.12Thestrike

startedduringtheexhibitiongamesofpreseason.Theplayersreturnedtowork

(actually,toplay)atthestartoftheregularseason,butresumedthestrikeafter

MemorialDay.Thiscuriousdiscontinuousstrikecanbeunderstoodwhenwe

examinethetime-varyingcostsofthestriketothetwosides.Duringtheexhibition

gamesperiod,theplayersarenotpaidsalariesbuttheownersearnsubstantial

revenuesfromfanswhocombineavacationinawarmerclimewithfollowingtheir

favoriteteam’sstarsandprospects.Oncetheregularseasonstarts,theplayersget

salaries,butattendancesatgames,andthereforetheowners’revenues,grow

substantiallyonlyafterMemorialDay.Thereforethediscontinuousstrikewasthe

players’correctstrategytomaximizetheowners’lossrelativetotheirown.

11InO.Henry’sshortstory“TheRansomofRedChief,”twosmall-timecrookskidnapabanker’s10-year-oldson.Heturnsouttobeabratwhomakestheirlivessoimpossiblethattheypaythefathertotakehimback.Thetextisavailablefromhttp://fiction.eserver.org/short/ransom_of_red_chief.html,accessedFebruary17,2016.12LawrenceM.DeBrockandAlvinE.Roth,“StrikeTwo:Labor-managementnegotiationsinmajorleaguebaseball,”BellJournalofEconomics12(2):413-425,1981.

Page 8: Avinash Dixit, Princeton Universitydixitak/home/NashMemVolContrib_Dixit.pdf · 2016. 2. 25. · Avinash Dixit, Princeton University I had the privilege and pleasure of John and Alicia

8

ConcludingComments

Youmayhavealreadyforgottentheformaldefinitionsofvariablethreat

bargaining,butIguaranteethatyouwillnotforgettheexamples.Andwiththe

examplesinmind,anymathematicianwilleasilybeabletoreconstructthe

formalism.ThereforeIhopeIhaveconvincedreadersofthemeritsofthe

pedagogicalphilosophyIamhappytohavesharedwithJohnNash:vividexamples

canconveyconceptsandevenformalmethodsofmathematicaltheoriesbetterand

morememorablythanpurelyalgebraicorsymbolicstatements.