106
Consumer Behavior Consumer Behavior Modeling Modeling Linling He, Xiaoyan Liu, and Linling He, Xiaoyan Liu, and Muhong Zhang Muhong Zhang April 29, 2005 April 29, 2005

Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

  • View
    214

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Consumer Behavior Consumer Behavior ModelingModeling

Linling He, Xiaoyan Liu, and Muhong Linling He, Xiaoyan Liu, and Muhong ZhangZhang

April 29, 2005April 29, 2005

Page 2: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Consumer Behavior Consumer Behavior ModelingModeling

OutlinesOutlinesChoice-Based Model in Revenue Choice-Based Model in Revenue ManagementManagement

Literature Review in Inventory ComLiterature Review in Inventory Competition Modelpetition ModelChoice based inventory competitioChoice based inventory competition Modeln Model

Page 3: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Why Model Consumer Why Model Consumer Behavior?Behavior? Usually in RM or inventory control, we Usually in RM or inventory control, we

start our analysis with some set of start our analysis with some set of assumptions assuming an underlying assumptions assuming an underlying stochastic or deterministic demand stochastic or deterministic demand processprocess

What if…What if…– assumptions are incorrect assumptions are incorrect – our model parameters are unknown?our model parameters are unknown?

Page 4: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Why Model Consumer Why Model Consumer Behavior? (cont)Behavior? (cont) Example: Example:

– Two classes of tickets (low/high fares)Two classes of tickets (low/high fares)– Flexible customer, but buys low fare when Flexible customer, but buys low fare when

availableavailable– An air-line chooses reserve level for the An air-line chooses reserve level for the

high-fare tickets based on historical data high-fare tickets based on historical data on saleson sales

– What happens if we neglect to account for What happens if we neglect to account for consumer’s choice behavior?consumer’s choice behavior?

““Spiral Down Effect”Spiral Down Effect”

Page 5: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Choice-Based Model in Choice-Based Model in Revenue ManagementRevenue Management

HistoryHistory Motivation for choice modelingMotivation for choice modeling Single-leg ModelSingle-leg Model

– Dynamic Programming FormulationDynamic Programming Formulation Network RM ModelNetwork RM Model

– Dynamic Programming FormulationDynamic Programming Formulation– Deterministic LP FormulationDeterministic LP Formulation– Asymptotic optimalityAsymptotic optimality

Page 6: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.1 What is Revenue 1.1 What is Revenue Management?Management?

Before 1972: controlled bookingBefore 1972: controlled booking Around 70’s: discount/full fare seat Around 70’s: discount/full fare seat

inventory controlinventory control Littlewood (1972) marked the beginning Littlewood (1972) marked the beginning

of of Yield Management.Yield Management.“…“…Discount fare booking should be accepted Discount fare booking should be accepted

as long as their revenue value exceeded the as long as their revenue value exceeded the expected revenue of future full fair expected revenue of future full fair bookings…”bookings…”

Single-leg control, segment control, Single-leg control, segment control, origin-destination controlorigin-destination control

Page 7: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.1 What is Revenue 1.1 What is Revenue Management? (cont)Management? (cont)

Practice of controlling the Practice of controlling the availabilityavailability and/or and/or pricingpricing of travel seats in of travel seats in different booking classesdifferent booking classes with the goal of with the goal of maximizingmaximizing expected revenuesexpected revenues or or profits. profits.

Fundamental revenue management decision: Fundamental revenue management decision: whether or not to accept or reject this bookingwhether or not to accept or reject this booking

Key areas of researchKey areas of research– ForecastingForecasting– OverbookingOverbooking– Seat inventory controlSeat inventory control– pricingpricing

Page 8: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.1 What is Revenue 1.1 What is Revenue Management (cont)Management (cont)

Consumer Behavior Consumer Behavior and Demand and Demand ForecastingForecasting– Demand volatilityDemand volatility– Sensitivity to pricing Sensitivity to pricing

actionsactions– Demand dependencies Demand dependencies

btwn different booking btwn different booking classesclasses

Control SystemControl System– Booking lead timeBooking lead time– OverbookingOverbooking– Leg-based, segment-Leg-based, segment-

based, or full ODF controlbased, or full ODF control

Revenue FactorsRevenue Factors– Fare valuesFare values– Frequent flyer Frequent flyer

redemptionsredemptions– Cancellation penalties or Cancellation penalties or

restrictionsrestrictions Variable Cost FactorsVariable Cost Factors

– Marginal costs per Marginal costs per passengerpassenger

– Denied boarding Denied boarding penaltiespenalties

Problem ScaleProblem Scale– Large airline or airline Large airline or airline

alliancealliance

Page 9: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.2 Motivation for Choice 1.2 Motivation for Choice Modeling (cont) Modeling (cont)

Choices among fare productsChoices among fare products

Y $320 Unrestricted

Q $189 Nonrefundable

Flight AB123

Page 10: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.2 Motivation for Choice 1.2 Motivation for Choice Modeling (cont)Modeling (cont)

Choice among multiple departure Choice among multiple departure times between same ODtimes between same OD

6:50 AMOpen: Y, M, B, Q

9:15 AMOpen: Y, M Closed: Q, B

1:10 PMOpen: Y, M, B Closed: Q

Page 11: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.2 Motivation for Choice 1.2 Motivation for Choice Modeling (cont)Modeling (cont)

Choice among different routingChoice among different routing

Long Beach

Oakland

New York

Q Class: nonstop flight $154

Q class, connecting flight $179

Page 12: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005
Page 13: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.2 Motivation for Choice 1.2 Motivation for Choice ModelingModeling

Traditional model:Traditional model:– Demand is mutually statistically independent and Demand is mutually statistically independent and

also unaffected by the availability control.also unaffected by the availability control.– Heuristic correction: “buy-up” “buy-down”Heuristic correction: “buy-up” “buy-down”– But, traditional RM techniques are limited!But, traditional RM techniques are limited!– More over…More over…

Competition is fundamentally about choice…Competition is fundamentally about choice…

It is natural to consider It is natural to consider Consumer Behavior Consumer Behavior Models!Models!

Page 14: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.3 Single-leg Model1.3 Single-leg Model

Traditional ModelTraditional Model

)0(reject or )1(accept

}1,0{

.decision..ect accept/rejan is Control

0...

j class fare of revenue

j) classfor request is P(Arrival

classesfareofset},...,2,1{

periodstime,...1

21

jj

j

n

j

j

uu

u

rrr

r

λ

nN

Tt

(At most one arrival per period)

Page 15: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.3 Single-leg Model (cont)1.3 Single-leg Model (cont)

Discrete DP FormulationDiscrete DP Formulation

Njtjtjj

tjjtjjjNju

t

t

xVuxVr

xVuxVurxV

xV

x

t

n

)(}))(max{(

)}()1())(({{max)(

equationBellman

function value)(

remaining seats ofnumber

remaining time

11

11}1,0{

capacity of valuemarginal exp.

)1()()( where 111

xVxVxV ttt

Page 16: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.3 Single-leg Model (cont)1.3 Single-leg Model (cont)

Bid price decision rule: Open class j iff…Bid price decision rule: Open class j iff…

)(1 xVr tj

Open class j if the revenue of class j is greater than or equal to the marginal value of extra capacity

Page 17: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.3 Single-leg Model (cont)1.3 Single-leg Model (cont)

Nested allocation decision rule: Nested allocation decision rule:

i i nested protection level for class i or highernested protection level for class i or higher

2

1

3

aircraft cabin

Page 18: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.3 Single-leg Model (cont)1.3 Single-leg Model (cont)

Traditional model assumes a arrival pattern for Traditional model assumes a arrival pattern for class j, does not consider consumer’s choice class j, does not consider consumer’s choice

In reality, each customer makes a In reality, each customer makes a choicechoice among among the fare products that are offered the fare products that are offered (Talluj and van Ryzin)(Talluj and van Ryzin)

Control decision now: which products do we make Control decision now: which products do we make available? available?

ProductProduct 21-Day21-Day FareFare

YY NoNo $800$800

MM YesYes $500$500

QQ YesYes $450$450

No PurchaseNo Purchase

Page 19: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.3 Single-leg Model (cont)1.3 Single-leg Model (cont)

ExampleExample– Discounts:Discounts:

– Customer Segments:Customer Segments:

ProductProduct SA-SA-StayStay

21-Day21-Day FareFare

YY NoNo NoNo $800$800

MM NoNo YesYes $500$500

QQ YesYes YesYes $450$450

Qualify for RestrictionQualify for Restriction Willing to Buy?Willing to Buy?

SegmentSegment %Pop%Pop SA StaySA Stay 21-Day 21-Day AdvAdv

Y ClassY Class M ClassM Class

Business Business 11

10%10% NoNo NoNo YesYes YesYes

Business Business 22

20%20% NoNo YesYes YesYes YesYes

Leisure 1Leisure 1 20%20% YesYes NoNo NoNo YesYes

Leisure 2Leisure 2 20%20% YesYes YesYes No No YesYes

Leisure 3Leisure 3 30%30% YesYes YesYes NoNo NoNo

Page 20: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.3 Single-leg Model (cont)1.3 Single-leg Model (cont)

Each offer set leads to a different Each offer set leads to a different outcome…outcome…

Ex. If we offer the full fare (Y) and the Ex. If we offer the full fare (Y) and the 21-Day advance purchase discount (M), 21-Day advance purchase discount (M), thenthen

10% buy full fare (Y)10% buy full fare (Y)

40% buy 21-Day discount (M)40% buy 21-Day discount (M)

50% do not buy50% do not buy

Why?Why?

Page 21: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.3 Single-leg Model (cont)1.3 Single-leg Model (cont)

The revised single-leg modelThe revised single-leg model

)S | j choosecustomer ()(

tat time products fareopen ofset

set"...offer "an now is t each timeat Control

0...

j class fare of revenue

period)in arrives P(customer

classesfareofset},...,2,1{

periodstime,...1

nformulatio gprogrammin dynamic timeDiscrete

t

21

PSP

NS

rrr

r

λ

nN

Tt

tj

t

n

j

Page 22: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.3 Single-leg Model (cont)1.3 Single-leg Model (cont)

Revised choice-based DPRevised choice-based DPt time remainingx number of seats remainingVt(x) value functionPj(S) probability of choosing j given offer set S

Bellman’s Equation:

tt

tt

Sjttjtj

NS

tttjtjSj

NSt

xVxVrSP

xVSPxVrSPxV

)())}()(({max

)}()1)(())1()((({max)(

11

101

(1)

Page 23: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.3 Single-leg Model (cont)1.3 Single-leg Model (cont)

Efficient Sets: A set T is said to be inefficient if a Efficient Sets: A set T is said to be inefficient if a mixture of other offer sets can be used to mixture of other offer sets can be used to generate more revenue for the same (or lower generate more revenue for the same (or lower consumption rate.consumption rate.

Mathematically:Mathematically: set of convex weights set of convex weights (S), S(S), SN satisfying N satisfying S S

(S)=1 and (S)=1 and (S)>=0, (S)>=0, S SN such thatN such thatR(T)< R(T)< S S (S)R(S)(S)R(S)Q(T)Q(T) S S (S)Q(S)(S)Q(S)

R(S)=expected revenueR(S)=expected revenueQ(S)=probability of selling a unit using offer set SQ(S)=probability of selling a unit using offer set S

Page 24: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.3 Single-leg Model (cont)1.3 Single-leg Model (cont)

An optimal policy:An optimal policy: select a set select a set kk** from among the from among the mm efficient, efficient,

ordered sets ordered sets {S{Skk: k=1,…m}: k=1,…m}, where , where SS11SS22… … SSm m that maximizes (1). that maximizes (1).

For a fixed t, the largest optimal index For a fixed t, the largest optimal index kk** is is increasing in the remaining capacity increasing in the remaining capacity xx, ,

For any fixed For any fixed xx, , kk** is decreasing in the is decreasing in the remaining time t.remaining time t.

Page 25: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

0

100

200

300

400

500

600

0 0.1 0.2 0.3 0.4 0.5 0 .6 0.7 0 .8 0.9 1

Q(S)

R(S)

{Y,Q}

{Y,Q,M}

{Y}

0

100

200

300

400

500

600

0 0.1 0.2 0.3 0.4 0.5 0 .6 0.7 0 .8 0.9 1

Q(S)

R(S)

{Y,Q}

{Y,Q,M}

{Y}

0

100

200

300

400

500

600

0 0.1 0.2 0.3 0.4 0.5 0 .6 0.7 0 .8 0.9 1

Q(S)

R(S)

{Y,Q}

{Y,Q,M}

{Y}

3 efficient combinations: {Y}, {Y,Q}, {Y,Q,M}These are the only combinations we should consider!

An “efficient frontier

inefficient offer sets

Page 26: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Optimal policy: Optimal policy: Use efficient sets in this order Use efficient sets in this order as capacity / time changeas capacity / time change

1.3 Single-Leg Model (cont)1.3 Single-Leg Model (cont)

0

100

200

300

400

500

600

0 0.1 0.2 0.3 0.4 0.5 0 .6 0.7 0 .8 0.9 1

Q(S)

R(S)

{Y,Q}

{Y,Q,M}

{Y}

0

100

200

300

400

500

600

0 0.1 0.2 0.3 0.4 0.5 0 .6 0.7 0 .8 0.9 1

Q(S)

R(S)

{Y,Q}

{Y,Q,M}

{Y}

0

100

200

300

400

500

600

0 0.1 0.2 0.3 0.4 0.5 0 .6 0.7 0 .8 0.9 1

Q(S)

R(S)

{Y,Q}

{Y,Q,M}

{Y}

More capacity/Less time

Less capacity/more time

Optimal policy: Use efficient sets in this order as capacity/time change

Page 27: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.3 Single-leg Model (cont)1.3 Single-leg Model (cont)

Notice what’s “odd” in this example!Notice what’s “odd” in this example!– It can be optimal to offer deep discount (Q) It can be optimal to offer deep discount (Q)

but but NOTNOT the moderate discount (M). Why? the moderate discount (M). Why? Some business customers who buy the full fare Some business customers who buy the full fare

may “buy-down” to M if it is offeredmay “buy-down” to M if it is offered Leisure customers will not buy full fare anywayLeisure customers will not buy full fare anyway

– Numerical examples show revenue Numerical examples show revenue benefits over standard methods can be benefits over standard methods can be very large.very large.

Page 28: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.3 Single-leg Model (cont)1.3 Single-leg Model (cont)

A variety of choice models can be used…A variety of choice models can be used…– MNL (MNL (The ratio of the probabilities of any two The ratio of the probabilities of any two

alternatives is independent from the choice alternatives is independent from the choice setset.).)

– But there are But there are manymany other possibilities… other possibilities… Finite mixture logitFinite mixture logit Nested logitNested logit General random utilityGeneral random utility

weightsoftor vec

price) (e.g. attributes ofr vecto )(

j

Si

y

y

j

y

e

eSP

iT

jT

Page 29: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.4 Network RM Model1.4 Network RM Model

Figure 1: Two-fareclasses airlinenetwork

Page 30: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.4 Network RM Model (cont)1.4 Network RM Model (cont)

m = no. of legsm = no. of legsn = no. of products (itinerary x fare-class combo)n = no. of products (itinerary x fare-class combo)N = {1,…n}=set of all productsN = {1,…n}=set of all products

c = (cc = (c11,…c,…cmm)=initial capacity)=initial capacity

rj rj = revenue of fare-product j= revenue of fare-product j

A = [aA = [aijij]]mxnmxn=incidence matrix (a=incidence matrix (aijij=1 if leg i is use for =1 if leg i is use for product j)product j)

AAj j = incidence vector for product j= incidence vector for product j

AAi i = incidence vector for leg I= incidence vector for leg I = prob. Of an arrival in each time period= prob. Of an arrival in each time period

Page 31: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.4 Network RM Model (cont)1.4 Network RM Model (cont)

Control: set of products to make available at each point in Control: set of products to make available at each point in time, i.e. offer set, Stime, i.e. offer set, SNN

PPjj(S) = prob. of arriving customer chooses fare-product j (S) = prob. of arriving customer chooses fare-product j given offer set Sgiven offer set S

PP00(S) = prob. Of no purchase(S) = prob. Of no purchase

jjSSPPjj(S)+P(S)+P00(S)=1(S)=1

DecisionDecision: find an optimal policy for choosing : find an optimal policy for choosing the offer set S at each time t and giving the the offer set S at each time t and giving the remaining capacity x such that their total remaining capacity x such that their total expected revenue is maximized.expected revenue is maximized.

Page 32: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.4 Network RM Model (cont)1.4 Network RM Model (cont)

Dynamic Programming Dynamic Programming formulationformulation

)()()()(max

)()1)(())()((max

)(

111

101

xVAxVxVrSP

xVSPAxVrSP

functionvaluexV

tSj

jttjjNS

Sjtjtjj

NS

t

Boundary Conditions: Vt(0)=0 t=1,…,TVT+1(x)=0 x0

Page 33: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.4 Network RM Model (cont)1.4 Network RM Model (cont)

DP not solvable for most realistic DP not solvable for most realistic network due to the large network due to the large dimensionality of the state spacedimensionality of the state space

Use Use Deterministic ApproximationDeterministic Approximation with stochastic quantities with stochastic quantities replaced by mean values and replaced by mean values and assume continuous capacities and assume continuous capacities and demanddemand

Page 34: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.4 Network RM Model 1.4 Network RM Model (cont)(cont) R(S) = expected revenuR(S) = expected revenu

e from an arriving custoe from an arriving customer when S is offered.mer when S is offered.

P(S)=vector of purchasP(S)=vector of purchase probabilitiese probabilities

QQii(S) = probability of usi(S) = probability of using a unit of capacity on ng a unit of capacity on leg i, i=1,…,m, given S.leg i, i=1,…,m, given S.

Sj

jj SPrSR )()(

)(

))(),...(()( 1

SAP

SQSQSQt

m

Page 35: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.4 Network RM Model 1.4 Network RM Model (cont)(cont) Choice-Based Deterministic LP Choice-Based Deterministic LP

(CDLP)(CDLP)

: )(

: )( )( ..

)( )(max

TSt

xStSAPts

StSRV

NS

NS

NS

CDLP

Max. total revenue

Consumption less than capacity

Total time sets offered less than horizon length

S = subset of available (open) products (the offer set)Decision variables: t(S) = Total time subset S is offered

Page 36: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.4 Network RM Model 1.4 Network RM Model (cont)(cont)

This LP has an exponential number of variables! This LP has an exponential number of variables! How do we solve it?How do we solve it?– Gallego et al. show for special classes of choice models, LP Gallego et al. show for special classes of choice models, LP

can be solved relatively efficiently using can be solved relatively efficiently using column generationcolumn generation

Ex: Customers belong to Ex: Customers belong to LL segment and each segment and each segment segment ll– Has a disjoint Has a disjoint consideration setconsideration set CCll

– Makes multinomial logit (MNL) choice among products in Makes multinomial logit (MNL) choice among products in CCll

Then columns can be generated by a simple Then columns can be generated by a simple ranking procedure (linear complexity in |ranking procedure (linear complexity in |CCll|)|)

? )()(max

SAPSR

NS

Page 37: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.4 Network RM Model (cont)1.4 Network RM Model (cont)

Asymptotic optimality Asymptotic optimality (van Ryzin & Liu 2004(van Ryzin & Liu 2004))

Theorem: Consider scaled problem in which capacity and time are both increased by the same factor ….

Let t*(S) denote the optimal solution to the original choice-based LP. Then the solution t*(S) is asymptotically optimal for the corresponding stochastic dynamic network choice problem (suitably defined).

Capacity = xTime horizon = T

Page 38: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.4 Network RM Model (cont)1.4 Network RM Model (cont)

How do we use the choice-based DLP How do we use the choice-based DLP solution?solution?

– Directly apply time variables Directly apply time variables t*(S) t*(S) (Gallego et al. 2004)(Gallego et al. 2004)

– Discard primal solution, but use dual Discard primal solution, but use dual information in a decomposition heuristic information in a decomposition heuristic and other analysis and other analysis

(van Ryzin & Liu 2004)(van Ryzin & Liu 2004)

Page 39: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.4 Network RM Model (cont)1.4 Network RM Model (cont)

Dual of CDLP:Dual of CDLP:

Page 40: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.4 Network RM Model (cont)1.4 Network RM Model (cont)

Prop. 3 A set T is efficient if and only if for Prop. 3 A set T is efficient if and only if for some some =(=(11,…,,…,mm))tt0, T is the optimal solution 0, T is the optimal solution to to

maxmaxSS{R(S)- {R(S)- ttQ(S)}.Q(S)}.

Prop. 4 If tProp. 4 If t**(T)>0 in the optimal solution to (T)>0 in the optimal solution to the CDLP, then T is an efficient set. the CDLP, then T is an efficient set.

Prop. 5 If Q(SProp. 5 If Q(S22))Q(SQ(S11), then R(S), then R(S22) ) R(SR(S11). ). – Efficient sets are partially order. (compare to the Efficient sets are partially order. (compare to the

single-leg problem)single-leg problem)

Page 41: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.4 Network RM Model (cont)1.4 Network RM Model (cont)

Can solution to Single-leg RM problem Can solution to Single-leg RM problem be applied to Network RM?be applied to Network RM?– VVt-1t-1(x)-V(x)-Vt-1t-1(x-A(x-Ajj) is not additive in A) is not additive in Ajj

– In general, efficient sets are In general, efficient sets are notnot the only the only optimal solution to the original DP. optimal solution to the original DP.

– Special case: additivity property holds if Special case: additivity property holds if each product uses only a single legeach product uses only a single leg

– But, by our Asymptotic optimality But, by our Asymptotic optimality condition, the efficient sets are condition, the efficient sets are asymptotically optimal for the DP. asymptotically optimal for the DP.

Page 42: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.4 Network RM Model (cont)1.4 Network RM Model (cont)

Simulation-based optimization in network Simulation-based optimization in network RMRM

Basic Idea:Basic Idea:

1.1. Define a Define a parametric classparametric class of policies (e.g. of policies (e.g. booking limit, bid price)booking limit, bid price)

2.2. Use simulation and sensitivity information Use simulation and sensitivity information to to optimize the policy parameters.optimize the policy parameters.

Page 43: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

1.5 Summary1.5 Summary

Traditional RMTraditional RM Choice-based RMChoice-based RM

DemandDemand Stochastic demand for Stochastic demand for productsproducts

Stochastic choice by Stochastic choice by customerscustomers

ControlsControls Accept/rejectAccept/reject Offer setsOffer sets

ForecastsForecasts Time series by productTime series by product

Censored dataCensored dataDiscrete choice model Discrete choice model estimationestimation

Unobserved no-Unobserved no-purchasepurchase

OptimizationOptimization Single leg DP\EMSR Single leg DP\EMSR heuristicsheuristics

Deterministic LPDeterministic LP

Choice DPChoice DP

Deterministic choice-Deterministic choice-based LPbased LP

Simulation-based Simulation-based OptimizationOptimization

Page 44: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Consumer Behavior Consumer Behavior ModelingModeling

OutlinesOutlinesChoice-Based Model in Revenue Choice-Based Model in Revenue ManagementManagement

Literature Review in Inventory ComLiterature Review in Inventory Competition Modelpetition ModelChoice based inventory competitioChoice based inventory competition Modeln Model

Page 45: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Outline – Literature Outline – Literature Review on Inventory Review on Inventory CompetitionCompetition Parlar (1988) – 2-firm modelParlar (1988) – 2-firm model

Existence and Uniqueness of NEExistence and Uniqueness of NE Maxmin strategyMaxmin strategy Cooperation between playersCooperation between players

Lippman and McCardle (1994)Lippman and McCardle (1994) Results on 2-firm modelResults on 2-firm model Summary of N-firm modelSummary of N-firm model

Page 46: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

2.1 Literature Review in 2.1 Literature Review in Inventory Competition Inventory Competition ModelModel

Parlar (1988) - Parlar (1988) - 2-Firm Model 2-Firm Model Existence of NEExistence of NE Uniqueness of NEUniqueness of NE Maxmin strategyMaxmin strategy Cooperation between playersCooperation between players

Page 47: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Literature Review in Literature Review in Inventory Competition Inventory Competition ModelModel

2-Firm Model Assumptions: 2-Firm Model Assumptions:

1.1. Single period, Single productSingle period, Single product

2.2. Independent random demand at each Independent random demand at each firmfirm

3.3. Substitution of products allowedSubstitution of products allowed

4.4. Deterministic fraction of excess demand Deterministic fraction of excess demand substitutes to alternativessubstitutes to alternatives

5.5. No price competitionNo price competition

6.6. Continuous and strictly increasing CDFContinuous and strictly increasing CDF

Page 48: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Literature Review in Literature Review in Inventory Competition Inventory Competition ModelModelNotations:Notations: ppii : shortage cost/unit for firm i’s product : shortage cost/unit for firm i’s product ssii: sales price/unit of firm i’s product: sales price/unit of firm i’s product ccii: order cost/unit for firm i’s product: order cost/unit for firm i’s product qq ii: savage value of firm i’s product: savage value of firm i’s product DDii: random demand of firm i’s product ~ F: random demand of firm i’s product ~ Fii(y)(y) bb ii: fraction of firm i’s demand which will switch t: fraction of firm i’s demand which will switch t

o firm j’s product when it is sold out at firm io firm j’s product when it is sold out at firm i xx ii: order quantity of each firm: order quantity of each firm

Page 49: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Literature Review in Literature Review in Inventory Competition Inventory Competition ModelModelPlayer i’s Expected Profit Function:Player i’s Expected Profit Function:

}])(,min{[),( jjjiiiDjii xDbDxsExx

}]0,max{[ iiiiiD xDpxcE

)}])((,0max{[ jjjiiiD xDbDxqE

Sales price

Savage

valueOrder cost

Penalty cost

}])(,min{[),( jjjiiiDjii xDbDxsExx

Page 50: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Comparison Comparison

Recall the game theory version of the Recall the game theory version of the newsvendor model introduced in class newsvendor model introduced in class in week 8.in week 8.

It is a compact version of Parlar’s model It is a compact version of Parlar’s model without two terms: savage value and without two terms: savage value and penalty cost. Also, bpenalty cost. Also, bii is set to be one. is set to be one.

Conclusion on that model: the expected Conclusion on that model: the expected profit function is concave, and by profit function is concave, and by Theorem (Debrea, 1952), there exists at Theorem (Debrea, 1952), there exists at least one pure strategy NE in the game.least one pure strategy NE in the game.

Page 51: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Discussion on Nash Discussion on Nash EquilibriumEquilibrium

Nash Equilibrium (xNash Equilibrium (x11*,x*,x22*) satisfies:*) satisfies:

),(),( *211

*2

*11 xxxx ),(),( 2

*11

*2

*12 xxxx

Best response functions Ii are obtained as below: 0),( 211

1

1

xxIx

0),( 212

2

2

xxIx

0),(

1

2112

1

12

x

xxI

x

0

),(

2

2122

2

22

x

xxI

x

Strict Concavity of profit functions:

Page 52: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Discussion on Nash Discussion on Nash EquilibriumEquilibrium

1

1 0 111112111

1 )()()(),(x

xdxxfqdxxfpsxxI

x

Best response functions I1 : 0),( 2111

1

xxIx

In more details,

0)()()( 10 1211

1

22

1

cdydxxfyfqs

x

xb

xx

Thinking x2 as a function of x1 in I1(x1,x2)=0, we can obtain:

0)()()(

)()()()(1|

22

120 111

11221111

21

2

11

dxxb

xxfxfqs

xfpxFxfqs

bdx

dxxI

Page 53: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Discussion on Nash Discussion on Nash EquilibriumEquilibrium

Similarly, thinking x2 as a function of x1 in I2(xx11,,xx22)=0, we can obtain the following by implicit differentiation on both sides of I2(xx11,x,x22)=0 over x1:

0)(])()(

1)()()[(

)()()(

|

22211

210 2

1221122

0 11

21222

1

2

2

2

2

xfpdyx

byx

fyfb

xfxFqs

dyxb

yxfyfqs

dx

dxx

x

I

Page 54: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Discussion on Nash Discussion on Nash EquilibriumEquilibriumSummary:Summary: The expected profit function is strictly concaveThe expected profit function is strictly concave The best response curve for each player is The best response curve for each player is

strictly decreasing in the (xstrictly decreasing in the (x11,x,x22) plane. ) plane. Since the derivative of xSince the derivative of x22 relative to x1 is relative to x1 is

negative for player 2, xnegative for player 2, x22 is upper bounded when is upper bounded when xx11=0, x=0, x22 is lower bounded by some value when is lower bounded by some value when xx11 approaches positive infinity. approaches positive infinity.

Since the derivative of xSince the derivative of x22 relative to x1 is relative to x1 is negative for player 1 as well, xnegative for player 1 as well, x11 is upper is upper bounded when xbounded when x22=0, x=0, x11 is lower bounded by is lower bounded by some value when xsome value when x22 approaches positive infinity. approaches positive infinity.

Page 55: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Discussion on Nash Discussion on Nash EquilibriumEquilibrium

X1=u

X2=v

Page 56: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Discussion on Nash Discussion on Nash EquilibriumEquilibrium

Theorem: There exists a unique Nash Equilibrium (xTheorem: There exists a unique Nash Equilibrium (x11*,*,xx22*)*)

Proof:Proof:Existence: follow from the properties of the best respExistence: follow from the properties of the best resp

onse functions, or follow from strict concavity of thonse functions, or follow from strict concavity of the expected profit function due to e expected profit function due to Theorem Theorem (Debrea, 1952)(Debrea, 1952)

Uniqueness: can be proven by using strict monotone-Uniqueness: can be proven by using strict monotone-decreasing properties of the best response functiondecreasing properties of the best response functions and showing the following inequality :s and showing the following inequality :

21||

1

2

1

2II dx

dx

dx

dx

Page 57: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Maxmin Strategy of FirmsMaxmin Strategy of Firms

Consider the following Scenario:Consider the following Scenario: Firm 2 acts irrationally to minimize the profit of Firm 2 acts irrationally to minimize the profit of

firm 1 as much as possible.firm 1 as much as possible. Firm 1 acts to maximize its profit under the Firm 1 acts to maximize its profit under the

assumption that firm 2 tries to minimize firm 1’s assumption that firm 2 tries to minimize firm 1’s profit as much as possibleprofit as much as possible

Since the demands are independent at each firm, Since the demands are independent at each firm, the only way for the firm 2 to affect firm 1’s profit the only way for the firm 2 to affect firm 1’s profit negatively is not to lose any customer of its own. negatively is not to lose any customer of its own. => Firm 2 will order infinitely many units. => Firm 2 will order infinitely many units.

Page 58: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Maxmin Strategy of FirmsMaxmin Strategy of Firms

Results:Results: Based on our assumption, firm 1 will know firm 2 orders iBased on our assumption, firm 1 will know firm 2 orders i

nfinitely amount of units. Hence, firm 1 will maximize its nfinitely amount of units. Hence, firm 1 will maximize its own profit assuming no exogenous demand from firm 2 own profit assuming no exogenous demand from firm 2

=> traditional newsvendor model with no product => traditional newsvendor model with no product substitutionsubstitution Using maxmin strategy, each firm will obtain lower expecUsing maxmin strategy, each firm will obtain lower expec

ted profits since it loses the chance to make profit from thted profits since it loses the chance to make profit from the other firm’s demand. e other firm’s demand.

=> any strategy other than the one trying to => any strategy other than the one trying to damage each other could bring more expected damage each other could bring more expected profits profits

Page 59: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Discussion on Nash Discussion on Nash EquilibriumEquilibrium

X1=u

X2=v

Page 60: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Cooperation between Cooperation between FirmsFirms

Consider the following scenario:Consider the following scenario: The two firms decide to cooperate with The two firms decide to cooperate with

each other so that it does not incur each other so that it does not incur penalty cost if the competitor satisfies penalty cost if the competitor satisfies the corresponding demand. the corresponding demand.

The objective is trying to maximize the The objective is trying to maximize the total profits from both firmstotal profits from both firms

Since only the penalty cost is affected, we Since only the penalty cost is affected, we can easily modify the objective function:can easily modify the objective function:

Page 61: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Cooperation between Cooperation between FirmsFirms

Expected Profit Function: Expected Profit Function:

}])(,min{[),(' jjjiiiDjii xDbDxsExx

}]0),)(1max{([ iiiiiiD xDbpxcE

)}])((,0max{[ jjjiiiD xDbDxqE

Sales price

Savage

value

Order cost

Penalty cost

}]0,)()(max{[ jjiiiiD DxxDbpE

),(),(),( ''jijjiijic xxxxxx

where

Extra term

Page 62: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Cooperation between Cooperation between FirmsFirmsResults:Results: The total profit under cooperation is shown to The total profit under cooperation is shown to

be larger than the sum of profits obtained be larger than the sum of profits obtained without cooperation. without cooperation.

=> increase the social welfare by cooperation=> increase the social welfare by cooperation Finding the optimal solution (xFinding the optimal solution (x11*,x*,x22*) can be *) can be

done by solving a mathematical done by solving a mathematical programming.programming.

),(max0,0

jicxx

xxji

Page 63: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Weakness of this Weakness of this ModelModel The assumption of the independent demanThe assumption of the independent deman

d is not reasonable sometimes.d is not reasonable sometimes.

This motivates the paper by Lippman and McThis motivates the paper by Lippman and McCardle (1994)Cardle (1994)

Page 64: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

2.2 Another model2.2 Another model

Lippman and McCardle (1994)Lippman and McCardle (1994) Instead of the individual demand, aggregatInstead of the individual demand, aggregat

e demand is a random variable with a contie demand is a random variable with a continuous distribution, thus isolating the pure inuous distribution, thus isolating the pure impact of competition for consideration.mpact of competition for consideration.

Consider the allocation of aggregate industConsider the allocation of aggregate industry demand to each firm, thus allowing the iry demand to each firm, thus allowing the individual demand to be correlated.ndividual demand to be correlated.

Page 65: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Model AssumptionsModel Assumptions

No price competitionNo price competition Industry demand does not change with the Industry demand does not change with the

number of firms, and is allocated to each firm number of firms, and is allocated to each firm based on some initial allocation rules, which is based on some initial allocation rules, which is known to all firms before the competition starts. known to all firms before the competition starts.

=> allow demand to be correlated.=> allow demand to be correlated. Deterministic fraction of excess demand is Deterministic fraction of excess demand is

reallocated to other firms based on some reallocated to other firms based on some reallocation rules, through which a firm’s reallocation rules, through which a firm’s decision impacts the other firms in the industry.decision impacts the other firms in the industry.

Page 66: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Initial Allocation RulesInitial Allocation Rules

Rule 1: Deterministic splittingRule 1: Deterministic splitting Rule 2: Simple random splittingRule 2: Simple random splitting Rule 3: Incremental random splittingRule 3: Incremental random splitting Rule 4: Independent random demandsRule 4: Independent random demands

For simplicity of discussion, the For simplicity of discussion, the aggregate industry demand D is aggregate industry demand D is assumed to be uniformly distributed on assumed to be uniformly distributed on [0,1] from now on unless specified [0,1] from now on unless specified otherwise.otherwise.

Page 67: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Deterministic SplittingDeterministic Splitting

Example 1 – linear splitting:Example 1 – linear splitting:

DD11==D, DD, D22=(1- =(1- )D (where 0=< )D (where 0=< <=1) <=1) This spitting rule is called nondecreasing, since This spitting rule is called nondecreasing, since

each firm’s share is nondecreasing in total each firm’s share is nondecreasing in total industry demand. industry demand.

DD1 1 has a continuous density provided D does. has a continuous density provided D does.

Example 2 – discontinuous splitting:Example 2 – discontinuous splitting:

DD11=D when D<=0.5 and D=D when D<=0.5 and D11=0 when D>0.5=0 when D>0.5 The distribution of DThe distribution of D11 has discontinuity has discontinuity

Page 68: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Simple Random Simple Random SplittingSplitting Example:Example:

Consider flipping a fair coin, Consider flipping a fair coin, P(DP(D11=0)=P(D=0)=P(D11=D)=0.5=D)=0.5 The probabilistic structure of DThe probabilistic structure of D11 is is

a mixture of 0 and a uniform random a mixture of 0 and a uniform random variable on [0,1], hence, Dvariable on [0,1], hence, D11 doesn’t doesn’t necessarily have a density when D necessarily have a density when D doesdoes

Page 69: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Incremental Random Incremental Random SplittingSplitting Incremental Random Splitting can Incremental Random Splitting can

be considered as applying the be considered as applying the simple random splitting rule to simple random splitting rule to each atom of the whole demand each atom of the whole demand DD

It is shown to be equivalent to the It is shown to be equivalent to the linear deterministic splitting rulelinear deterministic splitting rule

Page 70: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Duopoly Analysis Duopoly Analysis

Note: Note: Due to these splitting rules used to allocate the Due to these splitting rules used to allocate the

demand, the individual demand distribution demand, the individual demand distribution function might not have a density, or equivalently, function might not have a density, or equivalently, CDF is not continuous. CDF is not continuous.

Notation: Notation: XXjj : player j’s strategy space : player j’s strategy space jj(x(x11,x,x22): payoff of player j): payoff of player j X=XX=X1*1*XX22: the strategy space of the game: the strategy space of the game (x(x11,x,x22)=()=(11(x(x11,x,x22), ), 22(x(x11,x,x22)): the joint payoff function of )): the joint payoff function of

the gamethe game

Page 71: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

NotationsNotations

Notations:Notations: ppii : shortage cost/unit for firm i’s product : shortage cost/unit for firm i’s product ssii: sales price/unit of firm i’s product: sales price/unit of firm i’s product ccii: order cost/unit for firm i’s product: order cost/unit for firm i’s product qq ii: savage value of firm i’s product: savage value of firm i’s product D: aggregate industry demand ~unif (0,1)D: aggregate industry demand ~unif (0,1) DDii: demand allocated to firm i based on splitting rul: demand allocated to firm i based on splitting rul

es on Des on D RRii: effective demand of firm i’s product after consi: effective demand of firm i’s product after consi

dering the reallocation of demanddering the reallocation of demand bb ii: fraction of firm i’s demand which will switch t: fraction of firm i’s demand which will switch t

o firm j’s product when it is sold out at firm io firm j’s product when it is sold out at firm i xx ii: order quantity/inventory levels of each firm: order quantity/inventory levels of each firm RRii= = DDii + + bb j j(D(Djj-x-xjj))++

Page 72: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Nash Equilibrium in Nash Equilibrium in Duopoly gameDuopoly game Existence Theorem: A pure-strategy Existence Theorem: A pure-strategy

Nash equilibrium in inventory levels Nash equilibrium in inventory levels (x(x11,x,x22) exists.) exists.

Proof by Topkis theorem after showing:Proof by Topkis theorem after showing:– Strategy space is a complete latticeStrategy space is a complete lattice– Joint payoff function is upper semi-Joint payoff function is upper semi-

continuouscontinuous– Each firm’s payoff function is Each firm’s payoff function is

supermodularsupermodular

Page 73: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Duopoly Analysis Duopoly Analysis

Theorem 3.1 Topkis (1979)Theorem 3.1 Topkis (1979)

If the strategy space of X is a complete If the strategy space of X is a complete lattice (lattice (i.e. a nonempty partially ordered i.e. a nonempty partially ordered set in which every nonempty subset has a set in which every nonempty subset has a supremum and infimumsupremum and infimum) , the joint payoff ) , the joint payoff function is upper-semicontinuous and each function is upper-semicontinuous and each player’s payoff function is supermodular, player’s payoff function is supermodular, then there exists a pure strategy Nash then there exists a pure strategy Nash equilibrium. equilibrium.

Page 74: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Duopoly AnalysisDuopoly Analysis

One way to show One way to show supermodularity:supermodularity:

if f(x,z)-f(y,z) is nondecreasing in z if f(x,z)-f(y,z) is nondecreasing in z for all x>y, then f is for all x>y, then f is supermodular, i.e. f has supermodular, i.e. f has nondecreasing difference. nondecreasing difference.

Page 75: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Nash Equilibrium in Nash Equilibrium in Duopoly gameDuopoly game Show each firm’s payoff function is Show each firm’s payoff function is

supermodular (for simplicity, let the penalty cost supermodular (for simplicity, let the penalty cost and savage value be zero, the sales price s and and savage value be zero, the sales price s and the order cost c are the same for both firms):the order cost c are the same for both firms):

ijjjiiDjii cxxDbDxsExx }])(,[min{),(

Let’s show that 1(x1,x2)-1(y1,x2) is nondecreasing in x2 for all x1 >= y1

Page 76: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Nash Equilibrium in Nash Equilibrium in Duopoly GameDuopoly Game

Example (to gain some intuition for next theorem): Example (to gain some intuition for next theorem): Assume initial firm demands DAssume initial firm demands D11 and D and D22 are independently, are independently,

and each is uniformly distributed on [0,1]and each is uniformly distributed on [0,1] c=1,s=2, and bc=1,s=2, and b11=b=b22=1=1 Monopolist’s optimal inventory level x*: Monopolist’s optimal inventory level x*: P(D<x*) =(s-c)/s =0.5 (stockout P(D<x*) =(s-c)/s =0.5 (stockout

probability=p(D>x*)=0.5)probability=p(D>x*)=0.5)

=> P(D=> P(D11 + D + D22 <x*) =0.5 <x*) =0.5 => x*=1=> x*=1 In order to achieve the same stockout probability when we In order to achieve the same stockout probability when we

consider two competitive firms, we haveconsider two competitive firms, we have

P(DP(D11 + (D + (D22-x-x22))++<x<x11)=0.5)=0.5

=> (1-x=> (1-x11)+(1-x)+(1-x22))22/2=0.5/2=0.5

=> (1-x=> (1-x22)+(1-x)+(1-x11))22/2=0.5 (due to symmetry)/2=0.5 (due to symmetry)

Page 77: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Nash Equilibrium in Nash Equilibrium in Duopoly GameDuopoly Game Example (cont’d)Example (cont’d)

P(DP(D11 + (D + (D22-x-x22))++>x>x11)=0.5)=0.5 => (1-x=> (1-x11)+(1-x)+(1-x22))22/2=0.5/2=0.5 => (1-x=> (1-x22)+(1-x)+(1-x11))22/2=0.5 /2=0.5 We observe that the above leads to the We observe that the above leads to the

unique equilibrium inventory levels:unique equilibrium inventory levels: xx1*=x2*=2-2*=2-21/2 1/2 (Note: (Note:

xx1*+x2*>x*=1)*>x*=1)Games where the above procedure Games where the above procedure

converges to this game’s unique equilibrium, converges to this game’s unique equilibrium, are called dominance solvableare called dominance solvable

Supermodular games possessing a unique Supermodular games possessing a unique pure strategy nash equilibrium are pure strategy nash equilibrium are dominance solvable.dominance solvable.

Page 78: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Nash Equilibrium in Nash Equilibrium in Duopoly GameDuopoly Game Theorem:Theorem:

The pair (xThe pair (x1*,x2*) of inventory levels is a Nash *) of inventory levels is a Nash equilibrium if each firm stocks out with equilibrium if each firm stocks out with probability c/s:probability c/s:

P(DP(Dii + (D + (Djj-x-xjj*)*)++>x>xii*)=c/s*)=c/s

If the CDF of DIf the CDF of Dii is continuous, then this is continuous, then this condition is also necessary. Moreover, condition is also necessary. Moreover, when bwhen b11=b=b22=1, then x=1, then x1*+x2*>=x*: *>=x*: competition never leads to a decline in competition never leads to a decline in industry inventoryindustry inventory

Page 79: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Nash Equilibrium in Nash Equilibrium in Duopoly Game Duopoly Game Uniqueness is not guaranteed by the Uniqueness is not guaranteed by the

above theoremabove theorem Example:Example:

D is uniform on [0,1]D is uniform on [0,1]bb11=b=b22=1, c=4, s=9=1, c=4, s=9Deterministic splitting ruleDeterministic splitting rule DD11 = D/2, if D€[0,4/9) = D/2, if D€[0,4/9) DD11 = D, if D€[4/9, 5/9) = D, if D€[4/9, 5/9)

DD11 = 0, if D€[5/9,1] = 0, if D€[5/9,1]DD11 does not have a continuous CDF though D does not have a continuous CDF though D

doesdoesAny pair (x, 2/3-x) with x €[2/9, 4/9) satisfies Any pair (x, 2/3-x) with x €[2/9, 4/9) satisfies

the previous theorem, so results in a the previous theorem, so results in a continuum of equilibriacontinuum of equilibria

Page 80: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Nash Equilibrium in Nash Equilibrium in Duopoly GameDuopoly Game Uniqueness Theorem:Uniqueness Theorem:

If the distribution of D is strictly increasing If the distribution of D is strictly increasing and continuous and if the initial allocation and continuous and if the initial allocation is effected by a strictly increasing is effected by a strictly increasing deterministic split, then there is a unique deterministic split, then there is a unique equilibrium and xequilibrium and x1*+x2*=x*.*=x*.

The key determinant of the level of The key determinant of the level of industry inventory is the correlation industry inventory is the correlation between Dbetween D11 and D and D22. The greater the . The greater the negative correlation, the greater the negative correlation, the greater the increase in industry inventory.increase in industry inventory.

Page 81: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

N-Firm CaseN-Firm Case

Summary of ResultsSummary of Results There exists a pure strategy equilibrium in the There exists a pure strategy equilibrium in the

n-firm competitive newsboy.n-firm competitive newsboy. With identical firms and continuous distributions With identical firms and continuous distributions

for the effective demand Rfor the effective demand Rii= D= Dii + (D + (Djj-x-xjj*)*)++, there , there is a unique equilibrium and it is symmetric.is a unique equilibrium and it is symmetric.

If the distribution of D is strictly increasing and If the distribution of D is strictly increasing and continuous, and if all demand is allocated continuous, and if all demand is allocated deterministically via a strictly increasing deterministically via a strictly increasing splitting rules, then there is a unique splitting rules, then there is a unique equilibrium and industry inventory is x*.equilibrium and industry inventory is x*.

If demand is allocated and reallocated via If demand is allocated and reallocated via simple random splitting, then expected industry simple random splitting, then expected industry profit converges to zero as the number of firms profit converges to zero as the number of firms increasesincreases

Page 82: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Consumer Behavior Consumer Behavior ModelingModeling

OutlinesOutlinesChoice-Based Model in Revenue Choice-Based Model in Revenue ManagementManagement

Literature Review in Inventory ComLiterature Review in Inventory Competition Modelpetition ModelChoice Based Inventory CompetitioChoice Based Inventory Competition Modeln Model

Page 83: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Choice Based Choice Based Inventory Inventory Competition ModelCompetition Model

SummarySummary 2-Firm Model2-Firm Model n-Firm with particular rulesn-Firm with particular rules

Existence of NEExistence of NE Uniqueness of NEUniqueness of NE Extreme caseExtreme case

Page 84: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Choice Based Choice Based Inventory Competition Inventory Competition ModelModel

1 2 -1

5 3 6

Q=4

4 0

Q=3

1 3 2

3

Page 85: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Choice based Choice based inventory competition inventory competition ModelModeln firm Modeln firm Model

Assumption: Assumption:

1.1. Single-Period Inventory ModelSingle-Period Inventory Model

2.2. N Firms, each stock a single goodsN Firms, each stock a single goods

3.3. Customers arrive sequentiallyCustomers arrive sequentially

4.4. Perfect InformationPerfect Information

5.5. No salvage valueNo salvage value

Page 86: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Choice Based Choice Based Inventory Competition Inventory Competition ModelModelNotations:Notations: T: Number of customers;T: Number of customers; pp jj: selling price of Firm j;: selling price of Firm j; cc jj: procurement cost;: procurement cost; xx jj: initial inventory level of Firm j;: initial inventory level of Firm j; UUtt

jj: Utility of customer t to goods j;: Utility of customer t to goods j; QQ tt: Quantity of goods required by cusomter t: Quantity of goods required by cusomter t xx tt : (x : (x tt

11,…, x,…, x ttnn) inventory observed by ) inventory observed by

customer t;customer t;

Page 87: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Choice Based Choice Based Inventory Competition Inventory Competition ModelModelUtility:Utility:

Quantity: Quantity:

Sample PathSample Path

Assumption (cont.)Assumption (cont.)

, C is a constant, C is a constant

),,,( 10 ntttt UUUU

tQ

)},(,),,(),,(,{ 2211 TT QUQUQUT

1}{ CTP

Page 88: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Choice Based Choice Based Inventory Competition Inventory Competition ModelModelUtility Function: Utility Function:

Example:Example: Only one alternative good Only one alternative good

Prefer to buy somethingPrefer to buy something

1}2|}0,:{{| 0 jUUjP j

1}0,{ 0 jUUP j

Page 89: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Choice Based Choice Based Inventory Competition Inventory Competition ModelModel : number of sales of good j: number of sales of good j

Sample Path Profit Function of Firm jSample Path Profit Function of Firm j

Expected Profit Expected Profit

),( xj

jjjjj xcxpx ),(),(

),()( xEx jj

Page 90: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Choice Based Choice Based Inventory Competition Inventory Competition ModelModelQuestions:Questions:

1.1. Does there exist NE?Does there exist NE?

2.2. If so, if the NE is unique?If so, if the NE is unique?

3.3. What’ s the extreme case What’ s the extreme case properties?properties?

Page 91: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Choice Based Choice Based Inventory Competition Inventory Competition ModelModelNash Equilibrium : Nash Equilibrium :

Global Optimal :Global Optimal :

x

Njxxxx jjj

x

jjj

j

),(),( max0

*x

n

j

j

x

xx10

* )()( max

Page 92: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Choice Based Choice Based Inventory Competition Inventory Competition ModelModelOrdered Statistic:Ordered Statistic:

Rank Rank

Inventory Function Inventory Function

]1[]1[0][]1[ nt

mtt

mtt UUUUU

][,)( kt

jt UUifkjb

),,(1 tttjj

t QUxfx

Page 93: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Choice Based Choice Based Inventory Competition Inventory Competition ModelModelRecursive Sales-to-go Function:Recursive Sales-to-go Function:

Initial conditions:Initial conditions:

),(),,(),( 11 tj

ttttjj

ttj

t xQUxfxx

),,(1 tttt QUxfx

NjxTj

T ,0),( 11

xx 1

Page 94: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Choice Based Choice Based Inventory Competition Inventory Competition ModelModelLipschitz Function:Lipschitz Function:

Lemma: Function is Lipschitz with modLemma: Function is Lipschitz with modulus , where andulus , where and

is such that .is such that .

Homework: Prove the LemmaHomework: Prove the Lemma

SyyyyKyhyh h 211212 ,||||||)()(||

),( xj

11 CK j)1(

1 2 nCC1}{ CTPC

Page 95: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Choice Based Choice Based Inventory Competition Inventory Competition ModelModelTheorem: There exists a pure strategy NE to n Theorem: There exists a pure strategy NE to n

firm inventory game.firm inventory game.

Proof: First, is continuous;Proof: First, is continuous;

Second, is concave in . Second, is concave in .

NE exists (Fudenberg and Tirole). NE exists (Fudenberg and Tirole).

)],,([ jjj xxE

),( jjj xx jx

Page 96: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Choice Based Choice Based Inventory Competition Inventory Competition ModelModelLemma: If c.d.f.’s of are continuous and Lemma: If c.d.f.’s of are continuous and

, then for all ,, then for all ,

(1) Gradient exists with p.b. 1 ,(1) Gradient exists with p.b. 1 ,

(2) .(2) .

Lemma: The partial derivatives satisfyLemma: The partial derivatives satisfy

, and , and

, ,

tQ

1}{ CTP x

),( x

)],([)],([ xExE

}1,0{),( t

jtj

t

xx

}0,1{),( t

jti

t

xx

ji

Page 97: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Choice Based Choice Based Inventory Competition Inventory Competition ModelModelComparison of NE and Joint OptimalComparison of NE and Joint Optimal

Theorem: If , then at any NE point ,Theorem: If , then at any NE point ,

,, while at any joint optimum point , while at any joint optimum point ,

0)( ijxAP x

Njx

xj

0

)(

*x

Njx

xj

j

0

)( *

}1),(

:{

i

jijx x

xA

Page 98: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Choice Based Choice Based Inventory Competition Inventory Competition ModelModelUniqueness of NEUniqueness of NE

Definition: Goods are Definition: Goods are symmetricsymmetric if the n if the n random T-vectors are random T-vectors are exchangeable. exchangeable.

Assumption: Identical prices and costs.Assumption: Identical prices and costs.

Incomplete Demand Diversion (IDD): Incomplete Demand Diversion (IDD):

Nontrivial Demand Diversion (NDD):Nontrivial Demand Diversion (NDD):

},...,1:{ TtU jt

ijjijj xxMexMP 0,0}),(),({

xyxMyMP jjjj ,0)},(),({

Page 99: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Choice Based Choice Based Inventory Competition Inventory Competition ModelModelLemma 4: Suppose IDD, is Lemma 4: Suppose IDD, is

absolutely continuous, and absolutely continuous, and Then Then

..

Lemma 5: Suppose NDD, then Lemma 5: Suppose NDD, then

rxxMP jjj }),({ ),( jM

jirxexMP jijj ,}),({

xyxxMPyyMP jjjjjj },),({}),({

Page 100: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Choice Based Choice Based Inventory Competition Inventory Competition ModelModelTheorem: By the assumptions, there exists a uTheorem: By the assumptions, there exists a u

nique NE to the symmetric game.nique NE to the symmetric game.Proof: First-order ConditionsProof: First-order Conditions

By Lemma 5, no other symmetric equilibriBy Lemma 5, no other symmetric equilibria other than .a other than .

By Lemma 4, no asymmetric equilibria exiBy Lemma 4, no asymmetric equilibria exists. sts.

NjxxMP pcjjj ,}),({

'x x

Page 101: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Choice Based Choice Based Inventory Competition Inventory Competition ModelModelExtreme cases: Extreme cases:

Assumption: Symmetric Game;Assumption: Symmetric Game;

Customer prefer to buy Customer prefer to buy something.something.

Theorem: Under the assumptions. Let Theorem: Under the assumptions. Let be the equilibrium. be the equilibrium. When , . is the When , . is the inventory level with zero profits. inventory level with zero profits.

n

xn 0xx 0x

Page 102: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Choice Based Choice Based Inventory Competition Inventory Competition ModelModel

Page 103: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Choice Based Choice Based Inventory Competition Inventory Competition ModelModelSample Path Gradient AlgorithmSample Path Gradient Algorithm1.1. Initialize outer looper jInitialize outer looper j2.2. Initialize inner looper kInitialize inner looper k3.3. For firm j at iteration kFor firm j at iteration k

• Generate a new sample path Generate a new sample path • Calculate sample path gradientCalculate sample path gradient• Update current inventory levelUpdate current inventory level

4.4. Check convergence or returnCheck convergence or return

Page 104: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Choice Based Choice Based Inventory Competition Inventory Competition ModelModelConclusion:Conclusion: NE exists under mild regularity NE exists under mild regularity

conditions;conditions; NE is unique in case of symmetric NE is unique in case of symmetric

firms;firms; NE solution is overstocking;NE solution is overstocking; The industry becomes competitive The industry becomes competitive

as number of firms increase.as number of firms increase.

Page 105: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Choice Based Choice Based Inventory Competition Inventory Competition ModelModelOpen Questions: Open Questions:

1.1. What if without assumption that What if without assumption that customers prefer to buy customers prefer to buy something?something?

2.2. Include price and cost factors?Include price and cost factors?

3.3. What if arrival time is a factor?What if arrival time is a factor?

4.4. Analysis cooperative game.Analysis cooperative game.

Page 106: Consumer Behavior Modeling Linling He, Xiaoyan Liu, and Muhong Zhang April 29, 2005

Reference:Reference:

Lippman and McCardle, 1997, The Lippman and McCardle, 1997, The Competitive Newsboy, Competitive Newsboy, Operations ResearchOperations Research, , Vol. 45, No. 1, 54-65Vol. 45, No. 1, 54-65

Topkis, 1979, Equilibrium Points in Nonzero-Topkis, 1979, Equilibrium Points in Nonzero-sum n-Person Submodular Games, sum n-Person Submodular Games, SIAM J. SIAM J. Control and OptimizationControl and Optimization, Vol. 17, 773-787, Vol. 17, 773-787

Parlar, 1988, Game Theoretic Analysis of the Parlar, 1988, Game Theoretic Analysis of the Substitutable Product Inventory Problem with Substitutable Product Inventory Problem with Random Demands, Random Demands, Naval Research LogisticsNaval Research Logistics, , Vol. 35, 397-409Vol. 35, 397-409

Mahajan and Ryzin, Inventory Competition Mahajan and Ryzin, Inventory Competition under Dynamic Consumer choice, under Dynamic Consumer choice, Operations Operations ResearchResearch, Vol. 49, 646-657, Vol. 49, 646-657