16
International Journal of Software Engineering and Its Applications Vol. 10, No. 3 (2016), pp. 67-82 http://dx.doi.org/10.14257/ijseia.2016.10.3.07 ISSN: 1738-9984 IJSEIA Copyright ⓒ 2016 SERSC A Stochastic Approach for Valuing Customers: A Case Study Hyun-Seok Hwang Division of Business, Hallym Univ. [email protected] Abstract The more competition among industry participants severe, the more companies try to retain their customers and acquire new customers from their competitors. To gain competitive advantage, many companies are adopting and deploying more refined and sophisticated Customer Relationship Management systems. In the marketing area, a personalized marketing paradigm has already been infiltrated into our lives. To support personalized marketing, it is necessary to identify an individual customer’s true value. Various researches on customer value have conducted under the name of Customer Lifetime Value (CLV), Customer Equity, Customer Profitability, and LifeTime Value. In this paper we present issues of calculating individual customer’s lifetime value to deploy more personalized CRM activities. We propose a new method to calculate individual customer’s lifetime value dynamically. The feasibility of the suggested model is illustrated through a case study of the wireless telecommunication industry in Korea. Data mining techniques are used to predict lifetime value of a customer. Marketing implications will be discussed based on the result of individual CLV. Keywords: Customer lifetime value, Customer relationship management, Stochastic model, Data mining 1. Introduction The more a marketing paradigm evolves, the more a long-term relationship with customers gains its importance. CRM, a recent marketing paradigm, pursues a long-term relationship with profitable customers. It can be a starting point of relationship management to understand and measure the true value of customers since marketing management as a whole is to be deployed toward the targeted customer, profitable customers, to foster customers‟ full profit potential. The firm must first determine that the relationship has the potential to be profitable before investing the resources required to develop the relationship. When evaluating customer lifetime value, marketers are often reminded of the 80/20 rule (80% of the profits are produced by top 20% of profitable customers and 80% of the costs, by top 20% of unprofitable customers, vice versa) [7]. It is required to know individual customer‟s value to a firm since a firm has to foster profitable customers to optimize marketing efforts. Therefore we need a research foundation for the recent but growing interests in Customer Lifetime Value and its marketing applications. This paper aims at proposing a new model for measuring customer lifetime value considering both customer relationship dynamics with a firm and marketing potential. Customer relationship dynamics denotes the change of customer relationships with a firm such as customer retention, customer churn, customer winback, and customer loss. Since customers form a variety of relationships with a firm, a CLV model should regard these relationship changes in calculating the value. Another considerable aspect of CLV is marketing potential.

A Stochastic Approach for Valuing Customers: A Case Study · customer state). Figure 1 shows the Customer Relationship Dynamics (CRD) using the Markov chain. Figure 1. Customer Relationship

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: A Stochastic Approach for Valuing Customers: A Case Study · customer state). Figure 1 shows the Customer Relationship Dynamics (CRD) using the Markov chain. Figure 1. Customer Relationship

International Journal of Software Engineering and Its Applications

Vol. 10, No. 3 (2016), pp. 67-82

http://dx.doi.org/10.14257/ijseia.2016.10.3.07

ISSN: 1738-9984 IJSEIA

Copyright ⓒ 2016 SERSC

A Stochastic Approach for Valuing Customers: A Case Study

Hyun-Seok Hwang

Division of Business, Hallym Univ.

[email protected]

Abstract

The more competition among industry participants severe, the more companies try to

retain their customers and acquire new customers from their competitors. To gain

competitive advantage, many companies are adopting and deploying more refined and

sophisticated Customer Relationship Management systems. In the marketing area, a

personalized marketing paradigm has already been infiltrated into our lives. To support

personalized marketing, it is necessary to identify an individual customer’s true value.

Various researches on customer value have conducted under the name of Customer

Lifetime Value (CLV), Customer Equity, Customer Profitability, and LifeTime Value.

In this paper we present issues of calculating individual customer’s lifetime value to

deploy more personalized CRM activities. We propose a new method to calculate

individual customer’s lifetime value dynamically. The feasibility of the suggested model is

illustrated through a case study of the wireless telecommunication industry in Korea.

Data mining techniques are used to predict lifetime value of a customer. Marketing

implications will be discussed based on the result of individual CLV.

Keywords: Customer lifetime value, Customer relationship management, Stochastic

model, Data mining

1. Introduction

The more a marketing paradigm evolves, the more a long-term relationship with

customers gains its importance. CRM, a recent marketing paradigm, pursues a long-term

relationship with profitable customers. It can be a starting point of relationship

management to understand and measure the true value of customers since marketing

management as a whole is to be deployed toward the targeted customer, profitable

customers, to foster customers‟ full profit potential. The firm must first determine that the

relationship has the potential to be profitable before investing the resources required to

develop the relationship.

When evaluating customer lifetime value, marketers are often reminded of the 80/20

rule (80% of the profits are produced by top 20% of profitable customers and 80% of the

costs, by top 20% of unprofitable customers, vice versa) [7].

It is required to know individual customer‟s value to a firm since a firm has to foster

profitable customers to optimize marketing efforts. Therefore we need a research

foundation for the recent but growing interests in Customer Lifetime Value and its

marketing applications.

This paper aims at proposing a new model for measuring customer lifetime value

considering both customer relationship dynamics with a firm and marketing potential.

Customer relationship dynamics denotes the change of customer relationships with a firm

such as customer retention, customer churn, customer winback, and customer loss. Since

customers form a variety of relationships with a firm, a CLV model should regard these

relationship changes in calculating the value. Another considerable aspect of CLV is

marketing potential.

Page 2: A Stochastic Approach for Valuing Customers: A Case Study · customer state). Figure 1 shows the Customer Relationship Dynamics (CRD) using the Markov chain. Figure 1. Customer Relationship

International Journal of Software Engineering and Its Applications

Vol. 10, No. 3 (2016)

68 Copyright ⓒ 2016 SERSC

Customer value may be increased by up-selling/cross-selling promotions. It is

necessary to add marketing potential as a components of a CLV model to consider full

profit potential of a customer.

This paper is organized as follows. Section 2 reviews some related works on customer

valuation and categorizes research directions of the past customer valuation studies.

Section 3 proposes a new model for measuring CLV. The suggested model is

implemented and verified through an industrial case study in Section 4. Section 5 deals

with some marketing implications. Finally, in Section 6, concluding remarks of the paper

are discussed, along with further research directions.

2. Related Works

Customer value has been studied under the name of LTV (Life Time Value), CLV

(Customer Lifetime Value), CE (Customer Equity) and Customer Profitability. The

previous researches contain several definitions of CLV. The differences between the

definitions are relatively small.

CLV can be defined as the sum of the revenues gained from a company‟s customers

over the lifetime of transaction after the deduction of the total cost of attracting, selling,

and servicing customers, taking into account of the time value of money [13].

The literatures in customer lifetime value research have taken multiple directions.

However, the main directions of previous studies in CLV research are classified into four

categories. The first one is developing structural models to calculate CLV for a customer

or customer group. These articles analyze the profit/cost components of transactions and

estimate lifetime-long customer value contribution to a firm [1, 3, 11, 24, 4]. Researchers

have used empirical methods to examine a range of issues concerning which a customer

or segment of customers a firm should focus on attracting and retaining, since not all

customers are profitable [9], Based on RFM (Recency, Frequency, Monetary) model,

Pfeifer suggested a Markov chain model to calculate CLV [22]. Each RFM variable is

used as a state in Markov chain.

The second direction focuses on the strategic use of CLV in customer management. In

the early stage of CLV research, many studies were conducted to present a competitive

advantage gaining from CLV [23, 25, 27, 28, 17], the role of CLV in marketing

[McDonald, 1997], CLV-based segmentation [29, 13, 16], and managerial implications

[28, 20, 21, 26].

The third direction is normative models used mainly to understand the issues

concerning CLV [15]. Normative models provide us with an opportunity to explore

common beliefs in making decisions regarding CLV without the „noise‟ encountered in

empirical studies. Such models provide valuable insight for policy-making. A typical

example of normative models covers the traditional belief that long lifetime customers are

more profitable than newly acquired customers. Numerous researchers and practitioners

have provided many reasons in support of this belief. Recent research, however, to

explore this issue has found contradictory evidence - it depends on industry characteristics

whether the past duration affects profitability of customers positively or not [7].

Finally, the last area has been devoted to developing analytical models which help

decision making relevant to marketing management, such as promotion, campaign,

pricing, and budget allocation.

The era of mass marketing is being replaced by an era of targeted marketing.

Knowledge of CLV enables firms to develop customer-specific marketing programs

leading to an increase in efficiency and effectiveness of such programs. The Internet is

undoubtedly a major instrument of such targeted marketing; the direct marketing concepts

of CLV can be extended to be useful in interactive scenarios. CLV, if carefully calculated

with a widespread organizational buy-in, becomes the first metric to apply for customer

planning [20].

Page 3: A Stochastic Approach for Valuing Customers: A Case Study · customer state). Figure 1 shows the Customer Relationship Dynamics (CRD) using the Markov chain. Figure 1. Customer Relationship

International Journal of Software Engineering and Its Applications

Vol. 10, No. 3 (2016)

Copyright ⓒ 2016 SERSC 69

If classified in detail, the structural model can be divided into eight sub-models

according to the classification criteria shown in Table 1. In the individual model, an

individual customer‟s CLV is calculated while value is calculated per segment in the

segment model. The literatures show that the traditional marketing‟s focus is on targeted

markets, hence CLV is computed for a group of customers. In customer-based marketing,

however, the focus is shifted onto individual customers, and data should be collected and

analyzed at an individual level correspondingly. CLV should be computed for each

individual customer.

With the prediction data perspective, the retrospective model primarily deals with the

past transaction data to forecast only future cash flows. The prospective model, however,

considers not only future cash flows from the past transaction history but also marketing

potential such as up-selling, cross-selling, and additional sales caused by customer

satisfaction [14].

The contractual models assume that transaction is executed based on a contract

between a customer and a firm, while non-contractual models, not [5], [2]. In the

contractual model, compared with the non-contractual model, customer churn is less

observed since early termination of a contract results in penalties generally. Typically it is

expected that customer churn occurs at the end of a contract in the contractual models. To

analyze CLV in contractual settings, Bolton (1998) models the duration of the customer‟s

relationship with an organization that delivers a continuously provided service, such as

utilities, financial services, and telecommunications [5]. Beonit (2009) used quantile

regression to consider skewness of customer attributes [8].

According to the distinct characteristics of products, the purchase of goods is done

periodically or almost continuously. In the case of a continuous model, a revenue stream

happens continuously and an integral form of CLV formula is needed to add up the

revenue. Table 1 presents classification of the previous researches on CLV.

Table 1. Classification of the CLV Researches

Focus Category Model

Structural Model

Customer Unit Individual model

Segment (Customer base) model

Prediction data Retrospective model

Prospective model

Transaction Contractual model

Non-Contractual model

Purchase cycle Discrete model

Continuous model

Strategic Model Strategic use of CLV in management

Normative Model Relationship between Duration and cost

Analytic Model Resource allocation (Budget allocation) / Pricing

3. A Dynamic Model for Measuring Customer Lifetime Value

Since customers form a variety of relationships with a firm such as customer retention,

customer churn, customer winback, and customer loss, a CLV model should regard these

relationship changes in calculating the value. Customer defection is regarded as a major

issue in CRM. Customer winback, compared to customer defection, attracts little attention

in CLV model. However customer winback should be included in customer valuation to

evaluate customer true value. Since profiles of defecting customers are already stored in a

Page 4: A Stochastic Approach for Valuing Customers: A Case Study · customer state). Figure 1 shows the Customer Relationship Dynamics (CRD) using the Markov chain. Figure 1. Customer Relationship

International Journal of Software Engineering and Its Applications

Vol. 10, No. 3 (2016)

70 Copyright ⓒ 2016 SERSC

firm‟s database, it is important to consider a winback rate. Therefore, the service cost of a

wonback customer is less than that of a new customer.

To regard the time variant characteristics of customer relationship with a firm, we

adopt the Markov chain model to express the customer relationship dynamics. Before

expressing the customer relationship in terms of the Markov chain model, we should

define the states of the Markov chain. The relationship with a customer can be classified

into three states, P (potential customer state), D (defected customer state), and A (active

customer state). Figure 1 shows the Customer Relationship Dynamics (CRD) using the

Markov chain.

Figure 1. Customer Relationship Dynamics

CRD represents the changing relationship of a customer with a firm during a

customer‟s lifetime. Customers are acquired from the potential customer (P) state and

defect from the active customer (A) state and become the defecting customer (D) state.

Some of defected customers are wonback to an original firm and move to the active

customer state but the others are lost and move to the potential customer state. Each state

change is represented by the probability of movement from one state to the other. Within

the active customer state, there are many substates representing possible states while a

customer served by a firm.

In this paper we consider the cross-selling and up-selling potentials of a customer as

customer profit potential. Staying as an active customer, he or she receives various

marketing promotions from a firm. Figure 2 shows a graphical representation of the

Markov chain model considering customer relationship dynamics such as the customer

acquisition rate, the customer churn rate, the customer winback rate, and up-selling and

cross-selling probability. The subscript m and n denote the number of cross-selling

options and the number of up-selling options respectively. The rectangular area of Figure

2 denotes customer retention. Though customers stay at customer retention area, their

state varies with cross-selling and up-selling acceptances. Hence we can classify customer

retention into three types: positive retention, status quo retention, and negative retention.

Positive retention represent customers are retained by cross-selling and/or up-selling and

positive profit stream while negative retention fails in cross-selling and up-selling

promotion and, furthermore, customer quit cross-sold and up-sold products. Positive

retentions are depicted by forward horizontal arrows and downward vertical arrows.

Therefore the profit stream of negative retention is decreasing compared with the previous

states while the absolute profit is positive. The negative retentions are depicted by

backward horizontal arrows and upward vertical arrows. The status quo retention is

maintaining the current status and represented by recursive arrows.

Page 5: A Stochastic Approach for Valuing Customers: A Case Study · customer state). Figure 1 shows the Customer Relationship Dynamics (CRD) using the Markov chain. Figure 1. Customer Relationship

International Journal of Software Engineering and Its Applications

Vol. 10, No. 3 (2016)

Copyright ⓒ 2016 SERSC 71

Figure 2. Possible States of Customer Relationship with a Firm

A horizontal move denotes a state change by up-selling while vertical by cross-selling.

Therefore, state Ai, j represents the up-selling and cross-selling results of a customer. We

can divide the movements within the active customer state into six directions.

Downward vertical movement (Ai, j Ai+1, j): A customer accepted the cross-

selling promotion (i+1)

Upward vertical movement (Ai, j Ai-1, j): No response to the cross-selling

promotion (i+1) and quit cross-sold product i

Forward horizontal movement (Ai, j Ai, j+1): A customer accepted the up-selling

promotion (j+1)

Backward horizontal movement (Ai, j Ai, j-1): No response to the up-selling

promotion (j+1) and quit up-sold product j

Recursive movement (Ai, j Ai, j): No response to the cross-selling promotion

(i+1) and to the up-selling promotion (j+1)

Defective movement (Ai, j D): A customer has no response to the promotions

and defects

3.1. Individual CLV Equation

With a CRD perspective, customers do not stay at one state. They are moving

constantly and the movement causes changes in customer profitability. For instance, a

firm loses sales opportunities for a customer if he or she defects. Defected customers

receive marketing promotions for customer winback. When defected customers wonback

after receiving marketing promotion, the promotion turned out to be successful one. In

short, customers generate a variety of profits and costs as their relationship with a firm

change. Therefore it is necessary to consider CRD in representing individual CLV. The

dynamic nature of customer relationship results in dynamic change of individual CLV

while the structural model provides static monetary value of a customer. Hence, it is

necessary to build an extended model to represent CRD.

The suggested individual CLV model based on the Markov chain is as follows:

)1.()1(0

Eqd

imlCLVN

tt

t

Ni

RT

Page 6: A Stochastic Approach for Valuing Customers: A Case Study · customer state). Figure 1 shows the Customer Relationship Dynamics (CRD) using the Markov chain. Figure 1. Customer Relationship

International Journal of Software Engineering and Its Applications

Vol. 10, No. 3 (2016)

72 Copyright ⓒ 2016 SERSC

T is the one-step transition matrix of customer i. R is the reward vector of customer i.

The reward vector is a (mn+2)(mn+2) square matrix whose i th column element

represents the profitability of a customer while he or she remains at i th rows state for one

time period. To consider time value of money, discount rate d, converts future profits into

present one. All future profits changed into Net Present Value (NPV) and then added. The

suggested model, therefore, converts the future profit potentials composed of the

probability of customer staying at a state and profit contribution to net present value.

Figure 3 shows the one-step transition matrix which aggregates all customer states and

inter-state transition probabilities. The individual CLV model is the infinite geometrical

series as shown in Equation 2 and Equation 3. The matrix I is an (mn+2)×(mn+2) identity

matrix.

Figure 3. One-step Transition Matrix

)2.()1()1()1( 1

1

0

0

Eqddd

CLVN

N

i RTTT

)3.()1(

1

Eqd

CLVi RT

I

It is already proved that the inverse matrix of {I – (1+d)-1

T}-1

exists [30]. CLVi is

(mn+2)1 column matrix whose jth element denotes the cumulative profitability generated

by customer i while he or she remains at the state.

3.2. Limiting Probability of CRD

Generally speaking, the one-step transition matrix has the limiting probability on

condition that the Markov chain is irreducible and ergodic, i.e., positive recurrent and

aperiodic. The CLV transition matrix, T, communicates among all states and the expected

time, starting at state i, until the process returns to state i is finite. Furthermore, all states

have the period 1. Therefore the matrix T has the limiting probability.

The limiting probability of matrix T represents the long-run proportion of time a

customer stays at a certain state. Letting i be the limiting probability of state i in matrix T,

j is obtainable from the following equation:

Page 7: A Stochastic Approach for Valuing Customers: A Case Study · customer state). Figure 1 shows the Customer Relationship Dynamics (CRD) using the Markov chain. Figure 1. Customer Relationship

International Journal of Software Engineering and Its Applications

Vol. 10, No. 3 (2016)

Copyright ⓒ 2016 SERSC 73

jstatetoistatefromyprobabilittransitiontheisPwhere

EqP

ij

j

jij

i

ij )4.(,

The limiting probability enables marketing managers to identify CRD roughly, since it

can provide marketing promotions for positive retention.

4. A Case Study on a Wireless Telecommunication Company in Korea

Churn is the one of the most serious problems in the wireless telecommunication

industry where customers join a cellular service for an introductory offer and then join a

different company when the introductory offer of the original firm expires. In the initial

stage of the wireless telecommunication business, churn may not be an important issue

since acquisition of new customers can compensate for customer attrition from customer

churn. As the market, however, becomes more saturated, customer churn become a

critical concern for a telecommunication firm since the customer acquisition rate

diminishes quickly and customer loss does not recover from customer acquisition. The

wireless telecommunication industry in Korea already saturated since nearly 100% of

adults use one or more mobile service(s). A customer has three possible optional services

in this case. We assume that a customer accepts or cancels one cross-selling service in a

given time period.

The graphical representation of the state transition is depicted in Figure 4.

P D A1 A2A3 A4

P(acquisition)

P(s_retention)

P(p_retention)

P(n_retention)

P(winback)

P(churn)

P(d_stay)

P(loss)

P(p_stay)

Figure 4. Graphical Representation of the Markov Chain for a Case Study

4.1. Decision Variables of Individual CLV

To decide several probabilities for the one-step transition matrix of a customer, the

probabilities of the customer denoted in Figure 3 should be calculated. We use data

mining techniques to predict these probabilities. Data mining is to discover hidden useful

information in large databases. Mining frequent patterns from transaction databases is an

important problem in data mining [30]. Figure 4 shows the data mining procedure to

predict various transition probabilities in the case study.

Page 8: A Stochastic Approach for Valuing Customers: A Case Study · customer state). Figure 1 shows the Customer Relationship Dynamics (CRD) using the Markov chain. Figure 1. Customer Relationship

International Journal of Software Engineering and Its Applications

Vol. 10, No. 3 (2016)

74 Copyright ⓒ 2016 SERSC

Figure 5. Data Mining Procedure

The mining result, then, is the individual customer‟s predicted probabilities listed in

Table 2. Therefore data mining plays a role of providing an individual transition matrix

with input data as shown in Figure 6.

P(loss)P(churn)…P(winback)

Customer 1

Customer l

:

Customer k

:

:

:

:

Customer 2

P(retention)Transaction

information

Demographic

informationCustomer P(loss)P(churn)…P(winback)

Customer 1

Customer l

:

Customer k

:

:

:

:

Customer 2

P(retention)Transaction

information

Demographic

informationCustomer

T

Input data Matrix element

Data MiningMined result

Figure 6. Data Mining and Transition Matrix

Since customer churn is a critical issue of the wireless telecommunication industry, we

investigate the main cause of customer churn using Decision Tree as shown in Figure 7.

The most important factor indicating customer churn is variable DEL_STAT which is

an arrear type of monthly charge. Misclassification rate is 7% which means churning

customers are predicted 93% correctly by using Decision Tree model.

Page 9: A Stochastic Approach for Valuing Customers: A Case Study · customer state). Figure 1 shows the Customer Relationship Dynamics (CRD) using the Markov chain. Figure 1. Customer Relationship

International Journal of Software Engineering and Its Applications

Vol. 10, No. 3 (2016)

Copyright ⓒ 2016 SERSC 75

1

0

Total

10.9%

89.1%

100.0%

31

254

285

AC…

DEL_STAT

DD…

1

0

Total

82.4%

17.6%

100.0%

14

3

17

1

0

Total

6.3%

93.7%

100.0%

17

251

268

DEL_STAT

AC… VO

1

0

Total

5.4%

94.6%

100.0%

14

245

259

1

0

Total

33.3%

66.7%

100.0%

3

6

9

VAS_CNT

…2 …7

1

0

Total

100%

0%

100.0%

2

0

2

1

0

Total

14.3%

85.7%

100.0%

1

6

7

1

0

Total

10.9%

89.1%

100.0%

31

254

285

AC…

DEL_STAT

DD…

1

0

Total

82.4%

17.6%

100.0%

14

3

17

1

0

Total

6.3%

93.7%

100.0%

17

251

268

DEL_STAT

AC… VO

1

0

Total

5.4%

94.6%

100.0%

14

245

259

1

0

Total

33.3%

66.7%

100.0%

3

6

9

VAS_CNT

…2 …7

1

0

Total

100%

0%

100.0%

2

0

2

1

0

Total

14.3%

85.7%

100.0%

1

6

7

1

0

Total

10.9%

89.1%

100.0%

31

254

285

1

0

Total

10.9%

89.1%

100.0%

31

254

285

AC…

DEL_STAT

DD…

1

0

Total

82.4%

17.6%

100.0%

14

3

17

1

0

Total

6.3%

93.7%

100.0%

17

251

268

DEL_STAT

AC… VO

1

0

Total

5.4%

94.6%

100.0%

14

245

259

1

0

Total

33.3%

66.7%

100.0%

3

6

9

VAS_CNT

…2 …7

1

0

Total

100%

0%

100.0%

2

0

2

1

0

Total

14.3%

85.7%

100.0%

1

6

7

Figure 7. Prediction of Churn Rate using Decision Tree

4.2. Building the one-step transition matrix

To build the one-step transition matrix of customer i, various probabilities are

predicted by the data mining technique, Decision Tree. Table 2 shows the probabilities of

customer i forecasted by Decision Tree.

Table 2. Transition Probabilities of Customer i

Transition probability Notation Mined result

Customer churn P(churn) 0.021

Positive retention P(p_retention) 0.072

Status quo retention P(s_retention) 0.928

Negative retention P(n_retention) 0.048

Customer winback P(winback) 0.239

Customer acquisition P(acquisition) 0.006

Customer loss P(loss) 0.021

Stay at Defected customer P(d_stay) 0.761

Stay at Potential customer P(p_stay) 0.994

Page 10: A Stochastic Approach for Valuing Customers: A Case Study · customer state). Figure 1 shows the Customer Relationship Dynamics (CRD) using the Markov chain. Figure 1. Customer Relationship

International Journal of Software Engineering and Its Applications

Vol. 10, No. 3 (2016)

76 Copyright ⓒ 2016 SERSC

When the transition probabilities of a customer are estimated, the all probabilities

should be normalized to obey the basic rule of the Markov chain, the sum of all outflow

probabilities is 1. Since the outflow probabilities are estimated separately, the sum of

those probabilities may exceed 1. The normalization of the outflows is performed by

dividing the outflow probability by the sum of all outflow probabilities.

4.3. One-step transition matrix of customer i

The one-step transition matrix consists of the probabilities listed in Table 2. Figure 8

represents the one-step transition probabilities of customer i after normalizing the

probabilities.

Figure 8. One-step Transition Matrix of Customer i

4.4. Reward Vector of Customer i

The reward vector of customer i, the contributed profit while he or she stays at a certain

state, is derived from an interview as shown in Table 3.

Table 3. Cost Drivers of a Telecommunication Company

ID Profit/Cost Drivers Profit/cost (KRW)

D1 Monthly Profit from Charge without optional

service (+)15,000

D2 Profit from a cross-selling service (+)1,000

D3 Marketing cost for a cross-selling promotion (-)3,000

D4 Marketing cost for a defected customer (-)2,000

D5 Subsidy for a wonback customer (-)20,000

D6 Marketing cost for acquiring a potential customer (-)2,000

D7 Subsidy for an acquired customer (-)20,000

The reward vector is calculated from Table 3. The reward vector of customer i,

composed of profit or cost driver, is shown in Figure 9.

Page 11: A Stochastic Approach for Valuing Customers: A Case Study · customer state). Figure 1 shows the Customer Relationship Dynamics (CRD) using the Markov chain. Figure 1. Customer Relationship

International Journal of Software Engineering and Its Applications

Vol. 10, No. 3 (2016)

Copyright ⓒ 2016 SERSC 77

Figure 9. Reward Vector of Customer i

The (m, n) element of the vector denotes the profit/cost of customer i who stays at state

m and transferred from state n. The profit includes the profit contribution at state m and

marketing cost at state n. For instance, element (A4, D) means that customer i moves from

state A4 to state D. Therefore the profit includes profit contribution from the monthly

charge (D1), three optional services (D2*3) and loss from subsidy for a wonback

customer (D5), marketing cost for acquiring a potential customer (D6).

4.5. Lifetime Value of Customer i

Lifetime value of customer i can be derived through Equation 4 as shown above.

Monthly interest rate are used for the discount rate, d, and it is set as 0.3 (%/month). The

result of Equation 3 is shown in Figure 10. As mentioned before, the diagonal elements

are the lifetime value and, therefore, Figure 10 can be summarized as Figure 11.

CLVi =

-1,180,577 -1,180,577 2,164,731 1,161,731 1,161,731 1,161,731 P

-1,361,950 -1,361,950 2,931,705 1,928,705 1,928,705 1,928,705 D

-1,386,319 -1,386,319 3,296,046 2,293,046 2,293,046 2,293,046 A4

-1,400,335 -1,400,335 3,285,095 2,282,095 2,282,095 2,282,095 A3

-1,420,173 -1,420,173 3,265,946 2,262,946 2,262,946 2,262,946 A2

-1,436,533 -1,436,533 3,247,096 2,244,096 2,244,096 2,244,096 A1

PDA4A3A2A1

-1,180,577 -1,180,577 2,164,731 1,161,731 1,161,731 1,161,731 P

-1,361,950 -1,361,950 2,931,705 1,928,705 1,928,705 1,928,705 D

-1,386,319 -1,386,319 3,296,046 2,293,046 2,293,046 2,293,046 A4

-1,400,335 -1,400,335 3,285,095 2,282,095 2,282,095 2,282,095 A3

-1,420,173 -1,420,173 3,265,946 2,262,946 2,262,946 2,262,946 A2

-1,436,533 -1,436,533 3,247,096 2,244,096 2,244,096 2,244,096 A1

PDA4A3A2A1

Figure 10. CLV Matrix of Customer i

The sum of the diagonal elements in Figure 10 is the net CLV of customer i. We,

therefore, anticipate that customer i will contribute 7,542,656 (KRW) to the company

during his lifetime.

While a customer stays at the Active Customer State, his CLV is positive. While

staying at the Defected Customer State and the Potential Customer State, his CLV is

negative, i.e., generated more cost than profit. The negative profit contribution results

from the poor winback rate (0.220) and acquisition rate (0.006).

4.6. Limiting Probability of Customer i

The limiting probability of the transition matrix of customer i represents the long-run

proportion of time that customer i stays at a certain state. Table 4 shows the limiting

probability of customer i.

Page 12: A Stochastic Approach for Valuing Customers: A Case Study · customer state). Figure 1 shows the Customer Relationship Dynamics (CRD) using the Markov chain. Figure 1. Customer Relationship

International Journal of Software Engineering and Its Applications

Vol. 10, No. 3 (2016)

78 Copyright ⓒ 2016 SERSC

Table 4. Limiting Probability of the Transition Matrix

Stage state Limiting probability

Active Customer State

A1 1 = 0.178

A2 2 = 0.129

A3 3 = 0.101

A4 4 = 0.099

Defected Customer State D D = 0.035

Potential Customer State P P = 0.458

total 1

Customer i is expected to stay as an active customer having probability about 1/2. He

or she also stays as a potential customer for almost half of the lifetime.

5. Marketing Implications

The lifetime value of customer i provides marketing managers with marketing

implications. As we can see in Figure 12, customer i contributes negative profit during

potential customer state, i.e., cost, to a firm. Therefore marketing managers should decide

whether marketing for customer acquisition is effective when a customer is in state P, the

Potential Customer State. The decision is possible through a recalculated CLV after

modifying the transition matrix T and the reward vector R. Assume that a manager

decides to improve profitability by stopping a marketing promotion for customer i when

he stays at state P. The cost drivers of a firm will change as in Table 5.

Table 5. New Cost Drivers for Customer i

Cost drivers Profit/cost

Monthly Profit from Charge (+)15,000

Profit from a cross-selling service (+)1,000

Marketing cost for a cross-selling promotion (-)3,000

Marketing cost for churn management (-)2,000

Subsidy for a wonback customer (-)20,000

Marketing cost for acquiring a potential

customer 0

Subsidy for an acquired customer 0

Assume that the acquisition rate of customer i will be decreased by 0.0000001 which

denotes the acquisition rate without acquisition promotion. The transition matrix and the

reward vector are also changed like Figure 11 and Figure 12 respectively.

Page 13: A Stochastic Approach for Valuing Customers: A Case Study · customer state). Figure 1 shows the Customer Relationship Dynamics (CRD) using the Markov chain. Figure 1. Customer Relationship

International Journal of Software Engineering and Its Applications

Vol. 10, No. 3 (2016)

Copyright ⓒ 2016 SERSC 79

R =

000-3000-3000-3000P

000-3000-3000-3000D

18000-600018000150001500015000A4

17000-700017000140001400014000A3

16000-800016000130001300013000A2

15000-900015000120001200012000A1

PDA4A3A2A1

000-3000-3000-3000P

000-3000-3000-3000D

18000-600018000150001500015000A4

17000-700017000140001400014000A3

16000-800016000130001300013000A2

15000-900015000120001200012000A1

PDA4A3A2A1

Figure 11. One-step Transition Matrix under No Acquisition Promotion

T =

0.999999900000.0000001P

0.0790.7010000.220D

00.0110.9420.04700A4

00.010.0670.8780.0450A3

00.0100.0670.8780.045A2

00.021000.070.909A1

PDA4A3A2A1

0.999999900000.0000001P

0.0790.7010000.220D

00.0110.9420.04700A4

00.010.0670.8780.0450A3

00.0100.0670.8780.045A2

00.021000.070.909A1

PDA4A3A2A1

Figure 12. Reward Vector under No Acquisition Promotion

The result of CLV is shown in Figure 12. As seen in Figure 12, the total CLV

decreases from 7,542,656 to 6,463,542. The result implies that acquisition promotion is

effective and profitable for customer i. We can discover that it is profitable for a firm to

execute acquisition promotion for customer i since reducing acquisition expenditure for

customer i result in the deduction of the overall profitability. Before performing

marketing promotion, we can forecast its monetary result through the changes of a

transition matrix and a reward vector.

6. Conclusion & Further Research Directions

This paper focused on the implementation of an individualized Customer Lifetime

Value model. Customer relationship with a firm is embodied by a state of the Markov

chain. The suggested CLV model provides not only the lifetime value of a customer but

the fractionized lifetime value of a customer according to the state. The model also covers

the long-run proportion of time for a state where he or she stays. The suggested model is

illustrated by an industrial case study on the wireless telecommunication industry in

Korea.

In future, we expect this work to spur further research on personalized stochastic CLV

model, which includes the Markov chain model and other structural CLV models based

on probabilistic revenue estimation. Another further research issue is to develop a

personalized marketing strategy based on individual CLV. Individual CLV is expected to

vary with changes of business environment. Therefore, marketing strategies should be

built based on the result of sensitivity analysis. A sensitivity analysis can help the strategy

development by deciding optimal budget allocation, forecasting profitability change, and

measuring marketing effectiveness.

Page 14: A Stochastic Approach for Valuing Customers: A Case Study · customer state). Figure 1 shows the Customer Relationship Dynamics (CRD) using the Markov chain. Figure 1. Customer Relationship

International Journal of Software Engineering and Its Applications

Vol. 10, No. 3 (2016)

80 Copyright ⓒ 2016 SERSC

Acknowledgements

This paper is a revised and expanded version of a paper entitled “A Dynamic Model for

Valuing Customers: A Case Study” presented at GST 2015, Jeju island, Dec. 16 ~ Dec. 19,

2015.

References

[1] T. Bayon, J. Gutsche and H. Bauer, “Customer Equity Marketing: Touching the Intangible”, European

Management Journal., vol. 20, no. 3, (2002), pp. 213-222.

[2] D. F. Benoit and D. Van den Poel, “Benefits of quantile regression for the analysis of customer lifetime

value in a contractual setting: An application in financial services”, Expert Systems with Applications,

vol. 36, no. 7, (2009), pp. 10475-10484.

[3] P. D. Berger and N.I. Nasr, “Customer lifetime value: Marketing models and applications”, Journal of

interactive marketing., vol. 12, no. 1, (1998), pp. 17-30.

[4] R. C. Blattberg, E.C. Malthouse and S.A. Neslin, “Customer lifetime value: Empirical generalizations

and some conceptual questions”, Journal of Interactive Marketing., vol. 23, no. 2, (2009), pp. 157-168.

[5] R. N. Bolton, “A dynamic model of the duration of the customer‟s relationship with a continuous service

provider: the role of satisfaction”, Marketing science, vol. 17, (1998), pp. 45-65.

[6] G. R. Dowling and M. Uncles, “Do customer loyalty programs really work?”, MIT Sloan., vol. 38, no. 4,

(1997), pp. 71-82.

[7] R. S. Duboff, “Marketing to maximize profitability”, Journal of Business Strategy., vol. 13, no. 6, (1992),

pp. 10-13.

[8] J. Filar, and K. Vrieze, Editor, “Competitive Markov decision processes”, Springer-Verlag, New York,

(1996).

[9] N. Glady, B. Baesens and C. Croux, “A modified Pareto/NBD approach for predicting customer lifetime

value”, Expert Systems with Applications., vol. 36, no. 2, (2009), pp. 2062-2071.

[10] B. A. Gloy, J.T. Akridge and P.V. Preckel, “Customer lifetime value: An application in the rural

petroleum market”, Agribusiness., vol. 13, no. 3, (1997), pp. 335-347.

[11] S. Gupta and D.R. Lehmann, “Customers as assets”, Journal of Interactive Marketing., vol. 17, no. 1,

(2003), pp. 9-24.

[12] J. C. Hoekstra and E. K. Huizingh, “The lifetime value concept in customer-based marketing”, Journal of

Market-Focused Management., vol. 3, (1999), pp. 257-274.

[13] H. Hwang, T. Jung and E. Suh, “An LTV model and customer segmentation based on customer value: a

case study on the wireless telecommunication industry”, Expert systems with applications, vol. 26, no. 2,

(2004), pp. 181-188.

[14] F. A. Jacobs, W. Johnston, and N. Kotchetova, “Customer profitability: prospective vs. retrospective

approaches in a business-to-business setting”, Industrial Marketing Management., vol. 30, (2001), pp.

353-363.

[15] D. Jain and S.S. Singh, “Customer lifetime value research in marketing: A review and future directions”,

Journal of interactive marketing., vol. 16, no. 2, (2002), pp. 34-46.

[16] S. Y. Kim, T. S. Jung, E. H. Suh and H. S. Hwang, “Customer segmentation and strategy development

based on customer lifetime value: A case study”, Expert systems with applications., vol. 31, no. 1, (2006),

pp. 101-107.

[17] V. Kumar, K. N. Lemon and A. Parasuraman, “Managing Customers for Value An Overview and

Research Agenda”, Journal of Service Research, vol. 9, no. 2, (2006), pp. 87-94.

[18] M. McDonald, “The role of marketing in creating customer value”, Engineering Science and Education

Journal., vol. 6, no. 4, (1997), pp. 177-181.

[19] D. McDougall, G. Wyner and D. Vazdauskas, “Customer valuation as a foundation for growth”,

Managing Service Quality: An International Journal., vol. 7, no. 1, (1997), pp. 5-11.

[20] W. McKnight, “The CRM-Ready Data Warehouse: Personalized Customer Lifetime Value”, DM

Review, (2001).

[21] B. Noone, and P. Griffin, “Enhancing yield management with customer profitability analysis”,

International Journal of Contemporary Hospitality Management., vol. 9, no. 2, (1997), pp. 75-79.

[22] P. E. Pfeifer, and R. L. Carraway, “Modeling customer relationships as Markov chains”, Journal of

interactive marketing., vol. 4, no. 2, (1988), pp. 43-55.

[23] L. F. Pitt, M. T. Ewing and P. Berthon, “Turning competitive advantage into customer equity”, Business

Horizons., vol. 43, no. 5, (2000), pp. 11-18.

[24] M. L. Roberts, and P. D. Berger, Editor, “Direct marketing management”, Englewood Cliffs (NJ):

Prentice Hall, New York, (1989).

[25] K. Ruyter, and M. Wetzels, “Customer equity considerations in service recovery: a cross-industry

perspective”, International Journal of Service Industry Management., vol. 11, no. 1, (2000), pp. 91-108.

[26] L. Ryals, “Are your customers worth more than money?”, Journal of Retailing and Consumer Services.,

vol. 9, no. 5, (2002), pp. 241-251.

Page 15: A Stochastic Approach for Valuing Customers: A Case Study · customer state). Figure 1 shows the Customer Relationship Dynamics (CRD) using the Markov chain. Figure 1. Customer Relationship

International Journal of Software Engineering and Its Applications

Vol. 10, No. 3 (2016)

Copyright ⓒ 2016 SERSC 81

[27] B.P. Shapiro, V.K. Rangan, R.T. Moriarty, and E.B. Ross, “Manage customers for profits (not just

sales)”, Harvard Business Review., vol. 65, no. 5, (1987), pp. 101-108.

[28] H.K. Stahl, K. Matzler, and H.H. Hinterhuber, “Linking customer lifetime value with shareholder value”,

Industrial Marketing Management., vol. 32, no. 4, (2003), pp.267-279.

[29] K. Storbacka, “Segmentation based on customer profitability-retrospective analysis of retail bank

customer bases”, Journal of Marketing Management., vol. 13, no. 5, (1997), pp. 479-492.

[30] X. Yang and L. Lian, "A New Data Mining Algorithm based on MapReduce and Hadoop", International

Journal of Signal Processing, Image Processing and Pattern Recognition., vol.7, no.2, (2014), pp.131-142.

[31] H. Hwang , “A Dynamic Model for Valuing Customers: A Case Study”, Proceedings of GST 2015, Jeju

island, Republic of Korea, (2015), December 16 ~19.

Author

Hyun-Seok Hwang, He is a Professor of Business Administration

and a research fellow of Hallym Business Research Institute at

Hallym University, Chuncheon, South Korea. He received his PhD in

Industrial Engineering from the Pohang University of Science and

Technology (POSTECH), South Korea. His current research focuses

on Big Data Analytics, Opinion Mining, Interaction Design.

Page 16: A Stochastic Approach for Valuing Customers: A Case Study · customer state). Figure 1 shows the Customer Relationship Dynamics (CRD) using the Markov chain. Figure 1. Customer Relationship

International Journal of Software Engineering and Its Applications

Vol. 10, No. 3 (2016)

82 Copyright ⓒ 2016 SERSC