Abstract

With a view to develop a more realistic model for credit risk analysis in consumer loan, our paper addresses the problem of how to incorporate business cycles into a repayment behavior model of consumer loan in portfolio. A particular Triplet Markov Model (TMM) is presented and introduced to describe the dynamic repayment behavior of consumers. The particular TMM can simultaneously capture the phases of business cycles, transition of systematic credit risk of a loan portfolio, and Markov repayment behavior of consumers. The corresponding Markov chain Monte Carlo algorithms of the particular TMM are also developed for estimating the model parameters. We show how the transition of consumers’ repayment states and systematic credit risk of a loan portfolio are affected by the phases of business cycles through simulations.

1. Introduction

The widespread use of consumer loan has not only alleviated the financial distress of consumers but also benefited credit companies. However, with the increasing consumer loan and credit limit, default risk has risen rapidly and even triggered systemic risk such as the subprime crisis in 2007. Dynamic management of consumer loan risk becomes more and more important in the credit business.

It is an important and practically relevant issue to assess and measure credit risk of a consumer loan in portfolio. In order to model the behavior of credit accounts, a stationary Markov chain approach was introduced [1]. Since then, the line of research has been developed [24]. In a previous study [5], a Markov chain model based on behavioral scores was developed for establishing the credit risk of consumer loans in portfolio. Moreover, a Markov model (MM) to measure transition of loan accounts is presented [6], in which the Markov transition probability is a function of account states, collection actions applied and borrower characteristics.

For linking the risk states of a debtor with loan default, Hidden Markov Model (HMM) or Double Chain Markov Model (DCMM), as important extension to the simple MM, has been popular in credit modeling in recent years. Giamperi et al. [7] introduced an HMM to model the occurrence of defaults within a bond portfolio. They assume that the default probability of each bond in a portfolio depends on the hidden states of an HMM, which are interpreted as risk states of the bonds. In Banachewicz et al. [8], an HMM is developed to model and predict corporate default frequencies; the hidden states in their paper correspond to the industry credit cycles. In Fitzpatrick and Marchev [9], a multivariate DCMM is applied to credit rating dynamics of financial companies where a hidden process is regarded as a broader economy indicator affecting the transition of credit rating of companies. Quirini and Vannucci [10] link HMM with the analysis of credit risk of consumer loans in portfolio; the hidden states, which are regarded as credit market conditions, are endogenously extracted from repayment behavior records to measure loans’ creditworthiness.

The hidden states of the model can be interpreted as systematic credit risk states of the loan portfolio when HMM or DCMM is used to measure the credit risk of a portfolio of consumer loan. Based on HMM or DCMM, one can link the systematic credit risk of a loan portfolio with the repayment behavior of consumers. However, the literature mentioned above leaves a fundamental question unanswered: What influences the transition of both repayment behavior of consumers and systematic credit risk of a loan portfolio?

Numerous studies have found a significant relationship between nonperforming loans (NPLs) and business cycles [1113]. It is common to observe high NPL ratios during business cycle contraction, owing to the contraction in economic activity and the consequent decline in consumers’ ability to repay their debts. In contrast, economic growth allows consumers to keep their finances buoyant and pay back their installments on time, resulting in low NPL ratios [14]. The evolution of consumers’ repayment behavior and systematic credit risk of a loan portfolio are affected by business cycle, and different portfolios may be affected differently. A realistic model should account for this.

This paper aims to develop a credit risk model for consumer loan portfolio across business cycle. A particular TMM is presented and introduced to describe the dynamic Markov repayment behavior of consumers in the field of consumer loan. The particular TMM can test for and model two paths of impact of business cycle on the transition of consumers’ repayment behavior. One of the paths is that the transition consumers’ repayment behavior is directly affected by the business cycle. The other path is the business cycle affects the transition of systematic credit risk state of the loan portfolio and then affects the transition of consumers’ repayment behavior. Simulation studies are provided to illustrate how the model functions.

TMM, also known as Triplet Markov Chains, was first proposed in Pieczynski et al. [15]. TMM consists of three processes: a hidden process , an observed process and a third process . The model is called a TMM if there exists a stochastic process , where takes its value in a finite set, such that the triplet is a Markov chain. TMM has been applied in the context of signal processing image processing and others [1619]. To the authors’ knowledge, there is little research that links credit risk measurement with TMM. In view of this, the present paper is the first study to introduce TMM into the credit risk analysis of consumer loan in portfolio.

By assessing the consumers’ repayment behavior across business cycles, our proposed approach provides more information about the creditworthiness of consumer loans in portfolio, especially at extreme phases of the business cycle, which is very useful for credit risk management. Scenario analysis is more realistic and persuasive since our approach simultaneously captures the phases of a business cycle, transition of hidden risk states of loan portfolio, and Markov repayment behavior of consumers.

The remainder of this paper proceeds as follows. Section 2 describes the architecture of the particular TMM. Section 3 proposes a specific TMM for consumer loan. Section 4 gives simulation studies to illustrate how the model works in consumer loan. Section 5 provides a conclusion.

2. The Particular Triplet Markov Model Architecture

In this section, we present the structure of our particular TMM. For ease of comprehension and comparison, we first introduce two simpler models: HMM and DCMM.

HMM proposed in Baum and Petrie [20] has been widely used in various problems [2123]. It consists of two stochastic processes and , where is a Markov chain and not directly visible (hidden), but the output of another variable whose distribution depends on the hidden process , is visible. A specific value of output variable is usually called observation. This is shown in Figure 1. A drawback of HMM is that the outputs are assumed to be conditionally independent. Considering that the conditional independence between outputs of an HMM is not always justified, the literature [24] proposes a DCMM as an extension of HMM to overcome this drawback. Figure 2 gives the Bayesian network representation of DCMM.

The TMM extends DCMM by adding a discrete value process , such that the triplet is a Markov chain. The particular TMM proposed in our paper consists of three variables: an additional input variable , an underlying process which is hidden from the output variable and depends on the input variable, the output variable which depends on both the input variable and the underlying process. The model is characterized by the following elements:(i), the set of input variables.(ii), the set of hidden states.(iii), the set of output variables.(iv), the initial probability distribution of a hidden state.(v), transition probabilities between successive inputs.(vi), transition probabilities between successive hidden states given a specific value of input variable.(vii), transition probabilities between successive outputs given specific input value and hidden state.

Figure 3 shows the Bayesian network of our particular TMM. We can see that the transition process of and depends on the specific value of input variable and are all non-homogeneous.

3. Triplet Markov Model for Consumer Loan

In this section, we set up the particular TMM for consumer loan. As described previously, the model consists of three Markov chains. We next construct each of them in the context of consumer loan.

We take the business cycle as the input variable of the particular TMM. In facing a real case, practitioners can use the business cycle chronology compiled by the National Bureau of Economic Research (NBER) as input variable. Scholars have divided the business cycle into separate phases or regimes, in particular treating expansions separately from contractions [25, 26]. Following this tradition, we present the business cycle in using a very simple two-states model where and “1” for expansion, “2” for contraction. The process of two phases of business cycle is governed by the following homogenous Markov transition matrix:

In our paper, the hidden states of TMM are regard as systematic credit risk states of a loan portfolio. We assume the number of hidden risk states is . Taking the input variable into account, the process of hidden risk states evolves according to a non-homogeneous Markov process:

where is the one-step transition probability matrix of the chain with , i.e., for , and is the probability distribution at . From (2), it can be seen that the transition of consumer’ hidden risk states switches between two Markov regimes according to the input value of the business cycle .

It is worth emphasizing that the particular TMM in our paper has only one common hidden sequence, and multiple output sequences are all driven by this common hidden sequence. That is to say, the hidden systemic credit risk is common to all consumers within a loan portfolio, even if each consumer’s repayment behavior is different. This design of hidden sequence in our particular TMM is consistent with that in DCMM represented in Fitzpatrick and Marchev [9].

We now consider the repayment behavior of consumers affected by both the business cycle and the systemic credit risk of the loan portfolio. For a consumer , let denote his/her random repayment state expressed by the number of unpaid installments at time . In practice, a default state is usually considered and regarded as an absorbing state which means any consumer who has reached this state can never return back. Here, we adopt the assumption in [10, 27] a consumer is assumed to become a defaulter when three accumulative installments are unpaid. Hence, we have:

The process of each consumer’s repayment behavior is a nonhomogeneous Markov chain with the following transition matrices:

for , where is the number of consumers in portfolio.

Form (3) shows that affected by both business cycle and hidden systemic credit risk, the transition of consumers’ repayment states switches among Markov regimes.

The relationship among the business cycles, systematic credit risk of a loan portfolio, and consumers’ repayment state is plotted in Figure 4. We can see that the particular TMM can test for and model two paths of impact of business cycle on the transition of consumers’ repayment state. One of the paths is that the transition of consumers’ repayment state is directly affected by the business cycle. The other path is indirect impact, where the business cycle affects the transition of systematic credit risk state of the loan portfolio, and then affects the transition of consumers’ repayment state.

The impacts of business cycle on consumers’ repayment behavior are reflected in the difference of the transition probabilities in the transition matrix and , respectively. In practical terms, the probability of occurrence of a low/high systematic credit risk state increases when the external business cycle is in the expansion/contraction stage. At the same time, the repayment behavior of consumers in loan portfolio is more likely to ameliorate/deteriorate because of the expansive/contractive business cycle and low/high systemic credit risk.

The particular TMM provides an alternative approach to measure the credit risk of consumer loans in portfolio across business cycles. In practice, credit managers can focus on a portfolio of borrowers from a particular type or market, for example, borrowers from the energy sector. The systematic credit risk of the loan portfolio can then be seen as a proxy variable of credit market condition of the energy sector. Obviously, the credit market condition of the energy sector is affected by external business cycles. TMM provides us an approach to measure the performance of loans in portfolio under different business cycles and credit market conditions of the energy sector, while also considering the impact of a business cycle on the credit market condition of the energy sector.

4. Simulation Studies

4.1. Generation of Simulated Data

For the sake of simplicity and without loss of generality, we consider there are only two hidden risk states since it is a well-accepted theory that risk states fluctuate between two Markov regimes: normal risk and enhanced risk. We denote: “N” for normal risk and “E” for enhanced risk.

Considering the empirical characteristics of transition matrices of credit card loan accounts in Leow and Crook [27], the parameter values in our paper are given as follows:

The transition matrix of business cycle is

transition matrices of systematic credit risk states are

transition matrices of consumers’ repayment states are

We can see that the systematic credit risk states transfer according to whether or depend on the value of the input business cycle. The systematic credit risk state is more likely to remain or move to normal risk state when the phase of the external business cycle is expansion. On the contrary, the probability of turning into the enhance risk state increases during the contractive phase of the business cycle. The elements in matrices show that the probability of recovering overdue installments is larger than the probability of paying nothing, and the assumption is diminished if systematic credit risk state is “E” or the phase of business cycle is “2.”

We use the TMM with the given parameter values to generate our simulated data. In addition to containing an input sequence of business cycle, the simulated data also contain repayment states of consumers, a total of time intervals, that is to say, there are 1000 sequences, each containing 200 repayment histories. Figures 5 and 6 show the simulated business cycle and three randomly selected loans, respectively.

4.2. Estimation of Model Parameters

Our paper focuses on estimating the value of transition matrices from the simulated data set. From a Bayesian perspective, we use Markov chain Monte Carlo (MCMC) algorithms to estimate the parameters of the particular TMM. Since the classic Expectation-Maximization algorithm is sensitive to the starting values and is easy to fall into a local optimal solution. However, MCMC makes posterior risk minimization, and make full use of the experience, history information, and other information of samples. Employing the great computational power of MCMC, the model parameters can be quickly extracted. The MCMC algorithms of our particular TMM are similar to the MCMC algorithms of DCMM [9]. For the sake of brevity, all MCMC algorithms are consigned to Appendix A.

We run our MCMC algorithms of TMM 10000 iterations on software R with the first 5000 iterations being discarded as burn-in. The Dirichlet prior parameters in MCMC algorithms are all set to 0.1. The estimated values of parameters are obtained from the posterior means of the last 5000 iterations and the results are given in Table 1.

The estimated matrices in Table 1 are close to their true values. The estimated matrices give the transition probabilities between the two systematic credit risk states at different phases of the business cycle. Furthermore, by comparing the matrices , the different transition probabilities among repayment states of consumers in different systematic credit risk states and business cycles can be obtained. The results will assist practitioners for assessing, managing, and monitoring credit risk in their loan portfolio.

As a robustness check, Table 2 lists the sum of squared errors (SSE) of full sample and three subsamples. The SSE of two transition matrices of systematic credit risk states and four transition matrices of consumers’ repayment states are donated by SSE1 and SSE2 respectively.

The results of SSE show that a reduction in the number of consumers and the length of time interval has a negative impact on the estimation accuracy of transition matrices. Whereas, on average, the estimated deviations of each element in the transition matrix and are only and , respectively. These small deviations are not enough to have a significant impact on the estimation accuracy of transition matrices. That is to say, a 5% reduction in the number of borrowers and a 5% reduction in the length of time interval have no significant effect on the robustness of TMM.

We now test the robustness of our model with different parameter values. The following four cases are taken into consideration.

Case 1. The transition matrix of business cycle is reset to

Case 2. Transition matrices of systematic credit risk states are changed to

Case 3. Transition matrices of consumers’ repayment states are given as

Case 4. The parameter values are simultaneously changed to the values given in the above three cases.
We regenerate the simulated data according to the parameters given in above four cases. Again, using MCMC algorithms in Appendix A, we can obtain the estimated parameter values. SSE1, SSE2, and total SSE can then be obtained by comparing them with the true parameter values. The results are presented in Table 3. We can see that the SSE1, SSE2, and total SSE with different parameters are very close to those previously listed in Table 2. This shows that the accuracy of estimation does not seem to decrease with the above parameter values and TMM is robust to these parameter values.

4.3. Comparative Analysis

Now we study other cases for comparison. We estimate the parameter values of DCMM and the MM based on the same simulated data. The MCMC algorithms of DCMM are presented in Fitzpatrick and Marchev [9]. The algorithms of MM can be found in the R package “MCTM” (https://cran.r-project.org/web/packages/MCTM/index.html). All codes were run on software R. The estimated parameter values of DCMM and MM are obtained and listed in Tables 4 and 5, respectively.

By comparing the results of Tables 1, 4 and 5, we can see that the estimated matrices in DCMM can be regarded as a complex combination of and in TMM. Further, the estimated matrix in MM can be obtained by a complex combination of and in DCMM. Both DCMM and MM cannot explicitly analyze the influence of business cycle on consumers’ repayment behavior. Whereas, the transition process of consumers’ repayment states across business cycle can be modeled and estimated by TMM. Based on TMM, the analysis of consumer repayment behavior in loan portfolio is more meticulous and persuasive.

Once the estimated parameter values of TMM, DCMM, and MM are obtained, the prediction of future default probability of consumers can be made. We predict the expected default probability of current non-defaulting consumers after 12 time periods based on estimated parameter values. For the sake of simplicity, but without losing generality, we focus on the following three scenarios:

Scenarios 1. All phases of a business cycle are expansion and all systematic credit risk states are normal risk over the next 12 time periods.

Scenarios 2. All phases of a business cycle are contraction and all systematic credit risk states are enhanced risk over the next 12 time periods.

Scenarios 3. The current phase of the business cycle is contraction, but the current systematic credit risk state is normal risk.

Obviously, Scenarios 1 and 2 are the best and worst case of TMM respectively. In Scenario 3, the occurrences of business cycle and systematic risk state in the next 12 time periods are stochastic, and are governed by the estimated transition matrices. Before the process of prediction, we adjust the last row of the estimated matrices to since the repayment state “3” is an absorbing state. The predicted values of expected default rate (deviation rates are listed in parentheses) of current nondefaulting consumers after the 12 time periods of TMM, DCMM, and MM are given in Table 6.

The results in Table 6 show that the probability of becoming a defaulter increases with the increase in the number of unpaid instalments. We can also see that the deviation rate of TMM is the smallest among the three models, especially in Scenarios 1 and 2. This suggests that the TMM proposed in this paper can be used to accurately predict and assess the credit risk of consumers in loan portfolio, especially when business cycle stays at one stage for a long time.

Notice that the transition matrices, which characterize the expected changes in credit quality of consumers, are cardinal inputs to portfolio risk assessment. The particular TMM in this paper can integrate business cycle into the analysis of consumers’ repayment behavior and reveal more information about transition matrices of a loan portfolio. We believe our analysis provides a useful method to stress testing a loan portfolio and could assist practitioners in managing credit risk in loan portfolio.

5. Conclusions

The proposed TMM in this paper extends the credit risk measurement of consumer loan portfolio in HMM and DCMM by taking the impact of a business cycle into consideration. The structure of TMM can incorporate two paths of impact of a business cycle on the transition of consumers’ repayment behavior. One is the transition consumers’ repayment behavior is directly affected by the business cycle. The other is the business cycle affects the transition of systematic credit risk of the loan portfolio and then affects the transition of consumers’ repayment behavior. It is the first time that a TMM is applied to consumer loan. We also develop the corresponding MCMC algorithms of the particular TMM for estimating model parameters. Numerical examples illustrated that the proposed TMM is more accurate in assessing and predicting the credit risk of consumers in loan portfolio than DCMM and MM, especially when the business cycle is stuck in one phase for a long time.

Our research still has some limitations, which may be addressed in future research. The simulation studies confirm that the model fitting process can retrieve the original parameters closely. However, the simulated data do not assess potential practical limits and difficulties under real conditions. Concerning the using of TMM in real credit risk situations, an application to real data would substantially improve the quality of our paper. The early payoff case and recovery from default state can also be incorporated according to the real situation. A more complicated data structure such as default correlations among consumers and the missing data case can be further extended.

Appendix

To simplify the notation, for we define:

where is the number of consumers in portfolio and is the term of each loan.

The MCMC algorithms of the particular TMM are similar to the MCMC algorithms of DCMM which are given in Fitzpatrick and Marchev [9]. The five main steps of the MCMC algorithms of the particular TMM are as follows.

A. Priors Specification

The priors on are Dirichlet as follows:

B. Sampling from

Given the observations and the current value of the parameters , we wish to simulate a sample path of the hidden Markov chain, from its conditional distribution:

We draw values for backward. The “typical term” in (B.1) can be written as:

By Bayes theorem, the mass function of hidden state given information up to is:

By the law of total probability, we have:

The initial probability distribution of hidden states is:

Using (B.3)(B.5), we can obtain for

Combining with (B.1)(B.2), can be simulated.

C. Extra Permutation Step

To improve the convergence properties of the algorithm, a random permutation of the labels is applied. See Fitzpatrick and Marchev [9] for a detailed description.

Then we set

D. Sampling from

Given the process of hidden state , it is rather straightforward to determine the posterior distribution of . Using Bayes’ theorem, the posterior distribution can be simulated separately and independently as follows:

where

, is indicator function.

The steps B, C and D are repeated until a maximum number of iterations is reached.

E. Post-Processing Algorithm

The posterior inference step should be trivial once is drawn but the draw is complicated by a nonidentifiability problem called label switching. This will mean that ergodic averages of component-specific quantities will be identical and thus useless for inference. In dealing with the problem of label switching, a post-processing algorithm is applied to ensure the labels of the hidden states are consistent for all iteration. See Figure 3 of Boys and Henderson [28] for a d etailed description.

If at iteration the current estimate of is then

(E.1)Choose a permutation to minimize (E.2)Apply the permutation to output and (E.3)For set ;(E.4)Let be the size of sampling. We estimate the posterior probabilities of the hidden states along with the sequence by .

Data Availability

The data used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this paper.

Acknowledgments

This work was supported by the National Natural Science Foundation of China (grant numbers 71790593, 71521061, and 71573077). We are grateful to the editor and referees for many valuable comments and suggestions.