Abstract

Residual useful lifetime (RUL) prediction plays a key role of failure prediction and health management (PHM) in equipment. Aiming at the problems of residual life prediction without comprehensively considering multistage and individual differences in equipment performance degradation at present, we explore a prediction model that can fit the multistage random performance degradation. Degradation modeling is based on the random Wiener process. Moreover, according to the degradation monitoring data of the same batch of equipment, we apply the expectation maximization (EM) algorithm to estimate the prior distribution of the model. The real-time remaining life distribution of the equipment is acquired by merging prior information of real-time degradation data and historical degradation monitoring data. The accuracy of the proposed model is demonstrated by analyzing a practical case of metalized film capacitors, and the result shows that a better RUL estimation accuracy can be provided by our model compared with existing models.

1. Introduction

Prognostics and health management (PMH) has been a systematic method utilized to evaluate the reliability or residual life of actual life-cycle conditions in a system, predict failure degree, reduce the risk in operating, improve task completion rate, and make maintenance decisions. Prognostics is usually characterized by estimating the RUL of a system based on condition monitoring (CM) data [1, 2]. Once a prognosis is available, some health management tactics, such as maintenance, replacement, and logistic support, can be performed properly to obtain the operational objectives, which is required [3, 4].

In general, RUL prediction is an important step in PMH. Over the last decade, there are a great deal of research studies as to RUL prediction have been developed for a large wide range of industrial products, for example, bearings [5, 6], gearboxes [7], lithium batteries [8], organic light emitting diodes [9], and laser generators [10]. The main idea of RUL is to realize the life prediction by obtaining the distribution or expectation of RUL according to the effective information such as equipment failure mechanism, CM data, and failure time data [11, 12]. For fields with high safety and reliability requirements, for instance, aerospace and electronic equipment, whose performance gradually decreases as service time increases, their final failure is manifested as degraded failure. At the same time, due to measurement errors, environmental interference, and other factors, the degradation process has a certain degree of randomness. At present, life prediction based on statistical data is a central issue in current research [13, 14]. Based on the probability density function (PDF) of the RUL with the randomness of the degradation process, the PDF of the RUL density can be obtained.

In life prediction based on statistical data, stochastic processes are often used to fit the degradation process, such as Gamma process [15, 16], Wiener process [17, 18], and Inverse Gaussian process [19, 20]. The Wiener process is convenient to describe the degradation system that has a random nonmonotonic independent incremental process, which are influenced by external environment, internal state changes, and load conditions [21]. Li et al. in [22] proposed a novel RUL prediction models combined with degradation processes described by establishing the system age process and the system state process. They calculated the PDF of the RUL based on a closed-form solution by calculating the degradation trajectories values. Si et al. in [2] derived a random Wiener process model to predict the RUL of equipment by merging a recursive filtering algorithm and an EM algorithm for parameter estimation. With due consideration of the influence of measurement error, a nonlinear random Wiener model is proposed to predict remaining useful life [23].

The above research has enriched the application of stochastic processes in life prediction; however, a large number of the current degradation models made assumptions that the degradation process is subject to a single degradation law. Due to the staged changes in internal failure mechanism and dynamic changes in external environmental condition, many degradation process of equipment is characterized by multistage degradation [24]. However, for the current research in the Wiener process of the performance degradation modeling, there are few of them who target on multistage performance degradation models. Therefore, Wang et al. in [25] further proposed a two-stage degradation model of both Gamma process and Wiener process. In reference to the attenuation process of the brightness of light emitting diodes, Wang et al. in [9] assumed that individual differences exist in the change points and utilized a two-stage Wiener process model and Bayesian estimation method to analyze the degradation data under logarithmic transformation. In addition, how to integrate the degradation data of similar equipment to estimate the hyperparameters of the degradation model is the key to the RUL prediction. A two-stage maximum likelihood estimation (TSMLE) method was utilized to calculate the hyperparameters of the degradation model to achieve life prediction in some literatures [26]. Zhang et al. in [27] proposed a real-time residual life prediction algorithm including the Cumulative Sum (CUSUM) method and the Brownian motion with drift. However, the CUSUM method is only suitable for change-point degradation analysis and lacks the use of prior knowledge; when degradation data is small, the estimation accuracy of the two-step method is not high. Additionally, the change points in the multistage stochastic degradation process are sometimes scattered, so the RUL prediction based on the random process of the change point analysis is often not accurate enough.

Aiming at the above problems, in this paper, a multistage random degradation model based on the Wiener process is proposed to estimate the RUL of equipment aiming at above issues. Assuming that the parameters of the degradation model follow, respectively, certain random distributions to describe the differences between single equipment, an EM algorithm is used for iteratively estimating the prior distribution of the degradation model parameters based on the historical degradation data and historical failure time data. Finally, we apply the Bayesian algorithm to update the posterior distribution parameters of our model at each stage. By analyzing the degradation process of metallized film capacitors, the remaining life expectancy of individual capacitors can be predicted.

2. Residual Life Prediction Model of Equipment

2.1. Model Analysis and Assumptions

Generally, a degradation model of the Wiener process can be described aswhere u is the drift coefficient, σ is the diffusion coefficient, and is the standard Brownian motion.

When we predict the remaining life of the equipment, the following assumptions should be made:(1)If the performance degradation of the equipment exceeds the failure threshold, degradation failure will occur.(2)The performance degradation of equipment has the characteristics of multiple stages, each performance degradation stage obeys the Wiener process, and it is divided by a certain fixed degradation amount.(3)The drift coefficient μ and diffusion coefficient σ of the Wiener process are random variables. We assume that and as joint prior distribution of u and ω, which obeys the Gaussian-Gamma distribution. f (u,ω) can be expressed aswhere a, b, c, and d represent the hyperparameters in prior distribution of u and ω.

2.2. Performance Degradation Modeling

In fact, the degradation process of the equipment is characterized by multistage and randomness. A multistage degradation model of equipment can be expressed aswhere is the indicative function, is the initial value of the Wiener degradation model, and ti represents the time that the performance degradation of each stage reaching its boundary value. is the performance degradation process of each stage.

The degradation process of the equipment in each stage can be described by using the Wiener process without loss of generality, so the performance degradation amount of the equipment can be expressed aswhere is the boundary value of kth performance degradation stage, represents the degradation failure threshold, and and are the drift coefficient and diffusion coefficient of the kth stage of Wiener degradation, respectively.

The remaining life of the equipment represents the time from the performance degradation value at current time to the failure threshold According to the definition of performance failure, the remaining life is expressed as

Denote T as the life of the equipment, according to the relationship between the life and the remaining life, and it can be expressed as

Denote as the time when the device reaches the threshold value of the kth stage of performance degradation from the initial moment, and can be expressed aswhere . Because the failure time of the Wiener process obeys the Inverse Gaussian distribution, obeys the Inverse Gaussian distribution , and it is formulated as

Therefore, the probability density distribution function in the kth stage degradation process of the equipment can be formulated as

When the performance degradation value at of the equipment meets the condition , the remaining life of the degradation stage of equipment can be expressed as

The probability density distribution function of the remaining life of equipment degradation is expressed as

Because of , the expectation of remaining life can be expressed as

3. Bayesian Deduction of Hyperparameters

When the boundary value of each performance degradation stage is determined, μ and σ of the Wiener process jointly determining the probability density distribution of the remaining life, the parameters μ and need to be solved. Because the degradation process of individual equipment is different, in order to describe it conveniently, we assume that μ and obey the following conjugate prior distribution:

When the real-time degradation data is obtained, we can utilize the Bayesian formula to derive the posterior distribution , which is formulated aswhere presents log-likelihood function for parameters μ and , which is expressed as

is the joint prior density function of μ and , which is formulated as

In view of the derivation above, we combine equations (14)–(16) to obtain the following form:

Because the conjugate prior distribution of random parameters and its posterior distribution have the same distribution function, the difference is only the change of the hyperparameter value in different degradation stages. According to equation (17), we can obtain the posterior estimation values of the hyperparameters in the kth performance degradation stage deduced as

The posterior mean and of μ and ω can be obtained from , and from equation (17), the kth performance degradation stage is expressed as

After getting the result of , we can obtain the posterior mean values in kth stage to realize the prediction of the remaining life of the equipment.

4. Parameter Estimation of Degradation Model

4.1. Determination of the Complete Maximum Likelihood Function of the Hyperparameters

When the boundary value of each stage of performance degradation is determined, the probability density distribution of the remaining life can be determined by the Wiener process parameters μ and in each performance degradation stage. Therefore, parameters μ and is required to estimate. Because we assumed that the unknown parameters μ and are random variables, the unknown hyperparameters in the prior distribution of parameters can be estimated based on the historical performance degradation data and historical failure time data [28].

For the same kind of equipment, we can collect the degradation data of N equipments as priori information in CM time. Assuming that the performance degradation data of the ith (i = 1,2, …, N) equipment at the jth (j = 1,2, …, n) measurement is denoted as , the corresponding measurement time is . The kand of the historical data sample of the kth performance degradation stage are, respectively, expressed as

The probability density function of the degradation increment , in the kth stage of degradation based on the characteristics of the Wiener process, can be expressed as

Therefore, the complete likelihood functions of hyperparameters of the historical degradation data in the kth stage are expressed as

In theory, we can obtain the priori estimates of hyperparameters for the kth stage Wiener process , , , and through the traditional maximum likelihood estimation (MLE), and it can be expressed aswhere is the digamma distribution function, are implicit data, and the unknown items of the implicit data must be output first, otherwise, we cannot obtain the results of , , , and directly.

4.2. Estimation of Hyperparameter

The EM algorithm is an effective method for maximum likelihood estimation [29]. It is mainly used for parameter estimation of missing data, for instance, the EM algorithm can be applied to estimate the parameters of likelihood function when observed data is incomplete or the expression of the likelihood function is so complicated that the traditional estimation method of the maximum likelihood function could be failure.

Each recursive iteration process of the EM algorithm contains E steps and M steps. The first step of the EM algorithm (E-step): given the observed data ΔXk and current hyperparameter estimated value, we can get the conditional expected value of unknown latent variable in complete data log-likelihood function . The second step of the EM algorithm (M-step): solve the and make them as parameter estimate values for the next iteration.

In E-step, if iteration process performs r times in the kth stage of the degradation process, , and are the estimated value in lth (1 ≤ l ≤ r). The expectation that each unknown item contains implicit data in the l + 1 step iteration process is

In M-step, we substitute the expectations of μi,k and that are obtained in E-step into equation (23), and the estimated values of hyperparameters , , , and after l + 1 iterations under the kth stage degradation can be obtained as

If the error between , , , and and , , , and reaches the set condition after r iterations, then the a priori estimate of the hyperparameter is obtained.

4.3. Real-Time Remaining Life Distribution of Equipment

If joint posterior distribution of the parameters μ and are obtained, the marginal probability distributions can be obtained, respectively. Because the joint posterior distribution of μ and obeys Gaussian-gamma distribution, the posterior distribution of μ obeys and the posterior distribution of obeys . IG (·) is the Inverse Gamma distribution, so the posterior distribution of μ and can be expressed as

Moreover, the real-time remaining life density distribution of the equipment can be further expressed as

4.4. Prediction Steps for Remaining Life of Single Equipment

When the real-time performance degradation data of a single equipment is obtained, the remaining life of a single aero engine can be predicted in real time, and the specific steps are as follows: Step 1: we estimate the unknown hyperparameters in the prior distribution of the parameters μ and ω of the degradation model at each stage, getting estimated values , , , and by the EM algorithm by historical degradation data X and failure time data ξ. Step 2: when the real-time performance degradation data ΔX of the equipment is obtained, the model parameters in each performance degradation stage are updated in real time using equation (18) according to the Bayesian method. Moreover, we get the estimated hyperparameter values , , , and in posterior distribution in our model. Step 3: according to equation (26) the posterior estimated values and of our model in each performance degradation stage are calculated, respectively, and substituting them into equation (27), the remaining life density distribution of equipment after Bayesian updating can be obtained. Finally, we can estimate the expectancy value of equipment remaining life though calculating equation (12).

5. A Practical Case Study

Metalized film capacitor, as one of an important component in Inertial Confinement Fusion (ICF) laser equipment, is the key of life prediction to maintain the laser equipment and to develop a spare parts strategy [30]. However, some problems are unavoidable such as impurity or defect areas in organic film of a metallized film capacitor when it is in the production process. It is prone to form a discharge channel broken down by the external voltage during multiple charge and discharge processes, and because of weak electrical resistance in areas, capacitor result in “self-healing” phenomenon. A single self-healing causes a very small loss of capacitance; however, as the cycle of charge and discharge process increases, the capacitance value of the capacitor decreases continuously. When the loss of capacitance exceeds a certain threshold, the degradation rate of capacitance increases. Usually, we define 5% of the capacity loss as the end-of-life index [31]. The variation of the capacitance degradation under normal working conditions of the eight capacitors is shown in Figure 1, and t is the number of charge and discharge.

It can be observed from Figure 1 that the capacitance of most capacitors shows a decreasing trend at the increase of the number of charge and discharge. The degradation rate of metallized film capacitors is relatively slow in the initial stage. When the capacitance loss reaches about 0.23 μF, the capacitance degradation speed accelerates. We assume that the performance degradation threshold D1 = 0.23. Degradation of another capacitor during working of charge and discharge is shown in Table 1, and we record this capacitor as No. 9 capacitor. Degradation failure occurs when the capacitance change ΔC of the capacitor exceeds 5% of the initial capacitance value C0. We record the failure threshold Dn = 5% C0.

Take degradation data in first five of the 8 capacitors as historical monitoring data for priori parameter estimation, and take the degradation data in last three of them as real-time data for posterior parameter updating accordingly. We assume that the initial values of the hyperparameter is (1, 1, 1, 1), and when the error between the adjacent estimated values after iteration is not greater than 10−6 to end EM iteration process, the priori estimated hyperparameter values , , , and obtained. Moreover, the iterative convergence process of hyperparameter estimation is shown in Figure 2, and the a priori estimated values of hyperparameters at each stage are shown in Table 2.

After determining the prior distribution of the model parameters in each performance degradation stage, the real-time performance degradation data of a single capacitor is obtained. Moreover, according to the Bayesian method, the model parameters in each performance degradation stage can be updated in real time. Take No. 9 capacitor as an example for life prediction, and we rely on real-time performance degradation data of last three of capacitors to estimate the hyperparameters of the posterior distribution in the first stage and second stage. Tables 3 and 4 show the estimated values after Bayesian updating in different stages. Finally, we substitute the estimated values of Bayesian updating in the first stage and second stage into equation (27), and the probability density distribution of the remaining life can be obtained. Figures 3 and 4 show the real-time remaining life probability density distribution diagrams of No. 9 capacitor in the first and second stages, respectively.

The EM algorithm has certain advantage in estimation of hyperparameter. Comparing the EM algorithm with the Two-stage Maximum Likelihood Estimation (TSMLE) [26] for the error of the hyperparameter estimation results, we utilize the sum of relative errors Err of 4 hyperparameter estimations to show the precision of the estimation results, and Err is expressed as

The estimation error between the two methods is shown in Table 5. The result of Err in the EM algorithm and the TSMLE method can be seen. Obviously, the EM algorithm has certain accuracy advantage in the estimation of hyperparameters.

Table 6 shows the Relative Error (RE) of RUL prediction for No.9 Capacitor in our model, model of single-stage degradation [31] and the model of Brownian motion with drift [32]. It can be seen that the relative error of considering the multistage degradation process is smaller than the other models, which proves that the proposed model can provide better accuracy for predicting the remaining life of metallized film capacitors. In addition, due to environmental influence, defects, or impurities of organic film in the same type capacitors, individual capacitor has different degradation. Therefore, the Wiener process distribution parameter estimation based on Bayesian estimation of prior degradation information is more in line with engineering reality.

6. Conclusion Remarks

In this paper, we propose a degradation model based on the Wiener process combined with the EM algorithm and Bayesian method to estimate the RUL of equipment. A RUL estimation method is constructed with due considering the multistage degradation and individual differences in equipment. By assuming that parameters of the Wiener process are random variables which obey a certain distribution, we utilize EM algorithm to estimate prior parameter of the model based on historical degradation monitoring data and updating posterior parameters based on CM data by Bayesian. Finally, we can obtain different CDF of RUL and expectation value of RUL.

By comparing the proposed model with existing models, we utilize RE to measure prediction accuracy, and the result shows that the accuracy of proposed model is better than existing models. The Wiener process that considers individual differences can better describe the degradation process of the equipment, and multistage degradation is more suitable in engineering practical. In addition, we can see that the estimation accuracy of EM is better than the TSMLE method in hyperparameter estimation.

Data Availability

The data used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest

The authors declare that they have no conflicts of interest.