An Improved Bearing Fault Diagnosis Model of Variational Mode Decomposition Based on Linked Extension Neural Network

Wang, Tichun; Wang, Jiayun

doi:https://doi.org/10.1155/2022/1615676

Computational Intelligence and Neuroscience

On this page

Abstract Introduction Conclusions Data Availability Conflicts of Interest Acknowledgments References Copyright Related Articles

Special Issue

Human Behavior Modelling in Engineering Management under Industry 4.0

View this Special Issue

Research Article | Open Access

Volume 2022 | Article ID 1615676 | https://doi.org/10.1155/2022/1615676

An Improved Bearing Fault Diagnosis Model of Variational Mode Decomposition Based on Linked Extension Neural Network

Tichun Wang¹and Jiayun Wang¹

Academic Editor: Huihua Chen

Received29 Nov 2021

Revised31 Dec 2021

Accepted11 Jan 2022

Published25 Apr 2022

Abstract

In bearing fault diagnosis, due to the insufficient obtained supervised data and the inevitable noise contained in the vibration signals, the problem of clustering bearing fault diagnosis with imbalanced data containing noise is caused. Thanks to the ability to quickly and fully learn boundary information in small samples, the extension neural network-type 2 algorithm (ENN-2) has the potential in imbalanced data clustering and has been gradually applied in fault diagnosis. Therefore, in order to improve the unstable clustering performance of ENN-2 caused by its heavy dependence on input order of samples, a novel algorithm called linked extension neural network (LENN) is developed by redesigning the correlation function and its iterative method, which greatly reduces the clustering iteration epochs of the algorithm. In addition, an evaluation index of clustering quality for this novel algorithm, extension density, is also proposed. After that, a bearing fault diagnosis model of variational mode decomposition (VMD) based denoising and LENN is proposed. Firstly, VMD is used to get intrinsic mode functions (IMFs), and the correlation coefficients of IMFs are calculated for signal denoising. Secondly, the features are extracted from denoised signals and selected by PCA algorithm, and the fault diagnosis is finally completed by LENN. Compared with ENN-2, K-means, FCM, and DBSCAN based models, the proposed model identifies the faults with different severities more accurately and achieves superior diagnostic ability on different imbalance degrees of datasets, which can further lay a foundation for clustering fault diagnosis based on vibration signals.

1. Introduction

Bearing is one of the most common connecting parts in rotating machinery, which is more likely to break down because of wear, fatigue, corrosion, or overload. Therefore, diagnosis timely and accurately of bearing conditions is of great significance to ensure the mechanical operation steady and reliable. Much study in recent years has focused on bearing fault diagnosis based on vibration signals, including signal acquisition and noise reduction, feature extraction and selection, and fault recognition. However, in industry, diagnostic data is often derived from monitoring signals, bringing great difficulties to record the machinery conditions by frequent downtime checking or manual labeling, which is time-consuming and laborious and resulting in insufficient labeled data for fault diagnosis [1]. Moreover, the number of obtained fault samples is always far less than that of normal samples from monitoring signals, generating the diagnostic problem of imbalanced data.

Clustering analysis is especially suitable for fault recognition when there is no sufficient labeled data. Because of the nonlinear and unstable characteristics of bearing vibration signals, scholars preserve in their attempts to construct clustering diagnosis models with stronger identification ability. For example, after processing the data by ensemble empirical mode decomposition (EEMD) and linear discriminant analysis (LDA), Hou et al. [2] used Gath-Geva clustering algorithm (GG) to identify the faults of rolling bearing and got a satisfactory clustering result with better intraclass compactness. Chang et al.[3] achieved 96% accuracy of permanent magnet synchronous motors demagnetization fault diagnosis by auto-encoder and K-means algorithm. In addition, Li et al. [4] integrated K-means in the neural network architecture for unsupervised learning and proposed a deep representation clustering-based diagnosis model to address the data sparsity issue in data-driven machinery fault diagnosis. Also, K-means was utilized together with K-nearest neighbor algorithm (KNN) to identify a transformer’s fault category by cumulative votes [5]. On the other hand, for the algorithms which are unnecessary to set the number of fault categories before clustering, the study of Li et al. [6] describes a method to generate clustering template of rolling bearing so as to reduce the effect of noise on diagnostic accuracy using density-based spatial clustering of applications with noise (DBSCAN). This algorithm was also widely used in wind turbine condition monitoring [7] and diagnosis [8], photovoltaic power station fault detection [9], bolts with mission pins on transmission lines detection [10], and thermal runaway diagnosis of battery systems [11]. Moreover, Wei et al.[12] adopted affinity propagation clustering algorithm (AP) and a novel adaptive feature selection technique to identify different fault categories and severities of bearings successfully, and another bearing fault diagnosis model based on expectation maximization algorithm (EM) and wavelet packet was proposed by Zhang et al. [13] for coal cutter. Other clustering algorithms, including spectral clustering [14], fuzzy C-means (FCM) [15], clustering by fast search and find of density peaks algorithm (CFSFDP) [16], and extension neural network-type 2 (ENN-2) algorithm [17–19] were also applied to diagnosis. In conclusion, the clustering algorithms represented by K-means need to know the number of fault categories before clustering, which is contrary to the fact that clustering analysis does not require prior knowledge; however, the clustering algorithms represented by DBSCAN do not need to know the number of fault categories, but suffer a complex parameter adjustment process during training. Therefore, there remains a need for an efficient clustering method with less prior knowledge, simple parameter tuning process, and stable performance.

At the same time, considering the vibration signals used for fault diagnosis not only contain the running state signals of bearings but also contain a lot of aliasing signals with noises, signal denoising methods have generated considerable recent research interest. The commonly used denoising methods mainly include wavelet threshold denoising method, empirical mode decomposition (EMD), ensemble empirical mode decomposition (EEMD), and local mean decomposition (LMD). For example, Komaty et al. [20] introduced a signal-filtering method of EMD and a similarity measure. In their studies, white Gaussian and colored noises were almost removed from the signals by selecting the decomposed modes according to the similarity between the estimation of the probability density function (pdf) of the input signal and that of each mode, and combined EEMD with grey theory, Jia et al. [21] removed the noise of signals by evaluating noise levels of decomposed components of signals by grey relational analysis and selecting the noise-dominant components by grey model. Yang et al. [22] proposed an adaptive signal denoising method based on LMD. However, these decomposition methods have end-effect and modal aliasing phenomena and are more sensitive to sampling frequency, resulting in pretty large decomposition error. To overcome the defects above, Dragomiretskiy and Zosso [23] in 2014 have proposed variational mode decomposition (VMD), which is a new time-frequency analysis method with adaptive signal. Based on VMD, some research combined this method with other algorithms for signal denoising, such as singular value decomposition (SVD) [24], data-driven time-frequency analysis (DDTFA) [25], and wavelet threshold noise reduction [26], and there were also many studies that selected the decomposed modes in some evaluation methods and reconstructed the signal after VMD for noise reduction, such as kurtosis criterion [27], Bhattacharyya distance [28], and a novel parameter called signal clarity proposed by Li et al. [29]. In addition, Wang et al. [30] used VMD innovatively to eliminate outliers and noise points in features extracted from signals so as to achieve the purpose of signal-filtering and denoising.

However, few researchers have addressed the problem of bearing clustering fault diagnosis on imbalanced data with noise at the same time. Thus, in this paper, close attention is paid to develop an effective clustering algorithm on imbalanced data and construct a bearing fault diagnosis model dealing with the insufficient data contained noise. In our study, an improved clustering algorithm of ENN-2, called linked extension neural network (LENN), is proposed firstly, and based on this algorithm and VMD-based denoising method, a novel bearing fault diagnosis model is presented and applied to analyze the fault conditions and severities of bearings. To validate the effectiveness of the proposed algorithm and the model, three comparative experiments are designed and conducted on commonly used artificial clustering datasets and real bearing fault signals. The results manifest that the proposed model yields higher identification accuracy of minority fault clusters on imbalanced data with noise comparing with the models based on ENN-2, K-means, fuzzy C-means (FCM), and DBSCAN. Our study provides a promising method for machinery fault diagnosis based on insufficient labeled signals with imbalance, permitting an easier parameter adjustment process with less prior knowledge.

The rest of this paper starts with the novel LENN algorithm in Section 2. Section 3 provides a brief description of the proposed model, and the proposed algorithm and model are experimentally verified in Section 4. In Section 5, the concluding remarks are drawn.

2. Linked Extension Neural Network

Extension neural network-type 2 algorithm (ENN-2) is a new clustering algorithm based on extension theory [31]. With no need to set the number of clusters manually in advance, ENN-2 shows good clustering ability and fast convergence speed in simple construction. But in fact, the performance of ENN-2 relies heavily on the initial points and correct input order of the samples. To overcome these deficiencies, we develop a novel clustering algorithm called linked extension neural network (LENN).

2.1. Network Structure

Following the form of ENN-2, the structure of LENN contains only two layers, which is shown in Figure 1. The number of input layer nodes depends on the feature dimension of data, and the number of output layer nodes is determined by the number of clusters. Between the two layers, the upper and lower bounds of the clusters connect the neurons as the connection weights, and output neurons are successively constructed in the process of iteration (represented by color shades in Figure 1), with only one node activated at a time to indicate the clustering result.

2.2. Improved Correlation Function

2.2.1. Correlation Function in ENN-2

In ENN-2, the correlation function ED based on the extension distance is used to measure the distance between a sample and a target cluster. The extension distance in extension theory describes the distance between a point and an interval quantitatively, which is defined aswhere a and b are the lower and the upper bounds of , respectively.

Given the center of the kth cluster is , the boundary of the kth cluster can be represented by introducing a hyperparameter to measure the distance between the center and the ideal boundary as

Also, based on the definition of extension distance, the correlation function ED between a sample and the boundary of the kth cluster is defined as

As shown in Figure 2, ED measures the extension relationship between a feature and its boundary. From Figure 2, it can be seen that, for the jth dimension of the kth cluster, when , .

For a sample with n-dimensional features, the sample could be classified into the kth cluster if

Thanks to this property of ED, the algorithm can estimate a sample belongs to which cluster and update the boundary and the center of the corresponding cluster to revise its information for iteration. Therefore, ENN-2 does not require the number of clusters before learning and can obtain better clustering results by only adjusting the unique hyperparameter .

However, since the input order of samples determines the updating direction of clusters’ boundaries and centers in the iteration process, ENN-2 is greatly affected by the initial point selection and the input order of samples and shows unstable clustering performances. Therefore, it is necessary to improve this algorithm.

2.2.2. Improved Correlation Function in LENN

Different from ENN-2, each sample could be considered as a center during iteration in LENN. Take for example, its boundary can be represented as (4) with the hyperparameter :

In order to measure the correlation distance between the sample and , the new correlation function is defined as

The new correlation function is plotted in Figure 3. For the jth feature of the two samples, when , , and taking all features into account, the sample could be considered to belong to the same cluster as sample if

2.3. Learning Algorithm of LENN

The learning process of LENN is an unsupervised learning. It takes a dataset with samples as the input, and after calculating the correlation distances between samples level by level, the clustering results of the dataset are finally output in just one epoch. The specific learning steps are as follows:(1)Set an optimal hyperparameter in .(2)Input a sample randomly and mark the cluster which belongs to as k = 0. Calculate the improved correlation function ED between and all the other unmarked samples according to equation (5) and mark the samples which meet the requirements of as . (3) For all the qualified samples in step (2), each sample is taken as the center to traverse, and EDs between this sample and all the remaining unmarked samples are calculated. Similarly, the samples that meet the condition of are also marked as until no qualified samples left. (4) A sample is randomly generated from the remaining unmarked samples for input to create a new cluster . Repeat steps (2) and (3).(5)The learning process is finished until all samples are marked.

At the end of the iteration, if a cluster contains too few samples, it can be regarded as noise.

The iterative approaches of ENN-2 and LENN are both graphically presented in Figure 4. During the iteration, ENN-2 needs to update the central coordinates each time (represented by the orange dots), and the updating direction is significantly affected by the input order of the samples. Ideally, the input order of the samples should be sorted according to the distance between samples from small to large, which is pretty difficult to ensure for the unpretreated messy datasets. As can be seen from Figure 4(a) clearly, sample 6 is closer to the center corresponding to sample 4 than sample 5. If sample 6 is input for calculation first according to (3), the result meets the requirement of (4), indicating sample 6 and samples 1∼4 belong to the same cluster, and then the final clustering results of the whole dataset contain 2 clusters. But, if input sample 5 first for calculation, the result of (3) does not satisfy (4) because of the distant relationship of sample 5 and the current center, and then a new cluster is created for iteration, resulting in the final results of 3 clusters. However, in Figure 4(b) of LENN, one specific sample is regarded as the center each time, and all the qualified samples which satisfy (7) with the sample are found and marked in this iteration. Taking two-dimensional eigenspace as an example, the learning essence of LENN is to find the samples consecutively which fall in the square constructed by the initial center sample with as the side length. All the qualified samples are classified into the same cluster with their center. And then, the next iteration begins with a subsample of the cluster. Finally, all qualified samples of the same cluster are found by this iterative linkage method. Therefore, in Figure 5, samples 1, 4, 6, 5, and 10 are successively taken as the centers for iteration, and the final clustering result contains only 2 clusters with samples 1∼9 belonging to the same cluster.

(a)

(b)

(a)

(b)

According to the learning process of the algorithm, LENN has the following remarkable advantages:(1)Based on extension distance, LENN defines a new approach to categorization by distance calculation.(2)There is no need to preset the number of clusters as in ENN-2; in addition, it is not necessary to initialize clustering center.(3)The improved algorithm only needs one epoch to complete the clustering process and converges faster.(4)LENN is not sensitive to the initial center and the input order of the samples and preserves more stable clustering ability than ENN-2.

Nevertheless, LENN is very sensitive to the hyperparameter , so it is necessary to select the optimal before learning.

2.4. Parameter Selection Method

In LENN, the selection of the hyperparameter seriously affects the final number of clusters and the accuracy of clustering results. As shown in Figure 5, for a smaller (such as = 7.2 in Figure 5(a)), the constructed squares will be smaller with fewer qualified samples contained, resulting in more clusters in the end, and for a bigger (such as = 8.7 in Figure 5(b)), the constructed squares will be likewise bigger with more qualified samples contained, and fewer clusters are produced finally.

For clustering algorithms, silhouette coefficient is often used for evaluation with no real labels. However, this index is more suitable to analyze the clustering effectiveness of balanced data [32]. Considering this paper is primarily concerned with imbalanced data clustering problem, a novel evaluation index extension density EDe is developed to tune the hyperparameter based on extension distance, which is defined aswhere m_k is the number of samples in the kth cluster, Z_kj is the center of the jth feature, and a_kj and b_kj represent the lower and upper bounds of the kth cluster respectively, a_kj, b_kj and can be computed by

Typically, EDe declines with the increasing , and the optimal lies in the turning point of the curve.

3. Proposed Bearing Fault Diagnosis Model

3.1. Signal Denoising

Bearing vibration signals tend to present nonlinear and nonstationary characteristics with noise inevitably. Without signal denoising, the outliers in raw data will be transferred into the feature space through feature extraction and affecting the diagnostic results of the model. Compared with empirical mode decomposition (EMD) and ensemble empirical mode decomposition (EEMD), variational mode decomposition (VMD) can effectively extract each frequency component of the signal and solve the problems of mode mixing and white noise. Therefore, VMD-based method is used for noise reduction in this paper.

3.1.1. The Principle of VMD

VMD is a variational problem solving process based on classical Wiener filter, Hilbert transform, and mixing, which can be written as the following constrained optimization form:where K is the number of modes to be decomposed, represents Dirac function, means the convolution operator, and and stand for the kth intrinsic mode function (IMF) and center frequency after decomposition.

The solution process of this problem is as follows:(1)Transform the constrained variational problem to a nonconstrained variational problem by introducing the quadratic penalty factor and Lagrange multiplier :(2)Solving the minimization problem of equation (12), alternating direction method of multipliers (ADMM) is adopted to seek the saddle point of the augmented Lagrange expression by alternatively updating , , and , and can be obtained by where equals to , and equals to .

Next, transform to frequency domain by Parseval/Plancherel Fourier isometric transform:

Replace in (13) with and then we can get

(14) is then converted to the form of nonnegative frequency interval integral:and set the first item in (15) to zero to obtain the quadratic optimization problem:

Similarly, the minimization problem of the center frequency can be obtained by converting the center frequency updating problem to frequency domain:where is the Wiener filtering of , and represents the center of power spectrum.

Also, the learning process of VMD is as follows:(1)Initialize , , and n.(2)Update and according to equations (16) and (17).(3)Update by(4)For a given discriminant accuracy of , if , stop iteration, otherwise return to step (2).

3.1.2. VMD-Based Denoising Method

The VMD-based denoising method comprises two steps: (a) decompose the vibration signal by VMD. (b) Calculate correlation coefficients of IMFs obtained by VMD for noise filtering and reconstruct the denoised signal. The parameters , , and K of VMD should be set before decomposition, which may affect the results noticeably.

Correlation coefficient is to describe the correlation degree between the original signal Y and its IMFs , which is defined as

The correlation coefficient also offers a means of measuring the degree of noise contained in IMFs. Thus, by selecting the sensitive IMFs according to (20) below [33], we are able to obtain the reconstructed denoised signal:where is the threshold of the ith IMF. Retain the IMFs of as sensitive IMFs for signal reconstruction, and remove the unqualified IMFs directly.

3.2. Feature Extraction and Selection

3.2.1. Bearing Fault Features

In feature extraction, to reflect the operation conditions of bearings accurately, objectively, and simply, statistical features are extracted from the denoised signals in this study, including 11 time domain statistical features and 12 frequency domain statistical features shown in Table 1 [34]. For time domain statistical features extracted from raw signals, and reflect the amplitude and energy of vibration in time domain; and present the distribution of the signal in time series. For frequency domain statistical features extracted from FFT spectrums, F₁₂ shows the vibration energy in frequency domain; , , and stand for the dispersion and concentration degree of the spectrum; and represent the position variation of the main frequency band.

Here, is a signal series in time domain, n = 1, 2, …, N; N is the number of data points. is a frequency spectrum of signal , k = 1, 2, …, K, K is the number of spectrum lines, and is the frequency value of the kth spectrum line.

3.2.2. Feature Selection Based on PCA

Although the multidomain features obtained above better describe the signals than using time domain or frequency domain features only, there may be feature redundancy, which will affect the diagnostic performance of the model. Considering the lack of labels of samples in clustering fault diagnosis, a commonly used unsupervised feature reduction algorithms principal component analysis (PCA) is adopted in the diagnosis model. The specific steps of PCA are as follows:

Let the multidomain characteristic matrix obtained above be , where the number of samples is , and the dimension of features is , then its covariance matrix can be obtained bywhere is a matrix composed of row vectors of , .

After that, the eigenvalues and the eigenvectors of the covariance matrix are calculated bywhere are the eigenvalues of , and are the corresponding eigenvectors of the eigenvalues.

Arrange the eigenvectors according to the magnitude of the corresponding eigenvalues, take the front k rows of eigenvectors to form the matrix , and obtain the k-dimensional data by

3.3. Bearing Fault Diagnosis Model of VMD-Based Denoising and LENN

Based on the above techniques, a bearing fault diagnosis model of VMD-based denoising and LENN is proposed in this paper, including three stages: (a) signal denoising based on VMD and correlation coefficient calculation of IMFs; (b) feature extraction and selection by PCA; (c) clustering fault diagnosis on LENN. The specific diagnostic steps are as follows, which are shown in Figure 6.(1)After signal acquisition, divide the raw signals into some segments of 2048 data points.(2)For the sake of noise reduction, decompose each signal and calculate correlation coefficients and thresholds of IMFs according to equations (19)∼(20). Reconstruct the signals by retaining the sensitive IMFs and removing the IMFs of .(3)Based on the denoised signals, 11 time domain statistical features are extracted from the signals and 12 frequency domain statistical features are extracted from their FFT spectrums according to Table 1.(4)In order to avoid the influence of redundant features on the diagnosis results and improve the diagnostic speed of the model, PCA algorithm is used to obtain low-dimensional fault features for diagnosis.(5)Finally, the proposed LENN algorithm will identify bearing fault conditions by clustering the obtained low-dimensional feature matrix into different clusters and achieve fault diagnosis.

4. Experimental Verification

4.1. Experiment of LENN Algorithm on Artificial Datasets

In order to verify the clustering effectiveness and stability of the proposed LENN algorithm on imbalanced data, LENN, ENN-2, and three commonly used clustering algorithms, namely, K-means, fuzzy C-means (FCM), and DBSCAN were experimented on three artificial datasets commonly used for clustering testing, which were Flame, Jain and Aggregation. These three datasets are all in two dimensions with different degrees of imbalance, which are summarized in Table 2. From Figure 7 of the real distributions of the datasets, it can be seen that Flame consists of a circle and a semiring, Jain contains two semirings, and Aggregation is composed of many rounded or crescent clusters with two clusters connected, which increase the difficulty of clustering.

(a)

(b)

(c)

Adopt Rand Index to evaluate the clustering results of the algorithms here, which is defined aswhere a denotes the number of data pairs whose clustering results and real labels are in the same category; b represents the number of data pairs whose clustering results and real labels fall in the different categories; h denotes the number of data pairs whose clustering results are of the same category while real labels are of different categories; and represents the number of data pairs whose clustering results turn to be of different categories while real labels turn to be of the same category.

In the experimental process of LENN, the optimal value range of was narrowed in each round of the experiment based on to obtain the optimal , and the optimal selection processes of LENN on three datasets are shown in Figure 8. As can be seen from the figure, RI reaches a peak at the inflection point of the EDe drop-down curve, and the corresponding value of is just the desired , and for ENN-2, the optimal was determined in the same way based on (0, 1]. The parameter K of K-means was set according to the real number of categories of each experimental dataset, and the parameter setting of FCM was the same as above. In the training process of DBSCAN, the optimal combination of the radius parameter and the field density threshold MinPts was searched for several times with the initial range of set as (0, 2] and the initial range of MinPts set as [2, 10]. In order to eliminate the influence of the sample input order on the experimental results, each experiment was conducted for ten times by disrupting the sample input order randomly to obtain RI score of the five algorithms, which are depicted in boxplots in Figure 9 and summarized in Table 3. Figure 10 presents the clustering performances of LENN graphically on three datasets.

(a)

(b)

(c)

(a)

(b)

(c)

(a)

(b)

(c)

In general, LENN achieved better performances in higher accuracy and stability on the three different datasets. Comparing Figure 9 and Table 3, it can be observed that, in terms of clustering accuracies, LENN and DBSCAN were not affected by the shape of data distribution, showing higher RI scores overall; while ENN-2, K-means, and FCM were highly affected by the shape of data distribution, all of them performed worse on semiorbicular clusters than rounded clusters, among which ENN-2 scored lowest on Flame and FCM scored lowest on Jain; in terms of clustering stability, which was visible in Figure 9, LENN showed extremely stable clustering performances on different input orders of samples, and there were small fluctuations in clustering stability of DBSCAN, K-means, and FCM, while ENN-2 showed the worst stability with the largest range of RI reaching 0.2436 on Flame. In particular, LENN scored highest on both Flame and Jain with nearly no impact of imbalanced data distribution on clustering, while scored slightly lower than that of DBSCAN on Aggregation. That was because, for Flame and Jain in Figure 10, all misclassified points of LENN, which were considered as noise, were individuals far away from their surrounding points; while for Aggregation, two clusters were closely connected distinctly by several data points, resulting in the algorithm which classified the two connected clusters as one cluster because of LENN’s iterative distinguish mechanism; in spite of this, LENN could still fully identify the other minority clusters in Aggregation. As for ENN-2, only a small number of cases showed higher clustering accuracies on Aggregation, indicating that ENN-2 is better at processing rounded clusters, but still relies heavily on an appropriate sample input order. It could be concluded that the proposed LENN algorithm could deal with the clustering problem on imbalanced data in terms of higher accuracy and stability, addressing the limitations of dependency on input order of samples.

4.2. Bearing Fault Diagnosis Process of Proposed Model

The main purpose of this work was to establish an effective bearing fault diagnosis model on imbalance data with noise, so in this part, experiments were carried out based on bearing fault data from Case Western Reserve University [35, 36] to test the performance of the proposed VMD-based denoising and LENN model by comparing with the ENN-2-based model.

4.2.1. Experimental Data

The test rig for data acquisition is shown in Figure 11, which consists of a motor driving a shaft, a force meter, a torque transducer, and an electrical control device. In this part, we selected the data of a 6205-2RS deep-groove ball bearing from SKF Company, which were grouped into five categories, including normal, minor inner race fault (with the fault size of 0.1778 mm), serious inner race fault (with the fault size of 0.5334 mm), minor ball fault (with the fault size of 0.1778 mm), and serious ball fault (with the fault size of 0.5334 mm). After dividing the raw signals into segments of 2048 data points, five datasets above comprised the whole data of this experiment with the imbalance degree of 2 : 1:1 : 1:1, which are listed in Table 4.

4.2.2. Signal Denoising and Feature Extraction and Selection

Firstly, VMD was carried out on the segmented fault samples. Here, set = 2000, = 1.5, and the initial distribution of center frequency was uniform. Considering improper selection of the number of decomposition K will lead to excessive or insufficient decomposition, therefore, K was determined according to the change of the center frequency of each mode in this paper. Taking VMD results of minor inner race fault (MIF) for example, as shown in Table 5, there were similar center frequencies appearing when K = 5, which may be attributed to mode mixing and excessive decomposition. Thus, K was set as four. Similarly, the number of decomposition K of other datasets was determined to be four, and the VMD results of a sample of five conditions are shown in Figure 12.

(a)

(b)

(c)

(d)

(e)

Then, the correlation coefficients and thresholds corresponding respectively to IMFs and the original signal were calculated according to equations (19)∼(20). The obtained results of all samples are graphically presented in Figure 13. Retain the corresponding IMFs whose correlation coefficient is above the red line and get the reconstructed signals.

Next, after signal denoising, extract the 23-dimensional features of each sample from both time and frequency domain according to Table 1, and PCA was used for feature selection and dimension reduction. By comparing the dimensionality reduction results in two and three dimensions in Figure 14, it is visible that, in two dimensions, the cluster of normal is far away from others, while the other four clusters are pretty closer; moreover, the clusters of the same parts with different severities are very close to each other, with connected and overlapped points appearing in the clusters of minor and serious inner race fault, which is not conducive to fault diagnosis. In three dimensions, all the clusters could be well separated, and for the clusters of the same parts with different severities, there seem to be no overlaps among the clusters. Therefore, the feature matrix of three dimensions was selected and finally input into the proposed LENN and ENN-2 algorithms.

(a)

(b)

4.2.3. Fault Diagnosis Results and Analysis

At the end, the obtained matrix was input into LENN and ENN-2 using RI in (24) for comparison. Similarly, for the sake of eliminating the influence of sample input order on experimental results, each diagnosis experiment was conducted for 10 times by randomly shuffling the input order of samples. Two of the diagnosis results of ENN-2 and LENN-based models are depicted in Figure 15, with the detailed results summarized in Table 6.

(a)

(b)

It is particularly evident from the results that overall, there was a marked increase in the performance of LENN-based model than that of ENN-2-based model in terms of clustering accuracy and stability. As can be seen from Figure 15, both of the two models performed well on the data of MIF, SIF, MBF, and SBF because of the compact data distribution and good differentiation, with only three SIF points misclassified into MIF in ENN-2-based model. However, for the cluster in normal condition, its distribution was relatively loose, resulting in ENN-2-based model which could not identify the whole cluster correctly and generated multiple clusters and noise points in the results, while LENN-based model only marked very few points at the edge of the cluster as noise which were far from their near points, and from Table 6, it can be observed that ENN-2-based model needed an average iteration of two epochs to converge, while LENN-based model converged in only one epoch, and a significant improvement of RI score was obtained in LENN-based model (0.9754) than ENN-2-based model (0.5835). In addition, the clustering results of ENN-2-based model changed greatly with different sample input orders, while the performances of LENN-based model were very stable. All the results strongly confirm the proposed model preserves higher clustering accuracy and more stable performances.

4.3. Impact of Imbalance Degree of Datasets on Diagnostic Models

As outlined in the introduction, the problem of imbalanced data fault diagnosis in real industrial production increases the difficulty of clustering fault diagnosis. Thus, the impact of different imbalance degrees of datasets on diagnostic models was investigated experimentally. The bearing fault data used in Section 4.2 was still adopted in this experiment, and based on the signal denoising and feature extraction and selection method proposed in this paper, four diagnostic models commonly used in clustering diagnosis were constructed and compared on datasets in different imbalance degrees selected randomly by certain proportions (shown in Table 7), which were models on LENN, K-means, FCM, and DBSCAN. The specific parameter settings of the models were in line with the settings in Section 4.1. To evaluate the performances and measure the ability of the models to deal with the clustering problem on imbalanced data, RI, macro-recall, and macro-F score were adopted in this experiment, and by conducting each experiment randomly for 10 times, we were able to get the average scores of each model.

Macro-recall measures the clustering performance of each class, especially the minority classes, which can be computed bywhere and represent the number of correctly and incorrectly predicted samples of the ith class, respectively.

Macro-F score is a comprehensive evaluation of the precision and recall of clustering results, which is defined aswhere denotes the relative importance of macro-R and macro-P, which is usually set as one, and macro-P can be obtained bywhere represents the number of samples which are misclassified into the ith class but do not belong to that class actually.

Table 8 collects the scores of the models on four datasets in different imbalance degrees. Two extreme cases with data imbalance degrees of 2 : 1 : 1 : 1 : 1 and 10 : 1 : 1 : 1 : 1 are taken to draw confusion matrices of the clustering results, which are shown in Figure 16.

(a)

(b)

(c)

(d)

(e)

(f)

(g)

(h)

It is apparent that, with the increase of data imbalance degrees, the clustering scores of all models showed a downward trend to varying imbalance degrees on the whole, among which LENN-based model performed noticeably best in all cases, while the configurations of K-means and FCM-based models were far from optimal. Comparing Table 8 and Figure 16, it can be observed that, the proposed model achieved considerably higher scores than other three models on all the datasets. Even on dataset 4 of the most extreme imbalance degree of 10 : 1 : 1 : 1 : 1, LENN-based model also recognized four minority clusters precisely, with ten samples of minor inner race fault, nine samples of serious inner race fault, eight samples of minor ball fault, and nine samples of serious ball fault identified correctly, DBSCAN-based model identified relatively few samples of these minor clusters; while K-means-based model regarded the samples of the same position but different severities as one cluster, failing to further subdivide the severities of samples, and FCM-based model directly identified all the four minority clusters as the same cluster, which scored lowest among the models. In addition, in the training process of LENN-based model on datasets with different imbalance degrees, the value of optimal grew gradually with the increase of data imbalance degree (shown in Figure 17). This was because, as the samples became more and more sparse, the distances between the samples increased, which required a larger to construct an extension correlation relationship between the samples, and this also indicated that the value of optimal was related to the final clustering results. In other words, the smaller of , the more precise the constructed extension relationship between samples would be, and the higher the accuracy of the proposed model could be obtained.

In conclusion, the imbalance degree of datasets increases the difficulty of fault diagnosis, especially for clustering algorithms relying on the selection of initial center points, and the appearances of minority clusters make it difficult for these algorithms to identify the fault categories correctly by distance calculation. At the same time, surprising outcomes of the experiments manifest that, by expressing the information of minority clusters more precisely through the constructed extension correlation function, the proposed LENN-based model shows good efficiency in identifying the minority clusters on imbalanced data.

5. Conclusions

(1)A novel clustering algorithm called linked extension neural network (LENN) is developed based on extension neural network-type 2 (ENN-2), which is far less sensitive to initial point selection and sample input order by improved correlation function and new iterative method. Furthermore, to evaluate the clustering performance, extension density is proposed as an evaluation target for this algorithm.(2)With the intention of improving the bearing fault diagnosis ability on imbalanced data with noise, a clustering fault diagnosis model of VMD-based denoising and LENN is constructed. The experimental results provide compelling evidence that the proposed model preserves powerful identification ability of minority fault clusters and achieves better diagnosis performance on imbalanced data with noise.

Data Availability

The labeled dataset used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest

The authors declare no conflicts of interest.

Acknowledgments

This research was supported by the National Natural Science Foundation of China (Nos. 51775272 and 51005114).

References

Y. Lei, B. Yang, Z. J. Du, and N. Lv, “Deep transfer diagnosis method for machinery in big data era,” Journal of Mechanical Engineering, vol. 55, no. 7, pp. 1–8, 2019.
View at: Publisher Site | Google Scholar
J. B. Hou, Y. X. Wu, H. Gong, A. S. Ahmad, and L. Liu, “A novel intelligent method for bearing fault diagnosis based on EEMD permutation entropy and GG clustering,” Applied Sciences, vol. 10, no. 1, 2020.
View at: Publisher Site | Google Scholar
L. K. Chang, S. H. Wang, and M. C. Tsai, “Demagnetization fault diagnosis of a PMSM using auto-encoder and K-means clustering,” Energies, vol. 13, no. 17, pp. 1–12, 2020.
View at: Publisher Site | Google Scholar
X. Li, X. Li, and H. Ma, “Deep representation clustering-based fault diagnosis method with unsupervised data applied to rotating machinery,” Mechanical Systems and Signal Processing, vol. 143, 2020.
View at: Publisher Site | Google Scholar
M. M. Islam, G. Lee, and S. N. Hettiwatte, “A nearest neighbour clustering approach for incipient fault diagnosis of power transformers,” Electrical Engineering, vol. 99, no. 3, pp. 1–11, 2017.
View at: Publisher Site | Google Scholar
H. Li, W. Wang, P. Huang, and Q. Li, “Fault diagnosis of rolling bearing using symmetrized dot pattern and density-based clustering,” Measurement, vol. 152, 2019.
View at: Google Scholar
J. Y. Chen and Y. H. Chen, “Condition monitoring for wind turbines based on inner-DBSCAN and power curve pattern,” Electric Power Science and Engineering, vol. 33, no. 8, pp. 27–34, 2017.
View at: Google Scholar
F. F. Yin and Y. Gong, “DBSCAN and SVM for fault diagnosis of wind turbine based on SCADA data,” International Core Journal of Engineering, vol. 6, no. 6, 2020.
View at: Google Scholar
J. Ye, J. Zhu, Q. Lu, T. S. Li, S. Q. Chang, and Q. G. Wang, “A fault detection method of photovoltaic power station based on improved DBSCAN clustering algorithm,” Journal of Guangxi University(Natural Science Edition), vol. 44, no. 2, pp. 440–447, 2019.
View at: Google Scholar
Z. B. Zhan, S. Zhang, W. Jiang, and P. Wu, “Detection method for bolts with mission pins on transmission lines based on DBSCAN-FPN,” Electric power, vol. 54, no. 3, p. 10, 2021.
View at: Google Scholar
D. Li, Z. Zhang, P. Liu, and Z. Wang, “DBSCAN-based thermal runaway diagnosis of battery systems for electric vehicles,” Energies, vol. 12, no. 15, p. 2977, 2019.
View at: Publisher Site | Google Scholar
Z. Wei, Y. Wang, S. He, and J. Bao, “A novel intelligent method for bearing fault diagnosis based on affinity propagation clustering and adaptive feature selection,” Knowledge-Based Systems, vol. 116, pp. 1–12, 2017.
View at: Publisher Site | Google Scholar
Z. G. Zhang, Q. Y. Chen, and J. Ma, “Fault diagnosis of shearer gear based on wavelet packet and EM clustering,” Coal Mine Machinery, vol. 41, no. 9, pp. 183–186, 2020.
View at: Google Scholar
N. Lu, G. T. Zhang, and F. X. Liu, “Vibrant fault diagnosis method for hydroelectric generating unit via ltsa and spectral clustering,” Engineering Journal of Wuhan University, vol. 54, no. 296, pp. 1064–1069, 2021.
View at: Google Scholar
M. Zhu, A. Q. Xu, R. F. Li, and J. L. Dai, “Diagnosis method for avionics based on membership and LMK-ELM,” Acta Aeronautica et Astronautica Sinica, vol. 40, no. 12, pp. 202–214, 2019.
View at: Google Scholar
Z. P. Gu, X. B. Liu, and Z. D. Han, “Aero engine fault diagnosis based on improved density peak clustering,” Computer Integrated Manufacturing Systems, vol. 26, no. 5, pp. 1211–1217, 2020.
View at: Google Scholar
H.-C. Chen, F.-C. Gu, and M.-H. Wang, “A novel extension neural network based partial discharge pattern recognition method for high-voltage power apparatus,” Expert Systems with Applications, vol. 39, no. 3, pp. 3423–3431, 2012.
View at: Publisher Site | Google Scholar
T. Z. Wen, A. Q. Xu, and G. Cheng, “Multi-fault diagnosis method based on improved ENN2 clustering algorithm,” Control and Decision, vol. 30, no. 6, pp. 1021–1026, 2015.
View at: Google Scholar
M. H. Wang, M. L. Huang, and K. J. Liou, “Islanding detection method for grid connected photovoltaic systems,” IET Renewable Power Generation, vol. 9, no. 6, pp. 700–709, 2015.
View at: Publisher Site | Google Scholar
A. Komaty, A. O. Boudraa, B. Augier, and D. Dare-Emivat, “EMD-based filtering using similarity measure between probability density functions of IMFs,” IEEE Transactions on Instrumentation and Measurement, vol. 63, no. 1, pp. 27–34, 2013.
View at: Google Scholar
Y. C. Jia, G. L. Li, X. Dong, and K. He, “A novel denoising method for vibration signal of hob spindle based on EEMD and grey theory,” Measurement, vol. 169, 2021.
View at: Publisher Site | Google Scholar
M. Yang, S. H. Chen, H. Wu, and J. B. Yu, “An improved LMD-based denoising algorithm for fault diagnosis of rotating machinery,” Noise and Vibration Control, vol. 35, no. 2, pp. 160–164, 2015.
View at: Google Scholar
K. Dragomiretskiy and D. Zosso, “Variational mode decomposition,” IEEE Transactions on Signal Processing, vol. 62, no. 3, pp. 531–544, 2014.
View at: Publisher Site | Google Scholar
X. Y. Luo, W. H. Lu, Y. P. You, and X. N. Hu, “A method for ball mill vibration signal random noise suppression based on VMD and SVD,” Noise and Vibration Control, vol. 39, no. 6, pp. 169–175, 2019.
View at: Google Scholar
F. Li, R. Li, L. Tian, L. Chen, and J. Liu, “Data-driven time-frequency analysis method based on variational mode decomposition and its application to gear fault diagnosis in variable working conditions,” Mechanical Systems and Signal Processing, vol. 116, pp. 462–479, 2019.
View at: Publisher Site | Google Scholar
Z. Guo, X. B. Li, T. Y. Yu, and X. Y. Fang, “Vibration signal denoising method of blast furnace opening machine based on improved VMD,” Machine Design and Research, vol. 36, no. 5, pp. 174–179, 2020.
View at: Google Scholar
Z. Q. Ma, X. Y. Liu, and J. J. Zhang, “Application of VMD-ICA combined method in fault diagnosis of rolling bearings,” Journal of Vibration and Shock, vol. 36, no. 13, pp. 201–207, 2017.
View at: Google Scholar
F. Xu, J. H. Chang, and B. G. Liu, “De-noising method research for lidar echo signal based on variational mode decomposition,” Laser & Infrared, vol. 48, no. 11, pp. 1443–1448, 2018.
View at: Google Scholar
J. Li, Y. Chen, and Z. H. Qian, “Research on VMD based adaptive denoising method applied to water supply pipeline leakage location,” Measurement, vol. 151, 2020.
View at: Publisher Site | Google Scholar
Y. Wang, Z. Wei, and J. Yang, “Feature trend extraction and adaptive density peaks search for intelligent fault diagnosis of machines,” IEEE Transactions on Industrial Informatics, vol. 15, no. 1, pp. 105–115, 2019.
View at: Publisher Site | Google Scholar
M.-H. Wang, “Extension neural network-type 2 and its applications,” IEEE Transactions on Neural Networks, vol. 16, no. 6, pp. 1352–1361, 2005.
View at: Publisher Site | Google Scholar
L. J. Zhu, B. X. Ma, and X. Q. Zhao, “Clustering validity analysis based on silhouette coefficient,” Journal of Computer Applications, vol. 30, no. 2, pp. 139–141, 2010.
View at: Publisher Site | Google Scholar
A. Ayenu-Prah and N. Attoh-Okine, “A criterion for selecting relevant intrinsic mode functions in Empirical Mode Decomposition,” Advances in Adaptive Data Analysis, vol. 2, no. 1, pp. 1–24, 2010.
View at: Publisher Site | Google Scholar
Y. Lei, Z. He, Y. Zi, and Q. Hu, “Fault diagnosis of rotating machinery based on multiple ANFIS combination with GAs,” Mechanical Systems and Signal Processing, vol. 21, no. 5, pp. 2280–2294, 2007.
View at: Publisher Site | Google Scholar
http://csegroups.case.edu/bearingdatacenter/pages/download-data-file.
W. A. Smith and R. B. Randall, “Rolling element bearing diagnostics using the Case Western Reserve University data: a benchmark study,” Mechanical Systems and Signal Processing, vol. 64-65, pp. 100–131, 2015.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2022 Tichun Wang and Jiayun Wang. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies