Abstract
The paper investigates DOA estimation of coherent Signals with the limited aperture sparse array. Mutual coupling between the sensors of the array cannot be ignored in practical radar with a limited aperture of array sensors, which will result in a degradation in the performance of Direction of Arrival (DOA) estimation. This paper proposes a Mutual-coupling-optimized array (MCOA) with a limited aperture in this scenario to reduce the mutual coupling effect. Firstly, we prove the sparse uniform linear array (SULA) has the smallest mutual coupling leakage when the array aperture and the number of sensors is determined. Secondly, we modify the spacing of the array sensors in SULA to make sure that the spacing between all array sensors and the reference sensor are coprime aiming to estimate DOA without spatial aliasing. Thirdly, we give an expression for the array element spacing arrangement with reduced mutual coupling leakage. Finally, the coherent signals are well resolved by the Sparse Bayesian Learning (SBL) algorithm. Numerous simulations are conducted to validate the advantages of the proposed array compared to several sparse arrays for estimating coherent signals in the presence of mutual coupling.
1. Introduction
The problem of Direction of Arrival (DOA) estimation has attracted a lot of attention in the fields of radar, sonar, navigation, and astronomy [1–7], where the antenna arrays are utilized for collecting the spatial sampling of incident signals. Scholars propose many DOA estimation algorithms based on the uniform linear array (ULA), such as multiple signal classification (MUSIC) [5], estimation of signal parameters via rotational invariance techniques (ESPRIT) [6], propagator method (PM) [8], and parallel factor (PARAFAC) technique [9].
However, the above-given algorithm is predicated on the assumption that the incident signals are uncorrelated. The received signals are typically coherent and the rank of the covariance matrix is insufficient due to the impact of the transmission environment in actual applications. The aforementioned DOA estimation algorithm will be invalid at this time [10]. To tackle this problem, some decoherence algorithms are proposed to deal with coherent signals. The most representative method is the spatial smoothing (SS) method [11], which regards ULA as many subarrays with the same array flow type and then averages the covariance matrix of each subarray to obtain the full rank covariance matrix. Later, people proposed the Forward/backward spatial smoothing techniques [12], improved spatial smoothing techniques [13] on this basis of SS and make a series of improvement on these algorithms [14]. In [15], the authors were devoted to establishing more accurate conditions by studying the positive definiteness of smoothed target covariance matrix. There are also algorithms that reconstruct the covariance matrix of the received signal, such as SVD algorithms and the Toeplitz decoherence method [16]. These methods estimate coherent signals at the expense of array aperture, which reduces DOA estimation performance. The compressed sensing (CS) algorithms [17–19] can estimate DOA by exploiting the sparsity of the target in the spatial domain without taking into account the coherence of the signals. In [20], an iterative adaptive approach (IAA) is given for the beamforming design based on the sparsity. In [21], the Orthogonal Matching Pursuit (OMP) is used to recover the spare signal with high probability, but the accuracy of OMP is lower than that of MUSIC. In [22], both the Sparse Bayesian Learning (SBL) and the relevance vector machine (RVM) are proposed. The weakness of CS algorithms is that they are more complex than the previously described DOA estimating techniques. The traditional DOA estimation algorithms are generally considered based on ULA, but sparse linear arrays are seldom utilized.
Recently, sparse arrays such as Nested arrays (NA) [23] and coprime arrays (CA) [24] have attracted wide attention because such sparse arrays can achieve degrees of freedoms (DOFs) with only antenna sensors. Though the DOA estimation performance of NA is better than that of CA, the mutual coupling leakage of NA is much greater than that of CA due to the influence of the dense ULA subarray, which reduces performance in the presence of mutual coupling. Despite the array positions of CA and NA can be expressed in closed-form, their continuous degrees of freedom are not the greatest. In comparison to CA and NA, the minimum redundant array (MRA) [25] has the most continuous degrees of freedom, allowing it to use more virtual arrays. However, MRA lacks a closed-form expression for the locations of its sensors, and its array design requires a significant amount of complicated calculations.
The aperture of the array is usually limited in most applications, and the number of array elements is fixed. Because the spacing between the array elements is relatively close, the mutual coupling effect cannot be ignored. ULA and traditional sparse arrays will fail to estimate the DOA of coherent signals and the research of DOA estimation in this situation is relatively few. Though there are some methods [26–28] proposed to mitigate the mutual coupling effects by utilizing a complex mutual coupling model, these methods estimate mutual coupling coefficients at the cost of increased complexity and decreased degree of freedom (DOFs). Therefore, it is a good choice to consider how to reduce the mutual coupling effect when designing the array. Under the restrictions of a set array aperture and a number of array sensors, this paper determines the array design approach with the least mutual coupling leakage, and we further propose a Mutual-coupling-Optimized Array (MCOA) based on the theory of estimating DOA without spatial aliasing [29, 30]. To estimate the DOA of coherent signals, we use the sparse Bayesian learning-based (SBL) compressed sensing algorithm. In particular, we summarize our main contributions as follows:(1)We propose a mutual-coupling-optimized array under the restriction of a fixed number of sensors and fixed array aperture. Then, we prove that the mutual coupling leakage of the suggested array is smaller than that of conventional sparse arrays and that it can estimate DOA without spatial aliasing.(2)We employ the SBL algorithm to estimate coherent DOA for the proposed array and compare the SBL algorithm with other algorithms to demonstrate that the estimation performance of the SBL algorithm is better than other algorithms including OMP and IAA.
The remainder of this paper is given as follows: we provide the mathematical model of the sparse array and the definition of mutual coupling matrix in Section 2. In Section 3, we present how to design the mutual coupling optimized array with a limited aperture. Section 4 introduces the specific steps of the sparse Bayesian learning algorithm. Section 5 analyses the CRB of the array in this context. Section 6 verifies the theoretical performance of the proposed array through simulation analysis while Section 7 concludes this paper.
Notations: scalars, vectors, matrices, and sets are denoted by lowercase letters , lowercase letters in boldface , uppercase letters in boldface , and letters in blackboard boldface , respectively. , , and are the transpose, complex conjugate, and complex conjugate transpose of . denotes the trace operator for a matrix. represents the Frobenius norm and represents the matrix formed by the diagonal elements of the matrix. denotes the entry of . denotes the greatest common divisor of the elements.
2. Mathematical Model
Consider a sparse array consisting of sensors as shown in Figure 1, and the position of the sensor is denoted by with , represents the distance of the - th sensor relative to the reference sensor and stands for the wavelength. Suppose that there are far-field narrowband coherent signals from different directions with powers impinge on this sparse array. The received signal of the array can be expressed as follows [2]:where represents the direction matrix and denotes the direction vector of the signal. is the wavelength of the signal. means the narrowband coherent signals with snapshots, where is the generate signals and stands for the complex constant. represents the additive white Gaussian noise vector with noise variance .

There is coupling between the array elements. The received signal model is expressed as follows [28]:where is the mutual coupling matrix. The mutual coupling matrix can be modelled as a B-banded symmetric Toeplitz matrix according to the assumption in the following equation [28]:where , , , . is the mutual coupling constant and denotes the maximum spacing of sensor pairs with mutual coupling. In addition, the mutual coupling is evaluated by the coupling leakage, i.e.,
3. Mutual-Coupling-Optimized Array with Limited Aperture
In this section, we first show that the mutual coupling leakage of the sparse and uniform linear array is the smallest under the condition of finite aperture and number of elements. Then, we discussed how to change the position of the array elements, so that the mutual coupling leakage is still small, and there is no spatial aliasing in DOA estimation.
3.1. A Minimum Mutual Coupling Leakage Array
Considering the - element array with an array aperture of , we propose an array which has no spatial aliasing in DOA estimation and has the smaller mutual coupling leakage than most sparse arrays.
Lemma 1. For an element array with an array aperture of , the mutual coupling leakage is minimized if and only if the array elements are equally spaced.
Proof. According to equation (3), the mutual coupling matrix can be expressed as follows:Then, the expression of the coupling leakage can be calculated as follows:wherewhere . The value of corresponding to the minimum value of is the position of each array sensor when the mutual coupling leakage is minimum.
Denote the array spacings as respectively. Then,Calculate the minimum value of by Lagrange multiplier method.Take the partial derivative of each variable in the function and set the result equal to zero.There is an extreme point in (10) when and the cost function has a minimum value at this time. Therefore, the value of corresponding to the minimum value of is the position of each array element in the array when the mutual coupling leakage is minimum. From the above-given discussion, it can be seen that the elements array with an aperture of the array reach the minimum mutual coupling leakage when (5) holds. The array designed in (5) is a sparse uniform line array (SULA) when .
However, SULA will cause spatial aliasing during DOA estimation [29] because the spacing of the adjacent sensors are larger than half-wavelength. Next, we discuss how to fine-tune the position of SULA's array elements to solve the angular ambiguity problem and maintain the advantage of low mutual coupling leakage.
3.2. B Mutual-Coupling-Optimized Array (MCOA)
Suppose that the first sensor is located at the origin without loss of generality, then the position of the array can be expressed as follows:
In order to facilitate the subsequent discussion, needs to be adjusted to integer by choosing an appropriate .
Theorem 1. (see [29]). The array manifold is invertible if and only if the sensor locations (assumed integers) are coprime.According to heorem 1, we design the array structure as follows:where represent the spacing of adjacent sensors in array and are integers.
In fact, the different arrangement order of elements in will also cause the structural change of , which leads to different mutual coupling leakage. Due to the large number of repetitions of elements in , there will be many repeated combinations of corresponding . Obviously, when the larger distance between adjacent sensors in the center of the array, the mutual coupling between the middle sensors and the sensors on both sides can be effectively reduced so that the mutual coupling leakage of the whole array degrades significantly. This is the reason why we make as (14). The relationship between and is , then the expression of the array position can be written as follows:We will prove that the position in (15) satisfies Theorem 1 in the following part.
Proof. When , thenwhere represents the remainder of dividing by .
When , then.In summary , that is, the designed array structure satisfies Theorem 1. Suppose that an antenna array with array aperture and the number of sensors needs to be designed. According to (15), since N is not divisible by , we can calculate that with and write the expression of and .Figure 2 shows the example of the above MCOA. The array structure is very similar to that of the SULA. There are five spacing between the sensors are and the remaining two are . We place the in the middle of the array to make the mutual coupling between the middle sensors and sensor on both sides decreasing, which effectively reduces the coupling leakage of the whole array. The array locations also satisfy Theorem 1.

4. Sparse Bayesian-Based Compressed Sensing Method
In the sparse signal representation framework [23, 24], the direction matrix in (2) should be replaced by a transfer matrix , thus the signal model in (2) can be rewritten as follows:where represent the complex signal amplitudes containing DOAs and snapshots. The transfer matrix consists of all hypothetical DOAs. The likelihood function of the received signal can be represented as follows:
The SBL algorithm treats as a zero mean complex Gaussian random vector with unknown diagonal covariance . The prior model is given by the following equation:
For Gaussian prior and likelihood, the evidence is Gaussian and represented as follows:where and stands for the identity matrix of order . The SBL algorithm is to estimate the diagonal entries of by maximizing the evidencethe derivative of (24) is
The factor is introduced to obtain an iterative equation in . Equate the derivatives to zero and we can get the fixed-point update rule [1, 2, 4].where is the sample covariance matrix.
The main steps of the SBL algorithm are summarized as follows: Step 1: Set the parameters as and get the input data ; Step 2: Initialization the parameters ; Step 3: Calculate ; Step 4: Update by using equation (27); Step 5: Set ; Step 6: If and , go back to step 3; Step 7: The K largest peaks in are the required DOA values.
5. Performance Analysis
5.1. Comparison of Mutual Coupling Leakage between Different Arrays with the Same Aperture
We select some sparse arrays for comparison. In order to make the array aperture of all arrays consistent, we compress the element spacing of CA and ECA. The result is shown in Table 1, it can be seen that the mutual coupling leakage of the proposed array is the smallest except SULA, and its mutual coupling leakage is very close to SULA.
5.2. Crarmer–Rao Bound (CRB)
According to the knowledge of the literature [32], the Crarmer–Rao Bound (CRB) matrix can be represented as follows:where stands for the operation of taking the real part, represents the manifold matrix of the array, is the orthogonal projection of , and stands for the identity matrix of order , , denotes the average power of signal source, can be written as follows:where denotes steering vector.
5.3. Computational Complexity
In this section, we provide the complexity of the SBL method compared with OMP and MUSIC. Assuming that the number of array elements is , there are grid points and snapshots, the maximum number of iterations is , then the computational complexity of main operations are as follows: (a) calculate the covariance matrix: ; (b) update the in Step 3: ; (C) update in Step 4: . The computational complexity of SBL is .
6. Simulation Results
In this part, we provide numerical simulations of the performance of the proposed MCOA as well as a comparison with the other sparse arrays and the CRB. The array aperture is limited to 8 wavelengths and the number of array sensors is 8. Two coherent signals with equal power impinge on the array with directions , , and the correlation coefficient is set to . Define the Root Mean Square Error (RMSE) of the DOA estimates as follows:where and are the number of Monte Carlo trials and the total number of coherent signals, respectively. means the estimate of the real angle . Unless other stated, we assume that the mutual coupling constant is and the maximum spacing of sensor pairs is . For each Figure, 1000 Monte Carlo simulations were run to estimate the Root Mean Square Error (RMSE).
First, we compare the CRB of different arrays in Figure 3. The result shows that the CRB of the coprime array is very close to the CRB of the proposed array, but the CRB of the proposed array is the smallest among all arrays, which indicates that its performance is optimal.

Figure 4 depicts the spatial spectrum of the SBL method with the proposed array. The signal-to-noise ratio (SNR) is 10 dB and the snapshot is . There are many spectral peaks in the estimation result, but the peak of the incident signal is the highest, which is 40 dB higher than other spectral peaks. It shows that the estimation result of this method is accurate enough to be used for the coherent signal estimation when there is mutual coupling between array sensors.

The proposed array is also compared with other arrays with different SNRs in Figure 5. The SNR varies from −5 dB to 20 dB and the number of snapshots is . All five kinds of arrays can accurately estimate the incident angle of the relevant signals. Due to the influence of mutual coupling, the angle estimation of the CA and ULA decreases greatly, and their RMSE value is larger than the proposed array. Because the influence of mutual coupling leakage is less than that of other arrays, the proposed array can better estimate the DOA of coherent signals.

Figure 6 shows the performance of different arrays with snapshots changing, the coherent signal is consistent with the previous simulation and the SNR is 5 dB. The snapshot varies from 10 to 600. When the snapshot is less than 100, all five arrays cannot work well and the performance is not good enough. However, the RMSE of all the arrays reduces with the snapshot increasing. When the snapshot is larger than 100, the curve of RMSE of the CA and ULA is almost a straight line, because the impact of the mutual coupling leakage at this time is greater than the performance improvement brought about by the increase of snapshots. On the other hand, the performance of the proposed array and NA is better than the other three arrays, and the proposed array has the best performance because the mutual coupling leakage of the proposed array is the smallest among these arrays.

Finally, we compared the SBL algorithm with two other compressed sensing algorithms including the IAA [20] and the OMP [21]. In Figure 7, the SNR changes from −5 dB to 20 dB and the snapshot is 200. The other simulation conditions were the same as before. At low SNR, the SBL has the same performance as IAA and OMP, but when the SNR increases, the performance of OMP hardly improves, and the performance of IAA is better than OMP. The curve of SBL is smoother than the other two algorithms, which means that in this case, its performance is more stable than other algorithms.

7. Conclusions
In this paper, the mutual coupling optimization array with a given number of sensors under the condition of the finite aperture is studied. Compared with the sparse arrays including CA, NA, and ECA, the mutual coupling leakage of the proposed array is smaller. When there is mutual coupling between array sensors, we apply the SBL to DOA estimation of coherent signals and compare its performance with other compressed sensing methods including IAA and OMP. Finally, various simulations are carried out to prove the superior performance of the proposed array for estimating coherent signals in the condition of mutual coupling. In fact, this paper mainly focuses on the coherent signal estimation problem of the sparse array in the 1D-DOA case. By using the previous related research, this result can be extended to an L-shaped array to realize DOA estimation of coherent signal in the 2D-DOA case. Reference [31].
Data Availability
The data used to support the findings of this study are included within the article.
Conflicts of Interest
The authors declare that they have no conflicts of interest.
Acknowledgments
This work was supported by China NSF (Grant nos. 61971217, 61971218, and 61631020), Jiangsu NSF (Grant no. BK20200444), the fund of Sonar Technology Key Laboratory (Research on the theory and algorithm of signal processing for two-dimensional underwater acoustics coprime array) and the fund of Sonar technology key laboratory (Range estimation and location technology of passive target via multiple array combination), Jiangsu Key Research and Developement Project (Grant no. BE2020101), and National Key Research and Development Project (Grant no. 2020YFB1807602).