Sum Capacity Loss Quantification With Optimal and Sub-Optimal Precoding in Heterogeneous Multiuser Channels
Abstract
We analytically approximate the expected sum capacity loss between the optimal downlink precoding technique of dirty paper coding (DPC), and the sub-optimal technique of zero-forcing precoding, for multiuser channels. We also consider the most general case of multi-stream transmission to multiple users, where we evaluate the expected sum capacity loss between DPC and block diagonalization precoding. Unlike previously, assuming heterogeneous Ricean fading, we utilize the well known affine approximation to predict the expected sum capacity difference between both precoder types (optimal and sub-optimal) over a wide range of system and propagation parameters. Furthermore, for single-stream transmission, we consider the problem of weighted sum capacity maximization, where a similar quantification of the sum capacity difference between the two precoder types is presented. In doing so, we disclose that power allocation to different users proportional to their individual weights asymptotically maximizes the weighted sum capacity. Numerical simulations are presented to demonstrate the tightness of the developed expressions relative to their simulated counterparts.
I Introduction
Since the inception of massive multiple-input multiple-output (MIMO) systems, the downlink multiuser broadcast channel has, yet again, been under intense research limelight [1]. It is now well understood that dirty paper coding (DPC) – an optimal precoding technique pioneered by Costa in [2], achieves the capacity region of the multiuser broadcast channel [1]. Nonetheless, practical implementation of DPC requires substantial complexity for ordered decoding and interference cancellation with precise channel state information at both the cellular base station (BS) and user terminals [1]. This has paved the way for reduced complexity, yet sub-optimal, linear precoding techniques such as zero-forcing (ZF) and block diagonalization (BD) for multiuser transmission with single and/or multiple streams. Due to their sub-optimal nature, linear precoding techniques incur an absolute expected (average) sum capacity penalty (a.k.a. expected sum capacity offset) relative to DPC, reducing the achievable performance [3]. With massive MIMO systems, linear precoding can achieve up to 98% of DPC performance if the number of BS antennas exceeds at least 10 the total number of user antennas [1].
Despite the many research advances on multiuser broadcast channels (see e.g., [4, 5, 6] and references therein), understanding and quantifying the fundamental difference in the expected sum capacity with optimal and sub-optimal precoding techniques remains a sparsely investigated area. The focus of the paper is to close this research gap. The authors of [6, 7] present some preliminary results on this topic for point-to-point and multiuser MIMO systems for simple uncorrelated Rayleigh fading channels. Nevertheless, such analysis do not capture, to the full extent, the heterogeneity present in multiuser channels due to wide ranging propagation conditions. In reality, some users may experience the presence of dominant line-of-sight (LOS) components, while others may be experience heavy non-LOS (NLOS) conditions. In contrast to [6, 7], we consider the general case of a heterogeneous Ricean fading channel, where each terminal has a unique Ricean -factor and LOS component steering angle. For single-stream transmission, we analyze the expected sum capacity loss between DPC and ZF, and for multi-stream transmission, we consider BD precoding expected sum capacity performance relative to DPC over a wide range of operating signal-to-noise ratios (SNRs), BS/user antenna numbers, and Ricean -factors. Our analysis leverages the affine approximation to sum capacity developed in [8], which states that . Here, denotes the multiplexing gain (additional bits/sec/Hz for every 3 dB increase in SNR), denotes the sum capacity offset and represents an order one term. Though this approximation is exact at asymptotically high SNRs (see [6, 7]), it is seen to provide tight results over a wide range of SNRs. When applying this approximation to the DPC and ZF sum capacity, the same terms are obtained, with different terms allowing us to characterize the difference in sum capacity between optimal and sub-optimal precoding. By averaging the per-channel realization sum capacity offset over the myriad of Ricean fading, we are able to derive simple, yet accurate, expressions for the expected sum capacity difference as a function of system and propagation parameters. While the studies in [9, 10] have analyzed the ratio between sum capacity obtained with non-linear and linear precoding for Rayleigh fading multiuser channels, we study the absolute difference between these to quantify the sum capacity loss.
In addition the expected sum capacity loss quantification, we also investigate the weighted sum capacity maximization problem using DPC and ZF for single-stream transmission providing simple expressions for the capacity offsets. We show that the weighted sum capacity is maximized at asymptotically high SNRs by allocating power in direct proportion to the user weights. This result generalizes the well understood property that equal power allocation (e.g., across users and fading states) asymptotically maximizes the sum capacity of heterogeneous multiuser channels.
Notation. Upper and lower boldface letters represent matrices and vectors. The identity matrix is denoted as , while the zero matrix is denoted by . The -th entry of the matrix X is denoted by , while the transpose, Hermitian transpose, inverse and trace operators are denoted by , , and , respectively. Moreover, and denote the Euclidian vector norm and determinant operator of a matrix. We use to denote a complex Gaussian distribution for with mean and covariance matrix . Finally, we write to denote the statistical expectation, and to denote the maximum value of the function , where is a scalar value.
II System Model
We consider a downlink of an user MIMO broadcast channel, in which the BS has a uniform linear array (ULA) of electronically steerable antenna elements. For maximizing generality, each user terminal is equipped with antennas, where . The received signal observed at the antennas of the -th user terminal can then be written as
(1) |
where denotes the average transmit power from the BS and denotes the downlink propagation channel matrix to terminal from the BS encapsulating the effects of small-scale fading (discussed later in the text). Additionally, is the transmitted signal vector from the BS antennas having the total average power constraint , and is the additive white Gaussian noise with unit variance per-component, such that . Without loss of generality, we assume the same noise covariance matrix for each user. To this end, we define the operating SNR as the ratio of the average transmit power to the per-user noise variance, i.e., . To facilitate the analysis of the expected sum capacity loss between DPC and ZF precoding, as well as BD precoding, we assume that the BS has knowledge of all propagation channel matrices, and each user terminal has knowledge of its individual propagation channel matrix. At first glance, this assumption may come across as rather idealistic. However, such an assumption is necessary to make analytical progress, and the results derived here can be regarded as a useful upper bound in performance relative to what is obtainable with estimated channels. We denote the composite channel by , which can be further decomposed as , where is the -th row vector of . The small-scale fading matrix for user , , follows a Ricean distribution, which can be expressed as [11]
(2) |
Here, is the deterministic component modelling the presence of LOS or dominant components in the propagation channel, with its -th entry governed by
(3) |
We note that represents the inter-element spacing between successive antenna elements of the ULA, denotes the carrier wavelength and is the angle-of-departure (AOD) from the -th antenna element at the BS. Moreover, denotes the Ricean -factor of terminal governing the ratio of LOS to NLOS power [11]. The NLOS, i.e., purely stochastic component of the channel for user is modelled via the matrix, , the entries of which are independent and identically distributed Gaussian random variables with zero-mean and unit variance. Thus, . To maximize clarity, exact parameterization of above quantities is given in Sec. V, where further details are presented. In what follows, we present the methodology for the expected sum capacity loss quantification between DPC and ZF, as well as BD precoding.
III Expected Sum Capacity Loss Quantification Methodology
III-A Dirty Paper Coding Sum Capacity Analysis
The DPC sum capacity hits the multiuser broadcast channel capacity region, which can be expressed from the landmark results of [12] on the broadcast to multiple access channel duality. This allows us to express the DPC sum capacity as
(4) |
where is the covariance matrix of the dual multiple access channel. It is well known that no closed-form solution to (4) exists, yet it has been shown in [12] that converges in the absolute sense to the capacity of a point-to-point MIMO propagation channel with propagation matrix , when . As [5],
(5) |
One can discover a corollary of this result if the covariance matrices are designed such that , leading to an asymptotically optimal solution to (4). As such, an affine approximation (stated in the Sec. I) can be applied, such that the DPC sum capacity can be approximated as
(6) |
While this result becomes exact in the limit of high SNRs, we note that the high SNR sum capacity primarily depends on the product of the number of user terminals (), and the number of receive antennas per-user (). The effects of other parameters such as the number of BS antennas (), the Ricean -factors and LOS steering angles are captured in the term.
III-B Linear/Sub-Optimal Precoding Sum Capacity Analysis
We now evaluate the affine approximation to the linear precoding sum capacity using ZF and BD processing, and quantify the sum capacity offset relative to DPC. With linear precoding, the transmitted signal vector, , can be written as
(7) |
Here, is the vector of data symbols intended for user terminal , and is the precoding matrix for user . The received signal at user can then be written as
(8) |
where the first term denotes the desired signal power, while the second and third terms denote the multiuser interference (including multi-stream interference) and additive white Gaussian noise. In the case of BD precoding (multi-stream transmission), multiuser interference is nulled by designing the individual user precoding matrices such that , . On the otherhand, for single-stream transmission, ZF precoders can be designed such that , and . Here, denotes the -th column vector of . Keeping this in mind, the received signal at the -th antenna of the -th user terminal is given by
(9) |
As such, ZF precoding converts the system into parallel channels with an equivalent channel entry .111We exercise a slight abuse of notation here and denote as the additive white Gaussian noise to the observation received at the -th receive antenna of the -th user terminal. We caution the reader to be mindful of this. To maximize sum capacity, optimal power allocation across the channels should take place. Doing this would yield
(10) |
where . Since uniform power allocation coefficients converge to optimal power allocation at asymptotically high SNRs [3], applying the affine approximation,
(11) |
where . The expression in (11) has the same form of that derived for DPC sum capacity in (6), with the exception of the second term on the right-hand side (RHS) of (11), which is specific to ZF processing. As such, we define the asymptotic sum capacity loss as the difference between the DPC and ZF capacity. This can be expressed as
(12) |
While the above metric denotes the sum capacity loss per-realization of , we can also determine the expected capacity loss across the myriad of small-scale fading. That is,
(13) |
where . In general, it is extremely difficult (if not intractable) to exactly analyze the expected value of (12), due to the heterogeneity present in the composite multiuser channel. To this end, we employ the well characterized (see e.g., [13, 14] and references therein) first-order Laplace approximation, which takes the form as shown in (13). The accuracy of such an approximation relies on the denominator of (13) having a small second moment relative to its first moment. This can be seen via application of a multivariate Taylor series expansion of (13) around its first moment value. The approximation in (13) has shown to give tight results when and start to grow (the case for massive MIMO), since the implicit averaging in the denominator of (13) gives rise to the required variance reduction [13, 14]. The result in (13) can equivalently be written as
(14) |
Analyzing the second term on the RHS of (14), we can observe that follows an uncorrelated non-central Wishart distribution denoted by [15]. Here by definition, we note that is the mean matrix of with capturing each user’s LOS channel matrix. Additionally, is an diagonal matrix containing -factors for all users, and is the covariance matrix of the row vectors of . Leveraging the results in [16] on the expected log-determinants of non-central Wishart matrices, the second term of the RHS of (14) is given by
(15) |
where is the -th eigenvalue of . Note that is defined in (16) on the top of the following page for reasons of space, where denotes the exponential integral function and denotes the factorial operation [17].
(16) |
In contrast to this, the first term of the RHS of (14) is obtained by approximating the structure of by the often used (see e.g., [11, 14]) uncorrelated central Wishart distribution with a shift in the covariance matrix (following the methodology in [14])222Detailed investigation into the accuracy of the quoted approximation from non-central to central Wishart matrices can be found in [14]. to
(17) |
Considering the above, one can recognize that is a chi-squared random variable with degrees-of-freedom. Applying the standard probability density of the chi-squared random variable together with some straightforward algebraic manipulations, we can express the first term of the RHS of (14) as follows; where
(18) |
Adding the result in (18) with (15) yields the expected sum capacity loss between DPC and ZF precoding as stated in (14). We note that this is a rather simple result for an extremely general and complex scenario of multiuser channels having user specific heterogeneity and parameters. Due to aforementioned mathematical difficulties, analysis of this type has been missing from the literature. In Sec. V, we evaluate the accuracy of the derived expected sum capacity loss by comparing it to its simulated counterpart for a wide range of system and propagation parameters.
Similar to ZF precoding, with BD precoding, parallel channels are formed with equivalent channel matrices , . To this end, the BD sum capacity over all users can be written as [3, 9]
(19) |
and the sum capacity can be approximated under the same constraints as for ZF processing via the affine approximation as
(20) |
Note that in (20) is as defined after (11). Similar to (12), the asymptotic loss from the instantaneous DPC sum capacity relative to that achieved by BD precoding can be expressed as
(21) |
Similar to the ZF case, the expected loss across the ensemble of small-scale fading can then be evaluated by analyzing the statistical expectation term, . Following a similar methodology to the ZF analysis, one can derive approximation to . Due to space reasons, we omit its detailed analysis here and note that the full derivation will feature in the upcoming journal version of the paper. In Sec. V, the sum capacity performance with BD precoding relative to ZF and DPC is assessed for multi-stream transmission scenarios.
In the section which follows, for single-stream, single receive antenna per-user scenarios, we analyze the maximization of the sum capacity with power allocation to each user.
IV Weighted Sum Capacity Maximization
In this section, we generalize the earlier discussed sum capacity to weighted sum capacity maximization for the case when each user has a single antenna, i.e., . As such, the downlink propagation channel to user is a row vector, denoted by . We first show that allocating power in proportion to the user weights is asymptotically optimal, and use this result to compute the associated sum capacity offsets. Without loss of generality, we assume that user weights, denoted by , are in descending order, i.e., with . The maximum weighted sum capacity problem for DPC, defined as the maximum of over the capacity region, which can be written as in (22) on top of the following page for reasons of space. Note that here denotes the -th user’s individual capacity.
(22) |
In (22), . The result which follows, shows that if we limit ourselves to linear power allocation policies, then the maximization problem of (22) can be decoupled at higher SNRs. Following the arguments in [3, 9], with , for any , with condition , we can write
(23) |
where is the projection of on to the matrix null space of . That is, instead of solving (22) directly, the following optimization setup will yield an asymptotically identical solution. That is,
(24) |
The Karush–Kuhn–Tucker conditions (see e.g., [3, 7]) to the problem presented in (24) yields the solution
(25) |
for . Therefore, at high SNRs, we have
(26) |
Since the order one term leads to a vanishes with SNR, allocating power according to , maximizes (25). Meanwhile, the weighted sum capacity with ZF processing is given by [7]
(27) |
where is the projection of onto the matrix null space of . Rather interestingly, the optimization problem quoted in (27) is identical as that quoted in (25), with the exception that is replaced by which does not contribute to the asymptotic solution. This only affects the term in (26) and thus the power allocation policy of is also the asymptotic solution to (27).
Using the asymptotically optimal power allocation, the weighted sum capacity of DPC can be expressed as
(28) |
while the weighted sum capacity for ZF can be written as
(29) |
Note that (28) and (29) utilize the classical affine approximation. Thus, the instantaneous sum capacity loss per-channel realization is given by
(30) |
As such, the expected capacity loss can be computed by evaluating . In the following section, for a given channel realization, we demonstrate the negligible difference between the true weighted sum capacity and the weighted sum capacity achievable using the derived power allocation solution in Sec. IV, i.e., .
V Numerical Results
We consider the setting where the BS is located at the origin of a circular cell having a radius 100 m. The users are uniformly distributed within the cell with respect to its area. We assume operation at 3.7 GHz, where 8.1 cm and employ inter-element antenna spacing at the BS array. We assume uniformly distributed LOS steering angles to each user from the BS, denoted earlier as , within the interval across the azimuthal plane. Unless otherwise stated, we assume the following parameters: The BS is equipped with a ULA of 64 elements, serving 8 users for single-antenna ( 1), single-stream transmission. For multi-stream transmission, we consider service to 4 users, each having 2 receive antennas, such that the total number of receive antennas across all terminals remains consistent with the single-stream case for comparison purposes. For single-stream transmission, ZF precoding and DPC performance is evaluated, while for multi-stream, BD precoding and DPC performance is evaluated.
Figure 1 depicts the expected sum capacity performance as a function of operating SNRs. The top sub-figure shows the DPC performance relative to BD and ZF, for thr baseline case of Rayleigh fading channels. As such, , . Several important trends can be noted: (1) We can observe that both ZF and BD suffer from an expected capacity loss relative to DPC across all SNRs. This is due to a penalty in the desired signal power incurred in orthogonalizing interfering channels. (2) At both high and low SNRs, the achieved capacities converge for both optimal (DPC) and sub-optimal (BD and ZF) precoding, where their performance is comparable to DPC. This is since at high SNRs, the desired power penalty is less pronounced (in magnitude) due to the scaling of the ZF/BD beamforming vectors/matrices by high operating SNRs. In contrast, at low SNRs, noise power dominates performance, and thus all techniques yield almost equal performance. (3) BD performance is marginally better than ZF due to multi-stream transmission, as also observed by [7]. In contrast to the top sub-figure, the middle and bottom sub-figures depict the expected sum capacity performance with fixed 1 dB and 20 dB . These serve as test cases denoting low and high LOS powers. The performance obtained with low LOS powers is similar to the baseline case of Rayleigh fading. However, the expected sum capacity performance is significantly lower at higher Ricean -factors across all SNRs. This is due to the ill-conditioning of the matrix inverse for both ZF and BD, respectively. As shown in [1], with strong LOS presence, the condition number of the inverted matrix (ratio of the largest to smallest singular values of the composite channel covariance matrix) is larger (on the order of 20 dB on average via simulations) relative to the case with strong NLOS conditions. This implies that strong LOS increases the spread of singular values relative to strong NLOS, inducing higher correlation levels and thereby reducing performance. Moreover, with high -factors, the relative gap between DPC and ZF, BD performance at higher SNRs tends to increase, in comparison to the Rayleigh fading.
In the general case, when each user has a specific -factor, we consider the model adopted in [11]. Here, , i.e., the -factors are drawn from a lognormal distribution with mean of 9 dB and variance of 5 dB. Figure 2 depicts the expected sum capacity performance as a function of operating SNRs for the case where each user has a specific -factor. The top sub-figure shows DPC, BD and ZF performance with , while the bottom sub-figure shows the equivalent performance with , where a proportional reduction in the expected sum capacities is observed, as expected. For the case, one can observe that the expected sum capacities yield values in between those for low and high -factor cases in Figure 1. This is since on average, -factor values close to 9 dB are drawn (between 1 dB and 20 dB), yet the lognormal nature of -factor density occasionally yields larger values, skewing the result.
Figure 3 demonstrates the expected sum capacity loss between DPC and ZF, as well as BD precoding when each user has . One can observe that the derived approximations of the expected capacity loss in (12)-(18) and (19)-(21) for both ZF and BD precoding tightly match the simulated expected sum capacity loss. This confirms the generality of our analysis, as promised earlier in the paper.
Figure 4 demonstrates the weighted sum capacity difference, referred to as the “sum capacity error” on the -axis of the figure, between the solution in (22) and the asymptotic solution of . Since single-stream transmission is required, the result is shown for , and with fixed and . We fix 0.6 and 0.4 for three instantaneous channel realizations to both users. We can observe that the sum capacity error is negligible across the entire SNR range considered. This is interesting, since even though the derived expressions rely on high SNRs, the analysis methodology seems to be applicable over a much wider range of SNRs, demonstrating its generality.
VI Conclusions
We approximate the difference between the expected sum capacity achieved by optimal and sub-optimal precoding techniques of DPC, ZF and BD. Our analysis methodology utilizes the affine approximation and computes the asymptotic capacity loss for multiuser broadcast channels. Unlike previously, our analysis caters for the more general propagation conditions captured by Ricean fading and considers maximum channel heterogeneity across multiple users by considering user specific parameters. It is shown that linear precoding techniques incur a moderately high expected sum capacity loss penalty relative to DPC, yet this penalty is much smaller at high SNRs and in pure NLOS conditions. We generalized our analysis to problem of weighted sum capacity maximization. We show that allocating power proportional to user weights is asymptotically optimal at high SNR.
References
- [1] F. Rusek, et al., “Scaling up MIMO: Opportunities and challenges with very large arrays,” IEEE Signal Process. Mag., vol. 30, no. 1, pp. 40-60, Jan. 2013.
- [2] M. Costa, “Writing on dirty paper,” IEEE Trans. Inf. Theory, vol. 23, no, 9, pp. 439-441, May 1983.
- [3] N. Jindal, “High SNR analysis of MIMO broadcast channels,” in Proc. IEEE ISIT, Sep. 2005, pp. 2310-2314.
- [4] J. Nam, et al., “On the role of transmit correlation diversity in multiuser MIMO systems,” IEEE Trans. Inf. Theory, vol. 63, no. 1, pp. 336-354, Jan. 2017.
- [5] G. Caire and S. Shamai, “On the achievable throughput of a multiantenna Gaussian broadcast channel,” IEEE Trans. Inf. Theory, vol. 49, no. 7, pp. 1691-1706, Jun. 2003.
- [6] A. Lozano, et al., “High-SNR power offset in multiantenna communication,” IEEE Trans. Inf. Theory, vol. 51, no. 12, pp. 4134-4151, Nov. 2011.
- [7] J. Lee and N. Jindal, “Dirty paper coding vs. linear precoding for MIMO broadcast channels,” in Proc. IEEE ASILOMAR, Oct. 2006, pp. 779-783.
- [8] S. Shamai and S. Verdu, “The impact of frequency-flat fading on the spectral efficiency of CDMA,” IEEE Trans Inf. Theory, vol. 47, no. 5, pp. 1302-1327, May 2001.
- [9] N. Jindal and A. J. Goldmsmith, “Dirty paper coding versus TDMA for MIMO broadcast channels,” IEEE Trans on Inf. Theory, vol. 51, no. 5, pp. 1783-1794, May 2005.
- [10] Z. Shen, et al., “Sum capacity of multiuser MIMO broadcast channels with block diagonalization,” in Proc. IEEE ISIT, Jul. 2006, pp. 886-890.
- [11] H. Tataria, et al., “Performance and analysis of downlink multiuser MIMO systems with regularized zero-forcing precoding in Ricean fading channels,” in Proc. IEEE ICC, May 2016.
- [12] S. Vishwanath, et al., “Duality, achievable rates and, and sum-rate capacity of Gaussian MIMO broadcast channels,” IEEE Trans Inf. Theory, vol. 49, no. 10, pp. 2658-2668, Oct. 2003.
- [13] H. Tataria, et al., “On the general analysis of coordinated regularized zero-forcing precoding: An application to two-tier small-cell networks,” IEEE Trans. Commun., vol. 65, no. 7, pp. 3133-3150, Apr. 2017.
- [14] Q. Zhang, et al., “Power scaling of uplink massive MIMO systems with arbitrary-rank channel means,” IEEE J. Sel. Topics Signal Process., vol. 8, no. 5, pp. 966-981, Oct. 2014.
- [15] A. M. Tulino and S. Verdu, “Random matrix theory and wireless communications,” Foundations and Trends in Commun. and Inf. Theory, vol. 1, no. 1, pp. 1–182, Jun. 2004.
- [16] Y.-H. Kim and A. Lapidoth, “On the log determinant of non-central Wishart matrices,” in Proc. IEEE ISIT, Jun. 2003, pp. 54.
- [17] I. S. Gradshteyn and I. M. Ryzhik, Table of Integrals, Series, and Products, Academic Press, 2007.