Channel Modeling and Rate Analysis of Optical Inter-Satellite Link (OISL)
Abstract
Optical inter-satellite links (OISLs) improve connectivity between satellites in space. They offer advantages such as high-throughput data transfer and reduced size, weight, and power requirements compared to traditional radio frequency transmission. However, the channel model and communication performance for long-distance inter-satellite laser transmission still require in-depth study. In this paper, we first develop a channel model for OISL communication within non-terrestrial networks (NTN) by accounting for pointing errors caused by satellite jitter and tracking noise. We derive the distributions of the channel state arising from these pointing errors and calculate their average value. Additionally, we determine the average achievable data rate for OISL communication in NTN and design a cooperative OISL system, highlighting a trade-off between concentrating beam energy and balancing misalignment. We calculate the minimum number of satellites required in cooperative OISLs to achieve a targeted data transmission size while adhering to latency constraints. This involves exploring the balance between the increased data rate of each link and the cumulative latency across all links. Finally, simulation results validate the effectiveness of the proposed analytical model and provide insights into the optimal number of satellites needed for cooperative OISLs and the optimal laser frequency to use.
Index Terms:
Optical inter-satellite link, non-terrestrial networks, inter-satellite communication, channel model.I Introduction
Non-terrestrial network (NTN), particularly those using low-Earth orbit (LEO) satellites, provide widespread wireless connectivity through radio frequency (RF) signal transmissions. It’s important to note that these satellites are expected to be interconnected to transfer data to designated ground stations for internet access. Typically, ground stations are located in fixed and constrained areas. Therefore, establishing inter-satellite links (ISLs) among satellites is crucial for various applications within NTNs.
Optical ISLs (OISLs) are developed using laser communications to achieve very high-throughput data transfer [1]. Unlike the congested wireless RF spectrum, which includes bands such as the S-band, Ka-band, and Ku-band, the infrared portion of the electromagnetic spectrum used in OISL—ranging from approximately 300 gigahertz (GHz) to around 430 terahertz (THz)—provides an exceptional bandwidth. This characteristic enhances the potential for encoding more data into the waveform. In comparison to RF links, OISL can gather more energy, allowing for a reduction in the size, weight, and power requirements of the laser transmitter and detector [2].
In contrast to laser communication between a satellite and a ground station, the propagation of the OISL signal is primarily influenced by pointing errors. These errors can significantly reduce the power of the received signal at the detector, underscoring the importance of addressing this issue. Pointing errors in OISL arise from the satellite’s jitter and tracking noise [3]. These sources of misalignment collectively contribute to the vibration of the pointing direction.
Prior Art: Several studies in the literature have explored the channel model for satellite optical communications. In [4] and [5], beam pointing errors were introduced and modeled using Gaussian distributions for both elevation and horizontal directions. The authors of [6] examined the effects of vibrations on the bit error rate in satellite optical communications. However, these works did not consider how the beam waist changes with propagation distance, reducing the detector’s received energy. Additionally, they assumed that photons radiate omnidirectionally in the channel model, overlooking the directional characteristics of lasers. In [7], the combined effects of air turbulence and jitter on outage probabilities in terrestrial free-space optical (FSO) links were investigated. Another study in [8] analyzed the impact of Hoyt-distributed pointing errors on the error performance of on-off keying optical signals. Nonetheless, these studies focused on terrestrial FSO links that accounted for atmospheric turbulence and pointing errors. The channel statistics can be revisited in more manageable forms in the context of OISL. Moreover, the existing literature should address the average achievable data rate for OISL using laser beams across various applications. Therefore, developing an analytical model for OISL is essential to fully characterize its overall communication performance in NTN.
Contributions: The main contributions of this paper are summarized as follows.
-
•
OISL Channel Model: We establish a channel model for OISL based on a Gaussian beam. The statistical characteristics of the OISL channel are derived by considering the effects of pointing errors and the detector’s sensitivity threshold. Additionally, we derive the simplified forms of the probability density function (PDF), the cumulative distribution function (CDF), and the average channel state for the OISL channel, using Rayleigh-distributed radial deviation. Furthermore, we determine the maximum radial deviation distance associated with a Gaussian beam.
-
•
Cooperative OISLs Design: We designed a cooperative OISL communication system where satellites forward data between source and destination satellites by using OISLs. With the developed OISL channel model, we can accurately derive the average achievable data rate of an OISL communication, facilitating performance analysis of a cooperative OISL communication system. Moreover, we introduce optimizing the number of OISL relaying satellites and laser frequency to guarantee a latency constraint and a targeted data transmission size.
-
•
OISLs Design Insights: Regarding the average achievable data rate, adjusting the laser frequency or beam waist introduces a trade-off between concentrating beam energy and balancing misalignment. A reduced beam waist could potentially increase the detector’s received power intensity. However, reducing the beam waist causes the detector to deviate from the beam center and decrease the received power intensity. Furthermore, changing the number of satellites in a cooperative OISL communication system results in a trade-off between the increased data rate of each OISL link and the sum of latency over all cooperative links.
The remainder of this paper is organized as follows. Section II provides a system model. Section III introduces the channel statistics of the OISL. Section IV demonstrates the achievable data rate and the total latency. Simulation results are given in Section V, and the paper is concluded in Section VI.

II System Model
In OISL, the received signal power at the detector suffers from a fluctuation in signal power, which is modeled by
(1) |
where denotes the channel state due to the expanded beam, path loss, and pointing errors, is the detector responsivity, is the power of the transmitted signal, and is signal-independent additive white Gaussian noise with variance . Specifically, depends on two factors [7] shown as follows
(2) |
where encompasses the deterministic path loss which approaches one in space, since the laser beam does not propagate omnidirectionally and space is in a vacuum state [9], and indicates the channel random attenuation caused by pointing errors. This model is suitable for any satellite or spacecraft with OISL devices. We assume that the laser beam can be tracked and pointed with misalignment [9], and the Doppler shift due to satellite movement can be well compensated.
In Fig.1, the beam waist at distance is given by
(3) |
where is the beam divergence angle [10], denotes the wavelength, and is the beam waist at m. Considering the long propagation distance and diffused beam, we approximate as follows
(4) |
In Fig. 1, denotes the radial vector from the beam center, i.e., pointing error, and we assume a large field of view at the receiver with no angular fluctuation [11]. The power intensity distribution of a Gaussian beam [7] at distance is
(5) |
Since the shapes of the transverse plane of the beam and detector are symmetrical, depends on the radial deviation distance of the pointing error, i.e., , which is given by
(6) | ||||
where is the area of the detector, is the radius of the detector, and we have .
The main notations are summarized in Table 1.
Notations | Description |
---|---|
Channel power gain in the OISL | |
Additive white Gaussian noise with variance | |
Channel random attenuation with pointing errors | |
Beam waist of the OISL at a distance | |
Beam divergence angle | |
The radial deviation distance from the beam center | |
Beam waist at the transmitter | |
Radius of the detector | |
The variance of pointing errors | |
Sensitivity threshold at the detector | |
Channel state average threshold at the detector | |
The maximum radial deviation distance | |
The average channel state caused by pointing error | |
Communication data size of OISL | |
Communication distance of OISL | |
The number of satellites in cooperation | |
Total latency threshold | |
Average data rate of the n-th OISL |
III OISL Channel Statistics
In this section, we derive the OISL channel statistical characteristics.
Proposition 1.
In OISL, we have . The channel state caused by the pointing error is given by
(7) |
where is the radial deviation distance of the pointing error.
Proof.
Since the inter-satellite distances range from a few hundred kilometers to tens of thousands of kilometers, the beam waist is much larger than the radius of the detector, i.e., . Then, we approximate that the intensity of received photon is equal across the detector, and we have , where is given in (5). ∎
Theorem 1.
The PDF of at distance is given by
(8) | ||||
where is the PDF of radial deviation distance , is the maximum collected power without pointing error.
Without loss of generality, we reasonably assume that the horizontal and vertical misalignment, stemming from the satellite’s jitter and tracking noise, follow independent and identical normal distributions [4, 5, 6, 7]. Since the sum of two independent normal variables is also normally distributed, we use a single normal distribution to represent the vertical or horizontal misalignment for notation simplicity.
Proposition 2.
The radial deviation distance follows a Rayleigh distribution and its PDF is given as follows
(12) |
where is the variance of pointing errors.
Proof.
Denote and as horizontal and vertical deviation distances, respectively. Thus, follows a Rayleigh distribution. ∎
Theorem 2.
Given the beam waist at distance , the variance of pointing errors , the detector radius , the PDF of is given by
(13) |
Proof.
In Theorem 2, we observe that the PDF of , i.e., , is a power function of . It’s worth noting that changes with the propagation distance .
Denote as the sensitivity power threshold for a detector to identify an optical signal and as the corresponding average sensitivity threshold of , which is given by
(14) |
Thus, the maximum radial deviation distance, i.e., , is calculated by , as follows
(15) |
In some cases, the average channel state is essential to evaluating the average channel condition of OISL, as given in the following Theorem.
Theorem 3.
Proof.
Based on Proposition 1, Proposition 2 and (15), is obtained as follows
(17) | ||||
where is the probability that the radial deviation distance is smaller than the maximum radial deviation distance , shown as follows
(18) |
is given in (13). By calculating (17), we obtain (16). The detailed derivation is omitted here to save space. ∎
It is worth noting that in Theorem 3, can be approximated by when is very small.
Theorem 4.
Given the beam waist at distance , the variance of pointing errors , the detector radius , the CDF of is given by
(19) |
Proof.
The CDF of is calculated by where is given in (13). ∎
IV Cooperative OISL System Design
In this section, we design a cooperative OISL communication system where relaying satellites are strategically positioned to balance the trade-off between the increased data rate of each link and the overall transmission latency. As illustrated in Fig. 2, the channel state of the single hop between the source and destination satellites can be unfavorable due to the broader beam width and significant pointing errors that arise from the long propagation distance. Introducing additional relaying satellites enhances the data rate of each hop; however, the increased number of transmissions through these relays may lead to an increase in total transmission latency. To address this, we aim to minimize the number of cooperating satellites, denoted as , while ensuring that the total latency remains below a specified threshold, . This is done with the given parameters of a data size and a communication distance between the source and destination satellites.
(20) | ||||
where is the average data rate of the n-th OISL.

Theorem 5.
Given bandwidth , transmit power , communication distance , the number of satellites , the average achievable data rate of the n-th OISL is given by
(21) |
where
(22) | ||||
and is the fraction of the collected power at beam center with propagation distance, , is the distance from satellite’s orbit to the center of the earth, , , is the hypergeometric function.
Proof.
As shown in Fig. 2, we have , , and . Denote the distance of each hop by , and we have
(23) | ||||
Therefore, according to (23), we have
(24) |
The average achievable data rate of the n-th OISL is
(25) | ||||
In addition, we have
(26) | ||||
Let us denote as the integral in the last step of (26) as follows
(27) |
Note that can be further derived as follows
(28) |
where
(29) |
and
(30) |
Specifically, is given in (31) at the top of the page.
(31) |
Considering based on [13]. Similarly, for , we have
(32) | ||||
We obtain the desired results with mathematical manipulations and complete the proof. ∎
In practice, the variance of pointing errors increases with the propagation distance due to the increased difficulty of tracking. Therefore, is a function of propagation distance. For example, we model and , , and km as the reference distance.
The optimal is obtained by solving the equation , where we consider equally spaced relay satellites.
V Simulations and Discussions
In this section, we conduct simulations to evaluate the OISLs’ communication performance. Unless specified otherwise, the default parameters are shown in Table I.
Description | Parameter | Value |
---|---|---|
Beam waist at transmitter | 0.1 m [5] | |
Radius of the detector | 0.1 m [5] | |
Laser frequency | 200 THz | |
Deterministic path loss | 0.9 | |
Detector responsivity | 0.5 [7] | |
Transmit power | 0.5 Watt | |
Bandwidth | 10 GHz | |
Variance of additive noise | ||
Satellite distance to center | 6900 km | |
Data size | 100 Gbits | |
Sensitivity threshold | Watt [7] |
In Fig. 3, we compare the average channel state caused by pointing errors, i.e., , as derived in Theorem 3, versus OISL laser frequency, i.e., , under various values of and different propagation distances . It is observed that gradually increases as the laser frequency increases. This is because a higher frequency allows the laser beam to concentrate more energy on the detector. However, when is large, the increase in does not significantly enhance . This limitation is due to the misalignment caused by pointing errors, which leads the detector to deviate from the concentrated beam. Additionally, we observe that decreases with the increment of and , which aligns with our expectations. Moreover, the results from Monte Carlo simulations validate the analytical findings.


In Fig. 4, we examine the average achievable data rate, i.e., , derived in Theorem 5 versus OISL laser frequency, i.e., , under various and propagation distance . We observe that there is an optimal laser frequency that maximizes . On the one hand, when is too small, the laser’s energy is diffused, and the power intensity received at the detector decreases. On the other hand, when is too large, the detector may deviate much from the beam center due to pointing errors. In turn, the amount of energy received at the detector also decreases. Therefore, there is a trade-off between concentrating the beam energy and balancing the misalignment.
In Fig. 5, the total latency of the cooperative OISLs system is presented concerning the number of cooperative satellites with/without frequency optimization. The optimal laser frequency solution is calculated by exhaustive searching. Optimizing the number of cooperative satellites and can significantly reduce the total latency. The reduction in total latency results from a trade-off involving balancing the increased data rate of each cooperative link with the sum of latency over all cooperative links.

VI Conclusions
In this paper, we developed an OISL channel model and derived its channel statistics. Based on the channel model, we introduced a cooperative OISL system in which the number of cooperative satellites involved and laser frequency can be optimized to minimize the total latency. Simulation results reveal the trade-offs in the design of the OISL system. Note that the proposed analytical model applies to both current and more complicated OISL systems. Future research can utilize the proposed model to assess the data rate and reliability of OISLs in more complex satellite mega-constellations, considering a pre-defined SINR threshold. This paper examines OISL channel modeling while accounting for pointing errors. Future investigations could explore additional factors impacting OISL, such as satellite orbit perturbations, beam tracking, and angular fluctuations.
References
- [1] G. Wang, F. Yang, J. Song, and Z. Han, “Free space optical communication for inter-satellite link: Architecture, potentials and trends,” IEEE Communications Magazine, vol. 62, no. 3, pp. 110–116, 2024.
- [2] A. U. Chaudhry and H. Yanikomeroglu, “Temporary laser inter-satellite links in free-space optical satellite networks,” IEEE Open Journal of the Communications Society, vol. 3, pp. 1413–1427, 2022.
- [3] H. Kaushal and G. Kaddoum, “Optical communication in space: Challenges and mitigation techniques,” IEEE Communications Surveys & Tutorials, vol. 19, no. 1, pp. 57–96, 2017.
- [4] J. Barry and G. Mecherle, “Beam pointing error as a significant design parameter for satellite-borne, free-space optical communication systems,” Optical Engineering, vol. 24, no. 6, pp. 1049–1054, 1985.
- [5] C.-C. Chen and C. Gardner, “Impact of random pointing and tracking errors on the design of coherent and incoherent optical intersatellite communication links,” IEEE Transactions on Communications, vol. 37, no. 3, pp. 252–260, 1989.
- [6] S. Arnon and N. S. Kopeika, “Laser satellite communication network-vibration effect and possible solutions,” Proceedings of the IEEE, vol. 85, no. 10, pp. 1646–1661, 1997.
- [7] A. A. Farid and S. Hranilovic, “Outage capacity optimization for free-space optical links with pointing errors,” Journal of Lightwave Technology, vol. 25, no. 7, pp. 1702–1710, 2007.
- [8] W. Gappmair, S. Hranilovic, and E. Leitgeb, “OOK performance for terrestrial fso links in turbulent atmosphere with pointing errors modeled by hoyt distributions,” IEEE Communications Letters, vol. 15, no. 8, pp. 875–877, 2011.
- [9] H. Hemmati, Deep space optical communications. John Wiley, 2006.
- [10] F. Pampaloni and J. Enderlein, “Gaussian, hermite-gaussian, and laguerre-gaussian beams: A primer,” arXiv preprint physics, 2004.
- [11] S. Huang and M. Safari, “Free-space optical communication impaired by angular fluctuations,” IEEE Transactions on Wireless Communications, vol. 16, no. 11, pp. 7475–7487, 2017.
- [12] J. L. Devore, “Probability and statistics,” Pacific Grove, 2000.
- [13] D. Zwillinger, Table of integrals, series, and products. Elsevier, 2014.