Full analytic expression of overlap reduction function for gravitational wave background with pulsar timing arrays
Abstract
Pulsar timing array (PTA) is expected to detect gravitational wave background (GWB) in the nanohertz band within the next decade. This provides an opportunity to test the gravity theory and cosmology. A typical data analysis method to detect GWB is cross-correlation analysis. The overlap reduction function (ORF) plays an important role in the correlation data analysis of GWB. The present approach to dealing with the intricate integration in ORF is to use short-wave approximation to drop out the tricky terms. In this paper, we provide the full analytic expression of the ORF for PTA without any approximation for all possible polarizations allowed by modifications of general relativity. Compared with the numerical simulation and short-wave approximation, our results are more efficient and widely applicable. Especially for the scalar-longitudinal mode where the short-wave approximation is not available, our analytical expression is particularly significant.
I Introduction
A lot of gravitational waves (GWs) induced by compact binary mergers 2016prl_GW150914 ; 2017prl_GW170817 ; 2021apjl_NSBH have been detected by LIGO and Virgo, which opens a new window for astronomical observations 2019prx_GWTC-1 ; 2021prx_GWTC-2 . The GWs can not only provide information about the compact binary, but also provide an opportunity to test the gravity theory and cosmology 2019prd_test_GR_GWTC-1 . These abundant GW signals imply that there are many weak GWs that the detector cannot discern. These weak GWs are indeed recorded by the detecter, but they are just masked by noise. The combined weak signal from the population of binary black holes is an example of gravitational wave background (GWB). In addition, there are many other sources that can generate GWB, such as cosmological phase transitions 1986mnras_GWB_cosmol_pt ; 2021prd_GWB_QCD_pt , primordial gravitational waves 1992pr_cosmol_perturbation ; 1997prd_GWB_inflation , cosmic strings 2005prd_GWB_cosmic_strings ; 2007prl_GWB_cosmic_strings , etc. The detection of the GWB can provide us with information on the astronomical distribution and the early evolution of the universe, which is of great significance.
At present, the ground-based laser interferometers cannot detect the GWB, and give an upper limits of dimensional energy density at Hz band 2021prd_upper_limits_GWB_LIGO_O3 . The future space-based interferometers such as LISA 2017arX_LISA and TianQin 2016cqg_TQ probe GWB at the mHz band. Pulsar timing arrays (PTA) probe GWB at much lower frequency of nHz and appears to be on the verge of detecting GWB now 2020apjl_GWB_NANOGrav ; 2021mnras_GWB_EPTA ; 2021apjl_GWB_PPTA ; 2022mnras_GWB_IPTA . The principle of the PTA is simple: the radio waves emitted by the rotating neutron star sweep through the earth at regular interval, so the time interval between the pulses arriving at the detectors on Earth is supposed to be constant. However, the GWs on the path cause the deviation from a regular pulse.
Cross-correlation is a typical method to detect the GWB. In a single detector, the GWB would be masked by noise, making it impossible to discern it from noise. However, the GWB signals in different detectors are correlated, and the noise is not, so the GWB signals can be extracted by correlating the outputs of two different detectors. To obtain the correlation signal, we need to calculate the correlation coefficient, which is the ORF. The ORF of PTA is the geometric factor of the correlation signal, which only depends on the relative orientation of the two pulsars and their distance to the Earth.
In general, one has to evaluate the integral in ORF numerically, due to the non-trivial exponential terms. With the short-wave approximation, the integral can be done analytically by dropping out the exponential terms. The results ORF for tensor mode is the Hellings and Downs curve 1983apj_HD_curve . The approximate ORF for vector mode and scalar-breathing mode can be found in a similar way 2008apj_Lee_ORF_nonGR . In the limit that the angle between two pulsars is close to 0, the short-wave expression of the ORF for the vector mode diverges, which means that the pulsar terms dropped out should be included to handle that case. Furthermore, for the scalar-longitudinal ORF, there is no analytic expression with the short-wave approximation except for some special cases 2012prd_ORF_nonGR ; 2015prd_PTA_GWB_nonGR . Because dropping out the exponential terms and integrating the remaining part will yield a divergent result. Recently, an analytic series expansion of ORF for all six polarizations was obtained without employing the short-wave approximation2021prd_ORF_PTA_series_GR ; 2022prd_ORF_PTA_series_nonGR . However, the series expansion is not satisfactory, because it is relatively complex and takes a long time to calculate. We find that the full analytic expressions of ORF for all six polarizations without employing the short-wave approximation can be obtained using a special integration method, which is used to calculate the response function of space-borne gravitational wave detectors 2019prd_analytic_response_function_TDI ; 2021prd_sensitivity_TDI ; 2021prd_sensitivity_TDI_nonGR .
The paper is organized as follows. In Sec.II, we briefly describe the correlations of PTA signal and outline the integration of the ORF. In Sec.III, we derive the analytic expansions for ORF for all polarizations and analyze their performance from different perspectives. Finally, in Sec. IV, we present a brief discussion.
II CORRELATIONS OF PTA SIGNALS
II.1 GWB statistic
The metric perturbations corresponding to GWB can be expressed as
(1) | ||||
where is the spin-2 polarization tensors. represent different polarization mode, where represent tensor mode predicted by general relativity, and represent vector mode and scalar allowed by the general metric theory of gravity. Explicitly,
(2) | ||||
where
(3) | ||||
For the isotropic, unpolarized and stationary GWB, the quadratic expected values satisfy that
(4) |
where can be regarded as the component corresponding to the polarization of one-sided gravitational-wave strain power spectral density function. For tensor mode and vector mode, it can be considered that , . However, the two scalar modes should be considered as two independent polarization modes. The strain power spectral density is simply related to the fractional energy density,
(5) |
The fractional energy density is defined as
(6) |
where is the critical energy density required for closed universe, and , are the Hubble constant and gravitational constant respectively.
II.2 Correlation signal
The metric perturbation is weak, so the single pulsar timing signal can be written as
(7) |
Here the response function for Doppler frequency measurements is 2017Review_detection_GWB
(8) |
where is the unit vector of the pulsar pointing to the earth, is the distance from the pulsar to the earth, and is the position vector of the earth. In the frequency domain, the signal is written in terms of polarized basis as
(9) |
where .
The cross-correlation of two pulsars signal and is
(10) |
where . The ORF for tensor mode, vector mode, scalar-breathing mode and scalar-longitudinal is
(11) | ||||
III Overlap reduction function

The ORF only depends on the relative orientation of the two pulsars and their distance to the Earth. Therefore, we can choose a suitable coordinate system to simplify the integral. We choose the Earth as the coordinate origin, so that . And the direction vectors of the two pulsars are , , where is the angle separation between two pulsars. For the convenience of calculation, we define that
(12) | ||||
where , .
III.1 Tensor mode
The ORF of the tensor mode is
(13) | ||||
where , , and are the distances from the two pulsars to the Earth, respectively. Change the integral variables by , so that the integral region is transformed from the unit sphere to the elliptical area on the plane. Then,
(14) | ||||
where and
is the boundary of the integration area. The integral can be done analytically (the details of the calculation are provided in Appendix), and the result is
(15) | ||||








where
and is the exponential integral function. is the normalized ORF, so that for a single pulsar. The normalization holds only for the short-wave approximation. Using the short-wave approximation , Eq. (15) will reduce to the HD function 1983apj_HD_curve ,
(16) |
In addition, it can also accurately converge to 1 when the two pulsars tend to coincide, because the exponential terms is included.
Since no approximations are used, the analytic expressions agree exactly with the values obtained by direct numerical integration. When the distances of two pulsars are the same (), the ORF is a real function. As shown in Fig. 2, our result is consistent with the HD curve as increase, and the curve approaches 1 smoothly when the two pulsars are very close. For the long-wave wavelengths, is a value less than 0.5, which depends on . However, the two pulsars are usually at different distances in reality, which implies that the ORF is a complex function and satisfies that . As shown in Fig. 3, for different distances of pulsars (), the imaginary part of the ORF depends on the ratio of and . The greater the difference between them, the greater the value of the imaginary part. But when both and are very large, the imaginary part is close to 0, no matter how large their ratio is. And the real part is tend to HD function in this case.
We show the behavior in Fig. LABEL:fig3 when the angle between the two pulsars is small. If , decays from 1 to 0.5 faster and faster as increases. From their similar curves, we can conclude that the ORF for two nearby pulsars depends on their distance from each other. For pulsars in the same direction ,
(17) | ||||
In addition, we noticed that when is not very large. Actually, the auto-correlated response for the tensor mode of a single detector is
(18) |
It dose converge to 1 for , but gradually decreases to 0 as decreases. The normalization expression is only valid for short-wave approximation.
III.2 Vector mode
The ORF of the vector mode isotropic is
(19) |
Changing the variables, then we get
(20) |
Finishing the integral, and we find that
(21) | ||||
The ORF for vector mode cannot be normalized, because increase with . The expression with using short-wave approximation is 2008apj_Lee_ORF_nonGR
(22) |
where the angular separation is assumed to be not small. In the limit , Eq. (21) will give the exact value while the short-wave expression diverges. The auto-correlated response for vector mode of a single detector is
(23) | ||||
where is the Euler constant and
is the cosine-integral function. In the limit , grows logarithmically with . It is consistent with Eq.(A42) in 2008apj_Lee_ORF_nonGR .
The behaviors of ORF for vector mode are shown in Fig. 2 and Fig. 3 in the case and respectively. For two pulsars at the same distance, the ORF for vector mode gradually approaches the short-wave expression as increases. From the short-wave expression (22), we know that diverges at . However, at , the full analytic expression tends to have finite values , which grows logarithmically with . For two pulsars at different distances, the ORF for vector mode is complex. The real part will also gradually approaches the short-wave expression for not too small of . However, when is very small, the imaginary part is not negligible compared to the real part even and are pretty large. The small angle behavior of vector mode is quite different from the tensor mode. As shown in Fig. LABEL:fig3, the ORF for vector mode converges to a finite value, which depends on and increases with logarithmically. There is also no fast halving decay, and the transition of the curve is smooth.
III.3 Scalar-breathing mode
The ORF of scalar-breathing mode is
(24) | ||||
The normalized analytic expression of ORF for scalar-breathing mode is
(25) | ||||
The short-wave expression is 2008apj_Lee_ORF_nonGR
(26) |
The auto-correlated response for the scalar-breathing mode of a single detector is the same as that of the tensor mode,
(27) |
But the actual responses satisfy that , because their normalization factors are different. Overall, the ORF for the scalar-breathing mode is very similar to that for the tensor mode, probably because they are both transverse modes. In particular, it should be noticed that for any configuration of pulsar pairs.
III.4 Scalar-longitudinal mode
The ORF of scalar-longitudinal mode is
(28) | ||||
The analytic expression of ORF for scalar-longitudinal mode is
(29) | ||||
Like the vector mode, the ORF of the scalar-longitudinal mode cannot be normalized. The auto-correlated response for the scalar-longitudinal mode of a single detector is
(30) | ||||
For short wavelengths, and it grows faster than the logarithmically growing vector mode as increases. This is consistent with Eq.(A36) in 2008apj_Lee_ORF_nonGR and Eq.(41) in 2012prd_ORF_nonGR .
For the scalar-longitudinal mode, there is no analytic expression of ORF even using the short-wave approximation. Dropping the exponential terms and directly calculating integral leads to divergence 2017Review_detection_GWB . The exponential terms must be included to overcome the divergence. However, we can obtain a short-wave expression from Eq. (29),
(31) | ||||
As shown in Fig. 2, the approximate expression works well except that is close to and . When the distance difference between the two pulsars is large, the accuracy of the approximate expression becomes worse. The ORF for scalar-longitudinal mode of pulsars at different distances is shown in Fig. 3. When is small, the imaginary part is comparable to the real part for large and . And the short-wave expression (31) underperforms in this case. In addition, we notice that also seems to increase with at . In fact, it can be shown that this is indeed the case and it grows logarithmically. increases linearity with at and logarithmically at . So what is the behavior between 0 and ? increases with except at , where it tends to be a constant. Explicitly,
(32) |
The small angle behavior is shown in Fig. LABEL:fig3. As decreases, it tends to a constant, which is consistent with Eq. (30). There is also no fast halving decay, which implies that the exponential terms accounts a non-negligible proportion of the integral.
IV Discuss and conclusions








Employing the method in 2019prd_analytic_response_function_TDI ; 2021prd_sensitivity_TDI ; 2021prd_sensitivity_TDI_nonGR , we obtained the full analytic expression of the ORF for PTA without any approximation for all possible polarizations allowed by the general metric theory of gravity. Since no approximation is used, for any two pulsars, the ORF can be obtained quickly and accurately by the expression. For example, plots of the ORF of a pair of pulsars for different modes are shown in Fig. 5, plotted as functions of frequency . We choose to fix the distance between the two pulsars and the Earth and , and draw different curves at different angular. In the current detection band of PTA of Hz, the ORF for tensor mode and scalar-breathing mode can be regarded as a constant that only depends on the angular separation between pairs of pulsars. However, the ORF for vector mode at small is likely to vary with frequency. And for the scalar-longitudinal mode, the ORF grows logarithmically with frequency if .
The tensor mode and scalar-breathing mode show similar behavior, since they are both transverse modes. And they are quite different from the longitudinal mode (vector and scalar-longitudinal). For co-directional pulsars (), the ORF of transverse modes is finite, no matter how large is. However, the ORF of longitudinal modes grows with . The vector mode grows logarithmically with , and the scalar-longitudinal mode grows linearly. In addition, the phases of the two kinds of modes are also different. In the actual detection, the distances from the two pulsars to Earth are usually not the same, and the ORF is complex in this case. As long as is large enough, the imaginary part of the ORF for transverse modes can always be ignored. For longitudinal modes, this can only be done around .
For most cases, the short-wave expressions 1983apj_HD_curve ; 2008apj_Lee_ORF_nonGR are valid and succinct, and our result will reduce to them with short-wave approximation. For the scalar-longitudinal mode, there is no short-wave expression except for the co-aligned pulsars . But our results hold for scalar-longitudinal modes at any angle separation. The auto-correlated response functions, which are inferred from our results, also agree with the prior literature 2008apj_Lee_ORF_nonGR ; 2012prd_ORF_nonGR for the co-aligned pulsars. Compared with the recent series expansions 2021prd_ORF_PTA_series_GR ; 2022prd_ORF_PTA_series_nonGR , the numerically calculated values of our expressions are consistent, and our computation time will be much less. The only thing to worry about is that one can’t bring that value directly into the calculation for , as that could lead to uncertainty. In this case, the expressions under the limit are needed, that is, the auto-correlated response functions.
Totally, for current PTA detection, our results improve slightly for transverse modes. The short-wave approximation is very precise and concise for most of the pulsars. Our results only improve for nearly co-located pulsars, such as pulsar binary systems, and pulsars close to Earth that may be discovered in the future. However, our results are very meaningful for other modes in modified gravity theory, especially the scalar-longitudinal mode. For vector mode, the short-wave approximation is not valid for small angular separation between pulsars. And the situation is even worse for scalar-longitudinal mode, where the shortwave approximation is not valid for any angle separation. Our results greatly improve this situation and provide help for future detection of the polarized GWB. The full analytic expression of ORF is very useful in GWB data analysis of PTA.
Acknowledgments
This work is supported by the National Natural Science Foundation of China (Grant Nos. 11925503 and 12175076 ) and Guangdong Major project of Basic and Applied Basic Research (Grant No. 2019B030302001).
*
Appendix A Detailed calculations for the integration of ORF
Through the variable transformation from to , the primitive function of the integral of the ORF can be found. For example, for the integral in the ORF for scalar-breathing mode,
(33) | ||||
where
are used to obtain the second and third line respectively. For the exponential terms, the method is also valid,
(34) | ||||
If the exponential term contains , just change the integral order,
(35) | ||||
where . The same result can be easily obtained by changing in (34) to , because the integration region is symmetric for and . To calculate the integral that includes both and in the exponential term, we change the variables to and , where . And the integration region becomes . It rotates the plane by an angle such that , where . With the new variables, the integration is
(36) | ||||
where
and , which can be obtained by solving . The rest are similar to the previous process. can be expressed in the form . In this way the integral for can be decomposed into three parts: , and . The remaining integral with respect to is a product of an exponential and a polynomial. After some tedious process, the final result is
(37) | ||||
So the ORF for scalar-breathing mode is
(38) |
For the integral in the ORF for tensor mode in Eq. 14, the first term is the same as the scalar-breathing mode, and the rest term is
It can be divided into four parts in the previous way.
(39) | ||||
where the integration in second line is
(40) | ||||
(41) | ||||
(42) | ||||
It can be simplified as the form and the rest process is trivial. The result is
(43) | ||||
Finally, the ORF of the tensor modulus is obtained,
(44) |
The above method can be utilized to obtain the ORF for all polarizations. It should be noted that the process for scalar-longitudinal mode is slightly different. Divide the integral into separate parts, and the separate integration of each part will get divergent results. We need to drop out the divergent parts in the integral result. And it can be proved that the divergent parts dropped out just cancel out.
References
- (1) B. P. Abbott et al., Phys. Rev. Lett. 116, 061102 (2016).
- (2) B. P. Abbott et al., Phys. Rev. Lett. 119, 161101 (2017).
- (3) R. Abbott et al., Astrophys. J. Lett. 915, L5 (2021).
- (4) LIGO Scientific Collaboration and Virgo Collaboration, B. P. Abbott et al., Phys. Rev. X 9, 031040 (2019).
- (5) LIGO Scientific Collaboration and Virgo Collaboration, R. Abbott et al., Phys. Rev. X 11, 021053 (2021).
- (6) The LIGO Scientific Collaboration and the Virgo Collaboration, B. P. Abbott et al., Phys. Rev. D 100, 104036 (2019).
- (7) C. Hogan, Mon. Not. R. Astron. Soc. 218, 629 (1986).
- (8) C. Caprini, R. Durrer, and X. Siemens, Phys. Rev. D 82, 063511 (2010).
- (9) V. Mukhanov, H. Feldman, and R. Brandenberger, Phys. Rep. 215, 203 (1992).
- (10) M. S. Turner, Phys. Rev. D 55, R435 (1997).
- (11) T. Damour and A. Vilenkin, Phys. Rev. D 71, 063510 (2005).
- (12) X. Siemens, V. Mandic, and J. Creighton, Phys. Rev. Lett. 98, 111101 (2007).
- (13) LIGO Scientific Collaboration, Virgo Collaboration, and KAGRA Collaboration, R. Abbott et al., Phys. Rev. D 104, 022004 (2021).
- (14) P. Amaro-Seoane et al., arXiv:1702.00786 (2017).
- (15) J. Luo et al., Classical Quantum Gravity 33, 035010 (2016).
- (16) Z. Arzoumanian et al., Astrophys. J. Lett. 905, L34 (2020).
- (17) S. Chen et al., Mon. Not. R. Astron. Soc. 508, 4970 (2021).
- (18) B. Goncharov et al., Astrophys. J. Lett. 917, L19 (2021).
- (19) J. Antoniadis et al., Mon. Not. R. Astron. Soc. 510, 4873 (2022).
- (20) R. Hellings and G. Downs, Astrophys. J. 265, L39 (1983).
- (21) K. Lee, F. A. Jenet, and R. H. Price, Astrophys. J. 685, 1304 (2008).
- (22) S. J. Chamberlin and X. Siemens, Phys. Rev. D 85, 082001 (2012).
- (23) J. R. Gair, J. D. Romano, and S. R. Taylor, Phys. Rev. D 92, 102003 (2015).
- (24) A. Boîtier, S. Tiwari, and P. Jetzer, Phys. Rev. D 103, 064044 (2021).
- (25) A. Boîtier, T. Giroud, S. Tiwari, and P. Jetzer, Phys. Rev. D 105, 084006 (2022).
- (26) X.-Y. Lu, Y.-J. Tan, and C.-G. Shao, Phys. Rev. D 100, 044042 (2019).
- (27) P.-P. Wang, Y.-J. Tan, W.-L. Qian, and C.-G. Shao, Phys. Rev. D 103, 063021 (2021).
- (28) P.-P. Wang, Y.-J. Tan, W.-L. Qian, and C.-G. Shao, Phys. Rev. D 104, 023002 (2021).
- (29) J. D. Romano et al., Living Rev. Relativity 20, 1 (2017).