Overcoming Separation Between Counterparts Due to Unknown Proper Motions in Catalogue Cross-Matching–B.2
Overcoming Separation Between Counterparts Due to Unknown Proper Motions in Catalogue Cross-Matching
Abstract
To perform precise and accurate photometric catalogue cross-matches – assigning counterparts between two separate datasets – we need to describe all possible sources of uncertainty in object position. With ever-increasing time baselines between observations, like 2MASS in 2001 and the next generation of surveys, such as the Vera C. Rubin Observatory’s LSST, Euclid, and the Nancy Grace Roman telescope, it is crucial that we can robustly describe and model the effects of stellar motions on source positions in photometric catalogues. While Gaia has revolutionised astronomy with its high-precision astrometry, it will only provide motions for 10% of LSST sources; additionally, LSST itself will not be able to provide high-quality motion information for sources below its single-visit depth, and other surveys may measure no motions at all. This leaves large numbers of objects with potentially significant positional drifts that may incorrectly lead matching algorithms to deem two detections too far separated on the sky to be counterparts.
To overcome this, in this paper we describe a model for the statistical distribution of on-sky motions of sources of given sky coordinates and brightness, allowing for the cross-match process to take into account this extra potential separation between Galactic sources. We further detail how to fold these probabilistic proper motions into Bayesian cross-matching frameworks, such as those of Wilson & Naylor. This will vastly improve the recovery of e.g. very red objects across optical-infrared matches, and decrease the false match rate of photometric catalogue counterpart assignment.
keywords:
Algorithms – methods: statistical – catalogues – astrometry – proper motions – Galaxy: kinematics and dynamics1 Introduction
Counterpart assignment, the merging of bandpass detections in two (or more) datasets, enables a wide range of value-added science, and is therefore a crucial aspect of many areas of astronomical research. Fundamentally, we require the ability to answer the question ‘are these two detections observations of two different objects, or two observations or the same astrophysical object?’ Thus, to provide accurate and precise cross-matches between two photometric catalogues, we require a complete description of all sources of separation between detections of a single astrophysical object.
Unfortunately for astronomers, there are many reasons for the same source, detected by two different telescopes in different parts of the world at different times, to have recorded positions that are not perfectly aligned with one another. The first, and frequently assumed only, contribution is that from the act of measuring the position of the source on the detector image as part of the catalogue creation process. This ‘centroid’ uncertainty is related to the size of the telescope and the wavelength of the observation, as well as the atmospheric seeing, if applicable – all of which affect the telescope ‘point spread function’ (PSF), as well as the signal-to-noise ratio (SNR) of the detection, related to its brightness (e.g. King, 1983). Wilson & Naylor (2017) highlighted an additional source of positional shift that can affect detections in crowded fields: sources, too close together on the sky to be resolved by the telescope, can appear as a single observation, leading the fainter source to influence the position of the (assumed singular) brighter object (sometimes referred to as ‘classical confusion’; see also e.g. Hogg, 2001).
Here we consider an extra source of apparent separation between detections: that of the physical motion of the source across the sky. If the observations to be combined are sufficiently separated in time, the ‘proper motion’ of sources introduces a drift in the separation between consecutive measurements of the objects’ locations. Thus for pairs of observations with significant baselines, the proper motion-induced separations can become significant for large enough numbers of objects that, if we failed to consider these motions, we would decide the objects were too far apart to be counterpart detections of one object, and fail to assign them properly.
For probabilistic cross-matching algorithms this problem of object drift is further compounded. It is not only objects with significant proper motion that suffer, those few objects with motions large enough to render them completely incompatible with the hypothesis that the two detections are counterparts. All objects, even those with relatively small motions, are affected. Any motion on the same length scale as the astrometric precisions will impact the derived match confidence, and potentially render quoted match or non-match probabilities meaningless. This issue of your chosen model completely encapsulating the information contained within your data (or not) is often referred to as ‘model (mis)specification’. Therefore, the effect of source motion must be accounted for, even if not so extreme as to completely move an object beyond its prior position. If it is not taken into account, users of any resulting cross-match tables may not be able to put trust in the quoted match likelihoods and be able to take reliable, high-confidence cuts of the merged datasets.
This effect is particularly important for the upcoming Vera C. Rubin Observatory’s Legacy Survey of Space and Time (LSST; Ivezić et al., 2019), for a few key reasons. First, it will operate from 2025-2035, and thus have a two or three-decade baseline to the numerous surveys that operated during the 2000s and 2010s, such as 2MASS (Skrutskie et al., 2006) or SDSS (e.g. York et al., 2000). And second, it will lack measured proper motions for almost all of its sources for a large fraction of its survey lifetime. In part this is because the survey will require a multi-year baseline before reliable proper motions can be derived, but more simply because most objects within the full LSST catalogue will be below the completeness limit of the single-visit images. Even in this specific case, with Rubin’s high-fidelity time-series capabilities, proper motions will only ever be available for objects that appear in multiple images, which sets the proper motion magnitude limit much higher than that of inclusion in the full coadd catalogue. Worse still, the sheer number density of objects in the full LSST catalogue mean that up to 10 LSST sources will be potential counterparts to every single opposing catalogue object, and the ‘re-shuffle’ of objects, even of order the precision of the measured positions, may lead to false matches being returned for a sizeable fraction of the catalogues. Thus, the survey will be especially susceptible to this match misspecification due to proper motion drift, primarily at faint magnitudes. Additionally, other upcoming missions such as Euclid (Laureijs et al., 2011) and the Nancy Grace Roman Space Telescope (Green et al., 2012) will likely lack the multi-epoch capabilities that Rubin and LSST offer, but still suffer the effects of decade-long time baselines back to previous generations of deep surveys, such as SDSS or VISTA (e.g. VHS, McMahon et al., 2013).
As time goes on, and we accumulate increasing numbers of surveys we wish to combine to maximum scientific return, we will increasingly no longer be able to ignore even relatively small levels of apparent on-sky motion. One obvious solution is to use the individual proper motions available through datasets such as the Gaia (Gaia Collaboration et al., 2016) mission. These positions – combined with the rate-of-change of position from the proper motions – can be ‘fast-forwarded’ through time, allowing for sources to be placed in the epoch of the opposing catalogue, removing on-sky drift as a factor in considering the separation between sources. However, this is impractical for surveys such as LSST for a couple of reasons.
First, and simplest, is that proper motions are not available for the entire Gaia catalogue. Something like 20% of sources in the early Data Release 3 (eDR3; Gaia Collaboration et al., 2021; Lindegren et al., 2021) do not have the five- or six-parameter solutions necessary to include proper motions, and a not insignificant fraction of those that have quoted proper motions have uncertainties that render the quoted values useless for any meaningful position projection. Second, this would result in needing to run two Gaia-to-other-catalogue matches, merge the most likely of those matches in turn, and then run an internal Gaia-Gaia look up to get the inner join of the two catalogues. This would significantly affect the quality of the resulting matched datasets, with probabilistic cross-matching processes not being able to provide the proper probability of sources in the two ‘other catalogue’ datasets matching. Third, and most crucial, is the dynamic range consideration. Gaia is, for all its superb data, a relatively bright survey – at least by LSST standards. It also lacks coverage against longer wavelength surveys, where Galactic extinction is less oppressive. LSST will, with its 7 magnitude fainter completeness limit, include at least an order of magnitude more stars (Ivezić et al., 2019), and VISTA, as an example infrared (IR) catalogue of consideration as an ancillary dataset to extend LSST information with, will have little overlap with Gaia due to differing wavelength coverage. Other surveys with deeper completeness limits, such as Euclid, Roman, and SDSS, will also suffer significant numbers of matches beyond the Gaia completeness limit, with neither offering reliable proper motions at 21st magnitude or fainter. Thus, even if we did decide to peg Gaia as our gold standard, this would leave perhaps 9 out of every 10 LSST Galactic sources without a proper motion match. Those LSST objects, and many others in other catalogues, would be in need of a separate, and worse, cross-match once we had handled those few objects with a Gaia proper motion.
If we cannot trust matches between observations with significant time between observations, and we cannot necessarily use ancillary datasets with measured proper motions, how can we recover robust catalogue counterpart assignments through cross-matching? Naively, we might think that we can ‘re-center’ the distribution of offsets, by subtracting some mean separation between all of our counterpart pairings to account for the drift of our objects. However, different average proper motions across the dynamic range of the two catalogues would cause further systematics, affecting the distribution of counterpart separations. One may also think to use a Galactic model that calculates stellar velocities, and hence provides proper motions as viewed from Earth, for example the Besançon model (Robin et al., 2003). However, as discussed in more detail in Section 4.8, there are various reasons that these proper motions do not provide robust enough statistics for the determination of a statistical separation drift between two potential counterpart stars during a probabilistic cross-match process.
Thus, in this paper we put forward a model to build a statistical distribution of proper motions of sources, based on their Galactic motions. Modelling all sources of motion a star orbiting the Galactic center is subject to – its bulk circular orbit, and any ‘random’ scatter of sources from e.g. stellar cluster interactions – combined with the Sun’s motion, we are able to build a picture of the apparent motion of the given object. To do so, we begin with the velocity of the star as it orbits around the Galactic center. The conversion from velocity – in units like – to proper motion – in units like – is, roughly speaking, an inverse relation with distance. As we detail later, instead of using distance directly, we intend to use the brightness of an object as its more readily available surrogate, accepting that this is only an approximation.
Hence, combining the apparent motions of a wide range of objects at the same sky position and brightness we obtain all proper motions such a source might have – faint M dwarfs close by would have larger apparent motions than very intrinsically bright supergiants, but all ‘types’ of object contribute to the spread of motion drifts a source of this particular brightness could have. We are not particularly interested in a precise reconstruction of Galactic orbital dynamics – not being overly concerned with the details of spiral arm dynamics, or the specifics of the Milky Way Bar shape, for example. The use of the proper motions here is to ‘spread’ the motion drift, the separation between potential counterparts, allowing for the recovery, and increasing the reliability of match probability, of these objects within a Bayesian cross-matching framework. Therefore, the exact shape is less important than its central location and width; so long as these match reality to a fraction of the precision of the objects’ positions and the underlying distribution width to a factor , the model has served its purpose. The probability of two stars being counterpart ranges over many orders of magnitude, and hence the resulting probability density functions (PDFs) we derived to model the statistical proper motions having widths, and overall PDF heights, correct to a factor two is sufficient to improve counterpart recovery. We also desire computational simplicity, and thus speed, over an overly prescriptive or detailed exact model of the Galaxy, as this model must fit within a wider counterpart assignment framework and be able to be run on-the-fly for some arbitrary sets of sky positions and brightnesses.
Once we have constructed our distribution of theoretical proper motions, we can then consider their effect on our potential cross-match pairings. Here we can, in a similar way to how we would handle known Gaia proper motions, translate one object’s position into the epoch of the second catalogue observations, and consider the additional separation caused by the motion of the object. We must then test all modelled proper motions, with appropriate weighting, ultimately accounting for these potential additional time-based separations in answering the question of whether these two detections are two physical sky objects or one source viewed twice in time.
1.1 Paper Layout
This paper is split into two parts. First, we detail the construction of a simple analytic model for the statistical distribution of potential proper motions of a source of a given magnitude and sky coordinates. In Section 2 we detail the constituent parts necessary to build the model of proper motions. We describe the process of building the distributions in Section 3, while Section 4 discusses the precision and accuracy of the model at various Galactic sightlines and brightnesses. Here we will return to Gaia, using its high-precision stellar proper motions across many Galactic sightlines to evaluate and corroborate our model distributions.
The second part of this work describes how to include this unknown proper motion distribution – or any distribution of proper motions, theoretical or poorly constrained yet detected – in the cross-matching process. We discuss the mathematical framework necessary for including proper motion drift in the evaluation of the separation between potential counterpart detections in Section 5. We also touch upon how to use these statistical distributions of proper motion drift as a discriminator between stars and galaxies. Concluding remarks are given in Section 7.
2 Constructing the Proper Motions
We need to build a model to describe the observed motions of sources across the sky. There are, essentially, three components that matter: first, the ‘peculiar’ motion of the Sun itself; second, the expected velocity of a source moving with the Galactic rotation; and third, the random velocities of the Galactic sources; these will be discussed individually. First, we must consider how we will build this model.
As the model involves consideration of the Galactic rotation (and we will see later that source random motion is location dependent), we will require a description of the position of the source in the Galaxy. The first two components are easy: sky coordinate in Galactic coordinates (converting Equatorial and by rotation to longitude and latitude , if necessary). The only other component we would need is a distance, or parallax; however, if we have parallax we likely have a unique proper motion, as these are generally fit for simultaneously, and hence we use the next best proxy: magnitude. This will blend several ‘types’ of source together (e.g. dwarfs and giants of the same brightness are at different distances). We will see that while this might introduce extra scatter in the proper motion drifts, our models match Gaia proper motions at magnitude cuts well – and indeed account for the fact that we do not know the type of any individual source from its photometry a priori!
However, we do need some distance metric, and hence we turn to the TRILEGAL simulations (Girardi et al., 2005) to provide a theoretical magnitude-distance relation. Thus, while our catalogue sources have their proper motions built as a function of sky coordinates and photometric brightness, our model is coordinate/distance based. In the following sections we describe how we formulate a description of the observed proper motion of a set of sources based on their given parameters.
2.1 Solar Peculiar Motion
The first component in the Galactic motion is the unique velocity of the Sun, relative to the local standard of rest (LSR). The Sun’s motion through the Galaxy will induce a ‘secular’ parallax effect (i.e. distance-dependent, albeit non-periodic, as a trigonometric parallax would be) in the apparent movement of all other sources in the sky, with opposite sign. Hence we need to know the Sun’s motion, relative to this ‘zero point’ motion, the LSR, defined in the Heliocentric Cartesian coordinate frame, – velocities corresponding to the coordinate system. Here we use the values of Schönrich et al. (2010):
(1) |
2.2 Galactic Rotation
The main component of our model that will dictate the Galaxy-wide observed motions of sources is that of the Galactic rotation, and the stellar streaming. Descriptions of this motion go back to Oort (1927), with the Oort constants describing the motion of stars on closed orbits around the Galaxy. However, through modern kinematic surveys, obtaining the three-dimensional velocities and independent distances to a host of well-characterized objects, it is possible to directly measure the rotation curve of the Milky Way. Thus, we can derive the average tangential velocity of sources orbiting the Galactic center at a given radius, here following Model 3 of Mróz et al. (2019).
Obtaining the rotational velocity at a given Galactocentric radius , we can transform this Galactocentric Cylindrical azimuthal velocity into a Galactocentric Cartesian coordinate frame and subtract the Solar peculiar and LSR motion, obtaining , , and (Mróz et al., 2019, equations 5-7). To do so, we use the transformation
(2) |
here is the Solar Galactocentric Cylindrical radius, is the in-plane distance from the Sun to the particular location, and is Galactic longitude – see Appendix A.1.1 for details. Deviating from Mróz et al. (2019), we set , the non-circular motion of the source, all to zero, and hence have
(3) |
Once we have the Galactocentric Cartesian components of the rotational velocity, relative to the Sun, we can transpose into the in-plane Heliocentric radial and tangential velocities,
(4) |
along with , since the two axes are still in alignment. Finally, once we have appropriate Heliocentric Cylindrical velocities, we can construct our latitudinal velocity as
(5) |
and relate the Heliocentric longitudinal and latitudinal velocities to their proper motions through
(6) | ||||
(7) |
where is the parallax of the source. As our distances come from Galactic models, we assume they are not subject to any observational bias or uncertainty, and simply treat . The factor describes the translation from units of to , and is given by .
In practice, the TRILEGAL simulations do not provide either distance or parallax, but provide its distance modulus. Hence, to obtain a (three-dimensional) distance in kpc, we invert the absolute magnitude equation:
(8) |
where is the distance modulus.
2.3 Asymmetric Drift Velocity
The above equations describe the average Galactic rotation velocity around the center of the Galaxy. However, objects have other sources of velocity that impact their observed proper motions, and this leads to a deviation away from the expected velocity, and thus proper motion. This is termed the asymmetric drift velocity, and essentially controls how much of the theoretical velocity a source should have is taken by other, random motions. Thus, we must include this component in the velocities.
We model three Galactic components (see Sections 2.4.1-2.4.3 for more details of their construction) in our simulations: the Galactic thin and thick discs, and a single Galactic (outer) halo. Each of these is given their own asymmetric drift, as a measure of the levels to which their motions are different from ‘pure’ streaming motion. We assume the thin disc of the Galaxy has an azimuthal asymmetric drift velocity of (Robin et al., 2003). As Mróz et al. (2019) used Classical Cepheids in the derivation of their rotation curve, we also assume the rotation curve is valid for the thin disc and already folds in any drift velocity, and therefore just need to consider the relative drift velocities of the thick disc and the halo. We use a thick disc drift velocity of (Pasetto et al., 2012a), and give the halo a drift velocity of (Golubov et al., 2013), to essentially counteract the motion of the LSR, modelling the halo as stationary relative to the Galaxy. We therefore use for the relative thin disc, thick disc, and halo drift velocities, respectively.
For a given location in the Galaxy, our decomposition of the drift velocity, from Galactocentric Cylindrical coordinates into Heliocentric Cylindrical coordinates, is given by the transformation
(9) |
with
(10) |
and
(11) |
with taking on any one of the three given drift velocities above, depending on which component of the Galaxy is being considered. For details on the derivation of this transformation (rotation and mirror) matrix, see Appendix A.1.2.
2.4 Velocity Dispersion
The asymmetric drift velocity suggests that some of the motion that ought to be used by a given source in its rotation around the Galaxy is being used otherwise, in a random component. Hence, a collection of sources in a particular part of the Galaxy will have some spread of their velocities around some mean value. Thus, to be able to model our collection of sources in the Galaxy we require a description of the dispersion of the velocities.
Each component of the Galaxy modelled – thin and thick discs, and halo – have their own prescription of velocity dispersion. In addition, when simulating sources, we do not initially know to which component to assign a given simulated object. Therefore we simply generate a set of proper motion realisations for each of the three components, weighted according to their a priori density at that location. Hence, in the following sections we also describe the formulation of each component’s density profile, which are simply re-normalised by the sum of their densities to provide a prior probability, used as the weight for the proper motion distribution. We currently do not consider the Bulge, a common component of Galactic simulation models such as TRILEGAL, in our proper motion model. We chose to ignore this additional component for this initial, exploratory model, focussing on relatively bright sources, with detected Gaia proper motions to compare and verify our model against. This should mean they are sufficiently far from the Galactic center to not be influenced by the Bulge, avoiding the complexities that the inner region of the Galaxy impose on velocities of orbiting stars. However, with the upcoming LSST survey and the need to model much fainter, more distant objects in the next few years, we will investigate a robust Galactic Bulge/Bar model for inclusion within this proper motion framework. We simply conclude, for now, that it would be easy to add additional components, and we could model a simple Bulge component after e.g. Jackson et al. (2002).
Once a given Galactic component has its dispersion vector – its covariance matrix – in the Heliocentric Cylindrical coordinate system, then a realisation is drawn from a multivariate normal, given by
(12) |
where and is the Cylindrical frame rotated covariance matrix of the th component.
2.4.1 Thin Disc
The thin disc is modelled as an exponentially decaying density profile with given radial and vertical scale heights, as per Jurić et al. (2008) and Ivezić et al. (2008):
(13) |
with (Mróz et al., 2019), (Jurić et al., 2008); is an irrelevant normalisation constant, used simply to explicitly cancel in the re-normalisation from density to weighting. The radial and vertical scale lengths we use are the bias-corrected values calculated by Jurić et al.: , and .
The dispersion vector for the thin disc is based on observations of RAVE stars from Pasetto et al. (2012b). However, the nature of the observations limit their calculation of covariances to approximately from the Sun, and we need to extrapolate these dispersions out to perhaps five times that distance. Thus we turn to Amendt & Cuddeford (1991) for relations between the various (co-)variances in the dispersion vector.
First, we assume that the variance in the vertical direction, , scales with radial distance in the mid-plane of the Galaxy:
(14) |
As discussed by Amendt & Cuddeford, this scaling relation is also sometimes assumed for , but a second, valid formalism can be used where the rotation curve of the Galaxy is flat – which it should be safe to assume given the very small gradient from Mróz et al. (2019) for most of the Galaxy. This formalism is based on a constant Toomre (1964) local stability parameter, and gives
(15) |
Hence we use111Using for the Galactocentric Cylindrical frame radial dispersion component, to avoid the slightly clunky notation .
(16) |
For the vertical extrapolation, we assume a local Taylor expansion to first order (i.e. we extrapolate linearly to above and below the plane, from ). We limit this extrapolation to the inner one kiloparsec of the plane, and assume a constant dispersion beyond that, and hence:
(17) | ||||
(18) |
Using the Pasetto et al. data in the range , , we find
(19) |
Additionally, to be consistent with the data as derived by Pasetto et al., we use – note that – for extrapolating the dispersions. Here we have assumed their quoted location of the Sun ‘in the range ’ implies222Inclusive of 8.6 but exclusive of 8.4, equivalent to . an assumed default location in the middle of the bin.
We assume, following Amendt & Cuddeford (1991) and Vallenari et al. (2006), that
(20) |
where the first term on the right hand side vanishes by symmetry at , and the derivative is given by
(21) |
Given no information on the radial dependence of , we fix it to the local value of (Amendt & Cuddeford, 1991). In cases where the linear extrapolation would result in a correlation larger in absolute value than one, we force the correlation back to either +1 or -1.
Following Vallenari et al. (2006), this is the only off-diagonal term we consider for the thin disc covariance matrix. Finally, again following the prescription of Amendt & Cuddeford, we assume that the azimuthal and radial dispersions are related by a constant, and hence use
(22) |
with and the Oort (1927) constants, for all and . We use the Olling & Dehnen (2003) Oort constant values (their table 5, figure 6), as a function of intrinsic colour . Here we interpolate and as a linear function of , fitting:
(23) |
as shown in Figure 1 (left-hand panel).

As we are using TRILEGAL simulations, we require a conversion from available TRILEGAL parameters to ; for this we use the dwarf colour sequence of Pecaut & Mamajek (2013). We fit a two-step function to the intrinsic B-V colour as a function of effective temperature (with in units of Kelvin),
(24) |
as shown in Figure 1, right-hand panel.
Once we have all of the terms, we rotate the covariance matrix from its Galactocentric cylindrical coordinate frame into the Heliocentric coordinate system by
(25) |
using the rotation matrix as defined in equation 10.
2.4.2 Thick Disc
The formalism for the thick disc is very similar to that of the thin disc. We also use the exponential decay model for the density profile, albeit with different scale lengths:
(26) |
again following the Jurić et al. (2008) and Ivezić et al. (2008) formalism, with and again, and , and . In addition, the parameter sets the relative densities of the thin and thick discs, and again is an arbitrary normalisation constant.
The thick disc dispersion vector uses the data from Pasetto et al. (2012a), again following the same radial scaling relations for the thin disc:
(27) | ||||
(28) | ||||
(29) |
where, once again, we use from Pasetto et al. (2012b), assuming the two papers were jointly analysed and hence have the same , although neither paper in the series quote a specific value. This time, we do not describe any vertical dependency of the dispersions. Finally, we take the diagonal terms as presented by Pasetto et al. (2012a) within or without the Solar circle as the values approximately at , as given by their tables 3 and 4 respectively, but ignore the off-diagonal terms, which are all within of zero.
Exactly the same as with the thin disc, we rotate the Galactocentric Cylindrical reference frame into Heliocentric Cylindrical coordinates by
(30) |
again using the cylindrical rotation matrix of equation 10.
2.4.3 Halo
The halo Galactic component follows the density profile
(31) |
again using the Jurić et al. (2008) and Ivezić et al. (2008) formalism, with , , . is a normalising constant once again. This parameterization of an inverse power law leads, at , , to an infinite halo density, and hence unphysical normalising weighting in the Galactic model. We therefore truncate the halo density within the solar circle, , fixing it at its value at at smaller radii. This ought to be possible because the old Galactic halo should be negligible in relative density by the solar circle.
The dispersion vector for the halo is derived from King et al. (2015), given in spherical coordinates. We take the full covariance matrix from the closest radial bin from the ‘Equally Populated Bins’ in their table 3 for a given set of parameters for a given source, with the exception of their bin. This bin gives a covariance matrix that is not positive semi-definite, and hence we ignore the off-diagonal terms for that individual bin. These have no scaling applied to them and are taken exactly as quoted.
To rotate into the Heliocentric Cylindrical reference frame, we use
(32) |
where333Once again, has been used instead of for notation’s sake, analogous to the thin and thick disc notations.
(33) | ||||
(34) | ||||
(35) |
and where , following the King et al. notation. describes the rotation from Galactocentric Spherical coordinates to Galactocentric Cylindrical coordinates, with , as before, defining the rotation from Galactocentric Cylindrical to Heliocentric Cylindrical coordinates. is defined as the angle between the spherical radial vector and the Galactic plane (), with the three-dimensional distance to the source in question, and the three-dimensional Galactocentric distance to the star. For more details on the derivation of this transformation matrix, see Appendix A.1.3.
3 Creating a Proper Motion Distribution
Now that we have described the model for simulating the velocity of a source at a given position in the Galaxy, we can create a theoretical distribution of sources. In a small sky coordinate window (in our tests limiting ourselves to a few square degrees in the Galactic plane, and relatively small polar cap latitude windows), we run a TRILEGAL simulation in the center of the defined region. We simulate either 1.5 million sources down to Gaia , or as many as we are allowed within 10 square degrees, the maximum limit of the public simulation API. Distances for these simulated sources are derived from their absolute distance modulus, and – with no positional information in the simulated dataset – we randomly place the sources within the rectangle defining the coordinate window.
For a given small magnitude range of sources, each source then has its proper motions calculated as though it were from each of the three Galactic components in turn, with some number of realisations () of the multivariate dispersion drawn. We then calculate a weighted histogram of proper motions. For each source, , where is the number of simulated stars (and thus distances), the three Galactic components at the given Galactic longitude, latitude, and distance have their respective weights (, or ) calculated. The weighted histogram is therefore built with each derived proper motion being given weight ( the number of derived Galactic velocities for the th source, in each of the three components), for each of the derived proper motions, across all objects. The histogram (which will contain weighted counts across all bins) is then converted to a PDF.

For the purposes of visualisation and testing, we extract all of the proper motions of Gaia eDR3 sources with flux SNRs greater than five in the same coordinate window and magnitude range defined for the simulated proper motions. Finally, one additional step is taken, solely for the purposes of distribution comparison: we convolve the model with the median uncertainty of the Gaia proper motions in the dataset for this magnitude cut and sightline. This allows for the inclusion of non-negligible Gaussian uncertainties in our comparison of our generated model to the Gaia data. This step was purely for visualisation purposes, and is not part of the model itself.
4 Assessing the Accuracy and Precision of the Proper Motion Model




4.1 Overall Model Shape
The simulated proper motions are good across all sightlines and brightnesses; some examples are shown in Figures 2-4. We get good agreement in the mean proper motion, and shape of the distributions, of bulk source motions. For most sightline-brightness combinations the agreement is quantitative, while sometimes the shapes are merely broadly in agreement. Disagreement in modal proper motion drift is likely largely caused by our Galactic rotation model not capturing the fine detail of Galactic potentials or inaccuracies in our asymmetric drift velocity, while distribution width issues can mostly be explained by the extrapolation of the velocity dispersion vector. However, we stress that the model’s simplicity is one of its strengths in the context of inclusion within a larger cross-match process, and that these minor differences are more than acceptable for the purpose of improving Bayesian match likelihoods. These distributions are intended to reflect a wide range of potential positional shifts through time, rather than model any one specific proper motion. Hence so long as the rough widths – to within something like a factor two, which we achieve – and mean offsets – good to high accuracy using the Galactic rotation curve – are modelled to reasonable accuracy, our distributions are good enough for our work, and as intended.
Figure 5 shows some reduced statistics for the entire set of sightline-brightness combinations we tested in the Galactic plane – , in the range from to in 15 degree intervals, and , as well as the Galactic north and south poles at , , , and . Overall, we find that the widths of the Gaia data are approximately 80% that of our model (i.e. our model is too wide by 25%) across all positions and brightnesses. There is a roughly 10% spread in relative widths – middle column, Figure 5, cf. Figure 2, bottom right panel, where our red model has a slightly wider wing than the histogram of the black Gaia data. We also see evidence for overly narrow simulated proper motion distributions (Gaia-to-model ratios larger than one) along various sightlines, in approximately 8% of cases – but, again, get extremely good agreement along others. These slightly-too-wide distributions are likely related to our modelled radial and vertical dependencies of the thin disc dispersion vector, as the thin disc is the dominant term at the distances our Gaia data probe. Additionally, as can be seen in the top row of e.g. Figure 2, low-number statistics of brighter Gaia stars could be interpreted as lower standard deviations, as the ‘real’ distributions fail to probe the wings of the simulated distributions to high precision.
Relative to the standard deviation of the distributions, our biases – the mean motion offsets – are within % two-thirds of the time, and almost always within %, as shown by right-hand column, Figure 5. Absolutely, on a decade baseline, we find most of our mean motion offsets are within approximately 0.01 arcseconds (or 0.025 arcseconds on a 25-year baseline, as maybe be important for LSST), well within the ‘centroid’ precision of most photometric catalogues – left-hand column, Figure 5. These results – even where qualitative (e.g. Figure 4, bottom-left panel) as opposed to quantitatively (e.g. Figure 4, top-left panel) good fits – are satisfactory, and we therefore have chosen not to over-explore the residuals, as the subtleties of the spiral arm structure of the Milky Way are outside of the scope of this work.
4.2 Galactic Poles
All previous examples shown (Figures 2-4) were limited in Galactic latitude to , exploring primarily the proper motions of sources roughly in the Galactic plane. However, we must also verify that our model is good at high absolute Galactic latitudes, where we are viewing sources orbiting around the Galactic center ‘above’ us. As shown in Figure 6, we get good agreement for the Galactic longitudinal and latitudinal proper motions, after removing objects with parallax () or . Here, close to , our equations for the average rotational velocities (equations 3-7) simplify somewhat. First, looking straight up out of the Galactic plane, we have ; we also have , and hence , and can assume , giving , . This further gives , , and hence, along with a simplified ,
(36) | ||||
(37) |
This renders the orbital motions effectively just those of the Sun, with our dispersion vector giving good shape agreement to the Gaia data. Overall, we see good agreement in the shape of our model and the Gaia proper motions.

4.3 Widths of Distributions vs. Position and Proper Motion Precisions
At this point it is worth briefly considering if, or at what brightnesses, this additional information is necessary. Figures 2-6 show a representative sample of Galactic sightlines and the various widths of the distributions of potential proper motions in each sightline-magnitude combination. Overall, the widths of these distributions are approximately arcsecond drifts over a 10 yr baseline () at the bright end of our tests (), reducing to arcsecond drifts in 10 years () at .
The first parameter we should compare the proper motions to is the precision on an individual position. If one or both of the positions in a given cross-match were highly uncertain, factors 10 or higher than the proper motion drift, this would dominate over the extra positional spread caused by the potential proper motion of the source. Its inclusion would then not contribute to the determination of potential counterparts. However, for a decade-long baseline, the spread of separations induced by unknown proper motion is at least a factor two or three higher than typical astrometric precisions, with even small motions over long enough baselines moving objects several astrometric precisions apart. For Gaia astrometric precisions are vastly higher; while 80% of its sources will also have incredibly high precision proper motions even the remaining sources will have coordinate positions significantly higher than the unknown proper motion distributions. A more typical ground-based survey, LSST should have at worse 0.07 arcsecond precision on each individual visit at (Ivezić et al., 2019). While this is a factor times smaller than the widths of our proper motion distributions on decade baselines, the real power of LSST lies in its repeated observations. Depending on whether the object is in the full ‘Wide-Fast-Deep’ (WFD) survey or in the Galactic Plane footprint, it will either be observed approximately 800 or 150 times across LSST’s full survey lifetime (Bianco et al., 2022). Hence the statistical precision on a co-added detection at is arcseconds depending on the exact number of visits. Even including systematic precision (Ivezić et al., 2019) this is far below the widths of our models for proper motion drift. While those objects will likely also have proper motions after LSST DR3-4, coadded detections will have statistical astrometric precisions a factor higher, arcseconds, still a factor 10 or more below our 10-year baseline drift spread. It will be therefore important to take these long-baseline drifts into account for faint LSST objects. For current-generation surveys such as SDSS, its very faintest sources have statistical positional uncertainties comparable to the tightest of our proper motion distribution widths () so objects in SDSS may only see limited gains matching across a 10-year timespan. Of course, the drifts increase linearly with time, and so a 15-year baseline (2015-2030, for example, in the case of SDSS-LSST) increases the potential proper motion drifts to a larger impact than astrometric precision. Additionally, in the context of crowded field Bayesian cross-matching, even a ‘one-sigma’ positional movement will be enough to significantly disrupt match likelihoods.
It is also useful to ask if proper motion precisions are ever comparable to the width of potential unknown proper motion. Again, for Gaia this is not the case due to its extremely high precision and repeated observations of all objects. At the median precision on its proper motions are of order (Gaia Collaboration et al., 2021). For LSST, quoted proper motion uncertainties are also of order (Ivezić et al., 2019) – but these assume visits. Hence the stellar proper motion precisions for Galactic Plane objects will be a factor higher due to the reduced number of observations within the same timeframe. However, even is over a 10-year timeframe and therefore a smaller, but sizeable, fraction than the unknown proper motion distribution widths. Right at the detection limit of proper motions with LSST it may be the case that it is preferable to not use the detected-but-unconstrained proper motions, though. SDSS has typical limiting proper motion precisions of by . Hence, like LSST, where constrained individual SDSS proper motions brighter than about 20th magnitude are likely preferable to unknown proper motions, but below this limit and the single-visit detection limit of unknown proper motions may be the more precise constraint. In the IR, CatWISE (Eisenhardt et al., 2020) has proper motion uncertainties of at (Marocco et al., 2021) and the VVV survey (Smith et al., 2018) cites uncertainties of around ; below these brightnesses the precisions on individual proper motions become comparable to or larger than the widths of typical unknown proper motion distributions.
4.4 Missing Galactic Components
As discussed in Section 2.4, we do not currently include a full prescription for the Galaxy. In particular, we do not model the Galactic Bulge (or Bar). This may have an effect at very low Galactic longitudes and latitudes. The Gaia data show a broader, almost flat distribution of longitudinal proper motions, where our simpler Galactic model, using the thin disc as the dominant term, has a bi-modal distribution of two narrower peaks, as shown in Figure 7, left hand panel. It can also be seen in the data (Figure 7, right hand panel) that there is a slightly too narrow distribution of latitudinal proper motions, as compared to the Gaia data. This likely comes back to the minor effects of radial dependencies of the term, either following a Gaussian- or Rayleigh-like distribution (as discussed in Section 2.4.1). However, it could also be the case that our radial and vertical dispersion scalings are failing at these smaller Galactic radii, as a significant fraction of Gaia sources ought to be sufficiently far removed from the Galactic center to be Bar or Bulge objects. Once again, we deem these minor issues beyond the scope of this preliminary work – the combined bi-modal longitudinal distribution almost entirely covers the distribution of Gaia motion drifts, to within better than a factor 1.5 or so, which is our goal. However, we highlight the issue that the very inner few degrees of the Galactic center may suffer systematic proper motion effects due to the nature of the Galactic Bulge and Bar complexities.
We also have not modelled the Magellanic Clouds, and indeed during testing found that several of our test fields are heavily ‘contaminated’ by sitting on the Small Magellanic Cloud (SMC) and Large Magellanic Cloud (LMC). These extra terms, as with the Bulge, would be easy to implement; provided a relative number density of sources, with some positional distribution, and bulk and dispersal proper motion – assuming the Magellanic Clouds are orbiting internally, and around the Milky way – the proper motions can be modelled in much the same way with the Galactic discs and halo. For now, we also simply urge the reader to take care when simulating sources centered on the Magellanic Clouds (SMC , ; LMC , ).
4.5 Missing Binarity Perturbation
Our model for motions of objects in the plane of the sky assumes all sources are single stars, subject solely to the Galactic potential. However, half of objects are in some form of higher-order system (e.g. Raghavan et al., 2010) and should therefore be subject to additional on-sky motion. It is therefore reasonable to ask whether the non-inclusion of this effect, of unresolved binary objects, would have any impact on our derived proper motions.
If the binary were equal mass, any orbital motion of the two sources around their common barycentre would completely cancel by symmetry, and show no impact on the photocentre and proper motion of the blended sources. On the other hand, if the objects were very unequal in mass then both the barycentre and photocentre of the pair will be dominated by the larger, brighter main source, and effectively reduce to a singular object for our purposes. An object of approximately half the mass of the primary, however, contributes very little in luminosity but significantly in astrometric effects. Placing such an object on a worse-case orbit of approximately would give an orbital period around 25 years, and a half-phase orbit on our key decade-long time interval between photometric catalogue ‘generations’. In that time, the primary object would travel halfway around the orbit, appearing to move a total of AU, twice its orbital distance from the barycentre. At a typical distance of roughly this is or . Such a perturbation is well below the of order widths to the proper motion distributions observed for faint objects in our model. If the object were significantly closer – say instead – the motion effects would be 10 times higher, and comparable to the model widths. In those cases the object would be much brighter, and likely have an individually measured proper motion or be known to be a multiple system through other means. We therefore believe the non-inclusion of higher-order systems is justifiable at the resolution we are aiming to achieve.
4.6 Random Positions of Sources
As noted in Section 3, the TRILEGAL simulations we use to construct our models of proper motions do not provide individual positions for simulated sources. To overcome this, we simply uniformly distributed sources within the rectangular area we sampled our Gaia proper motions in. This effect may explain some small disagreements between our simulated and Gaia proper motion distributions, as we are therefore not properly modelling any clustering, extinction effects, or other non-uniformity and correlations in the distances and positions of Galactic sources.
However, the effect on each individual proper motion should be relatively small, as the regions in question were mostly limited to several degrees in extent, and , over the entire Galactic longitude. Thus our values for, e.g. the decomposition of , or , within our proper motion equations, are of order 8% wrong at their most extreme, in the case of a simulated patch of sky five degrees wide. As an ensemble, however, this assumption should be a reasonable one, and the ‘incorrectness’ should average out, with uniformity of source distribution acceptable for small enough patches of sky, providing a statistical distribution of variations of velocity decomposition across the whole region.
4.7 Gaia Proper Motion Uncertainty
To compare our ensemble proper motion distribution with the distribution of Gaia proper motions, we included the Gaia measurement uncertainty in our theoretical distribution of drifts. The Gaia data have individual uncertainties but to smooth the model with the uncertainty we had to select a single average value (the error bar included in the corners of sub-plots in e.g. Figure 2). A small part of the discrepancies between model and data in our analysis could therefore stem from this simplifying assumption, with no bearing on the model itself. If the Gaia data have a particularly broad distribution of measurement uncertainties, as they tend to at fainter magnitudes, our single uncertainty value would not produce an uncertainty-convolved motion drift distribution that reflected that of the Gaia data. Testing more complex treatments of Gaia uncertainty distributions in the comparison between model and data, we found that more fully describing the non-singular value of measurement precision did produce theoretical drift distributions that better matched the expected data, but not completely. We therefore still find a few sightlines with slight differences in central proper motion or distribution width, but perhaps 30% of these tensions are explainable by the different measurement precisions of faint Gaia proper motions. Ultimately, however, as mentioned in Section 3, we do not include this measurement uncertainty in the final model, just performing the convolution to compare to the Gaia distributions more accurately.
4.8 Comparison with the Besançon Model
Throughout this work we have used the TRILEGAL simulations to provide a set of theoretical distances for sources of a particular Galactic sightline and magnitude. We could, of course, use any model of the Milky Way to achieve this, such as the Besançon model (Robin et al., 2003, 2012, 2014, 2017; Czekaj et al., 2014; Bienaymé et al., 2015). With the Besançon models, however, we receive simulated proper motions for the objects returned in our query, unlike with TRILEGAL. We can use these simulated proper motions to further verify the robustness of our proper motion model; but this then raises the question of why we simply do not use these simulated proper motions for use in our cross-matches. We will address both of these issues in the next two sections.
4.8.1 Verifying the Accuracy of Our Model with Besançon

With simulated Besançon proper motions, we can compare our model’s statistical distribution of proper motions with those of the Galactic model. Shown in Figure 8 are distributions of proper motions at , for Gaia, our simple model for stellar velocities, and Besançon proper motions. Overall, at fainter magnitudes (bottom row), both models are in agreement with the Gaia data, with our distribution a slightly better match in Galactic latitude than the Besançon model.

However, there are some sightlines within the Galaxy where our model has some mismatches to the Gaia data – an example sightline demonstrating this effect is shown in Figure 9. Here, at faint magnitudes (), the Besançon model better reproduces the Galactic longitude proper motion distribution seen with Gaia, where our model shows a slight bias, and a distribution slightly too broad. Neither model can reproduce the Galactic latitude Gaia proper motions, and both look very similar in their over-broad distribution.
At bright magnitudes (), however, we can see that our distribution (red solid lines) much better matches the Gaia data points than the Besançon simulation (blue dashed lines). In almost all cases, and in Figures 8 and 9, but more generally across multiple sightlines, the Besançon models are too sharp in distribution, and fail to match the Gaia data as well as our model for proper motion. We discuss this magnitude-dependence of the Besançon model fits further in Section 4.8.2.
Here we conclude that our model matches the Besançon models very well, as it does the Gaia data, and see cases where both our model and the Besançon model fail to match the Gaia data perfectly.
4.8.2 Why Not Just Use the Besançon Proper Motions?
We have used TRILEGAL simulations to construct our Galactic model throughout this work, but we could have used any Galactic model. If we had used the Besançon model, we would also have been provided with simulated proper motions for the objects we use for their distances in constructing our proper motions. It is therefore reasonable to ask why we would go to the effort of using another model, if we already had a set of proper motions from which to construct a PDF of unknown proper motions.
First, as our model is broken up into separate smaller sub-models, as opposed to being wrapped in a full Galaxy model, our magnitude-to-distance relation is flexible. As mentioned, we have been using TRILEGAL simulations to get our potential distribution of distances of sources of a given magnitude, but we could use any Galactic model. Indeed, we do not need to use a model at all; if we instead had a known distribution of tip of the red-giant branch stars, or some other class of standard candle, we would immediately know the distance of our sources from their brightnesses. We therefore do not necessarily need to rely on fully resolved Galactic models to provide proper motions or distances with our simple model. On the other hand, our options become slightly more limited if we wish to use a full Galactic model to obtain simulated proper motions in one pass, as opposed to generating more ‘static’ distributions of object brightnesses (or distances), and using other functionality to continue on to create our final proper motion distributions, as we do here.
The second consideration is that of dimensionality; each Besançon source is provided with a simulated proper motion – but only one. Our model uses the simulated distance for each source once, but draws simulated velocities – and hence simulated proper motions – for each source. We therefore much more completely sample the 3-D velocity space than any one simulation from the Besançon Galactic model will. This effect can be seen in the panels of Figures 8 and 9, where our model (red solid lines) much better agrees with the Gaia proper motions, where limited sample size means the Besançon model is not fully populating the velocity dispersion dimensions. At , number counts have increased by a factor 100, and the velocity dispersion, having an inverse-distance component (and fainter stars being further away, on average), has reduced in size. This reduces the effect of the lack of realisations; the Besançon models therefore agree much better at these fainter magnitudes than they do at bright ones.
By using each source only for its distance, as opposed to using it to sample the 4-D distance-velocity dimensionality, we much more accurately sample from the full potential proper motion distribution at bright magnitudes. This is crucial for bright sources, being closer to the Sun on average, which have larger proper motions (cf. the axis ranges on the top and bottom rows of Figures 8 and 9). It is here where our constructed model has the edge on the proper motions constructed from large-scale Galactic simulations, although brighter objects are, of course, more likely to have a robustly detected proper motion from other sources.
5 Including Proper Motions in Probabilistic Catalogue Cross-Matching
No matter how you construct your proper motion distributions, it is still important to consider them in a match between two photometric catalogues of differing epochs. The Astrometric Uncertainty Function (AUF; Wilson & Naylor, 2017; Wilson & Naylor, 2018b) is the description of the belief as to a true position of the source, given its measured position. This is typically assumed to be a Gaussian, which describes the most obvious term affecting the measured positions of sources in photometric catalogues, and hence the separation between two potential counterparts: the noise-based centroiding of the individual objects during the catalogue creation process. The function representing the likelihood of two sources having a given separation under the assumption that they are counterparts to one another – two detections of the same physical object – is given by
(38) |
(Wilson & Naylor, 2018a). Here are the two-dimensional sky offsets (e.g. right ascension and declination, or Galactic longitude and latitude), and the AUFs of the sources from the two catalogues respectively, and denotes the convolution of two arbitrary functions and evaluated at and .
As discussed by Wilson & Naylor (2018b), the AUF can be extended with any additional terms, etc. Here the additional components, after the first noise-based centroid term, describe extra potential movement away from the ‘true’ sky position of the source in the limit of infinite precision. These could include, for example, stochastic processes such as the perturbation of objects due to hidden contaminants affecting the center-of-light of sources, or systematic effects like offsets of the coordinate frame of the catalogue from a common reference frame, such as the ICRS. Whatever the effects, the point is that each source is considered individually, and has all of its components applied to it on an isolated, per-source basis. Proper motion, however, does not work like this; the effect of proper motion drift works on offsets between two positions, as opposed to affecting the absolute position of one source.
Thus the proper motion drift must be applied to , giving, effectively (see Appendix B.1 for details). should be calculated in the sense of mapping from oldest to youngest epoch, in units of distance; thus for we have, crudely, . Mapping from most recent to older data would have a negative , but the proper motion would have to be of the opposite sign as well (being a ‘rewind’ of the motion), and thus the sign of would be the same. If a source has a purely positive proper motion distribution, such that all for this simulated source, then we would expect a source observed in the year J2000 to have a smaller Galactic longitude than a source observed at J2015, for example. This convolution can be performed as any other convolution done to calculate by the convolution of all components – e.g. either numerically, or through expression as a mixture of analytically convolvable models.
We also highlight here that while Sections 2-4 detail a method for the construction of a distribution of unknown proper motions, can be constructed through any available means. For example, Kerekes et al. (2010) construct sets of data-driven proper motion distributions for the purpose of improving cross-matches, using available proper motions to construct priors for weighting the search for unknown proper motions between potential source counterparts. On the other hand, the faint end of a photometric catalogue will systematically have worse precision on its measurements (see Section 4.3), and at some point will have detected the proper motion of an object but be unable to constrain it with high precision. In these cases, could very well be constructed as a Gaussian PDF with mean and covariance matrix that of the best-fit and uncertainty of the proper motion.
5.1 Star-Galaxy Separation
Our model for proper motions assumes the source in question is a star – objects orbiting the Galactic center in some fashion. However, for an all-sky catalogue cross-match we will also, at high Galactic latitudes, be matching a considerable number of galaxies. We therefore need to model the two cases. First, that the sources being matched are stars, and hence have the statistically modelled unknown proper motion distribution, with which we wish to ‘blur’ out our potential match separations. Second, they are galaxies, which have zero proper motion, being altogether too distant to have visibly moved anywhere. We therefore have a slightly different probability of match (sources being ‘counterparts’, under hypothesis ) given separation , now also conditioned on the ‘type of source’ hypothesis, which we will denote as and for a ‘star’ and ‘galaxy’ pairing respectively.
When matching, we are generally only concerned with the overall probability of the two sources having a given sky separation under the hypothesis of their being matched, – this term is denoted by Wilson & Naylor (2018a). Note that this differs from , the probability of the two sources being counterparts given their sky separation, Wilson & Naylor (2018a)’s . we can obtain by the marginalisation over the two hypotheses:
(39) |
where is the prior probability that these counterparts (with given sky positions, brightnesses, etc.) are stars (or galaxies, in the opposite case). We work under the assumption there is no third type of object – crudely labelling objects as ‘in the Milky Way’ or ‘outside the Milky Way’ – and thus .
However, we can also ask a related but separate question: ‘what is the probability that these two detections are of a star, given that they are counterparts with a given separation?’, which looks like
(40) |
Here we have the likelihood of the separation given the hypothesis that the sources are counterparts and stars, multiplied by the prior chance of the sources being stars given they are counterparts, normalised by the overall chance of either a galaxy or star pair having this particular detection offset. To calculate both and we therefore need both prior and likelihood terms.
Calculating the likelihood terms and is relatively straightforward, simply being the convolution of the respective AUFs (containing all relevant AUF components for the two catalogues) of the sources in question. For this does not include any proper motion terms, as the ‘proper motion model’ for galaxies is a static one – mathematically, this is equivalent to the convolution of and a delta function at zero proper motion, with – and hence . For , however, we wish to include the motion of Galactic sources, and hence subsequently convolve by the PDF, describing the potential additional on-sky movement due to the epoch difference between the two sets of observations; .
Thus, the likelihood for our new question is easy to calculate; we are therefore left with the derivation of the prior, . The ‘conditioned on the fact that the sources are counterparts’ aspect of the prior is tricky to implement in practice. We wish to know, analogous to Wilson & Naylor (2018a)’s derivation of photometric likelihoods, the distribution of stars and galaxies as a function of the two bandpasses in question – e.g. and , for a match between optical and infrared data. Thus, is really ‘what is the probability that these two sources are stars given that they are counterparts with magnitude limits (or dynamic ranges) in their respective bandpasses?’, . Due to the nature of the simulated objects – being derived from one-sided distributions, a function of just a single magnitude in one bandpass in one of the two catalogues – we are unable to create two-dimensional relationships between stars and galaxies in the construction of these priors. In fact, our likelihoods, , should implicitly assume counterparts for sources, but are built from the full distribution of sources of just a single magnitude. Here we could have, for example, a case where sources of either have optical brightnesses or (being two classes of objects at differing distances, say); this distance distribution is blurred into a bimodal proper motion distribution in the IR, but one class of object is rejected if we consider the dynamic range of the optical data for an example .
At present, the explicit dependency on the two-sided, magnitude-magnitude relationship between sources in our two catalogues is beyond the scope of this work, due to the nature of the outputs available from most Galactic simulations being limited to a particular set of bandpasses for a specific catalogue. We therefore simply note here that for now, the construction of these models is one-sided – in contrast to the cross-matching algorithms of Wilson & Naylor (2018a), taking into account both catalogues symmetrically, in both AUF-based astrometry and photometry. We thus sidestep this dependency by constructing our priors on star and galaxy counts on single magnitude source counts, effectively creating and , removing the dependency on within the priors. We can still, however, account for the dynamic range of each bandpass within its given catalogue on a per-filter basis, and hence implicitly use in a practical implementation.
With this minor practical dependency removed, we conclude that with the inclusion of a distribution of unknown proper motions for Galaxy-based stars, it is possible to discriminate between stars and galaxies in photometric catalogues. The equations
(41) |
and
(42) |
allow for the drift of Galactic sources with time, recovering them as non-static sources. This is the most certain question that can be answered; stars, as shown in e.g. Figure 3, can have a very high probability of small proper motions in certain sightlines in the Galaxy. Thus, zero proper motion does not necessarily mean galaxy; but a combination of delta-function likelihood for Galactic proper motion and imbalanced priors at high Galactic latitudes mean that zero proper motion objects will bias towards being extragalactic. On the other hand, if a source has a proper motion distribution which is significantly non-zero, as is the case for Galactic longitude proper motions at , (Figure 8), then we should see a breaking of this degeneracy. The offset between the two sources being considered as potential counterparts should now be able to tell whether the sources are further apart than their respective AUFs would suggest – at which point they are very likely detections of a star – or if they have an offset compatible with their AUFs – at which point they are very likely a galaxy.
5.2 Inclusion of Proper Motions in the Non-Match Hypothesis
We also note that we should also consider the proper motions within the context of non-matches, but it is easy to see that this results in a trivial case, effectively ignoring the proper motions. For the counter hypothesis of ‘these sources are unrelated to one another, and separate detections of two physical sky objects’, each source can have its own proper motion, based on its own statistical distribution of potential motions. In these cases, we need to compare to the hypothesis that these sources are not related to one another given the separation between them. This involves the double, but separate, marginalisation over all possible unknown locations and proper motions, for both objects. Ultimately, as the integrals are separate the proper motions do not affect the end result – see Appendix B.2. This is obvious intuitively: the distribution of separations of unrelated, randomly placed objects is independent of the unknown motion history of those objects.
6 When Are Unknown Proper Motion Distributions Needed?
The theoretical framework for accounting for unknown proper motions presented here is relatively indifferent to the type of surveys being matched and brightnesses at which it is used. However, practically it is more useful in some situations than others. Hence, we summarise here some key surveys, magnitude ranges, and science cases for which the inclusion of statistical proper motions may be most crucial.
The main criterion for considering whether the inclusion of unknown proper motion distributions is important or not is the surveys being matched.
-
•
The model is most useful outside of Gaia dynamic ranges, as such high-precision individual proper motions may be too important to ignore at brighter magnitudes. The main downside here is that Gaia is quite a bright survey relative to the next generation of photometric catalogues, and therefore large numbers of objects won’t be detected in Gaia at all.
-
•
In the case of LSST, it will also offer proper motions down to perhaps (Ivezić et al., 2019) but cannot offer proper motions for objects not detectable in its single-visit images, and thus those objects will have to rely solely on statistical proper motions to avoid risking underestimating match probability or unnecessary false match rates.
-
•
More generally, any science done in the Northern Hemisphere, where LSST has no coverage, will be unable to take advantage of the dataset – for its increased proper motion coverage or otherwise. These cases will more likely require the falling back on unknown proper motions when outside of Gaia or SDSS proper motion dynamic ranges ( and respectively).
-
•
Where proper motions are not important to the science case, and any motion drift is a nuisance parameter, it may also be preferable to avoid relying on matching to an intermediate catalogue that contains proper motions. When trying to match catalogue to catalogue , we may not want to perform separate LSST- and LSST- (or Gaia- and Gaia-, depending on your source of individual proper motions) matches, then join across common LSST (Gaia) objects to obtain a final cross-match. In these cases, where the ability to select high-quality matches using the added-value information from a probabilistic cross-match algorithm is important, reliance on proper motion distributions may suffice to gain in other areas.
-
•
With the key exceptions of CatWISE, albeit with order-of-magnitude larger uncertainties than LSST or Gaia, and, but with much less sky coverage, VVV, most IR surveys are single-epoch, and matching longer wavelength surveys to one another therefore relies far more than optical catalogues on unknown proper motion distributions.
In terms of science cases, the main areas that benefit from including unknown proper motions are those in which proper motions are crucial but lacking by other methods.
-
•
Nearby faint objects, which LSST especially will find significant numbers of, will have appreciable on-sky motions that may not be derived as part of the survey’s dataset construction due to their faint fluxes.
-
•
Red objects will suffer a bias in current- and future-generation surveys such as LSST, Euclid, and Roman where they will systematically be less likely to have measured proper motions.
-
•
Very faint transient progenitors will also suffer from a lack of known proper motions, and potentially may require matching back to a number of long-time-baseline surveys to probe progenitor characteristics.
-
•
For LSST, Galactic Plane science will systematically be affected due to the much lower number of visits currently planned than in the main WFD survey (Bianco et al., 2022). Current simulated LSST precisions (e.g. Ivezić et al., 2019, table 3) assume WFD cadences and hence numbers of observations, but reduced visit count will lead to worse proper motion accuracies and precisions by factors of a few.
Finally, care should be taken when attempting to extrapolate reasonably uncertain, but ‘detected’ proper motions. In these cases it may be more advantageous to not use the best-fit value, but marginalise over all potential proper motions based on the likely more robustly determined position and brightness. Alternatively, the best-fit proper motion can be used, but ‘blurred’ out with the detection’s precision, representing the proper motion offset PDF as a Gaussian with given mean proper motion and one-sigma uncertainty.
7 Conclusion
We described a model of the bulk motion of a random set of sources through the Galaxy. The model uses the rotation curve of the Galaxy, the Solar motion, and a prescription for the random motion of sources due to e.g. their interaction history to create a statistical distribution of potential proper motions of a source at a particular set of sky coordinates and brightness. We compared this model to Gaia sources in various sightlines across the Galactic plane – in the mid-plane and out of plane – in different magnitude regimes, and to the proper motions provided by the Besançon Galactic model, to verify its robustness and accuracy.
Overall we find that our model matches the observed proper motions with a high degree of both accuracy and precision, and hence believe that our model is an acceptable description of the statistical proper motions of sources. This will be invaluable when matching the next generation of deep photometric surveys to other datasets, in the regime where Gaia cannot provide individual proper motions for sources. Without the inclusion of unknown proper motions we could be subject to a source separation bias that will impact the number of cross-matches reported between two such catalogues. This will be particularly crucial in the coming years in light of the revolution in Galactic studies that the Rubin Observatory’s LSST will bring, where – with its long time baseline back to previous brighter infrared surveys – this effect has the potential to dominate a systematic search for classes of sources such as faint, red objects.
We have made a Python version of the model described in this paper available through the macauff GitHub codebase444At this URL..
Acknowledgements
TJW thanks the reviewers for their useful comments and suggestions, which much improved the manuscript. TJW would also like to thank Sergey Koposov for useful conversations and suggestions that improved the accuracy of the model, and Tim Naylor for his helpful discussions and proofreading assistance throughout this work. This work has been supported by STFC funding for UK participation in LSST, through grant ST/S 006117/1. This work has made use of Python (Van Rossum & Drake, 2009), and the SciPy (Virtanen et al., 2020), NumPy (Harris et al., 2020), Astropy (Astropy Collaboration et al., 2013; Astropy Collaboration et al., 2018), astroquery (Ginsburg et al., 2019), Matplotlib (Hunter, 2007), and F2PY (Peterson, 2009) Python modules, as well as NASA’s Astrophysics Data System.
This work has made use of data from the European Space Agency (ESA) mission Gaia (https://www.cosmos.esa.int/gaia), processed by the Gaia Data Processing and Analysis Consortium (DPAC, https://www.cosmos.esa.int/web/gaia/dpac/consortium). Funding for the DPAC has been provided by national institutions, in particular the institutions participating in the Gaia Multilateral Agreement.
Data Availability
The datasets used in this manuscript were derived from sources in the public domain, from the Gaia archive (https://gea.esac.esa.int/archive/), TRILEGAL (http://stev.oapd.inaf.it/cgi-bin/trilegal_1.7), and Besançon (https://model.obs-besancon.fr/modele_home.php).
References
- Amendt & Cuddeford (1991) Amendt P., Cuddeford P., 1991, ApJ, 368, 79
- Astropy Collaboration et al. (2013) Astropy Collaboration et al., 2013, A&A, 558, A33
- Astropy Collaboration et al. (2018) Astropy Collaboration et al., 2018, AJ, 156, 123
- Bianco et al. (2022) Bianco F. B., et al., 2022, ApJS, 258, 1
- Bienaymé et al. (2015) Bienaymé O., Robin A. C., Famaey B., 2015, A&A, 581, A123
- Budavári & Szalay (2008) Budavári T., Szalay A. S., 2008, ApJ, 679, 301
- Czekaj et al. (2014) Czekaj M. A., Robin A. C., Figueras F., Luri X., Haywood M., 2014, A&A, 564, A102
- Eisenhardt et al. (2020) Eisenhardt P. R. M., et al., 2020, ApJS, 247, 69
- Gaia Collaboration et al. (2016) Gaia Collaboration et al., 2016, A&A, 595, A1
- Gaia Collaboration et al. (2021) Gaia Collaboration et al., 2021, A&A, 649, A1
- Ginsburg et al. (2019) Ginsburg A., et al., 2019, AJ, 157, 98
- Girardi et al. (2005) Girardi L., Groenewegen M. A. T., Hatziminaoglou E., da Costa L., 2005, A&A, 436, 895
- Golubov et al. (2013) Golubov O., et al., 2013, A&A, 557, A92
- Green et al. (2012) Green J., et al., 2012, arXiv e-prints, p. arXiv:1208.4012
- Harris et al. (2020) Harris C. R., et al., 2020, Nature, 585, 357
- Hogg (2001) Hogg D. W., 2001, AJ, 121, 1207
- Hunter (2007) Hunter J. D., 2007, Computing in Science & Engineering, 9, 90
- Ivezić et al. (2008) Ivezić Ž., et al., 2008, ApJ, 684, 287
- Ivezić et al. (2019) Ivezić Ž., et al., 2019, ApJ, 873, 111
- Jackson et al. (2002) Jackson T., Ivezić Ž., Knapp G. R., 2002, MNRAS, 337, 749
- Jurić et al. (2008) Jurić M., et al., 2008, ApJ, 673, 864
- Kerekes et al. (2010) Kerekes G., Budavári T., Csabai I., Connolly A. J., Szalay A. S., 2010, ApJ, 719, 59
- King (1983) King I. R., 1983, PASP, 95, 163
- King et al. (2015) King III. C., Brown W. R., Geller M. J., Kenyon S. J., 2015, ApJ, 813, 89
- Laureijs et al. (2011) Laureijs R., et al., 2011, arXiv e-prints, p. arXiv:1110.3193
- Lindegren et al. (2021) Lindegren L., et al., 2021, A&A, 649, A2
- Marocco et al. (2021) Marocco F., et al., 2021, ApJS, 253, 8
- McMahon et al. (2013) McMahon R. G., Banerji M., Gonzalez E., Koposov S. E., Bejar V. J., Lodieu N., Rebolo R., Collaboration V., 2013, The Messenger, 154, 35
- Mróz et al. (2019) Mróz P., et al., 2019, ApJ, 870, L10
- Olling & Dehnen (2003) Olling R. P., Dehnen W., 2003, ApJ, 599, 275
- Oort (1927) Oort J. H., 1927, Bull. Astron. Inst. Netherlands, 3, 275
- Pasetto et al. (2012a) Pasetto S., et al., 2012a, A&A, 547, A70
- Pasetto et al. (2012b) Pasetto S., et al., 2012b, A&A, 547, A71
- Pecaut & Mamajek (2013) Pecaut M. J., Mamajek E. E., 2013, ApJS, 208, 9
- Peterson (2009) Peterson P., 2009, International Journal of Computational Science and Engineering, 4, 296
- Raghavan et al. (2010) Raghavan D., et al., 2010, ApJS, 190, 1
- Robin et al. (2003) Robin A. C., Reylé C., Derrière S., Picaud S., 2003, A&A, 409, 523
- Robin et al. (2012) Robin A. C., Marshall D. J., Schultheis M., Reylé C., 2012, A&A, 538, A106
- Robin et al. (2014) Robin A. C., Reylé C., Fliri J., Czekaj M., Robert C. P., Martins A. M. M., 2014, A&A, 569, A13
- Robin et al. (2017) Robin A. C., Bienaymé O., Fernández-Trincado J. G., Reylé C., 2017, A&A, 605, A1
- Schönrich et al. (2010) Schönrich R., Binney J., Dehnen W., 2010, MNRAS, 403, 1829
- Skrutskie et al. (2006) Skrutskie M. F., et al., 2006, AJ, 131, 1163
- Smith et al. (2018) Smith L. C., et al., 2018, MNRAS, 474, 1826
- Toomre (1964) Toomre A., 1964, ApJ, 139, 1217
- Vallenari et al. (2006) Vallenari A., Pasetto S., Bertelli G., Chiosi C., Spagna A., Lattanzi M., 2006, A&A, 451, 125
- Van Rossum & Drake (2009) Van Rossum G., Drake F. L., 2009, Python 3 Reference Manual. CreateSpace, Scotts Valley, CA
- Virtanen et al. (2020) Virtanen P., et al., 2020, Nature Methods, 17, 261
- Wilson & Naylor (2017) Wilson T. J., Naylor T., 2017, MNRAS, 468, 2517
- Wilson & Naylor (2018a) Wilson T. J., Naylor T., 2018a, MNRAS, 473, 5570
- Wilson & Naylor (2018b) Wilson T. J., Naylor T., 2018b, MNRAS, 481, 2148
- York et al. (2000) York D. G., et al., 2000, AJ, 120, 1579
Appendix A Coordinate Systems
Here we define the coordinate systems we use in this paper, and how to transform from one to another. We use several coordinate systems: Heliocentric Cartesian space (); the observable, Heliocentric Spherical coordinate space (); Heliocentric Cylindrical coordinates (); the Galactocentric Cylindrical coordinate system (); the Galactocentric Spherical coordinate system (); and the Galactocentric Cartesian coordinate system ().
The Heliocentric Cylindrical coordinate system is defined as the radial and tangential velocity components of the in-plane stellar motions, as measured from the Sun in (and orthogonal to) the direction towards the source, as well as the orthogonal, vertical component of the motion. Its transformation from Heliocentric Spherical coordinates is a simple rotation from through the angle to , albeit with the caveat that the direction of rotation varies with the sign of ; its transformation from Galactocentric Cartesian coordinates is a rotation through longitudinal angle .
The Heliocentric Cartesian coordinate system can be obtained from the Heliocentric Spherical coordinates, the observables, distance , and Galactic coordinates and , with
(43) | ||||
(44) | ||||
(45) |
where we have used the ‘right-handed’ system that defines as pointing towards the Galactic center from the Sun, to ; towards ; and towards .
The Galactocentric Cartesian coordinates are a simple shift of zero-point, relative to the Heliocentric coordinates:
(46) | ||||
(47) | ||||
(48) |
with a shift of the origin up by and down in the and directions (e.g. Jurić et al., 2008).
For the Galactocentric non-Cartesian coordinate systems, we have to define new angles, as well as two additional radii. The radii are fairly straightforward, being based simply on the Galactocentric Cartesian coordinates. First, the Galactocentric Cylindrical radius, being defined as the in-plane radius, is given by
(49) |
and the Galactocentric Spherical radius by
(50) |
The angle , used in both Galactocentric Cylindrical and Spherical coordinate systems, is defined as the angle around the Galaxy – if viewed top-down, from the Galactic North Pole – from the line running from the Sun through the Galactic center. This angle, however, is defined as clockwise for the Galactocentric Cylindrical coordinates (and during the derivation of the Heliocentric Spherical proper motions; see Section 2.3), but counter-clockwise for the Galactocentric Spherical coordinate system. Equivalently, this counter-clockwise angle can be considered as being measured in the plane, from the axis towards the axis (or axis, for a clockwise defined ), analagous to how is defined as the angle from the axis towards the axis. Finally, when in Galactocentric Spherical coordinates, we could calculate by
(51) |
where is the co-latitude, the angle as measured from the Cartesian -axis, which differs from the system defining the Galactic latitude , measured from the plane. We will find that we never need to consider or themselves, as they will entirely be used to define rotation. The rotation matrices to convert from Galactocentric Spherical to Galactocentric Cylindrical coordinates, or Galactocentric Cylindrical to Heliocentric Cylindrical coordinates, along with the conversion from Galactocentric Cylindrical to Galactocentric Cartesian coordinates, are derived in Appendix A.1.
A.1 Rotating Covariance Matrices
In this section we briefly outline the transformation, reflection, and rotation matrices used to convert between four coordinate systems: the Galactocentric and Heliocentric Cylindrical, and Galactocentric Cartesian and Spherical frames. First, we need to convert from Galactocentric Cylindrical to Galactocentric Cartesian coordinates, following the rotation curve-based methodology of Mróz et al. (2019). Additionally, to work entirely in Sun-based radial, tangential, and vertical velocity space, we need to rotate the covariance matrices calculated from Pasetto et al., and King et al., in Galactocentric Cylindrical and Spherical coordinates respectively, to space.

A.1.1 Galactocentric Cylindrical to Galactocentric Cartesian Rotation
First we need to calculate the rotation matrix describing the change from Galactocentric Cylindrical to Galactocentric Cartesian coordinates. Starting with Figure 10, we first consider the case of (left-hand schematics), a counter-clockwise rotation from through angle to . As these are left-handed cartesian coordinate systems, this is a negative rotation, and hence the rotation matrix is
(52) |
We therefore need to calculate and . can be derived using the law of sines, and is given by
(53) |
while the cosine can be calculated from its corresponding law,
(54) |
In the case, right-hand side of Figure 10, we now have a clockwise rotation, which in our left-handed coordinate system is a positive rotation,
(55) |
We can, as before, calculate the sine and cosine of :
(56) |
(57) |
We can therefore now see that the changing from positive to negative rotation in , which changes the sign of in the rotation matrix, is correlated with a change of sign of . Thus we can simplify our matrices, giving us
(58) |
Expanding to the full three-dimensions of our problem, we note that the third axis is unchanged by the rotation within the plane of the Galaxy, and therefore the final axis has a trivial transformation, giving
(59) |

A.1.2 Galactocentric Cylindrical to Heliocentric Cylindrical Rotation
Here we calculate the Pasetto et al. rotation from the Galactic center-based cylindrical frame on to one centered on the Sun. Consider the left-hand panel of Figure 11; to rotate from coordinates to is a negative (clockwise) rotation – working in the more traditional right-handed coordinate system – through , as well as a mirroring around the axis (i.e. a flip of the axis on to the axis, after rotation). Hence a rotation-then-mirror transformation matrix would look like
(60) |
As can be seen in Figure 11, , and hence
(61) |
(62) |
In the right-hand case of Figure 11, where , we now have a counter-clockwise, positive rotation from through , but still have a mirror reflection. This simply changes the sign of in the rotation matrix, and hence
(63) |
Again, we can consider the inner triangle of and calculate angles for using :
(64) |
(65) |
Similar to Appendix A.1.1, we can see that no matter the direction of the rotation – i.e. if or – the sign of cancels with the sign within the elements of the transformation matrix, and hence
(66) |
We can also now explicitly include the third axis, the vertical coordinate in our three-dimensional cylindrical reference frame, a trivial continued alignment of the axis with our axis, giving the final transformation matrix as
(67) |

A.1.3 Galactocentric Spherical to Galactocentric Cylindrical Rotation
Finally, we consider the King et al. rotation from a spherical reference frame into a cylindrical one, albeit still centered on the Galactic center. To do this, we consider the frame goes from to ; here, () and () are both in a right-handed cartesian coordinate systems. We therefore define our rotation matrices in the opposite sense to Section A.1.1,
(68) |
The upper case of Figure 12 shows the rotation necessary for , with the left hand side showing the clockwise rotation through , and the right hand side showing a schematic of the various known distances and angles. Here, considering a negative – clockwise in a right-handed frame – rotation through , we can calculate and as
(69) |
where , and
(70) |
For the lower case of Figure 12, , with a positive rotation, , as previously, as the triangle is unchanged, just mirrored. is a little more complicated to derive, however, as the triangle in Figure 12 uses as its modulus value, but it is negative in value. Using explicitly, the law of sines gives
(71) |
as previously. However, if we use, as we will in practice, , we get , and hence .
Once again, we find – as with Appendices A.1.1 and A.1.2 – that the sign of cancels with the sign of the term within the rotation matrices. Thus, for either orientation – positive and negative Galactic latitude – the rotation matrix from Galactocentric spherical to Galactocentric cylindrical coordinates (from the to plane) is given by
(72) |
with still defined consistently as before.
While we are using to represent the two azimuthal angles, they are defined in the opposite sense (see Section A). We therefore need to reflect the axis through the plane, after the rotation has occurred, given by
(73) |
Thus, our full three-dimensional transformation matrix is given by
(74) |
Appendix B Convolution Mathematics for Counterpart and Non-Counterpart Hypotheses
B.1 Counterpart Likelihood Including Proper Motion
In this Appendix we detail the derivation of the inclusion of the proper motion PDF in the hypothesis that two objects are one astrophysical object given their separation. Starting from a similar place to Wilson & Naylor (2018a)’s equation 14, we have
(75) |
Here we have the simultaneous marginalisation over an unknown common position – dropping the prior, for being uniform and independent of unknown position (and proper motion), as per Wilson & Naylor (2018a) – and a marginalisation over the PDF of all unknown proper motions drifts (here representing proper motions in the two orthogonal sky directions with and ). Substituting and into we get
(76) |
Now we change variables from and to and via , . This rearranges such that , , and thus
(77) |
As per Wilson & Naylor (2018a), we note that the inner integral is the definition of a convolution, and thus setting
(78) |
we have
(79) |
Now it is clear that this is itself a convolution, of and , and hence we can now write
(80) |
We note that our equation 75 is of similar form to equation 5 of Kerekes et al. (2010), with the interchange of integrals. Here we have chosen to construct a semi-analytic simulated model for the construction of the distribution of unknown proper motions, while Kerekes et al. built theirs from survey data. However, as discussed in Section 5, we can substitute such a data-driven distribution of proper motions within our matches, using any valid distribution as (or ).
Finally, consistent with Wilson & Naylor (2018a)’s original derivation, we explicitly remind the reader that the AUFs must be defined such that .
B.2 Unrelated Object Likelihood Including Proper Motion
For the case where the sources are unrelated to one another, we have a slightly different equation to that of equation 75; something more like equation 10 of Budavári & Szalay (2008),
(81) |
Here, as with equation 75, we have explicitly assumed that is independent of both unknown position and proper motion, and thus can be removed as a factor from the equation. As and are normalised PDFs, the inner integral is trivially integrable to unity; but with , the PDF of unknown proper motions, also normalised, the outer integral then also evaluates to unity. Thus we have the trivial case, for unrelated objects, that and . In these cases, as with the counterpart hypothesis having a prior as per Wilson & Naylor (2018a), we can say that the equivalent priors in the ‘unrelated’ hypothesis case are , Wilson & Naylor (2018a)’s ‘field’ source density. Hence, for the hypothesis of two sources being unrelated to one another and two detections of different sky objects, the PDF describing the likelihood of the objects having some separation is independent of proper motion, just as it is independent of the respective sources’ AUFs.