This paper was converted on www.awesomepapers.org from LaTeX by an anonymous user.
Want to know more? Visit the Converter page.

Multivariate Survival Mixed Models for Genetic Analysis of Longevity Traits

Rafael Pimentel Maia, Per Madsen and Rodrigo Labouriau

Department of Molecular Biology and Genetics, Aarhus University
Corresponding author. Email:rodrigo.labouriau@agrsci.dk
(March 2013)
Abstract

A class of multivariate mixed survival models for continuous and discrete time with a complex covariance structure is introduced in a context of quantitative genetic applications. The methods introduced can be used in many applications in quantitative genetics although the discussion presented concentrates on longevity studies. The framework presented allows to combine models based on continuous time with models based on discrete time in a joint analysis. The continuous time models are approximations of the frailty model in which the hazard function will be assumed to be piece-wise constant. The discrete time models used are multivariate variants of the discrete relative risk models. These models allow for regular parametric likelihood-based inference by exploring a coincidence of their likelihood functions and the likelihood functions of suitably defined multivariate generalized linear mixed models. The models include a dispersion parameter, which is essential for obtaining a decomposition of the variance of the trait of interest as a sum of parcels representing the additive genetic effects, environmental effects and unspecified sources of variability; as required in quantitative genetic applications. The methods presented are implemented in such a way that large and complex quantitative genetic data can be analyzed.

1 Introduction

Longevity is an important trait often considered in animal breeding programs [31, 30, 33, 37, 27, 35, 17, 9, 6, 32, 1]. Even small changes in the longevity of a population under production might have remarkable economic, welfare and ethics consequences [30, 12]. Since the study of longevity involves several types of incomplete observation (e.g. censoring, truncation, late entry and competing risks), survival and event-history-analysis techniques are typically used [8, 19, 3]. However, the use of those techniques in the context of quantitative genetics of longevity involves several non-trivial challenges. We will present a model framework here that allows to overcome these challenges. These models will have a structure of means and covariances similar to the gaussian linear mixed models classically used in quantitative genetics. They will allow for a proper representation of quantitative genetic phenomena and for efficient implementations required in practice. We will show that these models extend the class of models currently in use for studying the genetic of longevity.

The first challenge in the use of survival models for characterizing the genetic aspects of longevity is the high complexity of the models. Typically it is necessary to adjust simultaneously for the effects of several explanatory variables, some continuous with linear effects (e.g. breed composition and heterosis [21]), some factors with many levels (e.g. herd) or even time-dependent effects (e.g. year and season). Further complexity is added by the necessity of representing complex genetic effects (several generations deep pedigrees) under different genetic models (e.g. sire model, sire-dam-model etc). A typical scenario of applications in quantitative genetics involves a very large number of observations (individuals); indeed often the analyses involve several hundred thousand of observations (we will present two relative small illustrative examples involving 142,133 and 200,084 individuals). This leads to inference problems of the complexity equivalent to solve systems of linear equations with several hundred of thousand, or even several million, simultaneous linear equations (in our examples between 8,248 and 118,432 simultaneous linear equations) when using classic gaussian linear mixed models. Now, the complexity of survival and event-history models is even larger since these models require to keep track of the individuals’ history. Moreover, as it will be apparent from the description of the methods available and from our discussion, some of those models might present very flat likelihood functions making the inference problem hard and numerically unstable. This rules out the naive use of the standard methods of survival analysis and makes the use of specially constructed models and approximations mandatory.

A second challenge is the proper representation of the genetic phenomena in play. The interpretation of the gaussian linear mixed models in genetic terms requires a linear decomposition of the so called total variance (i.e. the phenotypic variance after having corrected for the effects of a range of non-genetic related aspects with known effects on the trait of interest)[18, 34]. This decomposition of the total variance occurs naturally in the gaussian linear mixed models but not in all the adaptations of survival models specially constructed for genetic evaluations of longevity. We will show that a way to circumvent this problem is to consider models containing a dispersion parameter which plays the role of the residual variance (i.e. the part of the total variance that is neither attributed to genetic components nor to identifiable sources of variation) and base the inference on the quasi-likelihood theory [36, 4]. The use of generalised linear mixed models with a dispersion parameter occurs only occasionally in the literature of quantitative genetics [14, 5], and the genetics and the statistics consequences of using a free dispersion parameter has not being systematically explored yet. Moreover, survival models with dispersion parameter were, to the best of our knowledge, never considered in the literature of quantitative genetics.

A third challenge is the presence of incomplete observations following complex patterns. Variants of the so called Cox proportional model [8] were used for univariate traits describing longevity [9, 13, 10]. These techniques succeeded to implement models of approximations that were operational for some of the purposes of animal breeding. However, all those models were of univariate nature (i.e. they consider one trait at time) [30, 11], which makes it difficult, if not impossible, to address some key questions related to the issues of competing risks, informative censoring and inhomogeneity of the failure mechanism. A clear example is the study of time to death were the individuals on the study may die from one among several different causes of death. Moreover, the use of multivariate models is necessary to study the time death in a competing risk scenario, by evaluating the risk of death for each specific cause simultaneously. This allows to form the basis to study further aspects as the presence of common genetic determining factors and/or independent or specific genetic factors for each of the death causes. In the framework presented here, it will be possible to treat these issues by using suitable multivariate models.

Two types of models will be considered: models based on continuous time and models based on discrete time. The continuous time models (CTM) will be suitable approximations of the semi-parametric Cox proportional model in which the hazard function will be assumed to be piece-wise constant. These models allow for regular parametric likelihood-based inference by exploring a coincidence of their likelihood functions and the likelihood function of a Poisson model applied to a specially constructed data [2]. When including gaussian random components (log gaussian frailties) the inference can be based on a Laplace approximation to a high dimensional integral [4, 24, 28]. Here, we will include also a dispersion parameter that will play the role of the residual variance which is an essential element for the genetic interpretation of the models. The CTM will depend on an arbitrary choice of time cut points used to define the intervals at which the hazard function is assumed to be constant.

The discrete time models (DTM) used are multivariate variants of the classic discrete relative risk models [19]. These models present advantages in terms of computational and statistical complexity as compared to the CTM: the algorithms run faster relatively to the analogous algorithm for CTMs, are numerically more stable, and the statistical inference is more efficient. The loss of genetic information occurred when switching from the CTM to the DTM is minimal in typical applications in quantitative genetics and this loss is fairly compensated by the avoidance of capturing a large amount of noise. Here, we will also introduce the use of a dispersion parameter, which will be essential for well representing genetic scenarios.

The aim of this article is to introduce, characterize and discuss a class of multivariate mixed survival models for continuous and discrete time with a complex covariance structure in a context of quantitative genetics applications. The methods introduced here can be used in many other applications in quantitative genetics although the discussion presented concentrates on longevity.

The paper is organized as follows. Section 2 describes the basic set-up and the genetic scenario discussed. There, a suitable multivariate version of the proportional hazard model is introduced in general terms. Those models will encompass models for competing risks possibly defined with different types of time scale (continuous and discrete time). The techniques for statistical inference under those models are presented in section 3, including a general discussion on the calculations involved in the likelihood based inference and some connections with multivariate generalized linear mixed models (section 3.1). A Poisson approximation useful for efficiently implementing likelihood based inference for continuous time models is presented in section 3.2. Section 3.3 presents an extension of the models to a situation where there is a stratification variable. A discussion comparing the amount of statistical information between models constructed with discrete time and models based on continuous time is given in section 3.4. The quantitative genetic theory behind the models considered here requires a special decomposition of the phenotypic variance in terms of the variance of the random components and a scale parameter present in the models. This will be necessary for the calculation of the so called heritability, which is crucial in quantitative genetic applications. Section 4 will discuss methods for that and some technical details involving counting processes and martingale theory are presented in the appendix. Two illustrative examples involving longevity of sows and dairy cattle will be presented in section 5.1 and 5.2 respectively. Some discussion will be given in section 6.

2 The basic set-up and genetic scenario

The class of models we will discuss are thought to be applied in the following general scenario. The life spans of a population of nn individuals are observed. Genetic information (typically in the form of a reasonably deep pedigree or comprehensive genomic data) and the values of kk explanatory variables are available for each individual. The interest lies in modeling the longevity, i.e. the length of the life span or the length of the productive life of the individuals, with particular interest on some forms of genetic determination typically used in quantitative genetics.

The longevity can be operationally measured using a continuous time, by determining the time elapsed between two life events in the life of the individuals (e.g. the time elapsed from the first parity the to the culling of cows under production) or a discrete time, by counting a number of certain events during the life of the individual (e.g. by counting the number of survived parities of cows). We will present two illustrative examples: one involving the longevity of sows and the other studying the longevity of dairy cattle. Many similar examples can be found in the literature with other husbandry animals as ewes [25], salmon [20] among others.

An additional issue that might occur in longevity studies is the presence of competing risks, which arises when the individuals could be culled for one of two or more types of culling. For instance, in the example of dairy cattle longevity, the cows might die or be slaughtered, and the interest is in studying the culling rates for both causes. We assume in this scenario that there are two causes of death or culling, which will be labeled by the index jj. It is straightforward to extend the setup described here to the general case with more than two culling causes or to the case with only one culling type.

The longevity will be characterized by the time development of the rate at which the individuals die or are culled. This is measured differently when using continuous or discrete time as we define below. In order to describe the models we have in mind, consider two random variables: TT representing the time (continuous or discrete) of culling and JJ indicating the cause (or type) of culling. In the case of the continuous time, we define the cause-specific hazard function [19] for the jthj^{\rm th} culling cause (for j=1,2j=1,2) by

λ[j](t)=limΔ0P(tT<t+Δ,J=j|T>t)Δ,t0.\displaystyle\lambda_{[j]}(t)=\lim_{\Delta\downarrow 0}\frac{P(t\leq T<t+\Delta,J=j|T>t)}{\Delta}\;\;\;,\;\forall\,t\geq 0\,.

In contrast, when the time is discrete, we define the cause-specific hazard probability function [19] for the jthj^{\rm th} culling cause (for j=1,2j=1,2) by

λ[j](t)=P(T=t,J=j|Tt) for t=0,1,2,.\displaystyle\lambda_{[j]}(t)=P(T=t,J=j|T\geq t)\mbox{ for }t=0,1,2,\dots\;.

Although these two characterisations of the time development of the culling rate are of different nature, they will essentially play the same rule in the models discussed and will be generically referred simply as the cause-specific hazard function. Note that in the case where only one cause of culling is studied the cause-specific hazard function and the cause-specific hazard probability function defined above coincide with the hazard function and the hazard probability function used in the literature of survival analysis (see [19]).

The models presented below will assume a scenario where there are two causes of culling (indexed by jj). Here, the cause-specific hazard functions (or the hazard probability functions) are specified in terms of kk explanatory variables (the fixed effects) and a set of gaussian random components. Without loss of generality, we consider only two random components for each culling cause: U1\mbox{\bf U}_{1} and U2\mbox{\bf U}_{2} that will represent additive genetic effects (usually determined using information on the pedigree of the animals in play) for cause 11 and 22 respectively and V1\mbox{\bf V}_{1} and V2\mbox{\bf V}_{2}, representing an environment effect (e.g. the effect of herd where an animal is kept) for cause 11 and 22, respectively. The random components related to genetics (i.e. U1\mbox{\bf U}_{1} and U2\mbox{\bf U}_{2}) are independent of the components related to environment (V1\mbox{\bf V}_{1} and V2\mbox{\bf V}_{2}) by construction. This constraint can be relaxed for describing possible interactions between environmental and genetic effects, but we will not pursue this project here. The extension of the present definition to a situation with a different number of random components is straightforward. According to the general model we describe, the vector of cause specific hazard functions of the ithi^{\mbox{th}} individual (for i=1,,ni=1,\dots,n), conditionally on U1=u1\mbox{\bf U}_{1}=\mbox{\bf u}_{1}, U2=u2\mbox{\bf U}_{2}=\mbox{\bf u}_{2}, V1=v1\mbox{\bf V}_{1}=\mbox{\bf v}_{1} and V2=v2\mbox{\bf V}_{2}=\mbox{\bf v}_{2} (for the realizations u1\mbox{\bf u}_{1} , u2\mbox{\bf u}_{2}, v1\mbox{\bf v}_{1} and v2\mbox{\bf v}_{2} of U1\mbox{\bf U}_{1} , U2\mbox{\bf U}_{2}, V2\mbox{\bf V}_{2} and V2\mbox{\bf V}_{2}, respectively), is given by

[λ[1],i(t1|U1,V1)λ[2],i(t2|U2,V2)]=[λ1(t1)exp(X1i(t1)𝜷1+Z1iu1+W1iv1)λ2(t2)exp(X2i(t2)𝜷2+Z2iu2+W2iv2)].\left[\begin{array}[]{c}\lambda_{[1],i}(t_{1}|\mbox{\bf U}_{1},\mbox{\bf V}_{1})\\ \lambda_{[2],i}(t_{2}|\mbox{\bf U}_{2},\mbox{\bf V}_{2})\end{array}\right]=\left[\begin{array}[]{c}\lambda_{1}(t_{1})\exp\left(\mbox{\bf X}_{1i}^{{}^{\prime}}(t_{1})\mbox{\boldmath$\beta$}_{1}+\mbox{\bf Z}_{1i}^{{}^{\prime}}\mbox{\bf u}_{1}+\mbox{\bf W}_{1i}^{{}^{\prime}}\mbox{\bf v}_{1}\right)\\ \lambda_{2}(t_{2})\exp\left(\mbox{\bf X}_{2i}^{{}^{\prime}}(t_{2})\mbox{\boldmath$\beta$}_{2}+\mbox{\bf Z}_{2i}^{{}^{\prime}}\mbox{\bf u}_{2}+\mbox{\bf W}_{2i}^{{}^{\prime}}\mbox{\bf v}_{2}\right)\par\end{array}\right]\;. (1)

Here the times t1t_{1} and t2t_{2} might be continuous or discrete; moreover, t1t_{1} and t2t_{2} are not necessarily of the same type (as in the example of sows longevity considered in section 5.1). Equation (1) holds for tj0t_{j}\geq 0 when tjt_{j} is continuous and for tj=0,1,2,t_{j}=0,1,2,\dots if tjt_{j} is discrete (j=1,2j=1,2). Furthermore, λ1()\lambda_{1}(\cdot) and λ2()\lambda_{2}(\cdot) are baseline hazard functions describing a common time development of the cause specific hazard functions (typically considered as a nuisance parameter), 𝜷1,𝜷2k\mbox{\boldmath$\beta$}_{1},\mbox{\boldmath$\beta$}_{2}\in\mathbb{R}^{k} are (finite dimensional) parameters representing the fixed effects (also viewed as a nuisance parameter), Xi\mbox{\bf X}_{i}, Zji\mbox{\bf Z}_{ji} and Wji\mbox{\bf W}_{ji} are incidence matrices for the fixed, genetic and environment effects for the jthj^{\mbox{th}} cause and the ithi^{\rm th} individual. When the time is continuous λ[j],i()\lambda_{[j],i}(\cdot) in (1) is a hazard function and the marginal model described will correspond to a variant of the Cox proportional hazard model with frailties [19, 3]. If the time is discrete, λ[1],i\lambda_{[1],i} in (1) is a hazard probability function and the marginal model described will be a variant of the discrete relative risk model with frailties [19].

In the case of the models based on continuous time, we assume that the baseline function, λj()\lambda_{j}(\cdot) is piece-wise constant. That is, we assume that there is a set of disjoint intervals, I1,,IKI_{1},\dots,I_{K} covering the positive real line, in which λj()\lambda_{j}(\cdot) is constant. This constraint in the class of possible baseline functions will allow us to connect the models described here with some generalized linear mixed models: Moreover, this will allow us to perform efficient inference with complex data using existent software.

The structure of covariance of the random components is a crucial part of the construction of the models for longevity described since this is the part of the model where the additive genetics and the environment contributions to the cause specific hazard functions are considered. We assume the random components to be multivariate normally distributed, i.e. (U1,U2,V1,V2)𝒩(𝟎,𝚺)(\mbox{\bf U}_{1},\;\mbox{\bf U}_{2},\;\mbox{\bf V}_{1},\;\mbox{\bf V}_{2})^{{}^{\prime}}\sim\mathcal{N}\left({\bf 0},{\bf\Sigma}\right) where

𝚺=[Σ1A𝟎𝟎Σ2I].{\bf\Sigma}=\left[\begin{array}[]{cc}\Sigma_{1}\otimes\mbox{\bf A}&\bf 0\\ \bf 0&\Sigma_{2}\otimes\mbox{\bf I}\end{array}\right]\;. (2)

Here, 𝐈{\bf I} is an identity matrix and 𝐀{\bf A} is the n×nn\times n additive relationship matrix constructed as follows. Each entry of 𝐀{\bf A} represents a pair of individuals in the population. Aii=1A_{ii}=1 for i=1,,ni=1,\dots,n, and Aij=0A_{ij}=0 if the pair of individuals (i,j)(i,j) are not related. In the case were the pair of individuals (i,j)(i,j) are related, we consider the degree of relationship rr given by 1 for relatives of first-degree, 2 for relatives of second-degree, 3 for relatives of third-degree and so on. In that case Aij=(1/2)rA_{ij}=(1/2)^{r}. The additive relationship between two individuals measures the proportion of identical by descent genes expected to be shared by pairs of individuals in the population. The methods introduced here could also be applied to genomic analyses where the relationship matrices are inferred from genomic data.

The covariance structure between the genetic random components is given by

Σ1=[σg.12σg.12σg.12σg.22].\Sigma_{1}=\left[\begin{array}[]{cc}\sigma_{g.1}^{2}&\sigma_{g.12}\\ \sigma_{g.12}&\sigma_{g.2}^{2}\end{array}\right]\;.

In particular the genetic correlation between the two culling causes is given by ρg=σg.12σg.12σg.22\rho_{g}=\frac{\sigma_{g.12}}{\sqrt{\sigma_{g.1}^{2}\sigma_{g.2}^{2}}}. Finally, the covariance structure between the environment random components is given by

Σ2=[σe.12σe.12σe.12σe.22].\Sigma_{2}=\left[\begin{array}[]{cc}\sigma_{e.1}^{2}&\sigma_{e.12}\\ \sigma_{e.12}&\sigma_{e.2}^{2}\end{array}\right]\;.

3 Inference

3.1 Representation of the counting process and connections with generalized linear mixed models

The statistical inference for the longevity models can be made by using the coincidence of the conditional likelihood of those models (conditioned on the frailties) with the conditional likelihood of a generalized linear model applied to a specially designed pseudo data representing an underlying counting process as briefly described below. In the case of the continuous time, the pseudo data is constructed by generating one pseudo observation for each time interval (in which the baseline function is assumed to be constant) observed for each individual. In the case of the discrete time, the pseudo data contains one observation per each unit of time observed for each individual. To facilitate the description we use the term ”observed times” to refer to the observed discrete times or the time intervals related to the observed continuous time. A pseudo response variable was created for each of the culling causes. These variables are such that they take the value 0 when an individual is at risk of being culled for the current reason but was not culled or take the value 1 if the individual was culled for the current reason in that period. This pseudo data describes the groups of individuals at risk at each observed time.

The statistical inference is performed by using a multivariate generalized linear mixed model (MGLMM) applied to the pseudo data. One dimensional versions of the calculations we describe below were given previously in [2] for models without random components and in [15] for mixed models for continuous time models (piece-wise constant baselines). For one-dimensional discrete times models without random components see [19]. Each of the marginal model of this MGLMM corresponds to a culling reason and is defined with a logarithmic link function. The distribution of each marginal model is Bernoulli (or binomial) when the corresponding time is discrete or Poisson when the time is continuous. Furthermore, the marginal models constructed with continuous time include an offset variable with the logarithm of the length of the corresponding time intervals. Additionally, a discrete explanatory variable counting the order of the time period for each individual should be included in the model in order to represent the baseline function. The model should also specify the covariance structure of the random components given in equation (2). Furthermore, each marginal model includes a dispersion parameter ϕj\phi_{j} (known in the literature of generalized linear models as an over-dispersion parameter for binomial and Poisson models), which allowed us to better characterizing the genetic scenario.

The MGLMM described above can be adjusted with any software implementing multivariate generalized linear mixed models, which allows the inclusion of over-dispersion parameters in binomial and Poisson models via quasi-likelihood inference [36, 4]. We used the software DMU version 6.0, release 5.1 [23, 24], which implements multivariate generalized linear mixed models efficiently and facilities to specify the required covariance structure of the random components.

3.2 A Poisson approximation for discrete-time models

The inference for the discrete time models presented here is equivalent to making inference for a Bernoulli model where the response variable is a variable indicating whether a culling event occurred. Here, we present a Poisson approximation that will be useful for performing likelihood-based inference for the discrete time models, specially in the case of very large populations with relatively low occurrence of culling. More precisely, for each time tt (t=0,1.,τt=0,1.\dots,\tau, where τ\tau is the maximum observed time) and for each individual ii (i=0,1,,nti=0,1,\dots,n_{t} where ntn_{t} is the number of individuals at risk in the time tt), we constructed a pseudo observation of a response variable YitY_{it} taking the value 1 if the individual ii died at time tt and 0 otherwise. Exploring a coincidence of the likelihood function, we treated the observations YitY_{it}, for t=0,1.,τt=0,1.\dots,\tau and i=0,1,,nti=0,1,\dots,n_{t}, as independent Bernoulli random variables with P(Yit=1)=pitP(Y_{it}=1)=p_{it}, where pitp_{it} is the hazard probability for the individual ii at the time tt.

The following condition will ensure that the likelihood function of a suitably defined Poisson model will approximate the likelihood function of the Bernoulli models considered here. Suppose that

max1tτp¯t,nt0,\displaystyle\max_{1\leq t\leq\tau}\bar{p}_{t,n_{t}}\rightarrow 0\,\,, (3)

where p¯t,nt=max1intpit\bar{p}_{t,n_{t}}=\max_{1\leq i\leq n_{t}}p_{it}, and

i=1ntpit=γt (fixed)  for all t as min1tτnt.\displaystyle\sum_{i=1}^{n_{t}}p_{it}=\gamma_{t}\mbox{ (fixed) }\mbox{ for all }t\mbox{ as }\min_{1\leq t\leq\tau}n_{t}\rightarrow\infty\,\,. (4)

The general result on convergence for arrays of probabilities presented in [7] implies that, under the conditions (3) and (4), for each time tt and r=0,1,r=0,1,\dots,

limnt0P(Wnt=r)=eγtγtrr!,\lim_{n_{t}\rightarrow 0}P(W_{n_{t}}=r)=\frac{e^{\gamma_{t}}\gamma_{t}^{r}}{r!}\,\,, (5)

where Wnt=i=1ntYitW_{n_{t}}=\sum_{i=1}^{n_{t}}Y_{it}. Note that the right side of the equation (5) is the density probability function of a Poisson random variable with expected value equal to γt\gamma_{t}. In other words, if the number of individuals at risk in each time tt (i.e. ntn_{t}) is larger enough and the probability of death in each time tt is small enough, then the likelihood function of the Bernoulli model is approximated by the likelihood function of a Poisson model.

Note that the conditions given in (3) and (4) are reasonable in the example presented here, since the number of individuals is of the order of 100 thousands at the first observed period and is of the order of 16 thousands at the last observed period. Moreover, for a given individual ii, the pseudo random variables YitY_{it} (t=1,,tit=1,\dots,t_{i}) is a sequence of zeros until time ti1t_{i}-1 and takes the value1 at tit_{i} only if this individual was culled, therefore pitp_{it} will be small in general.

3.3 Continuous models with stratification

The examples of survival models with continuous time presented here required the use of stratification of the baseline function, which is a standard technique of survival analysis. For example, we used the number of days from the first parity to the culling day as one of the characterizations of the longevity of animals (sows or dairy cows), in the two examples presented here. Exploratory analyses of the data used indicated that there were differences in the mortality rates between the different parities and that the form of the baseline functions were not the same for the different parities, i.e. the baseline functions for the different parities were not proportional. A way to circumvent this issue is to use the stratification technique defined here. This type of model is referred in the literature of dairy cattle longevity as the ”lactation basis model” (see [29]).

Define tpit_{p_{i}} as the time of the occurrence of the pthp^{\rm th} parity of the individual ii (i=1,,ni=1,\dots,n and p=1,,Pip=1,\dots,P_{i} where PiP_{i} is the maximum parity observed for the individual ii) and tit_{i}^{*} as the observed time (death or censure) for the ithi^{\rm th} individual. The hazard function for the ithi^{\rm th} individual at the pthp^{\rm th} parity, for i=1,2,,ni=1,2,\dots,n and for p=1,,Pip=1,\dots,P_{i} conditional on the random components U=u\mbox{\bf U}=\mbox{\bf u} and V=v\mbox{\bf V}=\mbox{\bf v} is then

λi,p(t|U,V)=Yi,p(t)λp(t)exp(Xi,p𝜷+Ziu+𝐖iv),\displaystyle\lambda_{i,p}(t|\mbox{\bf U},\mbox{\bf V})=Y_{i,p}(t)\lambda_{p}(t)\exp\left(\mbox{\bf X}_{i,p}\mbox{\boldmath$\beta$}+\mbox{\bf Z}_{i}\mbox{\bf u}+{\bf W}_{i}\mbox{\bf v}\right),

for t[tpi,t(pi+1))t\in[t_{p_{i}},t_{\left({p_{i}+1}\right)}) when p<Pip<P_{i} and for t[tPi,ti)t\in[t_{P_{i}},t_{i}^{*}) when p=Pip=P_{i}. Here λp()\lambda_{p}(\cdot) is the baseline hazard function for the pthp^{\rm th} parity. The variable Yi,p(t)Y_{i,p}(t) is equal to 1 if the individual was at risk at t[tpi,t(pi+1))t\in[t_{p_{i}},t_{\left({p_{i}+1}\right)}) and 0 otherwise. In this study, the time dependent explanatory variables will be a function of pp and then Xi,p(t)=Xi,pX_{i,p}(t)=X_{i,p} for all t>0t>0.

3.4 Comparison of the statistical information between discrete and continuous time models

When applying the longevity models described above it is often possible to choose between models defined with continuous time and models defined with discrete time. For instance, in the examples studied in section 5 the longevity can be characterized by the time between the first parity and the culling (continuous time) using a stratification by parity or, alternatively, by the number of survived parities (discrete time). The complexity and the statistical stability of these two types of models differ, which is an important aspect to take into account when deciding which type of model to use. We will argue next that the likelihood function of a continuous time model is typically much flatter than the likelihood function of a corresponding discrete time model. This explains certain anomalies in the inference under continuous time models.

In order to simplify the exposition, we assume a scenario where two models are considered: a discrete time model where the number of survived parities is modeled and a continuous time model where the number of survived days is modeled but there is a stratification by parity (as described in section 3.3). Moreover, we restrict the discussion to the case where there is only one cause of culling and there is only one random component, say U, in the model. Here, U will be a multivariate normal random variable with E(U)=𝟎E(\mbox{\bf U})={\bf 0}, Var(U)=Aσ2Var(\mbox{\bf U})=\mbox{\bf A}\sigma^{2}, where A is a known matrix. We denote the density function of the distribution of U by Φ(,σ2)\Phi\left(\cdot,\sigma^{2}\right) and represent the multiple integral for integration with respect to this density function by a single integration sign.

The likelihood function of the piece-wise constant hazard model stratified by parity based on the number of survival days is

i,p,kexp{Δipkexp(ηipk)}{Δipkexp(ηipk)}yipkΦ(u,σ2)du,\displaystyle\int\prod_{i,p,k}\exp\left\{-\Delta_{ipk}\exp\left(\eta_{ipk}\right)\right\}\left\{\Delta_{ipk}\exp\left(\eta_{ipk}\right)\right\}^{y_{ipk}}\Phi\left(\mbox{\bf u},\sigma^{2}\right)d\mbox{\bf u}\,\,, (6)

where the indices i,pi,p and kk indexes the individual, the parity and the time intervals in each periods, respectively. Here, yipky_{ipk} is a indicator variable taking the value 1 if the ithi^{\rm th} individual died at the pthp^{\rm th} parity in the kthk^{\rm th} time interval and 0 otherwise; Δipk\Delta_{ipk} is the length of the kthk^{\rm th} time interval at the pthp^{\rm th} parity; and ηipk=log(λpk)+Xipk𝜷+Ziu\eta_{ipk}=\log(\lambda_{pk})+\mbox{\bf X}_{ipk}^{{}^{\prime}}\mbox{\boldmath$\beta$}+\mbox{\bf Z}_{i}^{{}^{\prime}}\mbox{\bf u} is the linear predictor.

On the other hand, by the Poisson approximation discussed in section 3.3, the likelihood function of the discrete relative risk model based on the number of survived parities is approximated by

i,pexp{exp(ηip)}{exp(ηip)}yipΦ(u,σ2)du,\displaystyle\int\prod_{i,p}\exp\left\{-\exp\left(\eta_{ip}\right)\right\}\left\{\exp\left(\eta_{ip}\right)\right\}^{y_{ip}}\Phi\left(\mbox{\bf u},\sigma^{2}\right)d\mbox{\bf u}\,\,, (7)

where ii and pp indexes the individual and the parity, respectively; yipy_{ip} is the indicator variable that the ithi^{\rm th} individual died at the pthp^{\rm th} parity and ηip=log(λp)+Xip𝜷+Ziu\eta_{ip}=\log(\lambda_{p})+\mbox{\bf X}_{ip}^{{}^{\prime}}\mbox{\boldmath$\beta$}+\mbox{\bf Z}_{i}^{{}^{\prime}}\mbox{\bf u} is the linear predictor.

Note that, when there are many censured observations and when there are many survived parities or many observed time intervals in each parity, the variables yipky_{ipk} and yipy_{ip} will take the value zero in most of the cases. Therefore, under these conditions, the integrand in (6) will be dominated by

i,p,kexp{Δipkexp(ηipk)}=exp{i,p,kΔipkexp(ηipk)}\displaystyle\prod_{i,p,k}\exp\left\{-\Delta_{ipk}\exp\left(\eta_{ipk}\right)\right\}=\exp\left\{-\sum_{i,p,k}\Delta_{ipk}\exp\left(\eta_{ipk}\right)\right\} (8)

and the integrand in (7) will be dominated by

i,pexp{exp(ηip)}=exp{i,pexp(ηip)}.\displaystyle\prod_{i,p}\exp\left\{-\exp\left(\eta_{ip}\right)\right\}=\exp\left\{-\sum_{i,p}\exp\left(\eta_{ip}\right)\right\}\,\,. (9)

Note that the sum in the right side of (8) has typically a larger number of parcels as compared to the sum in the right side of (9). Moreover, the parcels in the sum in the right side of (8) are multiplied by the factors Δipk\Delta_{ipk} which are typically larger than 1. Note, moreover, that if one reduces the size of the intervals used in the piecewise constant hazard model, the factors Δipk\Delta_{ipk} decrease, but the number of parcels in the sum in the right side of (8) increases; on the other hand, if one decreases the number of intervals, the number of parcels decreases, but the factors Δipk\Delta_{ipk} might increase substantially. This makes the likelihood function of the piecewise constant hazard models much flatter, since the likelihood function is positive. More precisely, the curvature of the support curve (i.e. the graph of the logarithm of the likelihood function) near the maximum likelihood estimate will be much smaller for the piecewise constant hazard models. Therefore, the Fisher information will be smaller, and the maximization of the likelihood function will be a much harder problem, for the piecewise constant hazard models as compared to the corresponding discrete relative risk model.

4 Decomposition of the phenotypic variance and heritability

The notion of heritability is crucial in quantitative genetic applications; it measures the magnitude of the detected additive genetic signal relative to the total variance of a trait of interest and is typically used to quantify the potential response to selection. Heritability (in the narrow sense) is defined operationally by the ratio

h2=σg2σP2,h^{2}=\frac{\sigma_{g}^{2}}{\sigma_{P}^{2}}\;, (10)

where σg2\sigma_{g}^{2} is the variance of an unobserved random component representing all the additive genetic variation (termed the genetic variance) and σp2\sigma_{p}^{2} is the variance of the trait of interest (called the phenotypic variance). For details see [22, 18]. In the classic scenario, where gaussian linear mixed models are used, the calculation of the heritability is straightforward because the phenotypic variance can be expressed as the sum of the genetic variance σg2\sigma_{g}^{2} and the variances of the other random components present in the model. However, the calculation of the heritability is much more complicated in the context of survival analysis considered here and are, therefore, developed in full details below. It will be necessary to introduce some details of the counting process behind the models used and to define the trait of interest carefully. Here, we present the main results informally and expose the precise formal definitions and the technical details using the mathematical machinery of counting processes in appendix A. For simplicity of exposition, we discuss only the one-dimensional case were only one cause of culling is present (referred as death) and assume the same model structure presented in section 3 but with dimension one.

Let TT be a non-negative random variable representing the observed survival time and DD be an indicator variable taking the value 1 if a death is observed and 0 otherwise (censure). The random variable TT will take values in +\mathbb{R}_{+} if the time is continuous or in +\mathbb{Z}_{+} (i.e. in {0,1,2,}\{0,1,2,\dots\}) if the time is discrete. We assume that for each time tt a vector X(t)X(t) of explanatory variables (possibly changing with time) is known. Denote by X(t)={X(s):0s<t}\mbox{\bf X}(t)=\{X(s):0\leq s<t\} the trajectory (or path) function until the time just before tt (denoted by tt-). Additionally, we consider two independent gaussian random components, U and V, representing the additive genetic effects and some environmental effects, respectively. Here, we follow the same convention as in section 2, so Var(U)=Aσg2Var(\mbox{\bf U})=\mbox{\bf A}\sigma_{g}^{2} and Var(V)=Iσe2Var(\mbox{\bf V})=\mbox{\bf I}\sigma_{e}^{2}, where A is the relationship matrix and I is an identity matrix with suitable dimensions. The hazard function for the ithi^{\rm th} individual takes then the form

λi(t|U,V)=λ0(t)exp(Xi(t)𝜷+Ziu+Wiv).\lambda_{i}(t|\mbox{\bf U},\mbox{\bf V})=\lambda_{0}(t)\exp\left(\mbox{\bf X}_{i}^{{}^{\prime}}(t)\mbox{\boldmath$\beta$}+\mbox{\bf Z}_{i}^{{}^{\prime}}\mbox{\bf u}+\mbox{\bf W}_{i}^{{}^{\prime}}\mbox{\bf v}\right)\,. (11)

In order to describe the models presented in section 3 properly, we need to introduce two stochastic processes: the death (or event) counting process and the at risk process. To define the death process we consider, for each tt, the random variable N(t)N(t), which indicates whether a death occurred until the time tt, i.e. N(t)=𝟏(Tt,D=1)N(t)=\mathbf{1}(T\leq t,D=1). The stochastic process 𝐍={N(t):t+ or +}\mathbf{N}=\left\{N(t):t\in\mathbb{R}_{+}\mbox{ or }\mathbb{Z}_{+}\right\} is the death counting process. It is convenient to introduce the notation dN(t)dN(t) to denote the increments of the counting process 𝐍\mathbf{N} at each time tt, i.e. dN(t)=N(t)N(t)dN(t)=N(t)-N(t-), where N(t)=limΔ0N(tΔ)N(t-)=\lim_{\Delta\downarrow 0}N(t-\Delta). Furthermore, the at risk process given by 𝐘={Y(t):t+ or +}\mathbf{Y}=\left\{Y(t):t\in\mathbb{R}_{+}\mbox{ or }\mathbb{Z}_{+}\right\}, where, for each time tt, the random variable Y(t)Y(t) takes the value 11 when the individual is at risk at time tt or 0 otherwise.

We will calculate the phenotypic variance and the heritability for two characteristics of interest: the hazard function evaluated at a given time and the accumulated hazard function up to a given time. These two characteristics are associated to the intensity and the cumulative intensity of the counting process of death 𝐍\mathbf{N}. Due to the structure of the models used here (see equation (1) and (11) for instance), the entire hazard function of an individual is multiplied by the factor exp(u)\exp(\mbox{\bf u}), where u is the realization of the genetic random component U for that individual; so, according to this model, when selecting individuals by the predicted values of U (as it is the usual practice in animal breeding), the entire hazard curve is affected and therefore, it is indifferent if one measures the potential response to selection (i.e. the heritability) of the hazard evaluated at a given time-point, say tt, or even of the accumulated hazard up to tt.

In order to study the heritability related to the hazard function evaluated at a given time tt (in +\mathbb{R}_{+} or in +\mathbb{Z}_{+}), we define the conditional random variable

𝒴(t)=dN(t)|Tt,X(t).{\cal{Y}}(t)=dN(t)\,|\,T\geq t,X(t)\,. (12)

Note that E(𝒴(t)|U=u,V=v)=λ(t|U=u,V=v)E\left({\cal{Y}}(t)\,|\,\mbox{\bf U}=\mbox{\bf u},\,\mbox{\bf V}=\mbox{\bf v}\right)=\lambda\left(t\,|\,\mbox{\bf U}=\mbox{\bf u},\,\mbox{\bf V}=\mbox{\bf v}\right), therefore 𝒴(t){\cal{Y}}(t) will be treated as the trait of interest, for which we calculate the phenotypic variance and the heritability. A more precise definition of 𝒴(t){\cal{Y}}(t) using counting processes theory is given in appendix A. There we show, taking advantage of the basic theory of martingales and using a suitable Taylor expansion, that in the continuous time case the variance of 𝒴(t){\cal{Y}}(t) is approximated by

Var[𝒴(t)]Y(t){[λ(t)]2(σg2+σe2)+ϕλ(t)},Var\left[{\cal{Y}}(t)\right]\approx Y(t)\left\{\left[\lambda^{*}(t)\right]^{2}\left(\sigma_{g}^{2}+\sigma_{e}^{2}\right)+\phi\lambda^{*}(t)\right\}\,\,, (13)

where λ(t)\lambda^{*}(t) is the hazard function evaluated at tt with vanishing random components, i.e.

λ(t)=λ(t|U=𝟎,V=𝟎)=λ𝟎(𝐭)exp{X𝐢(𝐭)𝜷}.\lambda^{*}(t)=\lambda(t|\mbox{\bf U}=\bf{0},\mbox{\bf V}=\bf{0})=\lambda_{0}(t)\exp\left\{\mbox{\bf X}_{i}^{{}^{\prime}}(t)\mbox{\boldmath$\beta$}\right\}\,\,. (14)

Note that according to (13) the variance of 𝒴(t){\cal{Y}}(t) is additively decomposed in three components: one depending on σg2\sigma^{2}_{g}, one depending on σe2\sigma^{2}_{e} and one depending on ϕ\phi. This is a situation analogous to the classic gaussian linear mixed models. Here, the component of the variance of 𝒴(t){\cal{Y}}(t) associated to σg2\sigma^{2}_{g}, namely [Y(t)λ(t)]2σg2\left[Y(t)\lambda^{*}(t)\right]^{2}\sigma_{g}^{2} , plays the role of the genetic variance and therefore the heritability for the hazard evaluated at the time tt is given by

hλ(t)2Y(t)σg2σg2+σe2+ϕλ(t).h_{\lambda(t)}^{2}\approx Y(t)\frac{\sigma_{g}^{2}}{\sigma_{g}^{2}+\sigma_{e}^{2}+\frac{\phi}{\lambda^{*}(t)}}\,\,. (15)

Analogous calculations (see appendix A) yield for the discrete time case that the variance of 𝒴(t){\cal{Y}}(t) is approximated by

Var[𝒴(t)]Y(t){[λ(t)]2(σg2+σe2)+ϕλ(t)[1λ(t)]}.Var\left[{\cal{Y}}(t)\right]\approx Y(t)\left\{\left[\lambda^{*}(t)\right]^{2}\left(\sigma_{g}^{2}+\sigma_{e}^{2}\right)+\phi\lambda^{*}(t)[1-\lambda^{*}(t)]\right\}\,\,. (16)

Here, as in the case of the continuous time, the variance of 𝒴(t){\cal{Y}}(t) is additively decomposed in three separate a components depending on σg2\sigma^{2}_{g}, on σe2\sigma^{2}_{e} and on ϕ\phi, respectively. Therefore, the heritability is approximated by

hλ(t)2Y(t)σg2σg2+σe2+ϕλ(t)1λ(t).h_{\lambda(t)}^{2}\approx Y(t)\frac{\sigma_{g}^{2}}{\sigma_{g}^{2}+\sigma_{e}^{2}+\phi\frac{\lambda^{*}(t)}{1-\lambda^{*}(t)}}\,. (17)

Moreover, when a Poisson approximation is used, the approximated heritability takes the form given in (15).

We turn now to the calculation of the heritability of the accumulated hazard function evaluated at a time point tt. In the continuous time case we define the accumulated hazard function, for each t+t\in\mathbb{R}_{+}, by

Λ(t)=0tY(s)λ(s)𝑑s,\Lambda(t)=\int_{0}^{t}Y(s)\lambda(s)ds\,,

and in the discrete time case the accumulated hazard function is given, for each t+t\in\mathbb{Z}_{+}, by

Λ(t)=stY(s)λ(s),\Lambda(t)=\sum_{s\leq t}Y(s)\lambda(s)\,,

where λ()\lambda(\cdot) is the hazard function in play. Furthermore, the conditional random variable

𝒵(t)=N(t)|Tt,X(t){\cal{Z}}(t)=N(t)\,|\,T\geq t,X(t) (18)

is such that E(𝒵(t)|U=u,V=v)=Λ(t|U=u,V=v)E\left({\cal{Z}}(t)\,|\,\mbox{\bf U}=\mbox{\bf u},\,\mbox{\bf V}=\mbox{\bf v}\right)=\Lambda\left(t\,|\,\mbox{\bf U}=\mbox{\bf u},\,\mbox{\bf V}=\mbox{\bf v}\right). Therefore, 𝒵(t){\cal{Z}}(t) will be treated as the trait of interest, for which we calculate the phenotypic variance and the heritability. A more precise definition of 𝒵(t){\cal{Z}}(t) using counting processes theory is given in appendix A. It can be shown (see appendix A) that in the case of the continuous time the variance of 𝒵(){\cal{Z}}(\cdot) evaluated at a given t+t\in\mathbb{R}_{+} is approximated by

Var[𝒵(t)][Λ(t)]2(σg2+σe2)+ϕΛ(t)Var\left[{\cal{Z}}(t)\right]\approx\left[\Lambda^{*}(t)\right]^{2}\left(\sigma_{g}^{2}+\sigma_{e}^{2}\right)+\phi\Lambda^{*}(t) (19)

where Λ(t)=0tY(s)λ(s)𝑑s\Lambda^{*}(t)=\int_{0}^{t}Y(s)\lambda^{*}(s)ds. Therefore, the heritability is approximated by

hΛ(t)2σg2σg2+σe2+ϕ[Λ(t)]1.h_{\Lambda(t)}^{2}\approx\frac{\sigma_{g}^{2}}{\sigma_{g}^{2}+\sigma_{e}^{2}+\phi\left[\Lambda^{*}(t)\right]^{-1}}\,\,. (20)

In the case of the discrete time the variance of 𝒵(){\cal{Z}}(\cdot) evaluated at a given t+t\in\mathbb{Z}_{+} is approximated by

Var[𝒵(t)][Λ(t)]2(σg2+σe2)+ϕγ(t),Var\left[{\cal{Z}}(t)\right]\approx\left[\Lambda^{*}(t)\right]^{2}\left(\sigma_{g}^{2}+\sigma_{e}^{2}\right)+\phi\gamma(t), (21)

where γ(t)=i=0tϕY(t)λ(t)[1λ(t)]\gamma(t)=\sum_{i=0}^{t}{\phi Y(t)\lambda^{*}(t)[1-\lambda^{*}(t)]} and the cumulative hazard is Λ(t)=s=0tY(s)λ(s)\Lambda^{*}(t)=\sum_{s=0}^{t}Y(s){\lambda^{*}(s)} .Then, the heritability is approximated by

hΛ(t)2σg2σg2+σe2+ϕγ(t)[Λ(t)]2.h_{\Lambda(t)}^{2}\approx\frac{\sigma_{g}^{2}}{\sigma_{g}^{2}+\sigma_{e}^{2}+\phi\gamma(t)[\Lambda^{*}(t)]^{-2}}\,\,. (22)

When the Poisson approximation is used the heritability is approximated by the right side of (20).

The calculations above are performed for one individual. We propose that given a population of nn individuals, the phenotypic variances and the heritabilities for the hazard function or the cumulative hazard (evaluated at a time tt) should be calculated using the estimated variance components and an estimated hazard or an estimated cumulative hazard as described below. In the continuous time case, where the PCHM is used, the observed time is split in intervals Ik=[tk,tk+1)I_{k}=[t_{k},t_{k+1}), for k=0,,Kk=0,\dots,K where 0=t0<t1<<tK<tK+1=τ0=t_{0}<t_{1}<\dots<t_{K}<t_{K+1}=\tau, where τ\tau is the largest observed time. Given that U=u^\mbox{\bf U}=\hat{\mbox{\bf u}} and V=v^\mbox{\bf V}=\hat{\mbox{\bf v}}, where u^\hat{\mbox{\bf u}} and v^\hat{\mbox{\bf v}} are the BLUP of the random components, the conditional hazard is defined, for each tIkt\in I_{k}, by

λi(t)=λkexp[Xi,k𝜷+Ziu^+Wiv^]=exp[ηi,k(t)],\displaystyle\lambda_{i}^{*}(t)=\lambda_{k}\exp\left[\mbox{\bf X}_{i,k}^{{}^{\prime}}\mbox{\boldmath$\beta$}+\mbox{\bf Z}_{i}^{{}^{\prime}}\hat{\mbox{\bf u}}+\mbox{\bf W}_{i}^{{}^{\prime}}\hat{\mbox{\bf v}}\right]=\exp\left[\eta_{i,k}(t)\right]\,\,,

where ηi,k(t)=log(λk)+Xi,k𝜷+Ziu^+Wiv^\eta_{i,k}(t)=\log(\lambda_{k})+\mbox{\bf X}_{i,k}^{{}^{\prime}}\mbox{\boldmath$\beta$}+\mbox{\bf Z}_{i}^{{}^{\prime}}\hat{\mbox{\bf u}}+\mbox{\bf W}_{i}^{{}^{\prime}}\hat{\mbox{\bf v}} and Xi,k=Xi(t)\mbox{\bf X}_{i,k}=\mbox{\bf X}_{i}(t) for tIkt\in I_{k}. We obtain η^i,k(t)=log(λk)^+Xi,k𝜷^+Ziu^+Wiv^\hat{\eta}_{i,k}(t)=\widehat{\log(\lambda_{k})}+\mbox{\bf X}_{i,k}^{{}^{\prime}}\hat{\mbox{\boldmath$\beta$}}+\mbox{\bf Z}_{i}^{{}^{\prime}}\hat{\mbox{\bf u}}+\mbox{\bf W}_{i}^{{}^{\prime}}\hat{\mbox{\bf v}} from the adjusted model and then calculate, for each time tIkt\in I_{k},

λ~(t)=λ~k=exp[η¯k],\displaystyle\tilde{\lambda}^{*}(t)=\tilde{\lambda}^{*}_{k}=\exp\left[\bar{\eta}_{k}\right]\,\,,

where η¯k=n1i=1nη^i,k\bar{\eta}_{k}=n^{-1}\sum_{i=1}^{n}{\hat{\eta}_{i,k}}. The cumulative hazard is estimated, for tIkt\in I_{k}, by

Λ~(t)=j=0k1Δjλ~j+(ttk)λ~k,\displaystyle\tilde{\Lambda}^{*}(t)=\sum_{j=0}^{k-1}\Delta_{j}\tilde{\lambda}_{j}^{*}+(t-t_{k})\tilde{\lambda}_{k}^{*}\,\,,

where Δj=tj+1tj\Delta_{j}=t_{j+1}-t_{j} is the length of the interval IjI_{j}.

In the discrete time case the hazard, conditionally that U=u^\mbox{\bf U}=\hat{\mbox{\bf u}} and V=v^\mbox{\bf V}=\hat{\mbox{\bf v}}, is given, for each t+t\in\mathbb{Z}_{+}, by

λi(t)=λtexp[Xi(t)𝜷+Ziu^+Wiv^]=exp[ηi(t)],\displaystyle\lambda_{i}^{*}(t)=\lambda_{t}\exp\left[\mbox{\bf X}_{i}^{{}^{\prime}}(t)\mbox{\boldmath$\beta$}+\mbox{\bf Z}_{i}^{{}^{\prime}}\hat{\mbox{\bf u}}+\mbox{\bf W}_{i}^{{}^{\prime}}\hat{\mbox{\bf v}}\right]=\exp\left[\eta_{i}(t)\right]\,\,,

where ηi(t)=log(λt)+Xi(t)𝜷+Ziu^+Wiv^\eta_{i}(t)=\log(\lambda_{t})+\mbox{\bf X}_{i}^{{}^{\prime}}(t)\mbox{\boldmath$\beta$}+\mbox{\bf Z}_{i}^{{}^{\prime}}\hat{\mbox{\bf u}}+\mbox{\bf W}_{i}^{{}^{\prime}}\hat{\mbox{\bf v}}. We obtain η^i(t)=log(λt)^+Xi(t)𝜷^+Ziu^+Wiv^\hat{\eta}_{i}(t)=\widehat{\log(\lambda_{t})}+\mbox{\bf X}_{i}^{{}^{\prime}}(t)\hat{\mbox{\boldmath$\beta$}}+\mbox{\bf Z}_{i}^{{}^{\prime}}\hat{\mbox{\bf u}}+\mbox{\bf W}_{i}^{{}^{\prime}}\hat{\mbox{\bf v}} from the adjusted model and then calculate for each time tt (t=0,1,2,,t=0,1,2,\dots,)

λ~(t)=exp[η¯(t)],\displaystyle\tilde{\lambda}(t)=\exp\left[\bar{\eta}(t)\right]\,\,,

where η¯(t)=n1i=1nη^i(t)\bar{\eta}(t)=n^{-1}\sum_{i=1}^{n}{\hat{\eta}_{i}(t)}. The cumulative hazard is estimated by Λ~(t)=j=0tλ~(j)\tilde{\Lambda}^{*}(t)=\sum_{j=0}^{t}\tilde{\lambda}^{*}(j). The heritabilities will be estimated at λ~(tm)\tilde{\lambda}^{*}(t_{m}) and Λ~(tm)\tilde{\Lambda}^{*}(t_{m}) where tmt_{m} represents the median survival time, i.e. P(Ttm)=0.5P(T\geq t_{m})=0.5 in the illustrative examples.

5 Two illustrative examples

The methods presented above will be illustrated by two examples: one involving the longevity of sows (section 5.1) and another characterizing the longevity of dairy cattle (section 5.2). In both examples, we will characterize the longevity of female animals in two different ways: first, by the length of the productive life of the animals (sows or cows) measured by the number of days from the first parity to the culling day (ND); second, by the number of survived parities (NP). Models based on continuous time and models based on discrete time were applied to study ND and NP, respectively.

Incomplete observations are present in both examples because some animals were still alive at the end of the study, some animals were moved, sold or exported during the study and due to intentional right truncation. In the study of sow longevity the proportion of censure was relatively low (9.6%9.6\%), while in the study of longevity of cows a much higher proportion of censure was observed (23.5%23.5\%). Furthermore, in the study of longevity of cows it was possible to distinguish two culling causes: slaughter (67.7%67.7\% of the observations) and death (only 8.8%8.8\% of the observations), which characterizes a typical scenario of competing risks. Therefore, it is natural to use bivariate models in this example to model these two culling causes simultaneously. Bivariate models will be used in the example of sows longevity to model ND and NP simultaneously and use that to discuss how much the information of these two characterizations of the longevity overlap.

5.1 Longevity of sows

The data in this example was retrieved from the registers of the Danish Pig Center of 200,084 pure Landrace sows that were giving birth in the years between 1999 and 2010. Only the sows that had the first parity in the comprised period were included in the study. All the models proposed for ND and NP included the following explanatory variables: age at the first parity, year and season at the first parity, litter size (total number of piglets born per parity) and herd year size (total number of sows farrowing per herd per year). The litter size and the herd year size were both time dependent variables. In addition two random components were included: a sire component with pedigree, representing the sire additive genetic effects and a herd-year component representing the environment effects. Since a sire model was used, the additive genetic variance was estimated by multiplying the additive sire variance by four.

The Kaplan-Meyer estimate of the median survived NP was 2 parities (CI95% 2;3) and of the median survived ND was 320 days (95% CI, 319 - 322). The median number of days between two consecutive parities for the sows that did not die in the respective period varied from 152 to 155 days. Thus, the median survived time of 320 days from the first parity is approximately the time necessary for the sow, give it had one parity, have the second and survive until a third parity.

Figure 1 displays the logarithm of the cumulative hazard curves for ND stratified by parity. The curves per parity presented similar behavior, however, they are not parallels indicating a non proportional effect of parity. The dashed lines represents the cut-points of the intervals where the baseline hazard function was assumed to be constant.

Table 1 presents the estimates of the variance components and heritabilities from the piece-wise constant hazard model stratified by parity based on the ND and for two discrete relative risk models based on the NP (an exact model and an approximated model via Poisson approximation). The estimates of variance for the sire and the herd-year components were very similar among the three adjusted models (\sim 0.065 with SE \sim 0.003 for the sire component and \sim 0.220 with SE \sim 0.009 for the herd-year component). Comparing the execution time between the two adjusted discrete models the approximated models was around 72 times faster compared to the time spent to execute the exact model.

A bivariate model describing the ND and the NP traits (using a Poisson approximation for the discrete marginal models) was fitted (see Table 2).

Table 1: Estimated variance components (with asymptotic standard error in parenthesis) and heritabilities for the number of days (ND) and for the number of parities (NP) at the sows longevity study.
Source ND-PCHMa NP-DRRMb NP-DRRMcP{}_{P}^{\rm c}
Sire 0.071 (0.005) 0.066 (0.002) 0.063 (0.003)
Herd-Year 0.217 (0.010) 0.220 (0.005) 0.219 (0.009)
Dispersion 3.089 (0.002) 0.978 (0.002) 0.653 (0.001)
hλ2h_{\lambda}^{2}d - 0.098 0.096
hΛ2h_{\Lambda}^{2}e 0.180 0.161 0.165
Execution timee 48.5 min 8h 28 min 7 min

a PCHM: Piece-wise constant hazard model stratified by parity.

b DRRM: Discrete relative risk model.

c DRRMP: Discrete relative risk model via Poisson approximation.

d Estimated heritability for the hazard (λ\lambda) at the median survival time.

e Estimated heritability for the cumulative hazard (Λ\Lambda) at the median survival time.

f Execution time (Intel i5 processor).

Table 2: Estimated variance components and correlations from the bivariate model based on the number of days (ND) and number of parity (NP) at the sows longevity study.
Source Trait σ2\sigma^{2} (SE) Cor (SE)
Sire ND 0.022 (0.001) 1.000 (0.004)
NP 0.081 (0.004)
Herd-Year ND 0.332 (0.015) 1.000 (0.002)
NP 0.231 (0.010)
Dispersion ND 3.130 (0.002) -
NP 0.657 (0.001)
Refer to caption
Figure 1: Log of cumulative hazard curves for the number of days trait(ND) stratified by parity at the sow’s longevity study. Axis x is presented on the logarithm of days scale. The vertical dashed lines are the cut points for the intervals where the baseline function was assumed to be constant.

5.2 Longevity of dairy cattle

The data analyzed in this example was retrieved from the register of Knowledge Centre for Agriculture of 142,133 Jersey Danish dairy cows that were calving in the period between 1990 to 2006. The explanatory variables (fixed effects) included in the models were: herd year size (number of calving per herd per year), year and season of each parity, as time dependent variables and age at the first parity and a coefficient of general heterosis (defined as a continuous explanatory variables), as time independent variables. Two random components were included in the model, a combination of herd-year-season component representing the environment effects and a sire component with the pedigree representing the genetic effect. In addition, the cows could be culled by one of two possible reasons: death and slaughter.

The Kaplan-Meyer estimate of the overall median NP was 3 parities (95% CI, 3;3) and overall median ND was 826 days (95% CI, 820 - 831). The median number of days between 2 consecutive parities for the cows that did not die in the respective period varied from 361 days to 367 days. Figure 2 displays the stratified cumulative incidence probability curves for ND for the slaughter and the death, respectively. The dashed lines represent the cut points for the intervals where the baseline hazard were assumed to be constant for both specific reasons.

Tables 3 displays the estimates of the variance and covariance components from the competing risk models describing the ND and NP traits. The sire end herd-year-season variances for death rate based on the ND trait were very small, both for the death and the slaughter rate. In contrast, the discrete time model detected significantly larger variances of the random components. The failure of the continuous time models can be explained by the large amount of censure in the data.

Table 3: Estimated variances and covariances components for the number of parities (NP) and the number of days (ND) from a discrete and continuous multivariate competing risk model, respectively, at the dairy cattle longevity study.
NP ND
Source Cause σ2\sigma^{2} (SE) Cov (SE) σ2\sigma^{2} (SE) Cov (SE)
Sire Death 0.102 (0.041) 0.002 0.7×103\times 10^{-3} (0.006) 0.002
Slaughter 0.029 (0.003) (0.004) 0.008 (0.002) (0.003)
HYS a Death 0.458 (0.015) -0.055 0.1×105\times 10^{-5} (0.079) 0.7×107\times 10^{-7}
Slaughter 0.061 (0.002) (0.004) 0.3×106\times 10^{-6} (0.010) (0.021)
ϕj\phi_{j} b Death 0.691 (0.002) - 5.165 (0.005) -
Slaughter 0.710 (0.002) 4.148 (0.004)
hλ2h_{\lambda}^{2}c Death 0.013 -
Slaughter 0.040 -
hΛ2h_{\Lambda}^{2}d Death 0.044 0.2×103\times 10^{-3}
Slaughter 0.108 0.012

a Herd-year-season random component.

b Marginal dispersion parameters.

c Marginal heritabilities for the hazard (λ\lambda) at the median overall survival time.

d Marginal heritabilities for the cumulative hazard (Λ\Lambda) at the median overall survival time.

Refer to caption
Figure 2: Cumulative incidence probability curves for the ND stratified by parity for the cow’s longevity study. The dashed vertical lines are cut points for the intervals were the hazard was assumed constant. PJ(t)=P(Tt,J=j)P_{J}(t)=P(T\leq t,J=j) for J=(Death,Slaughter)J=(Death,Slaughter).

6 Discussion

The several variants of models for studying longevity in quantitative genetics can be described using the following general approach. The models are one-dimensional and describe the conditional hazard function, given the random components, as taking the form

λi(t|U=u,V=v)=λ0(t)exp(Xi(t)𝜷+Ziu+Wiv),\displaystyle\lambda_{i}(t|\mbox{\bf U}=\!\mbox{\bf u},\!\mbox{\bf V}\!=\!\mbox{\bf v})=\lambda_{0}(t)\exp\left(\mbox{\bf X}_{i}^{{}^{\prime}}(t)\mbox{\boldmath$\beta$}+\mbox{\bf Z}_{i}^{{}^{\prime}}\mbox{\bf u}+\mbox{\bf W}_{i}^{{}^{\prime}}\mbox{\bf v}\right)\,,

for tt in +\mathbb{R}_{+} or in +\mathbb{Z}_{+}. The models based on continuous time used in the literature differ essentially in the form of the baseline hazard function λ0()\lambda_{0}(\cdot): the classical Cox model (with frailties) assumes the hazard function to be a smooth function (almost everywhere) imposing in this way almost no restriction on λ0()\lambda_{0}(\cdot) (see [19, 26, 28]); the piece-wise Weibull models (see [9]) assume λ0()\lambda_{0}(\cdot) to be a saw function (i.e. a piecewise linear function); while the piece-wise constant hazard models (as described here) assume λ0()\lambda_{0}(\cdot) to be a step function (i.e. a piece-wise constant function). These models are nested, in the sense that saw functions are smooth almost everywhere, and step functions are particular cases of saw functions. Moreover, smooth functions can be arbitrarily approximated (point-wisely) by saw functions or by step functions. A fourth category of models, which was introduced here, are the piece-wise constant hazard models with free dispersion parameter. These models are an instance of quasi-likelihood based models (see [36, 4]). They contain the traditional piece-wise constant hazard models as a particular case (by setting the dispersion parameter ϕ\phi to be constant equal to 1) and might arbitrarily approximate the piece-wise Weibull models and the Cox frailty models. Although in many practical situations those models yield equivalent representations of the data and produce similar results, this is not always the case for the quantitative genetics applications discussed here.

One of the interesting features of the piece-wise constant hazard model with (free) dispersion parameter presented here is that the phenotypic variance can be approximately decomposed as the sum of parcels representing the additive genetic effects, environmental effects and unspecified sources of variability. This is analogous to the classic decomposition of the phenotypic variance obtained in gaussian linear mixed genetic models. Here, the component of the phenotypic variance involving the dispersion parameter ϕ\phi plays the rule of the residual variance in the classic models. Note that, if we fix the dispersion parameter ϕ\phi, say by setting it equal to 1 as in the piece-wise constant hazard model, it might be that we obtain models that describe the data well and the referred decomposition phenotypic variance would still exists, but this would be equivalent to set the residual variance to be constant, which clearly causes problems in the representation of quantitative genetic phenomena. For instance, in a sire model the genetic variance transmitted by the dam is not captured by the random component representing the sire, therefore, this part of the variability should be represented in the residual variance (i.e. should compose part of the residual variance); but this is not possible to occur if the residual variance is set to be constant. This issue occurs also in the piece-wise Weibull models (see [9]). Furthermore, in the most general case where λ0\lambda_{0} is only assumed to be smooth (the Cox frailty model) it might be argued that λ0\lambda_{0} could be point wisely approximated (almost every where) by a sequence of step functions obtained even from distributions in a model with dispersion parameter, which would have a proper decomposition of the phenotypic variance. However, in this case it would not be possible to identify the dispersion parameter ϕ\phi (as essentially argued in [13]); therefore, one would still have the representation issues referred above.

The piece-wise constant hazard model and the piece-wise Weibull model are parametric models, making it possible to implement relatively efficient inference techniques. This explains why they are implementable for complex and large models as in quantitative genetics typical applications. Moreover, when the baseline hazard function λ0()\lambda_{0}(\cdot) is assumed to be piece-wise linear (a saw function), as in the piece-wise Weilbull models, the rate of approximation of λ0()\lambda_{0}(\cdot) to a smooth function (as in the frailty model) is improved (specially if there are regions where the smooth baseline is steep) as well argued in [9]; however, in this case the inference via generalized linear mixed models would not be possible without using profile likelihood techniques (to estimate the shape parameter), which rules out the direct use of extensions containing a dispersion parameter or multivariate extensions already implemented. Finally, a disadvantage of the piece-wise constant hazard models and the piece-wise Weibull models is that both depend on an arbitrary choice of time cutting points.

Models based on discrete time (i.e. variants of the discrete relative risk models) has been occasionally used in quantitative genetic previously; however, without incorporating a dispersion parameter. These models do not assume any pre-specified form for the baseline hazard function and also not require any arbitrary definition of time cutting points; therefore, they are similar to the Cox frailty models. Due to the coincidence with the Bernoulli models with random components (with or without dispersion parameter), techniques for parameter inference are at hand, allowing for efficient implementations capable to handle complex large problems as illustrated here. Moreover, these models allow to incorporate time-dependent variables (by splitting data with record for each survived time for each individual) both as fixed effects and as random components. The Poisson approximation presented here might represent a substantial save in computational resources and yields essentially the same results as the exact inference, as illustrated in the example of sows longevity presented in section 5.1.

The continuous time models and the discrete time models yielded similar results in the example of sows longevity. However, the continuous time models failed in the example of dairy cattle longevity (section 5.2), which can be explained by the fact that, in this case, both rare events and high frequencies of censored observations are observed. This is in line with the limitations of the continuous time models discussed in section 3.4 and shows that those limitations do occur in practical situations.

The lack of multivariate techniques for analyzing several traits simultaneously has been a serious limitation in the application of survival models in quantitative genetics [30, 11]. This lack not only makes the study of the relation between longevity and other traits impossible, but also limits very much the possibility of performing time-to-event-analysis in the presence of competing risks. Indeed, if there are two competing culling reasons, one might use standard survival models for modeling the rate of occurrence of one of the culling reasons by considering the observations where the other culling reason occurred as censored. However, this naive approach implies in the implicit use of the assumption that the competing culling reasons are independent. The example of dairy cattle longevity presented here illustrates that this assumption might be not reasonable. Indeed, in this example we detected a significant negative correlation between the herd-year-season random components; moreover, a range of fixed effects were found to be significant for both culling reasons, implying that a naive use of marginal models would violate the assumption of absence of informative censoring.

Acknowledgements

Rafael Pimentel Maia was financed by the project ”Svineavl: Developing New Methods for Genetic Selection of Sow Durability” , Ministry of Food, Agriculture and Fisheries of Denmark.

References

  • [1] A. Abdelqader, A.A. Yacoub, and M. Gauly, Factors influencing productive longevity of Awassi and Najdi ewes in intensive production systems at arid regions, Small Ruminant Research, 104 (2012), 37–44.
  • [2] N. Aitkin and D. Clayton, The fitting of exponential and extreme value distributions to complex censored data using GLIMM, Journal of the Royal Statistical Society. Series C (Applied Statistics), 29(2) (1980), pp. 156–163.
  • [3] P.K. Andersen, Ø. Borgan, R.D. Gill and N. Keiding Statistical models based on counting processes Spring Series in Statistics, Springer, 1997.
  • [4] N.E. Breslow, and D.G. Clayton, Approximate inference in generalized linear mixed models, Journal of the American Statistical Association, 88(421) (1993), pp. 9–25.
  • [5] D. Butler, B.E. Cullis, A.R. Gilmour, B.J. Gogel, Analysis of mixed models for S-language Environments: ASReml-R Reference Manual, Queensland DPI, Brisbane, Australia (2004). Available at http://www.vsni.co.uk/resources/doc/asreml-R.pdf.
  • [6] D.Z. Caraviello, Weigel, K. and D. Gianola, Prediction of longevity breeding values for US Holstein sires using survival analysis methodology, Journal of Dairy Science, 87(10) (2004), pp. 3518–-25.
  • [7] L. H. Y. Chen , On the convergence of Poisson Binomial to Poisson Distributions. The Annals of Probability, 2(1) (1974), pp. 178–180.
  • [8] D.R. Cox, Regression Models and Life-Tables. Journal of Statistical Society. Series B (methodologial), 34(2) (1972), pp. 187–220.
  • [9] V. Ducrocq, R. L. Quaas, E.K. Pollak, and G. Casella, Length of Productive Life of Dairy Cows. 1. Justification of a Weibull Model, Journal of Dairy Science, 71(11) (1988), pp. 3061–3070.
  • [10] V. Ducrocq and V.J. Sölkner, The Survival Kit, a Fortran Package for the Analysis of Survival Data proceedings of the 5thth World Congress on Genetics Applied to Livestock Production, Vol. 21, Univeristy of Guelph ontario, Canada, (1994), pp. 51–52.
  • [11] V. Ducrocq, Topics that may deserve further attention in survival analysis applied to dairy cattle breeding: some suggestions, in: Proceedings of Workshop on genetic improvement of functional traits in cattle, Jouy-en-Josas, Interbull Bulletin 21 (1999), pp. 181–189, Swedish University of Agricultural Sciences, Dept. of Anim. Breed. and Genet., Uppsala.
  • [12] L. Engblom, N. Lundeheim, A. Dalin, and K. Andersson, Sow removal in Swedish commercial herds, Livestock Science, 106(1) (2007), 76–86.
  • [13] S.R. Giolo, and C. G.B. Demétrio, A frailty modeling approach for parental effects in animal breeding, Journal of Applied Statistics, 38(3) (2011), 619–629.
  • [14] J.L.L. Guerra Statistical models and genetic evaluation of binomial traits, Ph.D. diss. Program in Animal and Dairy Science, Louisiana State University and Agricultural and Mechanical College, Baton Rouge, (2004).
  • [15] D. Ha and Y. Lee, Estimating frailty models via Poisson hierarchical generalized linear models, Journal of Computational and Graphical Statistics, 12(3) (2003), pp. 663–661.
  • [16] A. Hald, Statistical theory with engineering applications. John Wiley & Sons, Inc., New York, 1952.
  • [17] M. Hoque and J. Hodges, Genetic and phenotypic parameters of lifetime production traits in Holstein cows, Journal of dairy science, 63(11) (1980), pp. 1900–1910.
  • [18] A. Jacquard, Heritability : One Word , Three Concepts, Biometrics, 39(2) (1983), 465–477.
  • [19] J.D. Kalbfleish and R.L. Prentice, The Statistical Analysis of Failure Time Data, 2nd2^{nd} Edition, Wiley series in Prob. and Statisc., John Wiley & Sons, Inc., Hoboken, New Jersey, 2002.
  • [20] R. Labouriau, M. Wetten and P. Madsen. Simultaneous analysis of two challenge tests and body weight in fish: an example of multivariate generalized linear mixed model. In: Book of Abstracts of the 62nd Annual Meeting of the European Federation of Animal Science. Vol. 16 Wageningen Academic Publishers (2011). p. 325–325.
  • [21] N. López-Villalobos, M. Penasa, R.D. Zotto, M. Cassandro, W. Brade, O. Distl, R. Evans, and A. Cromie, A. Calculation of a cow culling merit index including specific heterosis in a multibreed dairy population, Archiv Tierzucht, 53(1) (2010), 9–17.
  • [22] M. Lynch and B. Walsh, Genetics and analysis of quantitative traits. Sinauer, Massachusetts, 1998.
  • [23] P. Madsen and J. Jensen, A Users Guide to DMU: A Package for Analyzing Multivariate Mixed Models, Manual, Faculty of Agricultural Science, University of Aarhus (2010). Available at http://dmu.agrsci.dk/dmuv6_guide.5.0.pdf.
  • [24] P. Madsen, Su, G., R. Labouriau and O.F. Christensen, DMU - A Package for Analyzing Multivariate Mixed Models, In: Proceedings CD - paper 732. Gesellschaft fur Tierzuchtwissenschaften e. V., (2010). Available at http://www.kongressband.de/wcgalp2010/assets/pdf/0732.pdf.
  • [25] R. P. Maia, L. S. Eikje, I. A. Boman, P. Madsen and R. Labouriau. Genetic determination of sheep culling rates: a competing risk analysis. In Preparation (2013).
  • [26] V.S. Pankratz, M. de Andrade, and T.M. Therneau, Random-effects Cox proportional hazards model: general variance components methods for time-to-event data, Genetic Epidemiology, 28(2) (2005), pp. 97–109.
  • [27] A. Ricard, and C. Blouin, Genetic analysis of the longevity of French sport horses in jumping competition, Journal of animal science, 89(10) (2011), 2988–94.
  • [28] S. Ripatti, and J. Palmgren, Estimation of multivariate frailty models using penalized partial likelihood, Biometrics, 56(4) (2000), pp. 1016–22.
  • [29] A.R. Roxstro¨\ddot{o}m, V. Ducrocq, and E. Strandberg, Survival analysis of longevity in dairy cattle on a lactation basis, Genetics Selection Evolution, 35 (2003), pp. 305–318.
  • [30] T. Serenius and K.J. Stalder, Selection for sow longevity, Journal of Animal Science, 84 (2006), pp. 166–171.
  • [31] B.R. Southey and K.A. Leymaster, Discrete time survival analysis of lamb mortality in a terminal sire composite population, Journal of Animal Science, 81 (2003), pp. 1399–1405.
  • [32] B.R. Southey, R.V. Knox, J.F. Connor, J. F., Lowe and B. F. Roskamp, The bioeconomic evaluation of sow longevity and profitability, Journal of Animal Science, 81 (2003), pp. 2915–2922.
  • [33] J. Tarrés, J.P. Bidanel, A. Hofer, and V. Ducrocq, Analysis of longevity and exterior traits on Large White sows in Switzerland, Journal of animal science, 84(11) (2006), 2914–24.
  • [34] P.M. Visscher, W.G. Hill, and N.R. Wray Heritability in the genomics era–concepts and misconceptions Nature reviews. Genetics, 9(4) (2008), 255–66.
  • [35] L.D. Van Vleck ,Stayability Evaluation as a Categorical Trait and by Considering Other Traits, Journal of Dairy Science, 63(7) (1980), pp. 1172–1180, doi:10.3168/jds.S0022-0302(80)83063-3.
  • [36] R.W.M. Wedderburn, Quasi-likelihood functions, generalized linear models, and the Gauss-Newton method, Biometrika 61(3) (1974), pp. 439–447.
  • [37] M.H. Yazdi, P.M. Visscher, V. Ducrocq, V. and R. Thompson, Heritability, reliability of genetic evaluations and response to selection in proportional hazard models, Journal of dairy science, 85(6) (2002), 1563–77.

Appendix A Technical details on the decomposition of the phenotypic variance

Let TT be a non-negative random variable representing the observed survival time and DD be an indicator variable taking the value 1 if a death is observed and 0 otherwise (censure). Denote by X(t)={X(s):0s<t}\mbox{\bf X}(t)=\{X(s):0\leq s<t\} the trajectory function of the known vector of explanatory variables until the time just before tt. Additionally, we consider two independent gaussian random components, U and V, representing the additive genetic effects and some environmental effects, respectively.

We define the death counting process 𝐍={N(t):t+ or +}\mathbf{N}=\left\{N(t):t\in\mathbb{R}_{+}\mbox{ or }\mathbb{Z}_{+}\right\}, where, for each time tt, N(t)=𝟏(Tt,D=1)N(t)=\mathbf{1}(T\leq t,D=1). The increment of the death process at the time tt is given by dN(t)=N(t)N(t)dN(t)=N(t)-N(t-), where N(t)=limΔ0N(tΔ)N(t-)=\lim_{\Delta\downarrow 0}N(t-\Delta). The at risk process is given by 𝐘={Y(t):t+ or +}\mathbf{Y}=\left\{Y(t):t\in\mathbb{R}_{+}\mbox{ or }\mathbb{Z}_{+}\right\}, where, for each time tt, the random variable Y(t)Y(t) takes the value 11 when the individual is at risk at time tt or 0 otherwise.

The death counting process and the at risk process are both adapted to the filtration 𝐅={t:t+ or +}\mathbf{F}=\left\{{\cal{F}}_{t^{-}}:t\in\mathbb{R}_{+}\mbox{ or }\mathbb{Z}_{+}\right\}, where, for each time tt, t=σ{N(s),Y(s),X(s),0<s<t}{\cal{F}}_{t^{-}}=\sigma\left\{N(s),Y(s),X(s),0<s<t\right\} is the σ\sigma-algebra generated by N(),Y(),X()N(\cdot),Y(\cdot),X(\cdot) up to tt- (i.e. up to the time just before tt) . Here, t{\cal{F}}_{t^{-}} represents what is known up to (but not including) time tt.

Conditional on the random components U and V, under the standard independent censoring assumption (see [3, 19]), we have that

P[dN(t)=1|U=u,V=v,t]=Y(t)λ(t|u,v),P\left[dN(t)=1|\mbox{\bf U}=\mbox{\bf u},\mbox{\bf V}=\mbox{\bf v},{\cal{F}}_{t^{-}}\right]=Y(t)\lambda(t|\mbox{\bf u},\mbox{\bf v}), (23)

where λ(t|u,v)=λ0(t)exp[X(t)β+Zu+Wv]\lambda(t|\mbox{\bf u},\mbox{\bf v})=\lambda_{0}(t)\exp\left[X(t)^{{}^{\prime}}\beta+Z\mbox{\bf u}+W\mbox{\bf v}\right] and Y(t)λ(t|u,v)Y(t)\lambda(t|\mbox{\bf u},\mbox{\bf v}) is the intensity associated to the counting process 𝐍\mathbf{N} at time tt. Moreover, the cumulative intensity of 𝐍\mathbf{N} up to time tt is Λ(t|u,v)=0tY(s)λ(s|u,v)𝑑s\Lambda(t|\mbox{\bf u},\mbox{\bf v})=\int_{0}^{t}{Y(s)\lambda(s|\mbox{\bf u},\mbox{\bf v})}ds. Note that 𝚲={Λ(t|u,v):t+ or +}\mathbf{\Lambda}=\{\Lambda(t|\mbox{\bf u},\mbox{\bf v}):t\in\mathbb{R}_{+}\mbox{ or }\mathbb{Z}_{+}\} is predictable with respect to the filtration 𝐅\mathbf{F} . Define, for each time tt,

M(t)=N(t)Λ(t).M(t)=N(t)-\Lambda(t)\,\,. (24)

The process 𝐌={M(t):t+ or +}\mathbf{M}=\{M(t):t\in\mathbb{R}_{+}\mbox{ or }\mathbb{Z}_{+}\} is a martingale. Here, (24) is the Doob-Meyer decomposition of the death counting process where 𝚲\mathbf{\Lambda} is the compensator. Define, for each time tt, the increment of the martingale 𝐌\mathbf{M} by dM(t)=M(t)M(t)dM(t)=M(t)-M(t-), where M(t)=limΔ0M(tΔ)M(t-)=\lim_{\Delta\downarrow 0}M(t-\Delta). Since 𝐌\mathbf{M} is a martingale, E[dM(t)|t]=0E[dM(t)|{\cal{F}}_{t^{-}}]=0 for each time tt, which shows that 𝐌\mathbf{M} plays the role of the residuals of the model. The predictable variation process of the martingale 𝐌\mathbf{M} at the time tt is

M(t)=0tVar[dM(s)|s]\displaystyle\left\langle M\right\rangle(t)=\int_{0}^{t}{Var[dM(s)|{\cal{F}}_{s^{-}}]}

and

dM(t)=Var[dM(t)|t].\displaystyle d\left\langle M\right\rangle(t)=Var[dM(t)|{\cal{F}}_{t^{-}}]\,\,.

Now, we study the decomposition of the phenotypic variance related to the hazard function evaluated at a given time tt. Define the conditional random variable

𝒴(t)=dN(t)|t,{\cal{Y}}(t)=dN(t)|{\cal{F}}_{t^{-}}\,\,, (25)

which is equivalent to 𝒴(t){\cal{Y}}(t) informally defined by (12) in section 4.

Given the random components U and V,

E[𝒴(t)|U,V]=Y(t)λ(t|u,v)E\left[{\cal{Y}}(t)|\mbox{\bf U},\mbox{\bf V}\right]=Y(t)\lambda(t|\mbox{\bf u},\mbox{\bf v}) (26)

and

Var[𝒴(t)|U,V]=ϕVar[dM(t)|U,V,t],Var\left[{\cal{Y}}(t)|\mbox{\bf U},\mbox{\bf V}\right]=\phi Var\left[dM(t)|\mbox{\bf U},\mbox{\bf V},{\cal{F}}_{t^{-}}\right], (27)

where ϕ\phi is the dispersion parameter. Using (26) and (27), the variance of 𝒴(t){\cal{Y}}(t) is given by

Var[𝒴(t)]\displaystyle Var[{\cal{Y}}(t)] =\displaystyle= Var{E[𝒴(t)|U,V]}+E{Var[𝒴(t)|U,V]}\displaystyle Var\left\{E\left[{\cal{Y}}(t)|\mbox{\bf U},\mbox{\bf V}\right]\right\}+E\left\{Var\left[{\cal{Y}}(t)|\mbox{\bf U},\mbox{\bf V}\right]\right\}
=\displaystyle= Var{Y(t)λ(t|U,V)}+E{ϕVar[dM(t)|U,V,t]}.\displaystyle Var\left\{Y(t)\lambda(t|\mbox{\bf U},\mbox{\bf V})\right\}+E\left\{\phi Var[dM(t)|\mbox{\bf U},\mbox{\bf V},{\cal{F}}_{t^{-}}]\right\}\,\,.

A Taylor expansion argument (see [16], page 118) yields

E{Var[𝒴(t)|U,V]}\displaystyle E\left\{Var\left[{\cal{Y}}(t)|\mbox{\bf U},\mbox{\bf V}\right]\right\} \displaystyle\approx Var[Y(t)|U=𝟎,V=𝟎]\displaystyle Var\left[Y(t)\,|\,\mbox{\bf U}={\bf 0},\mbox{\bf V}={\bf 0}\right] (29)
=\displaystyle= ϕVar[dM(t)|U=𝟎,V=𝟎,t].\displaystyle\phi Var\left[dM(t)|\mbox{\bf U}={\bf 0},\mbox{\bf V}={\bf 0},{\cal{F}}_{t^{-}}\right]\,\,.

Moreover, a second order Taylor expansion (see [16], page 118) yields

Var{E[𝒴(t)|U,V]}\displaystyle Var\left\{E\left[{\cal{Y}}(t)|\mbox{\bf U},\mbox{\bf V}\right]\right\} \displaystyle\approx σg2{uE[𝒴(t)|U,V]}(U=𝟎,V=𝟎)2\displaystyle\sigma_{g}^{2}\left\{\frac{\partial}{\partial\mbox{\bf u}}E\left[{\cal{Y}}(t)|\mbox{\bf U},\mbox{\bf V}\right]\right\}_{\left(\mbox{\bf U}={\bf 0},\mbox{\bf V}={\bf 0}\right)}^{2} (30)
+σe2{vE[𝒴(t)|U,V]}(U=𝟎,V=𝟎)2\displaystyle+\sigma_{e}^{2}\left\{\frac{\partial}{\partial\mbox{\bf v}}E\left[{\cal{Y}}(t)|\mbox{\bf U},\mbox{\bf V}\right]\right\}_{\left(\mbox{\bf U}={\bf 0},\mbox{\bf V}={\bf 0}\right)}^{2}
=\displaystyle= [Y(t)λ(t)]2(σg2+σe2),\displaystyle\left[Y(t)\lambda^{*}(t)\right]^{2}\left(\sigma_{g}^{2}+\sigma_{e}^{2}\right)\,\,,

where u and v are realisations of the random components. Moreover, λ(t)=λ(t|U=𝟎,V=𝟎)\lambda^{*}(t)=\lambda(t|\mbox{\bf U}=\bf 0,\mbox{\bf V}=\bf 0).

In the continuous time case, for each t+t\in\mathbb{R}_{+},

Var[dM(t)|U=𝟎,V=𝟎,t]=Y(t)λ(t),\displaystyle Var\left[dM(t)|\mbox{\bf U}={\bf 0},\mbox{\bf V}={\bf 0},{\cal{F}}_{t^{-}}\right]=Y(t)\lambda^{*}(t)\,\,,

(see [19, 3]) and therefore, using (29) and (30) yields

Var[𝒴(t)]Y(t){[λ(t)]2(σg2+σe2)+ϕλ(t)},\displaystyle Var\left[{\cal{Y}}(t)\right]\approx Y(t)\left\{\left[\lambda^{*}(t)\right]^{2}\left(\sigma_{g}^{2}+\sigma_{e}^{2}\right)+\phi\lambda^{*}(t)\right\}\,\,,

which proves the decomposition of the phenotypic variance given in (13).

In the discrete time case, for each t+t\in\mathbb{Z}_{+},

Var[dM(t)|U=𝟎,V=𝟎,t]=Y(t)λ(t)[1λ(t)],\displaystyle Var\left[dM(t)|\mbox{\bf U}={\bf 0},\mbox{\bf V}={\bf 0},{\cal{F}}_{t^{-}}\right]=Y(t)\lambda^{*}(t)\left[1-\lambda^{*}(t)\right]\,\,,

(see [19, 3]) and therefore, using (29) and (30) yields

Var[𝒴(t)]Y(t){[λ(t)]2(σg2+σe2)+ϕλ(t)[1λ(t)]},\displaystyle Var\left[{\cal{Y}}(t)\right]\approx Y(t)\left\{\left[\lambda^{*}(t)\right]^{2}\left(\sigma_{g}^{2}+\sigma_{e}^{2}\right)+\phi\lambda^{*}(t)\left[1-\lambda^{*}(t)\right]\right\}\,\,, (31)

which proves the decomposition of the phenotypic variance given in (16).

For the decomposition of the phenotypic variance related to the cumulative hazard function evaluated at a given time tt we define the conditional random variable

𝒵(t)=N(t)|t.\displaystyle{\cal{Z}}(t)=N(t)|{\cal{F}}_{t^{-}}\,\,.

This is equivalent to conditional random variable 𝒵(t){\cal{Z}}(t) informally defined in (18). Note that,

E[𝒵(t)|U,V]=Λ(t|U,V) and Var[𝒵(t)|U,V]=M(t)|U,V.\displaystyle E\left[{\cal{Z}}(t)|\mbox{\bf U},\mbox{\bf V}\right]=\Lambda(t|\mbox{\bf U},\mbox{\bf V})\mbox{ and }Var\left[{\cal{Z}}(t)|\mbox{\bf U},\mbox{\bf V}\right]=\langle M\rangle(t)|\mbox{\bf U},\mbox{\bf V}\,\,.

The decomposition of the variance of 𝒵(t){\cal{Z}}(t) is obtained by applying an analogous calculation as in the decomposition of the variance of 𝒴(t){\cal{Y}}(t). This yields the equations (19) and (21) for the decomposition of the phenotypic variance for the continuous time and the discrete time cases.