This paper was converted on www.awesomepapers.org from LaTeX by an anonymous user.
Want to know more? Visit the Converter page.

Nonparametric Estimation of Conditional Copula using Smoothed Checkerboard Bernstein Sieves

Lu Lu   and Sujit K. Ghosh
Department of Statistics, North Carolina State University
Corresponding author Email: lulu1210143@gmail.com
Abstract

Conditional copulas are useful tools for modeling the dependence between multiple response variables that may vary with a given set of predictor variables. Conditional dependence measures such as conditional Kendall’s tau and Spearman’s rho that can be expressed as functionals of the conditional copula are often used to evaluate the strength of dependence conditioning on the covariates. In general, semiparametric estimation methods of conditional copulas rely on an assumed parametric copula family where the copula parameter is assumed to be a function of the covariates. The functional relationship can be estimated nonparametrically using different techniques but it is required to choose an appropriate copula model from various candidate families. In this paper, by employing the empirical checkerboard Bernstein copula (ECBC) estimator we propose a fully nonparametric approach for estimating conditional copulas, which doesn’t require any selection of parametric copula models. Closed-form estimates of the conditional dependence measures are derived directly from the proposed ECBC-based conditional copula estimator. We provide the large-sample consistency of the proposed estimator as well as the estimates of conditional dependence measures. The finite-sample performance of the proposed estimator and comparison with semiparametric methods are investigated through simulation studies. An application to real case studies is also provided.


Keywords: empirical checkerboard Bernstein copula (ECBC), conditional dependence measures, covariates

1 Introduction

Copulas have found many applications in the field of finance, insurance, system reliability, etc., owing to its utility in modeling the dependence among variables (see, e.g., Nelsen (2007), Jaworski et al. (2010) and Joe (2014) for details about copulas and their applications). In some situations, the dependence structure between variables can be influenced by a set of covariates and it is thereby of interest to understand how such dependence changes with the values of covariates. For instance, it is well known that the life expectancy at birth of males and females in a country are often highly dependent due to shared economic or environmental factors and it is possible that the strength of dependence relies on these factors. When the covariate is binary or discrete-valued with few levels, one can estimate a copula for each given level of the discrete-valued covariate separately. In constrast, the influence of continuous-value covariate on the dependence structure should be formulated in a functional way, and this is where conditional copulas (Patton (2006a); Patton (2006b)) along with the corresponding conditional versions of dependence measures come into play.

Suppose we are interested in the dependence among the components of a random vector 𝐘=(Y1,Y2,,Yd)\mathbf{Y}=(Y_{1},Y_{2},...,Y_{d}), given covariates 𝐗=(X1,X2,,Xp)\mathbf{X}=(X_{1},X_{2},...,X_{p}). The conditional joint and marginal distribution of 𝐘\mathbf{Y} given 𝐗=𝐱\mathbf{X}=\mathbf{x} can be denoted as

F𝐱(𝐲)F𝐱(y1,y2,yd)=P(Y1y1,Y2y2,,Ydyd|𝐗=𝐱),F_{\mathbf{x}}(\mathbf{y})\equiv F_{\mathbf{x}}(y_{1},y_{2},...y_{d})=P(Y_{1}\leq y_{1},Y_{2}\leq y_{2},...,Y_{d}\leq y_{d}\;|\;\mathbf{X}=\mathbf{x}), (1)

and

Fj𝐱(yj)=P(Yjyj|𝐗=𝐱)j=1,,d.F_{j\mathbf{x}}(y_{j})=P(Y_{j}\leq y_{j}\;|\;\mathbf{X}=\mathbf{x})\;\;j=1,...,d. (2)

If F1𝐱,F2𝐱,,Fd𝐱F_{1\mathbf{x}},F_{2\mathbf{x}},...,F_{d\mathbf{x}} are continuous, then by an extension of the well-known Sklar’s theorem (Sklar (1959)) for conditional distributions (e.g. see Patton (2006b)), there exists a unique copula C𝐱C_{\mathbf{x}} such that

F𝐱(𝐲)=C𝐱(F1𝐱(y1),F2𝐱(y2),,Fd𝐱(yd))yd,yd,F_{\mathbf{x}}(\mathbf{y})=C_{\mathbf{x}}(F_{1\mathbf{x}}(y_{1}),F_{2\mathbf{x}}(y_{2}),...,F_{d\mathbf{x}}(y_{d}))\;\;\forall y\in\mathbb{R}^{d},\forall y\in\mathbb{R}^{d}, (3)

and the function C𝐱C_{\mathbf{x}} is called a conditional copula, which captures the conditional dependence structure of 𝐘\mathbf{Y} given 𝐗=𝐱\mathbf{X}=\mathbf{x}. The focus of this paper is modeling continuous-valued responses and covariates. Thus, in what follows, we assume that the conditional marginal CDFs F1𝐱,j=1,,dF_{1\mathbf{x}},j=1,\ldots,d and the CDFs of each response and covariate are absolutely continuous.

The literature contains a variety of parametric families for modeling copulas. Some commonly used copula families are Archimedean copulas, elliptical copulas, etc.; see Žežula (2009) and Joe (2014), etc. Assuming that the conditional copula belongs to a parametric copula family where the copula parameter is a function of the covariate(s), there has been previous work addressing the estimation of conditional copula in a semiparametric setting. In regard to frequentist methods based on an assumed parametric class, Acar et al. (2011) propose to estimate the functional relationship between the copula parameter and the covariate nonparametrically by using local likelihood approach. But they assume known marginals and the maximization is conducted for a fixed value of the covariate, i.e., With the intention of identifying the entire function between the copula parameter and the covariate, it is necessary to solve the maximization problem for a sufficiently large grid of values within the range of the covariate. Abegaz et al. (2012) extend the work to a more general setting of unknown marginals and apply a two-stage technique that has been widely adopted in copula estimation: in the first stage, the nonparametric estimates of conditional marginals are obtained using kernel-based method and by plugging in theses estimates, the functional link is estimated by maximizing the pseudo log-likelihood in the second stage. As alternative estimation methods for the function relationship, Vatter and Chavez-Demoulin (2015) develop generalized additive models for conditional dependence structures, and Fermanian and Lopez (2018) introduce so-called single-index copulas, etc. In the Bayesian framework, inference for bivariate conditional copula models have been constructed in Craiu and Sabeti (2012), Sabeti et al. (2014) and Levi and Craiu (2018), among others.

However, the misspecification of copula family could lead to severely biased estimation even though a sophisticated and flexible parametric model is employed (e.g. see Geerdens et al. (2018)), so it is required to select an appropriate copula model from a large number of candidate families. In order to do so, many copula selection techniques have been proposed either in either frequentist or Bayesian setting, e.g., Acar et al. (2011) select the copula family based on cross-validated prediction errors, while the deviance information criterion (DIC) is utilized for the choice of copula in Craiu and Sabeti (2012).

Acknowledging the limitations of parametric copula models as mentioned above, fully nonparametric approaches have also been proposed for conditional copula estimation. Gijbels et al. (2011) suggests the empirical estimators for conditional copulas where the weights are smoothed over the covariate space through kernel-based methods. They further derive nonparametric estimates for the conditional dependence measures including conditional Kendall’s tau and conditional Spearman’s rho. Since the bandwidth selection is very crucial for any of the smoothing methods, they also develop an algorithm for selecting the bandwidths. The asymptotic properties of the estimators together with conditional dependence measure estimates are established in Veraverbeke et al. (2011). Gijbels et al. (2012) further consider more complex covariates like multivariate covariates and box-type conditioning events are studied in Derumigny and Fermanian (2020). On the other hand, there has been recent work on Bayesian nonparametric estimation of conditional copula. Leisen et al. (2017) introduce the effect of a covariate to the Bayesian infinite mixture models proposed by Wu et al. (2014). However, large-sample asymptotic properties of the Bayesian models have been almost unexplored and still remains an area of open work.

In this paper, we focus on the nonparametric estimation of conditional copulas and have realized that it can be done in a relatively easy way by employing the empirical checkerboard Bernstein copula (ECBC) estimator. When the covariates are continuous-valued, the main idea of extending the copula models to include covariates is to first estimate the full copula of responses along with covariates and then take partial derivatives to obtain the conditional distribution of responses given the covariates. As a fully nonparametric approach, it is not required to make any selection of the proper copula family, which is a key step in semiparametric methods to avoid the adverse consequence of model misspecification. Compared to the kernel-based empirical estimators, the selection of bandwidths is unnecessary either, making it easy to implement in practice. The proposed ECBC-based conditional copula estimator immediately leads to nonparametric estimates of the conditional dependence measures, which can be expressed in a very neat form under matrix operations. The large-sample consistency of the proposed estimator is also provided in the paper.

2 Models for Conditional Copula

In the following, we focus on the bivariate conditional copula of (Y1,Y2)(Y_{1},Y_{2}) with a single covariate XX for simplicity. Notice that the extension to more than two dimensions and multiple covariates is straightforward.

Suppose we have i.i.d. samples (Yi1,Yi2,Xi),i=1,,n(Y_{i1},Y_{i2},X_{i}),i=1,...,n, where (Yi1,Yi2),i=1,,n(Y_{i1},Y_{i2}),i=1,...,n are i.i.d observations of the random vector (Y1,Y2)(Y_{1},Y_{2}) of which the conditional dependence structure is of our interest. Xi,i=1,,nX_{i},i=1,...,n are i.i.d. observations of the covariate XX. We assume all components of (Y1,Y2,X)(Y_{1},Y_{2},X) are continuous-valued random variables with absolutely continuous marginal distributions and the conditional marginal distributions of Y1Y_{1} and Y2Y_{2} given X=xX=x are also absolutely continuous. The goal is to estimate the conditional copula CxC_{x} from a random sample of i.i.d. observations (Yi1,Yi2,Xi),i=1,,n(Y_{i1},Y_{i2},X_{i}),i=1,...,n.

As suggested by Gijbels et al. (2011), it is often favorable to remove the effect of the covariate on the marginal distributions before estimating CxC_{x}. In order to do that, we can transform the original observations (Yi1,Yi2)(Y_{i1},Y_{i2}) to marginally uniformly distributed (unobserved) samples

(Ui1,Ui2)(F1Xi(Yi1),F2Xi(Yi2)),i=1,,n,(U_{i1},U_{i2})\equiv(F_{1X_{i}}(Y_{i1}),F_{2X_{i}}(Y_{i2})),\;\;i=1,...,n, (4)

which can be estimated by pseudo-observations

(U^i1,U^i2)(F^1Xi(Yi1),F^2Xi(Yi2)),i=1,,n,(\hat{U}_{i1},\hat{U}_{i2})\equiv(\hat{F}_{1X_{i}}(Y_{i1}),\hat{F}_{2X_{i}}(Y_{i2})),\;\;i=1,...,n, (5)

where F^1x\hat{F}_{1x} and F^2x\hat{F}_{2x} are the estimated conditional marginal distributions.

Motivated by Janssen et al. (2016) who apply the empirical Bernstein estimator of bivariate copula derivative to conditional distribution estimation with a single covariate, we are able to use the proposed multivariate copula estimator ECBC to estimate the conditional marginal distributions of Y1Y_{1} and Y2Y_{2} given X=xX=x, respectively. Specifically, for j{1,2}j\in\{1,2\}, we have i.i.d samples (Yij,Xi),i=1,,n(Y_{ij},X_{i}),i=1,...,n and the corresponding pseudo-observations (W^ij,V^i)=(\hat{W}_{ij},\hat{V}_{i})= (FnYj(Yij),FnX(Xi)),i=1,,n(F_{nY_{j}}(Y_{ij}),F_{nX}(X_{i})),i=1,...,n, where FnYjF_{nY_{j}} and FnXF_{nX} are the modified empirical estimation of the (unconditional) marginal distributions FYjF_{Y_{j}} and FXF_{X}, respectively, e.g., FnX(x)=1n+1i=1n𝕀(Xix)F_{nX}(x)=\frac{1}{n+1}\sum_{i=1}^{n}\mathbb{I}(X_{i}\leq x). These pseudo-observations can be then treated as samples from a 22-dimensional copula CjC_{j}, which can be estimated by the ECBC copula estimator as follows

Cj#(wj,v)=h=0gjk=0mjθ~h,k(gjh)wjh(1wj)gjh(mjk)vk(1v)mjk,C^{\#}_{j}(w_{j},v)=\sum_{h=0}^{g_{j}}\sum_{k=0}^{m_{j}}\tilde{\theta}_{h,k}{g_{j}\choose h}w_{j}^{h}(1-w_{j})^{g_{j}-h}{m_{j}\choose k}v^{k}(1-v)^{m_{j}-k}, (6)

where

θ~h,k=Cjn#(hgj,kmj),\tilde{\theta}_{h,k}=C^{\#}_{jn}(\frac{h}{g_{j}},\frac{k}{m_{j}}), (7)

and Cjn#C^{\#}_{jn} is the empirical checkerboard copula. Then the partial derivative Cj(1)C^{(1)}_{j} of CjC_{j} with respect to vv can be estimated by using

Cj#(1)(wj,v)\displaystyle C^{\#(1)}_{j}(w_{j},v) Cj#(wj,v)v\displaystyle\equiv\frac{\partial C^{\#}_{j}(w_{j},v)}{\partial v} (8)
=h=0gjk=0mj1λ~h,k(gjh)wjhj(1wj)gjhmj(mj1k)vk(1v)mjk1,\displaystyle=\sum_{h=0}^{g_{j}}\sum_{k=0}^{m_{j}-1}\tilde{\lambda}_{h,k}{g_{j}\choose h}w_{j}^{h_{j}}(1-w_{j})^{g_{j}-h}m_{j}{m_{j}-1\choose k}v^{k}(1-v)^{m_{j}-k-1},

where

λ~h,k\displaystyle\tilde{\lambda}_{h,k} =θ~h,k+1θ~h,k.\displaystyle=\tilde{\theta}_{h,k+1}-\tilde{\theta}_{h,k}. (9)

Notice that the following relationship holds between the conditional marginal distribution function of YjY_{j} given X=xX=x and the partial derivative Cj(1)(wj,v)C^{(1)}_{j}(w_{j},v)

Fjx(yj)=P(Yjyj|X=x)=Cj(1)(FYj(yj),FX(x)).\displaystyle F_{jx}(y_{j})=P(Y_{j}\leq y_{j}\;|\;X=x)=C^{(1)}_{j}(F_{Y_{j}}(y_{j}),F_{X}(x)). (10)

Thus, we can estimate the conditional marginal distributions using

F^jx(yj)=Cj#(1)(FnYj(yj),FnX(x))\displaystyle\hat{F}_{jx}(y_{j})=C^{\#(1)}_{j}(F_{nY_{j}}(y_{j}),F_{nX}(x)) (11)

for j=1,2j=1,2, and then the corresponding pseudo-observations (U^i1,U^i2),i=1,,n(\hat{U}_{i1},\hat{U}_{i2}),i=1,...,n of the conditional copula CxC_{x} adjusted for the effect of the covariate on the marginal distributions can be estimated as given in (5).

Now we can use the covariate-adjusted pseudo-observations (U^i1,U^i2),i=1,,n(\hat{U}_{i1},\hat{U}_{i2}),i=1,...,n along with the pseudo-observations of the covariate V^i,i=1,,n\hat{V}_{i},i=1,...,n to estimate a 33-dimensional copula C(u1,u2,v)C(u_{1},u_{2},v) again using ECBC and denote it as C#(u1,u2,v)C^{\#}(u_{1},u_{2},v). Similar to (8), it is easy to obtain the partial derivative C#(1)C^{\#(1)} of C#C^{\#} with respect to vv, which is denoted as

C#(1)(u1,u2|v)\displaystyle C^{\#(1)}(u_{1},u_{2}|v) C#(u1,u2,v)v\displaystyle\equiv\frac{\partial C^{\#}(u_{1},u_{2},v)}{\partial v} (12)
=h1=0l1h2=0l2k=0m1γ~h1,h2,km(m1k)vk(1v)mk1s=12(lshs)ushs(1us)lshs,\displaystyle=\sum_{h_{1}=0}^{l_{1}}\sum_{h_{2}=0}^{l_{2}}\sum_{k=0}^{m-1}\tilde{\gamma}_{h_{1},h_{2},k}m{m-1\choose k}v^{k}(1-v)^{m-k-1}\prod_{s=1}^{2}{l_{s}\choose h_{s}}u_{s}^{h_{s}}(1-u_{s})^{l_{s}-h_{s}},

where

γ~h1,h2,k\displaystyle\tilde{\gamma}_{h_{1},h_{2},k} =θ~h1,h2,k+1θ~h1,h2,k.\displaystyle=\tilde{\theta}_{h_{1},h_{2},k+1}-\tilde{\theta}_{h_{1},h_{2},k}. (13)

Notice that we can use C#(1)(u1,u2|FnX(x))C^{\#(1)}(u_{1},u_{2}|F_{nX}(x)) as an estimate of the conditional copula CxC_{x}, however, C#(1)(u1,u2|v)C^{\#(1)}(u_{1},u_{2}|v) is itself a valid bivariate copula for any value of v[0,1]v\in[0,1] only asymptotically. This is because the conditional marginal distributions of C#(1)(u1,u2|v)C^{\#(1)}(u_{1},u_{2}|v) are not necessarily uniform distributions for finite samples. Aiming to obtain a more accurate estimate of the conditional copula for small samples, we consider the conditional marginal distributions of C#(1)(u1,u2|v)C^{\#(1)}(u_{1},u_{2}|v) given as

F1(u1|v)\displaystyle F_{1}(u_{1}|v) C#(1)(u1,1|v)\displaystyle\equiv C^{\#(1)}(u_{1},1|v) (14)
=h1=0l1k=0m1γ~h1,l2,km(m1k)vk(1v)mk1(l1h1)u1h1(1u1)l1h1,\displaystyle=\sum_{h_{1}=0}^{l_{1}}\sum_{k=0}^{m-1}\tilde{\gamma}_{h_{1},l_{2},k}m{m-1\choose k}v^{k}(1-v)^{m-k-1}{l_{1}\choose h_{1}}u_{1}^{h_{1}}(1-u_{1})^{l_{1}-h_{1}},

and

F2(u2|v)\displaystyle F_{2}(u_{2}|v) C#(1)(1,u2|v)\displaystyle\equiv C^{\#(1)}(1,u_{2}|v) (15)
=h2=0l2k=0m1γ~l1,h2,km(m1k)vk(1v)mk1(l2h2)u2h2(1u2)l2h2,\displaystyle=\sum_{h_{2}=0}^{l_{2}}\sum_{k=0}^{m-1}\tilde{\gamma}_{l_{1},h_{2},k}m{m-1\choose k}v^{k}(1-v)^{m-k-1}{l_{2}\choose h_{2}}u_{2}^{h_{2}}(1-u_{2})^{l_{2}-h_{2}},

By using Sklar’s theorem, we are able to obtain a conditional copula estimator which is a genuine copula itself denoted as

C#(u1,u2|v)=C#(1)(F11(u1|v),F21(u2|v)|v),\displaystyle C^{\#}(u_{1},u_{2}|v)=C^{\#(1)}(F_{1}^{-1}(u_{1}|v),F_{2}^{-1}(u_{2}|v)|v), (16)

where F11(u1|v)F_{1}^{-1}(u_{1}|v) and F21(u2|v)F_{2}^{-1}(u_{2}|v) are the inverse functions of F1F_{1} and F2F_{2}, respectively. It is to be noted that C#(u1,u2|v)C^{\#}(u_{1},u_{2}|v) is a valid copula for any value of v[0,1]v\in[0,1], and as a result, the conditional copula CxC_{x} can be estimated by

Cx#(u1,u2)=P(F1x(y1)u1,F2x(y2)u2|X=x)=C#(u1,u2|FnX(x)).\displaystyle C^{\#}_{x}(u_{1},u_{2})=P(F_{1x}(y_{1})\leq u_{1},F_{2x}(y_{2})\leq u_{2}\;|\;X=x)=C^{\#}(u_{1},u_{2}|F_{nX}(x)). (17)

Let ||g||(v)=sup(u1,u2)[0,1]2|g(u1,u2|v)|\displaystyle||g||(v)=\sup_{(u_{1},u_{2})\in[0,1]^{2}}|g(u_{1},u_{2}|v)| denote the conditional supremum norm of a conditional function g(u1,u2|v)g(u_{1},u_{2}|v) defined on the unit square [0,1]2[0,1]^{2} for a fixed vv. We denote the common supremum norm as ||||\displaystyle||\cdot||. The following theorem provides the large-sample consistency of the estimator C#(u1,u2|v)C^{\#}(u_{1},u_{2}|v) for fixed value of 0<v<10<v<1 using the conditional supremum norm.

Theorem 1.

Assume that the underlying trivariate copula C(u1,u2,v)C(u_{1},u_{2},v) is absolutely continuous and conditional copula Cv(u1,u2|v)=C(u1,u2,v)vC_{v}(u_{1},u_{2}|v)=\frac{\partial C(u_{1},u_{2},v)}{\partial v} is Lipschitz continuous on [0,1]3[0,1]^{3}. Then for any fixed 0<v<10<v<1, we have

E(C#Cv(v))a.s.0asn.\displaystyle E(||C^{\#}-C_{v}||(v))\stackrel{{\scriptstyle\text{a.s.}}}{{\rightarrow}}0\;\;as\;\;n\rightarrow\infty.

where the expectation is taken with respect to the empirical prior distribution of l1,l2l_{1},l_{2}, and mm as given for ECBC.

Remark: Following the hierarchical shifted Poisson distributions proposed for ECBC in Lu and Ghosh (2023) , the empirical prior distribution of l1,l2l_{1},l_{2}, and mm are given as

lj|αjPoisson(nαj)+1andαjUnif(13,23)j=1,2,l_{j}|\alpha_{j}\sim Poisson(n^{\alpha_{j}})+1\;\;\mbox{and}\;\;\alpha_{j}\sim Unif\Big{(}\frac{1}{3},\frac{2}{3}\Big{)}\;\;j=1,2,
m|αPoisson(nα)+2andαUnif(13,23).m|\alpha\sim Poisson(n^{\alpha})+2\;\;\mbox{and}\;\;\alpha\sim Unif\Big{(}\frac{1}{3},\frac{2}{3}\Big{)}.\;\;

The choice of the above priors are motivated by the asymptotic theory of empirical checkerboard copula methods Janssen et al. (2014). The use of sample size or more generally data dependent priors have been used extensively in literature (e.g., see Wasserman (2000) and Parrado-Hernández et al. (2012)) and have been shown to produce desirable asymptotic properties of the posterior distributions.

Next, by extending the dependence measures given in Schweizer et al. (1981) to conditional versions, we are able to estimate the conditional dependence measures (e.g. conditional Spearman’s rho, conditional Kendall’s tau, etc.) using the estimator C#(1)(u1,u2|v)C^{\#(1)}(u_{1},u_{2}|v). For instance, the estimate of conditional Kendall’s tau takes the form

τ^(v)=40101C#(1)(u1,u2|v)𝑑C#(1)(u1,u2|v)1,\displaystyle\hat{\tau}(v)=4\int_{0}^{1}\int_{0}^{1}C^{\#(1)}(u_{1},u_{2}|v)dC^{\#(1)}(u_{1},u_{2}|v)-1, (18)

and the estimate of conditional Spearman’s rho is given as

ρ^(v)=120101(C#(1)(u1,u2|v)F1(u1|v)F2(u2|v))𝑑F1(u1|v)𝑑F2(u2|v).\displaystyle\hat{\rho}(v)=12\int_{0}^{1}\int_{0}^{1}\big{(}C^{\#(1)}(u_{1},u_{2}|v)-F_{1}(u_{1}|v)F_{2}(u_{2}|v)\big{)}dF_{1}(u_{1}|v)dF_{2}(u_{2}|v). (19)

Let us denote

ηh1,h2|vmk=0m1γ~h1,h2,k(m1k)vk(1v)mk1,h1=0,,l1,h2=0,,l2.\displaystyle\eta_{h_{1},h_{2}|v}\equiv m\sum_{k=0}^{m-1}\tilde{\gamma}_{h_{1},h_{2},k}{m-1\choose k}v^{k}(1-v)^{m-k-1},\;\;h_{1}=0,...,l_{1},h_{2}=0,...,l_{2}. (20)

Then we can rewrite the estimator C#(1)(u1,u2|v)C^{\#(1)}(u_{1},u_{2}|v) and its conditional marginal distributions as

C#(1)(u1,u2|v)\displaystyle C^{\#(1)}(u_{1},u_{2}|v) =h1=0l1h2=0l2ηh1,h2|vs=12(lshs)ushs(1us)lshs,\displaystyle=\sum_{h_{1}=0}^{l_{1}}\sum_{h_{2}=0}^{l_{2}}\eta_{h_{1},h_{2}|v}\prod_{s=1}^{2}{l_{s}\choose h_{s}}u_{s}^{h_{s}}(1-u_{s})^{l_{s}-h_{s}}, (21)
F1(u1|v)=h1=0l1ηh1,l2|v(l1h1)u1h1(1u1)l1h1,\displaystyle F_{1}(u_{1}|v)=\sum_{h_{1}=0}^{l_{1}}\eta_{h_{1},l_{2}|v}{l_{1}\choose h_{1}}u_{1}^{h_{1}}(1-u_{1})^{l_{1}-h_{1}}, (22)

and

F2(u2|v)=h2=0l2ηl1,h2|v(l2h2)u2h2(1u2)l2h2,\displaystyle F_{2}(u_{2}|v)=\sum_{h_{2}=0}^{l_{2}}\eta_{l_{1},h_{2}|v}{l_{2}\choose h_{2}}u_{2}^{h_{2}}(1-u_{2})^{l_{2}-h_{2}}, (23)

respectively. As a result, a closed-form estimate of conditional Kendall’s tau takes the form

τ^(v)=4h1=0l1h2=0l2g1=0l11g2=0l21ηh1,h2|v(ηg1+1,g2+1|vηg1+1,g2|vηg1,g2+1|v+ηg1,g2|v)\displaystyle\hat{\tau}(v)=4\sum_{h_{1}=0}^{l_{1}}\sum_{h_{2}=0}^{l_{2}}\sum_{g_{1}=0}^{l_{1}-1}\sum_{g_{2}=0}^{l_{2}-1}\eta_{h_{1},h_{2}|v}(\eta_{g_{1}+1,g_{2}+1|v}-\eta_{g_{1}+1,g_{2}|v}-\eta_{g_{1},g_{2}+1|v}+\eta_{g_{1},g_{2}|v}) (24)
s=12ls(lshs)(ls1gs)B(hs+gs+1,2lshsgs)1,\displaystyle\prod_{s=1}^{2}l_{s}{l_{s}\choose h_{s}}{l_{s}-1\choose g_{s}}B(h_{s}+g_{s}+1,2l_{s}-h_{s}-g_{s})-1,

where BB is the beta function. Similarly, we are able to obtain a closed-form estimate of conditional Spearman’s rho as

ρ^(v)=12h1=0l1h2=0l2g1=0l11g2=0l21(ηh1,h2|vηh1,l2|vηl1,h2|v)(ηg1+1,l2|vηg1,l2|v)(ηl1,g2+1|vηl1,g2|v)\displaystyle\hat{\rho}(v)=12\sum_{h_{1}=0}^{l_{1}}\sum_{h_{2}=0}^{l_{2}}\sum_{g_{1}=0}^{l_{1}-1}\sum_{g_{2}=0}^{l_{2}-1}(\eta_{h_{1},h_{2}|v}-\eta_{h_{1},l_{2}|v}\eta_{l_{1},h_{2}|v})(\eta_{g_{1}+1,l_{2}|v}-\eta_{g_{1},l_{2}|v})(\eta_{l_{1},g_{2}+1|v}-\eta_{l_{1},g_{2}|v}) (25)
s=12ls(lshs)(ls1gs)B(hs+gs+1,2lshsgs).\displaystyle\prod_{s=1}^{2}l_{s}{l_{s}\choose h_{s}}{l_{s}-1\choose g_{s}}B(h_{s}+g_{s}+1,2l_{s}-h_{s}-g_{s}).

For the purpose of computing the estimates of conditional dependence measures more efficiently, we apply matrix operations to the tensor products in expressions (24) and (25). For given (h1,h2),h1=1,,l1,h2=1,,l2(h_{1},h_{2}),h_{1}=1,\ldots,l_{1},h_{2}=1,\ldots,l_{2}, let us denote

ah1,g1=l1(l1h1)(l11g1)B(h1+g1+1,2l1h1g1),g1=0,l11.a_{h_{1},g_{1}}=l_{1}{l_{1}\choose h_{1}}{l_{1}-1\choose g_{1}}B(h_{1}+g_{1}+1,2l_{1}-h_{1}-g_{1}),\;\;g_{1}=0,\ldots l_{1}-1. (26)

and

bh2,g2=l2(l2h2)(l21g2)B(h2+g2+1,2l2h2g2),g2=0,l21.b_{h_{2},g_{2}}=l_{2}{l_{2}\choose h_{2}}{l_{2}-1\choose g_{2}}B(h_{2}+g_{2}+1,2l_{2}-h_{2}-g_{2}),\;\;g_{2}=0,\ldots l_{2}-1. (27)

Then we have 𝐚h1=(ah1,0,,ah1,l11)T\mathbf{a}_{h_{1}}=(a_{h_{1},0},\ldots,a_{h_{1},l_{1}-1})^{T} and 𝐛h2=(bh2,0,,bh2,l21)T\mathbf{b}_{h_{2}}=(b_{h_{2},0},\ldots,b_{h_{2},l_{2}-1})^{T}. We also denote a l1×l2l_{1}\times l_{2} matrix 𝐃v=(dg1,g2|v)l1×l2\mathbf{D}_{v}=(d_{g_{1},g_{2}|v})_{l_{1}\times l_{2}} where dg1,g2|v=ηg1+1,g2+1|vηg1+1,g2|vηg1,g2+1|v+ηg1,g2|vd_{g_{1},g_{2}|v}=\eta_{g_{1}+1,g_{2}+1|v}-\eta_{g_{1}+1,g_{2}|v}-\eta_{g_{1},g_{2}+1|v}+\eta_{g_{1},g_{2}|v}. Thus, the estimate of conditional Kendall’s tau given in (29) can be rewritten as

τ^(v)=4h1=1l1h2=1l2ηh1,h2|v𝐚h1T𝐃v𝐛h21.\displaystyle\hat{\tau}(v)=4\sum_{h_{1}=1}^{l_{1}}\sum_{h_{2}=1}^{l_{2}}\eta_{h_{1},h_{2}|v}\mathbf{a}_{h_{1}}^{T}\mathbf{D}_{v}\mathbf{b}_{h_{2}}-1. (28)

Furthermore, we can denote two l1×l2l_{1}\times l_{2} matrices, 𝐇v=(ηh1,h2|v)l1×l2\mathbf{H}_{v}=(\eta_{h_{1},h_{2}|v})_{l_{1}\times l_{2}} and 𝐆v=(𝐚h1T𝐃v𝐛h2)l1×l2\mathbf{G}_{v}=(\mathbf{a}_{h_{1}}^{T}\mathbf{D}_{v}\mathbf{b}_{h_{2}})_{l_{1}\times l_{2}}, an as a result, we have

τ^(v)=4Tr(𝐇vT𝐆v)1.\displaystyle\hat{\tau}(v)=4\text{Tr}(\mathbf{H}_{v}^{T}\mathbf{G}_{v})-1. (29)

Similarly, we are able to rewrite the estimate of conditional Spearman’s rho given in (25). Let us first denote two vectors, 𝐩v=(pg1|v)l1T\mathbf{p}_{v}=(p_{g_{1}|v})_{l_{1}}^{T} where pg1|v=ηg1+1,l2|vηg1,l2|v,g1=0,,l11p_{g_{1}|v}=\eta_{g_{1}+1,l_{2}|v}-\eta_{g_{1},l_{2}|v},g_{1}=0,\ldots,l_{1}-1 and 𝐪v=(qg2|v)l2T\mathbf{q}_{v}=(q_{g_{2}|v})_{l_{2}}^{T} where qg2|v=ηl1,g2+1|vηl1,g2|v,g2=0,,l21q_{g_{2}|v}=\eta_{l_{1},g_{2}+1|v}-\eta_{l_{1},g_{2}|v},g_{2}=0,\ldots,l_{2}-1. Then we have

ρ^(v)=12h1=1l1h2=1l2(ηh1,h2|vηh1,l2|vηl1,h2|v)𝐚h1T(𝐩v𝐪v)𝐛h2.\displaystyle\hat{\rho}(v)=12\sum_{h_{1}=1}^{l_{1}}\sum_{h_{2}=1}^{l_{2}}(\eta_{h_{1},h_{2}|v}-\eta_{h_{1},l_{2}|v}\eta_{l_{1},h_{2}|v})\mathbf{a}_{h_{1}}^{T}(\mathbf{p}_{v}\otimes\mathbf{q}_{v})\mathbf{b}_{h_{2}}. (30)

If we further denote two l1×l2l_{1}\times l_{2} matrices, 𝐑v=(rh1,h2|v)l1×l2\mathbf{R}_{v}=(r_{h_{1},h_{2}|v})_{l_{1}\times l_{2}} where rh1,h2|v=ηh1,h2|vηh1,l2|vηl1,h2|vr_{h_{1},h_{2}|v}=\eta_{h_{1},h_{2}|v}-\eta_{h_{1},l_{2}|v}\eta_{l_{1},h_{2}|v} and 𝐉v=(𝐚h1T(𝐩v𝐪v)𝐛h2)l1×l2\mathbf{J}_{v}=(\mathbf{a}_{h_{1}}^{T}(\mathbf{p}_{v}\otimes\mathbf{q}_{v})\mathbf{b}_{h_{2}})_{l_{1}\times l_{2}}, then we have

ρ^(v)=12Tr(𝐑vT𝐉v)\displaystyle\hat{\rho}(v)=12\text{Tr}(\mathbf{R}_{v}^{T}\mathbf{J}_{v}) (31)

By applying the above matrix operations, we are able to obtain very neat expressions of the estimates of conditional dependence measures and the computational efficiency can be improved significantly.

3 Numerical Illustrations using Simulated Data

We now show the finite-sample performance of the conditional copula estimator Cx#(u1,u2)C^{\#}_{x}(u_{1},u_{2}). Similar to the simulation setup in Acar et al. (2011), data (Ui1,Ui2|Xi),i=1,,n{(U_{i1},U_{i2}|X_{i}),i=1,...,n} are generated from the Clayton copula using the package 𝚌𝚘𝚙𝚞𝚕𝚊\tt copula in 𝚁\tt R under the following models: (Ui1,Ui2)|XiC(u1,u2|θi)(U_{i1},U_{i2})|X_{i}\sim C(u_{1},u_{2}|\theta_{i}), where θi=exp(0.8Xi2)\theta_{i}=\text{exp}(0.8X_{i}-2) and XiUnif(0,3)X_{i}\sim Unif(0,3). The true copula parameter varies from 0.14 to 1.49 with Spearman’s rho ranging from 0.10 to 0.60. The pseudo-observations of the covariate are defined as ViFnX(Xi),i=1,,nV_{i}\equiv F_{nX}(X_{i}),i=1,\ldots,n, where FnX(x)=1n+1i=1n𝕀(Xix)F_{nX}(x)=\frac{1}{n+1}\sum_{i=1}^{n}\mathbb{I}(X_{i}\leq x). N=100N=100 replicates are drawn from the true copula with sample size n=200n=200.

Figure 1 shows the contour plots of the Monte Carlo average of the estimated Cx#(u1,u2)C^{\#}_{x}(u_{1},u_{2}) given x=0.5x=0.5, x=1x=1, x=1.5x=1.5, and x=2x=2, respectively, across 100 Monte Carlo replicates. The contour plots are drawn based on a 15×1515\times 15 equally spaced grid of points in the unit square, meaning that for a given vv we need to find 15+15=3015+15=30 roots. Since F1F_{1} and F2F_{2} are both non-decreasing functions, we can calculate the inverse functions F11(u1|v)F_{1}^{-1}(u_{1}|v) and F21(u2|v)F_{2}^{-1}(u_{2}|v) by applying the function 𝚞𝚗𝚒𝚛𝚘𝚘𝚝\tt uniroot in 𝚁\tt R to equations (LABEL:eq:f1) and (LABEL:eq:f2) for a given value of vv. The true copula parameters are 0.20 (Spearman’s rho equal to 0.09), 0.30 (Spearman’s rho equal to 0.20). 0.45 (Spearman’s rho equal to 0.27), and 0.67 (Spearman’s rho equal to 0.37) for x=0.5x=0.5, x=1x=1, x=1.5x=1.5, and x=2x=2, respectively.

Refer to caption
(a)
Refer to caption
(b)
Refer to caption
(c)
Refer to caption
(d)
Figure 1: The contour plots of the Monte Carlo average of the estimated Cx#(u1,u2)C^{\#}_{x}(u_{1},u_{2}) given x=0.5x=0.5, x=1x=1, x=1.5x=1.5, and x=2x=2, respectively.

It can be observed from the plots that all the estimated contour lines overlap with the true lines at the boundaries, which is a evidence that the conditional copula estimator C#(u1,u2|v)C^{\#}(u_{1},u_{2}|v) is a genuine copula with uniform conditional marginal distributions. Moreover, there is almost no bias between the estimated conditional copula averaged over 100 Monte Carlo samples and the true conditional copula across different values of the covariate, illustrating the proposed ECBC-based method works well in estimating conditional copula.

Then we can plot the conditional Kendall’s tau and conditional Spearman’s rho as given in (29) and (LABEL:eq:rho) as a function of the covariate. The covariate xx ranges from 0 to 3 so we compute the dependence measures at seven different values (0.05,0.5,1,1.5,2,2.5,2.95)(0.05,0.5,1,1.5,2,2.5,2.95). The following plots show the Monte Carlo average of estimates of dependence measures and the 90%90\% Monte Carlo confidence bands (5th5th and 95th95th percentiles of the dependence measure estimates) across 100 Monte Carlo replicates.

Overall, the estimates averaged over 100 Monte Carlo samples seem to be fairly close to the true conditional dependence measures across different values of the covariate. The variance tends to increase and the Monte Carlo average tends to underestimate a little bit when it gets closer to the boundaries of the covariate.

Refer to caption
(a)
Refer to caption
(b)
Figure 2: The plots of the estimated conditional Kendall’s tau and conditional Spearman’s rho as a function of the covariate.

Next, we would like to compare the performance of our proposed nonparametric method to the semiparametric method in Acar et al. (2011) through simulation studies. They assume a conditional copula model where the copula function comes from a parametric copula family and the copula parameter is a function of the covariate. Different copula families, e.g., Clayton and Gumbel, were considered and the functional relationship between the copula parameter and the covariate was estimated using a nonparametric local likelihood approach. The severe consequence of misspecified copula model was investigated in Acar et al. (2011) and they proposed a copula selection method based on cross-validated prediction errors. In contrast, the proposed conditional copula estimator is fully nonparametric so there is no need to make any choice of the copula family.

Simulation setups follow Acar et al. (2011). The data (Ui1,Ui2|Xi),i=1,,n{(U_{i1},U_{i2}|X_{i}),i=1,...,n} are generated from the Clayton copula under the following models: (Ui1,Ui2)|XiC(u1,u2|θi)(U_{i1},U_{i2})|X_{i}\sim C(u_{1},u_{2}|\theta_{i}), where (i): θi=exp(0.8Xi2)\theta_{i}=\text{exp}(0.8X_{i}-2) and XiUnif(2,5)X_{i}\sim Unif(2,5) ; (ii): θi=exp(20.3(Xi2)2\theta_{i}=\text{exp}(2-0.3(X_{i}-2)^{2} and XiUnif(2,5)X_{i}\sim Unif(2,5). The sample size is n=200n=200.

The comparison can be done numerically by calculating the conditional Kendall’s tau and some performance measures, including the integrated square Bias (IBIAS2), integrated Variance (IVAR) and integrated mean square error (IMSE) as given in Acar et al. (2011):

IBIAS2\displaystyle IBIAS^{2} =\displaystyle= [2,5][E[τ^x(x)]τx(x)]2𝑑x=3[0,1][E[τ^(v)]τ(v)]2𝑑v,\displaystyle\int_{[2,5]}\big{[}E[\hat{\tau}_{x}(x)]-\tau_{x}(x)\big{]}^{2}dx=3\int_{[0,1]}\big{[}E[\hat{\tau}(v)]-\tau(v)\big{]}^{2}dv, (32)
IVAR\displaystyle IVAR =\displaystyle= [2,5]E[[τ^x(x)E[τ^x(x)]]2]𝑑x=3[0,1]E[[τ^(v)E[τ^(v)]]2]𝑑v,\displaystyle\int_{[2,5]}E\big{[}[\hat{\tau}_{x}(x)-E[\hat{\tau}_{x}(x)]]^{2}\big{]}dx=3\int_{[0,1]}E\big{[}[\hat{\tau}(v)-E[\hat{\tau}(v)]]^{2}\big{]}dv, (33)
IMSE\displaystyle IMSE =\displaystyle= [2,5]E[[τ^x(x)τx(x)]2]𝑑x=3[0,1]E[[τ^(v)τ(v)]2]𝑑v,\displaystyle\int_{[2,5]}E\big{[}[\hat{\tau}_{x}(x)-\tau_{x}(x)]^{2}\big{]}dx=3\int_{[0,1]}E\big{[}[\hat{\tau}(v)-\tau(v)]^{2}\big{]}dv, (34)

where the second equality holds because τx(X)=τ(FX(X))=τ(V)\tau_{x}(X)=\tau(F_{X}(X))=\tau(V) and XUnif(2,5)X\sim Unif(2,5). We compute Monte Carlo estimates of these performance measures by following the tricks in Segers et al. (2017) and compare our proposed method (referred to as ”ECBC-based”) to the local likelihood method (referred to as ”Local”) in Acar et al. (2011). The results are shown in Table 1.

From the results we can see that when data are generated from the Clayton copula (the underlying true copula), our ECBC-based method outperforms the local likelihood method for the incorrect parametric case (Gumbel) in terms of bias and MSE, although the performance is not as good as the local likelihood method for the correct parametric case (Clayton). Nonetheless, the advantage of the proposed nonparametric method is that we can avoid the adverse impact of misspecified copula and obtain fairly good estimation of conditional copula and conditional dependence measures without having to select the ‘best’ copula model from numerous copula families.

Table 1: Comparison of the proposed method (referred to as “ECBC-based”) to the local likelihood method (referred to as “Local”) using Monte Carlo estimates of three performance measures, IBIAS2, IVAR and IMSE. Data are generated from the Clayton copula under two different functional relationships between the copula parameter and the covariate.
Clayton copula: θ=exp(0.8X2)\theta=\exp(0.8X-2)
Estimation Method Parametric Model IBIAS2 (×102\times 10^{-2}) IVAR(×102\times 10^{-2}) IMSE (×102\times 10^{-2})
Local Clayton 0.017 0.553 0.570
Local Gumbel 3.704 1.716 5.389
ECBC-based N/A 0.323 2.569 2.892
Clayton copula: θ=exp(20.3(X4)2)\theta=\exp(2-0.3(X-4)^{2})
Estimation Method Parametric Model IBIAS2 (×102\times 10^{-2}) IVAR(×102\times 10^{-2}) IMSE (×102\times 10^{-2})
Local Clayton 0.040 0.288 0.328
Local Gumbel 4.808 1.301 6.109
ECBC-based N/A 0.855 1.876 2.731

4 Real Case Study

We now apply the proposed methodology to a data set of life expectancy at birth of males and females with GDP (in USD) per capita as a covariate for 210 countries or regions. The data are available from the World Factbook 2020 of CIA. Similar data sets were analyzed in Gijbels et al. (2011) and Abegaz et al. (2012). Life expectancy at birth summarizes the average number of years to be lived in a country while GDP per capita is often considered as an indicator of a country’s standard of living. We are interested in the dependence between the life expectancy at birth of males and females and would like to see if the strength of dependence is influenced by the GDP per capita. In other words, it is of interest to investigate the dependence between the life expectancy at birth of males (Y1Y_{1}) and females (Y2Y_{2}) conditioning on the covariate XX, where X=X= log10(GDP) is log10 transformation of GDP per capita.

The pairwise scatterplots of the data are shown in Figure 3(a), from which we can see that there is strong positive correlation between the life expectancy of males (referred to as Male) and females (referred to as Female). Figure 3(a) also shows that the life expectancy tends to increase with the log10 transformation of GDP per capita (referred to as log10.GDP) for both males and females. Before estimating the conditional copula of (Y1,Y2)(Y_{1},Y_{2}) given XX, we first remove the effect of the covariate XX on the marginal distributions of Y1Y_{1} and Y2Y_{2}. As a result, the covariate-adjusted pseudo-observations of Y1Y_{1} and Y2Y_{2} (referred to as Male.pseudo and Female.pseudo, respectively) and the pseudo-observations of XX (referred to ad log10.GDP.pseudo) are given in 3(b).

We then estimate the conditional copula and the conditional dependence of life expectancy at birth of males and females given the covariate XX. Figure 4 shows the estimated conditional Kendall’s tau as a function of log10(GDP). It can be observed from the plot that the estimate of Kendall’s tau decreases from around 0.8 to 0.6 as GDP per capita increases from 103=100010^{3}=1000 to 104.64000010^{4.6}\approx 40000 USD and it picks up slightly as GDP per capita becomes greater than 4000040000 USD. Overall, the dependence between the life expectancy at birth of males and females is relatively larger for countries with lower GDP per capita (less than 10000 USD) and the dependence is relatively smaller for countries with higher GDP per capita (greater than 10000 USD).

Refer to caption
(a)
Refer to caption
(b)
Figure 3: Life expectancy data.
Refer to caption
Figure 4: Estimated conditional Kendall’s tau as a function of log10(GDP).

5 Concluding Remarks

This article provides a nonparametric approach for estimating conditional copulas based on the empirical checkerboard Bernstein copula (ECBC) estimator. The proposed nonparametric method has its own advantages compared to the semiparametric methods as it gets rid of model misspecification by not relying on any selection of copula family and demonstrates a good finite-sample performance. The large-sample consistency of the proposed ECBC-based conditional copula estimator is also presented. In addition, we derive closed-form nonparametric estimates of the conditional dependence measures from the proposed estimator.

Due to the complexity in modelling and inference caused by the dependence of conditional copula on the covariates, it is quite common in practice, particularly for vine copulas, to assume that the dependence structure is not influenced by the value of covariates, which is referred to as ‘simplifying assumption’ (e.g. see Haff et al. (2010), Acar et al. (2012), Stoeber et al. (2013), Nagler and Czado (2016) and Schellhase and Spanhel (2018)). In the literature, there have been some available tests of the simplifying assumption; see Acar et al. (2013), Gijbels et al. (2017), Gijbels et al. (2017), Derumigny and Fermanian (2017) and Kurz and Spanhel (2017), etc. Our proposed ECBC-based conditional copula estimator can be useful for constructing new tests of the simplifying assumption. We have shown the framework of obtaining a general estimate of the conditional copula that is allowed to vary with the value of covariates. It is also straightforward to obtain an estimate satisfying the simplifying assumption based on the covariate-adjusted pseudo-observations again using ECBC estimator. Therefore, it could be possible to build test statistics based on some discrepancy criteria like Kolmogorov-Smirnov type, Anderson-Darling type, etc., where the distributions of such test statistics could be approximated by bootstrap schemes.

Another interesting topic for future work would be extending the estimation framework to high-dimensional conditional copula. We can perhaps first use some dimension reduction methods like principal component analysis (PCA) and then develop copula models based on the lower dimensional principal components of the covariates.

References

  • Abegaz et al. (2012) Abegaz, F., I. Gijbels, and N. Veraverbeke (2012). Semiparametric estimation of conditional copulas. Journal of Multivariate Analysis 110, 43–73.
  • Acar et al. (2011) Acar, E. F., R. V. Craiu, and F. Yao (2011). Dependence calibration in conditional copulas: A nonparametric approach. Biometrics 67(2), 445–453.
  • Acar et al. (2013) Acar, E. F., R. V. Craiu, F. Yao, et al. (2013). Statistical testing of covariate effects in conditional copula models. Electronic Journal of Statistics 7, 2822–2850.
  • Acar et al. (2012) Acar, E. F., C. Genest, and J. NešLehová (2012). Beyond simplified pair-copula constructions. Journal of Multivariate Analysis 110, 74–90.
  • Craiu and Sabeti (2012) Craiu, V. R. and A. Sabeti (2012). In mixed company: Bayesian inference for bivariate conditional copula models with discrete and continuous outcomes. Journal of Multivariate Analysis 110, 106–120.
  • Derumigny and Fermanian (2017) Derumigny, A. and J.-D. Fermanian (2017). About tests of the “simplifying” assumption for conditional copulas. Dependence Modeling 5(1), 154–197.
  • Derumigny and Fermanian (2020) Derumigny, A. and J.-D. Fermanian (2020). Conditional empirical copula processes and generalized dependence measures. arXiv preprint arXiv:2008.09480.
  • Fermanian and Lopez (2018) Fermanian, J.-D. and O. Lopez (2018). Single-index copulas. Journal of Multivariate Analysis 165, 27–55.
  • Geerdens et al. (2018) Geerdens, C., E. F. Acar, and P. Janssen (2018). Conditional copula models for right-censored clustered event time data. Biostatistics 19(2), 247–262.
  • Genest et al. (2017) Genest, C., J. G. Nešlehová, and B. Rémillard (2017). Asymptotic behavior of the empirical multilinear copula process under broad conditions. Journal of Multivariate Analysis 159, 82–110.
  • Gijbels et al. (2017) Gijbels, I., M. Omelka, M. Pešta, and N. Veraverbeke (2017). Score tests for covariate effects in conditional copulas. Journal of Multivariate Analysis 159, 111–133.
  • Gijbels et al. (2017) Gijbels, I., M. Omelka, and N. Veraverbeke (2017). Nonparametric testing for no covariate effects in conditional copulas. Statistics 51(3), 475–509.
  • Gijbels et al. (2012) Gijbels, I., M. Omelka, N. Veraverbeke, et al. (2012). Multivariate and functional covariates and conditional copulas. Electronic Journal of Statistics 6, 1273–1306.
  • Gijbels et al. (2011) Gijbels, I., N. Veraverbeke, and M. Omelka (2011). Conditional copulas, association measures and their applications. Computational Statistics & Data Analysis 55(5), 1919–1932.
  • Haff et al. (2010) Haff, I. H., K. Aas, and A. Frigessi (2010). On the simplified pair-copula construction—simply useful or too simplistic? Journal of Multivariate Analysis 101(5), 1296–1310.
  • Janssen et al. (2012) Janssen, P., J. Swanepoel, and N. Veraverbeke (2012). Large sample behavior of the bernstein copula estimator. Journal of Statistical Planning and Inference 142(5), 1189–1197.
  • Janssen et al. (2014) Janssen, P., J. Swanepoel, and N. Veraverbeke (2014). A note on the asymptotic behavior of the bernstein estimator of the copula density. Journal of Multivariate Analysis 124, 480–487.
  • Janssen et al. (2016) Janssen, P., J. Swanepoel, and N. Veraverbeke (2016). Bernstein estimation for a copula derivative with application to conditional distribution and regression functionals. Test 25(2), 351–374.
  • Jaworski et al. (2010) Jaworski, P., F. Durante, W. K. Hardle, and T. Rychlik (2010). Copula theory and its applications, Volume 198. Springer.
  • Joe (2014) Joe, H. (2014). Dependence modeling with copulas. CRC press.
  • Kiriliouk et al. (2019) Kiriliouk, A., J. Segers, and H. Tsukahara (2019). On some resampling procedures with the empirical beta copula. Manuscript.
  • Kurz and Spanhel (2017) Kurz, M. S. and F. Spanhel (2017). Testing the simplifying assumption in high-dimensional vine copulas. arXiv preprint arXiv:1706.02338.
  • Leisen et al. (2017) Leisen, F., L. Dalla Valle, and L. Rossini (2017). Bayesian nonparametric conditional copula estimation of twin data. Journal of the Royal Statistical Society: Series C (Applied Statistics).
  • Levi and Craiu (2018) Levi, E. and R. V. Craiu (2018). Bayesian inference for conditional copulas using gaussian process single index models. Computational Statistics & Data Analysis 122, 115–134.
  • Lu and Ghosh (2023) Lu, L. and S. Ghosh (2023). Nonparametric estimation of multivariate copula using empirical bayes methods. Mathematics 11(20), 4383.
  • Nagler and Czado (2016) Nagler, T. and C. Czado (2016). Evading the curse of dimensionality in nonparametric density estimation with simplified vine copulas. Journal of Multivariate Analysis 151, 69–89.
  • Nelsen (2007) Nelsen, R. B. (2007). An introduction to copulas. Springer Science & Business Media.
  • Parrado-Hernández et al. (2012) Parrado-Hernández, E., A. Ambroladze, J. Shawe-Taylor, and S. Sun (2012). Pac-bayes bounds with data dependent priors. The Journal of Machine Learning Research 13(1), 3507–3531.
  • Patton (2006a) Patton, A. J. (2006a). Estimation of multivariate models for time series of possibly different lengths. Journal of applied econometrics 21(2), 147–173.
  • Patton (2006b) Patton, A. J. (2006b). Modelling asymmetric exchange rate dependence. International economic review 47(2), 527–556.
  • Sabeti et al. (2014) Sabeti, A., M. Wei, and R. V. Craiu (2014). Additive models for conditional copulas. Stat 3(1), 300–312.
  • Schellhase and Spanhel (2018) Schellhase, C. and F. Spanhel (2018). Estimating non-simplified vine copulas using penalized splines. Statistics and Computing 28(2), 387–409.
  • Schweizer et al. (1981) Schweizer, B., E. F. Wolff, et al. (1981). On nonparametric measures of dependence for random variables. Annals of Statistics 9(4), 879–885.
  • Segers et al. (2017) Segers, J., M. Sibuya, and H. Tsukahara (2017). The empirical beta copula. Journal of Multivariate Analysis 155, 35–51.
  • Sklar (1959) Sklar, M. (1959). Fonctions de repartition an dimensions et leurs marges. Publ. inst. statist. univ. Paris 8, 229–231.
  • Stoeber et al. (2013) Stoeber, J., H. Joe, and C. Czado (2013). Simplified pair copula constructions—limitations and extensions. Journal of Multivariate Analysis 119, 101–118.
  • Vatter and Chavez-Demoulin (2015) Vatter, T. and V. Chavez-Demoulin (2015). Generalized additive models for conditional dependence structures. Journal of Multivariate Analysis 141, 147–167.
  • Veraverbeke et al. (2011) Veraverbeke, N., M. Omelka, and I. Gijbels (2011). Estimation of a conditional copula and association measures. Scandinavian Journal of Statistics 38(4), 766–780.
  • Wasserman (2000) Wasserman, L. (2000). Asymptotic inference for mixture models by using data-dependent priors. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 62(1), 159–180.
  • Wu et al. (2014) Wu, J., X. Wang, and S. G. Walker (2014). Bayesian nonparametric inference for a multivariate copula function. Methodology and Computing in Applied Probability 16(3), 747–763.
  • Žežula (2009) Žežula, I. (2009). On multivariate gaussian copulas. Journal of Statistical Planning and Inference 139(11), 3942–3946.

Appendix

Proof of Theorem 1

Proof.

We denote

Pm,k(v)=(mk)vk(1v)mk.P_{m,k}(v)={m\choose k}v^{k}(1-v)^{m-k}. (35)

Then we can rewrite the Bernstein copula as

B(C;u1,u2,v)=h1=0l1h2=0l2k=0mC(h1l1,h2l2,km)Pl1,h1(u1)Pl2,h2(u2)Pm,k(v),\displaystyle B(C;u_{1},u_{2},v)=\sum_{h_{1}=0}^{l_{1}}\sum_{h_{2}=0}^{l_{2}}\sum_{k=0}^{m}C\left(\frac{h_{1}}{l_{1}},\frac{h_{2}}{l_{2}},\frac{k}{m}\right)P_{l_{1},h_{1}}(u_{1})P_{l_{2},h_{2}}(u_{2})P_{m,k}(v), (36)

and the ECBC copula estimator as

B(Cn#;u1,u2,v)=h1=0l1h2=0l2k=0mCn#(h1l1,h2l2,km)Pl1,h1(u1)Pl2,h2(u2)Pm,k(v),\displaystyle B(C_{n}^{\#};u_{1},u_{2},v)=\sum_{h_{1}=0}^{l_{1}}\sum_{h_{2}=0}^{l_{2}}\sum_{k=0}^{m}C^{\#}_{n}\left(\frac{h_{1}}{l_{1}},\frac{h_{2}}{l_{2}},\frac{k}{m}\right)P_{l_{1},h_{1}}(u_{1})P_{l_{2},h_{2}}(u_{2})P_{m,k}(v), (37)

where Cn#C^{\#}_{n} is the empirical checkerboard copula. Thus the partial derivative of 3-dimensional ECBC B(Cn#;u1,u2,v)B(C_{n}^{\#};u_{1},u_{2},v) with respect to vv takes the form of

C#(1)(u1,u2|v)B(Cn#;u1,u2,v)v\displaystyle C^{\#(1)}(u_{1},u_{2}|v)\equiv\frac{\partial B(C_{n}^{\#};u_{1},u_{2},v)}{\partial v} (38)
=h1=0l1h2=0l2k=0mCn#(h1l1,h2l2,km)Pl1,h1(u1)Pl2,h2(u2)Pm,k(v),\displaystyle=\sum_{h_{1}=0}^{l_{1}}\sum_{h_{2}=0}^{l_{2}}\sum_{k=0}^{m}C^{\#}_{n}\left(\frac{h_{1}}{l_{1}},\frac{h_{2}}{l_{2}},\frac{k}{m}\right)P_{l_{1},h_{1}}(u_{1})P_{l_{2},h_{2}}(u_{2})P_{m,k}^{{}^{\prime}}(v),

where Pm,k(v)P_{m,k}^{{}^{\prime}}(v) is the derivative of Pm,k(v)P_{m,k}(v) with respect to vv.

Let us denote the partial derivative of the Bernstein copula B(C;u1,u2,v)B(C;u_{1},u_{2},v) with respect to vv as

C(1)(u1,u2|v)B(C;u1,u2,v)v\displaystyle C^{(1)}(u_{1},u_{2}|v)\equiv\frac{\partial B(C;u_{1},u_{2},v)}{\partial v} (39)
=h1=0l1h2=0l2k=0mC(h1l1,h2l2,km)Pl1,h1(u1)Pl2,h2(u2)Pm,k(v),\displaystyle=\sum_{h_{1}=0}^{l_{1}}\sum_{h_{2}=0}^{l_{2}}\sum_{k=0}^{m}C\left(\frac{h_{1}}{l_{1}},\frac{h_{2}}{l_{2}},\frac{k}{m}\right)P_{l_{1},h_{1}}(u_{1})P_{l_{2},h_{2}}(u_{2})P_{m,k}^{{}^{\prime}}(v),

and the partial derivative of the empirical Bernstein copula B(Cn;u1,u2,v)B(C_{n};u_{1},u_{2},v) with respect to vv as

Cn(1)(u1,u2|v)B(Cn;u1,u2,v)v\displaystyle C^{(1)}_{n}(u_{1},u_{2}|v)\equiv\frac{\partial B(C_{n};u_{1},u_{2},v)}{\partial v} (40)
=h1=0l1h2=0l2k=0mCn(h1l1,h2l2,km)Pl1,h1(u1)Pl2,h2(u2)Pm,k(v).\displaystyle=\sum_{h_{1}=0}^{l_{1}}\sum_{h_{2}=0}^{l_{2}}\sum_{k=0}^{m}C_{n}\left(\frac{h_{1}}{l_{1}},\frac{h_{2}}{l_{2}},\frac{k}{m}\right)P_{l_{1},h_{1}}(u_{1})P_{l_{2},h_{2}}(u_{2})P_{m,k}^{{}^{\prime}}(v).

Using the triangle inequality we have

C#(1)Cv(v)\displaystyle||C^{\#(1)}-C_{v}||(v) ||C#(1)C(1)||(v)+||C(1)Cv|(v)\displaystyle\leq||C^{\#(1)}-C^{(1)}||(v)+||C^{(1)}-C_{v}|(v)
||C#(1)Cn(1)||(v)+||Cn(1)C(1)|(v)+||C(1)Cv||(v).\displaystyle\leq||C^{\#(1)}-C^{(1)}_{n}||(v)+||C^{(1)}_{n}-C^{(1)}|(v)+||C^{(1)}-C_{v}||(v).

First, we can show that

C#(1)Cn(1)(v)\displaystyle||C^{\#(1)}-C^{(1)}_{n}||(v)
=h1=0l1h2=0l2k=0m(Cn#(h1l1,h2l2,km)Cn(h1l1,h2l2,km))Pl1,h1(u1)Pl2,h2(u2)Pm,k(v)(v)\displaystyle=||\sum_{h_{1}=0}^{l_{1}}\sum_{h_{2}=0}^{l_{2}}\sum_{k=0}^{m}\left(C^{\#}_{n}\left(\frac{h_{1}}{l_{1}},\frac{h_{2}}{l_{2}},\frac{k}{m}\right)-C_{n}\left(\frac{h_{1}}{l_{1}},\frac{h_{2}}{l_{2}},\frac{k}{m}\right)\right)P_{l_{1},h_{1}}(u_{1})P_{l_{2},h_{2}}(u_{2})P_{m,k}^{{}^{\prime}}(v)||(v)
max0h1l1,0h2l2,0km1|Cn#(h1l1,h2l2,k+1m)Cn(h1l1,h2l2,k+1m)|\displaystyle\leq\underset{0\leq h_{1}\leq l_{1},0\leq h_{2}\leq l_{2},0\leq k\leq m-1}{\max}\left|C_{n}^{\#}\left(\frac{h_{1}}{l_{1}},\frac{h_{2}}{l_{2}},\frac{k+1}{m}\right)-C_{n}\left(\frac{h_{1}}{l_{1}},\frac{h_{2}}{l_{2}},\frac{k+1}{m}\right)\right|
h1=0l1h2=0l2k=0m|Pl1,h1(u1)||Pl2,h2(u2)||Pm,k(v)|\displaystyle\sum_{h_{1}=0}^{l_{1}}\sum_{h_{2}=0}^{l_{2}}\sum_{k=0}^{m}|P_{l_{1},h_{1}}(u_{1})||P_{l_{2},h_{2}}(u_{2})||P_{m,k}^{{}^{\prime}}(v)|
max0h1l1,0h2l2,0km1|Cn#(h1l1,h2l2,k+1m)Cn(h1l1,h2l2,k+1m)|k=0m|Pm,k(v)|.\displaystyle\leq\underset{0\leq h_{1}\leq l_{1},0\leq h_{2}\leq l_{2},0\leq k\leq m-1}{\max}\left|C_{n}^{\#}\left(\frac{h_{1}}{l_{1}},\frac{h_{2}}{l_{2}},\frac{k+1}{m}\right)-C_{n}\left(\frac{h_{1}}{l_{1}},\frac{h_{2}}{l_{2}},\frac{k+1}{m}\right)\right|\sum_{k=0}^{m}|P_{m,k}^{{}^{\prime}}(v)|.

In above the second inequality follows from the fact that since (ljhj)ujlj(1uj)ljhj,lj=0,1,,hj{l_{j}\choose h_{j}}u_{j}^{l_{j}}(1-u_{j})^{l_{j}-h_{j}},l_{j}=0,1,\ldots,h_{j}, j=1,2j=1,2 are binomial probabilities, hj=0lj(ljhj)ujhj(1uj)ljhj=1\sum_{h_{j}=0}^{l_{j}}{l_{j}\choose h_{j}}u_{j}^{h_{j}}(1-u_{j})^{l_{j}-h_{j}}=1 for any uj[0,1]u_{j}\in[0,1], j=1,2j=1,2. Under the assumption that the marginal CDFs are continuous, it follows from the Remark 2 in Genest et al. (2017) that for d-dimensional copula

Cn#Cn3n,||C_{n}^{\#}-C_{n}||\leq\frac{3}{n},

and from Lemma 1 in Janssen et al. (2014) it follows that for any fixed 0<v<10<v<1,

k=0m|Pm,k(v)|2πm1/2v(1v)=O(m1/2)asm.\sum_{k=0}^{m}|P_{m,k}^{{}^{\prime}}(v)|\sim\sqrt{\frac{2}{\pi}}\frac{m^{1/2}}{\sqrt{v(1-v)}}=O(m^{1/2})\;\;\text{as}\;\;m\rightarrow\infty.

Thus, for any fixed 0<v<10<v<1 we have

C#(1)Cn(1)(v)\displaystyle||C^{\#(1)}-C^{(1)}_{n}||(v)
max0h1l1,0h2l2,0km1|Cn#(h1l1,h2l2,k+1m)Cn(h1l1,h2l2,k+1m)|k=0m|Pm,k(v)|\displaystyle\leq\underset{0\leq h_{1}\leq l_{1},0\leq h_{2}\leq l_{2},0\leq k\leq m-1}{\max}\left|C_{n}^{\#}\left(\frac{h_{1}}{l_{1}},\frac{h_{2}}{l_{2}},\frac{k+1}{m}\right)-C_{n}\left(\frac{h_{1}}{l_{1}},\frac{h_{2}}{l_{2}},\frac{k+1}{m}\right)\right|\sum_{k=0}^{m}|P_{m,k}^{{}^{\prime}}(v)|
Cn#Cnk=0m|Pm,k(v)|=O(m1/2n1).\displaystyle\leq||C_{n}^{\#}-C_{n}||\sum_{k=0}^{m}|P_{m,k}^{{}^{\prime}}(v)|=O(m^{1/2}n^{-1}).

Next, we can use a similar technique to show that

||Cn(1)C(1)|(v)\displaystyle||C^{(1)}_{n}-C^{(1)}|(v)
max0h1l1,0h2l2,0km1|Cn(h1l1,h2l2,k+1m)C(h1l1,h2l2,k+1m)|k=0m|Pm,k(v)|\displaystyle\leq\underset{0\leq h_{1}\leq l_{1},0\leq h_{2}\leq l_{2},0\leq k\leq m-1}{\max}\left|C_{n}\left(\frac{h_{1}}{l_{1}},\frac{h_{2}}{l_{2}},\frac{k+1}{m}\right)-C\left(\frac{h_{1}}{l_{1}},\frac{h_{2}}{l_{2}},\frac{k+1}{m}\right)\right|\sum_{k=0}^{m}|P_{m,k}^{{}^{\prime}}(v)|

By using the Lemma 1 in Janssen et al. (2012) and equation (3) in Kiriliouk et al. (2019), for d-dimensional copula we obtain

CnC\displaystyle||C_{n}-C|| 3n+O(n1/2(loglogn)1/2)a.s.\displaystyle\leq\frac{3}{n}+O(n^{-1/2}(\log\log n)^{1/2})\;\;\;a.s.
=O(n1/2(loglogn)1/2)a.s..\displaystyle=O(n^{-1/2}(\log\log n)^{1/2})\;\;\;a.s..

Thus it follows that for any fixed 0<v<10<v<1,

Cn(1)C(1)(v)=O(m1/2n1/2(loglogn)1/2),a.s..||C^{(1)}_{n}-C^{(1)}||(v)=O(m^{1/2}n^{-1/2}(\log\log n)^{1/2}),\;\;\;a.s..

Hence, for any fixed 0<v<10<v<1 we have

||C#(1)C(1)||(v)||C#(1)Cn(1)||(v)+||Cn(1)C(1)|(v)=O(m1/2n1/2(loglogn)1/2),a.s..||C^{\#(1)}-C^{(1)}||(v)\leq||C^{\#(1)}-C^{(1)}_{n}||(v)+||C^{(1)}_{n}-C^{(1)}|(v)=O(m^{1/2}n^{-1/2}(\log\log n)^{1/2}),\;\;\;a.s..

Next, by mean value theorem there exists km<ξk<k+1m\frac{k}{m}<\xi_{k}<\frac{k+1}{m} s.t.

C(1)(u1,u2|v)\displaystyle C^{(1)}(u_{1},u_{2}|v)
=h1=0l1h2=0l2k=0m1m(C(h1l1,h2l2,k+1m)C(h1l1,h2l2,km))Pl1,h1(u1)Pl2,h2(u2)Pm1,k(v),\displaystyle=\sum_{h_{1}=0}^{l_{1}}\sum_{h_{2}=0}^{l_{2}}\sum_{k=0}^{m-1}m\left(C\left(\frac{h_{1}}{l_{1}},\frac{h_{2}}{l_{2}},\frac{k+1}{m}\right)-C\left(\frac{h_{1}}{l_{1}},\frac{h_{2}}{l_{2}},\frac{k}{m}\right)\right)P_{l_{1},h_{1}}(u_{1})P_{l_{2},h_{2}}(u_{2})P_{m-1,k}(v),
=h1=0l1h2=0l2k=0m1Cv(h1l1,h2l2|ξk)Pl1,h1(u1)Pl2,h2(u2)Pm1,k(v),\displaystyle=\sum_{h_{1}=0}^{l_{1}}\sum_{h_{2}=0}^{l_{2}}\sum_{k=0}^{m-1}C_{v}\left(\frac{h_{1}}{l_{1}},\frac{h_{2}}{l_{2}}\big{|}\xi_{k}\right)P_{l_{1},h_{1}}(u_{1})P_{l_{2},h_{2}}(u_{2})P_{m-1,k}(v),
=h1=0l1h2=0l2k=0m1(Cv(h1l1,h2l2|ξk)Cv(h1l1,h2l2|km1)+Cv(h1l1,h2l2|km1))\displaystyle=\sum_{h_{1}=0}^{l_{1}}\sum_{h_{2}=0}^{l_{2}}\sum_{k=0}^{m-1}\left(C_{v}\left(\frac{h_{1}}{l_{1}},\frac{h_{2}}{l_{2}}\big{|}\xi_{k}\right)-C_{v}\left(\frac{h_{1}}{l_{1}},\frac{h_{2}}{l_{2}}\big{|}\frac{k}{m-1}\right)+C_{v}\left(\frac{h_{1}}{l_{1}},\frac{h_{2}}{l_{2}}\big{|}\frac{k}{m-1}\right)\right)
Pl1,h1(u1)Pl2,h2(u2)Pm1,k(v).\displaystyle P_{l_{1},h_{1}}(u_{1})P_{l_{2},h_{2}}(u_{2})P_{m-1,k}(v).

Notice that

kmk+1m<kmkm1<ξkkm1<k+1mkm1<k+1mkm,\displaystyle\frac{k}{m}-\frac{k+1}{m}<\frac{k}{m}-\frac{k}{m-1}<\xi_{k}-\frac{k}{m-1}<\frac{k+1}{m}-\frac{k}{m-1}<\frac{k+1}{m}-\frac{k}{m},

which means that

|ξkkm1|<1m.\displaystyle\left|\xi_{k}-\frac{k}{m-1}\right|<\frac{1}{m}.

If Cv(u1,u2|v)=C(u1,u2,v)vC_{v}(u_{1},u_{2}|v)=\frac{\partial C(u_{1},u_{2},v)}{\partial v} is Lipschitz continuous on [0,1]3[0,1]^{3}, then there exists a Lipschitz constant LL s.t.

|Cv(h1l1,h2l2|ξk)Cv(h1l1,h2l2|km1)|L|ξkkm1|Lm,\displaystyle\left|C_{v}\left(\frac{h_{1}}{l_{1}},\frac{h_{2}}{l_{2}}\big{|}\xi_{k}\right)-C_{v}\left(\frac{h_{1}}{l_{1}},\frac{h_{2}}{l_{2}}\big{|}\frac{k}{m-1}\right)\right|\leq L\left|\xi_{k}-\frac{k}{m-1}\right|\leq\frac{L}{m},

and based on Lemma 3.2 in Segers et al. (2017) we also have

||h1=0l1h2=0l2k=0m1Cv(h1l1,h2l2|km1)Pl1,h1(u1)Pl2,h2(u2)Pm1,k(v)Cv||\displaystyle||\sum_{h_{1}=0}^{l_{1}}\sum_{h_{2}=0}^{l_{2}}\sum_{k=0}^{m-1}C_{v}\left(\frac{h_{1}}{l_{1}},\frac{h_{2}}{l_{2}}\big{|}\frac{k}{m-1}\right)P_{l_{1},h_{1}}(u_{1})P_{l_{2},h_{2}}(u_{2})P_{m-1,k}(v)-C_{v}||
L(12l1+12l2+12m1).\displaystyle\leq L\left(\frac{1}{2\sqrt{l_{1}}}+\frac{1}{2\sqrt{l_{2}}}+\frac{1}{2\sqrt{m-1}}\right).

Thus

C(1)Cv(v)\displaystyle||C^{(1)}-C_{v}||(v)
||h1=0l1h2=0l2k=0m1(Cv(h1l1,h2l2|ξk)Cv(h1l1,h2l2|km1))Pl1,h1(u1)Pl2,h2(u2)Pm1,k(v)||\displaystyle\leq||\sum_{h_{1}=0}^{l_{1}}\sum_{h_{2}=0}^{l_{2}}\sum_{k=0}^{m-1}\left(C_{v}\left(\frac{h_{1}}{l_{1}},\frac{h_{2}}{l_{2}}\big{|}\xi_{k}\right)-C_{v}\left(\frac{h_{1}}{l_{1}},\frac{h_{2}}{l_{2}}\big{|}\frac{k}{m-1}\right)\right)P_{l_{1},h_{1}}(u_{1})P_{l_{2},h_{2}}(u_{2})P_{m-1,k}(v)||
+||h1=0l1h2=0l2k=0m1Cv(h1l1,h2l2|km1)Pl1,h1(u1)Pl2,h2(u2)Pm1,k(v)Cv||\displaystyle+||\sum_{h_{1}=0}^{l_{1}}\sum_{h_{2}=0}^{l_{2}}\sum_{k=0}^{m-1}C_{v}\left(\frac{h_{1}}{l_{1}},\frac{h_{2}}{l_{2}}\big{|}\frac{k}{m-1}\right)P_{l_{1},h_{1}}(u_{1})P_{l_{2},h_{2}}(u_{2})P_{m-1,k}(v)-C_{v}||
Lm+L(12l1+12l2+12m1).\displaystyle\leq\frac{L}{m}+L\left(\frac{1}{2\sqrt{l_{1}}}+\frac{1}{2\sqrt{l_{2}}}+\frac{1}{2\sqrt{m-1}}\right).

Finally, for any fixed 0<v<10<v<1 we obtain

C#(1)Cv(v)\displaystyle||C^{\#(1)}-C_{v}||(v) C#(1)C(1)(v)+C(1)Cv(v)\displaystyle\leq||C^{\#(1)}-C^{(1)}||(v)+||C^{(1)}-C_{v}||(v)
Lm+L(12l1+12l2+12m1)+O(m1/2n1/2(loglogn)1/2),a.s..\displaystyle\leq\frac{L}{m}+L\left(\frac{1}{2\sqrt{l_{1}}}+\frac{1}{2\sqrt{l_{2}}}+\frac{1}{2\sqrt{m-1}}\right)+O(m^{1/2}n^{-1/2}(\log\log n)^{1/2}),\;\;\;a.s..

The empirical prior of the degrees mm, l1l_{1}, and l2l_{2} are given as

m|αPoisson(nα)+2andαUnif(13,23),m|\alpha\sim Poisson(n^{\alpha})+2\;\;\mbox{and}\;\;\alpha\sim Unif\Big{(}\frac{1}{3},\frac{2}{3}\Big{)},\;\;
lj|αjPoisson(nαj)+1andαjUnif(13,23)j=1,2.l_{j}|\alpha_{j}\sim Poisson(n^{\alpha_{j}})+1\;\;\mbox{and}\;\;\alpha_{j}\sim Unif\Big{(}\frac{1}{3},\frac{2}{3}\Big{)}\;\;j=1,2.

Notice that Pr(13α23)=1\Pr({1\over 3}\leq\alpha\leq{2\over 3})=1 and Pr(13αj23)=1,j=1,2\Pr({1\over 3}\leq\alpha_{j}\leq{2\over 3})=1,j=1,2, then E(m1/2n1/2(loglogn)1/2)E(m^{1/2}n^{-1/2}(\log\log n)^{1/2}) n1/3n1/2(loglogn)1/20\leq n^{1/3}n^{-1/2}(\log\log n)^{1/2}\rightarrow 0 as nn\rightarrow\infty. In the proof of Theorem 3.1 it has been shown E(1lj|αj)1enαjnαj0,j=1,2E\left(\sqrt{\frac{1}{l_{j}}}\big{|}\alpha_{j}\right)\leq\sqrt{{1-e^{-n^{\alpha_{j}}}\over n^{\alpha_{j}}}}\rightarrow 0,j=1,2, E(1m1|α)1enαnα0E\left(\sqrt{\frac{1}{m-1}}\big{|}\alpha\right)\leq\sqrt{{1-e^{-n^{\alpha}}\over n^{\alpha}}}\rightarrow 0 as nn\rightarrow\infty and E(1m|α)1enαnα0E\left(\frac{1}{m}\big{|}\alpha\right)\leq{1-e^{-n^{\alpha}}\over n^{\alpha}}\rightarrow 0 as nn\rightarrow\infty. Thus, taking expectation with respect to the prior distributions of l1l_{1}, l2l_{2} and mm as given for ECBC, it follows that

E(C#(1)Cv(v))\displaystyle E(||C^{\#(1)}-C_{v}||(v))
E(Lm)+E(L(12l1+12l2+12m1))+E(O(m1/2n1/2(loglogn)1/2))\displaystyle\leq E\left(\frac{L}{m}\right)+E\left(L\left(\frac{1}{2\sqrt{l_{1}}}+\frac{1}{2\sqrt{l_{2}}}+\frac{1}{2\sqrt{m-1}}\right)\right)+E\left(O(m^{1/2}n^{-1/2}(\log\log n)^{1/2})\right)
0asna.s.\displaystyle\rightarrow 0\;as\;n\rightarrow\infty\;\;a.s.

Since C(u1,1|v)=u1C(u_{1},1|v)=u_{1} and C(1,u2|v)=u2C(1,u_{2}|v)=u_{2} and C#(1)(u1,u2|v)C^{\#(1)}(u_{1},u_{2}|v) converges to Cv(u1,u2|v)C_{v}(u_{1},u_{2}|v) uniformly on [0,1]2[0,1]^{2} as nn\rightarrow\infty for any fixed 0<v<10<v<1, then we have

E(||F1(u1|v)u1||(v))E(supu1[0,1]|F1(u1|v)u1|)\displaystyle E\left(||F_{1}(u_{1}|v)-u_{1}||(v)\right)\equiv E\left(\sup_{u_{1}\in[0,1]}|F_{1}(u_{1}|v)-u_{1}|\right)
=E(||C#(1)(u1,1|v)C(u1,1|v)||(v))E(||C#(1)C(1)||(v))a.s.0,\displaystyle=E\left(||C^{\#(1)}(u_{1},1|v)-C(u_{1},1|v)||(v)\right)\leq E\left(||C^{\#(1)}-C^{(1)}||(v)\right)\stackrel{{\scriptstyle\text{a.s.}}}{{\rightarrow}}0,

and

E(||F2(u2|v)u2||(v))E(supu2[0,1]|F2(u2|v)u2|)\displaystyle E\left(||F_{2}(u_{2}|v)-u_{2}||(v)\right)\equiv E\left(\sup_{u_{2}\in[0,1]}|F_{2}(u_{2}|v)-u_{2}|\right)
=E(||C#(1)(1,u2|v)C(1,u2|v)||(v))E(||C#(1)C(1)||(v))a.s.0.\displaystyle=E\left(||C^{\#(1)}(1,u_{2}|v)-C(1,u_{2}|v)||(v)\right)\leq E\left(||C^{\#(1)}-C^{(1)}||(v)\right)\stackrel{{\scriptstyle\text{a.s.}}}{{\rightarrow}}0.

For any fixed 0<v<10<v<1, F1F_{1} and F2F_{2} are non-decreasing functions, so F11(u1|v)a.s.u1F_{1}^{-1}(u_{1}|v)\stackrel{{\scriptstyle\text{a.s.}}}{{\rightarrow}}u_{1} and F21(u2|v)a.s.u2F_{2}^{-1}(u_{2}|v)\stackrel{{\scriptstyle\text{a.s.}}}{{\rightarrow}}u_{2}, Thus we obtain the uniform convergence of

E(||C#Cv||(v))=E(||C#(1)(F11(u1|v),F21(u2|v)|v)Cv||(v))a.s.0\displaystyle E(||C^{\#}-C_{v}||(v))=E(||C^{\#(1)}(F_{1}^{-1}(u_{1}|v),F_{2}^{-1}(u_{2}|v)|v)-C_{v}||(v))\stackrel{{\scriptstyle\text{a.s.}}}{{\rightarrow}}0

as nn\rightarrow\infty for any fixed 0<v<10<v<1.