System theory and orthogonal multi-wavelets
Abstract
In this paper we provide a complete and unifying characterization of compactly supported univariate scalar orthogonal wavelets and vector-valued or matrix-valued orthogonal multi-wavelets. This characterization is based on classical results from system theory and basic linear algebra. In particular, we show that the corresponding wavelet and multi-wavelet masks are identified with a transfer function
of a conservative linear system. The complex matrices define a block circulant unitary matrix. Our results show that there are no intrinsic differences between the elegant wavelet construction by Daubechies or any other construction of vector-valued or matrix-valued multi-wavelets. The structure of the unitary matrix defined by allows us to parametrize in a systematic way all classes of possible wavelet and multi-wavelet masks together with the masks of the corresponding refinable functions.
keywords:
Quadrature mirror filters , Unitary Extension Principle , Transfer function , WaveletsMSC:
[2010] 65T60 , 11E25 , 65D991 Introduction and notation
There has been a multitude of results on orthogonal wavelet and multi-wavelet constructions and on the characterization of the corresponding filterbank systems, since the pioneering work [16]. Our goal is to unify all those approaches. Indeed we show that there are no intrinsic differences between the elegant construction of wavelets by Daubechies, in the scalar case, or any other construction of vector or matrix-valued multi-wavelets. In particular, we compare our results with the recent characterization of orthogonal multi-wavelets in [1].
By [29], the constructions of compactly supported multi-wavelets via the Unitary Extension Principle boil down to manipulations with certain trigonometric polynomials on the unit circle
Any such construction requires that the underlying orthogonal scaling function satisfies
(1) |
with the mask , . The corresponding wavelet or multi-wavelet is defined by
with the finitely supported mask , ,
By [8, 18], to ensure the existence of the compactly supported distributional solution of (1), we require that for the symbol
there exist vectors satisfying
(2) |
Additionally, the other eigenvalues of should be in the absolute values less than . In this case, we say that satisfies sum rules of order . Sum rules of order imply that the associated multi-wavelet mask possesses a discrete vanishing moment
(3) |
with the same vectors are as in (2). In the literature, the cases and are called the -rank and the full rank cases, respectively [8, 9, 26]. The higher smoothness of imposes additional sum rule conditions on the symbol , see e.g. [6, 21, 23].
In the scalar or full rank cases (i.e. ), the sum rules of order are equivalent to the existence of the factor in . The vanishing moment conditions of order in these cases guarantee the existence of the factors in .
In the scalar case (), the wavelet construction by Daubechies [17] amounts to defining the wavelet mask by
(4) |
In the case , due to the non-commutativity of the matrices and , the trick in (4) does not apply. Nevertheless, the interest in constructing multi-wavelets has not decreased for the last years and it is motivated, for example, by the fact that the growth of the support of in this case is decoupled from the smoothness of and symmetry does not conflict with orthogonality [8].
The constructions of the corresponding matrix-valued masks and are based on the so-called QMF (quadrature mirror filter) and UEP (Unitary Extension Principle) conditions. To state them, we define the matrix polynomial map
(5) |
with the matrix coefficients , ,
The entries in the first column of are usually called the polyphase components of . The QMF-condition states that
(6) |
and, equivalently, the UEP-conditions are
(7) |
To use classical results from the theory of linear systems, we look at in (5) as a holomorphic function on the unit disk
The QMF-condition (6) and the maximum principle imply that is contractive for any . Such matrix valued inner functions can be interpreted as transfer functions of conservative linear control systems; specifically it means that the representation
(8) |
holds, with the unitary matrix
(9) |
which we shall call the matrix. For possible further use in the present wavelet framework we refer for a proof and details to the mathematical article [5], which even treats realization theory in the case of several complex variables.
Note that the identity in (8) can be equivalently written as
(12) |
This system of equations plays an important role in constructions of appropriate blocks of the matrix.
The paper is organized as follows: In subsection 2.1 we discuss the structure of appearing in the transfer function system (12). In subsection 2.2, we provide the explicit form of the matrix under the assumptions that satisfies QMF-conditions on , see Theorem 2.7. The compact support of the constructed multi-wavelets is ensured by the property , see Proposition 2.8. The constructions of several compactly supported scaling functions and multi-wavelets are given in Section 4. In subsection 3, we compare our results with the characterization in [1]. The characterization in [1] makes use of the so-called Potapov-Blaschke-products and is also valid for rational .
We remark that although we prove our results for the case of dilation , they all can be generalized in a natural way to the case of a general dilation factor, since this mainly affects the dimensions of the matrices in (5).
2 Characterization of orthogonal univariate multi-wavelets
The main goal of this section is to provide the explicit form of the matrix in (9) for all that satisfy the QMF-condition (6) or, equivalently, the UEP-condition (7). We start by deriving the structure of in (12). Then we determine the explicit structure of the matrix (see Definition 2.4 and Theorem 2.7). Further properties of the matrix are studied in subsection 2.3.
2.1 Structure of
In order to derive the structure of (see Theorem 2.2), we make use of the following straightforward observation.
Proposition 2.1.
Proof.
The following result is an important step for determining the structure of the matrix in (9).
Theorem 2.2.
The proof of Theorem 2.2 for general is rather technical, thus, we first present the idea of the proof on the example of the case .
Example 2.3.
Proof of Theorem 2.2..
The proof of ”“ is by induction on . Let . The starting point of the inductive argument is given in (17). For general , we need to show that
Then the QMF-condition, by Proposition 2.1, implies that
We start by writing
By the induction assumption
Next observe that
Thus, we get
The QMF-condition, due to Proposition 2.1, and the geometric sum argument for lead to
By the definition of , we have
Note that, for ,
and the reordering of the summands leads to
Therefore, we obtain (15) with in (16). The proof of ”“ follows by substituting in (15) and since for . ∎
2.2 Structure of the matrix
The main result of this section characterizes all orthogonal wavelets and multi-wavelets in terms of transfer function representations for the analytic map defined in (5). Such representations involve certain complex matrices, which we define next.
Definition 2.4.
The proof of our main result, Theorem 2.7, relies on the unitary property of the matrix in Definition 2.4.
Example 2.5.
In the case , it is easy to check that the QMF-condition (6) implies that the matrix in Definition 2.4 is unitary
where we used that . The case illustrates the idea of the proof of the unitary property of in the general case (see Proposition 2.6). Assume that the QMF-condition is satisfied. Let be the identity matrix. Then writing (using the circulant structure of )
we get, using ,
(25) | |||||
(30) |
Thus, the rest of the QMF-conditions imply that .
Proposition 2.6.
Proof.
For the identity matrix , define
Note that, similarly to the standard definition of circulant matrices,
where is the identity matrix. Analogously,
Using these representations of and of and the fact that , , similarly to (25), we get that the product contains on its main diagonal and other (zero) QMF-conditions on its subdiagonals. Thus, the claim follows. ∎
We are finally ready to state the following characterization of all compactly supported orthogonal wavelet and multi-wavelet masks.
Theorem 2.7.
Proof.
The proof of ”“ consists of two parts. Firstly, note that the special choice of the matrices , , , , Proposition 2.6 and the hypothesis imply that the matrix in (32) is indeed unitary. Next, we show that satisfies (31). Let . By [5], the identity in (31) is equivalent to the system of equations
(33) |
with as in Theorem 2.2. By the definitions of the matrices , and the polynomial map , the system in (33) is equivalent to
(47) |
After the division of both sides of (47) by and by , we get another equivalent system
(55) |
Observe that the QMF-conditions yield
(62) | |||||
(66) |
Thus, due to and (62), the first identity in (55) is satisfied for in Definition 2.4
The rest of the QMF- and UEP-conditions and (62) imply that the second identity in (55) is satisfied for in Definition 2.4
The proof of ”“ follows by a linear algebra argument. Namely, (31), in its equivalent form
and the fact that is a unitary matrix is reflected in the conservation law
(71) |
Note that the matrix is contractive, so is a rational function, analytic in the unit disk . Let be a point on the unit torus which is not a pole of . Passing to the limit in the identity (71), we obtain
Recall that is assumed to be a polynomial map, hence
i.e. the matrix is unitary for all . ∎
2.3 Further properties of the matrix
In this section, we analyze the properties of the matrices and that guarantee that the representation in (31) leads to a polynomial .
Proposition 2.8.
Proof.
Using Definition 2.4, we write and . Note that, due to the invertibility of , we only need to show that . To prove the claim, we show that
and so on until
First, note that, due to the structure of and , we have
and
For , by QMF-condition, we have and, by UEP-condition, . Thus,
where, for ,
The UEP-condition implies, for ,
where
Therefore,
Multiplication by of both sides of the above equation, due to QMF-condition, yields the claim. ∎
3 Special case
In this section, we consider the special situation of polynomials of degree . The following Lemma 3.1 is crucial for comparison of Theorem 2.7 with [1, Theorem 3.1] and also for our specific constructions in Section 4.
Lemma 3.1.
Let be matrices in . The following two sets of conditions and are equivalent.
Proof.
Note first that the conditions and are equivalent.
Assume that are satisfied. The matrix is unitary, in particular and , and imply that is unitary
Next, and yield
The definitions of and in imply . Because is unitary, in particular , we get
By we obtain . Thus, , leads to .
Assume that are satisfied. By and , the matrix also satisfies and . Thus, by the definitions of and in , is unitary
Moreover, yield
which also proves that . Furthermore,
Similarly, . Next, we show that and . From and we get
and, by the definition of ,
which concludes the proof. ∎
4 Examples
This section illustrates our results with several examples. In particular, for , the examples point out the strength of the algorithm given by the conditions in Lemma 3.1. This algorithm allows us to characterize all possible wavelet and multi-wavelet masks with support on or . In subsection 4.2, we show how to apply the result of Theorem 2.7 for construction of in (5) of degree with support on .
4.1 Wavelets and multi-wavelets supported on or on
Several properties of in (5) are similar in the scalar () and full rank () cases. The corresponding masks are characterized in subsection 4.1.1. The rank one case () is considered in subsection 4.1.2.
4.1.1 Wavelets and full rank multi-wavelets
We first consider the full rank matrix case, which includes the wavelet case . Note first that the full rank requirement in the case uniquely determines the unitary matrix . In fact, since , the first order sum rule/vanishing moments conditions (2)-(3) are equivalent to
Therefore,
By Lemma 3.1, the masks and are, thus, determined by the choice of the projection . In the scalar case , there are only three choices for : identity or two one-parameter families
(72) |
Once a particular is chosen, set , . To recover Haar masks and choose or . To impose additional sum rules/vanishing moments [6, 21, 23] for we solve for
(73) |
This system yields a unique solution , determining the Daubechies (D4) masks and with the supports .
In the case , there are several choices for the projection . If we look for the masks and with supports , then the only possible projections are given by
(74) |
where the blocks are given in (72) and are zero blocks. Note, however, that these choices of lead to essentially diagonal matrix-valued masks and specified in [10]. Such essentially diagonal matrix-valued masks and are equivalent to some scalar masks and , , since and are jointly diagonalizable. This means that there are only trivial full rank matrix-valued masks and supported on .
If we consider and look for the masks with supports , then we retrieve e.g. all the full rank families of masks and in [14]. For example, the ones in [14, Table A.4] are obtained for the projections
Whereas, the masks and in [14, Table A.3] come from the projection
with . As in the scalar case, the free parameters , and are determined by imposing additional sum rules/vanishing moment conditions. These conditions are similar to the ones in (73), due to the nature of the full rank case:
4.1.2 -rank orthogonal multi-wavelets
In this subsection we relax the full rank requirement and consider the multi-wavelet (rank ) setting with . If we require the support of the masks and to be , then the projection is as in (74). To impose sum rule/vanishing moment conditions on the unitary matrix , we consider, for some non-zero , the system
(75) |
and
(76) |
Note that, by [6, 21], we can restrict our attention w.l.g. to the case (though one can allow for different to be able to reproduce other known constructions). Since , this happens for example under the assumption that the components of are symmetric/antisymmetric, respectively, around the center of their support, see e.g. [7]. In this case, the first row of can be determined from
To impose the symmetry/antisymmetry assumptions, we set the zero entry of the mask to be and its first entry to be diagonal. Here we use . Then and are diagonal matrices and the matrix , which depends only on one parameter, is one of the following matrices
where
and
The Chui-Lian multi-wavelets [7] correspond to the choice and in (74).
The next example, is related to a special type of multi-wavelet systems proposed in [25]. By similar argument as the ones used in [4, 13], the authors in [25] derive proper pre-filters associated to any multi-wavelet basis. The construction is based on the requirement that the mask preserves the constant data which make any pre-filtering step obsolete. Preservation of constants is equivalent to the choice in (75)-(76). In order to reduce the degrees of freedom, we impose some symmetry constraints on and (see [25]) directly on the matrix . Thus, we split into four symmetric blocks. One of such matrices (the other possibilities differ only by sign changes) is given by
with . The masks and in [25] correspond to and to the value in (74).
4.2 Wavelets with support .
In this section, we consider the case and and apply the method for determining the masks of Daubechies (D6) given by Theorem 2.7. By such theorem, the unitary matrix
contains already all the information about the unitary we aim to determine. Imposing the sum rules/vanishing moments of order on leads to
The condition reduces the parameters to one, . This requires us to solve quadratic equations in unknowns. We obtain four possible solutions depending on . We present only one of them that corresponds to the Daubechies wavelets . The others are the same up to a sign change.
where . The parameter is determined by solving one equation with the radical and yields .
5 Potapov-Blaschke factorizations: scalar case
In this subsection, we consider only the cases and . We think the corresponding examples are sufficient for the comparison of our results with the ones in [1]. The case of is of special interest as it directly establishes a link between our results and the results in [1].
It has been observed already in [28] , see also e.g. [20, Theorem 4.3], that any trigonometric polynomial of degree , which is unitary on the unit circle, possesses a factorization into so-called Blaschke-Potapov factors. These factorizations were applied for constructions of finite impulse response filters in [1]. In the case , the result of Lemma 3.1 also leads us to Blaschke-Potapov factors. Indeed in this case and and hence,
For factorizations of higher degree into Blaschke-Potapov factors we use the matrices and constructed via the algorithm in Lemma 3.1. In general, any unitary , , of degree possesses a factorization
where are some rank-1 projections.
For , the Daubechies (D6) scaling and wavelet masks are obtained by considering
for some and in (72). To determine the corresponding parameters and , as mentioned above, we determine the corresponding and, then, impose further the sum rules/vanishing moments of order
where symbolizes the matrix entries that do not contribute to our computations. We get
or more explicitly
To obtain and , we, additionally, need to solve one quadratic and one equation with the radicals. Thus, the computational effort is exactly the same as in Section 4.2.
Conclusion
In this paper we have shown that results from system theory provide complete characterization of all orthogonal (multi)wavelet filters. This has been achieved by explicitly determining the structure of the matrix from which an algorithm for multi-wavelet construction can be derived. The aim of the paper was not to propose new classes of multi-wavelets, but rather to provide a unifying framework for all the different constructions proposed in literature.
Future work includes the non-straightforward generalization to the bivariate case and the use of our results for the explicit construction of new classes of matrix wavelet filters satisfying more general properties, for example the exponential rather than polynomial vanishing moment property, or customized according to the problem.
Acknowledgements
Maria Charina was sponsored by the Austrian Science Foundation (FWF) grant P28287-N35. Part of the research was carried out during a visit of the first author at the University of Reggio Calabria supported by GNCS-INdAM.
References
- [1] D. Alpay, P. Jorgensen, I. Lewkowicz, Characterization of rectangular (para-)unitary rational functions, .
- [2] S. Bacchelli, M. Cotronei, D. Lazzaro, An algebraic construction of -balanced multi-wavelets via the lifting scheme, Numer. Algorithms 23 (2000) 329-356.
- [3] S. Bacchelli, M. Cotronei, T. Sauer, Wavelets for multichannel signals, Adv. Appl. Math. 29 (2002) 581-598.
- [4] S. Bacchelli, M. Cotronei, T. Sauer, Multifilters with and without prefilters, BIT 42:2 (2002) 231-261.
- [5] J. A. Ball, T. T. Trent, Unitary colligations, reproducing kernel Hilbert spaces, and Nevanlinna-Pick interpolation in several variables, J. Funct. Anal. 157 (1998) 1-61.
- [6] M. Charina, Vector multivariate subdivision schemes: comparison of spectral methods for their regularity analysis, App. Comp. Harm. Anal. 32 (2012) 86-108.
- [7] C.K. Chui, J. Lian, A study of orthonormal multi-wavelets, Appl. Num. Math. 20:3 (1996) 273-298.
- [8] D. Colella, C. Heil, Characterizations of scaling functions: Continuous solutions, SIAM J. Matrix Anal. Appl. 15 (1994) 469-518.
- [9] C. Conti and M. Cotronei, Construction of multichannel wavelets from orthogonal full rank refinable function, Wavelets and multiscale analysis, J. Cohen and A.I. Zayed (eds), Birkhauser, (2011) 109-130.
- [10] C. Conti, M. Cotronei, T. Sauer, Full rank interpolatory vector subdivision schemes, in Curve and Surface Fitting: Avignon 2006, A. Cohen, J.L. Merrien and L. Schumaker (eds.), 71 (2007) 71-80.
- [11] C. Conti, M. Cotronei, T. Sauer, Full rank positive matrix symbols: interpolation and orthogonality, BIT, 48 (2008) 5-27.
- [12] C. Conti, M. Cotronei, T. Sauer, Full rank interpolatory subdivision schemes: Kronecker, filters and multiresolution, J. Comput. Appl. Math. 233:7 (2010) 1649-1659.
- [13] M. Cotronei, L. Lo Cascio, T. Sauer, Multifilters and prefilters: Uniqueness and algorithmic aspects, J. Comput. Appl. Math. 221 (2008) 346-354.
- [14] M. Cotronei, M. Holschneider, Partial parameterization of orthogonal wavelet matrix filters, J. Comput. Appl. Math. 243 (2013) 113-125.
- [15] M. Cotronei, T. Sauer, Full rank filters and polynomial reproduction, Comm. Pure Appl. Anal. 6 (2007) 667-687.
- [16] I. Daubechies, Orthonormal bases of compactly supported wavelets, Comm. Pure Appl. Math. 41-7 (1988), 909–996.
- [17] I. Daubechies, Ten lectures on wavelets, in: CBMS Conf. Series in Appl. Math. 61 (1992).
- [18] I. Daubechies, J. C. Lagarias, Sets of matrices all infinite products of which converge, Linear Algebra Appl. 162 (1992), 227-263.
- [19] J. S. Geronimo, D. P. Hardin, P. R. Massopust, Fractal functions and wavelet expansions based on several scaling functions, J. Approx. Theory 78 (1994) 373-401.
- [20] I. Gohberg, M.A. Kaashoek, A. C. M. Ran, Factorizations of and extensions to -unitary rational matrix functions on the unit circle, Integr. Equat. Oper. Th. 15 (1992) 262-300.
- [21] B. Han, Vector cascade algorithm and refinable function vectors in Sobolev spaces, J. Approx. Theory 124 (2003) 44-88.
- [22] C. Heil, D. Colella, Matrix refinement equations: existence and uniqueness, J. Fourier Anal. Appl. 2 (1996) 363-377.
- [23] K. Jetter, G. Plonka, A survey on -approximation order from shift-invariant spaces, Multivariate Approximation and Applications, N. Dyn, D. Leviatan, D. Levin, A. Pinkus (eds.), Cambridge University Press, 2001, 73-111.
- [24] F. Keinert, Wavelets and Multiwavelets, Chapman & Hall/CRC, (2004).
- [25] J. Lebrun, M. Vetterli, High-order balanced multiwavelets: theory, factorization, and design, IEEE Trans. Signal Process., 49:9 (2001) 1918-1930.
- [26] C. A. Micchelli, T. Sauer, Regularity of multiwavelets, Adv. Comput. Math. 7 (1997) 455-545.
- [27] G. Plonka, V. Strela, Construction of multiscaling functions with approximation and symmetry, SIAM J. Math. Anal. 29 (1998) 481-510.
- [28] V. P. Potapov, Multiplicative structure of -nonexpansive matrix functions, Trudy Mosk. Math. Ob. 4 (1955) 125-236 [Russian]; English translation: AMS Translations, Series 2 (1960) 131-243.
- [29] A. Ron, Z. Shen, Affine systems in : the analysis of the analysis operator, J. Funct. Anal. 148 (1997) 408-447.
- [30] G. Strang, V. Strela, Orthogonal multiwavelets with vanishing moments, J. Optical Eng. 33 (1994) 2104-2107.
- [31] M. Vetterli, J. Kovačević, Wavelets and subband coding, Prentice Hall PTR (1995).