March 31, 2021
Interlacing Results for Hypergraphs
Abstract
Hypergraphs are a generalization of graphs in which edges can connect any number of vertices. They allow the modeling of complex networks with higher-order interactions, and their spectral theory studies the qualitative properties that can be inferred from the spectrum, i.e. the multiset of the eigenvalues, of an operator associated to a hypergraph. It is expected that a small perturbation of a hypergraph, such as the removal of a few vertices or edges, does not lead to a major change of the eigenvalues. In particular, it is expected that the eigenvalues of the original hypergraph interlace the eigenvalues of the perturbed hypergraph. Here we work on hypergraphs where, in addition, each vertex–edge incidence is given a real number, and we prove interlacing results for the adjacency matrix, the Kirchoff Laplacian and the normalized Laplacian. Tightness of the inequalities is also shown.
1 Introduction
Hypergraphs are a generalization of graphs in which edges can connect any number of vertices. They allow the modeling of bitcoin transactions [17], quantum entropies [2], chemical reaction networks [12], cellular networks [15], social networks [20], neural networks [6], opinion formation [16], epidemic networks [3], transportation networks [1]. Moreover, hypergraphs with real coefficients have been introduced in [13] as a generalization of classical hypergraphs where, in addition, each vertex–edge incidence is given a real coefficient. These coefficients allow to model, for instance, the stoichiometric coefficients when considering chemical reaction networks, or the probability that a given vertex belongs to an edge. In [13], also the adjacency matrix and the normalized Laplacian associated to such hypergraphs have been introduced, while the corresponding Kirchhoff Laplacian has been introduced in [9].
Here we study the spectral properties of these operators and we prove, in particular, interlacing results. We show that, given an operator (which is either the adjacency matrix, the normalized Laplacian or the Kirchhoff Laplacian), then the eigenvalues of the operator associated to a hypergraph interlace the eigenvalues of , if is obtained from by deleting vertices or edges. We also prove the tightness of these inequalities.
Since spectral theory studies the qualitative properties of a graph — and, more generally, of a hypergraph — that can be inferred by the spectra of its associated operators, interlacing results are meaningful as they offer a measure of how much a spectrum changes when deleting vertices or edges. We refer the reader to [10, 4, 18, 7] for some literature on interlacing results in the case of graphs, simplicial complexes and hypergraphs.
The paper is structured as follows. In Section 2 we offer an overview of the definitions on hypergraphs that will be needed throughout this paper. In Section 3 we recall the Courant–Fischer–Weyl min-max principle and we apply it to characterize the eigenvalues of the adjacency matrix, normalized Laplacian and Kirchhoff Laplacian associated to a hypergraph. In Section 4 we apply the Cauchy interlacing Theorem to prove various interlacing results, and in Section 5 we prove some additional interlacing results for the normalized Laplacian, using a generalization of the proof method developed by Butler in [4]. Finally, in Section 6 we draw some conclusions.
2 Definitions
We recall the basic definitions on hypergraphs with real coefficients, following [13].
Definition 2.1.
A hypergraph with real coefficients (Fig. 1) is a triple such that:
-
•
is a finite set of nodes or vertices;
-
•
is a multiset of elements called edges;
-
•
is a set of coefficients and it is such that
(1)

From here on, we fix an hypergraph with real coefficients and we assume that each vertex is contained in at least one edge, that is, there are no isolated vertices.
Definition 2.2.
Given , its cardinality, denoted , is the number of vertices that are contained in .
Remark 2.1.
The oriented hypergraphs introduced by Reff and Rusnak in [19] are hypergraphs with real coefficients such that for each and . Signed graphs are oriented hypergraphs such that for each , and simple graphs are signed graphs such that, for each , there exists a unique and there exists a unique satisfying
Moreover, weighted hypergraphs are hypergraphs with real coefficients such that, for each and for each , does not depend on .
Definition 2.3.
Given , its degree is
(2) |
The diagonal degree matrix of is
Note that is invertible, since we are assuming that there are no isolated vertices.
Definition 2.4.
The adjacency matrix of is , where for all and
Definition 2.5.
The incidence matrix of is , where
Definition 2.6.
The normalized Laplacian of is the matrix
where is the identity matrix.
Remark 2.2.
In [13], the normalized Laplacian is defined as the matrix
which is not necessarily symmetric. Here we chose to work on , which generalizes the classical normalized Laplacian for graphs introduced by Fan Chung in [5], so that we can apply the properties of symmetric matrices. From a spectral point of view, working on or is equivalent. In fact,
hence the matrices and are similar and, therefore, isospectral.
The Kirchhoff Laplacian, in the context of hypergraphs with real coefficients, was introduced by Hirono et al. [9]. We recall it and we introduce the dual Kirchhoff Laplacian.
Definition 2.7.
The Kirchhoff Laplacian of is the matrix
The dual Kirchhoff Laplacian of is the matrix
Remark 2.3.
and have the same non-zero eigenvalues. It follows from the fact that, if and are linear operators, then the non-zero eigenvalues of and are the same.
Given an real symmetric matrix , its spectrum consists of real eigenvalues, counted with multiplicity. We denote them by
Since the trace of an matrix (i.e. the sum of its diagonal elements) equals the sum of its eigenvalues, we have
The idea of the interlacing results that we will prove is to show how the removal of part of the hypergraph effects the eigenvalues of its associated operators. We define two operations that can be done for removing part of a hypergraph: the vertex deletion and the edge deletion, as generalizations of the ones in [18]. Similarly, we also define the restriction of a hypergraph to a subset of edges.
Definition 2.8.
Given , we let , where:
-
•
;
-
•
.
We say that is obtained from by a vertex deletion of .
Definition 2.9.
Given , we let , where
We say that is obtained from by an edge deletion of . More generally, given , we denote by the hypergraph obtained from by deleting all edges in .
Definition 2.10.
Given , the restriction of to is , where
-
•
and
-
•
.
3 Min-max principle
We recall the Courant–Fischer–Weyl min-max principle (Theorem 2.1 in [4]):
Theorem 3.1 (Min-max principle).
Let be an real symmetric matrix. Let denote a –dimensional subspace of and signify that for all . Then
for .
In the case of the normalized Laplacian, by considering the substitution ,
where
Therefore, by the min-max principle,
(3) |
Similarly,
(4) |
and
(5) |
Remark 3.1.
By the above characterizations, it is clear that the eigenvalues of and are non-negative.
4 Cauchy interlacing
We recall the Cauchy interlacing Theorem (Theorem 4.3.17 in [11]) and we apply it in order to prove interlacing results for , and when vertices or edges are removed.
Theorem 4.1 (Cauchy interlacing Theorem).
Let be an real symmetric matrix and let be an principal sub-matrix of . Then
Corollary 4.2.
Given ,
-
1.
, for all ;
-
2.
, for all ;
-
3.
, for all .
Given ,
-
4.
, for all .
Proof.
Since is an principal sub-matrix of , the first claim follows from the Cauchy interlacing Theorem. The second and the third claim are analogous. Similarly, since is an principal sub-matrix of , by the Cauchy interlacing Lemma we have that
Since and have the same non-zero eigenvalues for any hypergraph (cf. Remark 2.3), the claim follows. ∎
We now apply the Cauchy interlacing Theorem in order to prove the following
Theorem 4.3.
Let be an real symmetric matrix, let be an real symmetric matrix and assume that there exists a principal sub-matrix of both and of size . Then,
Proof.
Let be a principal sub-matrix of both and , of size . By repeatedly applying the Cauchy interlacing Theorem,
and
Therefore,
for all . Hence,
∎
Corollary 4.4.
Given such that has vertices,
(6) |
for all , and
(7) |
for all .
Proof.
Let be the vertices of . Then, is a principal sub-matrix of both and . Similarly, is a principal sub-matrix of both and . The claim follows by Theorem 4.3. ∎
Remark 4.1.
Corollary 4.4 is accurate in the sense that it is not possible to substitute, in the claim, the inequalities in (6) by
and the inequalities in (7) by
The accuracy for can be easily seen by considering the case where consists of a single loop (that is, an edge containing one single vertex). Clearly, removing one loop from the hypergraph does not change its adjacency matrix and therefore the inequalities in (6), in this case, can be re-written as
The accuracy of (7) is shown by the next example.
5 Alternative interlacing for the normalized Laplacian
In the case when we remove an edge that is not a loop from a hypergraph, we can improve Corollary 4.4 by partly generalizing, for , Theorem 1.2 in [4].
Theorem 5.1.
Given of cardinality ,
(8) |
for all . More generally, given such that for each and ,
Proof.
Up to re-labeling of the vertices, assume that and let
where are the first standard unit vectors in and therefore the condition implies that
By (3), we have
In the third line we added the condition , that makes the second term of the numerator vanish and that restricts the maximum over a smaller set. In the fifth line we considered an optimization that includes the one in the fourth line as particular case. This proves the claim. ∎
As shown by the next example, Theorem 5.1 is accurate in the sense that it is not possible to substitute, in the claim, the inequality (8) by
which becomes, for ,
Example 5.2.

Now, while Theorem 5.1 considers the removal of edges of cardinality , the following result is about the removal of loops.
Proposition 5.3.
If is a loop, then
for all such that , and
for all such that .
Proof.
Assume that and . By (3), we have
since adding the same non-negative quantity to the numerator and to the denominator makes the resultant fraction closer to . This proves the first claim. The proof of the second claim is analogous. ∎
6 Conclusions
We have shown that, if the structure of a hypergraph with real coefficients is perturbed by removing (or adding) vertices and edges, then the eigenvalues of the perturbed hypergraph interlace those of the original hypergraph. We have proved various inequalities for each operator that we considered (adjacency matrix, Kirchhoff Laplacian and normalized Laplacian), and we have shown tightness of the inequalities. These results are in line with intuition, because the spectra of the operators associated to a hypergraph encode important structural properties of the hypergraph. For future directions, it will be interesting to apply these interlacing results to problems arising in both pure mathematics and applied network analysis.
Acknowledgments.
The author would like to thank Tetsuo Hatsuda (RIKEN iTHEMS) and the organizers of the International Conference on Blockchains and their Applications (Kyoto 2021) for the invitation. This work was supported by The Alan Turing Institute under the EPSRC grant EP/N510129/1.
References
- [1] E. Andreotti, Spectra of hyperstars on public transportation networks, arXiv preprint, arXiv:2004.07831.
- [2] N. Bao, N. Cheng, S. Hernández-Cuenca and V.P. Su, The Quantum Entropy Cone of Hypergraphs, arXiv preprint, arXiv:2002.05317 (2020).
- [3] Á. Bodó, G.Y. Katona and P.L. Simon, SIS epidemic propagation on hypergraphs, Bull. Math. Biol. 78(4), 713–735 (2016).
- [4] S. Butler, Interlacing for weighted graphs using the normalized Laplacian, Electron. J. Linear Algebra 16, 90–98 (2007).
- [5] F. Chung, Spectral graph theory, American Mathematical Society (1997).
- [6] C. Curto, What can topology tell us about the neural code?, Bull. Amer. Math. Soc. 54, 63–78 (2017).
- [7] W.H. Haemers, Interlacing eigenvalues and graphs, Linear Algebra Appl. 226–228, 593–616 (1995).
- [8] F.J. Hall, The Adjacency Matrix, Standard Laplacian, and Normalized Laplacian, and Some Eigenvalue Interlacing Results, Lecture notes, Georgia State University (2010).
- [9] Y. Hirono, T. Okada, H. Miyazaki and Y. Hidaka, Structural reduction of chemical reaction networks based on topology, arXiv preprint, arXiv:2102.07687 (2021).
- [10] D. Horak and J. Jost, Spectra of combinatorial Laplace operators on simplicial complexes, Adv. Math. 244, 303–336 (2013).
- [11] R.A. Horn and C.R. Johnson, Matrix Analysis, Cambridge University Press, second edition (2013).
- [12] J. Jost and R. Mulas, Hypergraph Laplace operators for chemical reaction networks, Adv. Math. 351 (2019), 870–896.
- [13] J. Jost and R. Mulas, Normalized Laplace Operators for Hypergraphs with Real Coefficients, J. Complex Netw. 9(1), cnab009. DOI:10.1093/comnet/cnab009 (2021).
- [14] J. Jost, R. Mulas and F. Münch, Spectral gap of the largest eigenvalue of the normalized graph Laplacian, Communications in Mathematics and Statistics, DOI:10.1007/s40304-020-00222-7 (2021).
- [15] S. Klamt, U.U. Haus and F. Theis, Hypergraphs and cellular networks, PLoS Comp. Biol. 5(5), e1000385 (2009).
- [16] N. Lanchier and J. Neufer, Stochastic dynamics on hypergraphs and the spatial majority rule model, J. Stat. Phys. 151(1), 21–45 (2013).
- [17] S. Ranshous, C.A. Joslyn, S. Kreyling, K. Nowak, N.F. Samatova, C.L. West and S. Winters, Exchange Pattern Mining in the Bitcoin Transaction Directed Hypergraph, in International Conference on Financial Cryptography and Data Security, pp. 248–263, Springer, Cham (2017).
- [18] N. Reff, Spectral properties of oriented hypergraphs, Electron. J. Linear Algebra 27 (2014).
- [19] N. Reff and L. Rusnak, An oriented hypergraphic approach to algebraic graph theory, Linear Algebra Appl. 437, 2262–2270 (2012).
- [20] Z.K. Zhang and C. Liu, A hypergraph model of social tagging networks, J. Stat. Mech. 2010, P10005 (2010).