This paper was converted on www.awesomepapers.org from LaTeX by an anonymous user.
Want to know more? Visit the Converter page.

Lower bounding the MaxCut of high girth 3-regular graphs using the QAOA

Edward Farhi Google Quantum AI, Venice, CA 90291 Center for Theoretical Physics, Massachusetts Institute of Technology, Cambridge, MA 02139 Sam Gutmann Daniel Ranard Walter Burke Institute for Theoretical Physics, California Institute of Technology, Pasadena, CA 91125 Benjamin Villalonga Google Quantum AI, Venice, CA 90291
Abstract

We study MaxCut on 3-regular graphs of minimum girth gg for various gg’s. We obtain new lower bounds on the maximum cut achievable in such graphs by analyzing the Quantum Approximate Optimization Algorithm (QAOA). For g16g\geq 16, at depth p7p\geq 7, the QAOA improves on previously known lower bounds. Our bounds are established through classical numerical analysis of the QAOA’s expected performance. This analysis does not produce the actual cuts but establishes their existence. When implemented on a quantum computer, the QAOA provides an efficient algorithm for finding such cuts, using a constant-depth quantum circuit. To our knowledge, this gives an exponential speedup over the best known classical algorithm guaranteed to achieve cuts of this size on graphs of this girth. We also apply the QAOA to the Maximum Independent Set problem on the same class of graphs.

1 Introduction

The MaxCut problem asks one to partition the vertices of a graph into two subsets to maximize the size of the “cut,” or the set of edges that cross between the subsets. Determining the maximum cut of a graph is NP-hard, one of Karp’s original 21 problems [1], and it remains NP-hard when restricted to 3-regular graphs [2]. Often one studies MaxCut as an approximate optimization problem, with the goal of finding a large cut.

Here we study MaxCut on 3-regular graphs with large girth. The girth of a graph is the length of its shortest cycle. We are interested in two questions: (1) How can we lower bound the maximum cut of a graph in terms of its girth, and (2) How can we use a classical or quantum algorithm to efficiently obtain a cut at least this large? We answer both questions through our analysis of the Quantum Approximate Optimization Algorithm (QAOA) [3]. While the first question is a mathematical question that does not concern algorithms, we prove a new lower bound constructively, by proving a performance guarantee on the QAOA applied to 3-regular graphs of sufficient girth. Here we have analyzed the performance of the QAOA without the need to actually run the algorithm. To find a cut of that size using the QAOA, you need to run the algorithm on quantum hardware. To our knowledge, the QAOA then provides an exponential speedup over the best known classical algorithms guaranteed to achieve a cut of this size, which require exponential time.

We quantify a cut by the cut fraction, that is, the fraction of edges that appear in the cut. For a graph GG, we can ask about the cut fraction of the largest cut, or MaxCut(G)/|E(G)|\text{MaxCut}(G)/|E(G)| for edge set E(G)E(G). The smallest possible maximum cut fraction among all 3-regular graphs of girth at least gg is denoted

Mg=inf3-regular graphs Ggirth(G)gMaxCut(G)|E(G)|.\displaystyle M_{g}=\inf_{\begin{subarray}{c}\text{3-regular graphs }G\\ \text{girth(G)}\geq g\end{subarray}}\frac{\text{MaxCut}(G)}{|E(G)|}. (1)

We use the infimum because the set of graphs GG with girth(GG)g\geq g is infinite, but (1) means that every graph GG of girth at least gg has a cut of size at least |E(G)|Mg|E(G)|M_{g}. The numerical value of MgM_{g} is currently unknown for general gg.

Refer to caption
Figure 1: Edge neighborhood of the central edge of a 3-regular graph at p=3p=3 and girth g8g\geq 8. Every edge in the graph has this neighborhood structure at this minimum girth. We evaluate c~edge(p)\tilde{c}_{\rm edge}(p) which is the optimal quantum expected value of the cost function on the central edge.

In this paper, we obtain new rigorous lower bounds on MgM_{g}. We do this by predicting the performance of the QAOA for MaxCut on large girth 3-regular graphs. MaxCut may be viewed as an optimization problem over bit strings of length |V(G)||V(G)|, where V(G)V(G) is the vertex set, and each bit string indicates a partition of the graph into two subsets. The QAOA is a quantum algorithm for approximate optimization over bit strings. It has a depth parameter pp and performance can only improve as pp increases. The QAOA produces a quantum state where the expectation of the MaxCut cost function is guaranteed to have a certain value. This means that there must exist cuts of at least this value. The MaxCut cost function is a sum of terms from each edge of the graph. For high-girth graphs, at each edge the neighborhood relevant to the QAOA is a tree. See Fig. 1 for an example at p=3p=3. To guarantee this we need g2p+2g\geq 2p+2. Each of these tree neighborhoods is isomorphic and at optimal parameters makes a contribution of c~edge(p)\tilde{c}_{\rm edge}(p) for each edge of the graph. The total contribution to the quantum expected value of the cost, at optimal parameters, is |E(G)|c~edge(p)|E(G)|\tilde{c}_{\rm edge}(p). The size of the largest cut must be at least the size of the cut found by the QAOA. So we then have

Mgc~edge(p)M_{g}\geq\tilde{c}_{\rm edge}(p) (2)

for g2p+2g\geq 2p+2. So MgM_{g} is lower bounded by a quantum expectation value.

Our paper explains how we calculate c~edge(p)\tilde{c}_{\rm edge}(p) with classical numerical computation. We get values for pp up to 1717, corresponding to gg of 3636. The numerical computations are highly accurate and the numbers we quote are good to at least four digits. In fact we have the best lower bound known to us for MgM_{g} for any g16g\geq 16, improving on previous results by Thompson, Parekh, and Marwaha [4]. At p=17p=17 and g=36g=36 we are guaranteed a cut fraction of c~edge(p=17)=0.8971\tilde{c}_{\rm edge}(p\mathord{=}17)=0.8971. See Fig. 2. Separately, from Refs. [5] and [6], one finds limgMg0.912\lim_{g\to\infty}M_{g}\geq 0.912.

Actually running the QAOA on a graph GG has time-complexity O(|E(G)|)O(|E(G)|), and it uses a constant-depth quantum circuit. For any 3-regular graph of girth g2p+2g\geq 2p+2, by using repeated applications of the QAOA, with total time-complexity O(|E(G)|2)O(|E(G)|^{2}), we can obtain a cut of size at least |E(G)|c~edge(p)\lfloor|E(G)|\tilde{c}_{\rm edge}(p)\rfloor with probability 2/32/3. This may be viewed as an optimization or search problem with a promise (about the girth), with the goal of obtaining a cut of size above this threshold. There exist several classical algorithms for MaxCut, and we do not claim that the QAOA is superior in practice. However, besides the QAOA, we do not know any quantum or classical algorithms proven to solve this promise problem in subexponential time.

A natural point of comparison is the celebrated Goemans-Williamson (GW) algorithm [7]. The success of approximation algorithms is often measured by their approximation ratio: the ratio of the obtained value to the optimal value. The GW algorithm guarantees an approximation ratio of 0.878 for general graphs, and an improved ratio of 0.932 when specialized to graphs of maximum degree 3 [8]. Assuming the Unique Games Conjecture [9], it is NP-hard to exceed the GW algorithm’s 0.878 guarantee for the worst case. Our present analysis of the QAOA, however, focuses on cut fraction rather than approximation ratio. While our highest cut fraction guarantee of 0.89710.8971 immediately guarantees an approximation ratio at least this size, such an approximation ratio is already exceeded by the specialized GW algorithm. Meanwhile, the GW algorithm does not provide any direct guarantee on cut fraction. So given a graph of girth g36g\geq 36, with the task of finding a cut of size at least 0.8971|E(G)|0.8971|E(G)|, the GW algorithm is not guaranteed to succeed in general, while our specification of the QAOA provides an efficient algorithm. On the other hand, in the particular case of bipartite graphs (of any girth) the GW algorithm achieves the perfect cut, while the QAOA generally does not.

We briefly review QAOA, then describe the classical numerical methods used to obtain the performance guarantee. Our calculations are similar to the original calculations of Ref. [3], though performed at larger depth with distinct methods. We draw inspiration from the tensor network methods of Ref. [10], where the same QAOA quantities were calculated, though at lower depth pp. See also Refs. [11, 12] for related calculations at lower depth but including graphs of higher degree. Our main technical contribution is to analyze the QAOA for MaxCut on 3-regular graphs of large girth, using modified numerical methods to allow higher depth than previously obtained. We then interpret these results in relation to previous lower bounds for the maximum cut and previous algorithms for approximating its value. Finally we apply the QAOA to the problem of Maximum Independent Set on high-girth 3-regular graphs.

2 Review of the QAOA

The Quantum Approximate Optimization Algorithm (QAOA) is a quantum algorithm for finding approximate solutions to combinatorial optimization problems. We seek to optimize an objective function CC over bit strings, which is usually a sum over terms that each involves a few bits. The QAOA depends on an integer parameter p1p\geq 1 and produces quantum states of the form

|𝜸,𝜷=U(B,βp)U(C,γp)U(B,β1)U(C,γ1)|s.|{\boldsymbol{\gamma}},{\boldsymbol{\beta}}\rangle=U(B,\beta_{p})U(C,\gamma_{p})\cdots U(B,\beta_{1})U(C,\gamma_{1})|s\rangle. (3)

Here |s|s\rangle is the uniform superposition over computational basis states, U(C,γ)=eiγCU(C,\gamma)=e^{-i\gamma C} is diagonal in the computational basis, and U(B,β)=eiβBU(B,\beta)=e^{-i\beta B} where B=jXjB=\sum_{j}X_{j} is the sum of single-qubit Pauli X operators. The angles 𝜸=(γ1,,γp){\boldsymbol{\gamma}}=(\gamma_{1},\ldots,\gamma_{p}) and 𝜷=(β1,,βp){\boldsymbol{\beta}}=(\beta_{1},\ldots,\beta_{p}) are classical parameters which specify the QAOA state. For MaxCut, given a graph with vertices VV and edges EE, the cost function operator counts edges crossing between two subsets in a partition,

C=(j,k)E1ZjZk2.C=\sum_{(j,k)\in E}\frac{1-Z_{j}Z_{k}}{2}. (4)

When measured in the computational basis, the state |𝜸,𝜷|{\boldsymbol{\gamma}},{\boldsymbol{\beta}}\rangle produces a bit string with a cost function value whose expectation is

Fp(𝜸,𝜷)=𝜸,𝜷|C|𝜸,𝜷.F_{p}({\boldsymbol{\gamma}},{\boldsymbol{\beta}})=\langle{\boldsymbol{\gamma}},{\boldsymbol{\beta}}|C|{\boldsymbol{\gamma}},{\boldsymbol{\beta}}\rangle. (5)

The angles (𝜸,𝜷)({\boldsymbol{\gamma}},{\boldsymbol{\beta}}) are optimized to maximize the expectation value Fp(𝜸,𝜷)F_{p}({\boldsymbol{\gamma}},{\boldsymbol{\beta}}). The quantum circuit depth grows with pp, and the performance at optimal parameters can only improve with larger pp.

3 Pre-computing QAOA parameters for graphs with large girth

Traditionally, the QAOA is executed by applying the quantum circuit with initial parameters, estimating FpF_{p} through measurements, then using classical optimization to update (𝜸,𝜷)({\boldsymbol{\gamma}},{\boldsymbol{\beta}}) and repeating the process. Here we take a different approach, emphasized especially by Ref. [10], where parameters are chosen in advance for all graphs of a given girth.

First note that the expectation value Fp(𝜸,𝜷)F_{p}({\boldsymbol{\gamma}},{\boldsymbol{\beta}}) can be decomposed as a sum over edge terms. For MaxCut, each term depends only on the subgraph within distance pp of that edge. When a graph has girth at least

g2p+2\displaystyle g\geq 2p+2 (6)

these neighborhoods are trees. Moreover, for all 3-regular graphs with this minimum girth, these trees are all isomorphic and make the same contribution to Fp(𝜸,𝜷)F_{p}({\boldsymbol{\gamma}},{\boldsymbol{\beta}}). We then can write

Fp(𝜸,𝜷)=|E(G)|cedge(𝜸,𝜷)\displaystyle F_{p}({\boldsymbol{\gamma}},{\boldsymbol{\beta}})=|E(G)|\leavevmode\nobreak\ c_{\rm edge}({\boldsymbol{\gamma}},{\boldsymbol{\beta}}) (7)

where

cedge(𝜸,𝜷)=1𝜸,𝜷|ZiZj|𝜸,𝜷2\displaystyle c_{\rm edge}({\boldsymbol{\gamma}},{\boldsymbol{\beta}})=\frac{1-\langle{\boldsymbol{\gamma}},{\boldsymbol{\beta}}|Z_{i}Z_{j}|{\boldsymbol{\gamma}},{\boldsymbol{\beta}}\rangle}{2} (8)

and (i,j)E(G)(i,j)\in E(G) can be any pair of neighboring nodes in GG since they all make identical contributions. Since (7) holds for all 3-regular graphs of girth at least gg, we have

Mgcedge(𝜸,𝜷)\displaystyle M_{g}\geq c_{\rm edge}({\boldsymbol{\gamma}},{\boldsymbol{\beta}}) (9)

for any 𝜸,𝜷{\boldsymbol{\gamma}},{\boldsymbol{\beta}}. By finding optimal (or near optimal) parameters we improve the bound. We later discuss how we find the near optimal parameters 𝜸~,𝜷~\boldsymbol{\tilde{\gamma}},\boldsymbol{\tilde{\beta}}. Let

c~edge(p)=cedge(𝜸~,𝜷~).\displaystyle\tilde{c}_{\rm edge}(p)=c_{\rm edge}(\boldsymbol{\tilde{\gamma}},\boldsymbol{\tilde{\beta}}). (10)

Then we have

Mgc~edge(p)\displaystyle M_{g}\geq\tilde{c}_{\rm edge}(p) (11)

for any p(g2)/2p\leq(g-2)/2.

Wurtz and Lykov [10] computed c~edge(p)\tilde{c}_{\rm edge}(p) up to p=11p=11 and we reproduce these numbers. We compute up to p=17p=17. More precisely, for any fixed 𝜸,𝜷{\boldsymbol{\gamma}},{\boldsymbol{\beta}}, we compute cedge(𝜸,𝜷)c_{\rm edge}({\boldsymbol{\gamma}},{\boldsymbol{\beta}}) numerically using exact tensor network methods. The numerical error in the computation of cedge(𝜸,𝜷)c_{\rm edge}({\boldsymbol{\gamma}},{\boldsymbol{\beta}}) is negligible compared to the 4-digit accuracy reported in our results. Then we maximize to obtain some approximately optimal parameters 𝜸~,𝜷~\boldsymbol{\tilde{\gamma}},\boldsymbol{\tilde{\beta}}. Despite this approximate optimization, the value c~edge(p)\tilde{c}_{\rm edge}(p) then serves as a precise lower bound for MgM_{g}, due to (11).

When running the QAOA for graphs of girth greater than 36, it would be helpful to pre-compute the optimal parameters for p>17p>17, which we have not done. For sufficiently large pp this may be intractable, or it may be well-approximated by extrapolation of the optimal parameters from smaller pp to larger pp. Regardless, for the purpose of proposing a formal algorithm, for all 3-regular graphs of girth greater than 36, we propose running the p=17p=17 QAOA with our fixed, pre-computed parameters. This protocol already gives an algorithm with polynomial runtime with respect to graph size, with the best currently known performance guarantee on cut fraction. The only other algorithms we currently know with the same performance guarantee take exponential time. One example is the the brute force algorithm, which finds the best cut in exponential time, and is therefore guaranteed to find a cut of size at least 0.8971|E(G)|0.8971|E(G)|, whose existence follows from our present results. A classical algorithm of Williams [13] finds the best cut in exponential time but using a smaller exponent than brute force search.

4 Analyzing time-complexity

Here we detail the runtime of the QAOA as an algorithm running on a quantum computer to find an actual cut. (This analysis is separate from the classical numerical computations discussed in Section 5.2, which establish performance guarantees and serve as a pre-computation that is independent of problem instance.) We focus on the QAOA for dd-regular graphs on |V(G)||V(G)| vertices, treating dd as a constant. The MaxCutMaxCut problem size is the number of edges, |E(G)|=(d/2)|V(G)||E(G)|=(d/2)|V(G)|. The QAOA at depth pp uses O(p|E(G)|)O(p|E(G)|) total gates. When analyzing the runtime of quantum algorithms, we are interested in both the total number of gates and also the circuit depth, which counts the minimal number of layers such that each layer involves non-overlapping gates.

Refer to caption
Figure 2: Lower bound on MgM_{g} for 3-regular graphs given by the present work (blue crosses). As a comparison we show the results of Thompson-Parekh-Marwaha (TPM) [4] in orange. The QAOA lower bound exceeds the TPM lower bound at g16g\geq 16 (corresponding to p7p\geq 7). The QAOA lower bound exceeds the TPM gg\to\infty bound at g32g\geq 32 (p15)p\geq 15).
Refer to caption
Figure 3: Optimized parameters 𝜸~\boldsymbol{\tilde{\gamma}} and 𝜷~\boldsymbol{\tilde{\beta}} as a function of (j1)/(p1)(j-1)/(p-1) for different values of pp up to p=17. These figures suggest that the optimal parameters might approach fixed curves as pp increases.

While the parameter pp is sometimes called the “depth” of the QAOA, its relation to circuit depth depends on the graph. The unitary U(B,β)U(B,\beta) can be implemented in a single layer of depth 1. On the other hand, while U(C,γ)=eiγCU(C,\gamma)=e^{-i\gamma C} is naturally implemented by a two-qubit gate for every edge, these gates overlap whenever two edges share a vertex, so U(C,γ)U(C,\gamma) requires circuit depth larger than 1. Szegedy noted that one can use Vizing’s theorem to calculate the circuit depth [14]. For graph GG, the “edge chromatic number” χ(G)\chi^{\prime}(G) is the minimal number of colors required for an edge-coloring where no two adjacent edges share the same color. By using a layer of gates for each color, we see U(C,γ)U(C,\gamma) can be implemented in depth χ(G)\chi^{\prime}(G) using 2-local gates. Vizing’s theorem states that for general graphs, χ(G)Δ(G)+1\chi^{\prime}(G)\leq\Delta(G)+1, where Δ(G)\Delta(G) is the maximum degree. Again treating dd as a constant, we conclude U(C,γ)U(C,\gamma) has O(1)O(1) circuit depth, and the full QAOA has circuit depth O(p)O(p). To achieve this O(p)O(p)-depth circuit, we need to classically pre-compute to actually find one of the colorings guaranteed by Vizing’s theorem. For a bounded degree graph, this computation runs in time O(|E(G)|)O(|E(G)|) [15], the same as the problem size, hence not contributing to the asymptotic complexity.

In this section, when we analyze the time complexity of running the QAOA on a quantum computer at fixed pp, we imagine running with fixed parameters 𝜸,𝜷{\boldsymbol{\gamma}},{\boldsymbol{\beta}} given in advance. There is no outer loop variational search. The quantum circuit uses |V(G)||V(G)| qubits, with O(|E(G)|)=O(|V(G)|)O(|E(G)|)=O(|V(G)|) gates and constant circuit depth.

After running the QAOA circuit and performing a measurement in the computational basis, we obtain a cut of the graph that depends on the measurement outcome. The expected value of the cut size is |E(G)|c~edge(p)|E(G)|\tilde{c}_{\rm edge}(p). We can also ask for a guarantee that the cut is above (the floor of) this expected value with high probability. To that end, repeat the QAOA circuit and measurement many times and record the best outcome. The probability of sampling a cut size of at least |E(G)|c~edge(p)\lfloor|E(G)|\tilde{c}_{\rm edge}(p)\rfloor with a single sample is at least 1/|E(G)|1/|E(G)|. So with O(|E(G)|)O(|E(G)|) repetitions, we obtain a sample with cut at least |E(G)|c~edge(p)\lfloor|E(G)|\tilde{c}_{\rm edge}(p)\rfloor, with probability at least 2/32/3 (or any constant probability below 1).

5 Numerical results and methods

5.1 Results

pp 1 2 3 4 5 6 7 8 9
c~edge\tilde{c}_{\rm edge} 0.69240.6924 0.75590.7559 0.79230.7923 0.81680.8168 0.83630.8363 0.84980.8498 0.85970.8597 0.86730.8673 0.87340.8734
pp 10 11 12 13 14 15 16 17
c~edge\tilde{c}_{\rm edge} 0.87840.8784 0.88250.8825 0.88590.8859 0.88880.8888 0.89130.8913 0.89350.8935 0.89540.8954 0.89710.8971
Table 1: cedgec_{\rm edge} at optimized angles 𝜸~\boldsymbol{\tilde{\gamma}} and 𝜷~\boldsymbol{\tilde{\beta}} as a function of pp up to p=17p=17.

In order to maximize the quantum expected value of the cut size, we numerically evaluate the quantum expectation value of the cost function of Eq. (4). As we emphasized before, at the QAOA depths we consider, on these high girth graphs, each edge has an isomorphic tree neighborhood and so each edge gives the same contribution. We find values of (𝜸,𝜷)({\boldsymbol{\gamma}},{\boldsymbol{\beta}}) that approximately maximize cedge(𝜸,𝜷)c_{\rm edge}({\boldsymbol{\gamma}},{\boldsymbol{\beta}}). For fixed (𝜸,𝜷)({\boldsymbol{\gamma}},{\boldsymbol{\beta}}) the quantum expectation is evaluated using the tensor network contraction method described in Section 5.2. The blue crosses in Fig. 2 show the optimized values of cedge(𝜸,𝜷)c_{\rm edge}({\boldsymbol{\gamma}},{\boldsymbol{\beta}}) at approximately optimal parameters, c~edge(p)=cedge(𝜸~,𝜷~)\tilde{c}_{\rm edge}(p)=c_{\rm edge}(\boldsymbol{\tilde{\gamma}},\boldsymbol{\tilde{\beta}}). The values are listed in Table 1. The parameters 𝜸~\boldsymbol{\tilde{\gamma}} and 𝜷~\boldsymbol{\tilde{\beta}} are shown in Fig. 3 for different values of pp.

5.2 Methods

In order to evaluate cedge(𝜸,𝜷)c_{\rm edge}({\boldsymbol{\gamma}},{\boldsymbol{\beta}}), we consider the operator ZiZjZ_{i}Z_{j}, as well as all quantum gates in the QAOA circuit contained in the light cone of this operator. In the simple case of d=2d=2, i.e., when GG is a line, the tensor network that evaluates ZiZj\langle Z_{i}Z_{j}\rangle is that of Fig. 5(a). Here we have followed the tensor definitions:

[Uncaptioned image] =12a\displaystyle=\quad\frac{1}{\sqrt{2}}\quad\forall a [Uncaptioned image] ={eiγifa=beiγifab\displaystyle=\quad\begin{cases}e^{i\gamma}&{\rm if}\,\,a=b\\ e^{-i\gamma}&{\rm if}\,\,a\neq b\end{cases}
[Uncaptioned image] ={cos(β)ifa=bisin(β)ifab\displaystyle=\quad\begin{cases}\cos{(\beta)}&{\rm if}\,\,a=b\\ -i\sin{(\beta)}&{\rm if}\,\,a\neq b\end{cases} [Uncaptioned image] ={1ifa=b=01ifa=b=10otherwise\displaystyle=\quad\begin{cases}1&{\rm if}\,\,a=b=0\\ -1&{\rm if}\,\,a=b=1\\ 0&{\rm otherwise}\end{cases} (12)

where all tensor indices have support {0,1}\{0,1\}. Note that every gate of the form eiγZiZje^{i\gamma Z_{i}Z_{j}} is diagonal, which we explicitly exploit in writing its corresponding tensor over only two variables and making use of hyperindices in the tensor network, corresponding to hyperedges in the underlying network.

Refer to caption
Figure 4: We plot c~edge\tilde{c}_{\rm edge} which is cedgec_{\rm edge} at optimized angles 𝜸~\boldsymbol{\tilde{\gamma}} and 𝜷~\boldsymbol{\tilde{\beta}} as a function of 1/p1/p. The value 0.912 is the lower bound on limgMg\lim_{g\to\infty}M_{g} given by Refs. [6, 5]. If c~edge\tilde{c}_{\rm edge} were to exceed this value at larger pp, it would provide a new lower bound on limgMg\lim_{g\to\infty}M_{g}. The value 0.9351 is the upper bound on the expected cut fraction of large random 33-regular graphs given in Refs. [16, 17], and c~edge\tilde{c}_{\rm edge} cannot exceed this value.

In the generic case of d>2d>2 the number of qubits in the light-cone of the ZiZjZ_{i}Z_{j} operator grows exponentially with pp. For a 3-regular graph (i.e. d=3d=3), at p=1,2,3,p=1,2,3,\ldots the size of the light cone is 6,14,30,6,14,30,\ldots In general, for a dd-regular graph, the number of qubits at depth pp is 2(d1)p+11d22\frac{(d-1)^{p+1}-1}{d-2}. For d=3d=3 and p=17p=17 the size of the light-cone is 524,286 qubits. However, due to the fact that all branches in the regular tree are identical, we can perform this computation in a compact way that is not affected by the exponential growth in the number of qubits in the calculation. We contract a single branch inwards towards the root of the tree, raising its tensor entries to the (d1)(d-1)th power before proceeding to the next level of the tree. This is expressed in graphical notation in Fig. 5(b), where we have made use of the definition

[Uncaptioned image](Ta1,a2,,an)d1\displaystyle\vbox{\hbox{\includegraphics[width=78.04842pt]{figures/power_tensor.pdf}}}\equiv\quad\left(T_{a_{1},a_{2},\ldots,a_{n}}\right)^{d-1} (13)

for the entrywise exponentiation of a tensor. Note that the cost of the evaluation of Eq. (8) as expressed in Fig. 5(b) has both time and space complexities that grow as 𝒪(22p)\mathcal{O}(2^{2p}). This is quadratically better than the time complexity reported in Refs. [11] and [12] for finite dd. Note also that the cost is independent of dd, in contrast to that of the method used in Ref. [10], which scales exponentially in dd and was run up to p=11p=11 at d=3d=3 and lower values of pp at larger dd. This allows us to evaluate and optimize Eq. (8) up to p=17p=17 for any value of dd. Our implementation of the method is written in C++ and parallelized using OpenMP [18]. We also make use of the Eigen library for the manipulation of vectors [19] as well as the LBFGS++ library, which implements the Limited-memory BFGS algorithm for unconstrained optimization problems [20].

We remind the reader that all of our numerical methods are exact. We use computers to evaluate expressions, but there are no approximations. For d=3d=3 and at depth pp we evaluate cedge(𝜸,𝜷)c_{\rm edge}({\boldsymbol{\gamma}},{\boldsymbol{\beta}}) on a tree with (2(p+2)2)(2^{(p+2)}-2) vertices at a computational cost of O(4p)O(4^{p}). We go to p of 17. An alternate approach would be to use a quantum computer with (2(p+2)2)(2^{(p+2)}-2) qubits. Here we would evaluate the central edge of the tree using the full QAOA cost. Although we would be running a quantum computer, we would not be finding cuts but rather estimates of lower bounds on MaxCut values. It appears that this scales more favorably than our exact calculation of lower bounds, at least while d4d\leq 4. For this method to go beyond our p=17p=17 result requires a highly accurate quantum computer capable of handling graphs with at least one million vertices. Repeated measurements would extract an accurate estimate of the quantum expectation but not a proof of a lower bound.

(a) Refer to caption (b) Refer to caption

Figure 5: Tensor network for the computation of 𝜸,𝜷|ZiZj|𝜸,𝜷\langle{\boldsymbol{\gamma}},{\boldsymbol{\beta}}|Z_{i}Z_{j}|{\boldsymbol{\gamma}},{\boldsymbol{\beta}}\rangle for p=3p=3. On the left (a) we have d=2d=2 and on the right (b) arbitrary dd. In the latter case, the tensor network diagramatic notation is extended to denote extry-wise exponentiation of a tensor. In particular, the result of contracting the tensors in one of the colored boxes is raised to the power (d1)(d-1) before proceeding to later contractions, as expressed in Eq. (13). The time and space complexities of the contraction performed in this way are both 𝒪(22p)\mathcal{O}(2^{2p}). The complexity does not depend on dd. Higher values of pp are tackled in a similar fashion.

6 MaxCut Comparisons

We can directly compare our results with those of Thompson, Parekh and Marwaha [4]. They have a classical algorithm for MaxCut which they apply to large girth graphs. They lower bound the performance of their algorithm to obtain lower bounds on MgM_{g} for all gg. Using the formula found in Theorem 1 of their paper we can compare with our results. See Fig. 2. For any g16g\geq 16 the QAOA (at appropriate pp) finds cuts bigger than the TPM guarantees. Note that the limit as gg goes to infinity of their bound is 0.89180.8918 which we exceed at gg of 3232.

The results of Csóka et al [5] and Gamarnik and Li [6] imply that the limit as gg goes to infinity of MgM_{g} is greater than or equal to 0.912. (These methods could in principle be used to find bounds on MgM_{g} for finite gg, but as far as we know this has not been done.) Our numerical techniques are stretched to the limit at pp of 1717 and we do not have an analytic way of taking pp to infinity. See Fig. 4 where we plot c~edge\tilde{c}_{\rm edge} versus 1/p1/p and also show the target of 0.912. The reader can decide if we pass this target as pp increases, an empirical question left for future computations.

The graphs which we have considered have large girth and every edge sits in a tree neighborhood. We can ask about large random 3-regular graphs where almost all edges sit in tree neighborhoods. Such graphs have an order unity number of triangles, squares, pentagons, or any cycle of constant length, which means that they are not strictly large girth. However, since there are so few short cycles, any lower bound on MgM_{g} for any gg is a lower bound on the cut fraction of a typical large random 3-regular graph [6]. Furthermore the QAOA at level pp achieves cut fraction c~edge(p)\tilde{c}_{\rm edge}(p) on these graphs. There is an upper bound on the cut fraction of typical large random 3-regular graphs of 0.9351, described in Ref. [21] and shown by Hladky and McKay [16, 17]. Therefore the QAOA cut fraction c~edge(p)\tilde{c}_{\rm edge}(p) cannot exceed 0.9351 even as pp\to\infty. This value is shown in Fig. 4.

7 Maximum Independent Set

An independent set is a subset of the vertices of a graph with the property that there are no edges between any two members of the subset. The Maximum Independent Set problem (MIS) is to find the biggest independent set. The MIS problem is NP-hard for general graphs. Here we will use a general connection between independent sets and MaxCut that allows us to use our MaxCut results to get quick bounds on the independence ratio which is the fraction of vertices in the largest independent set. We then apply a variant of the QAOA to large-girth 3-regular graphs to establish better bounds on the independence ratio. We are not aware of any other bounds for MIS on this class of fixed girth graphs. However there are results in the limit as the girth goes to infinity [22].

pp 1 2 3 4 5 6 7 8 9
Indep. ratio (2 params.) 0.26930.2693 0.31690.3169 0.34420.3442 0.36260.3626 0.37720.3772 0.38740.3874 0.39480.3948 0.40050.4005 0.4051
Indep. ratio (3 params.) 0.28520.2852 0.33240.3324 0.35910.3591 0.37490.3749 0.38610.3861 0.39420.3942 0.40050.4005 0.40540.4054 0.4094
pp 10 11 12 13 14 15 16 17
Indep. ratio (2 params.) 0.40880.4088 0.41180.4118 0.41440.4144 0.41660.4166 0.41850.4185 0.42010.4201 0.42160.4216 0.4228
Indep. ratio (3 params.) 0.41260.4126 0.41540.4154 0.41770.4177 0.41970.4197 0.42150.4215 0.42300.4230 0.4244
Table 2: Independence ratio achieved by the QAOA for various values of pp.

A convenient local cost function for the MIS problem is

I1=iVbii,jEbibj,I_{1}=\sum_{i\in V}b_{i}-\sum_{\langle i,j\rangle\in E}b_{i}b_{j}, (14)

written as a function of the bit string (b1,,b|V|)(b_{1},\ldots,b_{|V|}), where each bit string also represents a subset of the vertex set VV, with bi=1b_{i}=1 if vertex ii is in the subset. Note this cost function is defined on all subsets and not just independent sets. The first term of I1I_{1} is the Hamming weight which we want to make big, and the subtracted term counts violations of the independent set property. We now argue that given any bit string with associated cost I1I_{1}, there exists an independent set of size at least I1I_{1}. In particular, we consider the set of vertices labeled 1 in the bit string, and we construct a subset of these vertices that forms an independent set of size at least I1I_{1}. To begin, given a bit string with cost I1I_{1}, assume that the set of 11’s is not yet an independent set. Choose any violated edge i,j\langle i,j\rangle, that is with bi=bj=1b_{i}=b_{j}=1, then choose either ii or jj and re-label it as 0, that is, remove the vertex from the set under consideration. Consider the cost function I1I_{1} for this new string: the bit flip decreases the Hamming weight by 11 and decreases the number of violations by at least 11, so I1I_{1} cannot decrease. Repeat this until there are no more violations so the final bit string must have 11’s that form a valid independent set. The new value of I1I_{1} is equal the size of the independent set which must be at least the original value of I1I_{1}. Now the maximum of I1I_{1} occurs when bb corresponds to an actual maximum independent set so achieving a high value of I1I_{1} gives an approximation to the size of the largest independent set.

We now use the connection between MaxCut and independent sets to get a general bound on MIS. Consider the problem of maximizing the total number of vertices in two disjoint independent sets. We consider a cost function given by the sum of two terms, one for each set:

I2=[iVbii,jEbibj]+[iV(1bi)i,jE(1bi)(1bj)].I_{2}=\left[\sum_{i\in V}b_{i}-\sum_{\langle i,j\rangle\in E}b_{i}b_{j}\right]+\left[\sum_{i\in V}(1-b_{i})-\sum_{\langle i,j\rangle\in E}(1-b_{i})(1-b_{j})\right]. (15)

Write the two terms as I2=I2,1+I2,0I_{2}=I_{2,1}+I_{2,0}. For any input bit string, the 11’s represent one set and the 0’s the complementary set. (Note that 0 and 11 here do not mean what they meant in the previous paragraph.) By the above argument regarding I1I_{1}, first applied to I2,1I_{2,1}, there exists a subset of 11’s that forms an independent set, with size at least I2,1I_{2,1}. Meanwhile, the same argument applied to I2,0I_{2,0} implies there exists a subset of 0’s that forms an independent set, with size at least I2,0I_{2,0}. Thus we have two disjoint independent sets of total size at least I2I_{2}.

We can rewrite Eq. (15) to get

I2=|V||E|+i,jE(bi+bj2bibj)I_{2}=|V|-|E|+\sum_{\langle i,j\rangle\in E}(b_{i}+b_{j}-2b_{i}b_{j}) (16)

where the sum on edges is the MaxCut cost. Let ww be the maximum fraction of combined vertices in two disjoint independent sets. Then for any graph,

wI2|V|=1|E||V|+C(b)|V|w\geq\frac{I_{2}}{|V|}=1-\frac{|E|}{|V|}+\frac{C(b)}{|V|} (17)

where C(b)C(b) is the cut size associated to any bit string bb. For 3-regular graphs we get

w32C(b)|E|12.w\geq\frac{3}{2}\frac{C(b)}{|E|}-\frac{1}{2}. (18)

As an aside, we note an interesting relation between ww and μ\mu, where μ\mu denotes the cut fraction of the best cut:

w=32μ12.w=\frac{3}{2}\mu-\frac{1}{2}. (19)

To see this, first note

w32μ12,w\geq\frac{3}{2}\mu-\frac{1}{2}, (20)

which follows immediately from Eq. (18). This holds for any 3-regular graph with no restriction on girth. Now we refer to Gamarnik and Li [6]. From the argument in their Section 6, one can deduce

μ23w+13.\mu\geq\frac{2}{3}w+\frac{1}{3}. (21)

Together, these two inequalities yield the claimed Eq. (19) and we end our aside.

Refer to caption
Figure 6: We plot the independence ratio for the MIS problem as a function of 1/p1/p. The value 0.4453 is the best available bound on the independence ratio for large-girth 3-regular graphs Ref. [22]. We show bounds on the independence ratio for angles 𝜸{\boldsymbol{\gamma}} and 𝜷{\boldsymbol{\beta}} optimized for MaxCut, as well as the set of parameters (𝜸,𝜸,𝜷)({\boldsymbol{\gamma}},\boldsymbol{\gamma^{\prime}},{\boldsymbol{\beta}}) (see expression (27)). In the latter case we necessarily achieve larger values of the independence ratio, although the improvement over the (𝜸,𝜷)({\boldsymbol{\gamma}},{\boldsymbol{\beta}}) alternative decreases with pp.

Let irir be the independence ratio, the fraction of vertices in the largest independent set. Then irw/2ir\geq w/2, since one of the two independent sets must contain at least half of their combined vertices. So from Eq. (18) we have

ir34C(b)|E|14.ir\geq\frac{3}{4}\frac{C(b)}{|E|}-\frac{1}{4}. (22)

Taking the quantum expectation and using our MaxCut result for large girth 3-regular graphs we have

ir34c~edge(p)14.ir\geq\frac{3}{4}\tilde{c}_{\rm edge}(p)-\frac{1}{4}\,. (23)

So we now have a lower bound on the independence ratio irir for any g2p+2g\geq 2p+2 using the values from Table 1. These values are given as the first line in Table 2. In particular for girth at least 3636 we get a lower bound of 0.42280.4228.

But we can do better. Return to the cost function of Eq. (14). First we need to write it as a sum over edges. For 3-regular graphs,

I1=i,jE[13(bi+bj)bibj].I_{1}=\sum_{\langle i,j\rangle\in E}\left[\frac{1}{3}(b_{i}+b_{j})-b_{i}b_{j}\right]. (24)

Now using the fact that bi=(1zi)/2b_{i}=(1-z_{i})/2 we can write the cost in terms of the ZiZ_{i} operators which is more convenient,

i,jE[12(1212ZiZj)16+112(Zi+Zj)].\sum_{\langle i,j\rangle\in E}\left[\frac{1}{2}\left(\frac{1}{2}-\frac{1}{2}Z_{i}Z_{j}\right)-\frac{1}{6}+\frac{1}{12}(Z_{i}+Z_{j})\right]. (25)

Again we are looking at graphs with g2p+2g\geq 2p+2 so each edge makes an identical contribution to the quantum expectation in the QAOA state. The quantum expectation equals the contribution from any edge times the number of edges |E||E|, that is,

ψ|[12(1212ZiZj)16+112(Zi+Zj)]|ψ×|E|\langle\psi|\left[\frac{1}{2}\left(\frac{1}{2}-\frac{1}{2}Z_{i}Z_{j}\right)-\frac{1}{6}+\frac{1}{12}(Z_{i}+Z_{j})\right]|\psi\rangle\times|E| (26)

where as before i,j\langle i,j\rangle is any edge in the graph, and |ψ|\psi\rangle is some state produced by the QAOA.

We are free to use any local operator to drive the QAOA. Here we modify the cost function part of the driver and but not the sum of the XX’s. We will introduce two parameters, γ\gamma and γ\gamma^{\prime}, for each layer of the cost function unitary. In particular for the driving cost function operator we try

γi,jEZiZj+γiVZi.\gamma\sum_{\langle i,j\rangle\in E}Z_{i}Z_{j}+\gamma^{\prime}\sum_{i\in V}Z_{i}. (27)

Including the β\beta at each layer there are a total of 3p3p parameters. If γ=0\gamma^{\prime}=0, this amounts to using the MaxCut cost function as the driver. Using symmetry we can show that the linear term in the objective in expression (26) vanishes. So in fact with γ=0\gamma^{\prime}=0 both the driver and objective function are those of MaxCut up to constants. Noting that |E|=32|V||E|=\frac{3}{2}|V| and dividing  (26) by |V||V| gives, at optimal parameters, the right hand side of  (23). If the ratio of γ\gamma to γ\gamma^{\prime} is set to the right constant, see expression (25), then the driver is the same as the objective function. So if we optimize over all γ\gamma’s and γ\gamma^{\prime}’s and β\beta’s we do at least as well as using the MaxCut cost function as the driver or the local MIS cost function as the driver. In Table 2 we give lower bounds on the independence ratio for MIS produced by this optimization over 3p3p parameters.

Refer to caption
Figure 7: Optimized parameters 𝜸~\boldsymbol{\tilde{\gamma}}, 𝜸~\boldsymbol{\tilde{\gamma^{\prime}}} and 𝜷~\boldsymbol{\tilde{\beta}} as a function of (j1)/(p1)(j-1)/(p-1) for different values of pp up to p=15 for the MIS problem.

In Fig. 6 we show the lower bounds we get on the independence ratio as a function of 1/p1/p from our MaxCut results and using the 33-parameter per layer ansatz. The 33-parameter ansatz must lie above the other but the difference shrinks as pp grows. The red line is the best available bound on the independence ratio for large girth 3-regular graphs as the girth goes to infinity [22]. The optimized parameters (𝜸~,𝜸~,𝜷~)(\tilde{{\boldsymbol{\gamma}}},\tilde{\boldsymbol{\gamma^{\prime}}},\tilde{{\boldsymbol{\beta}}}) are shown in Fig. 7 for different values of pp.

To find independent sets which meet these guarantees you can run the QAOA on quantum hardware with constant circuit depth for a constant pp. This gives a polynomial-time quantum algorithm for this problem. We know of no classical algorithm that performs as well (in terms of guaranteed independence ratio) on the problem of MIS on 3-regular graphs of girth at least gg.

8 Conclusions

We proved a new lower bound for MaxCut on high-girth graphs by using a classical computer to analyze the performance of a quantum algorithm. This graph-theoretic result holds even if quantum computing is infeasible. We are unaware of other examples where the analysis of quantum algorithmic performance yields similarly novel results.

Running the quantum algorithm on a quantum computer would efficiently find the actual cuts that achieve our lower bounds. This provides an exponential speedup for finding these cuts, compared to known classical algorithms with rigorous guarantees.

9 Acknowledgements

This project was an outgrowth of a project which included Brandon Augustino, Madelyn Cain, Swati Gupta, Eugene Tang and Katherine Van Kirk. We are grateful to them for getting us going. We also thank Ojas Parekh and Kunal Marwaha for reading our manuscript. We thank David Gamarnik for suggesting that we look at MIS. We thank Joao Basso, Stephen Jordan and Mario Szegedy for helpful comments and Leo Zhou for introducing the idea of the last paragraph of Section 5.2. DR acknowledges support by the Simons Foundation under grant 376205.

References

  • [1] Richard M Karp. On the computational complexity of combinatorial problems. Networks, 5(1):45–68, 1975.
  • [2] Mihalis Yannakakis. Node-and edge-deletion np-complete problems. In Proceedings of the tenth annual ACM symposium on Theory of computing, pages 253–264, 1978.
  • [3] Edward Farhi, Jeffrey Goldstone, and Sam Gutmann. A quantum approximate optimization algorithm. arXiv preprint arXiv:1411.4028, 2014.
  • [4] Jessica K Thompson, Ojas Parekh, and Kunal Marwaha. An explicit vector algorithm for high-girth maxcut. In Symposium on Simplicity in Algorithms (SOSA), pages 238–246. SIAM, 2022.
  • [5] Endre Csóka, Balázs Gerencsér, Viktor Harangi, and Bálint Virág. Invariant gaussian processes and independent sets on regular graphs of large girth. Random Structures & Algorithms, 47(2):284–303, 2015.
  • [6] David Gamarnik and Quan Li. On the max-cut of sparse random graphs. Random Structures & Algorithms, 52(2):219–262, 2018.
  • [7] Michel X Goemans and David P Williamson. Improved approximation algorithms for maximum cut and satisfiability problems using semidefinite programming. Journal of the ACM (JACM), 42(6):1115–1145, 1995.
  • [8] Eran Halperin, Dror Livnat, and Uri Zwick. Max cut in cubic graphs. Journal of Algorithms, 53(2):169–185, 2004.
  • [9] Subhash Khot. On the power of unique 2-prover 1-round games. In Proceedings of the thiry-fourth annual ACM symposium on Theory of computing, pages 767–775, 2002.
  • [10] Jonathan Wurtz and Danylo Lykov. The fixed angle conjecture for qaoa on regular maxcut graphs. arXiv preprint arXiv:2107.00677, 2021.
  • [11] Joao Basso, Edward Farhi, Kunal Marwaha, Benjamin Villalonga, and Leo Zhou. The quantum approximate optimization algorithm at high depth for maxcut on large-girth regular graphs and the sherrington-kirkpatrick model. arXiv preprint arXiv:2110.14206, 2021.
  • [12] Elisabeth Wybo and Martin Leib. Missing puzzle pieces in the performance landscape of the quantum approximate optimization algorithm. arXiv preprint arXiv:2406.14618, 2024.
  • [13] Ryan Williams. A new algorithm for optimal 2-constraint satisfaction and its implications. Theoretical Computer Science, 348(2-3):357–365, 2005.
  • [14] Mario Szegedy. What do qaoa energies reveal about graphs? arXiv preprint arXiv:1912.12277, 2019.
  • [15] Anton Bernshteyn and Abhishek Dhawan. Fast algorithms for vizing’s theorem on bounded degree graphs. arXiv preprint arXiv:2303.05408, 2023.
  • [16] Jan Hladkỳ. Structural properties of graphs—probabilistic and deterministic point of view. 2006.
  • [17] Brendan D McKay. Maximum bipartite subgraphs of regular graphs with large girth. In Proc. 13th SE Conf. on Combin. Graph Theory and Computing, Boca Raton, Florida, volume 436, 1982.
  • [18] Leonardo Dagum and Ramesh Menon. OpenMP: an industry standard API for shared-memory programming. Computational Science & Engineering, IEEE, 5(1):46–55, 1998.
  • [19] Gaël Guennebaud, Benoît Jacob, et al. Eigen v3. Online, 2010.
  • [20] Yixuan Qiu and Dirk Toewe. LBFGS++. Online, 2020.
  • [21] František Kardoš, Daniel Král, and Jan Volec. Maximum edge-cuts in cubic graphs with large girth and in random cubic graphs. Random Structures & Algorithms, 41(4):506–520, 2012.
  • [22] Endre Csóka. Independent sets and cuts in large-girth regular graphs. arXiv preprint arXiv:1602.02747, 2016.