This paper was converted on www.awesomepapers.org from LaTeX by an anonymous user.
Want to know more? Visit the Converter page.

institutetext: Center for Quantum Mathematics and Physics (QMAP), Department of Physics,
University of California, Davis, CA 95616, U.S.A.

A More Natural Composite Higgs Model

Hsin-Chia Cheng    and Yi Chung cheng@physics.ucdavis.edu yichung@ucdavis.edu
Abstract

Composite Higgs models provide an attractive solution to the hierarchy problem. However, many realistic models suffer from tuning problems in the Higgs potential. There are often large contributions from the UV dynamics of the composite resonances to the Higgs potential, and tuning between the quadratic term and the quartic term is required to separate the electroweak breaking scale and the compositeness scale. We consider a composite Higgs model based on the SU(6)/Sp(6)SU(6)/Sp(6) coset, where an enhanced symmetry on the fermion resonances can minimize the Higgs quadratic term. Moreover, a Higgs quartic term from the collective symmetry breaking of the little Higgs mechanism can be realized by the partial compositeness couplings between elementary Standard Model fermions and the composite operators, without introducing new elementary fields beyond the Standard Model and the composite sector. The model contains two Higgs doublets, as well as several additional pseudo-Nambu-Goldstone bosons. To avoid tuning, the extra Higgs bosons are expected to be relatively light and may be probed in the future LHC runs. The deviations of the Higgs couplings and the weak gauge boson couplings also provide important tests as they are expected to be close to the current limits in this model.

1 Introduction

The Standard Model (SM) of particle physics successfully describes all known elementary particles and their interactions. At the center of SM is the mechanism of electroweak symmetry breaking (EWSB), which is responsible for the masses of gauge bosons and fermions. The discovery of Higgs bosons in 2012 Chatrchyan:2012xdj ; Aad:2012tfa filled in the last missing piece of the SM. However, the Higgs boson itself brings new questions and puzzles that need to be answered. As a minimal model to realize EWSB, the Higgs field is characterized by the potential

V(H)=μ2|H|2+λ|H|4V(H)=-\mu^{2}|H|^{2}+\lambda|H|^{4} (1)

with just two parameters. The two parameters are now fixed by the observed Higgs vacuum expectation value (VEV) v246v\simeq 246 GeV and Higgs boson mass Mh125M_{h}\simeq 125 GeV as

μ2(88 GeV)2,λ0.13.\mu^{2}\simeq\left(88\text{ GeV}\right)^{2},\qquad\lambda\simeq 0.13~{}. (2)

However, SM does not address the UV-sensitive nature of scalar bosons. The Higgs mass-squared receives quadratically divergent radiative corrections from the interactions with SM fields, which leads to the well-known hierarchy problem. To avoid the large quadratic corrections, the most natural way is to invoke some new symmetry such that the quadratic contributions cancel in the symmetric limit. This requires the presence of new particles related to SM particles by the new symmetry, such as top partners, in order to cut off the divergent loop contributions.

One such appealing solution to the hierarchy problem is the composite Higgs model (CHM), where the Higgs doublet is the pseudo-Nambu-Goldstone boson (pNGB) of a spontaneously broken global symmetry of the underlying strong dynamics Kaplan:1983fs ; Kaplan:1983sm . Through the analogy of the chiral symmetry breaking in quantum chromodynamics (QCD), which naturally introduces light scalar fields, i.e., pions, we can construct models with light Higgs bosons in a similar way. In a CHM, an approximate global symmetry GG is spontaneously broken by some strong dynamics down to a subgroup HH with a symmetry breaking scale ff. The heavy resonances of the strong dynamics are expected to be around the compositeness scale 4πf\sim 4\pi f generically. The pNGBs of the symmetry breaking, on the other hand, can naturally be light with masses <f<f as they are protected by the shift symmetry. The potential of the Higgs field arises from the explicit symmetry breaking effects, such as the interactions with other SM fields. The largest coupling of the Higgs field in SM is to the top quark. As a result, for naturalness, the top partners which regulate the top loop contribution to the Higgs potential should not be too heavy. The top loop contribution to the Higgs mass term can be estimated as

Δμ2Nc8π2yt2MT2(220 GeV)2(MT1.2 TeV)2,\Delta\mu^{2}\sim\frac{N_{c}}{8\pi^{2}}y_{t}^{2}M_{T}^{2}\sim\left(220\text{ GeV}\right)^{2}\left(\frac{M_{T}}{1.2\text{ TeV}}\right)^{2}, (3)

where MTM_{T} is the top partner mass. On the other hand, the bounds on the SM colored top partners have reached beyond 1 TeV from the collider searches Sirunyan:2018omb ; Aaboud:2018pii . Compared with Eq.(2), we see that the models with colored top partners (including both the minimal supersymmetric standard model (MSSM) and the CHM) already require some unavoidable 𝒪(10%)\mathcal{O}(10\%) tuning, albeit not unimaginable.

In most CHMs, however, the tuning is much worse than that is shown in Eq. (3). Depending on the coset G/HG/H and the representations of composite operators that couple to the top quarks, the strongly interacting resonances of the top sector in the UV often give a bigger contribution to the Higgs potential than Eq. (3), which requires more tuning to cancel. Another problem is that, unlike the pions, the Higgs field needs to develop a nonzero VEV vv. The current experimental constraints require v<f/3v<f/3. On the other hand, for a generic pNGB potential, the natural VEV for the pNGB is either 0 or ff. To obtain a VEV much less than ff, a significant quartic Higgs potential compared to the quadratic term is needed. In little Higgs models ArkaniHamed:2001nc ; ArkaniHamed:2002qx ; ArkaniHamed:2002qy , a Higgs quartic term can be generated without inducing a large quadratic term from the collective symmetry breaking. Such a mechanism is not present in most CHMs, which is another cause of the fine-tuning issue.

In this study, our goal is to find a more natural CHM by removing the additional tuning beyond Eq. (3). We first identify the cosets and the composite operator representations that couple to the top quarks, which can preserve a larger symmetry for the resonances to suppress the UV contribution to the Higgs potential. Next, we implement the collective symmetry breaking to generate a Higgs quartic potential while keeping the quadratic term at the level of Eq. (3). In this way we can naturally separate the scales of vv and ff, resulting in a more natural CHM.

This paper is organized as follows. In section 2, we review the tuning problems in CHMs and identify the sources of the extra tuning, using the SO(5)/SO(4)SO(5)/SO(4) CHMs as an example. In section 3, we introduce the SU(6)/Sp(6)SU(6)/Sp(6) CHM, including the interactions that produce the SM Yukawa couplings, and show how the large UV contribution to the Higgs potential is avoided. We then move on to the next step to generate an independent Higgs quartic term from collective symmetry breaking in section 4. The resulting Higgs potential of the 2HDM is discussed in section 5. The complete potential and spectrum of all the pNGBs in our model are summarized in section 6 with numerical estimation. Section 7 and Section 8 are devoted to the phenomenology of this model. Section 7 focuses on the collider searches and constraints. The analyses of the indirect constraints from the precision experimental measurements are presented in Section 8. Section 9 contains our summaries and conclusions. In Appendix A we briefly discuss the possibility of constructing a similar model based on the SU(5)/SO(5)SU(5)/SO(5) coset. We point out the differences and some drawbacks of such a model. Appendix B contains the details of the interactions between elementary fermions and composite operators for a realistic implementation of the SU(6)/Sp(6)SU(6)/Sp(6) CHM model.

2 Tuning in General Composite Higgs Models

We first give a brief review of the tuning problem of the Higgs potential in general CHMs, which was comprehensively discussed in Ref. Panico:2012uw ; Panico:2015jxa . This will help to motivate possible solutions. As an illustration, we consider the Minimal Composite Higgs Models (MCHMs) Agashe:2004rs with the symmetry breaking SO(5)SO(4)SO(5)\to SO(4). The four pNGBs are identified as the SM Higgs doublet. The SM gauge group SU(2)W×U(1)YSU(2)_{W}\times U(1)_{Y} is embedded in SO(5)×U(1)XSO(5)\times U(1)_{X}, with the extra U(1)XU(1)_{X} accounting for the hypercharges of SM fermions. The explicit breaking of the global symmetry introduces a pNGB potential such that at the minimum the SO(5)SO(5) breaking VEV ff is slightly rotated away from the direction that preserves the SU(2)W×U(1)YSU(2)_{W}\times U(1)_{Y} gauge group. The misalignment leads to the EWSB at a scale vfv\ll f.

The explicit global symmetry breaking comes from SM gauge interactions and Yukawa interactions. The SM Yukawa couplings arise from the partial compositeness mechanism Kaplan:1991dc : elementary fermions mix with composite operators of the same SM quantum numbers from the strong dynamics,

=λLq¯LOR+λRq¯ROL,\mathcal{L}=\lambda_{L}\bar{q}_{L}{O}_{R}+\lambda_{R}\bar{q}_{R}{O}_{L}, (4)

where qLq_{L}, qRq_{R} are elementary fermions and OL{O}_{L}, OR{O}_{R} are composite operators of some representations of GG (=SO(5)=SO(5) in MCHMs). The values of couplings λL\lambda_{L}, λR\lambda_{R} depend on the UV theory of these interactions and are treated as free parameters to produce viable models. With these interactions, the observed SM fermions will be mixtures of elementary fermions and composite resonances. The SM fermions can then couple to the Higgs field through the portion of the strong sector with couplings given by

yλLλRgψϵLgψϵR,y\simeq\frac{\lambda_{L}\lambda_{R}}{g_{\psi}}\simeq\epsilon_{L}\cdot g_{\psi}\cdot\epsilon_{R}~{}, (5)

where gψg_{\psi} is a coupling of the strong resonances and is expected to be 1\gg 1, ϵL,R\epsilon_{L,R} are ratios λL,R/gψ\lambda_{L,R}/g_{\psi}, which are expected to be small. The resonances created by OL,R{O}_{L,R} have masses gψf\sim g_{\psi}f, and play the roles of SM fermion partners. They cut off the divergent contributions to the Higgs potential and make it finite. Notice that the operators belong to representations of the global symmetry GG, but the resonances are divided into representations of HH after the symmetry breaking. Because the elementary fermions in general do not fill the whole representations of GG, the partial compositeness couplings λL\lambda_{L}, λR\lambda_{R} explicitly break the global symmetry GG and generate a nontrivial Higgs potential.

The pNGB Higgs field parametrizes the coset G/HG/H so the potential is periodic in the Higgs field. The Higgs potential can be expanded in sin(H/f)\sin(H/f) and up to the quartic term it takes the form

V(H)=α^f2sin2Hf+β^f2sin4Hf,V(H)=-\hat{\alpha}f^{2}\text{sin}^{2}\frac{H}{f}+\hat{\beta}f^{2}\text{sin}^{4}\frac{H}{f}~{}, (6)

where α^\hat{\alpha} and β^\hat{\beta} have mass dimension two and α^\hat{\alpha} corresponds to the mass-squared parameter of the Higgs field while β^/f2\hat{\beta}/f^{2} will contribute to the quartic term. By expanding sin(H/f)\sin(H/f), higher powers of HH can be generated from each term, but for convenience, we will simply call the first term quadratic term and the second term quartic term. The parameters α^\hat{\alpha} and β^\hat{\beta} are model dependent and are generated by explicit breaking parameters, like λL\lambda_{L} and λR\lambda_{R}. Given the potential, we can get the VEV and Higgs mass parameterized as

v=α^2β^f,Mh2=8β^v2f2(1v2f2).v=\sqrt{\frac{\hat{\alpha}}{2\hat{\beta}}}~{}f,\qquad M_{h}^{2}=8\hat{\beta}\frac{v^{2}}{f^{2}}(1-\frac{v^{2}}{f^{2}})~{}. (7)

The misalignment of the minimum from the SM gauge symmetry preserving direction is parametrized by

ξv2f2=sin2θ=α^2β^1,\xi\equiv\frac{v^{2}}{f^{2}}=\text{sin}^{2}\langle\theta\rangle=\frac{\hat{\alpha}}{2\hat{\beta}}\ll 1~{}, (8)

where angle θh/f\langle\theta\rangle\equiv\langle h\rangle/f. Therefore, for a realistic model, we need α^β^\hat{\alpha}\ll\hat{\beta} and at the same time, the correct size of β^\hat{\beta} to get the observed Higgs boson mass Mh125M_{h}\simeq 125 GeV.

From the most explicit symmetry breaking effects of the composite Higgs models, one typically gets α^>β^\hat{\alpha}>\hat{\beta}, which is the source of the tuning problem. For example, in MCHM5 Agashe:2004rs ; Panico:2015jxa , the SM fermions mix with composite operators OLO_{L}, OR𝟓O_{R}\in\mathbf{5} of SO(5)SO(5). After the symmetry breaking, the composite resonances split into 𝟒\mathbf{4} and 𝟏\mathbf{1} representations of SO(4)SO(4). The mass difference between 𝟒\mathbf{4} and 𝟏\mathbf{1} resonances generates a Higgs potential at the compositeness (UV) scale with

α^Nc16π2λL,R2Mψ2ϵL,R2Ncgψ416π2f2,\displaystyle\hat{\alpha}\sim\frac{N_{c}}{16\pi^{2}}\lambda_{L,R}^{2}M_{\psi}^{2}\sim\epsilon_{L,R}^{2}\frac{N_{c}g_{\psi}^{4}}{16\pi^{2}}f^{2}, (9a)
β^Nc16π2λL,R4f2ϵL,R4Ncgψ416π2f2.\displaystyle\hat{\beta}\sim\frac{N_{c}}{16\pi^{2}}\lambda_{L,R}^{4}f^{2}\sim\epsilon_{L,R}^{4}\frac{N_{c}g_{\psi}^{4}}{16\pi^{2}}f^{2}. (9b)

The quartic term coefficient β^\hat{\beta} arises at a higher order in ϵ\epsilon than α^\hat{\alpha}, so generically β^α^\hat{\beta}\ll\hat{\alpha} is expected instead. It is then required more fine-tuning to achieve the correct EWSB. In some models, it is possible to have α^β^\hat{\alpha}\sim\hat{\beta}. For example, MCHM14 Panico:2012uw with OLO_{L}, OR𝟏𝟒O_{R}\in\mathbf{14} of SO(5)SO(5) can lead to the potential with

α^β^Nc16π2λL,R2Mψ2ϵL,R2Ncgψ416π2f2,\displaystyle\hat{\alpha}\sim\hat{\beta}\sim\frac{N_{c}}{16\pi^{2}}\lambda_{L,R}^{2}M_{\psi}^{2}\sim\epsilon_{L,R}^{2}\frac{N_{c}g_{\psi}^{4}}{16\pi^{2}}f^{2}, (10)

where β^\hat{\beta} arises at the same order as α^\hat{\alpha}. It requires less tuning to achieve ξ1\xi\ll 1. This has been called “minimal tuning.” But even so, the UV contribution of Eq. (10) to α^\hat{\alpha} is larger than the IR contribution from the top quark loop

ΔmIR2Nc16π2yt2MT2ϵL,R4Ncgψ416π2f2,\displaystyle\Delta m^{2}_{\text{IR}}\sim\frac{N_{c}}{16\pi^{2}}y_{t}^{2}M_{T}^{2}\sim\epsilon_{L,R}^{4}\frac{N_{c}g_{\psi}^{4}}{16\pi^{2}}f^{2}, (11)

which already requires some levels of fine-tuning as shown in Eq. (3). This additional UV contribution actually worsens the condition and requires more tuning. A less-tuned scenario is to have a composite right-handed top quark (which is a singlet of GG). In this case, ϵR1\epsilon_{R}\sim 1 but does not contribute to the Higgs potential. The Higgs potential is controlled by λLyt\lambda_{L}\sim y_{t}, which can be smaller.

From the above discussion, one can see that to obtain a more natural Higgs potential in CHM, it would be desirable to suppress the contribution from the composite top-partner resonances to the quadratic term. For example, a maximal symmetry was proposed in Ref. Csaki:2017cep to keep the degeneracy of the whole GG representation of the top-partner resonances. However, the maximal symmetry is somewhat ad hoc within a simple model and its natural realization requires more complicated model constructions by doubling the global symmetry groups or invoking a holographic extra dimension Csaki:2018zzf ; Blasi:2020ktl . We will look for cosets G/HG/H such that the representation of the top-partner resonances do not split even after the symmetry breaking of GHG\to H so that it preserves a global symmetry GG in any single partial compositeness coupling to prevent unwanted large contributions to the Higgs potential. Besides, we need some additional contribution to the quartic term without inducing the corresponding quadratic term simultaneously to make β^>α^\hat{\beta}>\hat{\alpha} naturally. This may be achieved by the collective symmetry breaking of the little Higgs mechanism ArkaniHamed:2001nc ; ArkaniHamed:2002qx ; ArkaniHamed:2002qy . Previous attempts include adding exotic elementary fermions to an SU(5)/SO(5)SU(5)/SO(5) CHM model Vecchi:2013bja and a holographic model with double copies of the global symmetry Csaki:2017eio . Another way of generating the quartic term without the quadratic term using the Higgs dependent kinetic mixing requires both new elementary fermions and an enlarged global symmetry or an extra dimension Csaki:2019coc . We will take a more economical approach by implementing the little Higgs mechanism without adding exotic elementary fermions or invoking multiple copies of the global symmetry, but simply using the couplings that mix SM fermions with composite resonances.

3 The SU(6)/Sp(6)SU(6)/Sp(6) Composite Higgs Model

Among the possible cosets, the cosets SU(5)/SO(5)SU(5)/SO(5) and SU(6)/Sp(6)SU(6)/Sp(6) are potential candidates to realize the ideas discussed at the end of the previous section. If the composite operator OL,R𝟓(𝟔)O_{L,R}\in\mathbf{5}(\mathbf{6}) of SU(5)(SU(6))SU(5)(SU(6)), the corresponding resonances do not split under the unbroken subgroup SO(5)(Sp(6))SO(5)(Sp(6)).111Naïvely they can split into two real representations, but if they carry charges under the extra U(1)XU(1)_{X} gauge group which is required to obtain the correct hypercharge, they need to remain complex. Since they are still complete multiplets of GG, there is an enhanced symmetry for each mixing coupling λL,R\lambda_{L,R}, which protects the pNGB potential. The cosets were also some earliest ones employed in little Higgs models ArkaniHamed:2002qy ; Low:2002ws where the collective symmetry breaking for the quartic coupling was realized. In CHMs, it requires different explicit implementations if no extension of the SM gauge group or extra elementary fermions are introduced. The SU(5)/SO(5)SU(5)/SO(5) model has a general problem that an SU(2)SU(2) triplet scalar VEV violates the custodial SU(2)SU(2) symmetry, leading to strong experimental constraints. We will focus on the SU(6)/Sp(6)SU(6)/Sp(6) model222A CHM with the SU(6)/Sp(6)SU(6)/Sp(6) coset were considered in Ref. Cai:2018tet , but for a different prospect. here and leave a brief discussion of the SU(5)/SO(5)SU(5)/SO(5) model in Appendix A.

3.1 Basics of SU(6)/Sp(6)SU(6)/Sp(6)

To parametrize the SU(6)/Sp(6)SU(6)/Sp(6) non-linear sigma model, we can use a sigma field Σij\Sigma^{ij}, which transforms as an anti-symmetric tensor representation 𝟏𝟓\mathbf{15} of SU(6)SU(6), where i,j=1,6i,j=1,\ldots 6 are SU(6)SU(6) indices. The transformation can be expressed as ΣgΣgT\Sigma\to g\Sigma g^{T} with gSU(6)g\in SU(6) or as ΣijgikgjΣk\Sigma^{ij}\to{g^{i}}_{k}{g^{j}}_{\ell}\Sigma^{k\ell} with indices explicitly written out. The scalar field Σ\Sigma has an anti-symmetric VEV Σ=Σ0αβ\langle\Sigma\rangle=\Sigma_{0}^{\alpha\beta} (with α\alpha, β\beta representing Sp(6)Sp(6) index), where

Σ0=(0𝕀𝕀0),\Sigma_{0}=\begin{pmatrix}0&-\mathbb{I}\\ \mathbb{I}&0\\ \end{pmatrix}, (12)

and 𝕀\mathbb{I} is the 3×33\times 3 identity matrix. The Σ\Sigma VEV breaks SU(6)SU(6) down to Sp(6)Sp(6), producing 14 Nambu-Goldstone bosons.

The 35 SU(6)SU(6) generators can be divided into the unbroken ones and broken ones with each type satisfying

{unbroken generatorsTa:TaΣ0+Σ0TaT=0,broken generatorsXa:XaΣ0Σ0XaT=0.\begin{cases}\text{unbroken generators}&T_{a}:T_{a}\Sigma_{0}+\Sigma_{0}T_{a}^{T}=0~{},\\ \text{broken generators}&X_{a}:X_{a}\Sigma_{0}-\Sigma_{0}X_{a}^{T}=0~{}.\end{cases} (13)

The Nambu-Goldstone fields can be written as a matrix with the broken generator:

ξ(x)=ξiα(x)eiπa(x)Xa2f.\xi(x)={\xi^{i}}_{\alpha}(x)\equiv e^{\frac{i\pi_{a}(x)X_{a}}{2f}}. (14)

Under SU(6)SU(6), the ξ\xi field transforms as ξgξh\xi\to g\xi h^{\dagger} where gSU(6)g\in SU(6) and hSp(6)h\in Sp(6), so ξ\xi carries one SU(6)SU(6) index and one Sp(6)Sp(6) index. The relation between ξ\xi and Σ\Sigma field is given by

Σ(x)=Σij(x)ξΣ0ξT=eiπa(x)Xa2fΣ0eiπa(x)XaT2f=eiπa(x)XafΣ0.\Sigma(x)=\Sigma^{ij}(x)\equiv\xi\Sigma_{0}\xi^{T}=e^{\frac{i\pi_{a}(x)X_{a}}{2f}}\Sigma_{0}e^{\frac{i\pi_{a}(x)X_{a}^{T}}{2f}}=e^{\frac{i\pi_{a}(x)X_{a}}{f}}\Sigma_{0}~{}. (15)

The complex conjugation raises or lowers the indices. The fundamental representation of Sp(6)Sp(6) is (pseudo-)real and the Sp(6)Sp(6) index can be raised or lowered by Σ0αβ\Sigma_{0}^{\alpha\beta} or Σ0,αβ\Sigma_{0,\alpha\beta}.

The broken generators and the corresponding fields in the matrix can be organized as follows (ϵ=iσ2\epsilon=i\sigma^{2}):

πaXa=(12ϕaσaη6𝟏H2ϵsH1H22η6H1T0ϵTsH112ϕaσaη6𝟏H2H10H2T2η6).\pi_{a}X_{a}=\begin{pmatrix}\frac{1}{\sqrt{2}}\phi_{a}\sigma^{a}-\frac{\eta}{\sqrt{6}}\bf{1}&~{}H_{2}&~{}\epsilon s&~{}H_{1}\\ H_{2}^{\dagger}&~{}\frac{2\eta}{\sqrt{6}}&~{}-H_{1}^{T}&~{}0\\ \epsilon^{T}s^{*}&~{}-H_{1}^{*}&~{}\frac{1}{\sqrt{2}}\phi_{a}\sigma^{a*}-\frac{\eta}{\sqrt{6}}\bf{1}&~{}H_{2}^{*}\\ H_{1}^{\dagger}&~{}0&~{}H_{2}^{T}&~{}\frac{2\eta}{\sqrt{6}}\\ \end{pmatrix}~{}. (16)

In this matrix, there are 14 independent fields. They are (under SU(2)WSU(2)_{W}): a real triplet ϕa\phi_{a}, a real singlet η\eta, a complex singlet ss, and two Higgs (complex) doublets H1H_{1} and H2H_{2}. We effectively end up with a two-Higgs-doublet model (2HDM). The observed Higgs boson will correspond to a mixture of h1h_{1} and h2h_{2} inside two Higgs doublets H1=H1/212(0h1)H_{1}=H_{1/2}\supset\frac{1}{\sqrt{2}}\bigl{(}\begin{smallmatrix}0\\ h_{1}\end{smallmatrix}\bigr{)} and H2=H1/212(h20)H_{2}=H_{-1/2}\supset\frac{1}{\sqrt{2}}\bigl{(}\begin{smallmatrix}h_{2}\\ 0\end{smallmatrix}\bigr{)}. Using the Nambu-Goldstone matrix, we can construct the low energy effective Lagrangian for the Higgs fields and all the other pNGBs.

3.2 The Gauge Sector

The SM electroweak gauge group SU(2)W×U(1)YSU(2)_{W}\times U(1)_{Y} is embedded in SU(6)×U(1)XSU(6)\times U(1)_{X} with generators given by

SU(2)W:12(σa000000000σa00000),U(1)Y:12(000000000000001000000000000000000001)+X𝐈.SU(2)_{W}:\frac{1}{2}\begin{pmatrix}\sigma^{a}&0&0&0\\ 0&0&0&0\\ 0&0&-\sigma^{a*}&0\\ 0&0&0&0\\ \end{pmatrix},\quad U(1)_{Y}:\frac{1}{2}\begin{pmatrix}0&0&0&0&0&0\\ 0&0&0&0&0&0\\ 0&0&1&0&0&0\\ 0&0&0&0&0&0\\ 0&0&0&0&0&0\\ 0&0&0&0&0&-1\\ \end{pmatrix}+X\mathbf{I}~{}. (17)

The extra U(1)XU(1)_{X} factor accounts for the different hypercharges of the fermion representations but is not relevant for the bosonic fields. These generators belong to Sp(6)×U(1)XSp(6)\times U(1)_{X} and not broken by Σ0\Sigma_{0}. Using the Σ\Sigma field, the Lagrangian for kinetic terms of Higgs boson comes from

h=f24tr[(DμΣ)(DμΣ)]+,\mathcal{L}_{h}=\frac{f^{2}}{4}\text{tr}\left[(D_{\mu}\Sigma)(D^{\mu}\Sigma)^{\dagger}\right]+\cdots, (18)

where DμD_{\mu} is the electroweak covariant derivative. Expanding this, we get

h=12(μh1)(μh1)+12(μh2)(μh2)+f22gW2(sin2h12+h222f)[Wμ+Wμ+ZμZμ2cosθW].\mathcal{L}_{h}=\frac{1}{2}(\partial_{\mu}h_{1})(\partial^{\mu}h_{1})+\frac{1}{2}(\partial_{\mu}h_{2})(\partial^{\mu}h_{2})+\frac{f^{2}}{2}g_{W}^{2}\left(\text{sin}^{2}\frac{\sqrt{h_{1}^{2}+h_{2}^{2}}}{\sqrt{2}f}\right)\left[W^{+}_{\mu}W^{-\mu}+\frac{Z_{\mu}Z^{\mu}}{2\text{cos}\theta_{W}}\right]~{}. (19)

The non-linear behavior of Higgs boson in CHM is apparent from the dependence of trigonometric functions.

The WW boson acquires a mass when h1h_{1} and h2h_{2} obtain nonzero VEVs V1V_{1} and V2V_{2} of

mW2=f22gW2(sin2V12+V222f)=14gW2(v12+v22)=14gW2v2,m_{W}^{2}=\frac{f^{2}}{2}g_{W}^{2}\left(\text{sin}^{2}\frac{\sqrt{V_{1}^{2}+V_{2}^{2}}}{\sqrt{2}f}\right)=\frac{1}{4}g_{W}^{2}(v_{1}^{2}+v_{2}^{2})=\frac{1}{4}g_{W}^{2}v^{2}, (20)

where

vi2fViV12+V22sinV12+V222fVi=hi.v_{i}\equiv\sqrt{2}f\frac{V_{i}}{\sqrt{V_{1}^{2}+V_{2}^{2}}}\text{sin}\frac{\sqrt{V_{1}^{2}+V_{2}^{2}}}{\sqrt{2}f}\approx V_{i}=\langle h_{i}\rangle~{}. (21)

The parameter that parametrizes the nonlinearity of the CHM is given by

ξv2f2=2sin2V12+V222f.\xi\equiv\frac{v^{2}}{f^{2}}=2\,\sin^{2}\frac{\sqrt{V_{1}^{2}+V_{2}^{2}}}{\sqrt{2}f}~{}. (22)

3.3 The Gauge Contribution to the pNGB Potential

SM gauge interactions explicitly break the SU(6)SU(6) global symmetry, so they contribute to the potential of the Higgs fields as well as other pNGBs. SM gauge bosons couple to pNGBs through the mixing with composite resonances:

=gWμ,aJWμ,a+gBμJYμ.\mathcal{L}=gW_{\mu,a}J^{\mu,a}_{W}+g^{\prime}B_{\mu}J^{\mu}_{Y}~{}. (23)

The JWJ_{W} and JYJ_{Y} belong to the composite operators in an adjoint representation 𝟑𝟓\mathbf{35} of SU(6)SU(6). After the symmetry breaking, the composite operators are decomposed into 𝟐𝟏\mathbf{21} and 𝟏𝟒\mathbf{14} of Sp(6)Sp(6). The masses of composite resonances of different representations of Sp(6)Sp(6) are in general different and this will generate a potential for pNGBs at 𝒪(g2)\mathcal{O}(g^{2}). For SU(2)WSU(2)_{W}, it only breaks the global symmetry partially and generates mass terms for the two Higgs doublets and the scalar triplet ϕ\phi:

SU(2)W:(for H1,H2)\displaystyle SU(2)_{W}:~{}\text{(for $H_{1},H_{2}$)}~{} cw116π23g22gρ2f2cw332π2g2Mρ2,\displaystyle c_{w}\frac{1}{16\pi^{2}}\frac{3g^{2}}{2}g_{\rho}^{2}f^{2}\approx c_{w}\frac{3}{32\pi^{2}}g^{2}M_{\rho}^{2}, (24)
(for ϕ\phi) cw116π24g2gρ2f2cw14π2g2Mρ2,\displaystyle c_{w}\frac{1}{16\pi^{2}}4g^{2}g_{\rho}^{2}f^{2}\approx c_{w}\frac{1}{4\pi^{2}}g^{2}M_{\rho}^{2}, (25)

where gρfMρg_{\rho}f\sim M_{\rho} is the mass of the vector resonances ρ\rho which act as the gauge boson partners to cut off the SU(2)WSU(2)_{W} gauge loop contribution to the pNGB masses, and cwc_{w} is a 𝒪(1)\mathcal{O}(1) constant. Similarly, for U(1)YU(1)_{Y}, the interaction also breaks the global symmetry partially. It only generates mass terms for H1H_{1}, H2H_{2}:

U(1)Y:c132π2g2gρ2f2c132π2g2Mρ2,\displaystyle U(1)_{Y}:~{}c^{\prime}\frac{1}{32\pi^{2}}g^{\prime 2}g_{\rho}^{2}f^{2}\approx c^{\prime}\frac{1}{32\pi^{2}}g^{\prime 2}M_{\rho}^{2}, (26)

where cc^{\prime} is also an 𝒪(1)\mathcal{O}(1) constant.

Combining these two contributions, we get the mass terms of the pNGBs from the gauge contributions at the leading order as

Mη2=Ms2=0,Mϕ2=cw14π2g2Mρ2,\displaystyle M_{\eta}^{2}=M_{s}^{2}=0,\qquad\qquad M_{\phi}^{2}=c_{w}\frac{1}{4\pi^{2}}g^{2}M_{\rho}^{2}~{},
MH12=MH22=cw332π2g2Mρ2+c132π2g2Mρ2(3g2+g2(c/cw)8g2)Mϕ2.\displaystyle M_{H_{1}}^{2}=M_{H_{2}}^{2}=c_{w}\frac{3}{32\pi^{2}}g^{2}M_{\rho}^{2}+c^{\prime}\frac{1}{32\pi^{2}}g^{\prime 2}M_{\rho}^{2}\approx\left(\frac{3g^{2}+g^{\prime 2}(c^{\prime}/c_{w})}{8g^{2}}\right)M_{\phi}^{2}~{}. (27)

From the gauge contributions only, we expect that Mϕ>MH1=MH2M_{\phi}>M_{H_{1}}=M_{H_{2}} and they are below the symmetry breaking scale ff. The SU(2)W×U(1)YSU(2)_{W}\times U(1)_{Y} singlets ss and η\eta do not receive masses from the gauge interactions at this order, but they will obtain masses elsewhere which will be discussed later.

3.4 The Yukawa Sector

For partial compositeness, the elementary quarks and leptons couple to composite operators of G=SU(6)G=SU(6). To be able to mix with the elementary fermions, the representations of the composite operators must contain states with the same SM quantum numbers as the SM fermions. For our purpose, we can consider 𝟔\mathbf{6} and 𝟔¯\mathbf{\bar{6}} of SU(6)SU(6) as they don’t split under the Sp(6)Sp(6) subgroup. To account for the correct hypercharge, e.g., qL=21/6q_{L}=2_{1/6}, qR=12/3q_{R}=1_{2/3} for up-type quarks and qR=11/3q_{R}=1_{-1/3} for down-type quarks, the composite operators need to carry additional charges under the U(1)XU(1)_{X} outside SU(6)SU(6) and the SM hypercharge is a linear combination of the SU(6)SU(6) generator diag(0,0,1/2,0,0,1/2)\text{diag}(0,0,1/2,0,0,-1/2) and XX. The composite operator as a 𝟔1/6\mathbf{6}_{1/6} of SU(6)SU(6) (where the subscript 1/61/6 denotes its U(1)XU(1)_{X} charge) can be decomposed under SM SU(2)W×U(1)YSU(2)_{W}\times U(1)_{Y} gauge group as

OL,RiξiαQL,Rα𝟔1/6=𝟐1/6𝟏2/3𝟐¯1/6𝟏1/3,O_{L,R}^{i}\sim{\xi^{i}}_{\alpha}Q_{L,R}^{\alpha}\sim\mathbf{6}_{1/6}=\mathbf{2}_{1/6}\oplus\mathbf{1}_{2/3}\oplus\mathbf{\bar{2}}_{1/6}\oplus\mathbf{1}_{-1/3}, (28)

where QL,RQ_{L,R} are the corresponding composite resonances. The composite states QL,RQ_{L,R} created by these operators belong to the 𝟔\mathbf{6} representations of Sp(6)Sp(6) and play the roles of SM fermion composite partners. For SU(2)SU(2), 𝟐\mathbf{2} and 𝟐¯\mathbf{\bar{2}} are equivalent and related by the ϵ\epsilon tensor. We make the distinction to keep track of the order of the fermions in a doublet. We see that the composite states have the appropriate quantum numbers to mix with the SM quarks.

The left-handed elementary top quark can mix with either the first two components or the 4th and 5th components of the sextet. If we assume that it couples to the first two components, the mixing term can be expressed as

λLq¯LaΛaiORi=λLq¯LaΛai(ξiαQRα)\lambda_{L}\bar{q}_{La}{\Lambda^{a}}_{i}O_{R}^{i}=\lambda_{L}\bar{q}_{La}{\Lambda^{a}}_{i}\left({\xi^{i}}_{\alpha}Q_{R}^{\alpha}\right) (29)

where aa represents an SU(2)WSU(2)_{W} index, and

(Λ)ai=Λ=(100000010000){(\Lambda)^{a}}_{i}=\Lambda=\begin{pmatrix}1&0&0&0&0&0\\ 0&1&0&0&0&0\\ \end{pmatrix} (30)

is the spurion which keeps track of the symmetry breaking.

To get the top Yukawa coupling, we couple the elementary right-handed quark to the 𝟔¯1/6\mathbf{\bar{6}}_{1/6}, which decomposes under SU(2)W×U(1)YSU(2)_{W}\times U(1)_{Y} as

OL,RjξjβΣ0βαQL,Rα𝟔¯1/6=𝟐¯1/6𝟏1/3𝟐1/6𝟏2/3.O^{\prime}_{L,Rj}\sim{\xi^{*}_{j}}^{\beta}\Sigma_{0\beta\alpha}Q_{L,R}^{\alpha}\sim\mathbf{\bar{6}}_{1/6}=\mathbf{\bar{2}}_{1/6}\oplus\mathbf{1}_{-1/3}\oplus\mathbf{2}_{1/6}\oplus\mathbf{1}_{2/3}~{}. (31)

The right-handed top quark mixes with the last component of the 𝟔¯1/6\mathbf{\bar{6}}_{1/6}, which can be written as

λtRt¯RΓtRjOLj=λtRt¯RΓtRj(ξjβΣ0βαQLα),\lambda_{t_{R}}\bar{t}_{R}{\Gamma_{t_{R}}}^{j}O^{\prime}_{Lj}=\lambda_{t_{R}}\bar{t}_{R}{\Gamma_{t_{R}}}^{j}\left({\xi^{*}_{j}}^{\beta}\Sigma_{0\beta\alpha}Q_{L}^{\alpha}\right), (32)

where ΓtR=(000001)\Gamma_{t_{R}}=\left(0~{}0~{}0~{}0~{}0~{}1\right) is the corresponding spurion.

Combining λL\lambda_{L} and λtR\lambda_{t_{R}} couplings, we can generate the SM Yukawa coupling for the top quark (and similarly for other up-type quarks),333If we had coupled the left-handed quarks to the 4th and 5th components of ORO_{R}, λ~Lq¯LaϵabΛbiORi=λ~Lq¯LaϵabΛbi(ξiαQRα)+h.c.,\tilde{\lambda}_{L}\bar{q}_{La}\epsilon^{ab}{{\Lambda^{\prime}}_{bi}}O_{R}^{i}=\tilde{\lambda}_{L}\bar{q}_{La}\epsilon^{ab}{{\Lambda^{\prime}}_{bi}}\left({\xi^{i}}_{\alpha}Q_{R}^{\alpha}\right)+\text{h.c.}, with the spurion (Λ)bi=Λ=(000100000010).{(\Lambda^{\prime})}_{bi}={\Lambda^{\prime}}=\begin{pmatrix}0&0&0&1&0&0\\ 0&0&0&0&1&0\\ \end{pmatrix}. The combination of λ~L\tilde{\lambda}_{L} and λtR\lambda_{t_{R}} would generate an up-type Yukawa coupling with H1H_{1}, λ~LλtR(q¯LH~1tR)\sim\tilde{\lambda}_{L}\lambda_{t_{R}}\left(\bar{q}_{L}\tilde{H}_{1}t_{R}\right).

λLλtRq¯LaΛaiξiαΣ0αβξβTjΓtRjtR=λLλtRq¯LaΛaiΣijΓtRjtRλLλtR(q¯LH2tR).\sim\lambda_{L}\lambda_{t_{R}}\bar{q}_{La}{\Lambda^{a}}_{i}{\xi^{i}}_{\alpha}\Sigma_{0}^{\alpha\beta}{\xi^{T}_{\beta}}^{j}{\Gamma}^{\dagger}_{t_{R}j}t_{R}=\lambda_{L}\lambda_{t_{R}}\bar{q}_{La}{\Lambda^{a}}_{i}\Sigma^{ij}{\Gamma}^{\dagger}_{t_{R}j}t_{R}\supset\lambda_{L}\lambda_{t_{R}}\left(\bar{q}_{L}H_{2}t_{R}\right)~{}. (33)

Similarly, for the bottom quark (or in general down-type quarks), we can couple bRb_{R} to the third component of 𝟔¯1/6\mathbf{\bar{6}}_{1/6} with the coupling λbR\lambda_{b_{R}} and spurion ΓbR=(001000)\Gamma_{b_{R}}=\left(0~{}0~{}1~{}0~{}0~{}0\right). This generates a bottom Yukawa coupling of

λLλbRq¯LaΛaiξiαΣ0αβξβTjΓbRjbR=λLλbRq¯LaΛaiΣijΓbRjbRλLλbR(q¯LH1bR).\sim\lambda_{L}\lambda_{b_{R}}\bar{q}_{La}{\Lambda^{a}}_{i}{\xi^{i}}_{\alpha}\Sigma_{0}^{\alpha\beta}{\xi^{T}_{\beta}}^{j}{\Gamma}^{\dagger}_{b_{R}j}b_{R}=\lambda_{L}\lambda_{b_{R}}\bar{q}_{La}{\Lambda^{a}}_{i}\Sigma^{ij}{\Gamma}^{\dagger}_{b_{R}j}b_{R}\supset\lambda_{L}\lambda_{b_{R}}\left(\bar{q}_{L}H_{1}b_{R}\right)~{}. (34)

Alternatively, we could also couple the left-handed elementary quarks to 𝟔¯1/6\mathbf{\bar{6}}_{1/6} and right-handed elementary quarks to 𝟔1/6\mathbf{6}_{1/6},

λLq¯LaϵabΩbiORi=λLq¯LaϵabΩbi(ξiβΣ0βαQRα),\lambda^{\prime}_{L}\bar{q}_{La}\epsilon^{ab}{\Omega_{b}}^{i}O^{\prime}_{Ri}=\lambda^{\prime}_{L}\bar{q}_{La}\epsilon^{ab}{\Omega_{b}}^{i}\left({\xi^{*}_{i}}^{\beta}\Sigma_{0\beta\alpha}Q_{R}^{\alpha}\right), (35)

where

(Ω)ai=Ω=(100000010000){(\Omega)_{a}}^{i}=\Omega=\begin{pmatrix}1&0&0&0&0&0\\ 0&1&0&0&0&0\\ \end{pmatrix} (36)

and

λbRb¯RΓbRjOLj=λbRb¯RΓbRj(ξjαQLα),\lambda_{b_{R}}^{\prime}\bar{b}_{R}{\Gamma_{b_{R}}^{\prime}}_{j}O_{L}^{j}=\lambda_{b_{R}}^{\prime}\bar{b}_{R}{\Gamma_{b_{R}}^{\prime}}_{j}\left({\xi^{j}}_{\alpha}Q_{L}^{\alpha}\right), (37)

where ΓbR=(000001)\Gamma_{b_{R}}^{\prime}=\left(0~{}0~{}0~{}0~{}0~{}1\right). Combining λL\lambda_{L}^{\prime} and λbR\lambda_{b_{R}}^{\prime} coupling, we can generate the SM Yukawa coupling for bottom quark as

λLλbRq¯LaϵabΩbiξiβΣ0βαξαjΓbRjbR=λLλbRq¯LaϵabΩbiΣijΓbRjbRλLλbR(q¯LH~2bR),\sim\lambda_{L}^{\prime}\lambda_{b_{R}}^{\prime}\bar{q}_{La}\epsilon^{ab}{\Omega_{b}}^{i}{\xi^{*}_{i}}^{\beta}\Sigma_{0\beta\alpha}{\xi^{\dagger\alpha}}_{j}\Gamma_{b_{R}}^{\prime*j}b_{R}=\lambda_{L}^{\prime}\lambda_{b_{R}}^{\prime}\bar{q}_{La}\epsilon^{ab}{\Omega_{b}}^{i}\Sigma^{\dagger}_{ij}\Gamma_{b_{R}}^{\prime*j}b_{R}\supset\lambda_{L}^{\prime}\lambda_{b_{R}}^{\prime}\left(\bar{q}_{L}\tilde{H}_{2}b_{R}\right)~{}, (38)

where H~ϵH\tilde{H}\equiv\epsilon H^{*}. In this case, the bottom mass also comes from VEV of H2H_{2}. Note that the combination of λL\lambda_{L} and λbR\lambda_{b_{R}}^{\prime} (or λL\lambda_{L}^{\prime} and λbR\lambda_{b_{R}}) does not generate the SM Yukawa coupling because it does not depend on Σ\Sigma.

The lepton Yukawa couplings can be similarly constructed by coupling elementary leptons to 𝟔\mathbf{6} and 𝟔¯\mathbf{\bar{6}} with X=1/2X=-1/2. In 2HDMs, if the SM quarks have general couplings to both Higgs doublets, large tree-level flavor-changing effects can be induced. To avoid them, it is favorable to impose the natural flavor conservation Glashow:1976nt ; Paschos:1976ay such that all up-type quarks couple to one Higgs doublet and all down-type quarks couple to either the same Higgs doublet (Type-I) or the other Higgs doublet (Type-II or flipped depending on the lepton assignment). We can obtain all different possibilities by choosing the partial compositeness couplings. For Type-II and flipped models, the bsγb\to s\gamma put strong constraints on the charged Higgs boson mass (600\gtrsim 600 GeV) Misiak:2017bgg which would require more tuning in the Higgs potential. Therefore, we will assume the Type-I 2HDM for the remaining of the paper, with the top Yukawa coupling coming from λLλtR\lambda_{L}\lambda_{t_{R}} and the bottom Yukawa coupling coming from λLλbR\lambda_{L}^{\prime}\lambda_{b_{R}}^{\prime}.

3.5 The Top Contribution to the pNGB Potential

The partial compositeness coupling λL\lambda_{L} or λR\lambda_{R} individually cannot generate a potential for the pNGBs by itself, because the coupling Eq. (29) [or (32)] preserves an SU(6)SU(6) symmetry represented by the α\alpha index. Although α\alpha is an Sp(6)Sp(6) index, without Σ0\Sigma_{0}, it cannot distinguish Sp(6)Sp(6) from SU(6)SU(6). To generate a nontrivial Higgs potential, we need at least an insertion of Σ0\Sigma_{0}, which distinguishes Sp(6)Sp(6) from SU(6)SU(6). It first arises through the combination of λL\lambda_{L} and λR\lambda_{R} in Eq. (33), which is just the top Yukawa coupling. Therefore, the first nontrivial Higgs potential shows up at the next order, i.e., 𝒪(λL2λR2)\mathcal{O}(\lambda_{L}^{2}\lambda_{R}^{2}), as

Nc8π2λL2λR2f4|(Λ)ai(Γ)jΣij|2\sim-\frac{N_{c}}{8\pi^{2}}\lambda_{L}^{2}\lambda_{R}^{2}f^{4}\left|{(\Lambda)^{a}}_{i}{(\Gamma^{*})}_{j}\Sigma^{ij}\right|^{2} (39)

It gives a contribution to the H2H_{2} squared-mass term of the order

ΔMH22Nc8π2λL2λR2f2Nc8π2yt2MT2,\displaystyle\Delta M_{H_{2}}^{2}\sim-\frac{N_{c}}{8\pi^{2}}\lambda_{L}^{2}\lambda_{R}^{2}f^{2}\sim-\frac{N_{c}}{8\pi^{2}}y_{t}^{2}M_{T}^{2}~{}, (40)

which is the same as the IR contribution from the top loop estimated in Eq. (3). Therefore, in this model, we avoid the potentially large 𝒪(λ2)\mathcal{O}(\lambda^{2}) UV contribution and achieve the minimal tuning for the quadratic part of the Higgs potential.

4 Collective Higgs Quartics from Fermion Partial Compositeness Couplings

In the previous section, we show that in the SU(6)/Sp(6)SU(6)/Sp(6) CHM the UV contribution from the strong dynamics to the Higgs potential is suppressed, minimizing the tuning of the quadratic term. However, we need some additional quartic Higgs potential to further reduce the tuning and to obtain a 125 GeV Higgs boson, as the IR contribution from the top quark loop to the Higgs quartic term is not enough. Generating a Higgs quartic coupling without inducing the corresponding quadratic term is the hallmark of the little Higgs mechanism. For example, in the original SU(6)/Sp(6)SU(6)/Sp(6) little Higgs model Low:2002ws , a Higgs quartic term from the collective symmetry breaking can be generated by gauging two copies of SU(2)SU(2), with generators given by

Q1a=12(σa00000000002×200000)andQ2a=12(02×2000000000σa00000)Q_{1}^{a}=\frac{1}{2}\begin{pmatrix}\sigma^{a}&0&0&0\\ 0&0&0&0\\ 0&0&0_{2\times 2}&0\\ 0&0&0&0\\ \end{pmatrix}\quad\text{and}\quad Q_{2}^{a}=-\frac{1}{2}\begin{pmatrix}0_{2\times 2}&0&0&0\\ 0&0&0&0\\ 0&0&\sigma^{a*}&0\\ 0&0&0&0\\ \end{pmatrix} (41)

and gauge couplings g1g_{1} and g2g_{2}. The two SU(2)SU(2)’s are broken down to the diagonal SU(2)WSU(2)_{W} by the Σ\Sigma VEV. The potential for the pNGBs generated by the two gauge couplings takes the form

g12f2|s+i2fH2~H1|2+g22f2|si2fH2~H1|2.g_{1}^{2}f^{2}\left|s+\frac{i}{2f}\tilde{H_{2}}^{\dagger}H_{1}\right|^{2}+g_{2}^{2}f^{2}\left|s-\frac{i}{2f}\tilde{H_{2}}^{\dagger}H_{1}\right|^{2}. (42)

The g12g_{1}^{2} term preserves the SU(4)SU(4) symmetry of the 3,4,5,63,4,5,6 entries which contains the shift symmetry of H1H_{1} and H2H_{2}. If only the first term of the potential exists, the H2~H1\tilde{H_{2}}^{\dagger}H_{1} dependence can be absorbed into ss by a field redefinition and the term just corresponds to a mass term for ss. Similarly, the g22g_{2}^{2} term preserves the SU(4)SU(4) symmetry of the 1,2,3,61,2,3,6 entries under which H1H_{1} and H2H_{2} remain as Nambu-Goldstone bosons, but with a different shift symmetry. The combination of both terms breaks either of the shift symmetries, and a quartic Higgs potential is generated after integrating out the ss field,

λ|H2~H1|2withλ=g12g22g12+g22.\lambda\left|\tilde{H_{2}}^{\dagger}H_{1}\right|^{2}\quad\text{with}\quad\lambda=\frac{g_{1}^{2}g_{2}^{2}}{g_{1}^{2}+g_{2}^{2}}~{}. (43)

The possibility of gauging two copies of SU(2)SU(2) gauge group is subject to the strong experimental constraints on WW^{\prime} and ZZ^{\prime}. We would like to generate the quartic Higgs potential without introducing additional elementary fields to the SU(6)/Sp(6)SU(6)/Sp(6) CHM, so we will consider the collective symmetry breaking from the interactions between the elementary fermions and the resonances of the strong dynamics.

From the discussion of the previous section, we see that the elementary quark doublets may couple to composite operators of SU(6)SU(6) representations 𝟔\mathbf{6} and/or 𝟔¯\mathbf{\bar{6}}, and each contains two doublets of the same SM quantum numbers:

𝟔1/6=𝟐1/6𝟏2/3𝟐¯1/6𝟏1/3,\mathbf{6}_{1/6}=\mathbf{2}_{1/6}\oplus\mathbf{1}_{2/3}\oplus\mathbf{\bar{2}}_{1/6}\oplus\mathbf{1}_{-1/3}, (44a)
𝟔¯1/6=𝟐¯1/6𝟏1/3𝟐1/6𝟏2/3.\mathbf{\bar{6}}_{1/6}=\mathbf{\bar{2}}_{1/6}\oplus\mathbf{1}_{-1/3}\oplus\mathbf{2}_{1/6}\oplus\mathbf{1}_{2/3}~{}. (44b)

Both operators can create the same resonances which belong to 𝟔\mathbf{6} of the Sp(6)Sp(6) group.

Now consider two elementary quark doublets couple to the first two components of the composite operators of 𝟔\mathbf{6} and 𝟔¯\mathbf{\bar{6}} respectively, while both representations contain the same resonances:

λLq¯LaΛaiORi=λLq¯LaΛai(ξiαQRα),\lambda_{L}\bar{q}_{La}{\Lambda^{a}}_{i}O_{R}^{i}=\lambda_{L}\bar{q}_{La}{\Lambda^{a}}_{i}\left({\xi^{i}}_{\alpha}Q_{R}^{\alpha}\right), (45)

where

(Λ)ai=Λ=(100000010000),{(\Lambda)^{a}}_{i}=\Lambda=\begin{pmatrix}1&0&0&0&0&0\\ 0&1&0&0&0&0\\ \end{pmatrix}~{}, (46)

and

λLq¯LaϵabΩbiORi=λLq¯LaϵabΩbi(ξiβΣ0βαQRα),\lambda^{\prime}_{L}\bar{q}^{\prime}_{La}\epsilon^{ab}{\Omega_{b}}^{i}O^{\prime}_{Ri}=\lambda^{\prime}_{L}\bar{q}^{\prime}_{La}\epsilon^{ab}{\Omega_{b}}^{i}\left({\xi^{*}_{i}}^{\beta}\Sigma_{0\beta\alpha}Q_{R}^{\alpha}\right), (47)

where

(Ω)ai=Ω=(100000010000).{(\Omega)_{a}}^{i}=\Omega=\begin{pmatrix}1&0&0&0&0&0\\ 0&1&0&0&0&0\\ \end{pmatrix}~{}. (48)

The combination of the two interactions breaks the SU(6)SU(6) global symmetry explicitly but preserves an SU(4)SU(4) symmetry of the 3,4,5,63,4,5,6 entries. It leads to a potential for the pNGBs at 𝒪(λL2λL2)\mathcal{O}(\lambda_{L}^{2}\lambda_{L}^{\prime 2}) of the form

[(Λ)ai(Ω)bjΣij][(Ω)bm(Λ)anΣmn],[{(\Lambda)^{a}}_{i}{(\Omega^{*})^{b}}_{j}\Sigma^{ij}][{{(\Omega)_{b}}^{m}}{(\Lambda^{*})_{a}}^{n}\Sigma^{*}_{mn}]~{}, (49)

which can easily be checked by drawing a one-loop diagram, with qLq_{L}, qLq^{\prime}_{L}, QRQ_{R} running in the loop.

After expanding it we obtain

Nc8π2λL2λL2f4|(Λ)ai(Ω)bjΣij|2Nc4π2λL2λL2f2|s+i2fH2~H1|2.\sim\frac{N_{c}}{8\pi^{2}}\lambda_{L}^{2}\lambda_{L}^{\prime 2}f^{4}\left|{(\Lambda)^{a}}_{i}{(\Omega^{*})^{b}}_{j}\Sigma^{ij}\right|^{2}\quad\to\quad\frac{N_{c}}{4\pi^{2}}\lambda_{L}^{2}\lambda_{L}^{\prime 2}f^{2}\left|s+\frac{i}{2f}\tilde{H_{2}}^{\dagger}H_{1}\right|^{2}~{}. (50)

(The factor of 2 comes from the trace which reflects the degrees of freedom running in the loop, as both elementary fermions are doublets.) This is one of the terms needed for the collective symmetry breaking. The coefficient is estimated from the dimensional analysis. Notice that we have chosen different (generations of) elementary quark doublets, qLq_{L} and qLq_{L}^{\prime} in the two couplings. If qLq_{L} and qLq_{L}^{\prime} were the same, the loop can be closed at 𝒪(λLλL)\mathcal{O}(\lambda_{L}\lambda_{L}^{\prime}) and a large ss tadpole term and Higgs quadratic term will be generated,

Nc8π2λLλLf4(ϵab(Λ)ai(Ω)bjΣij)Nc4π2λLλLgψ2f3(s+i2fH2~H1).\sim\frac{N_{c}}{8\pi^{2}}\lambda_{L}\lambda_{L}^{\prime}f^{4}\left(\epsilon_{ab}{(\Lambda)^{a}}_{i}{(\Omega^{*})^{b}}_{j}\Sigma^{ij}\right)\quad\to\quad\frac{N_{c}}{4\pi^{2}}\lambda_{L}\lambda_{L}^{\prime}g_{\psi}^{2}f^{3}\left(s+\frac{i}{2f}\tilde{H_{2}}^{\dagger}H_{1}\right)~{}. (51)

Such a term is actually needed for a realistic EWSB, but it would be too large if it were generated together with Eq. (50) that will produce the Higgs quartic term. It can be generated of an appropriate size in a similar way involving some other different fermions and composite operators with smaller couplings.

The way that the mass term for ss can be generated without the tadpole term can be understood from the symmetry point of view. In addition to the SU(2)W×U(1)YSU(2)_{W}\times U(1)_{Y}, the Σ0\Sigma_{0} preserves a global U(1)U(1) Peccei-Quinn (PQ) Peccei:1977ur subgroup of Sp(6)Sp(6). This global U(1)U(1) symmetry corresponds to the unbroken generator

U(1)PQ:12(100000010000000000000100000010000000),U(1)_{PQ}:\frac{1}{2}\begin{pmatrix}1&0&0&0&0&0\\ 0&1&0&0&0&0\\ 0&0&0&0&0&0\\ 0&0&0&-1&0&0\\ 0&0&0&0&-1&0\\ 0&0&0&0&0&0\\ \end{pmatrix}, (52)

under which ss has charge 1, both H1,H2H_{1},H_{2} have charge 1/2, and the rest of pNGBs have charge 0. The ss mass term is invariant under U(1)PQU(1)_{PQ} while the tadpole term has charge 1 so it will not be induced if the interactions can preserve the U(1)PQU(1)_{PQ} symmetry. On the other hand, the composite operators in Eqs. (45), (47) have the following PQ charges for their components (assuming that they don’t carry an additional overall charge),

𝟔0=𝟐1/2𝟏0𝟐¯1/2𝟏0,\displaystyle\mathbf{6}_{0}=\mathbf{2}_{1/2}\oplus\mathbf{1}_{0}\oplus\mathbf{\bar{2}}_{-1/2}\oplus\mathbf{1}_{0}, (53a)
𝟔¯0=𝟐¯1/2𝟏0𝟐1/2𝟏0,\displaystyle\mathbf{\bar{6}}_{0}=\mathbf{\bar{2}}_{-1/2}\oplus\mathbf{1}_{0}\oplus\mathbf{2}_{1/2}\oplus\mathbf{1}_{0}, (53b)

where the subscript here denotes the PQ charge instead of the XX charge. We see that qLq_{L} and qLq_{L}^{\prime} couple to components of different PQ charges. If qLq_{L} and qLq_{L}^{\prime} are different, it is possible to assign PQ charges, i.e., 1/21/2 for qLq_{L} and 1/2-1/2 for qLq_{L}^{\prime}, so that the interactions Eqs. (45), (47) preserve the PQ symmetry and the ss tadpole term will not be generated. If qLq_{L} and qLq_{L}^{\prime} are the same, then there is no consistent charge assignment that can preserve the PQ symmetry, and hence the ss tadpole term can be induced. Furthermore, if different generations of quarks carry different PQ charges, The U(1)PQU(1)_{PQ} preserving interactions will not induce flavor-changing neutral currents (FCNC) as they violate the PQ symmetry.

The second term required in realizing the collective symmetry breaking can be generated similarly by a different set of quarks (or leptons). They should couple to the 4th and 5th components of the 𝟔\mathbf{6} and 𝟔¯\mathbf{\bar{6}} operators through the spurions

(Λ)ai=(000100000010)and(Ω)ai=(000100000010),{(\Lambda^{\prime})}_{ai}=\begin{pmatrix}0&0&0&1&0&0\\ 0&0&0&0&1&0\\ \end{pmatrix}\quad\text{and}\quad{(\Omega^{\prime})}^{ai}=\begin{pmatrix}0&0&0&1&0&0\\ 0&0&0&0&1&0\\ \end{pmatrix}, (54)

which preserve the SU(4)SU(4) symmetry of the 1,2,3,6 entries.

The combination of Λ\Lambda^{\prime} and Ω\Omega^{\prime} can then introduce the potential

Nc8π2λL2λL2f4|(Λ)ai(Ω)bjΣij|2Nc4π2λL2λL2f2|si2fH2~H1|2,\sim\frac{N_{c}}{8\pi^{2}}\lambda_{L}^{2}\lambda_{L}^{\prime 2}f^{4}\left|{(\Lambda^{\prime})}_{ai}{(\Omega^{\prime*})}_{bj}\Sigma^{ij}\right|^{2}\quad\to\quad\frac{N_{c}}{4\pi^{2}}\lambda_{L}^{2}\lambda_{L}^{\prime 2}f^{2}\left|s-\frac{i}{2f}\tilde{H_{2}}^{\dagger}H_{1}\right|^{2}, (55)

which provides the other term needed for the collective symmetry breaking.

To generate all the terms required for the Higgs quartic potential from collective symmetry breaking, we need to use several different quarks and/or leptons, with different PQ charge assignments. As we mentioned earlier, we also need some smaller PQ-violating couplings between the elementary fermions and the composite operators, in order to generate a proper-sized H2~H1\tilde{H_{2}}^{\dagger}H_{1} term,

m122Nc8π2λLλL′′gψ2f2,m_{12}^{2}\sim\frac{N_{c}}{8\pi^{2}}\lambda_{L}\lambda_{L}^{\prime\prime}g_{\psi}^{2}f^{2}, (56)

where λL′′\lambda_{L}^{\prime\prime} represents the smaller U(1)PQU(1)_{PQ} violating coupling. A more detailed coupling assignment for a realistic model is presented in Appendix B. With all the collective symmetry breaking interactions discussed above, we obtain a pNGB potential,

ckNc4π2λkL2λL2f2|s+i2fH2~H1|2+cmnNc4π2λmL2λnL2f2|si2fH2~H1|2,c_{k\ell}\frac{N_{c}}{4\pi^{2}}\lambda_{k_{L}}^{2}\lambda_{\ell_{L}}^{\prime 2}f^{2}\left|s+\frac{i}{2f}\tilde{H_{2}}^{\dagger}H_{1}\right|^{2}+c_{mn}\frac{N^{\prime}_{c}}{4\pi^{2}}\lambda_{m_{L}}^{2}\lambda_{n_{L}}^{\prime 2}f^{2}\left|s-\frac{i}{2f}\tilde{H_{2}}^{\dagger}H_{1}\right|^{2}~{}, (57)

where ck,cmnc_{k\ell},\,c_{mn} are 𝒪(1)\mathcal{O}(1) constants depending on the UV completion,444In the Discrete CHMs Matsedonskyi:2012ym or UV completions with Weinberg’s sum rules Marzocca:2012zn ; Pomarol:2012qf for the MCHM, the analogous finite quartic potentials have the coefficient c2c\sim 2. and the indices k,,m,nk,\ell,m,n here label different fermions. After integrating out the massive ss field, we obtain a quartic term for the Higgs doublets (take Nc,Nc=3N_{c},N^{\prime}_{c}=3) as

λ12|H2~H1|2withλ12=34π2ckcmnλkL2λL2λmL2λnL2ckλkL2λL2+cmnλmL2λnL2.\lambda_{12}\left|\tilde{H_{2}}^{\dagger}H_{1}\right|^{2}\quad\text{with}\quad\lambda_{12}=\frac{3}{4\pi^{2}}\frac{c_{k\ell}c_{mn}\lambda_{k_{L}}^{2}\lambda_{\ell_{L}}^{\prime 2}\lambda_{m_{L}}^{2}\lambda_{n_{L}}^{\prime 2}}{c_{k\ell}\lambda_{k_{L}}^{2}\lambda_{\ell_{L}}^{\prime 2}+c_{mn}\lambda_{m_{L}}^{2}\lambda_{n_{L}}^{\prime 2}}~{}. (58)

Assuming λkLλLλmLλnL\lambda_{k_{L}}\lambda_{\ell_{L}}^{\prime}\sim\lambda_{m_{L}}\lambda_{n_{L}}^{\prime} and ckcmn2c_{k\ell}\sim c_{mn}\sim 2, then in our estimate

λ1234π2λkL2λL2.\lambda_{12}\sim\frac{3}{4\pi^{2}}\lambda_{k_{L}}^{2}\lambda_{\ell_{L}}^{\prime 2}~{}. (59)

Including this quartic term, the coefficients of the Higgs potential in this model are estimated to be

α^316π2λtL2λtR2f2,β^316π2λkL2λL2f2.\hat{\alpha}\sim\frac{3}{16\pi^{2}}\lambda_{t_{L}}^{2}\lambda_{t_{R}}^{2}f^{2},\quad\hat{\beta}\sim\frac{3}{16\pi^{2}}\lambda_{k_{L}}^{2}\lambda_{\ell_{L}}^{\prime 2}f^{2}~{}. (60)

Therefore we can further improve upon the minimal tuning (α^β^\hat{\alpha}\sim\hat{\beta}) case by requiring

λL>λtRβ^>α^.\lambda_{L}^{\prime}>\lambda_{t_{R}}\implies\hat{\beta}>\hat{\alpha}~{}. (61)

Of course, however, β^\hat{\beta} can not be arbitrarily large because it is determined by the Higgs boson mass from Eq. (7). The required numerical parameters will be discussed in the next section.

5 The Higgs Potential in the 2HDM

The SU(6)/Sp(6)SU(6)/Sp(6) model contains two Higgs doublets. To analyze the EWSB and the Higgs boson masses, we need to consider the Higgs potential in a 2HDM. A review of 2HDM can be found in Ref. Branco:2011iw . The other pNGBs do not affect the Higgs potential much (they either are heavy or couple mostly quadratically to the Higgs doublets), so we will postpone their discussion to the next section. The Higgs potential in our model can be parameterized as

V(H1,H2)\displaystyle V(H_{1},H_{2}) =m12H1H1+m22H2H2m122(H2~H1+h.c.)\displaystyle=m_{1}^{2}H_{1}^{\dagger}H_{1}+m_{2}^{2}H_{2}^{\dagger}H_{2}-m_{12}^{2}\left(\tilde{H_{2}}^{\dagger}H_{1}+\text{h.c.}\right)
+λ12(H1H1)2+λ22(H2H2)2+λ12|H2~H1|2.\displaystyle\quad+\frac{\lambda_{1}}{2}\left(H_{1}^{\dagger}H_{1}\right)^{2}+\frac{\lambda_{2}}{2}\left(H_{2}^{\dagger}H_{2}\right)^{2}+\lambda_{12}\left|\tilde{H_{2}}^{\dagger}H_{1}\right|^{2}~{}. (62)

Notice that, in CHMs, due to the non-linearity of pNGBs, the Higgs potential should include trigonometric functions instead of polynomials. Also, to match the potential here to the SM Higgs potential, an additional factor of cosθ\langle\theta\rangle will appear. However, since the deviation is strongly constrained by Higgs coupling measurements, we will take θ1\langle\theta\rangle\ll 1 and expand sinxxx\sim x in the following discussion for simplicity.

In the 2HDM potential (5), both Higgs doublets develop nonzero VEVs. Denote the VEVs of H1H_{1} and H2H_{2} to be v1v_{1} and v2v_{2} respectively, and their ratio is defined as tanβv2/v1\tan\beta\equiv v_{2}/v_{1}. The total VEV vv satisfies

v2=v12+v22=v2cos2β+v2sin2β=(246 GeV)2.v^{2}=v_{1}^{2}+v_{2}^{2}=v^{2}\text{cos}^{2}\beta+v^{2}\text{sin}^{2}\beta=(246\text{ GeV})^{2}~{}. (63)

H2H_{2} couples to the top quark and gets a large negative loop-induced contribution to its quadratic term, so it is natural to expect v2>v1v_{2}>v_{1}. On the other hand, the main quartic term coming from the collective symmetry breaking is λ12\lambda_{12}. To have a large enough effective quartic term for the 125 GeV Higgs boson, we do not want either sinβ(sβ)\sin\beta\,(\equiv s_{\beta}) or cosβ(cβ)\cos\beta\,(\equiv c_{\beta}) to be too small. The current constraints Kling:2020hmi ; Sirunyan:2019arl ; Aaboud:2018cwk have ruled out the region tanβ\tan\beta near 1, so we will consider a benchmark with a medium value,

tanβ3.\text{tan}\beta\sim 3~{}. (64)

Also, the light neutral eigenstate should be close to the SM Higgs boson, which imposes some conditions on the parameters in the Higgs potential (5). In Subsec. 5.1, we first discuss the quadratic potential, which will determine the spectrum of additional Higgs bosons in this model. Then, we will discuss the alignment issue in Subsec. 5.2 and the corresponding values of the quartic terms in the Higgs potential.

5.1 Estimating the Mass Terms

The experimental constraints require that the 2HDM should be close to the alignment limit (βα=π/2\beta-\alpha=\pi/2Gunion:2002zf ; Craig:2012vn ; Craig:2013hca ; Carena:2013ooa , where α\alpha is the mixing angle between the mass eigenstates of the two CP-even Higgs boson and the corresponding components in H1,H2H_{1},H_{2} (after removing the VEVs),

h=h1sinα+h2cosα.h=-h_{1}\,\sin\alpha+h_{2}\,\cos\alpha~{}. (65)

To simplify the discussion of the quadratic terms, we assume that the alignment holds approximately,

hh1cosβ+h2sinβ=hSM,h\approx h_{1}\,\cos\beta+h_{2}\,\sin\beta=h_{\text{SM}}, (66)

then we can calculate the SM Higgs potential by the transformation

(H1H2)=(cosβsinβsinβcosβ)(HSMHheavy).\left(\begin{array}[]{c}H_{1}\\ H_{2}\end{array}\right)=\begin{pmatrix}\text{cos}\beta&-\text{sin}\beta\\ \text{sin}\beta&\text{cos}\beta\end{pmatrix}\left(\begin{array}[]{c}H_{\text{SM}}\\ H_{\text{heavy}}\end{array}\right)~{}. (67)

The potential of the light SM Higgs doublet becomes (keeping the terms with HSMH_{\text{SM}} only and rewriting HSMHH_{\text{SM}}\to H)

V(H)\displaystyle V(H) =(m12cos2β+m22sin2β2m122sinβcosβ)|H|2\displaystyle=\left(m_{1}^{2}\,\text{cos}^{2}\beta+m_{2}^{2}\,\text{sin}^{2}\beta-2m_{12}^{2}\,\text{sin}\beta\,\text{cos}\beta\right)|H|^{2}
+(λ12cos4β+λ22sin4β+λ12sin2βcos2β)|H|4.\displaystyle\quad+\left(\frac{\lambda_{1}}{2}\text{cos}^{4}\beta+\frac{\lambda_{2}}{2}\text{sin}^{4}\beta+\lambda_{12}\,\text{sin}^{2}\beta\,\text{cos}^{2}\beta\right)|H|^{4}~{}. (68)

Matching the quadratic term with the SM Higgs potential implies that

μ2=m12cos2β+m22sin2β2m122sinβcosβ(88 GeV)2.\displaystyle-\mu^{2}=m_{1}^{2}\,\text{cos}^{2}\beta+m_{2}^{2}\,\text{sin}^{2}\beta-2m_{12}^{2}\,\text{sin}\beta\,\text{cos}\beta\approx-\left(88\text{ GeV}\right)^{2}~{}. (69)

As shown in the previous section, these mass terms get contributions from different sources: m1m_{1} comes from gauge contributions, m2m_{2} gets an additional large negative contribution from the top quark besides the gauge contributions, and m12m_{12} comes from the PQ-violating interactions. No natural cancellation among the three terms in Eq. (69) is warranted. Therefore, the absolute values of all three terms should be of the same order as μ2\mu^{2} to avoid tuning. For example, for tanβ=3\tan\beta=3 Eq. (69) can be satisfied by m12(360 GeV)2m_{1}^{2}\sim\left(360\text{ GeV}\right)^{2}, m22(120 GeV)2m_{2}^{2}\sim\left(120\text{ GeV}\right)^{2}, and m122(210 GeV)2m_{12}^{2}\sim\left(210\text{ GeV}\right)^{2} without strong cancellations among the three terms. These numbers are based on the alignment approximation. More accurate values need to include the whole 2HDM potential and will be given after the discussion of the quartic terms.

5.2 Estimating the Quartic Terms

There are three quartic couplings in the Higgs potential (5): λ1\lambda_{1}, λ2\lambda_{2}, and λ12\lambda_{12}. The effective quartic coupling for the light Higgs, which can be seen from Eq. (5.1), is a combination of the three quartic couplings and tanβ\tan\beta. To obtain a 125 GeV Higgs boson we need

λ12cos4β+λ22sin4β+λ12sin2βcos2β0.13.\frac{\lambda_{1}}{2}\text{cos}^{4}\beta+\frac{\lambda_{2}}{2}\text{sin}^{4}\beta+\lambda_{12}\,\text{sin}^{2}\beta\,\text{cos}^{2}\beta\approx 0.13~{}. (70)

λ1\lambda_{1} is mainly induced by the SM gauge loops and is expected to be small. λ2\lambda_{2} receives the top quark loop contribution,

λ23yt44π2lnMTv0.1.\lambda_{2}\sim\frac{3y_{t}^{4}}{4\pi^{2}}\ln\frac{M_{T}}{v}\sim 0.1. (71)

This implies that we need λ12\lambda_{12} which comes from the collective symmetry breaking to satisfy

λ12sβ2cβ20.1λ121for tanβ=3.\lambda_{12}\text{s}_{\beta}^{2}\text{c}_{\beta}^{2}\sim 0.1~{}~{}\Rightarrow~{}~{}\lambda_{12}\sim 1\quad\text{for }\tan\beta=3~{}. (72)

If it arises from the collective quartic term obtained in Eq. (59), it corresponds to

λLλL3.6λLλL1.9.\lambda_{L}\lambda_{L}^{\prime}\sim 3.6\quad\Rightarrow\quad\sqrt{\lambda_{L}\lambda_{L}^{\prime}}\sim 1.9~{}. (73)

These couplings between the elementary states and composite operators are quite large. However, the smallness of SM Yukawa couplings can be obtained by small λR\lambda_{R} couplings. There are other experimental constraints with these large λL\lambda_{L} couplings, which will be discussed in the following sections.

We have been assuming that the 2HDM potential is approximately in the alignment regime. Let us go back to check how well the alignment can be achieved. A simple way to achieve the alignment is the decoupling limit where the extra Higgs bosons are heavy. However, this would require more tuning in the Higgs mass parameters. In our model λ12>λ2,λ1\lambda_{12}>\lambda_{2},\lambda_{1}. Under this condition, we need tanβ1\tan\beta\sim 1 to achieve the exact alignment if the extra Higgs bosons are not too heavy. This is not compatible with the experiment constraints. Therefore we expect some misalignment and need to check whether the misalignment can be kept within the experimental constraints.

Solving the eigenvalue equations, we can get the following equations for the factor cβαc_{\beta-\alpha},

cβα\displaystyle c_{\beta-\alpha} =1MA2tanβ(λ1v12(sαcβ)+λ12v22(cαsβ)Mh2(sαcβ)),\displaystyle=\frac{1}{M_{A}^{2}\text{tan}\beta}\left(\lambda_{1}v_{1}^{2}\left(\frac{-s_{\alpha}}{c_{\beta}}\right)+\lambda_{12}v_{2}^{2}\left(\frac{c_{\alpha}}{s_{\beta}}\right)-M_{h}^{2}\left(\frac{-s_{\alpha}}{c_{\beta}}\right)\right), (74)
=1MA2cotβ(λ12v12(sαcβ)λ2v22(cαsβ)+Mh2(cαsβ)).\displaystyle=\frac{1}{M_{A}^{2}\text{cot}\beta}\left(-\lambda_{12}v_{1}^{2}\left(\frac{-s_{\alpha}}{c_{\beta}}\right)-\lambda_{2}v_{2}^{2}\left(\frac{c_{\alpha}}{s_{\beta}}\right)+M_{h}^{2}\left(\frac{c_{\alpha}}{s_{\beta}}\right)\right). (75)

As the misalignment should be small, to estimate its size, we can assume that the mass eigenstates of the 2HDM are near alignment, which satisfy (sα,cα)(cβ,sβ)(-s_{\alpha},c_{\alpha})\approx(c_{\beta},s_{\beta}) approximately for the right-handed side. We then have

cβα\displaystyle c_{\beta-\alpha} 1MA2tanβ(λ1v12+λ12v22Mh2),\displaystyle\approx\frac{1}{M_{A}^{2}\text{tan}\beta}\left(\lambda_{1}v_{1}^{2}+\lambda_{12}v_{2}^{2}-M_{h}^{2}\right), (76)
1MA2cotβ(λ12v12λ2v22+Mh2).\displaystyle\approx\frac{1}{M_{A}^{2}\text{cot}\beta}\left(-\lambda_{12}v_{1}^{2}-\lambda_{2}v_{2}^{2}+M_{h}^{2}\right). (77)

Consider the benchmark values

tanβ3,λ121,andMA380 GeV,\text{tan}\beta\approx 3,\quad\lambda_{12}\approx 1,\quad\text{and}\quad M_{A}\approx 380\text{ GeV}~{}, (78)

where the MAM_{A} value is chosen to keep the misalignment small and to evade the direct search in the A0hZA^{0}\to hZ decay channel at the LHC Kling:2020hmi . The equations for cβαc_{\beta-\alpha} becomes

cβα0.014λ1+0.0900.1991.132λ2.\displaystyle c_{\beta-\alpha}\approx~{}0.014\lambda_{1}+0.090~{}\approx~{}0.199-1.132\lambda_{2}~{}. (79)

Since λ1\lambda_{1} in this model is small, we have cβα0.090c_{\beta-\alpha}\approx 0.090 which parametrizes the deviation from the alignment. The misalignment will have a direct consequence on Higgs physics and will be discussed in the following sections. The most relevant deviation, the ratio of Higgs to vector bosons coupling to SM coupling, is proportional to sβα0.996s_{\beta-\alpha}\approx~{}0.996 and should still be safe.

Eq. (79) also implies that λ2\lambda_{2} needs to be 0.1\approx 0.1, which is consistent with the estimate from the top quark loop contribution Eq. (71). To sum up, the three quartic couplings in our 2HDM potential take values

λ121λ20.1λ1.\lambda_{12}\approx 1\quad\gg\quad\lambda_{2}\approx 0.1\quad\gg\quad\lambda_{1}~{}. (80)

5.3 A Realistic Higgs Potential

So far, all numbers in the above discussion are estimations based on simplified approximations. In a realistic benchmark model, the exact values can be solved by directly diagonalizing the mass matrix. To reproduce the correct Higgs boson mass Mh=125M_{h}=125 GeV and small enough cβαc_{\beta-\alpha} with fixed tanβ3\beta\approx 3 and λ121\lambda_{12}\approx 1, we choose the following values as a reference for our study:

tanβ3.0,λ121.0,λ20.12,andMA380 GeV.\text{tan}\beta\approx 3.0,\quad\lambda_{12}\approx 1.0,\quad\lambda_{2}\approx 0.12,\quad\text{and}\quad M_{A}\approx 380\text{ GeV}~{}. (81)

λ1\lambda_{1} is irrelevant as long as it is small so we don’t set its value. The value of λ2\lambda_{2} is set by producing the correct Higgs boson mass.

With these numbers, we can diagonalize the mass matrix and get the mixing angle α\alpha and the misalignment βα\beta-\alpha as

sα=0.215,cα=0.977cβα=0.1049,sβα=0.9945.\displaystyle s_{\alpha}=-0.215,\quad c_{\alpha}=0.977\quad\implies\quad c_{\beta-\alpha}=0.1049,\quad s_{\beta-\alpha}=0.9945~{}. (82)

The eigenvalues of the matrix give the masses of the CP-even neutral scalar bosons as

Mh125 GeVandMH370 GeV.\displaystyle M_{h}\approx 125\text{ GeV}\quad\text{and}\quad M_{H}\approx 370\text{ GeV}~{}. (83)

The complete spectrum will be discussed in the next section.

After we obtain the quartic couplings, we can go back to determine the mass terms. The value of MAM_{A} is chosen to satisfy the experimental constraint. It also gives the value of m12m_{12} based on the relation

m122=MA2sβcβ(210 GeV)2.\displaystyle m_{12}^{2}=M_{A}^{2}{s_{\beta}c_{\beta}}\sim\left(210\text{ GeV}\right)^{2}~{}. (84)

Given the values of all the quartic couplings and m12m_{12}, we can obtain the other mass terms

m12=3m12212λ1v1212λ12v22(320 GeV)2,\displaystyle m_{1}^{2}=3m_{12}^{2}-\frac{1}{2}\lambda_{1}v_{1}^{2}-\frac{1}{2}\lambda_{12}v_{2}^{2}\sim\left(320\text{ GeV}\right)^{2}, (85)
m22=13m12212λ2v2212λ12v12(90 GeV)2.\displaystyle m_{2}^{2}=\frac{1}{3}m_{12}^{2}-\frac{1}{2}\lambda_{2}v_{2}^{2}-\frac{1}{2}\lambda_{12}v_{1}^{2}\sim\left(90\text{ GeV}\right)^{2}~{}. (86)

These numbers will serve as a benchmark for our phenomenological studies.

Assuming that these masses arise dominantly from the loop contributions discussed in the previous sections, we can also estimate the masses of the composite states in the CHM,

m12=332π2g2Mρ2(320 GeV)2,\displaystyle m_{1}^{2}=\frac{3}{32\pi^{2}}g^{2}M_{\rho}^{2}\sim\left(320\text{ GeV}\right)^{2}, (87)
m22=332π2g2Mρ238π2yt2MT2(90 GeV)2,\displaystyle m_{2}^{2}=\frac{3}{32\pi^{2}}g^{2}M_{\rho}^{2}-\frac{3}{8\pi^{2}}y_{t}^{2}M_{T}^{2}\sim\left(90\text{ GeV}\right)^{2}, (88)
m122=Nc8π2λLλL′′gψ2f2(210 GeV)2,\displaystyle m_{12}^{2}=\frac{N_{c}}{8\pi^{2}}\lambda_{L}\lambda_{L}^{\prime\prime}g_{\psi}^{2}f^{2}\sim\left(210\text{ GeV}\right)^{2}~{}, (89)

where we have ignored the small U(1)U(1) gauge contribution and taken cw1c_{w}\sim 1. The m12m_{1}^{2} equation gives the mass of the gauge boson partners Mρ5M_{\rho}\sim 5 TeV. In the m22m_{2}^{2} equation, the top loop contribution needs to cancel the positive gauge contribution (320 GeV)2\left(320\text{ GeV}\right)^{2} to produce a (90 GeV)2\left(90\text{ GeV}\right)^{2} term. From that, the top partner is estimated to be around MT1.6M_{T}\sim 1.6 TeV. This corresponds to an 𝒪(10%)\mathcal{O}(10\%) tuning between the gauge contribution and the top contribution, but it is hard to avoid given the experimental constraints on the top partner mass. The desired size of m122m_{12}^{2} can be achieved by a suitable choice of the PQ-violating coupling λL′′\lambda^{\prime\prime}_{L} which is a free parameter in this model.

6 The Spectrum of pNGBs

After discussing the Higgs potential from the naturalness consideration, we are ready to provide the estimates of masses of all other pNGBs, based on the benchmark point alluded in the previous section.

6.1 The Second Higgs Doublet

The 2HDM potential has been discussed in the previous section. In addition to the SM-like 125 GeV Higgs boson, there is one more CP-even neutral scalar H0H^{0}, a CP-odd neutral scalar A0A^{0}, and a complex charge scalar H±H^{\pm}. Their masses from the Higgs potential (5) are

MA2=m122sβcβ,MH±2=MA212λ12v2,\displaystyle M_{A}^{2}=\frac{m_{12}^{2}}{s_{\beta}c_{\beta}}~{},\qquad\qquad M_{H^{\pm}}^{2}=M_{A}^{2}-\frac{1}{2}\lambda_{12}v^{2},
Mh,H2=12(MA2±MA48MH±2λ12v2sβ2cβ2),\displaystyle M_{h,H}^{2}=\frac{1}{2}\left(M_{A}^{2}\pm\sqrt{M_{A}^{4}-8M_{H^{\pm}}^{2}\lambda_{12}v^{2}s_{\beta}^{2}c_{\beta}^{2}}~{}\right), (90)

which results in a spectrum MA>MH>MH±M_{A}>M_{H}>M_{H^{\pm}}. This is different from the 2HDM spectrum of the MSSM because the dominant quartic term is λ12\lambda_{12}. For the benchmark point of the previous section, the three masses are estimated to be

MA380 GeV,MH370 GeV,andMH±340 GeV.\displaystyle M_{A}\sim 380\text{ GeV},\quad M_{H}\sim 370\text{ GeV},\quad\text{and}\quad M_{H^{\pm}}\sim 340\text{ GeV}. (91)

6.2 Other pNGBs

In addition to the two doublets, the pNGBs also include a real triplet ϕ\phi, a real singlet η\eta, and a complex singlet ss. The triplet obtains its mass from the gauge loop as shown in Eq. (25). For Mρ5M_{\rho}\sim 5 TeV, it gives

Mϕ2=cw14π2g2Mρ2(500 GeV)2.\displaystyle M_{\phi}^{2}=c_{w}\frac{1}{4\pi^{2}}g^{2}M_{\rho}^{2}\sim\left(500\text{ GeV}\right)^{2}. (92)

The singlets do not receive mass contributions from SM gauge interactions. The complex singlet ss obtains its mass from the collective symmetry breaking mechanism (57),

Ms2=ckNc4π2λkL2λL2f2+cmnNc4π2λmL2λnL2f24λ12f2(2f)2,M_{s}^{2}=c_{k\ell}\frac{N_{c}}{4\pi^{2}}\lambda_{k_{L}}^{2}\lambda_{\ell_{L}}^{\prime 2}f^{2}+c_{mn}\frac{N^{\prime}_{c}}{4\pi^{2}}\lambda_{m_{L}}^{2}\lambda_{n_{L}}^{\prime 2}f^{2}\geq 4\lambda_{12}f^{2}\approx(2f)^{2}, (93)

which is expected to be at the TeV scale. There is also a tadpole term from the PQ-violating potential, which will introduce a small VEV for ss,

sm122fMs2(210 GeV)24f𝒪(10 GeV).\langle s\rangle\sim\frac{m_{12}^{2}f}{M_{s}^{2}}\leq\frac{\left(210\text{ GeV}\right)^{2}}{4f}\sim\mathcal{O}(10\text{ GeV}). (94)

It will have little effect on the mass of the singlet.

Finally, the real singlet η\eta does not get a mass at the leading order but it couples quadratically to the Higgs doublets (e.g., from Eq. (39)), so it can still become massive after the Higgs doublets develop nonzero VEVs. Through Eq. (39), η\eta receives a mass

Mη238π2yt2MT2(vf)2Mη(MTf)48 GeV.\displaystyle M_{\eta}^{2}\sim\frac{3}{8\pi^{2}}y_{t}^{2}M_{T}^{2}\cdot\left(\frac{v}{f}\right)^{2}\implies M_{\eta}\sim\left(\frac{M_{T}}{f}\right)48\text{ GeV}. (95)

For naturalness, a relatively light top partner is preferred. On the other hand, the experimental constraints require η\eta to be heavier than half of Higgs boson mass to avoid large Higgs decay rate to the ηη\eta\eta channel. We expect a light singlet scalar around 100 GeV, which can be the lightest composite state in the spectrum.

7 Collider Searches

In CHMs, there will be new composite states of scalars, fermions, and vectors near or below the compositeness scale. The detailed spectrum and quantum numbers depend on the specific realizations of the CHMs. In this section, we study the collider searches of and constraints on these new states in the SU(6)/Sp(6)SU(6)/Sp(6) model discussed in this paper.

7.1 The Second Higgs Doublet

Refer to caption
Figure 1: Constraints on extra neutral Higgs bosons in a Type-I 2HDM with a small misalignment cβα=0.1c_{\beta-\alpha}=0.1. This summary plot is taken from Ref. Kling:2020hmi .

Under the requirement of naturalness, the second Higgs doublet is expected to be among the lightest states of the new resonances and could be the first sign of this model. In the Type-II 2HDM, the flavor-changing process bsγb\to s\gamma has put strong constraints on the charged Higgs mass to be above 600 GeV, which would require more tuning in the Higgs potential. Therefore, we focus on the Type-I 2HDM scenario. As explained in the previous section, we will consider a relatively small tanβ3\tan\beta\sim 3 with a small misalignment cβα0.1c_{\beta-\alpha}\sim 0.1.

The direct searches can be divided into two categories – charged Higgs bosons H±H^{\pm} and neutral Higgs bosons H0,A0H^{0},A^{0}. In the Type-I 2HDM with a small misalignment, neutral Higgs bosons to fermion couplings are characterized by a factor sα/sβ1/4-s_{\alpha}/s_{\beta}\sim 1/4 and the charged Higgs boson to fermion couplings are characterized by cβ/sβ1/3c_{\beta}/s_{\beta}\sim 1/3. Comparing to neutral Higgs bosons, the charged Higgs boson searches give a more reliable constraint on tanβ\beta because it doesn’t depend on the mixing angle α\alpha.

The charged Higgs boson is searched by its decays to SM fermions. For MH±mtM_{H^{\pm}}\lesssim m_{t}, the strongest constraint comes from decaying to τν\tau\nu Aaboud:2018gjj ; Sirunyan:2019hkq . Interpreted in the Type-I model, it excludes tanβ<14\tan\beta<14 for MH±100M_{H^{\pm}}\sim 100 GeV and tanβ<3\tan\beta<3 for MH±M_{H^{\pm}} up to 150 GeV Sanyal:2019xcp . For a heavier charged Higgs boson, the main constraint comes from the decay to tbtb, which rules out tanβ2\tan\beta\lesssim 2 for MH±M_{H^{\pm}} in the range of 200-400 GeV, and becomes weaker for larger MH±M_{H^{\pm}} Aaboud:2018cwk ; Sirunyan:2019arl .

For neutral Higgs bosons, there are multiple decay channels being searched. For light states below the tt¯t\bar{t} threshold, they can be searched by H/AττH/A\to\tau\tau Sirunyan:2018zut ; Aad:2020zxo and HγγH\to\gamma\gamma Sirunyan:2018wnk ; Aaboud:2017yyg decays. For heavier states, the decay to tt¯t\bar{t} becomes accessible and dominant. The searches of H/Att¯H/A\to t\bar{t} has been done at CMS and ATLAS Sirunyan:2019wph ; Aaboud:2018mjh . These searches typically constrain tanβ12\tan\beta\gtrsim 1-2 up to MH/A750M_{H/A}\sim 750 GeV. When there is misalignment as expected in this model, there are also additional decay channels of these neutral scalars which give important constraints. These include H/AWWH/A\to WW Sirunyan:2019pqw ; Aaboud:2017gsl and ZZZZ Sirunyan:2018qlb ; Aaboud:2017rel , HhhH\to hh  Sirunyan:2018ayu ; Aad:2019uzh , and AhZA\to hZ  Sirunyan:2019xls ; Aaboud:2017cxo . The AhZA\to hZ and HhhH\to hh turn out to be most constraining for the region that we are interested in. The AhZA\to hZ can exclude tanβ\tan\beta up to 10 below the tt¯t\bar{t} threshold. Some higher mass ranges are also constrained due to data fluctuations. HhhH\to hh constrains tanβ\tan\beta to be 3\gtrsim 3 for a wide mass range. Various constraints on the neutral scalars for 2HDMs are summarized in Ref. Kling:2020hmi , and the relevant plot is reproduced in Fig. 1. We can see that the benchmark point chosen in the previous section,

MA380 GeV,MH370 GeV,andMH±340 GeV,\displaystyle M_{A}\sim 380\text{ GeV},\quad M_{H}\sim 370\text{ GeV},\quad\text{and}\quad M_{H^{\pm}}\sim 340\text{ GeV}, (96)

with tanβ=3\tan\beta=3 is sitting in the gap of the constraints. It is still allowed by but very close to the current constraints, hence it will be tested in the near future.

For future searches, the most relevant channels for the more natural mass range are di-boson channels H/AVVH/A\to VV, HhhH\to hh, and AhZA\to hZ. The current bounds are expected to be improved by 10\sim 10 times Cepeda:2019klc . It will probe the parameter region that we are most interested in. If we can also find the charged Higgs with a slightly lighter mass, this particular spectrum can be an indication of the specific 2HDM Higgs potential (different from that of the MSSM) that arises from this type of CHMs.

7.2 Additional Scalar Bosons

Besides the second Higgs doublet, there are also several additional scalar bosons, which include a real triplet ϕ\phi, a complex singlet ss, and a real singlet η\eta. At the leading order, they don’t directly connect to the SM fermions. However, the couplings to SM fermions are induced through the mixing with Higgs bosons after EWSB, with a suppression factor of v/2f0.15v/2f\sim 0.15 (for ξ0.1\xi\sim 0.1).

Scalar triplet ϕ\phi:

The scalar triplet has unsuppressed gauge interactions with WW and ZZ bosons, but only through four-point vertices. They can be paired produced through the vector boson fusion but the production is highly suppressed due to the large energy required. Therefore, here we only consider the single production through the interaction with SM fermions. The scalar triplet includes a complex charged scalar ϕ±\phi^{\pm} and a neutral scalar ϕ0\phi^{0}. The collider searches of the charged scalar are similar to those of H±H^{\pm} of the second Higgs doublet but with the suppressed couplings. It can be produced in association with a top and a bottom. However, due to the suppressed coupling and the larger mass, the charged scalar ϕ±\phi^{\pm} is less constrained.

The neutral scalar ϕ0\phi^{0} is searched in the same ways as the neutral scalars in 2HDMs. Guided by the benchmark scenario, we consider a scalar with mass 500\sim 500 GeV, which gives a cross section 120120 fb. The dominant decay mode will be ϕ0tt¯\phi^{0}\to t\bar{t} with a branching ratio 75%\sim 75\%. The current bound from the LHC searches Sirunyan:2019wph ; Aaboud:2018mjh on the cross section is σ×BR<5\sigma\times BR<5 pb, which is still loose for a neutral scalar with σ×BR90\sigma\times BR\sim 90 fb. The di-boson modes are also important with branching ratios 16%\sim 16\% for WWWW and 8%\sim 8\% for ZZZZ. The most stringent current upper bound comes from ϕ0ZZ\phi^{0}\to ZZ channel, which ruled out σ×BR\sigma\times BR above 100100 fb Sirunyan:2018qlb ; Aaboud:2017rel . It is also much larger than 10\sim 10 fb for the benchmark point. In the future, around 3.6×1053.6\times 10^{5} ϕ0\phi^{0} (at 500 GeV) would be produced in the HL-LHC era with an integrated luminosity of 3 ab-1. The bound can be improved by 1010 times Cepeda:2019klc . And a 500 GeV ϕ0\phi^{0} could be within reach in the HL-LHC era.

Scalar singlets:

The complex scalar ss is expected to be at TeV scale and the real singlet η\eta is around 100100 GeV. They both act like the neutral scalar ϕ0\phi^{0} discussed above, but without the gauge interactions. They can be produced through the gluon fusion but the production cross sections will be suppressed by ξ/40.025\xi/4\sim 0.025.

For the heavy complex scalar ss, The expectation of its mass in the benchmark point is above 1.51.5 TeV. The dominant decay channel will be a pair of neutral Higgs bosons sh1h2(hh,hH,HH)s\to h_{1}h_{2}~{}(hh,hH,HH) or charged Higgs bosons due to the large sH2~H1s\tilde{H_{2}}^{\dagger}H_{1} coupling. It also connects to the fermions sector through the mixing with Higgs bosons. However, the production is suppressed due to the large mass. Although it is an essential element of the collective Higgs quartic term, it is hard to detect even at the HL-LHC. It may be accessible in the next generation hadron collider.

The light real scalar η\eta should be heavy enough so that hηηh\to\eta\eta is forbidden due to the constraint from the Higgs invisible decay measurement Khachatryan:2016whc . This requires MT/f1.3M_{T}/f\gtrsim 1.3 for a realistic model, but it should remain relatively light if the top partner is not too heavy for the naturalness reason. Since the interactions between η\eta and SM particles are all through the mixing with the Higgs boson, the search modes are similar but with the ξ/4\xi/4 suppression on the production rate. The cross section is 1.5\sim 1.5 pb for a 100 GeV η\eta. The dominant decay modes are bb¯(78.9%)b\bar{b}\,(78.9\%), ττ(8.3%)\tau\tau\,(8.3\%) and gg(7.4%)gg\,(7.4\%), but they all suffer from large backgrounds. On the other hand, the clean channel γγ\gamma\gamma suffers from a low branching ratio 0.16%\sim 0.16\%. For the benchmark point, the diphoton channel has σ×BR3\sigma\times BR\sim 3 fb. The latest search from CMS CMS:2017yta still has an uncertainty 20(10)\sim 20(10) fb for a diphoton invariant mass 80(110)\sim 80(110) GeV, much bigger than the cross section that we expect. With more data and improvements in the background determinations, it might be discoverable at future LHC runs.

7.3 Fermionic Top Partners

The top partners in the SU(6)/Sp(6)SU(6)/Sp(6) CHM are vector-like fermionic resonances which form a sextet of the Sp(6)Sp(6) global symmetry. Their quantum numbers under the SM gauge symmetry are (3,2,1/6)[×2](3,2,1/6)[\times 2], (3,1,2/3)(3,1,2/3), and (3,1,1/3)(3,1,-1/3), which are identical to those of SM quarks. There are no exotic states with higher or lower hypercharges. These states are degenerate in the limit of unbroken Sp(6)Sp(6) global symmetry. (Small splittings arise from the explicit symmetry breaking effects and EWSB.) Their mass MTM_{T} plays the important role of cutting off the quadratic contribution from the top quark loop to the Higgs potential. Naturalness prefers MTM_{T} to be as low as possible allowed by the experimental constraints. The current bound on the top partner mass has reached 1.2\sim 1.2 TeV Sirunyan:2018omb ; Aaboud:2018pii . The HL-LHC can further constrain the mass up to 1.5\sim 1.5 TeV CidVidal:2018eel . The benchmark value of 1.6 TeV is close to but probably still beyond the reach of HL-LHC. A future 100 TeV collider will cover the entire interesting mass range of the top partners if no severe tuning conspires. It may even be able to find the fermionic partners of the other SM quarks, which are expected to be much heavier.

7.4 Heavy Vector Bosons

Unlike the top partners, the partners of SM gauge bosons (spin-1 resonances) are not necessarily light because of the smallness of SU(2)WSU(2)_{W}, U(1)YU(1)_{Y} gauge couplings. In fact, their masses need to be large enough to give a sufficiently large mass to the second Higgs doublet and to cancel in a large part the negative contribution from the top sector to the quadratic Higgs potential. The largest couplings of these composite spin-1 resonances are to the composite states, including the pNGBs. Their mixings with SM gauge bosons are strongly suppressed by their multi-TeV masses, hence their couplings to SM light fermions are also suppressed, resulting in a small production rate as well as small decay branching ratios to SM elementary particles Pappadopulo:2014qza ; Greco:2014aza . The leading decay modes will be through the composite states, such as top partners or pNGBs which include the longitudinal modes of WW and ZZ. The current searches of heavy vector triplets decaying into SM gauge bosons final states have reached a bound about 4 TeV Aad:2020ddw ; Aad:2019fbh ; Sirunyan:2019vgt ; Sirunyan:2019jbg . The bound is relieved for larger gρ>3g_{\rho}>3 with more suppression on the production rate. Besides, the model contains a richer sector of the pNGBs which will dilute the decay branching fractions to SM gauge bosons, further reducing the bound. If the vector resonances are heavier than twice the top partner mass, the decaying into top partners will dominate and it would require different search strategies. As the production rate quickly diminishes for heavier vector resonances, the typically expected masses of the vector resonances as in our benchmark will be out of reach even at the HL-LHC. A future higher energy machine will be needed to discover them.

8 Precision Tests

In this section, we discuss the indirect tests of this model from precision experimental measurements.

8.1 Higgs Coupling Measurements

The Higgs boson couplings to SM fields in the SU(6)/Sp(6)SU(6)/Sp(6) CHM are modified by two effects: the nonlinear effect due to the pNGB nature of the Higgs boson and the misalignment from the mixing of the 2HDM. The deviation of the Higgs coupling to vector bosons is parameterized by

κVghVVghVVSM=sin(βα)cosV12+V222f,\kappa_{V}\equiv\frac{g_{hVV}}{g^{SM}_{hVV}}=\text{sin}(\beta-\alpha)~{}\text{cos}\frac{\sqrt{V_{1}^{2}+V_{2}^{2}}}{\sqrt{2}f}~{}, (97)

where the first factor comes from the misalignment of the 2HDM and the second factor is the nonlinear effect of the pNGB. For the benchmark point in Sec. 5, sin(βα)0.995\sin(\beta-\alpha)\approx 0.995, which gives

κV(0.995)1ξ20.9950.249ξ,\kappa_{V}\approx(0.995)\sqrt{1-\frac{\xi}{2}}\approx 0.995-0.249~{}\xi~{}, (98)

The deviation of the Higgs coupling to fermion is universal in Type-I 2HDMs because it couples to all fermions in the same way. The expression is somewhat more complicated in CHM, and here we only expand to 𝒪(ξ)\mathcal{O}(\xi),

κfghffghffSM=1sβ(cαξ112(3sβ2cα+cβ2cα2sβcβsα))1.0300.252ξ,\kappa_{f}\equiv\frac{g_{hff}}{g^{SM}_{hff}}=\frac{1}{s_{\beta}}\left(c_{\alpha}-\xi~{}\frac{1}{12}(3s_{\beta}^{2}c_{\alpha}+c_{\beta}^{2}c_{\alpha}-2s_{\beta}c_{\beta}s_{\alpha})\right)\approx 1.030-0.252~{}\xi~{}, (99)

where the numerical value of the last expression is obtained for the benchmark point.

Refer to caption
Figure 2: The fit of the Higgs coupling strengths to the gauge bosons (κV\kappa_{V}) and fermions (κf\kappa_{f}) obtained by the ATLAS Aad:2019mbh from the 13 TeV LHC data. The cross is the observed central value. The circles from inside out represent the 68%, 95%, and 99% CL respectively. The red star shows the SM value (1,1)(1,1). The blue star in the predicted value of the 2HDM benchmark of Sec. 5 with ξ=0\xi=0. Along the line, we show the predictions for the same benchmark with different ξ\xi from 0 to 0.3.

The current best-fit values of κV\kappa_{V} and κF\kappa_{F} from ATLAS Aad:2019mbh with an integrated luminosity of 80 fb-1 are

κV=1.06±0.04,\displaystyle\kappa_{V}=1.06\pm 0.04~{}, (100)
κF=1.05±0.09,\displaystyle\kappa_{F}=1.05\pm 0.09~{}, (101)

with a 45% correlation between the two quantities. The central values for both quantities are slightly above the SM value 1, but without significant deviations given the uncertainties. As shown in Fig. 2, within 95% CL level, ξ0.12\xi\leq 0.12 is still allowed (for the benchmark point), which gives a lower bound on the scale ff\sim 700 GeV.

In the future, the uncertainties in κV\kappa_{V} and κF\kappa_{F} can be improved to 1% and 3% respectively at the HL-LHC, deBlas:2019rxi . Assuming the central values of (1,1)(1,1), it can bound ξ\xi down to 0.10.1 at 99% CL. The next generation Higgs factories, such as ILC, CEPC, and FCCee, will have great sensitivities to the hZZhZZ coupling and can measure κV\kappa_{V} with a precision \approx 0.3%. It can test the scale ff up to several TeV and hence cover the entire natural parameter region for the CHMs.

Another decay mode worth mentioning is hγγh\to\gamma\gamma. The branching ratio of this decay mode will receive an additional contribution from charge Higgs bosons. But the current bound from this decay mode is still loose. It will improve at HL-LHC and future Higgs factories. It may provide a sign of the heavy charged Higgs bosons if they exist.

8.2 Flavor Changing Neutral Currents

New physics appearing near the TeV scale may introduce dangerously large flavor changing neutral currents (FCNCs), so the flavor-changing processes put strong constraints on the model constructions. The SU(6)/Sp(6)SU(6)/Sp(6) model contains two light Higgs doublets. If general Yukawa couplings are allowed between them and SM fermions, large FCNCs will be induced. Therefore, it is desirable to impose the natural flavor conservation such that each type of Yukawa couplings only comes from one of the two Higgs doublets. Even so, a light charged Higgs boson can induce a significant contribution to the branching ratio BR(BXsγ)(B\to X_{s}\gamma) Grinstein:1987pu ; Hou:1987kf ; Rizzo:1987km ; Geng:1988bq ; Barger:1989fj ; Grinstein:1990tj . In the Type-II or flipped 2HDM, this gives a lower bound on the charged Higgs boson MH±>600M_{H^{\pm}}>600 GeV Arbey:2017gmh ; Misiak:2017bgg , which would introduce more tuning in the Higgs potential. To have a more natural model, we therefore focus on the construction of the Type-I 2HDM. In a Type-I model, the BXsγB\to X_{s}\gamma constraint rule out the region below tanβ<2\tan\beta<2 Arbey:2017gmh ; Misiak:2017bgg .

The partial compositeness couplings between the elementary fermions and the composite operators can potentially induce FCNCs. In our construction, the largest such couplings (for the top Yukawa and the collective Higgs quartic term) preserve a Peccei-Quinn symmetry with different PQ charges for different generations (see Appendix B). As a result, there is no FCNC induced by these large couplings in the leading order. Some FCNCs may be induced by other (smaller) couplings which are responsible for generating the complete SM fermion masses and mixings, but they are suppressed by the small couplings and depend on the details of their pattern.

8.3 Oblique Parameters

The electroweak oblique corrections provide important tests of new physics near the weak scale. They are usually expressed in terms of SS, TT, and UU parameters Peskin:1990zt ; Peskin:1991sw . The current global fit gives Tanabashi:2018oca

S=0.01±0.10,T=0.03±0.12,U=0.02±0.11.S=-0.01\pm 0.10,\quad T=0.03\pm 0.12,\quad U=0.02\pm 0.11. (102)

For heavy new physics, UU is typically small as it is suppressed by an additional factor Mnew2/mZ2M_{\rm new}^{2}/m_{Z}^{2}. If one fixes U=0U=0, then SS and TT constraints improve to

S=0.0±0.07,T=0.05±0.06,S=0.0\pm 0.07,\quad T=0.05\pm 0.06, (103)

with a strong positive correlation (92%) between them. At 95% CL, one obtains S<0.14S<0.14 and T<0.22T<0.22.

There are several contributions to the oblique parameters in our model, with similarities and differences compared to the MCHM discussed in the literature. First, our model has two Higgs doublets. Their contributions to SS and TT can be found in Ref. Haber:1993wf ; Haber:1999zh ; Froggatt:1991qw . To satisfy the other experimental constraints, the Higgs potential needs to be close to the alignment limit and the heavy states are approximately degenerate. The contributions are expected to be small and do not provide a significant constraint Haller:2018nnx . The other contributions are discussed below.

The SS parameter

The leading contribution to the SS parameter comes from the mixing between the SM gauge bosons and the composite vector resonances. It is estimated to be  Agashe:2003zs ; Agashe:2005dk ; Giudice:2007fh

ΔScS4πv2Mρ2cS0.03(5 TeVMρ)2,\displaystyle\Delta S\sim c_{S}~{}4\pi\frac{v^{2}}{M_{\rho}^{2}}\sim c_{S}~{}0.03\left(\frac{5\text{ TeV}}{M_{\rho}}\right)^{2}, (104)

where cSc_{S} is an 𝒪(1)\mathcal{O}(1) factor. It gives a lower bound of 2.5\sim 2.5 TeV on MρM_{\rho} for cS=1c_{S}=1.

In CHMs, there is a contribution from the nonlinear Higgs dynamics due to the deviations of the Higgs couplings, which result in an incomplete cancellation of the electroweak loops Barbieri:2007bh ; Grojean:2013qca . This contribution is proportional to ξ\xi and depends logarithmically on Mρ/MhM_{\rho}/M_{h}. For Mρ=5M_{\rho}=5 TeV, it gives ΔS0.10ξ\Delta S\sim 0.10~{}\xi which is well within the uncertainty.555A factor of 1/2 is included due to the normalization of ff compared to Ref. Barbieri:2007bh ; Grojean:2013qca . In the MCHM, there is also a contribution due to loops of light fermionic resonances. It is logarithmically divergent and its coefficient depends on the UV physics Grojean:2013qca . This contribution can be significant, depending on the UV-sensitive coefficient. However, in our model, the fermionic resonances are complete multiplets of SU(6)SU(6) and their kinetic terms remain SU(6)SU(6) symmetric, so this divergent contribution is absent.

The TT parameter

The TT parameter parametrizes the amount of custodial SU(2)SU(2) breaking. There are also several potential contributions in our model. First, the pNGB spectrum contains a real SU(2)WSU(2)_{W} triplet ϕ\phi. If it obtains a VEV induced by the trilinear scalar couplings to a pair of Higgs doublets, H1ϕH1H_{1}^{\dagger}\phi H_{1}, H2ϕH2H_{2}^{\dagger}\phi H_{2}, or (H1ϕH2+h.c.H_{1}\phi H_{2}+\text{h.c.}), it will give a tree-level contribution to ΔT\Delta T. Its VEV is bounded to be less than 8\sim 8 GeV, putting strong constraints on these couplings. However, if all the large couplings are real and the CP symmetry is (approximately) preserved, the real scalars ϕ\phi and η\eta are CP odd and the interactions H1ϕH1H_{1}^{\dagger}\phi H_{1}, H2ϕH2H_{2}^{\dagger}\phi H_{2}, and (H1ϕH2+h.c.)H_{1}\phi H_{2}+\text{h.c.}) are forbidden by the CP symmetry. The η\eta and ϕ\phi fields need to couple quadratically to the Higgs fields. This also justifies the Higgs potential analysis based on the 2HDM potential. Of course, CP symmetry has to be broken in order to allow the nonzero phase in the CKM matrix. We assume that this is achieved with the small partial compositeness couplings so that the induced trilinear scalar couplings are kept small enough to satisfy the bound.

Apart from the potential triplet VEV contribution, the leading contribution to ΔT\Delta T comes from fermion loops. For the partial compositeness couplings in this model, the custodial symmetry breaking comes from λR\lambda_{R}.666The custodial symmetry of our model corresponds to the Case B in Ref. Cai:2018tet The dominant contribution comes from the light top partners and the corresponding mixing coupling λtR\lambda_{t_{R}} The deviation is estimated to be Giudice:2007fh 777The partial compositeness couplings are related to the top Yukawa coupling by λtLλtRytgT\lambda_{t_{L}}\lambda_{t_{R}}\sim y_{t}\,g_{T}. For ytsβ0.85y_{t}s_{\beta}\sim 0.85 at 2 TeV and assuming gT2g_{T}~{}\sim 2, we need λtLλtR1.3\sqrt{\lambda_{t_{L}}\lambda_{t_{R}}}\sim 1.3.

ΔTNc16π2αλtR4v2MT20.16(λtR1.3)4(1.6 TeVMT)2.\displaystyle\Delta T\sim\frac{N_{c}}{16\pi^{2}\alpha}\lambda_{t_{R}}^{4}\frac{v^{2}}{M_{T}^{2}}\sim 0.16\left(\frac{\lambda_{t_{R}}}{1.3}\right)^{4}\left(\frac{1.6\text{ TeV}}{M_{T}}\right)^{2}. (105)

There is also a contribution from the modifications of the Higgs couplings to gauge bosons due to the nonlinear effects of the pNGB Higgs. The contribution to ΔT\Delta T from the nonlinear effects again depends on ξ\xi and is logarithmically sensitive to MρM_{\rho}. For Mρ=5M_{\rho}=5 TeV, it gives ΔT0.28ξ\Delta T\sim-0.28~{}\xi Barbieri:2007bh ; Grojean:2013qca . It is significant and can partially cancel the light top partner contribution. The contribution from the mixing of the hypercharge gauge boson and vector resonances is small due to the custodial symmetry. The tree-level contribution vanishes and the loop contribution is negligible. The overall ΔT\Delta T correction is expected to be positive and could help to improve the electroweak precision fit in the presence of a positive ΔS\Delta S.

In summary, among the various sources of the corrections to the electroweak observables, the contributions from the composite resonances are expected to be dominant. They give strong constraints on the masses of heavy resonances MρM_{\rho} and MTM_{T} as well as the relevant coupling like λtR\lambda_{t_{R}}. Nevertheless, for natural parameter values as our benchmark, the corrections on (S,T)(S,T) can still lie safely within the current uncertainty region. A future ZZ factory can greatly improve the precisions of the electroweak observables, which can provide a strong test of the model.

8.4 Zff¯Zf\bar{f} Couplings

The partial compositeness couplings generate mixings between elementary fermions and composite resonances. They can modify the Zff¯Zf\bar{f} couplings in the SM. This is a well-known problem in CHMs for the Zbb¯Zb\bar{b} coupling in implementing the top partial compositeness. A solution based on an extended custodial symmetry SU(2)V×PLRSU(2)_{V}\times P_{LR} on the top sector by embedding the left-handed top-bottom doublet into the (2,2)(2,2) representation of SU(2)L×SU(2)RSU(2)_{L}\times SU(2)_{R} was proposed in Ref. Agashe:2006at . The top sector in our construction does not have this extended custodial symmetry. Furthermore, to obtain the collective quartic Higgs term, we need several large partial compositeness couplings involving other light SM fermions. As a consequence, we may expect significant deviations of the Zff¯Zf\bar{f} couplings for all fermions involved and they present important constraints on this model.

The third generation left-handed quark’s partial compositeness couplings modify the ZbLb¯LZb_{L}\bar{b}_{L} coupling. Its deviation δgbL\delta g_{b_{L}} from the current experimental determination is constrained within 3×1033\times 10^{-3} Batell:2012ca . This deviation comes from mixings between the bottom quark bb and the corresponding composite resonances BB. Under our assignment in Appendix B, there are two terms that will have large positive contributions to δgbL\delta g_{b_{L}}. They are

λtLq¯3,LH1BR(λtLv1)b¯LBR,\displaystyle\lambda_{t_{L}}\bar{q}_{3,L}H_{1}B_{R}\quad\to\quad(\lambda_{t_{L}}v_{1})\bar{b}_{L}B_{R}~{}, (106)
λbLq¯3,LH2~BR(λbLv2)b¯LBR.\displaystyle\lambda_{b_{L}}^{\prime}\bar{q}_{3,L}\tilde{H_{2}}B^{\prime}_{R}\quad\to\quad(\lambda_{b_{L}}^{\prime}v_{2})\bar{b}_{L}B^{\prime}_{R}~{}. (107)

The first one is responsible for generating the top Yukawa coupling and induces the mixing between bLb_{L} and the bottom partner BB with PQ charge 0. The second introduces the bottom Yukawa coupling and the collective quartic term. It induces the mixing with another bottom partner BB^{\prime} with PQ charge 1. The deviations that they bring can be estimated as

δgbLλtL2cβ2M02(TeV)×(30×103),δgbLλbL2sβ2M12(TeV)×(30×103),\displaystyle\delta g_{b_{L}}\approx\frac{\lambda_{t_{L}}^{2}c_{\beta}^{2}}{M_{0}^{2}(\text{TeV})}\times(30\times 10^{-3}),\quad\delta g_{b_{L}}\approx\frac{\lambda_{b_{L}}^{\prime 2}s_{\beta}^{2}}{M_{1}^{2}(\text{TeV})}\times(30\times 10^{-3})~{}, (108)

where M0M_{0} and M1M_{1} are the masses of the fermions resonances BB and BB^{\prime} respectively. Note that M0M_{0} is also the top partner mass which is responsible to cut off the top loop contribution to the quadratic Higgs potential so it should not be too large for naturalness. On the other hand M1M_{1} is the bottom partner mass which can be much larger because of the small bottom Yukawa coupling. These corrections impose strong constraints on the couplings and masses of the composite fermion resonances. For the first term, taking λtL1.3\lambda_{t_{L}}\approx 1.3 and cβ20.1c^{2}_{\beta}\approx 0.1 from the benchmark model, it requires M0=MT1.3M_{0}=M_{T}\gtrsim 1.3 TeV, which is still in the range we expect. Compared to the other models without the SU(2)V×PLRSU(2)_{V}\times P_{LR} custodial symmetry, such as the MCHM4 Agashe:2004rs , we are saved by the cβ2c_{\beta}^{2} factor to allow a relatively light top partner. For the second one, taking λbL1.9\lambda^{\prime}_{b_{L}}\approx 1.9 and sβ1s_{\beta}\approx 1 would require M16M_{1}\gtrsim 6 TeV for the bottom partner. The bound on M1M_{1} can be reduced for a smaller value of λbL\lambda^{\prime}_{b_{L}}, but at the cost of a larger λcL\lambda_{c_{L}} if their combination is responsible for the collective Higgs quartic term, which increases the deviations for δgcL\delta g_{c_{L}} and δgsL\delta g_{s_{L}}.

The collective Higgs quartic term needs at least four large λL,λL\lambda_{L},\lambda^{\prime}_{L} couplings. Each of them will induce two δgL\delta g_{L} deviations from SM Zff¯Zf\bar{f} couplings and all of them reduce the magnitudes from the SM predicted values. Since the ZZ decay width and branching ratios are all well measured at 𝒪(103)\mathcal{O}(10^{-3}) precision, we also need to examine their observable consequences and the corresponding constraints.

It is harder to extract the constraints on individual couplings from the observables that depend on more complicated combinations of different couplings. Therefore we consider the constraints from Γ\Gamma(hadron) and Γ\Gamma(charged lepton) because they are directly proportional to the couplings instead of some ratios. We predict smaller values for both Γ\Gamma(hadron) and Γ\Gamma(charged lepton), but their observed central values are both larger than the SM predictions so the allowed parameter space is strongly restricted. At the 95% CL level, the allowed negative deviations are Tanabashi:2018oca

ΔΓ(had)1.0 MeV ,ΔΓ(+)0.15 MeV .\displaystyle\Delta\Gamma(\text{had})\sim-1.0\text{ MeV ,}\qquad\Delta\Gamma(\ell^{+}\ell^{-})\sim-0.15\text{ MeV .} (109)

From these, we obtain the constraints on allowed negative deviations on the magnitude of different left-handed fermion couplings (assuming only one term dominates) as follow,

|δguL|<0.7×103\displaystyle|\delta g_{u_{L}}|<0.7\times 10^{-3} for up-type quarks, (110a)
|δgdL|<0.6×103\displaystyle|\delta g_{d_{L}}|<0.6\times 10^{-3} for down-type quarks, (110b)
|δgeL|<0.4×103\displaystyle|\delta g_{e_{L}}|<0.4\times 10^{-3} for charged leptons. (110c)
They strongly constrain the parameters of our model. To satisfy these constraints, the corresponding fermion partners need to be over 10 TeV if their couplings to the elementary fermions are large enough to be responsible for the collective Higgs quartic term.

These constraints can be relaxed somewhat if we use the neutrino couplings for the collective Higgs quartic term. The Γ\Gamma(invisible) is smaller than the SM prediction. The allowed negative deviation is 4 MeV at the 95% CL level, which corresponds to

|δgνL|<6×103\displaystyle|\delta g_{\nu_{L}}|<6\times 10^{-3} for neutrinos. (110d)

The resulting constraints on the corresponding fermion resonances are milder.

The precision measurements of the ZZ couplings put strong constraints on our model because we predict a reduction of all ZfLfL¯Zf_{L}\bar{f_{L}} couplings in the construction. A future ZZ factory may improve the coupling measurements by more than one order of magnitude. Consequently, it can either establish a deviation from the SM predictions which points to new physics in the nearby scales, or further affirm the SM predictions which will severely challenge this model or any other models with similar predictions. Nevertheless, we would like to emphasize that these constraints are indirect so it is quite possible that one can extend the model to introduce new contributions to cancel the deviations, at the expense of complexity and/or tuning.

9 Conclusions

Composite Higgs models remain an appealing solution to the hierarchy problem. However, in realistic models, some tuning in the Higgs potential is often required to obtain the correct EWSB and the observed Higgs boson mass. One source is from the mass splittings within the top partner multiplet of the composite resonances, which can generate a large quadratic Higgs potential through the partial compositeness couplings at the order λL(R)2\lambda_{L(R)}^{2}. The other is to obtain the necessary relative size between the quartic term and the quadratic term of the Higgs potential in order to separate the EWSB scale and the compositeness scale. In this paper, we look for models that can address both problems. We show that a CHM based on the coset SU(6)/Sp(6)SU(6)/Sp(6) can achieve the goals without introducing additional elementary fields beyond the SM and the composite sector, which otherwise will introduce a new coincidence problem that why the new elementary fields and the compositeness resonances are at the same mass scale.

A key part of the setup is to couple the elementary SM fermions to the composite operators of the fundamental representation of SU(6)SU(6). The composite resonances do not split after the symmetry is broken to Sp(6)Sp(6) and hence do not induce any large potential from the UV dynamics for the pNGBs. The leading contribution to the Higgs quadratic term is reduced to the unavoidable top quark loop in the IR. In addition, the fundamental representation of SU(6)SU(6) contains two electroweak doublets of the same SM quantum numbers. This allows us to write down different ways of coupling between the elementary fermions and the composite resonances, each of which preserves a subset of the global symmetry. In this way, a quartic Higgs potential can be generated from the collective symmetry breaking of the little Higgs mechanism, without inducing the corresponding quadratic terms. This independent quartic term enables us to naturally separate the EWSB scale and the SU(6)SU(6) global symmetry breaking scale, reducing the tuning of the Higgs potential.

This model contains many more pNGBs than one Higgs double of the minimal model. In particular, there are two Higgs doublets and the second Higgs doublet should not be too heavy for naturalness considerations. The extra Higgs bosons are already subject to collider constraints and are the most likely new particles to be probed in the future LHC runs beside the top partners. The other pNGBs, having smaller couplings to SM particles, are more difficult to find. Together with the heavy vector and fermion resonances, they need higher energy machines with large integrated luminosities. The top partners in this model do not include new particles with exotic charges, e.g., 5/3, as in many other CHMs. The model also predicts deviations of the Higgs couplings and weak gauge boson couplings. The current experimental data already provide substantial constraints on the model parameters in the most natural region. The Higgs coupling measurements will be greatly improved at the HL-LHC and future Higgs factories. A future ZZ factory can also further constrain the electroweak observables. Either the agreements with SM predictions with higher precisions will push the model completely out of the natural scale for the solution to the hierarchy problem, or some deviations will be discovered to point to the possible new physics, and if any of the CHMs can provide an explanation for them.

Acknowledgements.
We thank Felix Kling, Shufang Su, and Wei Su for letting us use the figure in Ref. Kling:2020hmi . We also thank Da Liu, Matthew Low, and Ennio Salvioni for useful discussions. This work is supported by the Department of Energy Grant number DE-SC-0009999.

Appendix A The SU(5)/SO(5)SU(5)/SO(5) Composite Higgs Model

The SU(5)/SO(5)SU(5)/SO(5) is also a possible coset that can naturally avoid large UV contributions to the Higgs potential. It was one of the cosets considered in early composite Higgs models of 1980s Georgi:1984af ; Dugan:1984hq . It was also the coset of the littlest Higgs model ArkaniHamed:2002qy which was one of the pioneer models to realize the mechanism of the collective symmetry breaking for the Higgs quartic coupling. The symmetry breaking can be parametrized by a symmetric tensor field with a VEV

Σ=Σ0=(00𝕀010𝕀00),where 𝕀 is the 2×2 identity matrix.\langle\Sigma\rangle=\Sigma_{0}=\begin{pmatrix}0&0&\mathbb{I}\\ 0&1&0\\ \mathbb{I}&0&0\\ \end{pmatrix},\quad\text{where $\mathbb{I}$ is the $2\times 2$ identity matrix.} (111)

The SM SU(2)WSU(2)_{W} and U(1)YU(1)_{Y} generators are embedded as

12(σa0000000σa),12(𝕀0000000𝕀)+X𝐈,\frac{1}{2}\begin{pmatrix}\sigma^{a}&0&0\\ 0&0&0\\ 0&0&-\sigma^{a\ast}\\ \end{pmatrix},\quad\frac{1}{2}\begin{pmatrix}-\mathbb{I}&0&0\\ 0&0&0\\ 0&0&\mathbb{I}\\ \end{pmatrix}+X\mathbf{I}~{}, (112)

where the extra U(1)XU(1)_{X} charge XX accounts for the correct hypercharges of SM fermions.

There are 14 pNGBs, with a complex doublet (which is identified as the Higgs field HH), a complex triplet ϕ\phi, a real triplet ω\omega, and a real singlet η\eta. The partial compositeness couplings can go through the 𝟓\mathbf{5} and 𝟓¯\mathbf{\bar{5}} representations of SU(5)SU(5). They do not split under SO(5)SO(5) and hence do not give large UV contributions to the Higgs potential, just as in the SU(6)/Sp(6)SU(6)/Sp(6) case. Under the SM SU(2)W×U(1)YSU(2)_{W}\times U(1)_{Y}, they decompose as

𝟓x=𝟐x1/2𝟏x𝟐¯x+1/2,\mathbf{5}_{x}=\mathbf{2}_{x-1/2}\oplus\mathbf{1}_{x}\oplus\mathbf{\bar{2}}_{x+1/2}, (113a)
𝟓¯x=𝟐¯x+1/2𝟏x𝟐x1/2.\mathbf{\bar{5}}_{x}=\mathbf{\bar{2}}_{x+1/2}\oplus\mathbf{1}_{x}\oplus\mathbf{2}_{x-1/2}~{}. (113b)

To mix with elementary fermions, we need to choose x=2/3x=2/3 for the up-type quarks and 1/3-1/3 for the down-type quarks.

The Higgs quartic term arising from the collective symmetry breaking takes the form,

κ1f2|ϕij+i2f(HiHj+HjHi)|2+κ2f2|ϕiji2f(HiHj+HjHi)|2.\kappa_{1}f^{2}\left|\phi_{ij}+\frac{i}{2f}(H_{i}H_{j}+H_{j}H_{i})\right|^{2}+\kappa_{2}f^{2}\left|\phi_{ij}-\frac{i}{2f}(H_{i}H_{j}+H_{j}H_{i})\right|^{2}~{}. (114)

A drawback of this potential is that a nonzero VEV of the SU(2)WSU(2)_{W} triplet ϕ\phi will be induced after EWSB unless κ1=κ2\kappa_{1}=\kappa_{2}. The triplet VEV violates the custodial SU(2)SU(2) symmetry and is subject to the strong constraint of the TT (or ρ\rho) parameter. Even if we ignore that for a moment, it is also more challenging to generate the collective quartic potential (114) in this model. The two doublets in 𝟓\mathbf{5} or 𝟓¯\mathbf{\bar{5}} have different hypercharges if x0x\neq 0 and hence are not equivalent. We cannot couple the elementary SM fermion doublets to both 𝟓\mathbf{5} and 𝟓¯\mathbf{\bar{5}} in a way that preserves an SU(3)SU(3) global symmetry to protect the Higgs mass, so the mechanism introduced for the SU(6)/Sp(6)SU(6)/Sp(6) model in Sec. 4 does not work here. One could add additional exotic vector-like elementary fermions (with hypercharge 7/67/6 or 5/6-5/6) to couple to these composite operators for the purpose of generating the quartic term, but these exotic elementary fermions should have masses comparable to the compositeness scale, which requires some coincidence. Another possibility is to use the lepton partners that have x=0x=0, then the two doublets in 𝟓\mathbf{5}, 𝟓¯\mathbf{\bar{5}} are equivalent representations. One can write down the partial compositeness couplings to generate Eq. (114), analogous to the SU(6)/Sp(6)SU(6)/Sp(6) model. However, the same interactions will induce the Majorana mass terms for the left-handed neutrinos through the triplet ϕ\phi VEV. The couplings need to be 𝒪(1)\mathcal{O}(1) in order to produce a large enough quartic term. It means that unless the triplet VEV is tiny (which requires κ1\kappa_{1} and κ2\kappa_{2} to be equal to a very high accuracy), the induced neutrino masses will be too large. This constraint on the ϕ\phi VEV is even much stronger than that from the custodial SU(2)SU(2) violation.

Appendix B Couplings between SM Fermions and Composite Operators, and Their Peccei-Quinn Charges

Both SM Yukawa couplings and the Higgs quartic potential from collective symmetry breaking arise from the partial compositeness couplings between the elementary fermions and composite operators. The leading interactions (with 𝒪(1)\mathcal{O}(1) coupling strength) should respect an approximate U(1)PQU(1)_{PQ} symmetry to avoid a too large quadratic H~2H1\tilde{H}_{2}^{\dagger}H_{1} term and large FCNCs, so it is convenient to assign the PQ charges to the fermions in classifying the couplings. We will construct a Type-I 2HDM model because of the weaker constraint on the heavy Higgs bosons, and produce both terms needed for the collective quartic Higgs potential.

For the quark sector, we include eight composite operators in 𝟔\mathbf{6} and 𝟔¯\mathbf{\bar{6}} representations of SU(6)SU(6) with overall PQ charges r=0,1,2,3r=0,1,2,3,

𝟔r\displaystyle\mathbf{6}_{r} =𝟐r+1/2\displaystyle=\mathbf{2}_{r+1/2} 𝟏r\displaystyle\oplus\mathbf{1}_{r} 𝟐¯r1/2\displaystyle\oplus\mathbf{\bar{2}}_{r-1/2} 𝟏r\displaystyle\oplus\mathbf{1}_{r} (115a)
𝟔¯r\displaystyle\mathbf{\bar{6}}_{r} =𝟐¯r1/2\displaystyle=\mathbf{\bar{2}}_{r-1/2} 𝟏r\displaystyle\oplus\mathbf{1}_{r} 𝟐r+1/2\displaystyle\oplus\mathbf{2}_{r+1/2} 𝟏r\displaystyle\oplus\mathbf{1}_{r} (115b)

Here the subscript denotes the PQ charge instead of the hypercharge. The 𝟔\mathbf{6} and 𝟔¯\mathbf{\bar{6}} of the same PQ charges create the same resonances which become the quark partners of different flavors. The U(1)PQU(1)_{PQ} charges of the three generations of elementary quarks are shown in Table 1.

U(1)PQU(1)_{PQ} U(1)PQU(1)_{PQ} U(1)PQU(1)_{PQ}
q3,L=(tL,bL)Tq_{3,L}=(t_{L},b_{L})^{T} 1/2 tRt_{R} 0 bRb_{R} 1
q2,L=(cL,sL)Tq_{2,L}=(c_{L},s_{L})^{T} 3/2 cRc_{R} 1 sRs_{R} 2
q1,L=(uL,dL)Tq_{1,L}=(u_{L},d_{L})^{T} 5/2 uRu_{R} 3 dRd_{R} 3
Table 1: PQ charges of elementary quarks. The PQ charge of uRu_{R} appears out of the pattern. As discussed in the text, the up quark Yukawa coupling comes from the U(1)PQU(1)_{PQ} violating coupling, which also generates the required H~2H1\tilde{H}_{2}^{\dagger}H_{1} term.

The lepton sector can be similarly assigned.

There are some requirements for producing a Type-I 2HDM. First, to generate SM Yukawa couplings, we need to couple one of qLq_{L} and qRq_{R} to 𝟔\mathbf{6} and the other to 𝟔¯\mathbf{\bar{6}} of the same PQ charge. In addition, each qLq_{L} needs to couple to the composite operators at least in two ways in order to generate the up-type and down-type Yukawa couplings with the same Higgs doublet. If qLq_{L} had only one coupling to 𝟔\mathbf{6} (or 𝟔¯\mathbf{\bar{6}}), the up- and down-type quarks would couple to different Higgs doublets as we discussed in Sec. 3.4. Once qLq_{L} couplings are fixed, the right-handed quark couplings follow directly from the PQ charges (except for the up quark). To generate the Higgs quartic term by collective symmetry breaking, we need to introduce two pairs of couplings between the elementary doublets and the (𝟔\mathbf{6}, 𝟔¯\mathbf{\bar{6}}) pairs, with each pair of couplings preserving a different SU(4)SU(4) symmetry. Finally, we add a U(1)PQU(1)_{PQ} violating λuL′′\lambda^{\prime\prime}_{u_{L}} which serves to generate the mixed Higgs quadratic term in Eq. (56), and also the up quark Yukawa coupling.

From these requirements, a possible set of couplings between elementary quarks and the composite operators is shown below (in the parentheses after the corresponding composite operators).

𝟔0\displaystyle\mathbf{6}_{0} =𝟐1/2(λtL)\displaystyle=\mathbf{2}_{1/2}~{}(\lambda_{t_{L}}) 𝟏0\displaystyle\oplus\mathbf{1}_{0} 𝟐¯1/2\displaystyle\oplus\mathbf{\bar{2}}_{-1/2} 𝟏0\displaystyle\oplus\mathbf{1}_{0} (116a)
𝟔¯0\displaystyle\mathbf{\bar{6}}_{0} =𝟐¯1/2\displaystyle=\mathbf{\bar{2}}_{-1/2} 𝟏0\displaystyle\oplus\mathbf{1}_{0} 𝟐1/2\displaystyle\oplus\mathbf{2}_{1/2} 𝟏0(λtR)\displaystyle\oplus\mathbf{1}_{0}~{}(\lambda_{t_{R}}) (116b)
𝟔1\displaystyle\mathbf{6}_{1} =𝟐3/2(λcL)\displaystyle=\mathbf{2}_{3/2}~{}(\lambda_{c_{L}}) 𝟏1\displaystyle\oplus\mathbf{1}_{1} 𝟐¯1/2\displaystyle\oplus\mathbf{\bar{2}}_{1/2} 𝟏1(λbR)\displaystyle\oplus\mathbf{1}_{1}~{}(\lambda^{\prime}_{b_{R}}) (116c)
𝟔¯1\displaystyle\mathbf{\bar{6}}_{1} =𝟐¯1/2(λbL)\displaystyle=\mathbf{\bar{2}}_{1/2}~{}(\lambda^{\prime}_{b_{L}}) 𝟏1\displaystyle\oplus\mathbf{1}_{1} 𝟐3/2\displaystyle\oplus\mathbf{2}_{3/2} 𝟏1(λcR)\displaystyle\oplus\mathbf{1}_{1}~{}(\lambda_{c_{R}}) (116d)
𝟔2\displaystyle\mathbf{6}_{2} =𝟐5/2\displaystyle=\mathbf{2}_{5/2} 𝟏2\displaystyle\oplus\mathbf{1}_{2} 𝟐¯3/2(λ~sL)\displaystyle\oplus\mathbf{\bar{2}}_{3/2}~{}(\tilde{\lambda}^{\prime}_{s_{L}}) 𝟏2\displaystyle\oplus\mathbf{1}_{2} (116e)
𝟔¯2\displaystyle\mathbf{\bar{6}}_{2} =𝟐¯3/2\displaystyle=\mathbf{\bar{2}}_{3/2} 𝟏2(λ~sR)\displaystyle\oplus\mathbf{1}_{2}~{}(\tilde{\lambda}^{\prime}_{s_{R}}) 𝟐5/2(λ~uL)\displaystyle\oplus\mathbf{2}_{5/2}~{}(\tilde{\lambda}_{u_{L}}) 𝟏2\displaystyle\oplus\mathbf{1}_{2} (116f)
𝟔3\displaystyle\mathbf{6}_{3} =𝟐7/2(λuL′′)\displaystyle=\mathbf{2}_{7/2}~{}(\lambda^{\prime\prime}_{u_{L}}) 𝟏3\displaystyle\oplus\mathbf{1}_{3} 𝟐¯5/2\displaystyle\oplus\mathbf{\bar{2}}_{5/2} 𝟏3(λdR)\displaystyle\oplus\mathbf{1}_{3}~{}(\lambda^{\prime}_{d_{R}}) (116g)
𝟔¯3\displaystyle\mathbf{\bar{6}}_{3} =𝟐¯5/2(λdL)\displaystyle=\mathbf{\bar{2}}_{5/2}~{}(\lambda^{\prime}_{d_{L}}) 𝟏3\displaystyle\oplus\mathbf{1}_{3} 𝟐7/2\displaystyle\oplus\mathbf{2}_{7/2} 𝟏3(λuR)\displaystyle\oplus\mathbf{1}_{3}~{}(\lambda_{u_{R}}) (116h)

where the subscript of the coupling tells which elementary quark it is coupled to. (The left-handed couplings couple to the whole doublets despite the quark labels.) The SM quark Yukawa couplings are given by

ytλtLλtRgψ0,\displaystyle y_{t}\sim\frac{\lambda_{t_{L}}\lambda_{t_{R}}}{g_{\psi_{0}}}, ybλbLλbRgψ1,\displaystyle y_{b}\sim\frac{\lambda^{\prime}_{b_{L}}\lambda^{\prime}_{b_{R}}}{g_{\psi_{1}}},\quad (117)
ycλcLλcRgψ1,\displaystyle y_{c}\sim\frac{\lambda_{c_{L}}\lambda_{c_{R}}}{g_{\psi_{1}}}, ysλ~sLλ~sRgψ2\displaystyle y_{s}\sim\frac{\tilde{\lambda}^{\prime}_{s_{L}}\tilde{\lambda}^{\prime}_{s_{R}}}{g_{\psi_{2}}}\quad (118)
yuλuL′′λuRgψ3,\displaystyle y_{u}\sim\frac{\lambda^{\prime\prime}_{u_{L}}\lambda_{u_{R}}}{g_{\psi_{3}}}, ydλdLλdRgψ3,\displaystyle y_{d}\sim\frac{\lambda^{\prime}_{d_{L}}\lambda^{\prime}_{d_{R}}}{g_{\psi_{3}}}, (119)

where gψrg_{\psi_{r}} is the coupling of the strong resonances in 𝟔r,𝟔¯r\mathbf{6}_{r},\mathbf{\bar{6}}_{r}, with their masses given by gψrf\sim g_{\psi_{r}}f. To have a relatively light top partner, we should have gψ02g_{\psi_{0}}\sim 2, while all other gψrg_{\psi_{r}}’s are expected to be large. The quark flavor mixings (CKM matrix) can be generated by additional U(1)PQU(1)_{PQ} violating couplings which are not shown. These couplings are expected to be small and will not significantly affect the Higgs potential.

For the Higgs quartic term, the combination of λcL\lambda_{c_{L}} and λbL\lambda^{\prime}_{b_{L}} generates one term of the collective symmetry breaking, while the combination of λ~sL\tilde{\lambda}^{\prime}_{s_{L}} and λ~uL\tilde{\lambda}_{u_{L}} generates the other. Alternatively, we could also use the lepton sector to generate one of the collective symmetry breaking terms. The quartic coupling is estimated to be

λ12=34π2ccbcusλcL2λbL2λ~uL2λ~sL2ccbλcL2λbL2+cusλ~uL2λ~sL234π2λcL2λbL2(if λcLλbLλ~uLλ~sL,ccbcus2).\lambda_{12}=\frac{3}{4\pi^{2}}\frac{c_{cb}c_{us}\lambda_{c_{L}}^{2}\lambda_{b_{L}}^{\prime 2}\tilde{\lambda}_{u_{L}}^{2}\tilde{\lambda}_{s_{L}}^{\prime 2}}{c_{cb}\lambda_{c_{L}}^{2}\lambda_{b_{L}}^{\prime 2}+c_{us}\tilde{\lambda}_{u_{L}}^{2}\tilde{\lambda}_{s_{L}}^{\prime 2}}\sim\frac{3}{4\pi^{2}}\lambda_{c_{L}}^{2}\lambda_{b_{L}}^{\prime 2}\quad(\mbox{if }\lambda_{c_{L}}\lambda_{b_{L}}^{\prime}\sim\tilde{\lambda}_{u_{L}}\tilde{\lambda}_{s_{L}}^{\prime},~{}c_{cb}\sim c_{us}\sim 2). (120)

To get a large enough λ12\lambda_{12}, these couplings should be quite large (1\gtrsim 1). The correct SM Yukawa couplings can still be obtained by suitable choices of λR\lambda_{R} couplings and gψrg_{\psi_{r}}. The λuL′′\lambda_{u_{L}}^{\prime\prime} coupling violates the U(1)PQU(1)_{PQ} symmetry as it mixes the q1,Lq_{1,L} with charge 5/25/2 with the composite doublet of charge 7/27/2. By combining with λdL\lambda_{d_{L}}^{\prime}, it will generate a mixing mass term for the two Higgs doublets,

m12238π2λdLλuL′′gψ32f2.m_{12}^{2}\sim\frac{3}{8\pi^{2}}\lambda_{d_{L}}^{\prime}\lambda_{u_{L}}^{\prime\prime}g_{\psi_{3}}^{2}f^{2}~{}. (121)

In this way, all terms required in the Higgs potential for a realistic model can be generated without introducing additional elementary fermions.

References