definitiontheorem \aliascntresetthedefinition \newaliascntlemmatheorem \aliascntresetthelemma \newaliascntclaimtheorem \aliascntresettheclaim \newaliascntfacttheorem \aliascntresetthefact \newaliascntobservationtheorem \aliascntresettheobservation \newaliascntconjecturetheorem \aliascntresettheconjecture \newaliascntcorollarytheorem \aliascntresetthecorollary \newaliascntremarktheorem \aliascntresettheremark \newaliascntpropositiontheorem \aliascntresettheproposition
99% Revenue with Constant Enhanced Competition
Abstract
The enhanced competition paradigm is an attempt at bridging the gap between simple and optimal auctions. In this line of work, given an auction setting with items and bidders, the goal is to find the smallest such that selling the items to bidders through a simple auction generates (almost) the same revenue as the optimal auction.
Recently, Feldman, Friedler, and Rubinstein [EC, 2018] showed that an arbitrarily large constant fraction of the optimal revenue from selling items to a single bidder can be obtained via simple auctions with a constant number of bidders. However, their techniques break down even for two bidders, and can only show a bound of .
Our main result is that bidders suffice for all values of and . That is, we show that, for all and , an arbitrarily large constant fraction of the optimal revenue from selling items to bidders can be obtained via simple auctions with bidders.††margin: Linda Note! ††margin: Linda Note! Linda Note: Specifically, the simple auction can be any auction that guarantees a constant fraction of the optimal revenue. The total number of bidders needed is optimal up to constant factors.]Notes:1: Linda: Specifically, the simple auction can be any auction that guarantees a constant fraction of the optimal revenue. The total number of bidders needed is optimal up to constant factors.]Notes:1: Specifically, the simple auction can be any auction that guarantees a constant fraction of the optimal revenue. The total number of bidders needed is optimal up to constant factors. Moreover, when the items are regular, we can achieve the same result through auctions that are prior-independent, i.e., they do not depend on the distribution from which the bidders’ valuations are sampled.
1 Introduction
That optimal auctions are not simple and simple auctions are not optimal is the theme of a lot of recent work on designing auctions for multi-item multi-bidder settings. Indeed, it has been well demonstrated that revenue-optimal auctions selling items to additive bidders suffer from several undesirable properties, such as the need for randomization, non-monotonicity, computational intractability, etc. [Thanassoulis04, ManelliV07, Pavlov11, HartN13, DaskalakisDT14, HartR15, DaskalakisDT17], that make them impractical. On the other hand, the state of the art bounds for simple auctions only show that they obtain a small constant fraction of the optimal revenue [ChawlaHK07, ChawlaHMS10, ChawlaMS10, HartN12, LiY13, BabaioffILW14, BateniDHS15, Yao15, RubinsteinW15, ChawlaMS15, ChawlaM16, CaiDW16, CaiZ17, EdenFFTW17a].
The enhanced competition paradigm is an attempt at bridging the gap between simple and optimal auctions. In this paradigm, given an auction setting with items and independent and identically distributed additive bidders, the goal is to find the smallest number of bidders such that simple auctions with bidders (almost) match the revenue of the optimal auction with bidders. If such a result can be shown, then it conveys the message that an auctioneer aspiring to get the optimal revenue with bidders need not spend all his energy on finding the optimal, even if impractical, auction with bidders. Instead, he can try to rope in more bidders and get the same revenue using a simple and practical auction format.
The focus of this paper is to show enhanced competition results for general auction settings where is at most a constant times . The first such result is found in the seminal work of Bulow and Klemperer [BulowK96] where it was shown that the revenue of the optimal auction selling a single item to bidders is at most the revenue of the simple VCG auction with bidders, as long as the distribution of the bidders’ valuation for the item is regular111A (continuous) distribution with probability density function and cumulative density function is regular if the function is monotone non-decreasing..
The only other enhanced competition result with is in [FeldmanFR18] where it is shown that, for any , a -fraction of the revenue of the optimal auction selling items to a single bidder can be obtained by either selling the items separately, or by selling the grand bundle, to a constant number of bidders. However, the techniques used in [FeldmanFR18] do not generalize to bidders and finding enhanced competition results with for bidders remains an open problem222[FeldmanFR18] also show that, for any , when , i.e., when the number of bidders is much larger than the number of items, then, even without “enhancing” competition, i.e., with , the revenue of selling the items separately obtains a -fraction of the revenue of the optimal auction. In other words, these settings are competitive enough for enhanced competition to not yield great gains in the revenue. Thus, the interesting range of parameters is . See [BeyhaghiW19] for a related result..
1.1 Our Results
Our main theorem is the first enhanced competition result with that works for all and .
Theorem 1.1 (Informal).
Consider an auction setting where items are being sold to bidders. Let and . At least one of the following hold:
-
1.
A -fraction of the optimal revenue with bidders is obtained by a VCG auction with bidders.
-
2.
A simple auction (either selling the items separately using Myerson’s optimal auction or a VCG auction with an entry fee) with bidders generates more revenue than the optimal auction with bidders.
Note that aside from Case 1 where the optimal revenue with bidders is nearly matched by the revenue of a VCG auction with bidders, Theorem 1.1 actually promises that simple auctions with bidders outperform the optimal auction with bidders. This is interesting as all known “hard” instances for enhanced competition results involve the equal-revenue distribution333The equal revenue distribution is the distribution defined by for all . for which Case 1 does not hold [EdenFFTW17b, FeldmanFR18]. Thus, we outperform the optimal auction in all of these “hard” cases.
In fact, when Case 1 does not hold, then, at the cost of increasing the total number of bidders by another constant factor, our techniques can also show that a simple auction as in Case 2 with this increased number of bidders obtains much more, say a times more, revenue than the revenue of the optimal auction with bidders. As far as we know, this is the first enhanced competition result that not only outperforms the optimal revenue but actually obtains revenue that is significantly larger. At least this stronger version of Case 2 cannot be shown for general distributions, and some condition like Case 1 not being true is necessary444To see why, consider an item such that the values for this item are sampled from a distribution that is supported on the interval . Even with one bidder, setting a posted price of achieves revenue , while no number of additional bidders can get revenue larger than ..
Moreover, as we discuss in Section 2 below, our proof of Theorem 1.1 is the same for all values of and , avoiding the case analysis in [FeldmanFR18] that uses different techniques to prove a claim similar to Theorem 1.1 in the case and in the case .
Prior-independent auctions.
Finally, we mention that even though Theorem 1.1 matches the optimal revenue with bidders using a simple auction with bidders, the simple auction that it uses in Case 2 is prior-dependent, i.e., the auctioneer needs to know the distribution from which the bidders’ sample their valuations in order to run the auction. Dependence on the prior is necessary555The example to keep in mind is a single-item single-bidder setting where the value of the bidder for the item is sampled from a distribution that, for some , takes the value with probability , and the value with probability . For such a distribution, it is impossible to design an auction with any non-trivial revenue guarantee without the knowledge of . when there is no other promise on the distribution of the bidders’ valuation. However, when these distributions are promised to be regular, there is a long line of work that focuses on developing prior-independent auctions [BulowK96, DevanurHKN11, AzarDMW13, AzarKW14, GoldnerK16, EdenFFTW17b]. We contribute to this line of work by showing the following prior-independent analogue of Theorem 1.1.
Theorem 1.2 (Informal).
Consider an auction setting where regular items are being sold to bidders. Let and ††margin: Linda Note! ††margin: Linda Note! Linda Note: ]Notes:2: Linda: ]Notes:2: . At least one of the following hold:
-
1.
A -fraction of the optimal revenue with bidders is obtained by a VCG auction with bidders.
-
2.
A prior-independent VCG auction with an entry fee and bidders generates ††margin: Linda Note! ††margin: Linda Note! Linda Note: times]Notes:3: Linda: times]Notes:3: times more revenue than the optimal auction with bidders.
Linda Note: Theorem 1.2 immediately implies that there exists a prior-independent auction with bidders which achieves a faction of the optimal revenue: we can simply run VCG auction with probability and run the prior-independent VCG auction with entry fee with probability .]Notes:4: Linda: Theorem 1.2 immediately implies that there exists a prior-independent auction with bidders which achieves a faction of the optimal revenue: we can simply run VCG auction with probability and run the prior-independent VCG auction with entry fee with probability .]Notes:4: Theorem 1.2 immediately implies that there exists a prior-independent auction with bidders which achieves a faction of the optimal revenue: we can simply run VCG auction with probability and run the prior-independent VCG auction with entry fee with probability . We mention that parts of our proof of Theorem 1.2 draw inspiration from [GoldnerK16] and that all properties of Theorem 1.1 mentioned above also apply to Theorem 1.2. We also note that we can even extend the prior-independent mechanisms that we develop to certain settings of irregular distributions. Specifically, it is possible to combine our proof of Theorem 1.2 with ideas from [SivanS13] to get analogous claims for the form of irregular distributions considered there.
1.2 Related Work
Besides the works mentioned above, our work is also related to the following works.
Enhanced competition results with .
The focus of the current paper is getting enhanced competition results with . However, there is a long line of work focusing on getting enhanced competition results with larger . Among the first such works were those of [RoughgardenTY20] and [EdenFFTW17b] which show the bounds and for unit-demand and additive bidders respectively. These works were followed by [FeldmanFR18] and [BeyhaghiW19] which improve these bounds to for additive bidders. We remark that [FeldmanFR18] focuses on getting a -fraction of the optimal revenue with bidders while all the other works outperform the optimal revenue with bidders.
One key difference between the current work and the foregoing works is that all of them focus on upper bounding the optimal revenue with bidders by the revenue of an auction that sells the items separately with bidders, while we also consider VCG auctions with an entry fee. It is known that when restricting attention to auctions that sell the items separately, one cannot get a bound better than [FeldmanFR18, BeyhaghiW19]. Thus, these works cannot hope to get like we do.
The duality framework.
We prove Theorem 1.1 and Theorem 1.2 using the duality framework of [CaiDW16]. In this work, [CaiDW16] view the problem of finding the optimal revenue as a linear program, and analyze it in terms of its Lagrangian dual. The duality framework shown in this work is extremely general, and in particular, is the first one that also applies to multi-bidder settings. In fact, it also applies to settings beyond the additive bidder setting we consider in this paper but we shall not need those ideas.
The [CaiDW16] framework has been used in a lot of subsequent work on getting enhanced competition results in particular and approximately revenue optimal mechanisms in general. Examples include [LiuP18, CaiZ17, EdenFFTW17b, EdenFFTW17a, BrustleCWZ17, DevanurW17, FuLLT18, BeyhaghiW19]. Our duality based proof also uses tools and ideas from [Ronen01, GoldnerK16].
1.3 Our Techniques
We now summarize the most important ideas in this work, focusing solely on Theorem 1.1. A more comprehensive overview can be found immediately below in Section 2.
As mentioned in Subsection 1.2 above, several works have studied how many bidders are necessary for the revenue obtained by selling the items separately to surpass the optimal revenue from selling to bidders. Due to these works, we now know that the answer is , and thus any result that works for (when ) must use auctions other than just selling the items separately.
The only such enhanced competition result in the literature is by [FeldmanFR18] and shows Theorem 1.1 when . The proof proceeds by first bounding the optimal revenue when selling to a single bidder by the core-tail decomposition of [LiY13]. The resulting bound is the sum of the welfare from the bidders with a “low” value for the items (the Core) and the revenue from the bidders with a “high” value for the items (the Tail). The next step is to upper bound the sum of Core and Tail by the revenue of a simple auction with bidders.
The term Tail turns out to be easier to bound than Core, and the reason is that Core corresponds to the welfare of some distribution and bounding it in terms of the revenue of some other distribution is like comparing apples to oranges. We get around this problem by adopting a different approach that tries to bound the welfare term coming from the Core with another welfare term. Specifically, our main lemma, that works for any and any distribution, shows that if Case 1 of Theorem 1.1 does not hold, then, the welfare with bidders can be upper bounded by, say, a fraction of the welfare with bidders.
Unfortunately, even though Core corresponds to the welfare of some distribution and our main lemma applies to welfare of any distribution, it cannot be applied to Core as it assumes that the values of all the bidders are drawn independently and identically from the same distribution, a property that Core does not satisfy in general. This turns out to be a major obstacle and to get around it, we have to start from scratch. This time, instead of starting with the core-tail decomposition of [LiY13], we start with the virtual welfare based upper bound on the revenue from [CaiDW16]. We are able to extend our main lemma to this notion of virtual welfare, and show that unless Case 1 of Theorem 1.1 holds, the virtual welfare with bidders can be upper bounded by a fraction of the virtual welfare with bidders.
To finish the proof, we use techniques from [CaiDW16] to upper bound the virtual welfare with bidders by times the revenue of simple auctions, i.e. either selling the items separately or through a VCG auction with an entry fee, with bidders.
2 Technical Overview
In this section, we cover the main ideas behind the proof of Theorem 1.1 and Theorem 1.2. As the proofs have significant overlap, we focus only on Theorem 1.1 for the most part.
2.1 The [FeldmanFR18] Result
As mentioned above, the work of [FeldmanFR18], showed, amongst other results, that Theorem 1.1 holds in the case , i.e., when there is only one bidder. In this special case, Theorem 1.1 reduces to showing that 99% of the revenue can be obtained by either selling the items separately, or selling the grand bundle, to a (large enough) constant number of bidders. The main tool in this result of [FeldmanFR18] is the core-tail decomposition of [LiY13].
Core-tail decomposition.
The key insight in the core-tail decomposition framework is to set a cutoff for each item and reason separately about the case where the values of the bidders for item are “low”, i.e. at most , and when they are “high”, i.e., more than . We say that an item is in the Core if its value is low, and say that it is in the Tail otherwise. Core-tail decomposition says that, for any choice of the cutoffs , the optimal revenue is at most the optimal welfare from the items in the Core and the optimal revenue from the items in the Tail.
Thus, in order to show that 99% of the revenue is upper bounded by either the revenue obtained by selling separately, or that obtained by selling the grand bundle to a constant number of bidders, it is sufficient to show that, for some choice of the cutoff, the sum total of the welfare from the Core and the revenue from the Tail is also upper bounded by the maximum of selling separately or selling the grand bundle to a constant number of bidders. The specific cutoff in [FeldmanFR18] is involved, and for simplicity in this overview, we shall assume that the cutoff is just a large, say the -th for some small , quantile.
Bounding the revenue from the Tail is the easy part, and uses the observation that the probability that a given item is in the Tail is at most . In fact, one can show that the revenue from the Tail is only a small fraction, say , of the revenue obtained by selling the items separately to a constant number of bidders.
Bounding the Core.
The hard part is to bound the welfare from the Core, and it is here that the assumption is crucially used. When , the welfare is simply the sum of the bidder’s value for all the items in the Core. Being the sum of independent random values that are bounded (below the cutoff), one would expect that the welfare from the Core would be reasonably well concentrated in an interval of size roughly equal to the standard deviation.
It turns out that, with the right choice of the cutoffs, the standard deviation is much smaller than the revenue obtained by selling the items separately to a constant number of bidders. This implies that either the expected welfare of the Core is at most the revenue obtained by selling the items separately to a constant number of bidders, or one can expect (with at least some small constant probability) that the sum of values of a bidder for all the items is very close to the welfare from the Core.
In the latter case, when there are many bidders, it is very likely that there exists a bidder whose total value for all the items is around the welfare from the Core. Thus, an auction that sells the grand bundle around this price will likely generate revenue equal to the welfare from the Core, proving the result.
2.2 Difficulty in Extending to Multiple Bidders
Interestingly, the core-tail decomposition framework used in [FeldmanFR18] extends, with some changes (see Subsection 2.5), to the case. Moreover, the analysis of the Tail can be done in essentially the same way, and the only part of the argument above that does not extend to the case is bounding the Core.
Specifically, what breaks is that the welfare of the Core is no longer the sum over all items of the value the (only) bidder has for the item. Instead, the welfare in the case equals the sum over all items of the maximum value that any bidder has for the item. Thus, even if one can somehow show that it is highly concentrated around some value, say , it is not clear how to design an auction with a constant-factor more bidders whose revenue is at least .
In particular, selling the grand bundle at price does not work, as it is no longer guaranteed that there will be a bidder whose value for the grand bundle will be around . All the concentration of the welfare buys us in this case is that if we take the sum of the maximum value of bidders for all the items, we are likely to get . However, it is not clear how to realize this maximum value as the revenue of a simple auction.
2.3 Our Approach
The difficulty described above is serious, as we are trying to upper bound the welfare by the revenue, when it is known that the former may be arbitrarily larger than the latter in the worst case. What is supposed to save us is that the distribution of the values in the Core is not a general distribution as, for example, its support is upper bounded by the cutoff. Using this upper bound on the support, prior work [Yao15, CaiDW16, amongst others] has shown that the welfare of the Core is at most a constant (actually, ) times the revenue of a (simple) auction. However, getting this constant down all the way to , even with more bidders seems challenging.
Our way around this difficulty is to upper bound the welfare of the Core in two steps: (1) Firstly, we show that if ( of the) Core is larger than revenue obtained by selling separately to a constant-factor larger number of bidders, then the welfare of the Core can be bounded by a small constant (say, ) of the welfare of the Core with a constant-factor larger number of bidders. The hope is that proving such a bound is easier as it requires bounding the welfare term by another welfare term. (2) Next, we invoke the known results about the welfare of the Core being at most times the revenue of simple auctions on the Core with the larger number of bidders to get our result about the Core with the smaller number of bidders.
Overall, this scheme will give us that if ( of the) Core is larger than the revenue obtained by selling separately to a constant-factor larger number of bidders, then the welfare of the Core can be bounded by the revenue of a simple auction with constant-factor larger bidders, as desired.
2.4 Our Proof When
Step 2 of our two-step approach above follows from known results, and in this subsection, we show Step 1. We note that our proof for this part does not even require the welfare to come from the Core and it actually works for any distribution. In fact, it does not even require and works for all , but as we shall explain in Subsection 2.5, it will only fit in our overall framework when .
The main idea, for the one item case, is captured in the following informal lemma. Using linearity of expectation and the fact that the bidders are additive, a similar lemma can also be shown for the multi-item case.
Lemma \thelemma (Informal).
Let . Consider a single item and bidders each of whose value for the item are sampled from a distribution . If times the welfare of the bidders is larger than the revenue generated from a second price auction with bidders, then, the welfare with bidders is at most times the welfare with bidders.
Proof.
Define for convenience, and let for be the value of the bidder for the item. As we assume our bidders to be independent and identically distributed, this is just an independent sample from .
Next, note that as welfare is just the maximum value of the item, we have that the expected welfare with bidders is just the expected value of while the expected welfare with bidders is just the expected value of . Now if the maximizer (we disregard all issues about tie-breaking in this informal lemma and assume that the maximizer is unique) on over all bidders lies in the first bidders, an event (which we denote by ) that happens with probability as the bidders are identically distributed, then the maximum value amongst the first bidders equals that amongst all the bidders. Otherwise, the maximum value amongst the first is at most the second highest value amongst all the bidders. We get that:
Now, using basic conditional probability, we can upper bound the second term by the expected second highest value overall, which is just the revenue of a second price auction with bidders. We get:
As we assume that times the welfare of the bidders is larger than the revenue generated from a second price auction, we get:
To finish, we remove the conditioning on noting that the expected value of the maximum is independent of where the maximizer is. This gives:
as claimed in the lemma. ∎
2.5 The Case
As mentioned above, Subsection 2.4 is very general and works for all distributions and all . However, it does require that: (i) The distribution for different bidders are independent and identical, so that the probability that happens is . (ii) The distribution does not depend on the number of bidders participating in the auction, so that the distribution with bidders is the same as the distribution of the first bidders when there are actually bidders in total.
Both these properties hold for the case, when the distribution of the Core for all the bidders is determined by the same cutoff that is not a function of the total number of bidders in the auction. However, core-tail type arguments for the multiple bidder () case often have a more involved cutoff, that may be different for each bidder, and may also depend on the second highest value (amongst all the bidders) of the item concerned [Yao15, CaiDW16]. As the distribution of the second highest value depends on the number of bidders in the auction, the resulting distribution of the Core does not satisfy either of the two properties above.
Due to these complications in the core-tail framework for the case, we are forced to adopt a different approach that avoids the core-tail decomposition framework altogether! This becomes possible only because our proof of Subsection 2.4 works for all distributions, and not just those that correspond to the core of some other distribution. The goal now is to apply Subsection 2.4 on a carefully chosen notion of ‘virtual welfare’. This notion of virtual welfare must satisfy the following properties in addition to Properties i and ii above: (iii) It must be an upper bound on the optimal revenue, so that upper bounding it using Subsection 2.4 also gives a bound on the optimal revenue. (iv) It must be within a constant factor of the revenue of a (simple) auction so that, after applying Subsection 2.4, we can upper bound the virtual welfare with bidders by the revenue of the simple auction. (v) The virtual values must be at most the corresponding values, so that the expected second highest virtual value is at most the revenue of a second price auction.
Duality based virtual values.
To construct such a virtual value function, we use the duality framework of [CaiDW16]. In fact, the work [CaiDW16] itself defines a virtual value function that satisfies Properties iii, iv, and v above but does not satisfy Properties i and ii. As a result, we cannot use the results shown in [CaiDW16] as a black box, but are able to suitably adapt them for our purposes.
More specifically, we define a new duality-based revenue benchmark that we call the independent utilities, or the IU-benchmark. This (randomized) benchmark is parameterized by an integer 666In the actual proof, we set . and is defined as follows: Consider a bidder and suppose that bidder has value for item . For each such bidder, we sample valuations for “ghost”-bidders and simulate a second price auction with bidder and the ghost bidders. If item gets him the highest (breaking ties lexicographically) non-negative utility in this auction, the virtual value of bidder for item is the Myerson’s (ironed) virtual value corresponding to . Otherwise, it is equal to .
As the ghost bidders are sampled independently and identically for each bidder (and also independently of ), our virtual value function satisfies Properties i and ii. Moreover, as, like [CaiDW16], it is based on the utilities obtained in a second price auction, it is close enough to [CaiDW16] to retain Properties iii, iv, and v, and we can finish our proof of Theorem 1.1.
Proving Theorem 1.2.
We show Theorem 1.2 using the same framework. The only change is that Property iv needs to replaced by a prior-independent version. Namely, we want: (iv*) The virtual welfare must be within a constant factor of the revenue of a (simple) prior independent auction. We show that the IU-virtual welfare defined above also satisfies this property. For this, we take inspiration from [GoldnerK16] and get prior-independence by using the bids of one of the bidders to get some estimate of the prior distribution. Adapting the proof in [GoldnerK16] to IU-virtual welfare is done in Section 4.
2.6 Organization
For readers not familiar with duality or this line of work, we overview all the necessary definitions in Section 3. All our definitions and notations defined in Section 3 are standard, so expert readers can jump to Section 4 without losing continuity. It is in Section 4 and Section 5 that we prove our main result, and specifically, Section 4 is the analogue of Subsection 2.4 for IU-virtual welfare. Finally, Appendix A and Appendix B have the proofs of some standard lemmas that are used in Section 4 and Section 5.
3 Preliminaries
We use to denote the set of real numbers and to denote the set of non-negative real numbers. For a real number , we use to denote . For and , we use to denote the vector obtained by taking the coordinate wise maximum of . That is, for all , the coordinate of , which shall be denote by , is .
3.1 Probability Theory
Let be a finite set and be a probability distribution over . Let denote the probability mass function of , i.e., for all , we have .
Expectation and Variance.
For a function , the expectation of is defined as:
The variance of is:
We omit from the above notations when it is clear from the context.
Independence.
We say two functions are independent of each other if for all , we have
For , we say that functions are (pairwise) independent if and are independent for all .
Standard lemmas.
The following are some standard facts and lemmas that we shall use:
Fact \thefact.
For any function , we have:
-
1.
Bounds on variance:
-
2.
Chebyshev’s inequality: For all , we have
-
3.
Linearity of variance assuming independence: For all and all that are pairwise independent, we have
Lemma \thelemma ([CaiDW16], Lemma 777All theorem numbers from [CaiDW16] are from the arXiv version https://arxiv.org/abs/1812.01577 , etc.).
For all functions , it holds that:
Proof.
The first inequality follows from Subsection 3.1, item 1. For the second, let be all the values of when and let be a negative number arbitrarily close to . We have:
Using the identity , we get:
The lemma follows as was arbitrary. ∎
3.2 Auction Design Theory
The paper deals with Bayesian auction design for multiple items and multiple independent additive bidders. Formally, this setting is defined by a tuple , where denotes the number of bidders, denotes the number of items, and , for , is a distribution with a finite support . We shall assume that, for all , all elements in have non-zero probability under . This is without loss of generality as we can simply remove all elements that have zero probability.
We define , and use and interchangeably. Bidder has a private valuation for each item , that is sampled (independently for all bidders and items) from the distribution . We shall to denote the tuple , to denote the tuple , and to denote the tuple . We sometimes use instead of if we want to emphasize the valuation of bidder .
We reserve to denote the probability mass function corresponding to and to denote the cumulative mass function, i.e., . For all , we use and to denote the probability mass function and the cumulative mass function for the distribution . We omit when . We may also write and if is clear from context.
3.2.1 Definition of an Auction
Let be an auction setting as above. For our purposes, owing to the revelation principle, it is enough to think of an auction as a pair of functions with the following types:
Here, the function represents the ‘allocation function’ of the auction . It takes a tuple of ‘reported valuations’ and outputs for all bidders and items , the probability that bidder gets item when the reported types are . As every item can be allocated at most once, we require for all and (here, denotes the coordinate of ) that:
(1) |
The function denotes the ‘payment function’ of the auction. It takes a tuple of reported valuations and outputs for all bidders , the amount bidder must pay the auctioneer. We shall use to denote the coordinate of .
The functions and .
For a bidder , we define the functions and to be the expectation over the other bidders’ valuations of the functions and respectively. Formally, for , we have:
(2) |
(Bayesian) truthfulness.
Roughly speaking, an auction is said to be truthful if the ‘utility’ of any bidder is maximized (and non-negative) when they report their true valuation. As the utility of bidder is defined simply as the value of player for all items allocated to them minus the payment made by player , we have that an auction is truthful if for all , we have:
(3) |
Throughout this work, we restrict attention to auctions that are truthful.
Revenue.
Equation 3 implies that one should expect the bidders in a truthful auction to report their true valuations. When this happens, we can calculate the revenue generated by the auction as follows:
(4) |
We use to denote the maximum possible revenue of a (truthful) auction in the setting , i.e., .
3.2.2 ‘Simple’ Auctions
The following well-known (truthful) auctions will be referenced throughout the proof.
VCG.
The VCG auction is a truthful auction that runs as follows: First, all bidders report their valuation function to the auctioneer. Then, for all , item is given to the bidder with the highest (ties broken lexicographically) bid for item at a price equal to the second highest bid for item . Formally, we have that for all , , and that:
We define to be the revenue generated by the VCG auction.
Selling Separately.
We say that an auction sells the items separately if it can be seen as separate auctions, one for each item , such that the auction for item depends only on the values the bidders have for item , and the payments of the bidders is just the sum of their payments in each of the auctions. Formally, for all , there exists truthful auctions such that for all , , and :
Note the VCG auction sells the items separately. We define to be the Myerson optimal revenue for selling item to bidders. It follows that is the maximum revenue generated by any auction that sells the items separately
BVCG.
A BVCG auction is defined by a number and888We will have in the proof of Theorem 1.1 and in the proof of Theorem 1.2. and a set of non-negative numbers , for all and . In this auction, the last bidders are treated as special and do not receive any items or pay anything. The first bidders participate in a VCG auction but bidder only gets access to the items allocated to him in the VCG auction if he pays an entry fee that depends on the bids of all the other players in addition to the prices charged by the VCG auction.
Formally, for all and , we have for all that and , and for all , we have:
We define to be the maximum revenue of a BVCG auction with bidders. Also, define to be the maximum revenue of a prior-independent BVCG auction with bidders, i.e, where the values for all and are not a function of the distribution .
3.2.3 Myerson’s Virtual Values
We define the virtual value function following [CaiDW16]. Throughout this subsection, we fix our attention on a single item in an auction setting. The notations , , , will be the same as above. Recall our assumption that for all .
Definition \thedefinition.
The virtual value function is defined to be:
Here, denotes the smallest element in and is well defined for all .
Using the function , one can compute the ironed virtual value function as described in Algorithm 1.
The ironed virtual value function has several nice properties some of which recall below. The lemmas are adapted from [CaiDW16] which also has a more in depth discussion.
Lemma \thelemma.
For all such that , we have .
Proof.
As , Algorithm 1 did not set the value of after setting the value of . Using this and Line 5 of Algorithm 1, we get that it is sufficient to show that the value cannot increase between two consecutive iterations of the While loop. To this end, consider two consecutive iterations and let and be the values of the corresponding variables in the first and the second iteration respectively and note that .
By our choice of in Line 4 in the first iteration, we have that . Extending using Line 3, we get:
It follows that , as desired.
∎
Lemma \thelemma.
For all , we have .
Proof.
Let be the values of the corresponding variables in the iteration when the value of is set. Observe that . If , we simply have:
where the penultimate step uses by Subsubsection 3.2.3. Otherwise, we have . Define to be the smallest such that and observe that . By our choice of in Line 4, we have:
Rearranging, we get:
using by Subsubsection 3.2.3 in the penultimate step. ∎
Myerson [Myerson81] proved that when there is only one item and is continuous, the optimal revenue is equal to the expected (Myerson’s) virtual welfare. [CaiDW16] shows that Myerson’s lemma also applies to that are discrete. For the item setting considered in this paper, we get:
Proposition \theproposition (Myerson’s Lemma [Myerson81, CaiDW16]).
It holds that:
Definition \thedefinition (Regular Distributions).
The distribution is called regular when , or equivalently, when is monotone increasing. Namely, for all such that , we have .
In the seminal paper [BulowK96], Bulow and Klemperer show that the maximum possible revenue from an auction selling one item to any number of bidders whose valuations for the item are sampled from the same regular distribution is at most the revenue of the (simple and prior-independent) VCG auction with bidders. It follows that, when there are multiple items, we have:
Proposition \theproposition (Classic Bulow-Klemperer [BulowK96]).
If is a product of regular distributions, .
4 Proof of Main Result
This section formally states and proves our main results Theorem 1.1 and Theorem 1.2. Using the notation developed in Section 3, we can rewrite Theorem 1.1 as:
Theorem 4.1 (Formal statement of Theorem 1.1 and Theorem 1.2).
Let be an auction setting as in Subsection 3.2. Let and define . If , we have that:
Furthermore, if is a product of regular distributions, the same assumption also implies .
The proof of Theorem 4.1 spans the rest of this section. We fix an auction setting and . To simplify notation, we drop from the arguments but retain when we want to emphasize the number of bidders. Our proof has three main steps: First, we use the duality framework of [CaiDW16] to get a suitable upper bound on . As explained in Subsection 2.5, the “standard” duality framework seems to be insufficient for our needs, and out first step is to show a new duality benchmark, called the independent utilities, or the -benchmark.
To define our benchmark, we first define the -virtual value of bidder . Let be the valuation (or the type) of bidder and let be the valuations of “ghost” bidders. We first partition the set of all possible valuations for bidder into regions based on . Namely, we define a region for each item and also a region of all elements of that are not in any of the . For , we say that if:
(5) |
Having defined these regions for each , we next consider the probability, for all , that the valuation where the probability is over choice of the types of the ghost bidders. Formally,
(6) |
Next, for , define the -virtual value of bidder for item as:
(7) |
We drop the superscript from all the above notations when it is clear from context. We now define the -benchmark as:
(8) |
The first step in our proof is to show that the -benchmark indeed upper bounds .
Lemma \thelemma.
It holds that:
The next step of the proof is to show that, under the assumption of the theorem, our -benchmark increases (significantly) as the number of bidders increases. We have:
Lemma \thelemma.
Assume that . We have:
We mention that the choice of the constant in Section 4 is arbitrary and it can be replaced by any other value as long as the value of is changed accordingly. In fact, it can even be function of . As the last step of the proof, we show the following upper bounds on .
Lemma \thelemma.
For all , we have:
Lemma \thelemma.
If is a product of regular distributions, then, for all , we have:
Once we have these lemmas, Theorem 4.1 is almost direct. We include the two-line proof below.
Proof of Theorem 4.1.
4.1 Proof of Section 4
Proof.
Let be the auction that maximizes revenue amongst all (Bayesian) truthful auctions, and let be as defined Subsection 3.2. By definition, we have that .
As the partition of defined by is “upwards closed”999A partition is said to be upwards closed if for all , , and all , if , then (Here, means the standard basis of ). for all , we have from Corollary of [CaiDW16] that101010To make this paper self-contained, we recall their proof of Corollary as Appendix B in Appendix B., for all :
Therefore, by a weighted sum of the above equation over ,
(Equation 6) | ||||
(Equation 7) |
Recall that the function is just the expected value (over the randomness in ) of . Using this and the fact that (from Equation 1), we have that:
(As and ) | ||||
(Equation 8) |
∎
4.2 Proof of Section 4
We start by showing a technical lemma saying that if is a distribution over a finite set and is a -length vector of independent samples from , the maximum value is independent of the maximizer (with the “correct” tie-braking rule). The tie breaking rule we use is the randomized tie breaking rule satisfying, for all , that:
(9) |
It holds that:
Lemma \thelemma.
Let , be a finite set, and be a distribution over . For all and , we have that
Proof.
We omit the subscript to keep the notation concise. Observe that we have by symmetry and also that:
This means that it is sufficient to show that:
We show this by considering all possible values of . We have:
(Equation 9) |
We can calculate the term on the right:
The Binomial theorem then gives:
∎
We now prove Section 4.
Proof of Section 4.
Recall from the definition of in Equation 8 that . As we can always sample values for more bidders and not use them, we also have:
For , we use to denote the vector . Over the random space defined by the distribution , define the event . We get:
(As ) |
Next, note that the maximum over the first coordinates is at most the maximum over all the coordinates. Moreover, conditioned on , it is at most the second highest value over all the coordinates. Using denote the second largest value in a set, we get that:
From Subsubsection 3.2.3, we have , we also have for any . This means that the second highest value of is at most the second highest value of . We get:
To continue, note that all the second highest value of is non-negative. We get:
By definition, the second term is simply . We remove the conditioning from the first term using Subsection 4.2. We get:
From Equation 8, we conclude:
Under the assumption in Section 4, we have that . From Section 4, we have . Plugging in, we get:
Rearranging gives the lemma.
∎
5 Proofs of Section 4 and Section 4
We show Section 4 and Section 4 following the framework of [CaiDW16]. The first step is common to both the lemmas and shows that is at most plus an additional term corresponding to the term Core in [CaiDW16]. This is captured in Subsection 5.1. The next step bounds Core in two different ways to show the two lemmas. These can be found in Subsubsection 5.2.1 and Subsubsection 5.2.2.
5.1 Step – Decomposing
Lemma \thelemma.
For all , we have:
where we define Core as:
Proof.
Fix . We first get rid of the parameter by showing that is the hardest case for the lemma. We have:
Henceforth, we focus on upper bounding . Note that the term in corresponds to the event that . By our choice of the regions , whenever this happens, either is less than or there is a such that the utility from is at least as much as that from . To capture these cases we define the sets111111For readers familiar with [CaiDW16], our naming of these events corresponds to that used in [CaiDW16], e.g., NF corresponds to Non-Favorite.:
(10) |
As mentioned before, when , we either have or . Thus, we have the following inequality.
(11) |
Using Equation 11, we decompose as follows:
(Single) | ||||
(Under) | ||||
(Non-Favorite) |
We have now split into three terms, Single, Under, and Non-Favorite. We will later show that both Single and Under are at most . As far as the term Non-Favorite goes, we need to decompose it further. We have:
Non-Favorite | |||
Plugging into the previous decomposition and using the fact that and are disjoint by Equation 10, we get that:
(Over) | ||||
(Surplus) |
It can now be shown that Over is at most . However, Surplus needs to be decomposed even more before it is analyzable. For this, we first use linearity of expectation to take the expectation over inside. As the summand corresponding to only depends on , we get:
Writing the expectation is a sum and noting that only happens when and by Equation 10, we get that:
To continue, we define, for all , the function . This definition is identical to that in Appendix A and is closely connected to the payment of the highest bidder in Ronen’s auction for item when the second highest bid is [Ronen01]. We also define, for all , the quantity and, for all , the quantity . Using to denote the tuple , we continue decomposing Surplus as:
Surplus | (Tail) | |||
(Core) |
We call the first term above Tail and the second term as Core. We shall show that Tail is at most while Core can be bounded as a function of and . First, we state our final decomposition for :
(12) |
To finish the proof of Subsection 5.1, we now show that each of the first four terms above is bounded by .
Bounding Single.
If the term Single did not have the factor inside, it will just be maximum (over all auctions) value of (Myerson’s) ironed virtual welfare, and we could use Subsubsection 3.2.3 to finish the proof. As adding the factor can only decrease the value of Single, we derive:
Bounding Under.
Roughly speaking, the term contributes to Under only if it is not the highest amongst bids. As the fact that is not the highest amongst bids implies that it is also not the highest amongst bids, we get:
Under | (Equation 10) | |||
Now, consider each term inside the max as the bids of bidders. In this interpretation (as formalized in Appendix A), the term inside the max is at most the revenue generated by a VCG auction where the reserve for item is . Using Appendix A, we get:
Bounding Over.
We first manipulate Over so that can be moved outside the max. Using Equation 10, we have:
Over | |||
We now analyze the term corresponding to each separately. For each , consider a sequential posted price auction that sells each item separately. When selling item , the auction visits the bidders in non-increasing order of and offers them the item at price . The revenue generated by this auction is at least term corresponding to above. Appendix A formalizes this and gives:
Bounding Tail.
At a high level, the term Tail is large only when bidder gets high utility from item but there exists an item that gives even higher utility. This should be unlikely. More formally, by Equation 10 and a union bound, we have:
As Tail only sums over , the definition of allows us to further bound this by:
(12) |
Plugging Equation 12 into the term Tail, we have:
(13) |
Now, we claim that . In the case , this holds trivially. Otherwise, there exists be the smallest such that and we get:
We continue Equation 13 as:
The last expression is closely related to the revenue of a Ronen’s auction [Ronen01] that sells the items separately, and is captured in Appendix A. Using Appendix A, we conclude:
This concludes the proof of Subsection 5.1. ∎
5.2 Step – Bounding Core
The next (and final) step in the proof of Section 4 and Section 4 is to upper bound the term Core that was left unanalyzed in Subsection 5.1. To this end, we first recall some definitions made in Subsection 5.1. Recall that, for all , roughly (but not exactly) corresponds to the payment of the highest bidder in a Ronen’s auction when the second highest bid is . We also defined, for all and for all , . The term Core equals:
Observe that the term in the above equation is closely related to the utility that bidder with valuation gets from item in a VCG auction when the bids of the other bidders are . To capture this, we define the notation:
These will primarily be used in the following form:
(14) |
Using this notation, Core satsifies:
(15) |
Observe that, written this way, Core is closely related to the random variable . It is in this form that we upper bound Core in Subsubsection 5.2.1 and Subsubsection 5.2.2. But first, let us show using Subsection 3.1 that the variance of is small.
Lemma \thelemma.
It holds for all and all that:
Proof.
Recall that is such that all the items are independent. Using the fact that variance is linear when over independent random variables (Subsection 3.1, item 3) and Equation 14, we get:
(16) |
Our goal now is to bound each term using Subsection 3.1. To this end, note that is always at most and thus, we can conclude that . Moreover, we have for all that
Now, if , then, the right hand side is and consequently, is at most . We show that the latter holds even when . Indeed, we have:
(Definition of ) |
Thus, we can conclude that:
Plugging this and into Subsection 3.1, we get:
Plugging into Equation 16, we get:
∎
5.2.1 Bounding Core for Section 4
In this section, we finish our proof of Section 4 by upper bounding the right hand side of Equation 15 by the revenue of a BVCG auction (and ). Specifically, we shall consider a BVCG auction with bidders, where the fee charged for player , when the types of the other bidders are is:
The following lemma shows that most bidders will agree to pay this extra fee, and thus, expectation of the total fee is at most .
Lemma \thelemma.
It holds that:
Proof.
Consider the BVCG auction defined by . That is, consider the auction where the auctioneer first asks all bidders for their bids and runs a VCG auction based on these bids. If bidder is not allocated any items in the VCG auction, he departs without paying anything. Otherwise, he gets all the items allocated to him in the VCG auction if and only if he agrees to pay an amount equal to in addition to the prices charged by the VCG auction.
This auction is truthful as we ensure that . Moreover, if bidder does not pay at least , we must have that his utility from the VCG auction is (strictly) smaller that . Thus, we get the following lower bound on .
where the last step is because upper bounds . The next step is to lower bound the probability on the right hand side. We do this using Chebyshev’s inequality (Subsection 3.1, item 2) and use the variance bound in Subsection 5.2. We have:
Plugging in, we have:
and the lemma follows. ∎
We now present our proof of Section 4.
Proof of Section 4.
From Equation 15 and the definition of , we have:
Core | |||
These two terms can be bounded by Subsubsection 5.2.1 and Appendix A respectively yielding . Plugging into Subsection 5.1, we get:
∎
5.2.2 Bounding Core for Section 4
Now, we finish our proof of Section 4 by upper bounding the right hand side of Equation 15 by the revenue of a prior-independent BVCG auction. The auction defined in Subsubsection 5.2.1 was not prior independent as to compute the fees charged to the bidders required knowledge of the distribution . Our main idea follows [GoldnerK16], we construct an auction with bidders, and treat the last bidder as ‘special’. This special bidder does not receive any items or pay anything, but his bids allow us to get a good enough estimate of the distribution .
We shall reserve to denote the bid of the special bidder and will denote the bids of the other bidders. For , the notation will (as before) denote the bid of player , while will denote the bids of all the other players excluding the special player. This time the fee for player is defined as (recall Equation 14):
(17) |
Importantly, this is determined by the bids of the bidders and is independent of . We also define, for all and , the set as follows:
(18) |
We now show a prior-independent analogue of Subsubsection 5.2.1.
Lemma \thelemma.
It holds that:
Proof.
We follow the proof approach in Subsubsection 5.2.1 but this time use the fees defined in Equation 17 as they are prior-independent. More specifically, we consider the auction that first receives the bids and of the non-special and special players respectively and runs a VCG auction based on . Thus, the special bidder never receives or pays anything. If bidder is not allocated any items in the VCG auction, he departs without paying anything. Otherwise, he gets all the items allocated to him in the VCG auction if and only if he agrees to pay an amount equal to in addition to the prices charged by the VCG auction.
This auction is truthful as we ensure that . Moreover, if bidder does not pay at least the amount , we must have that his utility from the VCG auction is (strictly) smaller than . From Equation 17, we get the following lower bound on the revenue of this auction:
As upper bounds and we only consider , we have . Plugging in, we have:
By symmetry, we conclude that:
∎
We now present our proof of Section 4.
Proof of Section 4.
Call a pair “high” if
(19) |
and call it “low” otherwise. Using Chebyshev’s inequality (Subsection 3.1, item 2) and the variance bound in Subsection 5.2, we have for all high that:
Thus, if the pair is high, we get that is at least . We now bound Core from Equation 15 and finish the proof. We have:
Core | |||
where, for high , we plug in , while for low , we use Equation 19. This gives:
Using Subsubsection 5.2.2 and using the definition of , we get:
Using Appendix A on the second term, we have . Plugging into Subsection 5.1, we get . As we assumed that all the items are regular, we have from Subsubsection 3.2.3 that . This yields:
∎
Appendix A Some Lower Bounds on
In this section, we analyze the revenue of some auctions that sell the items separately. By definition, the revenue of any such auction is a lower bound for . All lemmas in this section are for a fixed auction setting (see Section 3).
Lemma \thelemma (VCG with reserves).
Fix item . For all , it holds that:
Proof.
Consider the auction that sells item through a VCG auction with reserve . Namely, it solicits bits for item for each bidder and proceeds as follows: If the highest bid is at least , then allocate this item to the highest bidder for a price equal to the maximum of and the second highest bid. Otherwise, the item stays unallocated. Clearly, the auction is truthful and generates revenue at least:
Thus, we can upper bound the above quantity by and the lemma follows. ∎
Lemma \thelemma (Sequential Posted Price).
Let non-negative numbers be given. It holds that:
Proof.
Consider the auction that sells each item separately through the following auction: It goes over all the bidders in decreasing order of , bidder can either take the item and pay price , in which case the auction terminates, or skip the item, in which case the auction goes to the next bidder. Clearly, the auction is truthful and generates revenue at least:
Thus, we can upper bound the above quantity by and the lemma follows. ∎
Lemma \thelemma (Ronen’s auction [Ronen01]).
For all and , define . It holds that:
Proof.
Consider the auction that sells each item separately through the following auction: First, it solicits bids for item from each bidder . Then, for , it sets to be121212We write as a function of but note that it only depends on the bidders’ bids for item . the maximizer in the definition of , and offers each bidder to purchase item at a price of . As by definition, at most one bidder will ever purchase the item and the auction is well defined (Equation 1).
Also, as the price offered to bidder does not depend on his bid, the auction is also truthful. Thus, its revenue is a lower bound on and we get:
∎
Appendix B Proof of Corollary 27 of [CaiDW16]
This section recalls the proof of Corollary from [CaiDW16] as Appendix B. Our presentation is different from [CaiDW16] as we do not need their ideas in full generality.
Lemma \thelemma.
Let be an auction setting as in Subsection 3.2. Let and suppose that for all , valuations are given. For all that correspond to a truthful auction , we have that:
Proof.
We start with some notation. We use to denote a dummy valuation for the bidders and adopt the convention for all , . Suppose that non-negative numbers are given that satisfy for all and that:
(20) |
As correspond to a truthful auction , we have from Equation 4 that . Continuing using the non-negativity of and Equation 3, we have:
This can be rearranged to:
Plugging in Equation 20, we get:
Rearranging again, and denoting by , we get:
(21) |
Observe that Equation 21 holds for any that is non-negative and satisfies Equation 20. In order to show Appendix B, we construct a suitable and apply Equation 21. This is done by defining and as below and setting .
Defining .
We start with some notation. For , let denote the probability mass function of the distribution . Also, for and , let be defined to be if . Otherwise define for all and . Recall the definition of the regions from Equation 5 and for all , define the numbers:
Defining .
For all , we define using the procedure described in Algorithm 2. In Line 6 of Algorithm 2, when we say we invoke Algorithm 1 restricted to values at least , we mean that Line 4 of Algorithm 1 would only include values that are at least in the and Line 6 of Algorithm 1 will abort as soon as (instead of when ). Algorithm 1 guarantees that the output produced in this manner is a lower bound of , and therefore, also a lower bound of , for all values at least . Moreover it satisfies, for all and with equality when , that:
(22) |
We now finish the proof of Appendix B. Having defined and , we first observe that they are both non-negative ( is non-negative due to Equation 22). Moreover, observe that setting satisfies Equation 20. Plugging into Equation 21, we get:
Where, using Equation 22 and Subsubsection 3.2.3, the value can be simplified to:
Plugging in and using the fact that , we get:
∎