vEnhance's avatar

Mar 14, 2016

🖉 Mechanism Design and Revenue Equivalence

Happy Pi Day! I have an economics midterm on Wednesday, so here is my attempt at studying.

1. Mechanisms

The idea is as follows.

  • We have NN people and a seller who wants to auction off a power drill.
  • The ii-th person has a private value of at most $1000\$1000 on the power drill. We denote it by xi[0,1000]x_i \in [0,1000].
  • However, everyone knows the xix_i are distributed according to some measure μi\mu_i supported on [0,1000][0, 1000]. (Let’s say a Radon measure, but I don’t especially care). Tacitly we assume μi([0,1000])=1\mu_i([0,1000]) = 1.

Definition 1. Consider a game MM played as follows:

  • Each player i=1,,Ni=1, \dots, N makes a bid bib_i (which depends on how much they value the object)
  • Based on all the bids b=(b1,,bN)\vec b = \left( b_1, \dots, b_N \right), each player has a chance Qi(b)[0,1]Q_i(\vec b) \in [0,1] of actually obtaining the object. We call Q={Qi}i=1NQ = \{Q_i\}_{i=1}^N the allocation function and require iQi(b)1\sum_i Q_i(\vec b) \le 1.
  • Based on all the bids b=(b1,,bN)\vec b = \left( b_1, \dots, b_N \right), each player makes a payment Pi(b)R0P_i(\vec b) \in \mathbb R_{\ge 0}. We call the P={Pi}i=1nP = \{P_i\}_{i=1}^n the payment function. Note that one might have to pay even if they don’t get the drill!
  • The utility of the ii-th player is Ui(b)=Qi(b)xiPi(b)U_i(\vec b) = Q_i(\vec b) \cdot x_i - P_i(\vec b) i.e. the expected chance they get the power drill minus the amount which they pay.

We call the pair (P,Q,μ)(P,Q,\mu) a mechanism.

For experts: we require that each PiP_i and QiQ_i is measurable. Right now this is not a very good definition, because there are no assumptions on what PP and QQ look like. Nonetheless, we’ll give some examples.

2. Examples of mechanisms

In the auction that you’d see in real life, we usually set Q=Qhighesthighest bidder winsQ = Q_{\text{highest}} \coloneqq \text{highest bidder wins} which is the simple rule that the highest bidder gets the power drill with probability 11; if there is a tie, we pick one of the highest bidders at random.

In all the examples that follow, for simplicity let’s take the case N=2N=2, and call the two players Anna and Elsa. We assume that both Anna and Elsa the value they place on the drill is uniform between [0,1000][0,1000]. Finally, we give the auctioneer a name, say Hans.

2.1. First-price auction

The first-price auction is the one you’ve probably heard of: each player makes a bid and

  • Q=QhighestQ = Q_{\text{highest}}, and
  • PP is defined by requiring the winner to pay their bid.

How do Anna and Elsa behave in this auction? Clearly no one will bid more than they think the drill is worth, because then they stand to lose utility if they happen to win the auction. But the truth is they actually will bid less than they think the drill is worth.

For concreteness, suppose Anna values the drill at $700\$700. It doesn’t make sense for Anna to bid more than $700\$700 obviously. But perhaps she should bid $699\$699 — save a dollar. After all, what’s the chance that Elsa would bid right between $700\$700 and $699\$699? For that matter, Anna knows that Elsa has a 50%50\% chance of valuing the drill at less than $500\$500. So if Anna bids $500\$500, she has at least a 50%50\% of saving at least $200\$200; it makes no sense for her to bid her true $700\$700 value.

It gets better. Anna knows that Elsa isn’t stupid, and isn’t going to bid $500\$500 even if her true value is $500\$500. That is, Elsa is going to try and sell Hans short as well. Given this Anna can play the game of cheating Hans more aggressively, and so an ad infinitum.

Of course there’s a way to capture this idea of “I know that you know that I know that you know…”: we just compute the Nash equilibrium.

Proposition 2 (Nash eqilibirum of the first-price auction for N=2N=2)

Consider a first-price auction where Anna and Elsa have values uniformly distributed in [0,1000][0, 1000]. Suppose both Anna and Elsa bid x/2x/2 if they have value xx. Then this is a Nash equilibrium.

Proof: Suppose Anna values the drill at aa and wants to make a bid xx. Elsa values the drill at ee, and follows the equilibrium by bidding e/2e/2. For a bid of xx, Anna gets utility {axx>e/20otherwise.\begin{cases} a-x & x>e/2 \\ 0 & \text{otherwise} \end{cases}. The probability of winning with xx is thus min(1,2x/1000)\min(1, 2x/1000) (this the probability that e<2xe < 2x) so the expected utility is (ax)min(1,2x1000)21000x(ax).(a-x)\min\left( 1, \frac{2x}{1000} \right) \le \frac{2}{1000} x(a-x). Hence we see x=a/2x = a/2 maximizes Anna’s expected utility. \Box

The first-price auction is interesting because both players “lie” when bidding in the Nash equilibrium. For this reason we say that the first-price auction is not incentive compatible.

Just for interest, let’s compute how much money Hans is going to make off the drill in this equilibrium. The amount paid to him is equal to Ea,e(max(a/2,e/2))=10003.\mathbf E_{a,e} \left( \max(a/2, e/2) \right) = \frac{1000}{3}. To see this we had to use the fact that if two numbers in [0,1][0,1] are chosen at random, the expected value of the larger is 23\frac23. Multiplying by 1000/2=5001000/2 = 500 gives the answer: Hans expects to make $333\$333.

2.2. Second-price auction

The second-price auction is the other one you’ve probably heard of: each player makes a bid and

  • Q=QhighestQ = Q_{\text{highest}}, and
  • PP is defined by requiring the winner to pay the smallest amount needed to win, i.e. the second highest bid.

The fundamental difference is that in a second-price auction, a player “doesn’t need to be shy”: if they place a large bid, they don’t have to worry about possibly paying it.

Another way to think about is as a first-price auction with the property that the winning player can retroactively change their bid, provided they still win the auction. So unlike before there is no advantage to being honest.

Indeed, the second-price auction is incentive compatible in a very strong sense: bidding your true value is the best thing to do regardless of whether your opponents are playing optimally.

Proposition 3 (Second-price auctions are incentive compatible)

In a second-price auction, bidding truthfully is a weakly dominant strategy.

Proof: Easy. Check it. \Box

Just for interest, let’s compute how much money Hans is going to make off the drill in this equilibrium. This time he amount paid to him is equal to Ea,e(min(a,e))=10003.\mathbf E_{a,e} \left( \min(a, e) \right) = \frac{1000}{3}. Here we had to use the fact that if two numbers in [0,1][0,1] are chosen at random, the expected value of the smaller is 13\frac13. This might come as a surprise: the expected revenue is $333\$333 in this auction too.

2.3. All-pay auction

The all-pay auction is like lobbying. Each player makes a bid, and

  • Q=QhighestQ = Q_{\text{highest}}, and
  • PP is defined by requiring everyone to pay their bid, regardless of whether they win the power drill or not.

This is clearly not incentive compatible. In fact, the Nash equilibrium is as follows:

Proposition 4 (Nash equilibirum of the all-pay auction)

Consider a first-price auction where Anna and Elsa have values uniformly distributed in [0,1000][0, 1000]. Suppose both Anna and Elsa bid 121000(x/1000)2\frac{1}{2} \cdot 1000(x/1000)^2 if they have value xx. Then this is a Nash equilibrium.

Proof: Omitted, but a fun and not-hard exercise if you like integrals. It will follow from a later result. \Box

Just for interest, let’s compute how much money Hans is going to make off the drill in this equilibrium. This time he amount paid to him is equal to

Ea,e(a22000+b22000)=01000x21000dx=10003. \mathbf E_{a,e} \left( \frac{a^2}{2000} + \frac{b^2}{2000} \right) = \int_{0}^{1000} \frac{x^2}{1000} dx = \frac{1000}{3}.

Surprise — same value again! This is a very special case of the Revenue Equivalence Theorem later.

2.4. Extortion

We’ve seen three examples that all magically gave $333\$333 as the expected gain. So here’s a silly counterexample to show that not every auction is going to give $333\$333 as an expected gain. It blatantly abuses the fact that we’ve placed almost no assumptions on PP and QQ:

  • Q=QhighestQ = Q_{\text{highest}}, or any other QQ for that matter, and
  • PP is defined by requiring both Anna and Elsa to give $1000000\$1000000 to Hans.

This isn’t very much an auction at all: more like Hans just extracting money from Anna and Elsa. Hans is very happy with this arrangement, Anna and Elsa not so much. So we want an assumption on our auctions to prevent this silly example:

Definition 5. A mechanism (M,σ)(M, \sigma) is voluntary (or individually rational) if ui(xi)0u_i(x_i) \ge 0 for every xi[0,1000]x_i \in [0,1000].

2.5. Second-price auction with reserve

Here is a less stupid example of how Hans can make more money. The second-price auction with reserve is the same as the second-price auction, except Hans himself also places a bid of R=500R = 500. Thus if no one bids more than RR, the item is not sold.

For the same reason as in the usual second-price auction, bidding truthfully is optimal for each players. The cases are:

  • If both Anna and Elsa bid less than $500\$500, no one gains anything.
  • If both Anna and Elsa bids more than $500\$500, the higher bidder wins and pays the lower bid.
  • If exactly one player bids more than $500\$500, that player wins and pays the bid for $500\$500.

So Hans suffers some loss in the first case, but earns some extra money in the last case (when compared to the traditional second-price auction.) It turns out that if you do the computation, then Hans gets an expected profit of 12503$417\frac{1250}{3} \approx \$417 meaning he earns another $80\$80 or so by setting a reserve price.

3. Direct mechanisms

As it stands, bib_i might depend in complicated ways on the actual values xix_i: for example in the first-price auction. We can capture this formalism as follows.

Definition 6. A direct mechanism is a pair M=(M,σ)M = (M, \sigma) where

  • (P,Q,μ)(P,Q, \mu) is a mechanism,
  • σ={σi}i=1N\sigma = \{\sigma_i\}_{i=1}^N is a Nash equilibrium of bidding strategies for the bidders. So in this equilibrium the ii-th player will bid σi(xi)\sigma_i(x_i).

If σ=id\sigma = \mathrm{id}, meaning σi(x)x\sigma_i(x) \equiv x for every ii, then we say MM is incentive compatible.

So in other words, I’m equipping the mechanism MM with a particular Nash equilibrium σ\sigma. This is not standard, but I think it is harder to state the theorems in a non-confusing form otherwise.

Definition 7. Let M=(M,σ)M = (M, \sigma) be a direct mechanism. Then we define pi(x)p_i(x), qi(x)q_i(x), ui(x)u_i(x) by ui(x)=E[Ui(b)xi=x and everyone follows σ]u_i(x) = \mathbb E\left[ U_i(\vec b) \mid x_i = x \text{ and everyone follows } \sigma \right] For example, u1(x)u_1(x) is the expected utility of the 1st player conditioned on them having value xx for the power drill:

u1(x)=x2=01000 ⁣xN=01000U1(σ1(x),σ2(x2),,σN(xN))dμ2dμN. u_1(x) = \int_{x_2=0}^{1000} \dots \int_{x_N=0}^{1000} U_1(\sigma_1(x), \sigma_2(x_2), \dots, \sigma_N(x_N)) d\mu_2 \dots d\mu_N.

Similarly, let

pi(x)=E[Pi(b)xi=x and everyone follows σ]qi(x)=E[Qi(b)xi=x and everyone follows σ]. \begin{aligned} p_i(x) &= \mathbb E\left[ P_i(\vec b) \mid x_i = x \text{ and everyone follows }\sigma \right] \\ q_i(x) &= \mathbb E\left[ Q_i(\vec b) \mid x_i = x \text{ and everyone follows }\sigma \right]. \end{aligned}

Note that pip_i, qiq_i, uiu_i depend not only on the mechanism MM itself but also on the attached equilibrium σ\sigma.

It’s important to realize the functions pip_i, qiq_i, uiu_i carry much more information than just PP, QQ, UU. All three functions depend on the equilibrium strategy σ\sigma, which in turn depend on both PP and QQ. Moreover, all three functions also depend on μ\mu. Hence for example qq actually depends indirectly on PP as well, because the choice of PP affects the resulting equilibrium σ\sigma.

Example 8 (Example of σ\sigma, qiq_i, pip_i)

Let’s take the first-price auction with two players Anna and Elsa. If we call it M=(M,σ)M = (M, \sigma) then as we described before we have:

  • N=2N = 2,
  • μ1\mu_1 and μ2\mu_2 are uniform distributions over [0,1000][0,1000],
  • PiP_i is defined by having player ii pay their bid upon winning.
  • Q=QhighestQ = Q_{\text{highest}}

Moreover, the Nash equilibrium σ=(σ1,σ2)\sigma = (\sigma_1, \sigma_2) is given by σi(x)=x/2\sigma_i(x) = x/2 for all xx, as we saw earlier. Consequently, we have

  • qi(x)=x/1000q_i(x) = x/1000 since the probability of winning (and hence winning the bid) is proportional to the value placed on the item (since μ\mu is a uniform distribution).
  • pi(x)=x/2x/1000p_i(x) = x/2 \cdot x/1000 as the expected payment: there’s a x/1000x/1000 chance of winning, and a payment of x/2x/2 if you do.

4. Equivalence of utility and payment

In what follows let ii be any index.

We now prove that

Lemma 9 (Envelope theorem)

Assume M=(M,σ)M = (M, \sigma) is a direct mechanism. Then uu is convex, and ui(x)=qi(x)u_i'(x) = q_i(x) except for at most countably many points at which uu is not differentiable.

Proof: Since σ\sigma is an equilibrium, we have xqi(x)pi(x)=ui(x)xqi(b)pi(b)bI.x \cdot q_i(x) - p_i(x) = u_i(x) \ge x \cdot q_i(b) - p_i(b) \qquad \forall b \in I. i.e. there is no benefit in lying and bidding bb rather than xx.

First, let’s show that if xx is differentiable, then ui(x)=qi(x)u_i'(x) = q_i(x). We have that

limh0ui(x+h)ui(x)hlimh0[(x+h)qi(x)pi(x)][xqi(x)pi(x)]h=q(x). \lim_{h \rightarrow 0} \frac{u_i(x+h)-u_i(x)}{h} \ge \lim_{h \rightarrow 0} \frac{\left[ (x+h)q_i(x)-p_i(x) \right] - \left[ x \cdot q_i(x)-p_i(x) \right]}{h} = q(x).

Similarly

limh0ui(x)ui(xh)hlimh0[xqi(x)pi(x)][(xh)qi(x)pi(x)]h=qi(x). \lim_{h \rightarrow 0} \frac{u_i(x)-u_i(x-h)}{h} \le \lim_{h \rightarrow 0} \frac{\left[ x \cdot q_i(x)-p_i(x) \right] - \left[ (x-h)q_i(x)-p_i(x) \right]}{h} = q_i(x).

This implies the limit, if it exists, must be qi(x)q_i(x). We’ll omit the proof that uu is differentiable almost everywhere, remarking that it follows from qi(x)q_i(x) being nondecreasing in xx (proved later). \Box

Theorem 10 (Utility equivalence)

Let (M,σ)(M, \sigma) be a direct mechanism. For any xx, ui(x)=ui(0)+0xqi(t)dt.u_i(x) = u_i(0) + \int_0^x q_i(t) dt.

Proof: Fundamental theorem of calculus. \Box

Theorem 11 (Payment equivalence)

Let (M,σ)(M, \sigma) be a direct mechanism. For any xx, pi(x)=pi(0)+xqi(x)0xqi(t)dt.p_i(x) = p_i(0) + x \cdot q_i(x) - \int_0^x q_i(t) dt. Thus pp is determined by qq up to a constant shift.

Proof: Use ui(x)=xqi(x)pi(x)u_i(x) = x \cdot q_i(x) - p_i(x) and ui(0)=pi(0)u_i(0) = - p_i(0). \Box

This means that both functions pp and uu are completely determined, up to a constant shift, by the expected allocation qq in the equilibrium σ\sigma.

5. Revenue equivalence

A corollary:

Corollary 12 (Revenue equivalence)

Let M=(M,σ)M = (M, \sigma) be a mechanism. Then the expected revenue of the auctioneer, namely, Exi=1Npi(xi)\mathbf E_{\vec x} \sum_{i=1}^N p_i(x_i) depends only on qiq_i and pi(0)p_i(0).

Very often, textbooks will add the additional requirement that ui(0)=0u_i(0) = 0 or pi(0)=0p_i(0) = 0, in which case the statements become slightly simpler, as the constant shifts go away.

Here are the two important corollaries, which as far as I can tell are never both stated.

Corollary 13 (Revenue equivalence for incentive compatible mechanisms)

If M=(M,id)M = (M, \mathrm{id}) is incentive compatible, then ui(x)u_i(x) and pi(x)p_i(x) (and hence the seller’s revenue) depends only on the allocation function QQ and distributions μ\mu, up to a constant shift.

Proof: In an incentive compatible situation where σi(x)=x\sigma_i(x) = x we have

q1(x)=x2=01000 ⁣xN=01000Q1(x,x2,,xN)dμ2dμ3dμN q_1(x) = \int_{x_2=0}^{1000} \dots \int_{x_N=0}^{1000} Q_1(x, x_2, \dots, x_N) d\mu_2 d\mu_3 \dots d\mu_N

so q1q_1 depends only on QQ and μ\mu up to a constant shift. Ditto for any other qiq_i. \Box

Corollary 14 (Revenue equivalence for QhighestQ_{\text{highest}} auctions)

Suppose M=(M,σ)M = (M, \sigma) is a mechanism in which

  • The allocation function is Q=QhighestQ = Q_{\text{highest}},
  • The σi(x)\sigma_i(x) is strictly increasing in xx for all ii (players with higher values bid more).

Then u(x)u(x) and p(x)p(x) are determined up to constant shifts by μ\mu.

Proof: By the assumption on σ\sigma we have

Qhighest(σ1(x1),,σN(xN))=Qhighest(x1,,xN) Q_{\text{highest}}( \sigma_1(x_1), \dots, \sigma_N(x_N) ) = Q_{\text{highest}}\left( x_1, \dots, x_N \right)

so it follows for example that

q1(x)=x2=01000 ⁣xN=01000Q1(σ1(x),σ2(x2),,σN(xN))dμ2dμN=x2=01000 ⁣xN=01000Q1(x,x2,,xN)dμ2dμN. \begin{aligned} q_1(x) &= \int_{x_2=0}^{1000} \dots \int_{x_N=0}^{1000} Q_1(\sigma_1(x), \sigma_2(x_2), \dots, \sigma_N(x_N)) d\mu_2 \dots d\mu_N \\ &= \int_{x_2=0}^{1000} \dots \int_{x_N=0}^{1000} Q_1(x, x_2, \dots, x_N) d\mu_2 \dots d\mu_N. \end{aligned}

Once again qiq_i now depends only on μ\mu. \Box

As an application, we can actually use the revenue equivalence theorem to compute the equilibrium strategies of the first-price, second-price, and all-pay auctions with n2n \ge 2 players.

Corollary 15 (Nash equilibria of common QhighestQ_{\text{highest}} auctions)

Suppose a player has value x[0,1000]x \in [0,1000] as in our setup, and that the prior μ\mu is distributed uniformly. Each of the following is a Nash equilibrium:

  • In a first-price auction, bid nn+1x\frac{n}{n+1} x.
  • In a second-price auction, bid xx (i.e. bid truthfully).
  • In an all-pay auction, bid 1000n1n(x/1000)n1000 \cdot \frac{n-1}{n} (x/1000)^n.

Proof: First, as we saw already the second-price auction has an equilibrium where everyone bids truthfully. In this case, the probability of winning is (x/1000)n1(x/1000)^{n-1} and the expected payment when winning is n1nx\frac{n-1}{n} x (this is the expected value of the largest of n1n-1 numbers in [0,x][0,x].) Now by revenue equivalence, we have

piall(x)=piI(x)=piII(x)=1000n1n(x/1000)n. p_i^{\mathrm{all}}(x) = p_i^{\mathrm{I}}(x) = p_i^{\mathrm{II}}(x) = 1000 \cdot \frac{n-1}{n} \left( x/1000 \right)^n.

Now we examine the all-pay and first-price auction.

  • We have piall(x)=1000n1n(x/1000)np_i^{\mathrm{all}}(x) = 1000 \cdot \frac{n-1}{n} \left( x/1000 \right)^n, i.e. in the equilibrium strategy for the all-pay auction, a player with type xx pays on average 1000n1n(x/1000)n1000 \cdot \frac{n-1}{n} \left( x/1000 \right)^n. But the payment in an all-pay auction is always the bid! Hence conclusion.
  • We have piI(x)=piII(x)p_i^{\mathrm{I}}(x) = p_i^{\mathrm{II}}(x), and since in both cases the chance of paying at all is (x/1000)n1(x/1000)^{n-1}, the payment if a player does win is n1nx\frac{n-1}{n} x; hence the equilibrium strategy is to bid n1nx\frac{n-1}{n}x.

\Box

6. Design feasibility

By now we have seen that all our mechanisms really depend mostly on the functions qiq_i, (from which we can then compute pip_i and uiu_i) while we have almost completely ignored the parameters PiP_i, QiQ_i, σ\sigma which give rise to the mechanism (M,σ)(M, \sigma) in the first place.

We would like to continue doing this, and therefore, we want a way to reverse the work earlier: given the functions qiq_i construct a mechanism (M,σ)(M, \sigma) with those particular expected allocations. The construction need not even be explicit; we will be content just knowing such a mechanisms exists.

Thus, the critical question is: which functions qiq_i can actually arise? The answer is that the only real constraint is that qiq_i are nondecreasing.

Theorem 16 (Feasibility rule)

Consider NN players with a fixed a distribution {μi}i=1N\{\mu_i\}_{i=1}^N of private values. Consider any measurable functions q1,,qN:[0,1000]R0q_1, \dots, q_N : [0,1000] \rightarrow \mathbb R_{\ge 0}.

Then there exists a direct mechanism (M,σ)(M, \sigma) with qiq_i as the expected allocations if and only if

  • each function qiq_i is nondecreasing.
  • q1(x1)++qN(xN)1q_1(x_1) + \dots + q_N(x_N) \le 1 with probability 11.

Proof: First, we show that any qiq_i arising from a direct mechanism are nondecreasing. Indeed, if x>yx > y then we have the inequalities

xqi(x)pi(x)xqi(y)pi(y)yqi(y)pi(y)yqi(x)pi(x). \begin{aligned} x \cdot q_i(x) - p_i(x) &\ge x \cdot q_i(y) - p_i(y) \\ y \cdot q_i(y) - p_i(y) &\ge y \cdot q_i(x) - p_i(x). \end{aligned}

If we add these inequalities we recover (xy)qi(x)(xy)qi(y)(x-y)q_i(x) \ge (x-y)q_i(y), which shows that qiq_i is nondecreasing. The second condition just reflects that Qi(b)1\sum Q_i(\vec b) \le 1.

Conversely, suppose qiq_i are given nondecreasing function. We will construct an incentive compatible mechanism inducing them. First, define pi(x)=xqi(x)0xqi(t)dtp_i(x) = x \cdot q_i(x) - \int_0^x q_i(t) dt as predicted by Revenue Equivalence. First, define M=(P,Q,μ)M = (P,Q, \mu) by

  • Pi(x1,,xN)=pi(xi)P_i(x_1, \dots, x_N) = p_i(x_i), and
  • Qi(x1,,xN)=qi(xi)Q_i(x_1, \dots, x_N) = q_i(x_i). (Note iQi(xi)1\sum_i Q_i(x_i) \le 1.)

Then trivially piM=pip_i^M = p_i and qiM=qiq_i^M = q_i.

However, we haven’t specified a σ\sigma yet! This is the hard part, but the crucial claim is that we can pick σ=id\sigma = \mathrm{id}: that is, (M,id)(M, \mathrm{id}) is an incentive compatible direct mechanism.

Thus we need to check that for all xx and yy that ui(x)xqi(y)pi(y)u_i(x) \ge x \cdot q_i(y) - p_i(y) We just do x>yx > y since the other case is analogous; then the inequality we want to prove rearranges as

    ui(x)ui(y)(xy)qi(y)    yxq(t)dtyxq(y)dt \begin{aligned} \iff u_i(x) - u_i(y) &\ge (x-y) \cdot q_i(y) \\ \iff \int_y^x q(t) dt &\ge \int_y^x q(y) dt \end{aligned}

Since qq is increasing, this is immediate. \Box

In particular, we can now state:

Corollary 17 (Individually Rational)

A direct mechanism (M,σ)(M, \sigma) is voluntary if and only if ui(0)0    pi(0)0u_i(0) \ge 0 \iff p_i(0) \le 0 for every ii.

Proof: Since ui=qi0u_i' = q_i \ge 0, the function uiu_i is nonnegative everywhere if and only if ui(0)0u_i(0) \ge 0. \Box

7. Optimal auction

Since we’re talking about optimal auctions, we now restrict our attention to auctions in which pi(0)=0p_i(0) = 0 for every ii (hence the auction is voluntary).

Now, we want to find the amount of money we expect to extract for player ii. Let’s compute the expected revenue given a function qq and distribution μ\mu. Of course, we know that Exi[pi(xi)]=t=01000pi(t)  dμi\mathbf E_{x_i}\left[ p_i(x_i) \right] = \int_{t=0}^{1000} p_i(t) \; d\mu_i but we also know by revenue equivalence that we want to instead use the function qiq_i, rather than the function pip_i. So let’s instead use our theorem for the integral to compute it:

Exi[pi(xi)]=pi(0)+Exi[xiqi(xi)]Exi[0xiq(t)dt] \mathbf E_{x_i}\left[ p_i(x_i) \right] = p_i(0) + \mathbf E_{x_i}\left[ x_i \cdot q_i(x_i) \right] - \mathbf E_{x_i}\left[ \int_0^{x_i} q(t) dt \right]

Applying the definition of expected value and switching the order of summation,

Exi[pi(xi)]=pi(0)+t=01000tqi(t)dμix=010000xq(t)dtdμi=t=01000tqi(t)dμit=01000q(t)x=t10000xdμidt=t=01000tqi(t)dμit=01000qi(t)μi([t,1000])dt=t=01000tqi(t)dμit=01000qi(t)1μi([0,t])dμidt(t)dμi=t=01000qi(t)(t1μi([0,t])dμidt(t))dμi \begin{aligned} \mathbf E_{x_i}\left[ p_i(x_i) \right] &= p_i(0) + \int_{t=0}^{1000} t \cdot q_i(t) d\mu_i - \int_{x=0}^{1000} \int_0^{x} q(t) dt d\mu_i \\ &= \int_{t=0}^{1000} t \cdot q_i(t) d\mu_i - \int_{t=0}^{1000} q(t) \int_{x=t}^{1000} \int_0^{x} d\mu_i dt \\ &= \int_{t=0}^{1000} t \cdot q_i(t) d\mu_i - \int_{t=0}^{1000} q_i(t) \cdot \mu_i([t, 1000]) dt \\ &= \int_{t=0}^{1000} t \cdot q_i(t) d\mu_i - \int_{t=0}^{1000} q_i(t) \cdot \frac{1-\mu_i([0, t])} {\frac{d\mu_i}{dt}(t)} d\mu_i \\ &= \int_{t=0}^{1000} q_i(t) \left( t - \frac{1-\mu_i([0,t])} {\frac{d\mu_i}{dt}(t)} \right) d\mu_i \end{aligned}

Thus, we define for the player ii their virtual valuation to be the thing that we just obtained in this computation: ψi(t)=t1μi([0,t])dμidt(t).\psi_i(t) = t - \frac{1-\mu_i([0,t])}{\frac{d\mu_i}{dt}(t)}. Thus Exi[pi(xi)]=t=01000qi(t)ψi(t)dt.(1)\mathbf E_{x_i}\left[ p_i(x_i) \right] = \int_{t=0}^{1000} q_i(t) \cdot \psi_i(t) dt. \qquad (1) The virtual valuation ψi(t)\psi_i(t) can be thought of as the expected value of the amount of money we extract if we give the object to player ii when she has type tt. Note it has the very important property of not depending on qiq_i.

Now, let’s observe that

i=1NExi[pi(xi)]=i=1Nt=01000qi(t)ψi(t)dμi=i=1Nx1=01000 ⁣xN=01000Qi(x)ψ(xi)dμ1dμ2dμN=x1=01000 ⁣xN=01000i=1N(Qi(x)ψ(xi))dμ1dμ2dμN. \begin{aligned} \sum_{i=1}^N \mathbf E_{x_i} \left[ p_i(x_i) \right] &= \sum_{i=1}^N \int_{t=0}^{1000} q_i(t) \psi_i(t) d\mu_i \\ &= \sum_{i=1}^N \int_{x_1=0}^{1000} \dots \int_{x_N=0}^{1000} Q_i(\vec x) \psi(x_i) d\mu_1 d\mu_2 \dots d\mu_N \\ &= \int_{x_1=0}^{1000} \dots \int_{x_N=0}^{1000} \sum_{i=1}^N \left( Q_i(\vec x) \psi(x_i) \right) d\mu_1 d\mu_2 \dots d\mu_N. \end{aligned}

Now, our goal is to select the function QQ to maximize this. Consider a particular point x=(x1,,xN)\vec x = (x_1, \dots, x_N). Then we’re trying to pick Q1(x)Q_1(\vec x), Q2(x)Q_2(\vec x), …, Qn(x)Q_n(\vec x) to maximize the value of Q1(x)ψ1(x1)+Q2(x)ψ2(x2)++Qn(x)ψn(xn)Q_1(\vec x) \psi_1(x_1) + Q_2(\vec x) \psi_2(x_2) + \dots + Q_n(\vec x) \psi_n(x_n) subject to Qi(x)1\sum Q_i(\vec x) \le 1. The ψi\psi_i’s here depend only on the distribution μ\mu. This is thus a convex optimization problem, so the solution is obvious: put all the weight on the biggest positive ψi(xi)\psi_i(x_i), breaking ties arbitrarily. In other words, if k=argmaxiψi(xi)k = \operatorname{argmax}_i \psi_i(x_i) and ψk(xk)>0\psi_k(x_k) > 0, then set Qk(x)=1Q_k(\vec x) = 1 and all the other coefficients to be zero. (Ties broken arbitrarily as usual.) To be explicit, we set

Qk(x)={1ψk(xk)0 is maximal (ties broken arbitrarily)0else. Q_k(\vec x) = \begin{cases} 1 & \psi_k(x_k) \ge 0 \text{ is maximal (ties broken arbitrarily)} \\ 0 & \text{else}. \end{cases}

So we should think of this as a second-price auction with discriminatory reserve prices. Moreover, the “second-price” payment is done based on ψi\psi_i, so rather than “pay second highest bid” we instead have “pay smallest amount needed to win”, i.e. the smallest yy such that ψk(y)ψj(xj)\psi_k(y) \ge \psi_j(x_j) for all jkj \neq k.

Unfortunately, since the μi\mu_i are arbitrary the resulting QiQ_i might be strange enough that the game fails to have a reasonable strategy σ\sigma; in other words we’re worried the maximum might not be achievable. The easiest thing to do is write down a condition to handle this:

Definition 18. We say μ={μi}i=1N\mu = \{\mu_i\}_{i=1}^N is regular if the virtual valuations ψi:[0,1000]R\psi_i : [0,1000] \rightarrow \mathbb R are strictly increasing for all ii.

Theorem 19 (Regularity implies optimal auction is achievable)

Assume regularity of μ\mu. Consider a second-price auction with discriminatory reserve prices: the reserve price for player ii is the smallest xx such that ψi(x)>0\psi_i(x) > 0, and the winner kk pays the smallest amount needed to win.

This is an incentive compatible mechanism which maximizes the expected revenue of the auctioneer.

Proof: The QQ described in the theorem is the one we mentioned earlier. The hypothesis defines PP as follows:

  • If ψk(xk)>0\psi_k(x_k) > 0 is maximal, then that player wins and pays the smallest amount yy such that ψk(y)\psi_k(y) still exceeds all other ψj(xj)\psi_j(x_j).
  • Otherwise, the item is not sold.

The fact that this mechanism M=(P,Q,μ)M = (P,Q,\mu) is incentive compatible is more or less the same as before (bidding truthfully is a weakly dominant strategy). Moreover we already argued above that this allocation QQ maximizes revenue. \Box

You can and should think of this as a “reserve price second price auction” except with virtual valuations instead. The winner is the player with the highest virtual valuation, who is then allowed to retroactively change their bid so long as they still win.

To see this in action:

Corollary 20 (Optimal symmetric uniform auction)

Consider an auction in which nn players have uniform values in [0,1000][0,1000]. Then the optimal auction is a second-price auction with reserve price $500\$500. The expected earning of the auctioneer is 1000n1+(12)nn+1.1000 \cdot \frac{n - 1 + \left( \frac{1}{2} \right)^n}{n+1}.

Proof: We compute each ψi\psi_i as ψi(x)=x1μi([0,x])dμidt(x)=x1x/10001/1000=2x1000.\psi_i(x) = x - \frac{1 - \mu_i([0,x])}{\frac{d\mu_i}{dt}(x)} = x - \frac{1-x/1000}{1/1000} = 2x - 1000. Hence, we usually want to award the item to the player with the largest virtual valuation (i.e. the highest bidder), setting the reserve price at 500500 for everyone since ψi(500)=0\psi_i(500) = 0. By (1) the expected payment from a player equals

11000x=01000ψi(x)qi(x)dx=11000x=5001000(2x1000)(x/1000)n1dx \frac{1}{1000} \int_{x=0}^{1000} \psi_i(x) \cdot q_i(x) dx = \frac{1}{1000}\int_{x=500}^{1000} (2x-1000) \cdot (x/1000)^{n-1} dx

Simplifying and multiplying by nn gives the answer. \Box

More generally, in an asymmetric situation the optimal reserve prices are discriminatory and vary from player to player. As a nice exercise to get used to this:

Exercise 21. Find the optimal auction mechanism if two players are bidding, with one player having value distributed uniformly in [0,500][0,500] and the other player having value distributed uniformly in [0,1000][0,1000].

8. Against revelation

Here’s a pedagogical point: almost all sources state early on the so-called “revelation principle”.

Proposition 22 (Revelation principle)

Let M=(M,σ)M = (M, \sigma) be a direct mechanism. Then there exists a incentive compatible mechanism MM^\ast such that

  • M=(M,id)M^\ast = (M^\ast, \mathrm{id}) is incentive compatible, and
  • For any ii, pi=pip_i^\ast = p_i, qi=qiq_i^\ast = q_i, ui=uiu_i^\ast = u_i, i.e. at the equilibrium point, the expected payoffs and allocations don’t change.

Proof: Consider M=(M,σ)M = (M, \sigma). Then MM^\ast is played as follows:

  • Each player ii has an advisor to whom it tells their value xix_i
  • The advisor and figures out the optimal bid σi(xi)\sigma_i(x_i) in MM, and submits this bid on the player’s behalf.
  • The game MM is played with the advisor’s bids, and the payments / allocations are given to corresponding players.

Clearly the player should be truthful to their advisor. \Box

Most sources go on to say that this makes their life easier, because now they can instead say “it suffices to study incentive compatible mechanisms”. For example, one can use this to

  • Replace “direct mechanism” with “incentive-compatible direct mechanism”.
  • Replace “there exists a direct mechanism (M,σ)(M, \sigma)” with “there exists a (P,Q)(P,Q) which is incentive compatible”.

However, I personally think this is awful. Here is why.

The proof of Revelation is almost tautological. Philosophically, it says that you should define the functions qiq_i, pip_i, uiu_i in terms of the equilibrium σ\sigma. Authors which restrict to incentive compatible mechanisms are hiding this fact behind Revelation: now to the reader it’s no longer clear whether uiu_i should be interpreted as taking a bid or value as input.

Put another way, the concept of a bid/value should be kept segregated. That’s why I use xix_i only for values, bib_i only for bids, and build in the equilibrium σ\sigma as into uiu_i, pip_i, qiq_i; So ui(x)u_i(x) is the expected utility of bidding σ(xi)\sigma(x_i) in the equilibrium. Revelation does the exact opposite: it lets authors promiscuously mix the concepts of values and bids, and pushes σ\sigma out of the picture altogether.