When you browse the internet a lot of websites show you banners with advertisements. And if you reload the page some new flashy advertisement pops up in the same place. The websites do this to earn money usually to sustain themselves.
In the early days of the internet websites made deals with advertisers such that the advertiser was allowed to display their banner for a certain period of time on the website. But in the late 2000's a new way of selling advertising space made an introduction: Real-Time Bidding (RTB).
Web page loading
While your web page is loading an auction takes place. For this the web page uses a supply-side platform (SSP). An SSP is a platform that specializes in handling the filling up of advertising space so that the web page owners do not have to worry about the technical details. The moment you request a web page a notification is sent to the SSP with some information about you. Usually it is just your IP address, but sometimes due to tracking cookies more information about you is known.
SSPs and DSPs
When the SSP receives a notification it will start an auction. First it will send notifications to demand-side platforms (DSP) that are connected to the SSP. Just as SSPs handle the technical part of the procedure for web page owners, DSPs handle the technical aspect for clients that want to advertise. Based on how well your characteristics in the notification match with the target audience of the advertisers they determine a bid which the DSPs send to the SSP.
One fifth of a second
The SSP reviews the bids it received and based on these it determines a winner and a price. The winner is now allowed to display their advertisement on the web page you are looking at. This whole process, called Real-Time Bidding (RTB), takes place in about 200 milliseconds, one fifth of a second. It barely affects the loading time of the web page.
Second-price auction
Since the start of RTB in the late 2000's until 2019 the auction format was that of a second-price auction. Contrary to what probably first comes to mind when thinking about an auction, the winner of the auction does not have to pay what they bid. Instead, the winner has to pay the second highest bid.
Example
Let us take a look at a toy example to see the difference between the first-price auction, where the winner pays what they bid, and the second-price auction.
Suppose there is a banner space available at the network pages and while you are waiting to see if there are some new awesome articles available the SSP, of which the network pages is then a hypothetical client, starts an auction. There are four bidders: Leo who sells laptops, Candy selling candy bars, Eric selling electric bikes and Holly selling holidays. Some advertisers are more eager to advertise than others and are willing to spend more money, we say that each of them has some value for the advertising spot.
Since you are reading the network pages in an older browser Leo thinks you have a good chance of being interested in a new laptop and thinks the advertisement spot is worth 10€ euros to him. To digest all this difficult information from the network pages you need brainfood. Candy knows this. She thinks your ad is worth 9€ euros. Because your profile looks like the one of a young person Eric is not valuing you very high with 3€ euros and in these corona times the budget for holiday sellers is very limited and so Holly only values the ad at 1€. In reality you should think of these numbers as being divided by 1000.
What to bid?
Suppose we have a first-price auction where the winner pays what they bid.
If you are worth 10€ to Leo and he bids 10€ and wins, then he actually does not really earn any money on you, so to make a profit Leo will bid something like 7€. In the same way Candy is a bit more aggressive and bids 7.50€, Eric bids 0.50€ and Holly also bids 0.50€.
Winner
Candy bid the highest with 7.50€. Both in the first-price and in the second-price auction she will win the auction. In the first-price auction she will pay 7.50€ while in the second-price auction she will pay the second highest bid which is 7€. Candy now has the opportunity to display their advertisement.
Why has the second-price auction instead of the first-price auction been the auction format for online advertisement auctions for over 10 years?
Unpredictable
The example already reveals one of the main problems of a first-price auction. It is not clear at all how to determine how high your bid should be. Not too high because then you do not earn anything. If something is worth 5€ to you and you pay 5€ then you might as well have saved yourself the effort of buying it since you did not gain anything. But also not too low because then you might lose the auction even though you are the one valuing the item the highest of all bidders. This happened in our example with Leo. He was too conservative which gave Candy the opportunity of winning the auction.
Especially in the online setting where there are many auctions in a row, algorithms will automatically try to find this better price. So when you win, you are going to bid lower in the next auction, while if you do not win you are going to bid a bit more. At some point this will change the result so then the opposite will start happening. If your competitor starts doing this they will get an advantage, so you will have to join this battle. It makes it harder to participate in the auction and what will happen in the auction is also less predictable.
Bidding your value
A beautiful property of the second-price auction is that the outcome of the auction will never be better for you than when you bid your value for the item. To see this let us take a look at our example again.
Suppose Holly would have bid 1€ instead of 0.50€. She still would not have won, so she could as well have bid her value for the item of 1€. The same holds for Eric, bidding 3€ instead of 0.50€, it does not change anything. For Leo and Candy more interesting things happen. First consider Candy. If she would have bid 9€ instead of 7.50€ she still would have had the highest bid. And because the price is the second highest bid she still would have paid only 7€ so nothing would have changed for her. She could as well have bid 9€. Lastly Leo, if he had bid 10€ he would have won the auction and paid a price of 7.50€. That is even better than what happened now.
This observation holds in general, whatever the values of the bidders and the bids are, changing a bid to their value never makes the player unhappier.
This is very nice. When using a second-price auction the best strategy for a bidder is to just bid what they think the item is worth. No difficult guessing what the other bidders might bid and adjusting your bid on that. This was the main reason for using the second-price auction for RTB auctions.
Not so good after all
The second-price auction was used until 2019 for online banner auctions. Then, the industry has switched to first-price auctions. Why has this happened? I will mention two reasons.
One reason is that only the auctioneer knows all the bids. This gives the auctioneer the power to manipulate the price that is ultimately being paid. Consider a situation with only two bidders where one bids very low and the other very high, then the high bidder only has to pay very little while they were valuing the banner space much higher. The auctioneer can add hidden fees, or add some fake bids to jack up the price. In a first-price auction this is not possible because you know what you bid.
Another reason is that in the above analysis we considered a single item, while there are billions of advertisement spots auctioned every day. Advertisers usually have some daily budget and instead of finishing their budget before lunch they rather win more auctions spread throughout the day for a lower price. With this observation it is not true anymore that bidding your value is the best thing to do.
The best we can do
As already mentioned the first-price auction does not give us a handle to reason on how bidders will bid, but for billions of consecutive auctions where advertisers have budgets this is also not true for the second-price auction. The first-price auction can handle the non-transparency. You pay what you bid so hidden fees are not possible. This is why online advertising has switched from second-price auctions to first-price auctions.
Are there better alternatives? The field of mechanism design is actively trying to come up with ways to better analyze existing mechanisms and finding new mechanisms but for now this is the best we can do.