inferwire
/
Opinion·4 min read

A URL Survived an 11-Year Bet on Link Rot; Many Pages Don't

Jeremy Keith bet in 2011 that longbets.org/601 would vanish within eleven years. It survived, the Internet Archive got $1,000, and Pew found 38 percent of 2013 webpages gone a decade later.

TL;DR

  • Jeremy Keith bet in 2011 that a Long Bets URL would vanish within eleven years; it survived, so $1,000 went to the Internet Archive [^1] [^2].
  • That outcome isn't the norm for old pages: Pew found 38 percent of webpages that existed in 2013 were no longer accessible a decade later [^4].

Background

Long Bets is a project of the Long Now Foundation, a nonprofit devoted to long-term thinking. Two people stake money on a prediction years ahead, and by tradition the winnings go to an organization neither of them controls [^2]. Link rot means links that stop working because the page they point to was moved or deleted. In the argument for the bet, Keith quoted Tim Berners-Lee's line "Cool URIs don't change" and called link rot "the entropy of the web" [^1].

What happened

On February 22, 2011, Keith predicted: "The original URL for this prediction (www.longbets.org/601) will no longer be available in eleven years." [^1] [^3] A year later, Matthew Haughey took up the challenge, and the prediction became a bet with $1,000 at stake: the Bletchley Park Trust would get it if Keith won, the Internet Archive if Haughey won [^3]. Keith argued that the chance of a web document surviving in its original location drops sharply over time, and added: "I would love to be proven wrong." Haughey countered that a stable URL scheme was within reach of anyone with moderate technical knowledge, and that Haughey's own oldest sites still worked through 301 redirects [^1].

The terms were precise. On February 22, 2022, entering the original address, www.longbets.org/601 over plain HTTP, into a browser or a tool like curl had to return an HTML page that still contained the prediction's text; a 301 redirect to another URL with that text also counted [^1]. That day, Jason Scott wrote on the Internet Archive's blog that the URL "absolutely has survived", so the archive would receive $1,000, $500 from each bettor, from an escrow account [^2]. Keith wrote: "I'm very happy to lose this bet." [^3] The page is still online [^1].

Neither side treated the result as proof that the web keeps its pages. Scott called the outcome "at best a bittersweet victory" and pointed out that a short, static address on a site run by an organization devoted to longevity was "a pretty safe bet" [^2]. Keith wrote that the pessimism was misplaced in this case but "informed by data", and that "The lifetime of a URL on the web remains shockingly short." [^3]

Why it matters

Pew Research Center's 2024 study puts numbers on that pessimism. It sampled just under 1 million pages from Common Crawl, an archive of web snapshots, covering 2013 to 2023. As of October 2023, 25 percent were no longer accessible, including 38 percent of the 2013 pages and about one in five pages from 2021 [^4]. The links that hold the web together decay too: 23 percent of news pages and 21 percent of government pages contained at least one broken link, and 54 percent of Wikipedia pages had at least one dead link in their references [^4]. Pew counted a page as gone only if it returned an error that clearly showed the page or its server no longer existed, so these are conservative figures [^4].

The bet's two authors drew a similar lesson. Keith wrote that "if you put something online, you have to put in real effort to keep it online", since domain names are rented rather than bought [^3]. Scott noted that had Keith won, the Internet Archive's Wayback Machine might have been the only place to see the page in its original form [^2]. The page that survived belonged to an organization with, in Scott's words, "a very vested interest in its URLs staying stable" [^2].

Practical example

Say you run a small blog with a few hundred posts that link to outside articles. Going by Pew's Wikipedia figures, where 11 percent of all reference links no longer worked, some of your older links have probably died too [^4]. You check your outbound links, and for each dead one you look for a copy at archive.org, which Keith says "lessens the sting considerably" [^3]. When you later move the blog to a new address scheme, you set up 301 redirects from the old URLs, the method Haughey used to keep Haughey's own sites working [^1].

Related gear

We recommend this book because it traces how people have recorded and passed on information, from early writing to the web.

AdvertisementAmazon

The Information: A History, a Theory, a Flood

Sources

  1. [1]Long Bets — 02011-02022 (11 years): The original URL for this prediction (www.longbets.org/601) will no longer be available in eleven years.
  2. [2]Internet Archive Blogs — A Long Bet Pays Off
  3. [3]Jeremy Keith — Journal: 02022-02-22
  4. [4]Pew Research Center — When Online Content Disappears
  5. [5]Hacker News — The original URL for this prediction will no longer be available in 11 years (2011)