Latest news of the domain name industry

Recent Posts

Amazon backtracks after pricing free Alexa list at over $900,000

Kevin Murphy, November 23, 2016, 11:30:51 (UTC), Domain Services

Amazon has reversed, at least temporarily, its decision to yank its free list of the world’s most popular domains, after an outcry from researchers.
The daily Alexa list, which contains the company’s estimate of the world’s top 1 million domains by traffic, suddenly disappeared late last week.
The list was popular with researchers in fields such as internet security. Because it was free, it was widely used.
DI PRO uses the list every day to estimate the relative popularity of top-level domains.
After deleting the list, Amazon directed users to its Amazon Web Services portal, which had started offering the same data priced at $0.0025 per URL.
That’s not cheap. The cost of obtaining same data suddenly leaped from nothing to $912,500 per year, or $2,500 per day.
That’s beyond the wallets, I suspect, of almost every Alexa user, especially the many domain name tools providers (including yours truly) that relied on the data to estimate domain popularity.
Even scaling back usage to the top 100,000 URLs would be prohibitively expensive for most researchers.
While Amazon is of course free to price its data at whatever it thinks it is worth, no notice was given that the file was to be deleted, scuppering without warning goodness knows how many ongoing projects.
Some users spoke out on Twitter.


I spent most of yesterday figuring out how to quickly rejigger DI PRO to cope with the new regime, but it seems I may have been wasting my time.
After an outcry from fellow researchers, Amazon has restored the free list. It said on Twitter:


It seems clear that the key word here is “temporarily”, and that the the restoration of the file may primarily be designed to give researchers more time to seek alternatives or wrap up their research.


If you find this post or this blog useful or interestjng, please support Domain Incite, the independent source of news, analysis and opinion for the domain name industry and ICANN community.

Tagged: , , ,

Comments (2)

  1. Acro says:

    Alexa rankings have to be taken with a rather large grain of salt. That being said, after a huge, unexplained dive last year in rankings, web sites are now climbing up on average. Most likely, because Alexa’s algorithms were changed dramatically from 2015.

  2. Rubens Kuhl says:

    Alexa 1M got published free when QuantCast started publishing their 1 million list, and that is still true today:
    https://ak.quantcast.com/quantcast-top-sites.zip
    Unfortunately the 1M list is only available for the US and their data is biased towards sites they measure directly.

Add Your Comment