Google Developers Blog: scalability
COLLECTED BY
Organization:
Internet Archive
The Internet Archive discovers and captures web pages through many different web crawls.
At any given time several distinct crawls are running, some for months, and some every day or longer.
View the web archive through the
Wayback Machine .
Web wide crawl number 16
The seed list for Wide00016 was made from the join of the top 1 million domains from CISCO and the top 1 million domains from Alexa.
The Wayback Machine - https://web.archive.org/web/20170705141937/https://developers.googleblog.com/search/label/scalability
Posted by Dion Almaer, Google Developer Programs Seattle conference on scalability .
