This collection contains crawl data collected daily from a seed
list of US-based local news websites. Between 2005 and 2023, almost 2900
local newspapers shut down. This collection aims to archive existing
news sites should they shut down too.
Seed list used as of 2025-07-17 located here. The majority of seeds are provided courtesy of Northwestern University's State of Local News Project.
TIMESTAMPS
The Wayback Machine - https://web.archive.org/web/20250113234311/https://d1.awsstatic.com/
