These crawls are part of an effort to archive pages as they are created and archive the pages that they refer to. That way, as the pages that are referenced are changed or taken from the web, a link to the version that was live when the page was written will be preserved.
Then the Internet Archive hopes that references to these archived pages will be put in place of a link that would be otherwise be broken, or a companion link to allow people to see what was originally intended by a page's authors.
Alex McLeish felt it was his destiny to return for a second spell as Scotland manager and believes the only way to silence the doubters is by producing good results
For the first time since England’s top division rebranded there will not be a Scottish manager in charge of one of its clubs when the season gets under way. Why has their star fallen so far?
Jeremy Alexander: The former Birmingham manager Alex McLeish was jeered on his return to St Andrew's and his future at Nottingham Forest is no clearer after the 2-1 defeat
James Forrest’s snappy hat-trick crowns ascension day for nervy Scotland