These crawls are part of an effort to archive pages as they are created and archive the pages that they refer to. That way, as the pages that are referenced are changed or taken from the web, a link to the version that was live when the page was written will be preserved.
Then the Internet Archive hopes that references to these archived pages will be put in place of a link that would be otherwise be broken, or a companion link to allow people to see what was originally intended by a page's authors.
The wheelchair basketball player and Paralympics presenter talks about moving from Nigeria to the UK when he was three and being estranged from his parents for several years
North take a step in the right direction, St Kilda carnage, poking the bear, the Eagles have a nose for blood, and anger and finger-pointing at Port Adelaide
The Paralympian turned television presenter Ade Adepitan has praised Channel 4 for giving a new roster of disabled people a chance in front of the camera, as the broadcaster announced a presenting team for the London Paralympics
Ade Adepitan, one of the stars of this year's London marathon, talks to Emine Saner about life as a Paralympic basketball star, his TV career, and coming to terms with being bullied.
The balance Ade Adepitan: ‘I’d like to be the British Oprah’