Index of /modules/by-module/Apache/ARUN

COLLECTED BY

Organization: Internet Archive

The Internet Archive discovers and captures web pages through many different web crawls. At any given time several distinct crawls are running, some for months, and some every day or longer. View the web archive through the Wayback Machine.

Collection: Wide Crawl Number 14 - Started Mar 4th, 2016 - Ended Sep 15th, 2016

The seed for Wide00014 was:

- Slash pages from every domain on the web:

-- a list of domains using Survey crawl seeds

-- a list of domains using Wide00012 web graph

-- a list of domains using Wide00013 web graph

- Top ranked pages (up to a max of 100) from every linked-to domain using the Wide00012 inter-domain navigational link graph

-- a ranking of all URLs that have more than one incoming inter-domain link (rank was determined by number of incoming links using Wide00012 inter domain links)

-- up to a maximum of 100 most highly ranked URLs per domain

The seed list contains a total of 431,055,452 URLs
The seed list was further filtered to exclude known porn, and link farm, domains
The modified seed list contains a total of 428M URLs

TIMESTAMPS

Mar	APR	May
	04
2015	2016	2017

Name	Last modified	Size

Parent Directory		-
Apache-Htaccess-1.6.meta	08-Mar-2016 05:39	417
Apache-Htaccess-1.6.readme	08-Mar-2016 05:39	387
Apache-Htaccess-1.6.tar.gz	08-Mar-2016 05:53	11K
CHECKSUMS	11-Mar-2016 14:22	2.1K
WWW-Search-PharmGKB-2.03.meta	08-Mar-2016 07:41	436
WWW-Search-PharmGKB-2.03.readme	08-Mar-2016 07:41	406
WWW-Search-PharmGKB-2.03.tar.gz	08-Mar-2016 07:43	11K
WWW-Search-PharmGKB-2.04.meta	08-Mar-2016 11:26	625
WWW-Search-PharmGKB-2.04.readme	08-Mar-2016 11:26	38
WWW-Search-PharmGKB-2.04.tar.gz	08-Mar-2016 11:28	3.8K