 |
Skeeter's Crawler Report
Skeeter last crawled the Web on October 23 at 12:25 PM. He visited 12 of the 12 sites on the 1999 Web plus 358 other hosts,
read 2271 pages and took 2.2 seconds, not counting snack breaks. Sites that could not be reached
are skipped and retried on the next crawl. Pages are followed only within the same site, up to 400 per site. |
From the spider's log:
12:25:34 crawled http://yowza.localhost/ -> 160 pages, 574 KB
12:25:34 crawled http://altavisor.localhost/ -> 9 pages, 70 KB
12:25:34 crawled http://askreeves.localhost/ -> 11 pages, 87 KB
12:25:34 crawled http://orinoco.localhost/ -> 196 pages, 2602 KB
12:25:34 crawled http://ubid.localhost/ -> 271 pages, 1759 KB
12:25:35 crawled http://etoyz.localhost/ -> 157 pages, 1905 KB
12:25:35 GET http://petz.localhost/product_' + p.id + '.html -> 404 Not Found
12:25:35 GET http://petz.localhost/product_' + r.id + '.html -> 404 Not Found
12:25:35 crawled http://petz.localhost/ -> 83 pages, 1679 KB
12:25:35 GET http://geohoods.localhost/\"search.html -> 404 Not Found
12:25:35 GET http://geohoods.localhost/\"filemanager.html -> 404 Not Found
12:25:35 crawled http://geohoods.localhost/ -> 400 pages, 2513 KB
...
12:25:36 crawled http://www.yoyotricks.com/ -> 1 pages, 1 KB
12:25:36 crawled http://www.zinescene.com/ -> 1 pages, 1 KB
12:25:36 crawled http://www.zipdrivezone.com/ -> 2 pages, 3 KB
12:25:36 crawled http://www.ziplookup.com/ -> 2 pages, 2 KB
12:25:36 crawled http://www.zoocams.com/ -> 3 pages, 3 KB
Want Skeeter to come back sooner? He re-crawls whenever the webmaster runs tools/crawl.py.
Or submit a URL and he will add it to his list.
About AltaVisor | Help | Add/Remove URL |
Crawler Report | Top Searches | Translate
Disclaimer | Privacy Policy
Copyright © 1999 AltaVisor Company. All rights reserved.
