Website Crawler v0.1 (beta)

This tool will search a website and return a list of all pages linked internally and all external websites.

Note that the tool can take a while to run so please be patient. And don't be mischevious and run the tool on Google or Yahoo or Wikipedia.  For this reason, it'll only return the first 1000 results.  If you need a more in-depth report then please email me.

It currently doesn't handle http redirects and doesn't make any note of 310 redirects. This is something that will be addressed in future versions.

For feature requests, bug reports or anything else, email me at: gregor.spowart@massmediadesign.co.uk

Add to Delicious Add to Twitter Add to StumbleUpon Add to Google Add to Mixx Add to Facebook Add to Sphinn Add to Digg

Website URL:  
 

 

 

 

 

 

 

 

 

© Mass Media Design 2009 | Areas covered