SEOSpyder is an application which allows you to easily scan, trace and analyse every single link on your website which makes it a quite powerful tool for dealing with 404s and any other type of errors and mistakes which would be punished by the web crawlers.
v1.1 [Dec 13, 2013]
What's new in new version:
- improved speed of crawling - between 5 or 10 times (or even more)
- added Rich Snipped support - you can now check site for presence of rich snippets - their type, value and content
- you can skip some kind of content - like images, styles or scripts
- you can instruct crawler to accept cookies or discard them
