
Scan sites on the Internet and collect data on website links, images, CSS, scripts and apps to generate XML sitemaps in the program featuring a search and extraction engine with multiple filters by content type. Identification of redirected elements is possible.
Screaming Frog SEO Spider can help you crawl a website. The program can quickly analyze the structure of sites to provide various types of reports, which can be used to favor SEO positioning. Such elements as URL, page title, metadata, and headings can be exported to an Excel worksheet. Logically, the product is not intended for the general user; it is a great tool in the hands of web designers, though.
The program has a nice interface. Most of the results of the crawling are shown in tabular form in the main region of its window. There are two tabs between which you can switch to access page titles and meta description. Moreover, this information can be easily filtered to facilitate the analysis. A panel on the right shows summarized information about the site.
Screaming Frog SEO Spider lets you identify problems in the selected site. In this respect, it can efficiently find broken links as well as redirect links that lead to chains or loops. Similarly, you can use this program to discover excessively long page titles and meta descriptions, as well as omissions and duplicates. It is great the program can also create sitemaps, of which you can control the types of elements to include. Finally, the tool would not be complete if it could not connect to Google Analytics to download user data, which is essential to have a real grasp of the site’s usage.
All in all, Screaming Frog SEO Spider can definitely increase your productivity, mostly when you need to analyze the structure of large websites. The product has a free version, which is, regrettably, limited to 500 URLs only. It is pity that to avoid this limitation you need to purchase the full version, which can be unaffordable for some.
v11.3 [Jun 7, 2019]
- Added relative URL support for robots.txt redirects.
- Fix crash importing crawl file as a configuration file.
- Fix crash when clearing config in SERP mode
- Fix crash loading in configuration to perform JavaScript crawling on a platform that doesn’t support it.
- Fix crash creating images sitemap.
- Fix crash in right click remove in database mode.
- Fix crash in scheduling when editing tasks on Windows.
- Fix issue with Sitemap Hreflang data not being attached when uploading a sitemap in List mode.
- Fix configuration window too tall for small screens.
- Fix broken FDD HTML export.
- Fix unable to read sitemap with BOM when in Spider mode.