Screaming Frog SEO Spider
Allows you to crawl websites’ URLs to analyse & audit technical & onsite SEO
Screaming Frog SEO Spider is a powerful analysis tool that can audit web sites from the point of view of SEO-optimization and point out various technical errors. The program not only displays the main resource indicators, such as citation index, number of external and internal links, but also pays attention to the page re-linking, determines the presence of "quick bots" from different search engines, and checks the correctness of robots.txt and .htaccess.In general, Screaming Frog SEO Spider frees the webmaster from many routine tasks.
The program can analyze individual pages, as well as perform a comprehensive analysis of the entire web resource with subdomains. For individual pages, Screaming Frog SEO Spider detects the presence of keywords, descriptions, errors in CSS styles, non-responding pages (4xx, 5xx errors), redirections (3xx), encoding problems, duplicate pages, layout problems, and even unnecessary markup. Correction of all the errors found by the program will definitely improve the ranking of the site and make it more perfect from the technical point of view.
Screaming Frog SEO Spider identifies and helps rectify SEO-related issues, enhancing website's visibility and ranking.
Screaming Frog SEO Spider has a separate section for each type of errors and defects. In general, the interface of this program is as pragmatic as possible. No unnecessary graphic elements - only lists with "dry" data. You can export the analysis results to CSV, XLS and XLSX files for a clearer view of the information. This is especially useful if you need to "manually" process a large number of errors or send a list for "processing" to another person.
- determination of the number of external references;
- checking the correctness of robots.txt and .htaccess;
- to create a map of the site;
- Search for missing headings, page descriptions and blank keyword fields;
- searching for unsuitable pages and redirects;
- display the site structure as a tree list;
- export lists in CSV, XLS or XLSX format;
- a simple and pragmatic interface.
PROS
Has customizable search features for better crawling control.
Offers integration with Google Analytics and Search Console.
CONS
Premium version is relatively expensive.
Requires significant system resources to run efficiently.
