Because Search Engine Optimization (SEO) is an ever changing practice, it is absolutely necessary that we do SEO audits every once in a while. Audits like this can be time-consuming because it requires that you look at your website and backlinks with a fine-tooth comb.

Luckily, tools have been created to make this daunting task much easier. These tools are known in the industry as spiders. Spiders are programs that you can download onto your computer that will crawl your websites, images and apps to evaluate your onsite SEO.

The Screaming Frog SEO Spider is a tool created to audit your website, so you can do other things. It is extremely user-friendly, which is why it’s used by both amateurs and professionals.  To crawl your entire site with the Screaming Frog SEO Spider, follow these simple steps:

  1. List your URLs: Use the full URL (including http:// or https://) of the webpage or webpages you would like the Screaming Frog SEO Spider to crawl. These URLs will include the backlinks to your site. Copy and paste all of these URLs into a word document until needed in later steps.
  2. Configure the custom source code filter: Change the settings by clicking “configuration” and then selecting the “Custom” option. Then select “search.” This will allow you to customize your filter.
  3. Upload your URL list: In the toolbar you pulled up in the last step, click “mode” and then select the “list” option. Then, click “from a file” and upload the list you created in step 1. Once you have uploaded the list of URLs, click “OK”. Immediately, the SEO Spider tool will begin crawling your site.
  4. Review: Get the results in real time. As the spiders are crawling your site, you will be able to review the results. You will be able to view why some backlinks are no longer present. Contact us for Tampa SEO services.

Was this Screaming Frog SEO Spider guide helpful? Let us know in the comments below.