Your browser does not support JavaScript!
A New Powerful SEO Spider
to find site issues you didn't know about before
Big WebSite Auditor update:
  • Lightning-fast site auditing
  • All resources checked: CSS, JS, images, videos, etc.
  • Crawling as Google, Bing, or Yahoo
  • Loads of advanced options for data geeks

Why do you need an SEO spider? Simply put, to find and audit all pages and resources on your site that search engines see, and detect issues that negatively affect crawling, rankings, and user experience. What do you get in an SEO spider? Half of that, if you're lucky. While most SEO tools will only parse your site's HTML, search engine bots can see a lot beyond that: JavaScript and CSS, images and videos, HTTP headers, etc. All these resources can affect load time and crawl budget, result in duplication issues and redirect chains… The list goes on and on.

Today's big WebSite Auditor update was designed with the somewhat challenging aim to let you, the SEO, see your site exactly the way search engines do, and make all that technical data actionable and easy to digest. Whether you're a small business owner and only run site audits once a month, or a technical SEO auditing dozens of client sites a day, this update will make your technical SEO routine easier and infinitely more effective than before.

A whole load of new WebSite Auditor features for noobs and techies alike.
Don't mind getting your hands dirty in the tech stuff? Here are some tweaks and use cases advanced SEOs will love.

This update took over 2 months to develop, and we can't wait for you to try it out. Our own tests helped us find as much as 20% more resources than other popular SEO spiders, combined. That's why we're positive that even the free version of the new WebSite Auditor will reveal more than a few site issues you've been overlooking — issues other tools wound't have found. Want a bet? ;) Just fire up the tool and create a new project (or rebuild an existing one) and see for yourself.

Site auditing that's quicker, simpler,
and truly comprehensive.
1 Audit all resources on your site

Search engines don't just look at your site's HTML; they also see your CSS, JavaScript, Flash, images, videos, PDFs, and other resources, internal and external. The new WebSite Auditor digs through your site just like search engine bots do, leaving no tag unturned, and helps you spot problems in all types of your site's resouces, not just HTML.

Where to find it: Under Site Structure > Site Audit and Site Structure > All Resources in your WebSite Auditor project.
2 See how your pages and resources interlink.

Found a problematic resource you'd like to look into? One click the full list of pages that use it, so fixing becomes a matter of minutes. Spotted a page that's too heavy or slow? View all resources used on it to find the culprit. Wondering how well-linked-to a page is? Examine all internal links to (and from) the page in another click.

Where to find it: Under Site Structure > All Resources and Site Structure > Pages.
3 See your site through Google's eyes.

Or Bing's, or Yahoo's, or any other bot's. With the new WebSite Auditor, you can choose to crawl any website following its robots.txt instructions, either for all spiders or any specific bot of your choice.

Where to find it: If you are creating a new project, check the Show expert options box at Step 1 and pick a bot. For an existing project, go to Preferences > Crawler Settings to do the same, and click Rebuild Project.
4 Crawl any site in minutes, not hours.

WebSite Auditor's spider didn't just get more powerful and thorough; it also got 5x faster. Even if you're crawling a large e-commerce site, the audit will now only take a few minutes; and of course, there's a separate setting so you can increase (or reduce) the crawling speed to your liking.

Where to find it: Under Preferences > Crawler Settings in the Speed tab.
5 Instantly audit all site's images.

Whenever you create or rebuild a project, WebSite Auditor will go through all images across your site to let you know if any of them are broken or have empty alt text tags, and show you a list of pages the problematic images are found on.

Where to find it: Under Site Structure > Site Audit, in the the Images section.
Review microdata and Open Graph markup.

With WebSite Auditor, you can now see which of your pages don't have structured data in place, the markup that's used by Google for Knowledge Graph listings, rich snippets, and local ranks. You can also check each page's Open Graph titles, descriptions, and images — this type of metadata is used in snippets when your pages are shared on social media.

Where to find it: In Site Structure > Pages, under the Sctructured Data Markup, OG Title, OG Image, OG Description columns.

Lots of in-depth options for the tech-savvy.
Customize everything.

There are plenty of ways you can customize WebSite Auditor's crawler:

  • Select a bot or user agent to crawl as;
  • Adjust crawl speed;
  • Use filters to only crawl pages with (or without) specific symbols in URLs;
  • Treat pages with certain URL parameters as different pages (or as the same page) and specify parameters to use or ignore.

The latter can be especially useful if you are auditing a CMS-powered site, which often create numerous versions of the same page with different parameters, thus confusing search engines, causing duplication issues, and wasting your crawl budget.

Where to find it: Under Preferences > Crawler Settings. For your customizations to be applied, click Rebuild Project.

Search for orphan pages.

WebSite Auditor lets you find pages that aren't linked to from other pages of your site, but do exist. They could be old pages you forgot to link to, pages missed in a site migration or redesign, or even a sign that your site has been hacked. You'll easily find these pages in your project by the Orphan Pages tag. If they are important pages that aren't linked to by mistake, you'd want to find them and start linking to them internally, to pass on some link juice and encourage search engines to crawl them more frequently.

Where to find it: If you are creating a project, check the Show expert options box at Step 1 and select Look for orphan pages. For an existing project, go to Preferences > Crawler Settings to do that, and click Rebuild Project.

Spot hidden issues.

WebSite Auditor now parses every HTML tag and header field of your pages to uncover issues other crawlers wouldn't find. These include everything from common HTML issues like empty "href" attributes for links or "src" attributes for images to the numerous <link> tags (often created automatically by the CMS), iframes, Google Analytics scripts, and social media sharing plugins.

Best of all, for every resource you find, you'll instantly see all pages that use it — so making sure you've got all the right scripts and elements on the right pages only takes a moment.

Where to find it: In Site Structure > All Resources, by clicking on a resource and inspecting the Found in column.

Mind your response headers.

WebSite Auditor parses not only the HTML of your pages, but also their HTTP response headers, which can be especially useful for professional SEO consultants. Here are a few examples:

  • The "Server" field can be important if you're looking to implement server-side redirects — different server types call for distinct kinds of redirection. E.g., an Apache server might require .htaccess edits, while an IIS server means you'd need to use the URL Rewrite Module.
  • "Link" is the header field used to indicate a certain type of relationship between the requested resource and other resources. Like the HTML <link> tag, this header field can be used to specify canonical URLs, hreflang, shortlinks, and many other link types that matter for SEO.
  • The "X-Robots-Tag" header field contains robots directives. If you've found a page that's not indexed and can't figure out why, this field can be the answer.

Where to find it: Under Site Structure > All Resources, by clicking on any resource and switching to Response header in the bottom part of the screen.

Audit redirects and canonicals.

You can now see the destination URLs of every redirect along with canonical URLs and meta refresh URLs in your WebSite Auditor workspace, which lets you quickly make sure each redirect and canonical is set up correctly and points to the right page, and find & fix doorway pages by removing the meta refresh.

Where to find it: Under Site Structure > Pages, by right-clicking the header of any column and adding the Redirect URL, Canonical URL, and Meta Refresh URL columns to your workspace.

A sure way to spot issues you've been overlooking.

After 2 months of working on this update non-stop, we do hope you're as excited as we are! Here's a little teaser: even if you just ran a site audit yesterday, with any tool, you're in for a surprise. Create a project for your site in the new WebSite Auditor, and you will almost definitely spot a bunch of issues you didn't know existed (but Google did).

Ready to put this to a test? If you already have the app installed, just fire it up — it'll automatically update upon launch. If you don't, download WebSite Auditor's free version below (it'll let you crawl up to 500 of any site's pages), or get a WebSite Auditor license for unlimited auditing (as always, your purchase will be covered by an unconditional 30-day money-back guarantee).

Happy crawling!

WebSite Auditor FREE
WebSite Auditor Professional
WebSite Auditor Enterprise