Diagnosing Your Website Using Google’s Webmaster Tools

diagnostics - webmaster tools

diagnostics - webmaster tools

Google’s Webmaster Tools provides a set of diagnostics that enable you to make necessary repairs to your website.   The information covers issues like the presence of Malware, duplicate pages, missing links (404 errors) and suggestions re improvement in HTML.   So it seems the Google Bots are not so lazy after all!

Some of the information provided by Webmaster Tools gets very technical, so you may want to get your Webmaster to have a look at the diagnosis (or get a knowledgeable friend or family member to do so).   However,  you should be able to act on some of the information yourself and I will confine myself to a couple of these aspects.

Identifying and removing Malware

Webmaster Tools, as indicated in the above image, provides information about Malware that is affecting your website.  According to Malwarebytes, Malware represents 97% of all online threats.  Malware enables the perpetrator to steal your personal information (passwords, logins, etc) and disrupt your computer.  Malware includes computer invasions such as ‘viruses, worms, trojans, rootkits, dialers and spyware’.  Your Webmaster Tools will identify the threats and give you links for advice on how to remove these threats.  A better way to go is to be proactive and use a program that will detect, prevent and destroy malware.  The Anti-Malware program that I use and that is recommended by many technical experts (100 million downloads worldwide) is Malwarebytes.

If you take the opportunity to protect your website with an anti-malware program, then you will see the following message from Google’s Webmaster Tools (reported about my Small Business Odyssey site):

Google has not detected any malware on this site.

Clearing out duplicate webpages

The Webmaster Tools also advise other problems with your website that can be readily rectified.  One of these is where you have duplicate pages on your website.  Sometimes, you may have created a new version of an old page and accidentally left the old version on the website, resulting in duplication of the page.  This happened recently with the website for my own human resources business.  Google’s Webmaster Tools will advise you of this duplication under the ‘HTML suggestions’ menu item (see image above).  The duplicate pages I identified were listed under the sub-menu item, ‘Pages with duplicate meta descriptions’ (in other words, with substantially the same title).

Dealing with 404 errors – page not found

These ‘page not found’ errors (404) are reported under ‘Crawl errors’ (see image above – it means you’ve upset the Google Bots because they can’t find the webpage that was supposed to be present).  404 errors can occur because you have removed a page which is still showing in Google’s version of your sitemap or because the page you linked to no longer exists for some reason.  The Google Bots try to follow the links on your site and when they see a deadend, they report it as a 404 error. 

I recently found a series of 404 errors on the website for my human resource consultancy business as reported in Webmaster Tools.  These errors resulted from the fact that we had changed the default ‘permalink’ for the titles of our blog posts (changed from an auto-generated number to the title of our blog posts).  The result was the following type of errors reported in Webmaster Tools under ‘Crawl errors”:

Webmaster Tools

 

Webmaster Tools - 404

 

 

Where possible, you should clean up broken links and, where appropriate, resubmit your sitemap so that Google has a more up-to-date version to follow.

Through its Webmaster Tools, Google gives you a lot of information to help you to keep your website functioning  properly and to make it easy for the Google Bots to index your website effectively.

Do You Know How People Find Your Website on Google?

webmaster tools - menu

webmaster tools

 

Google’s Webmaster Tools (GWT) show you clearly how Internet users find your website through Google’s search results.  You can learn, for example, what search terms result in your site being displayed and which of these are the top queries for your website. 

Registering with Google Webmaster Tools and verifying your website

You need to visit Google’s Webmaster Tools site and sign in using your Google account.   This is the image you will see when you visit the site:

Google Webmaster Tools

Just click on the ‘Sign in to Webmaster Tools’ button and follow the instructions to enter username and password.  Once you are on the site, you will see a button, ‘ADD A SITE’ and you will be able to add the web address (URL) of your website.  

Before any results are reported, you will need to verify that you are the owner of the website.  Google Webmaster Tools explains how to do this and one of the options is to copy a verification file to your website (so that Google can check that you actually have Webmaster rights/access to the site you listed). 

Once you are verified, you will then need to be patient as Google takes some time to crawl your site and start reporting results.  I would give it a few days if you want to get anything meaningful.  The Google bots take holidays too – they don’t visit your site every day (unless your site is a really top ranked site or is updated daily and you let Google know about it).

What the Webmaster Tools tell you about how people find you in Google search results

Webmaster Tools provides information to show you how your site is seen on the web – it covers search queries, links to your site, keywords, internal links and subscriber statistics.  This information is accessible via the left hand menu:

 webmaster tools - menu

What I want to focus on in this post, is the ‘search queries’ information and its implications.   If you click on “search queries” in Webmaster Tools, you can find out valuable information about your website: 

  • Queries: the total number of different search queries in Google that resulted in your site being displayed; this is the number of search terms that generated a listing of your site in Google’s search results (for the period you specify). 
  • Query: a search term used by an Internet searcher that resulted in your website being listed in the Google search results; Google lists the top search terms (in descending order of frequency) that result in your website appearing in Google’s search results. 
  • Impressions:  the number of times one of your web pages appears in the Google search results for viewing by someone who searches on Google; Google gives you the total number of impressions ordered by query, along with the percentage change over the previous period.  
  • Clickthrough Rate (CTR): how many times your website impressions (appearances in Google’s search results) produced a click; Google expresses the clickthrough rate as a percentage (number of clicks as a percentage of number of impressions). 
  • Average Position: what position on the search results your website appeared at for a specified query; Google expresses this as an average position and shows the change in terms of ‘+’ or ‘–‘ the number of positions (improvements in position are shown in green). 

So through the Webmaster Tools you can learn the total number of Google ‘queries’ that resulted in your site being displayed.  You can establish what Google search queries were used to locate your site and which of these search terms generated the most traffic.  You can also establish which search terms resulted in the most clicks.   The other valuable piece of information is your average page rank for a particular query (which will impact heavily on your impressions and clickthrough rate). 

In the following diagram, I show how Google illustrates these results (this is the result over two days for my new site, a day after I registered the site on Webmaster Tools):

 

 webmaster tools - top queries

 

To access this representation of your search queries results, you click on ‘more’ at the end of your ‘query’ listing and the illustration will appear.  The image above is for ‘top queries’ and the illustration below is for ‘top pages’ (you can choose these options by using the tabs at the top left).

 webmaster tools - top pages

At the top on the left hand side, there is a button ‘Filters’ that allows you to set parameters for the displayed information, e.g. by geography.

Mining the riches of Webmaster Tools

There is a lot more to Google’s Webmaster Tools than at first meets the eye.  As you go deeper into this Google tool, you can find a rich store of information that can help your site get indexed better by Google, crawled more often by the Google bots, displayed more frequently in search results and visited more often – it’s up to you to tell Google what you want. 

In subsequent posts, I will explore some of the things that you can do based on other information that is available in Google’s Webmaster Tools:

  • What to do if you don’t like your search query results shown on Webmaster Tools
  • How to improve Google’s indexing of your targeted keywords
  • How to improve backlinking for your website
  • What to do to create more internal links
  • How to create and submit a sitemap
  • What to do about Google’s diagnosis of your website.

These topics alone demonstrate how important it is to use the Webmaster Tools  to understand how people find your site on Google and how Google actually ‘sees’ your site.